WO2022009356A1 - Système de surveillance - Google Patents

Système de surveillance Download PDF

Info

Publication number
WO2022009356A1
WO2022009356A1 PCT/JP2020/026772 JP2020026772W WO2022009356A1 WO 2022009356 A1 WO2022009356 A1 WO 2022009356A1 JP 2020026772 W JP2020026772 W JP 2020026772W WO 2022009356 A1 WO2022009356 A1 WO 2022009356A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
distribution
moving image
abnormality
monitoring system
Prior art date
Application number
PCT/JP2020/026772
Other languages
English (en)
Japanese (ja)
Inventor
光貴 岩村
守真 横田
剛久 三輪
康次 長谷川
孝之 小平
誠司 奥村
博文 西川
Original Assignee
三菱電機ビルテクノサービス株式会社
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機ビルテクノサービス株式会社, 三菱電機株式会社 filed Critical 三菱電機ビルテクノサービス株式会社
Priority to CN202080102698.1A priority Critical patent/CN115836516B/zh
Priority to JP2022528939A priority patent/JP7118322B2/ja
Priority to PCT/JP2020/026772 priority patent/WO2022009356A1/fr
Publication of WO2022009356A1 publication Critical patent/WO2022009356A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/10—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using wireless transmission systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M11/00—Telephonic communication systems specially adapted for combination with other electrical systems
    • H04M11/04—Telephonic communication systems specially adapted for combination with other electrical systems with alarm systems, e.g. fire, police or burglar alarm systems

Definitions

  • the present invention relates to a surveillance system using a camera.
  • the user confirms the abnormal situation by downloading and viewing the moving image from the URL contacted by the anomaly detection email received when the anomaly occurs. , It may take some time to confirm the abnormal condition.
  • the optimum data distribution method may not be selected depending on the content of the abnormal scene or the communication state of the mobile terminal, and the abnormal situation may not be confirmed promptly.
  • an object of the present invention is to provide a monitoring system that allows a user to quickly confirm an abnormal state.
  • the monitoring system of the present invention is an image analysis storage device that stores moving image data captured by a camera, analyzes the moving image data captured by the camera, and generates an alarm signal including an abnormality occurrence time when an abnormality is detected. , For the set time before and after the abnormality occurrence time in the moving image data stored in the image analysis storage device when communicating with the image analysis storage device and receiving the alarm signal from the image analysis storage device.
  • Communication device that receives moving image data as recorded moving image data from the image analysis storage device, communicates with the communication device, receives the recorded moving image data from the communication device, and abnormal state information based on the received recorded moving image data.
  • the server includes a server that distributes the data to the mobile terminal, and the server includes an image acquisition unit that acquires the recorded moving image data from the communication device, communication status data with the mobile terminal, the urgency of the abnormality, and the abnormality status.
  • the urgency of the abnormality is determined based on the distribution method selection map stored in association with the information distribution method and the recorded moving image data input from the image acquisition unit, and the determined urgency of the abnormality and the portable device are used.
  • a distribution method selection unit that selects a distribution method for the abnormal state information to be distributed to the mobile terminal based on the communication status data with the mobile terminal received from the terminal and the distribution method selection map, and a distribution method selection unit. It is characterized by including a distribution data generation unit that generates distribution data of the abnormal state information to be distributed to the mobile terminal based on the distribution method selected by.
  • the optimum data distribution method can be selected according to the content of the abnormal scene or the communication state of the mobile terminal, so that the user can quickly confirm the abnormal state.
  • the communication state data includes the communication speed with the mobile terminal and the radio wave intensity transmitted / received with the mobile terminal
  • the distribution method selection unit has the urgency of the abnormality and the communication speed.
  • the distribution method of the abnormal state information to be distributed to the mobile terminal may be selected based on the transmission / reception radio wave intensity and the distribution method selection map.
  • the optimum data distribution method can be selected according to the communication speed with the mobile terminal and the radio wave intensity transmitted / received with the mobile terminal, so that the user can confirm the abnormal state more quickly.
  • the distribution method selection unit indicates an abnormal state, such as full distribution of the recorded moving image data, partial distribution of the recorded moving image data, and distribution of at least one frame image data of the recorded moving image.
  • an abnormal state such as full distribution of the recorded moving image data, partial distribution of the recorded moving image data, and distribution of at least one frame image data of the recorded moving image.
  • One of the delivery method of the text data delivery and the delivery of the abnormality detection mail may be selected.
  • the entire recorded video data is distributed, the recorded video data is partially distributed, at least one frame image data of the recorded video is distributed, and the text data indicating the abnormal state is distributed.
  • the user can quickly confirm the abnormal state.
  • the occurrence of the abnormality can be promptly notified to the user by sending the abnormality detection mail.
  • the distribution method selection unit selects all distribution of the recorded moving image data
  • the feature to be confirmed by the user is the entire recording time of the recorded moving image.
  • a command for lengthening the set time before and after the abnormality occurrence time is output to the image analysis storage device via the communication device, and the set time is lengthened via the communication device.
  • the moving image data may be received from the image analysis storage device as the recorded moving image data.
  • the recorded video with the recorded video lengthened is lengthened. Since all of the data or low-quality data of the recorded moving image is distributed, the user can easily confirm the abnormal state without requesting the viewing of the moving image data again.
  • the partial distribution of the recorded moving image data includes the recorded moving image partial data distribution in which the recorded moving image data is edited so as to include the feature items to be confirmed by the user, and the recorded moving image partial data distribution.
  • the distribution method selection unit includes, when the user selects partial distribution of the recorded video data, including the recorded video low-quality data distribution that distributes the recorded video low-quality data in which the image quality of the recorded video data is deteriorated. If the feature to be confirmed is present only in a part of the recording time of the recorded video, the recorded video partial data distribution is selected, and if not, the recorded video low-quality data distribution is selected. You may.
  • the image acquisition unit is a case where the distribution method selection unit selects the recording video low-quality data distribution, and the feature to be confirmed by the user is the entire recording time of the recorded video.
  • a command for lengthening the set time before and after the abnormality occurrence time is output to the image analysis storage device via the communication device, and the set time is lengthened via the communication device.
  • the moving image data may be received from the image analysis storage device as the recorded moving image data.
  • the recorded video with the recorded video lengthened is lengthened. Since all of the data or low-quality data of the recorded moving image is distributed, the user can easily confirm the abnormal state without requesting the viewing of the moving image data again.
  • the distribution method selection unit selects all distribution of the recorded moving image data, and the above-mentioned.
  • the urgency of the abnormality is high and only one of the communication speed and the transmission / reception radio wave strength is high, partial distribution of the recorded moving image data is selected, and the urgency of the abnormality is high, but the communication speed is high. If both the transmitted / received radio wave strength and the transmitted / received radio wave strength are not high, the delivery of text data indicating an abnormal state may be selected.
  • the distribution method selection unit includes the feature items to be confirmed by the user when both the communication speed and the transmission / reception radio wave strength are high, when the urgency of the abnormality is not high. If delivery of at least one frame image of the moving image is selected and the urgency of the abnormality is not high and only one of the communication speed and the transmission / reception signal strength is high, the text data indicating the abnormal state is delivered. If the urgency of the abnormality is not high and both the communication speed and the transmission / reception radio wave strength are not high, the delivery of the abnormality detection mail may be selected.
  • the optimum data distribution method can be selected according to the communication speed with the mobile terminal and the radio wave intensity transmitted / received with the mobile terminal, so that the user can confirm the abnormal state more quickly.
  • the server includes a user database in which user attributes and a user's designated delivery method are stored in association with each other, and the delivery method selection unit is stored in the selected delivery method and the user database. If the designated distribution method of the user is not the same, the designated distribution method of the user may be output to the distribution data generation unit.
  • abnormal information can be distributed based on the user's designated distribution method, so that the usability of the monitoring system can be improved.
  • the mobile terminal may communicate with the server according to the abnormal state information received from the server, and may receive the recorded moving image data from the server.
  • the present invention can provide a monitoring system that allows a user to quickly confirm an abnormal state.
  • FIG. 1 It is a system diagram which shows the structure of the monitoring system of an embodiment. It is explanatory drawing which shows the moving image storage time of the 1st memory and the 2nd memory of the image storage part of the camera apparatus shown in FIG. It is explanatory drawing which shows the image analysis operation of the image analysis part of the monitoring system shown in FIG.
  • an abnormal state information is based on an image analysis storage device 10 including a camera 11, a communication device 30 for receiving recorded moving image data from the image analysis storage device 10, and recorded moving image data received from the communication device 30.
  • a server 40 that distributes the data to the mobile terminal 50.
  • the monitoring system 100 captures a moving image in the building by the camera 11, and based on this moving image, the monitoring system 100 monitors the occurrence of abnormalities in the building such as the intrusion of a suspicious person and the occurrence of a disaster.
  • the monitoring system 100 can also be applied to monitoring other buildings such as hospitals, schools, factories, etc., or outdoor events such as river water levels.
  • the image analysis storage device 10 is a device installed in the building to be monitored, and includes a plurality of cameras 11 for capturing a moving image inside the building to be monitored and a recorder 12 for storing the moving image data.
  • the camera 11 is a surveillance camera capable of capturing a moving image.
  • the recorder 12 has an image storage unit 13 connected to the camera 11 to store the moving image data captured by the camera 11 and an abnormality in the building by analyzing the moving image data captured by the camera 11 connected to the image storage unit 13. It includes an image analysis unit 16 that analyzes whether or not an abnormality has occurred, and an alarm signal generation unit 17 that receives an abnormality occurrence signal from the image analysis unit 16 and generates an alarm signal.
  • the recorder 12 is a computer composed of a CPU that internally performs arithmetic processing, data, and a storage device that stores programs, and the image storage unit 13, the image analysis unit 16, and the alarm signal generation unit 17 are programmed by the CPU. It is a functional block composed by executing.
  • the image storage unit 13 of the recorder 12 has two video data storage areas, a first memory 14 and a second memory 15.
  • the first memory 14 stores the long-term moving image data captured by the camera 11 for one day, several days, or one week while updating it. For example, when storing moving image data for one day, the moving image data from the present time to one day ago is saved in the first memory 14, and the moving image data before that is sequentially erased. The same applies when saving video data for several days or a week.
  • the moving image data stored in the first memory 14 contains the imaging time.
  • the second memory 15 sets the total of the pre-set time before a certain time t1 and the post-set time after the time t1 from the moving image data stored in the first memory 14.
  • the preset time is the time between the time t1 and the time t2 shown in FIG.
  • the post-set time is the time between the time t1 and the time t3 shown in FIG.
  • the set time is the total time of the pre-set time and the post-set time, and is the time between the time t2 and the time t3 shown in FIG.
  • the pre-set time and the post-set time may be, for example, 30 seconds, 1 minute, 5 minutes, or 10 minutes.
  • the image storage unit 13 is configured to be able to output the moving image data stored in the second memory 15 to the outside when the moving image request signal is input from the outside.
  • the pre-set time and the post-set time can be changed by an external command.
  • the image analysis unit 16 analyzes the moving image captured by the camera 11 and detects the occurrence of an abnormality.
  • the video analysis and abnormality detection will be briefly described by taking as an example the case where the camera 11 monitors the entrance door 22 of the building with reference to FIG.
  • the image analysis unit 16 stores an image of the entrance door 22 in a closed state as shown in FIG. 3A as a reference image of the entrance door 22 of the building. There is.
  • the image analysis unit 16 compares the moving image input from the camera 11 with the reference image shown in FIG. 3A, and if there is no difference between the two, it is determined that no abnormality has occurred.
  • a moving image in a state where the entrance door 22 is open is input from the camera 11 as shown in FIG. 3B, a difference occurs between this moving image and the reference image shown in FIG. 3A. In this way, when a difference occurs between the moving image input from the camera 11 and the reference image, the image analysis unit 16 determines that there is a possibility that an abnormality has occurred in the entrance door 22.
  • the image analysis unit 16 recognizes the person 25 coming in through the entrance door 22, as shown in FIG. 3 (b). Then, the clothes worn by the person 25 are compared with the uniform of the guard stored as a reference image in advance, and it is determined whether or not the person 25 is a guard. If the person 25 who entered through the entrance door 22 is a security guard, the image analysis unit 16 determines that the intrusion from the entrance door 22 has not occurred. On the other hand, if the person 25 who entered through the entrance door 22 is not a security guard, it is determined that the entrance door 22 has been invaded. Then, the fact that an abnormality has occurred is output to the alarm signal generation unit 17.
  • the alarm signal generation unit 17 When the alarm signal generation unit 17 receives the signal of occurrence of an abnormality from the image analysis unit 16, it generates an alarm signal including the time of occurrence of the abnormality.
  • the alarm signal is a signal composed of, for example, the type of abnormality such as "intrusion occurrence” and "A zone on the first floor", the location of occurrence of the abnormality, and the time of occurrence of the abnormality.
  • the type of abnormality for example, a code such as "0010" with four digits may be used.
  • the communication device 30 is a gateway device that connects the LAN line in the building to which the image analysis storage device 10 is connected and the remote communication network 35 in which security is ensured.
  • the communication device 30 communicates with the image analysis storage device 10 and receives an alarm signal from the image analysis storage device 10, the communication device 30 is included in the moving image data stored in the second memory 15 of the recorder 12 of the image analysis storage device 10.
  • the moving image data for the set time before and after the abnormality occurrence time is received as the recorded moving image data, and the received recorded moving image data is output to the server 40.
  • the mobile terminal 50 is a smartphone, tablet terminal, etc. owned by a building manager, owner, etc., who is a user of the monitoring system 100, and capable of sending / receiving e-mails, receiving / viewing image data, and the like.
  • the mobile terminal 50 may be located in a remote place away from the building to be monitored.
  • the server 40 communicates with the communication device 30, receives recorded moving image data from the communication device 30, and distributes abnormal state information to the mobile terminal 50 based on the received recorded moving image data.
  • the server 40 includes a communication unit 41, a terminal communication unit 42, an image acquisition unit 43, a distribution method selection unit 44, a distribution data generation unit 45, an image database 46, a user database 47, and a distribution method selection map 60. Contains each functional block of.
  • the general-purpose computer 150 includes a CPU 151 which is a processor that performs information processing, a ROM 152 and a RAM 153 that temporarily store data during information processing, and a hard disk drive that stores programs, user data, and the like. (HDD) 154, a mouse 155 provided as an input means, a keyboard 156, and a display 157 provided as a display device are included.
  • the CPU 151, the ROM 152, the RAM 153, and the HDD 154 are connected by a data bus 160.
  • the mouse 155, the keyboard 156, and the display 157 are connected to the data bus 160 via the input / output controller 158.
  • a network controller 159 provided as a communication means is connected to the data bus 160.
  • the communication unit 41, the terminal communication unit 42, the image acquisition unit 43, the distribution method selection unit 44, and the distribution data generation unit 45 of the server 40 cooperate with the hardware of the general-purpose computer 150 shown in FIG. 4 and the program running on the CPU 151. Is realized by.
  • the image database 46 and the user database 47 are realized by storing moving image data and user data in the HDD 154 of the general-purpose computer 150 shown in FIG. 4, respectively.
  • the distribution method selection map 60 is stored in the HDD 154 of the general-purpose computer 150 shown in FIG.
  • the communication unit 41 is connected to the remote communication network 35, and exchanges data with and from the image analysis storage device 10 via the communication device 30.
  • the terminal communication unit 42 is connected to the remote communication network 36 and exchanges data with and from the mobile terminal 50.
  • the image acquisition unit 43 acquires the recorded moving image data received from the communication device 30 by the communication unit 41 and stores it in the image database 46.
  • the distribution method selection unit 44 determines the urgency of the abnormality based on the recorded moving image data input from the image acquisition unit 43, and the determined abnormality urgency and the communication status data between the mobile terminal 50 and the mobile terminal 50 received from the mobile terminal 50.
  • the distribution method selection map 60 the distribution method of the abnormal state information to be distributed to the mobile terminal 50 is selected.
  • the distribution method selection map 60 is a map that stores the communication status data with the mobile terminal 50, the urgency of the abnormality, and the distribution method of the abnormal status information in association with each other, as shown in FIG.
  • the delivery method selection map 60 will be described in detail later.
  • the distribution data generation unit 45 generates distribution data of abnormal state information to be distributed to the mobile terminal 50 based on the distribution method selected by the distribution method selection unit 44, and outputs the distribution data to the terminal communication unit 42.
  • the image database 46 stores recorded moving image data received from the communication device 30 by the communication unit 41.
  • user attributes such as e-mail addresses, addresses, and telephone numbers of building managers and owners who are users of the monitoring system 100 are stored in association with the user's designated delivery method.
  • the designated distribution method is the same as the distribution method stored in the distribution method selection map 60 described later, that is, all distribution of recorded video data, partial distribution of recorded video data, distribution of frame images, and abnormal state. It may be the delivery of the text data shown, the delivery of the abnormality detection mail, or may include the delivery of the recorded video partial data and the delivery of the recorded video low-quality data, which will be described later. Further, other delivery methods may be stored as the designated delivery method.
  • the user can freely change the designated distribution method stored in the user database 47 by communicating with the server 40 on the mobile terminal 50.
  • the server 40 may be, for example, a server device on the cloud or a server device installed in a data center or the like in a remote place away from the building to be monitored, as long as it is connected to the network.
  • the distribution method selection map 60 is a map that stores the communication status data with the mobile terminal 50 in association with the urgency of the abnormality and the distribution method of the abnormal status information.
  • the communication status data includes the communication speed between the terminal communication unit 42 of the server 40 and the mobile terminal 50, and the transmission / reception radio field strength between the terminal communication unit 42 of the server 40 and the mobile terminal 50.
  • the distribution method selection map 60 is a matrix map that determines a distribution method to be selected according to the communication speed with the mobile terminal 50, the transmission / reception radio wave intensity with the mobile terminal 50, and the urgency of abnormality. ..
  • the distribution method 1 shows the distribution of all the recorded moving image data.
  • the distribution method 2 indicates partial distribution of recorded moving image data.
  • the distribution method 3 indicates distribution of at least one frame image of a recorded moving image including features to be confirmed by the user.
  • the delivery method 4 indicates delivery of text data indicating an abnormal state.
  • the delivery method 5 indicates delivery of an abnormality detection email.
  • the distribution method 1 is a distribution method in which all the recorded video data is distributed as the original data without degrading the image quality of the recorded image data acquired from the communication device 30.
  • the partial distribution of the recorded moving image data of the distribution method 2 is a distribution method of editing the recorded image data acquired from the communication device 30 and distributing a part of the original data.
  • Partial distribution of recorded video data includes distribution of recorded video partial data in which the recorded video data is edited so as to include features that the user should check, and recording in which the image quality of the recorded video data is reduced. Includes recording video low-quality data distribution that distributes video low-quality data.
  • the recorded moving image partial data may be, for example, moving image data obtained by extracting a moving image of several seconds before and after the time t1 shown in FIG. 3 from the recorded image data, or a moving image at the moment of the theft in the moving image data in which the theft occurred. It may be data or video data at the moment when the criminal's face is included.
  • the distribution of at least one frame image of the recorded video including the features to be confirmed by the user of the distribution method 3 is, for example, one or a plurality of frames from the video data of several seconds before and after the time t1 shown in FIG. 3 of the recorded image data. It also depends on the distribution of the extracted image. Further, a frame image during the theft in a video capturing the occurrence of the theft or a frame image including the face of the criminal may be distributed.
  • the distribution of the text data indicating the abnormal state of the distribution method 4 is, for example, the distribution of the text data indicating the abnormal state such as "a suspicious person has invaded" or "a fire has occurred. It is an emergency". Is.
  • the anomaly detection email of the delivery method 5 is, for example, a delivery method for transmitting an email with the text "abnormality detection".
  • the distribution method selection unit 44 when the distribution method selection unit 44 has a high degree of urgency of abnormality and both the communication speed and the transmission / reception radio wave strength are high, all of the recorded video data of the distribution method 1 is recorded. Select delivery. Further, when the distribution method selection unit 44 has a high degree of urgency of abnormality and only one of the communication speed and the transmission / reception radio wave strength is high, the distribution method selection unit 44 selects partial distribution of the recorded moving image data of the distribution method 2. Further, the distribution method selection unit 44 distributes when the urgency of the abnormality is high but both the communication speed and the transmission / reception signal strength are not high, that is, when both the communication speed or the transmission / reception signal strength are medium or low. Select the delivery of the text data indicating the abnormal state of the method 4.
  • the distribution method selection unit 44 determines that the communication speed and the transmission / reception radio wave strength are high when both the communication speed and the transmission / reception radio wave strength are high, that is, when the abnormality urgency is medium or low. If both are high, the user of the delivery method 3 selects delivery of at least one frame image of the recorded moving image including the features to be confirmed. Further, the distribution method selection unit 44 distributes text data indicating an abnormal state of the distribution method 4 when the urgency of the abnormality is medium or low and only one of the communication speed and the transmission / reception radio wave strength is high. Select. Further, the delivery method selection unit 44 selects delivery of the abnormality detection mail of the delivery method 5 when the urgency of the abnormality is medium or low and both the communication speed and the transmission / reception radio wave strength are medium or low. ..
  • the moving image data captured by the camera 11 is sent to the recorder 12.
  • the recorder 12 stores the moving image data received from the camera 11 in the first memory 14.
  • the image analysis unit 16 of the recorder 12 compares and analyzes the moving image data and the reference image data by the method as described above, and detects the occurrence of an abnormality. If the occurrence of an abnormality is not detected, the recorder 12 returns to step S101 of FIG. 7 and repeatedly executes the storage of the moving image data of the camera 11 and the detection operation of the occurrence of the abnormality.
  • the communication device 30 polls the recorder 12 as shown in step S201 of FIG. Polling may be performed once / minute, for example.
  • the image analysis unit 16 detects the occurrence of an abnormality in step S103 of FIG. 7, the image analysis unit 16 transmits the signal for detecting the occurrence of the abnormality to the alarm signal generation unit 17.
  • the alarm signal generation unit 17 generates an alarm signal composed of an abnormality type, an abnormality occurrence location, and an abnormality occurrence time based on the signal transmitted from the image analysis unit 16.
  • the recorder 12 After generating the alarm signal, the recorder 12 receives the poll from the communication device 30 as shown in step S105 of FIG. 7, and then the alarm signal generated by the alarm signal generation unit 17 as shown in step S106 of FIG. Is transmitted to the communication device 30.
  • step S202 of FIG. 8 the communication device 30 proceeds to step S203 of FIG. 8 after receiving the alarm signal from the recorder 12, and outputs the recorded moving image data request signal to the recorder 12.
  • the recorder 12 waits until the recorded moving image data request signal is received from the communication device 30. Then, when the recorder 12 receives the recorded moving image data request signal from the communication device 30, the abnormality occurrence time specified by the image analysis unit 16 among the image data stored in the first memory 14 is as shown in FIG.
  • the moving image data for the set time which is the total of the pre-set time and the post-set time, is written to the second memory 15 as the recorded moving image data. Then, as shown in step S108 of FIG. 7, the recorder 12 transmits the recorded moving image data written in the second memory 15 to the communication device 30.
  • the communication device 30 waits until the recorded video data is received from the recorder 12, and when the recorded video data is received, proceeds to step S205 of FIG. 8 to give an alarm signal to the server 40. To send.
  • the server 40 waits until the alarm signal is received from the communication device 30, and when the alarm signal is received, records the data to the communication device 30 as shown in step S302 of FIG. Send a video data request signal.
  • the communication device 30 waits until the recorded video data request signal from the server 40 is received, and after receiving the recorded video data request signal, proceeds to step S207 of FIG. 8 to record video data. To the server 40.
  • step S303 of FIG. 9 the image acquisition unit 43 of the server 40 waits until the recorded video data is received, and after receiving the recorded video data, proceeds to step S304 of FIG. 9 and records the video in the image database 46. Store and save data. Further, the image acquisition unit 43 outputs the recorded moving image data to the distribution method selection unit 44.
  • step S305 of FIG. 9 the terminal communication unit 42 of the server 40 acquires the communication speed with the mobile terminal 50 and the transmission / reception radio wave strength with the mobile terminal 50 and outputs them to the distribution method selection unit 44.
  • the distribution method selection unit 44 executes the distribution method selection process shown in FIGS. 10 and 11 in step S306 of FIG. 9, and outputs the image distribution method and the attached data to the distribution data generation unit 45.
  • the delivery method selection process will be described in detail later.
  • step S307 of FIG. 9 the distribution data generation unit 45 of the server 40 reads the recorded moving image data from the image database 46, and uses the distribution method and attached data input from the distribution method selection unit 44 to the mobile terminal 50.
  • the distribution data to be distributed is generated and output to the terminal communication unit 42. Then, the terminal communication unit 42 transmits the distribution data to the mobile terminal 50 in step S308 of FIG.
  • the terminal communication unit 42 waits until the recorded video data request signal is input from the mobile terminal 50 in step S309 of FIG. 9, and when the recorded video data request signal is input from the mobile terminal 50, the recorded video data request signal. Is output to the distribution method selection unit 44.
  • the distribution method selection unit 44 selects all distribution of the recorded moving image data as the distribution method, and outputs the distribution method and the attached data to the distribution data generation unit 45.
  • the distribution data generation unit 45 reads the recorded moving image data from the image database 46 and outputs it to the terminal communication unit 42 as distribution data.
  • the terminal communication unit 42 transmits the input recorded moving image data to the mobile terminal 50 in step S310 of FIG.
  • the distribution method selection unit 44 acquires recorded video data from the image acquisition unit 43 in step S401 of FIG. 10, and the communication speed from the terminal communication unit 42 to the mobile terminal 50 in step S402 of FIG. , Get the transmitted / received signal strength. Then, in step S403 of FIG. 10, the distribution method selection unit 44 determines the urgency of the abnormality from the recorded moving image.
  • the degree of urgency may be determined according to the degree of increase in the water level of the river.
  • the distribution method selection unit 44 proceeds to step S404 in FIG. 10 to select the distribution method of the abnormal state information based on the distribution method selection map 60 shown in FIG.
  • the distribution method selection unit 44 may determine high speed, medium speed, and low speed of the communication speed based on the line type with the mobile terminal 50. For example, when the type of the line is WiFi, 5G, 4G or the like, it may be determined as high speed, when it is 3G, it may be determined as medium speed, and when it is a telephone line, it may be determined as low speed. Further, the distribution method selection unit 44 acquires the current position information of the mobile terminal 50 from the mobile terminal 50, and determines the high intensity, medium intensity, and low intensity of the transmitted / received radio wave intensity based on the current position of the mobile terminal 50. May be good. For example, when the mobile terminal 50 is moving, it may be determined as medium strength, and when the mobile terminal 50 is underground, it may be determined as low intensity.
  • the distribution method selection unit 44 is based on the high-speed, medium-speed, and low-speed communication speeds, the high-intensity, medium-strength, and low-intensity of the transmitted / received radio wave strength, and the high, medium, and low urgency of the abnormality.
  • One delivery method is selected from the delivery method selection map 60 shown in FIG. As described above, for example, when the urgency of the abnormality is high and both the communication speed and the transmission / reception radio wave strength are high, the distribution method selection unit 44 selects all distribution of the recorded moving image data of the distribution method 1. Further, when the urgency of the abnormality is high and only one of the communication speed and the transmission / reception radio wave strength is high, the distribution method selection unit 44 selects partial distribution of the recorded moving image data of the distribution method 2.
  • the distribution method selection unit 44 proceeds to step S405 in FIG. 10 to determine whether or not partial distribution of the recorded video data has been selected. Then, if YES is determined in step S405 of FIG. 10, the process proceeds to step S406 of FIG. 10 to determine whether or not the feature items to be confirmed by the user exist only in a part of the recording time of the recorded moving image. For example, when the person 25 enters from the entrance door 22 described above, the intrusion operation of the person 25 from the entrance door 22 is recorded for a few seconds before and after the time t1 shown in FIG. , It is an image in a state where the entrance door 22 is closed, and after that, it may be an image in a state where the entrance door 22 is open.
  • the feature to be confirmed by the user is the intrusion operation of the person 25 from the entrance door 22 recorded only a few seconds before and after the time t1 shown in FIG.
  • the distribution method selection unit 44 determines YES in step S406 of FIG. 10, and proceeds to step S407 of FIG. 10 to select the recorded moving image partial data distribution.
  • the recorded video partial data distribution distributes the recorded video partial data in which the recorded video data is edited so as to include the feature items to be confirmed by the user.
  • the moving image data obtained by extracting the image of several seconds before and after the time t1 shown in FIG. 3 from the recorded image data becomes the recorded moving image partial data.
  • the distribution method selection unit 44 determines NO in step S406 of FIG. 10, the distribution method selection unit 44 proceeds to step S408 of FIG. 10 to select low-quality recorded video data distribution.
  • the recorded moving image low image quality data distribution the recorded moving image low image quality data for a set time in which the image quality of the recorded moving image data is deteriorated is distributed.
  • step S409 of FIG. 10 determines whether or not the feature items to be confirmed by the user are distributed over the entire recording time of the recorded moving image. do. If YES is determined in step S409 of FIG. 10, the process proceeds to step S410 of FIG. 10 to perform the set time extension process described later.
  • step S411 of FIG. 10 determines whether or not all the recorded moving images are selected for distribution. If YES is determined in step S411 of FIG. 10, and YES is determined in step S409 of FIG. 10, the procedure proceeds to step S410 of FIG. Perform time extension processing. The set time extension process will be described in detail later.
  • Step S412 of FIG. 11 is performed to read the user's designated distribution method from the user database 47. Then, in step S413 of FIG. 11, it is determined whether or not the distribution method previously selected in steps S401 to S411 and the designated distribution method of the user stored in the user database 47 are the same. If YES is determined in step S413 of FIG. 11, the process proceeds to step S414 of FIG. 11 and the distribution method previously selected in steps S401 to S411 is output to the distribution data generation unit 45. On the other hand, if NO is determined in step S413 of FIG. 11, the process proceeds to step S415 of FIG. 11 and the user's designated distribution method is output to the distribution data generation unit 45.
  • the distribution method selection unit 44 when the distribution method selection unit 44 outputs the recorded video partial data distribution to the distribution data generation unit 45, the distribution method selection unit 44 also outputs the data of the time to be extracted from the recorded video data as attached data.
  • the attached data is data of several seconds before and after the time t1 shown in FIG. 3 as the time for extracting the moving image data.
  • the distribution method selection unit 44 when the distribution method selection unit 44 outputs the recorded video low-quality data distribution, the image quality reduction degree of how much the image quality is reduced according to the communication speed with the mobile terminal 50 and the transmission / reception radio wave strength is determined. Output together as attached data.
  • the time data of the frame image extracted from the recorded moving image data is output together as attached data. Further, when the distribution of the text data indicating the abnormal state is output, the text data indicating the abnormal state is also output as attached data.
  • the distribution method selection unit 44 When the distribution method selection unit 44 outputs the image distribution method and the attached data to the distribution data generation unit 45, the distribution method selection process shown in step S306 of FIG. 9 ends.
  • the set time extension process shown in step S410 of FIG. 10 and the subsequent operation will be described.
  • the recorder 12 It is a process of lengthening the set time of and acquiring the video data for the lengthened set time as recorded video data.
  • the image acquisition unit 43 of the server 40 informs the image analysis storage device 10 via the communication device 30 of the preset time before or after the time when the abnormality occurs, or , Outputs a command to lengthen the post-set time.
  • the communication device 30 waits until the set time extension processing command from the image acquisition unit 43 is received. Upon receiving the set time extension processing command from the image acquisition unit 43, the communication device 30 proceeds to step S502 in FIG. 12 to extend either or both of the pre-set time and the post-set time of the recorder 12. Then, the communication device 30 outputs a recorded moving image data request for acquiring the recorded moving image data for the set time extended to the recorder 12 in step S503 of FIG.
  • the recorder 12 uses the video data for the extended set time among the image data stored in the first memory 14 as the recorded video data in the second memory as described above. Write to 15. Then, the recorder 12 transmits the recorded moving image data written in the second memory 15 to the communication device 30.
  • the communication device 30 waits until the recorded moving image data is received. Further, when the communication device 30 receives the recorded image data, as shown in step S505 of FIG. 12, the communication device 30 waits until the recorded moving image request signal from the image acquisition unit 43 of the server 40 is input. Then, when the recorded video request signal is input, the communication device 30 transmits the recorded video data for the set time extended to the image acquisition unit 43 of the server 40 as shown in step S506 of FIG.
  • the image acquisition unit 43 of the server 40 waits until the recorded image data is received in step S303 of FIG. 9, and then transfers the recorded moving image data to the image database 46 in steps S304 and S305 of FIG. While storing it, the terminal communication status data of the mobile terminal 50 is acquired. Then, the distribution method selection unit 44 of the server 40 executes the distribution method selection process as before. Then, when it is determined as NO in step S409 of FIG. 10, it is determined that all the feature items to be confirmed by the user are included in the recorded moving image data, and steps S412 to S414 and S415 of FIG. 11 are executed. Then, the distribution method and the attached data are output to the distribution data generation unit 45.
  • step S409 of FIG. 10 it is determined that some of the feature items to be confirmed by the user are not included in the recorded moving image data, and the set time is set until it is determined to be YES in FIG. Repeat the extension process.
  • the monitoring system 100 of the embodiment selectively selects and distributes the distribution method according to the communication speed with the mobile terminal 50, the transmission / reception radio wave strength with the mobile terminal 50, and the urgency of abnormality. Since the distribution data of the mobile terminal 50 is transmitted by the method, it is possible to reliably notify the user of the abnormal state by distributing the text data and the frame image data even when the communication speed is low or the transmission / reception radio wave strength is low. Further, when the communication speed and the transmission / reception radio wave strength are high, the user can easily understand the abnormal state by delivering a clear image to the user.
  • the monitoring system 100 distributes all the recorded video data, a part of the recorded video data, at least one frame image data of the recorded video, and text data indicating an abnormal state
  • the user can grasp the abnormal state from the delivered abnormal state information without downloading and viewing the moving image from the URL contacted by the abnormality detection mail as in the conventional monitoring system. Therefore, the user can quickly confirm the abnormal state. Further, when the urgency of the abnormality is low and the communication state with the mobile terminal is low, the occurrence of the abnormality can be promptly notified to the user by sending the abnormality detection mail.
  • the monitoring system 100 of the embodiment selects recorded video partial data distribution and recorded video low-quality data distribution according to the feature items to be confirmed by the user, extracts a part of the recorded video data, and distributes it to the user. .. As a result, the user can immediately confirm the feature items and can quickly confirm the abnormal state.
  • the monitoring system 100 performs a set time extension process when the feature items to be confirmed by the user are distributed over the entire recording time of the recorded moving image and the recording time of the recorded moving image data is considered to be short for the user. Since all of the recorded moving image data having a long recording time or low-quality data of the recorded moving image is distributed, the user can easily confirm the abnormal state without requesting the viewing of the moving image data again.
  • the monitoring system 100 of the embodiment allows the user to quickly confirm the abnormal state.
  • the feature to be confirmed by the user is the entire recording time of the recorded video.
  • the set time extension processing is performed, but this is not limited to this.
  • the recorded video data for the initially set time may be delivered as it is without performing the set time extension process, or the recorded video low-quality data in which the image quality of the recorded image data for the initially set time is reduced may be delivered. It may be delivered.
  • the mobile terminal 50 when the user's designated distribution method is not stored in the user database 47, the mobile terminal 50 is in an abnormal state due to the distribution method selected by the distribution method selection unit 44 without executing steps S412 to S415 in FIG. Information may be distributed.
  • the monitoring system 100 may stop the operation after the abnormal state information is delivered to the mobile terminal 50 without executing the steps S309 and S310 of FIG.
  • This operation process is an operation of transmitting the browsed moving image to the mobile terminal 50 when the monitoring system 100 user requests the viewing of the moving image captured by the camera 11 by designating the time by the mobile terminal 50.
  • the server 40 receives the viewing video request as shown in FIG. A viewing video request including a designated time is transmitted to the communication device 30.
  • the communication device 30 transmits a viewing video request to the recorder 12 of the image analysis storage device 10.
  • the recorder 12 that has received the viewing video request uses the video data for the set time before and after the specified time included in the viewing video request as the viewing video data in the second memory 15 among the video data stored in the first memory 14. And sends the viewing video data to the server 40 to the communication device 30.
  • the server 40 stores the received browsing video data in the image database 46, and transmits the browsing video data to the user's mobile terminal 50.
  • the user can receive the transmitted viewing video data and view the video for the set time before and after the time specified by the mobile terminal 50 from a remote location.
  • the monitoring system 100 does not have to include an operation of distributing the browsing video described with reference to FIG. 13 to the mobile terminal 50.
  • 10 image analysis storage device 11 camera, 12 recorder, 13 image storage unit, 14 first memory, 15 second memory, 16 image analysis unit, 17 alarm signal generation unit, 22 entrance door, 25 people, 30 communication device, 35 , 36 Remote communication network, 40 server, 41 communication unit, 42 terminal communication unit, 43 image acquisition unit, 44 distribution method selection unit, 45 distribution data generation unit, 46 image database, 47 user database, 50 mobile terminal, 60 distribution method Selection map, 100 monitoring system, 150 general purpose computer, 151 CPU, 152 ROM, 153 RAM, 154 HDD, 155 mouse, 156 keyboard, 157 display, 158 I / O controller, 159 network controller, 160 data bus.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Alarm Systems (AREA)

Abstract

La présente invention comprend : un dispositif de stockage d'analyse d'image (10) qui comprend une caméra (11); un dispositif de communication (30) qui reçoit, en provenance du dispositif de stockage d'analyse d'image (10), en tant que données vidéo enregistrées, des données vidéo pendant une quantité de temps établie avant et après l'instant auquel une anomalie s'est produite, lorsqu'un signal d'alarme est reçu en provenance du dispositif de stockage d'analyse d'image (10); et un serveur (40) qui reçoit les données vidéo enregistrées provenant du dispositif de communication (30), et transmet des informations d'état anormal à un terminal portable (50). Le serveur (40) comprend : une carte de sélection de procédé de transmission (60) qui stocke, en association les uns avec les autres, des données concernant l'état de communications avec le terminal portable (50), le degré d'urgence d'une anomalie, et un procédé de transmission d'informations d'état anormal; et une unité de sélection de procédé de transmission (44) qui détermine le degré d'urgence d'une anomalie sur la base des données vidéo enregistrées, et sélectionne un procédé de transmission pour transmettre les informations d'état anormal au terminal portable (50) sur la base du degré d'urgence déterminé de l'anomalie, des données d'état de communication reçues en provenance du terminal portable (50), et de la carte de sélection de procédé de transmission (60).
PCT/JP2020/026772 2020-07-09 2020-07-09 Système de surveillance WO2022009356A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202080102698.1A CN115836516B (zh) 2020-07-09 2020-07-09 监视系统
JP2022528939A JP7118322B2 (ja) 2020-07-09 2020-07-09 監視システム
PCT/JP2020/026772 WO2022009356A1 (fr) 2020-07-09 2020-07-09 Système de surveillance

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/026772 WO2022009356A1 (fr) 2020-07-09 2020-07-09 Système de surveillance

Publications (1)

Publication Number Publication Date
WO2022009356A1 true WO2022009356A1 (fr) 2022-01-13

Family

ID=79552398

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/026772 WO2022009356A1 (fr) 2020-07-09 2020-07-09 Système de surveillance

Country Status (3)

Country Link
JP (1) JP7118322B2 (fr)
CN (1) CN115836516B (fr)
WO (1) WO2022009356A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023175764A1 (fr) * 2022-03-16 2023-09-21 日本電気株式会社 Dispositif de traitement d'image, procédé de traitement d'image et support d'enregistrement
TWI840293B (zh) 2023-08-18 2024-04-21 合作金庫商業銀行股份有限公司 保管箱攝影畫面自動節錄系統及其方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006085500A1 (fr) * 2005-02-09 2006-08-17 Matsushita Electric Industrial Co., Ltd. Dispositif de caméra de surveillance, système de surveillance utilisant ledit dispositif, et procédé de transmission d’image de surveillance
JP6266184B1 (ja) * 2017-03-16 2018-01-24 三菱電機ビルテクノサービス株式会社 監視システム
JP2018101416A (ja) * 2016-12-21 2018-06-28 ホーチキ株式会社 火災監視システム

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017208391A1 (fr) * 2016-06-01 2017-12-07 三菱電機株式会社 Appareil et procédé de surveillance

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006085500A1 (fr) * 2005-02-09 2006-08-17 Matsushita Electric Industrial Co., Ltd. Dispositif de caméra de surveillance, système de surveillance utilisant ledit dispositif, et procédé de transmission d’image de surveillance
JP2018101416A (ja) * 2016-12-21 2018-06-28 ホーチキ株式会社 火災監視システム
JP6266184B1 (ja) * 2017-03-16 2018-01-24 三菱電機ビルテクノサービス株式会社 監視システム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023175764A1 (fr) * 2022-03-16 2023-09-21 日本電気株式会社 Dispositif de traitement d'image, procédé de traitement d'image et support d'enregistrement
TWI840293B (zh) 2023-08-18 2024-04-21 合作金庫商業銀行股份有限公司 保管箱攝影畫面自動節錄系統及其方法

Also Published As

Publication number Publication date
CN115836516B (zh) 2024-03-15
JP7118322B2 (ja) 2022-08-15
JPWO2022009356A1 (fr) 2022-01-13
CN115836516A (zh) 2023-03-21

Similar Documents

Publication Publication Date Title
US10123051B2 (en) Video analytics with pre-processing at the source end
JP6266184B1 (ja) 監視システム
KR100696728B1 (ko) 감시정보송신장치 및 감시정보송신방법
US7730534B2 (en) Enterprise video intelligence and analytics management system and method
US20110299835A1 (en) System and Method for Management of Surveillance Devices and Surveillance Footage
KR200433431Y1 (ko) 독립형 감시 시스템
US20240161592A1 (en) Proactive loss prevention system
JP5636205B2 (ja) 画像記録制御装置及び監視システム
JP6872963B2 (ja) 監視カメラシステム
JP3908707B2 (ja) 防犯監視システム、防犯監視方法、および、防犯監視プログラム
JP3942606B2 (ja) 変化検出装置
WO2022009356A1 (fr) Système de surveillance
US20190096153A1 (en) Smart digital door lock and method for controlling the same
JP2002230654A (ja) 遠隔監視システム
JP2004064276A (ja) 遠隔監視システム
US20100020177A1 (en) Apparatus for remotely, privately, and reliably monitoring a fixed or moving location, property or asset
JP2005094642A (ja) 監視カメラシステム
US20040008257A1 (en) Monitoring service process using communication network
CN113483760A (zh) 巡更监测方法及装置、电子设备及计算机可读存储介质
JP2005167382A (ja) 遠隔カメラ監視システムおよび遠隔カメラ監視方法
KR100950734B1 (ko) 댁내 경보시스템에서의 이상상태 자동인식방법 및 인터넷냉장고
KR200434039Y1 (ko) 중앙 집중형 감시 시스템
JP7212257B2 (ja) 監視システム、画像利用許諾方法、および画像利用許諾プログラム
KR101458365B1 (ko) 영상기기 보이스 알람 시스템 및 그 운용방법
JP2004145652A (ja) 監視装置および監視プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20944696

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022528939

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20944696

Country of ref document: EP

Kind code of ref document: A1