WO2021084612A1 - Digital safety response security system, method, and program - Google Patents

Abstract

Provided are a digital safety response security system, method, and program with which it is possible to prevent a situation in which an unpowerful warning to a suspicious person results in an intrusion. A digital safety response security system (1000) comprises: a time measurement unit (115) which starts to measure the elapse of time upon issuance of an emergency call; a person verification unit (116) which compares an image of a person present in a prescribed area associated with an automated locking device with images stored in a registered person/suspicious person/emergency helper information database (165); a warning unit (117) which makes an emergency call if a recognized person has stayed in the prescribed area for a prescribed period of time; and an unlocking unit 118 which unlocks the automated lock if the person verification unit (117) determines, within a third prescribed period of elapsed time (T3) as measured by the time measurement unit (116), that a person's image matches a stored image.

Description

Digital Safety Response Security Systems, Methods and Programs

The present invention relates to a digital safety response security system, a method and a program for performing crime prevention by photographing the inside of a security area with a surveillance camera.

Patent Document 1 describes that "the intrusion detection unit distinguishes the predetermined intrusion pattern according to the staying time of the subject in the predetermined area" (claim 4). The technique of Patent Document 1 relates to an intrusion deterrent device that deters an intruder on a road.

Non-Patent Document 1 describes that there are methods of "opening with a password" and "opening with an emergency unlock button" in order for police officers and the like to pass through the auto-lock door.

Japanese Unexamined Patent Publication No. 2015-022333

The devices described in Patent Document 1 and Non-Patent Document 1 merely give a warning in order to prevent intrusion into a predetermined area, and there is a problem that the warning to a suspicious person lacks power and allows intrusion. ..
In addition, there is a problem that it takes time for emergency supporters (police officers, etc.) to enter the building because of the auto lock.
An object of the present invention is to provide a digital safety response security system, method and program capable of preventing a warning to a suspicious person from being unpowered and allowing intrusion.

The digital safety response security system according to the present invention measures a person detecting means for detecting a person in a predetermined area in a security area and a time for a person detected by the person detecting means to stay in the predetermined area. From the stay period notification means that outputs the first notification signal by staying for the first predetermined period and further outputting the second notification signal by staying for the second predetermined period, and the stay period notification means. It is characterized by including a voice warning means that receives the first notification signal and gives a voice warning, and an image warning means that receives the second notification signal and gives an image warning from the stay period notification means.

With this configuration, it is possible to prevent the warning to a suspicious person from being unpowerful and allowing intrusion.

By providing the image warning means with the image warning and the reporting means for making an emergency call, it is possible to promptly notify an emergency supporter (police officer, etc.) and deal with a suspicious person.

An image saving means for saving an image of an emergency supporter, a time measuring means for measuring the passage of time after receiving an emergency call, an image of a person in a predetermined area related to an auto-lock device, and the image saving. The person collating means for collating the image stored in the means and the person collating means measure the time elapsed by the time measuring means within a third predetermined period, and the person collating means matches the image of the person with the stored image. By providing an unlocking means to unlock the auto lock in response to the judgment that the above matches, it is possible to prevent the emergency supporter from taking time to enter the building due to the auto lock. Can be done.

Since the emergency supporter is a police officer, paramedic, firefighter, or security company employee, the auto lock is unlocked by recognizing an image of the emergency supporter such as a police officer, paramedic, firefighter, or security company employee. can do.

The digital safety response security method according to the present invention measures a person detection step for detecting a person in a predetermined area in a security area and a time for a person detected by the person detecting means to stay in the predetermined area. From the stay period notification step of outputting the first notification signal by staying for the first predetermined period and further outputting the second notification signal by staying for the second predetermined period, and the stay period notification means. It is characterized by including a voice warning step of receiving the first notification signal and giving a voice warning, and an image warning step of receiving the second notification signal and giving an image warning from the stay period notification means.

In the present invention, the computer measures a person detecting means for detecting a person in a predetermined area in a security area and a time for a person detected by the person detecting means to stay in the predetermined area, and obtains a first predetermined value. The stay period notification means that outputs a first notification signal by staying for a period of time and further outputs a second notification signal by staying for a second predetermined period, and the first notification from the stay period notification means. It functions as a digital safety response security system including a voice warning means that receives a signal and gives a voice warning, and an image warning means that receives an image warning from the stay period notification means and gives an image warning. It is a program to make it.

According to the present invention, it is possible to prevent the warning to a suspicious person from being unpowerful and allowing intrusion. In addition, the auto-lock can prevent emergency supporters from having to enter the building.

It is a block diagram which shows the structure of the digital safety response security system which concerns on embodiment of this invention. It is a block diagram of the control part of the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows an example of the emergency support person information stored in the registrant / suspicious person / emergency support person information DB of the digital safety response security system which concerns on embodiment of this invention. It is a block diagram which shows the whole using the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows the safety response application operation of the digital safety response security system which concerns on embodiment of this invention. It is a flowchart which shows the digital safety response processing of the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows the example of the security in the private house of the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows the example of the security in the apartment house of the digital safety response security system which concerns on embodiment of this invention. It is a figure explaining the warning by the automatic voice and the remote dialogue function by the image, voice according to the position of the intruder of the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows the example of the intruder detection in the plane of the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows the example of the intruder detection in the elevation of the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows the example of the intruder verification by time of the digital safety response security system which concerns on embodiment of this invention. It is a figure which shows the example which the digital safety response security system which concerns on embodiment of this invention maps a site boundary to a camera image. It is a figure explaining an example of registering the height of the digital safety response security system which concerns on embodiment of this invention in advance in the site. It is a figure explaining the application example 1 of the intrusion detection by the digital safety response security system which concerns on embodiment of this invention. It is a figure explaining the application example 1 of the intrusion detection by the digital safety response security system which concerns on embodiment of this invention. It is a figure explaining the application example 1 of the intrusion detection by the digital safety response security system which concerns on embodiment of this invention. It is a figure explaining the application example 2 of the TV monitor of the digital safety response security system which concerns on embodiment of this invention, and the defense function by automatic voice. It is a figure explaining the application example 2 of the TV monitor of the digital safety response security system which concerns on embodiment of this invention, and the defense function by automatic voice.

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings.
(Embodiment)
FIG. 1 is a block diagram showing a configuration of a digital safety response security system according to an embodiment of the present invention.
This digital safety response security system is suitable for application to business establishments that require a high degree of management, such as residences, corporate offices, factories, research institutes, information processing rooms, and money collection rooms.

As shown in FIG. 1, the digital safety response security system 1000 includes a surveillance camera 11 (photographing means) installed in each of the security areas, a motion sensor 20, and Wi-Fi (Wi-Fi) installed in the security area. Controls the entire system, including the Wireless Fidelity terminal (hereinafter referred to as "Wi-Fi master unit") 30, the beacon master unit 40, and the mobile terminal device 50 (ID (Identification) terminal) carried by related parties (family members). It includes a monitoring device 100 and an AI (Artificial Intelligence) accelerator 200 (human detection means). The security area is a caution area (security target area), and includes, for example, a site, a front door and a balcony for a residence, and an elevator hall, a balcony and a window for an office.

Although the monitoring device 100 is installed in the security area, it may be installed outside via a network (not shown). When the monitoring device 100 is installed on a server on the network, a plurality of security areas can be monitored.

<Surveillance camera 11>
The surveillance camera 11 captures an image (two-dimensional) of the security area specified in two or three dimensions.
A part or all of the surveillance camera 11 is a PTZ camera having a PTZ (pan / tilt / zoom) function, and is remotely controlled by the surveillance device 100. The surveillance cameras 11 are installed around the outer wall of the security target building, for example, at the entrance / exit where an intruder can enter / exit, the window opening, the outer periphery of the site boundary, and the corresponding site area. The image taken by the surveillance camera 11 is output to the surveillance device 100 and recorded in the recording unit 160.

<Human sensor 20>
The motion sensor 20 is a thermo camera, an infrared camera, or the like, and detects the temperature of a sensing object in the security area to detect a suspicious person in the security area.

<Wi-Fi master unit 30>
The Wi-Fi master unit 30 uses Wi-Fi to exchange information with the Wi-Fi slave unit 51 of the mobile terminal device 50. Further, the Wi-Fi master unit 30 can acquire position information by Wi-Fi positioning, that is, can acquire position information using a Wi-Fi access point and a predetermined position information service.

<Beacon master unit 40>
The beacon master unit 40 is a BLE transmitter installed at a front door or the like and transmits a beacon signal containing an individual identification code by BLE (Bluetooth Low Energy).
BLE is a wireless technology that detects proximity. BLE is composed of a combination of a beacon master unit 40, which is a beacon device on the transmitting side, and an application of a mobile terminal device 50 (corresponding to the beacon slave unit 52 described later) that supports reception of radio waves from the beacon master unit 40. The BLE transmits unique ID information necessary for identification, and responds only to the application associated with the ID information of the mobile terminal device 50. The application of the mobile terminal device 50 registers the same identifier as the beacon master unit 40. The application (beacon slave unit 52) of the mobile terminal device 50 stands by in the background by executing an application equipped with a BLE function, and excites a predetermined action when approaching the beacon of the beacon master unit 40.

[Mobile terminal device 50]
The mobile terminal device 50 is carried by a person concerned (family member) or the like. The mobile terminal device 50 is, for example, a smartphone 50a, a tablet 50b, a notebook computer 50c, or the like. The mobile terminal device 50 is also a mobile phone, a PHS (Personal Handy-Phone System), a PDA (Personal Digital Assistants), a dedicated terminal, or the like. In the present embodiment, the mobile terminal device 50 can be used by related parties and the like in various places (that is, the current position), and a video including an e-mail or a moving image from the monitoring device 100 can be transmitted via a telephone line (not shown). It can be received.

In the present embodiment, the mobile terminal device 50 assumes the use of a smartphone 50a (ID terminal), and each individual can use it in various places (that is, the current position). One of the mobile terminal devices 50 is located at a security company (not shown).

The smartphone 50a has a digital safety response application (hereinafter referred to as "safety response application"). If the safety response application is started by the background processing of each application, for example, it goes through the communication carrier network (fixed network), the web service cloud 300 (see Fig. 4 below), or the Internet 303 (see Fig. 4 below). Then, the cloud server 301 (see FIG. 4 below) on the web service cloud 300 can be connected, and the telop about the suspicious person can be received from the cloud server 301. The smartphone 50a can notify a telop in which a suspicious person is detected on a standby screen or the like.

The smartphone 50a includes a Wi-Fi individual identification device (hereinafter referred to as "Wi-Fi slave unit") 51 and a GPS 53 that captures the positions of related parties.
The smartphone 50a may be provided with the beacon slave unit 52. Alternatively, the smartphone 50a may include any one of the Wi-Fi slave unit 51, the beacon slave unit 52, and the GPS 53.

<Wi-Fi handset 51>
The Wi-Fi slave unit 51 receives and individually identifies the radio waves of the Wi-Fi master unit 30 installed in the business facility. The monitoring device 100 stores the arrangement information of the Wi-Fi master unit 30 installed in the facility as safety-related information. When the Wi-Fi slave unit 51 approaches the Wi-Fi master unit 30, it is possible to determine the ID and position of the person who carries the mobile terminal device 50.

<Beacon handset 52>
The beacon slave unit 52 is an application of the mobile terminal device 50 that supports reception of radio waves from the beacon master unit 40. The beacon master unit 40 transmits a beacon (unique ID information necessary for identification), and the application (beacon slave unit 52) of the mobile terminal device 50 excites a predetermined action when approaching the beacon of the beacon master unit 40. To do.

<GPS53>
The GPS 53 receives radio waves of position information from GPS satellites and the like. The GPS 53 acquires the position information by calculating the current position information as three parameters of latitude, longitude and altitude from the information received via the GPS antenna. The acquired position information is timely transmitted to the monitoring device 100.

In the present embodiment, an example using GPS satellites is shown as a means for acquiring position information, but a method using a positional relationship with a base station other than GPS may also be used. For example, when an Android (registered trademark) smartphone or a high-performance mobile phone with a camera is used as the mobile terminal device 50, which is a mobile terminal, a base station and a mobile phone communication network (not shown) are used in place of or in combination with GPS53. It is also possible to send and receive information to and from the mobile phone company server via the mobile phone company and acquire the current location information of the own terminal from the proximity confirmation.

Further, location information acquisition by Wi-Fi positioning, that is, location information acquisition using a Wi-Fi access point and a predetermined location information service may be used.

[Monitoring device 100]
The monitoring device 100 is installed in the residence of a person concerned (for example, a family member) and centrally manages the security area. The monitoring device 100 may be a general server computer, a personal computer, or the like.

The monitoring device 100 includes a control unit 110, an input unit 120, a storage unit 130, a display unit 140, an output unit 150, a recording unit 160 (recording means), and a registrant / suspicious person / emergency supporter information DB 165. (Image storage means), an image processing unit 170, an interface (I / F) unit 180, and a communication unit 190 are provided, and each unit is connected by a bus 195.

After that, when the subject is described as "○○ part is", the control unit 110 shall read each program from the ROM as necessary, load it into the RAM, and execute each function (described later). Each program may be stored in the storage unit 130 in advance, or may be incorporated into the monitoring device 100 when necessary via another storage medium or communication medium.

The control unit 110 is composed of a CPU (Central Processing Unit) and the like, controls the entire monitoring device 100, executes a control program, and functions as a digital safety response security system. The detailed configuration of the control unit 110 will be described later.

The input unit 120 is an input device for the user of the monitoring device 100 to input instructions and the like, such as a keyboard, a mouse, a touch panel provided on the screen of the display unit 140, and a microphone.

The storage unit 130 includes memories such as ROM (ReadOnlyMemory), RAM (RandomAccessMemory), and EEPROM (ElectricallyErasableProgrammableRead-OnlyMemory), and stores various data and programs used by the control unit 110. The storage unit 130 stores still images or moving images received from the surveillance camera 11, various data and programs used by the control unit 110, and the like.

The display unit 140 displays the operating status of the monitoring device 100, the image received from the monitoring camera 11, the GUI (Graphical User Interface) for operating the monitoring device 100, and the like.

The output unit 150 is, for example, an audio interface, and outputs an audio signal from the monitoring device 100 to the sound system 158 in the security area. As the audio signal output from the monitoring device 100 to the acoustic system 158, for example, an audio signal input from an audio input device such as a microphone provided in the input unit 120, or data stored in the storage unit 130 is stored in the control unit 110. May be the reproduced audio signal. The sound system 158 includes an amplifier and a plurality of speakers arranged on the premises, and emits a signal input from the monitoring device 100 on the premises.

The recording unit 160 is composed of an external storage device such as an HDD (Hard Disk Drive), and records an image in the security area taken by the surveillance camera 11. The recording unit 160 records high image quality for a predetermined short time after shooting, converts it to low image quality after the predetermined short time elapses, and records for a predetermined long time.

The registrant / suspicious person / emergency supporter information DB 165 stores registrant information such as family members, guardians, managers, and visitors.
The registrant / suspicious person / emergency supporter information DB 165 stores the suspicious person information.
The registrant / suspicious person / emergency supporter information DB 165 is an image storage unit (image storage means) for storing emergency supporter information (see FIG. 3).

Even if a face information DB (not shown) is set up separately from the registrant / suspicious person / emergency supporter information DB 165 to accumulate face images (face information) of suspicious persons and store personnel. Good. Basic data such as the face of a person registered in this face information DB is obtained from a headquarters, a head office, a security company, etc. (not shown) via the I / F unit 180, and a face information DB is constructed. In addition, mutual face information DB can be updated to the latest face image (face information) by exchanging information with the headquarters, the head office, a security company, etc. (not shown).

Further, it is provided with an image correspondence DB (not shown) that stores each position in two dimensions of the image taken by the surveillance camera 11 and each position in the three-dimensional space taken by the surveillance camera 11 in association with each other. The control unit 110 stores the shape defined in the three-dimensional space in the image correspondence DB in association with each other by a projection transformation that projects the shape on the two-dimensional surface. The image-corresponding DB may use a part of the memory area of the storage unit 130.

The image processing unit 170 is composed of a DSP (Digital Signal Processor) or the like, and performs predetermined processing on the received image. Predetermined processing includes contour extraction, image resizing, resolution conversion processing, and the like.

When the image captured by the surveillance camera 11 in 1 second is, for example, a 5-frame image, the 1/5 second image, the 2/5 second image, the 3/5 second image, the 4/5 second image, and the 5/5 second image. In the case of 10 frames of images per second in motion, the size of the moving object can be known by inputting the outer shape line of the object in the motion of 10 images.
The image processing unit 170 processes the image data taken by the surveillance camera 11 and outputs the image in the security area.

The I / F unit 180 connects each surveillance camera 11 arranged in the security area with the surveillance device 100. Further, the I / F unit 180 is connected to a headquarters, a head office, a security company, etc. (not shown) by a network or a dedicated line.
The communication unit 190 transmits / receives data to / from the mobile terminal device 50 via the base station. The communication unit 190 has a wireless communication function, and is connected to a control board using, for example, USB (Universal Serial Bus).

[Control unit 110]
FIG. 2 is a block diagram of the control unit 110 of the digital safety response security system according to the embodiment of the present invention.
As shown in FIG. 2, the control unit 110 is configured by a CPU (Central Processing Unit) or the like, controls the entire monitoring device 100, executes a control program, and functions as a digital safety response security system.
The control unit 110 includes a person detection unit 111 (person detection means), a stay period notification unit 112 (stay period notification means), a voice warning unit 113 (voice warning means), and an image warning unit 114 (image warning means). A reporting unit 115 (reporting means), a time measuring unit 116 (time measuring means), a person collating unit 117 (person matching means), and an unlocking unit 118 (unlocking means) are provided.

The control unit 110 determines whether or not the person has the detected ID (Identification) terminal (mobile terminal device 50; smartphone 50a) (such as a person who has a predetermined ID such as a family member).

The control unit 110 excludes the person who possesses the detected ID terminal from the suspicious person.

The control unit 110 refers to the registrant / suspicious person / emergency supporter information DB 165, determines whether or not the person has the registered ID terminal (ID of the visitor, etc.), and determines whether or not the person has the registered ID terminal (ID of the visitor, etc.). Exclude people who have registered ID) from suspicious persons.

The control unit 110 determines the risk of intrusion based on the position of a person in the security area. For example, the risk of intrusion is determined based on where the intruder is on the security belts, the yellow belt Y, the orange belt O, and the red belt R (see the upper parts of FIGS. 8 to 9).

The control unit 110 gives a warning by voice or image according to the degree of danger.

The control unit 110 is based on the two-dimensional position of the person and the size of the person (particularly the size of the head of the person) detected by the person detection, and the three-dimensional space of the person by the image correspondence DB (not shown). Detect the position inside. Specifically, the control unit 110 reads the projected shape that has been defined and stored in advance as the shape projected in the three-dimensional space from the image correspondence DB. The control unit 110 performs the inverse transformation of the projection transformation that projects the shape defined in the three-dimensional space onto the two-dimensional plane based on the two-dimensional image of the person detected in the security area and the size of the person. The control unit 110 detects the three-dimensional position by performing the inverse transformation of the projection transformation from the image of one surveillance camera 11. In principle, it should not be possible to detect a 3D position in a 2D image, but it is assumed that the size of the person is known (assuming that there is almost no difference in the size of the head between people). The three-dimensional position can be detected based on the two-dimensional image taken by one surveillance camera 11 and the size information of the detected person.

The person detection unit 111 detects a person from the image taken by the surveillance camera 11 and detects the size of the person. Specifically, the person detection unit 111 detects a person in the security area using the AI accelerator 200 (described later). The person detection unit 111 issues a person detection request to the AI accelerator 200, and the AI accelerator 200 executes an AI calculation other than the CPU and transmits the person detection result to the person detection unit 111. Since high speed is required for human detection, the AI accelerator 200 is used for human detection.

The digital safety response security system 1000 detects an intruder in the security area by detecting a person using the AI accelerator 200.
The digital safety response security system 1000 is extremely high in deep learning by the AI accelerator 200, in particular, by targeting only people, as compared with image recognition by a conventional motion detection type surveillance camera using image difference. Intruder can be detected with high accuracy.

In the present embodiment, the person detection unit 111 detects a person by using the AI accelerator 200, but the person may be detected by a thermo camera (or a motion sensor 20). That is, the motion sensor 20 detects the temperature in the security area. Then, the human detection unit 111 detects the presence of a person (suspicious person candidate) by detecting the body temperature of the person by the motion sensor 20 and detecting the change in the captured image by the surveillance camera 11.

The person detection unit 111 may combine the person detection using the AI accelerator 200 and the person detection using the thermo camera (or motion sensor). For example, in the security area, AI accelerator 200 is used for the entrance, veranda, and windows where high speed of human detection is required, and the site of the boundary between the site and the outside where high speed of human detection is not required is a thermo. Use a camera (or motion sensor).

The stay period notification unit 112 measures the time that the person detected by the person detection unit 111 stays in the predetermined area, outputs the first notification signal N1 by staying at T1 for the first predetermined period, and further outputs the second notification signal N1. The second notification signal N2 is output by staying at T2 for a predetermined period of time.

The voice warning unit 113 receives the first notification signal N1 from the stay period notification unit 112 and gives a voice warning.

The image warning unit 114 receives a second notification signal N2 from the stay period notification unit 112 to give an image warning. The reporting unit 115 makes an emergency call with an image warning.

The reporting unit 115 warns the person detected by the person detecting unit 111 with a voice corresponding to the area, and also notifies the existence of a suspicious person. The reporting unit 115 does not report in the case of a person who has the detected ID terminal.

The time measurement unit 116 receives an emergency call and measures the passage of time thereafter.

The person collation unit 117 is an image of a person in a predetermined area associated with the auto-lock device 500 (see FIG. 15) and an emergency supporter stored in the registrant / suspicious person / emergency supporter information DB 165 (image storage means). Collate with the image (specifically, uniform).

The unlocking unit 118 receives that the person collation unit 117 determines that the image of the person and the stored image match within the third predetermined period T3 when the time elapsed measured by the time measuring unit 116 has elapsed. , Unlock the auto lock.

[AI Accelerator 200]
The AI accelerator 200 is a dedicated processor that detects a person, and uses a computing resource other than the CPU. The AI accelerator 200 is, for example, an accelerator for image processing by a processor enhanced with a GPU (Graphics Processing Unit) and signal processing using an FPGA (Field Programmable Gate Array). Further, the AI accelerator 200 executes the calculation of AI (Artificial Intelligence) on a dedicated hardware (for example, GPU).

In computer processing by a normal PC, it takes about 1.5 seconds to detect a person (human body) per digital image. Therefore, in the present embodiment, by using the AI accelerator 200, which is a human detection processor, the performance of the computer processing by the PC is about 10 times higher, and the intrusion detection is executed quickly. Further, in the present embodiment, the calculation of AI, which has a high calculation load, is left to the AI accelerator 200, which is a dedicated hardware. As a result, it was demonstrated that suspicious behavior can be detected in real time and suspicious persons can be registered even with a configuration using a commercially available camera and inexpensive equipment.

FIG. 3 is a diagram showing an example of emergency supporter information stored in the registrant / suspicious person / emergency supporter information DB 165.
As shown in FIG. 3, the registrant / suspicious person / emergency supporter information DB 165 contains an image of a police officer (see number 1651 in FIG. 3), an image of an emergency worker (see number 1652 in FIG. 3), and images of emergency supporters as emergency supporter information. Images of people wearing their respective uniforms (including caps) such as firefighter images (see number 1653 in FIG. 3) and images of security company employees (see number 1654 in FIG. 3) are stored.
The above is an example, and the registrant / suspicious person / emergency supporter information DB 165 stores images of a person wearing a plurality of types of uniforms corresponding to the emergency supporter.

[Digital Safety Response Security System]
FIG. 4 is a configuration diagram showing the whole using the digital safety response security system according to the embodiment of the present invention.
As shown in FIG. 4, the digital safety response security system 1000 actively cooperates with the cloud server (commercial server) 301 and the cloud server 301 that provide the digital safety response security service on the web service cloud 300. It has a Push notification server 302 that acquires information and notifies the user's smartphone 50a (mobile terminal device; ID terminal). The web service cloud 300 is connected to the Internet 303. The cloud server 301 is, for example, AWS (Amazon Web Services) (registered trademark).
The digital safety response security system 1000 is connected to the Internet 303 (see FIG. 15). The Internet 303 is connected to the Internet 303 by, for example, a VPN (Virtual Private Network).

The smartphone 50a can transmit texts and images to the cloud server 301 on the web service cloud 300 via the Internet 303. Further, the smartphone 50a receives the push notification from the push notification server 302 via the Internet 303. Further, the cloud server 301 and the push notification server 302 connect to the smartphone 50a equipped with the safety response application via a communication carrier network (fixed network) (see FIG. 15) such as an LTE / 4G / 5G network. ..

As shown in FIG. 4, the digital safety response security system 1000 detects an intrusion of a suspicious person into the premises and push-notifies the smartphone 50a owned by the person, his / her family, or the like.
When the user taps the notification that comes to the smartphone 50a, the safety response application is activated and the zoom screen of the suspicious person is displayed, and the telop "A suspicious person has been detected at the entrance on the 1st floor" is played. At the same time, the content is read aloud. In this way, the suspicious person is notified by the telop and voice on the screen of the smartphone 50a. Further, by the operation of the user of the smartphone 50a, for example, in an emergency, the related organizations (police, fire department) are notified. In this case, the security company and the head office of the affiliated company are also automatically notified. Also, if there is no urgency or if you want to confirm, only the security company will be notified.

[Safety response application operation]
FIG. 5 is a diagram showing the operation of the safety response application of the digital safety response security system according to the embodiment of the present invention.
As shown on the left side of FIG. 5, a telop that detects a suspicious person is notified on the standby screen or the like of the smartphone 50a. By tapping the user, as shown in FIG. 5, the display of the smartphone 50a is switched to the safety response application operation display, the zoom screen of the suspicious person is displayed, and the position and situation of the suspicious person "suspicious person at the entrance on the 1st floor" is displayed. indicate. In addition, this telop is read aloud by automatic voice. Further, by tapping the user, the display of the smartphone 50a is displayed on four time-series screens as shown on the right side of FIG.

Hereinafter, the operation of the digital safety response security system configured as described above will be described.
[Digital Safety Response Security Processing]
FIG. 6 is a flowchart showing digital safety response security processing. This flow is executed by the control unit 110 (see FIG. 2) of the monitoring device 100. This flow takes the case of a high-rise condominium in a high-rise building as an example.

In step S11, an image in the security area (specific area) specified in three dimensions is taken. The surveillance camera 11 is, for example, a PTZ camera, which is remotely controlled by the surveillance device 100. The image taken by the surveillance camera 11 is output to the surveillance device 100.
In step S12, the person detection unit 111 of the control unit 110 detects a person in a predetermined area within the security area.

In step S13, the person collation unit 117 of the control unit 110 identifies whether or not the person photographed by the surveillance camera 11 is a suspicious person. In the present embodiment, the person matching unit 117 requests the AI accelerator 200 to track a person by AI, and the person matching unit 117 waits for the result of tracking a person from the AI accelerator 200. In addition, the person collation unit 117 tentatively identifies a person who does not have an ID terminal or an identification number card registered in advance in the registrant / suspicious person / emergency supporter information DB 165 as a suspicious person.

When the suspicious person is recognized (step S13: Yes), the control unit 110 acquires the detailed information of the suspicious person (intruder) in step S14. The suspicious person detailed information is the history information of the suspicious person registered in the registrant / suspicious person / emergency supporter information DB 165 and the image (including moving image) information of the suspicious person taken by the surveillance camera 11.
If it is not recognized as a suspicious person (step S13: No), the process of this flow ends.

In step S15, the stay period notification unit 112 of the control unit 110 measures the time during which the person detected by the person detection unit 111 stays in the predetermined area. The stay period notification unit 112 receives a first notification signal N when a person (suspicious person) stays in a predetermined area (for example, the red belt R in FIG. 7 described later) for a first predetermined period (T1, for example, 10 seconds). (Notification signal) 1 is output, and the second notification signal N2 is output by staying for a second predetermined period (T2, for example, 20 to 30 seconds).

In step S16, the voice warning unit 113 of the control unit 110 receives the first notification signal N1 from the stay period notification unit 112 and gives a voice warning. That is, the voice warning unit 113 gives a voice warning to the suspicious person by the sound system 158 (see FIG. 1) in response to the suspicious person staying in the predetermined area for the first predetermined period (T1). The voice warning may be a speaker installed in the surveillance camera 11 (see speaker 12 in FIG. 15 below) or a speaker of a TV monitor (see TV monitor 13 in FIG. 18 below).

In step S17, the image warning unit 114 of the control unit 110 receives the second notification signal N2 from the stay period notification unit 112 and gives an image warning. That is, in response to further staying for the second predetermined period (T2), the image warning unit 114 photographs the suspicious person, for example, on the TV monitor 13 display screen that the suspicious person can see. Display the image you are shooting.

In step S18, the reporting unit 115 of the control unit 110 makes an emergency call (such as dialing 110) together with an image warning when the reporting function for staying in the second predetermined period (T2) is set.

Here, the emergency call to be made together with the image warning may be set to execute the emergency call after a predetermined period after the image warning, instead of simultaneously performing this emergency call with the image warning. In addition, an emergency call may be provided in a time stage, such as first reporting to a person concerned, a security company, or the like, and then reporting to the police or fire department. By doing so, the reliability of the emergency call can be improved by preventing the emergency call from being made when the suspicious person moves out immediately after receiving the image warning (such as when the need for an emergency call is reduced). Can be enhanced.

There are two types of emergency calls: one is that this system makes a report, and the other is that this system notifies the concerned parties and the related parties make a report.

By the process up to step S18, it is possible to prevent the warning to the suspicious person from being lacking in power and allowing intrusion.

In step S19, the time measuring unit 116 of the control unit 110 measures the passage of time after receiving the emergency call from the reporting unit 115.

In step S20, the person collation unit 117 of the control unit 110 includes an image of a person in a predetermined area associated with the auto-lock device and an image stored in the registrant / suspicious person / emergency supporter information DB 165 (image storage means). To match.

In step S21, the control unit 110 determines whether or not the time elapsed measured by the time measuring unit 116 has elapsed a third predetermined period (T3, for example, 30 minutes).

When the time elapsed measured by the time measuring unit 116 has passed the third predetermined period (T3) (step S21: Yes), the processing of this flow is terminated.

The third predetermined period (T3) is the emergency response time until the emergency supporter rushes to the site after receiving the emergency call. By setting this emergency response time, the start point (immediately after the emergency call) and the end point (expiration of the third predetermined period T3) of the monitoring control period are clarified, the reliability of this process is improved, and the process of this system is effective. Aim. That is, even if it is determined that the image collations match a little loosely, the emergency supporter can be accurately recognized as a result because the determination is made only for a predetermined period in which the emergency supporter is expected to pass.

When the time elapsed measured by the time measuring unit 116 is within the third predetermined period (T3) (step S21: No), the person collating unit 117 of the control unit 110 registers with the image of the person in the predetermined area in step S22. It is determined whether or not the image of the emergency supporter stored in the person / suspicious person / emergency supporter information DB165 matches.

When the image of the person and the image of the stored emergency supporter match (step S22: Yes), the unlocking unit 118 of the control unit 110 automatically sets the unlocking signal for unlocking the auto lock in step S23. Output to the lock device 500 (see FIG. 15). That is, this system unlocks the auto lock by outputting the unlock signal to the auto lock device 500.
If the image of the person and the image of the emergency supporter stored in step S22 do not match (step S22: No), the process returns to step S21.

In this way, in this system, when the image of the person and the image of the stored emergency supporter match within the third predetermined period (T3) when the measurement is started in response to the emergency call, This system unlocks the auto lock.

In the processes of steps S19 to S23 above, it is possible to prevent the emergency supporter from taking time to enter the building due to the auto lock.

In the present embodiment, the auto lock is unlocked by the image recognition (steps S15 to S18) of the emergency supporter after the emergency call, which is performed together with the voice warning and the image warning. Anything may have a process of recognizing a supporter as an image and unlocking the auto lock (steps S19 to S22), and the processes of steps S15 to S18 are not essential. That is, the process of recognizing the image of the emergency supporter and unlocking the auto lock (steps S19 to S22) may be independently executed in a predetermined period after the emergency call.

[Security example of digital safety response security system]
An example of security for a digital safety response security system will be described.
<Home &Building>
FIG. 7 is a diagram showing an example of security in a private house.
The digital safety response security system provides not only individual housing but also security systems for apartments, offices, stores, research institutes, information materials rooms, and financial institutions. The main functions are as follows.
A security mode (home security, outing security, etc.) is defined, and a security function is provided according to the security mode.
It has a function to change the security mode depending on the time.
An intruder is detected and registered from the image of the surveillance camera 11 installed around the outside of the house.
The detected intruder's risk level (caution level, urgency level) is determined, and the user is notified according to the risk level (caution level, urgency level).
The security mode is changed from the outdoors by the smartphone 50a.
A warning is notified to an intruder through the microphone of the smartphone 50a and the speaker of the surveillance camera 11.

FIG. 8 is a diagram showing an example of security in an apartment house.
For example, it provides a security system for apartment houses. The main functions are as follows.
Define a security mode and provide security functions according to the security mode.
It has a function to change the security mode depending on the time.
An intruder is detected and registered from the image of the surveillance camera 11 installed on the outer periphery of the living area.
The detected intruder's risk level (caution level, urgency level) is determined, and the user is notified according to the risk level (caution level, urgency level).
The security mode is changed from the outdoors by the smartphone 50a.
A warning is notified to an intruder through the microphone of the smartphone 50a and the speaker of the surveillance camera 11.

[Automatic voice warning according to people in the security area]
FIG. 9 is a diagram for explaining a warning by automatic voice and a remote dialogue function by image / voice according to the position of an intruder. FIG. 9 shows an "automatic voice warning" of the Digital Safety Response Security System 1000. FIG. 9 shows a “doorphone type dialogue system” for explanation in comparison with the “automatic voice warning” of the digital safety response security system 1000 on FIG. 9, and FIG. 9 bottom shows a “security camera type dialogue”. Indicates "system".

As shown in FIG. 9, the "doorphone type dialogue system" conducts two-way dialogue between the visitor and the guardian by the doorphone by image and voice. Alternatively, the "doorphone type dialogue system" executes a smartphone dialogue application of a mobile terminal (smartphone 50a) carried by a guardian via a cloud dialogue relay system to perform two-way dialogue by image and voice.

As shown in the lower part of FIG. 9, the "security camera type dialogue system" captures and collects sound of an intruder with a security camera equipped with a microphone, and the family engages in two-way dialogue with the intruder by image and voice. Alternatively, the "security camera-type dialogue system" executes a smartphone dialogue application of a mobile terminal carried by a family member via a cloud dialogue relay system to perform two-way dialogue by speaker voice.

With respect to these dialogue systems, the digital safety response security system 1000 accurately positions the position of an intruder who has invaded the security area as X, Y, and Z coordinates based on the image of the camera. Then, the digital safety response security system 1000 determines that there is a person in the security area and warns with a voice according to the degree of danger (for example, according to the yellow belt Y, the orange belt O, and the red belt R). ..
In the above example of FIG. 9, it is determined that the intruder is on the yellow belt Y, the orange belt O, and the red belt R, and an automatic voice warning is given by sending an automatic voice message according to the degree of danger or the situation. Details will be described later in the flow of FIG.
The digital safety response security system 1000 can accurately position the position of an intruder who has invaded the security area as X, Y, and Z coordinates based on the image of the camera.

[Characteristics of Digital Safety Response Security]
Next, the features of the digital safety response security system will be described.

The digital safety response security system 1000 has a technology for determining intrusion in a plane, a technology for determining intrusion in an elevation, and a technology for detecting intrusion in a plane or an elevation as a site intrusion detection and registration function. , Use one or a combination of techniques to verify intrusion over time. Hereinafter, a detailed description will be given.

To detect a suspicious person, first determine from the camera image whether a human has invaded the premises. After this judgment, it is verified whether the person is a suspicious person and registered / notified.

The warning area is inspected in 2D, 3D, and 4D (3D + time), and the degree of risk is evaluated and registered.

The area within the boundary of the site is categorized into the following three according to the degree of risk.
・ Yellow belt Y: For example, 30 cm to 4 m inside the boundary of the site
・ Orange belt O: Between yellow belt Y and red belt R ・ Red belt R: For example, 30 cm to 4 m from the wall surface of the house

<About the security belt>
The yellow belt Y (hereinafter referred to as Y in the figure) is in the state of early warning level. Intrusion into this part is notified with a yellow risk, but by adding 3D and 4D additional information and verifying, and notifying if there is an intrusion as a result of verification, detection accuracy and early It becomes possible to deal with. In addition, the red belt R (hereinafter, indicated by R in the figure) is a level at which it is necessary to immediately notify when there is an intrusion into the area.

<Detection on a plane>
FIG. 10 is a diagram showing an example of intruder detection on a plane, in which the left side of FIG. 10 shows a normal state in a plane and the right side of FIG. 10 shows an abnormal state in a plane.
As shown on the left side of FIG. 10, a yellow belt Y is set inside the boundary of the site, and a red belt R is set so as to surround the wall surface of the house having the entrance door and the window with the orange belt O which is the security zone sandwiched. ..
The right side of FIG. 10 shows an abnormal state in a plane. An intruder has invaded beyond the yellow belt Y to the outside of the red belt R.

In the intruder detection on the plane, the inclusion relationship between the intruder and the boundary is evaluated. For example, as shown by the symbol a on the right side of FIG. 10, if the surveillance camera 11 shoots at 10 frames / second, an intruded moving object is detected from the images of 10 frames (see the frame on the right side of FIG. 10). Calculate its position on the plane. If the intruder is certainly detected within the 10 frames (5 frames for a surveillance camera with 5 frames per second), it is determined that the intruder may exist.

<Detection on elevation>
FIG. 11 is a diagram showing an example of intruder detection on an elevation, in which the left side of FIG. 11 shows a normal state on an elevation surface and the right side of FIG. 11 shows an abnormal state on an elevation surface.
As shown on the left side of FIG. 11, a yellow belt Y is set inside the boundary of the site, and a red belt R is set so as to surround the wall surface of the house with the orange belt O sandwiched between them.
In the detection on the elevation, the height (see the frame on the right side of FIG. 11) is evaluated from the image of the surveillance camera 11. Evaluate whether this height is a standard human height. For example, as shown by reference numeral b on the right side of FIG. 11, the number of images per second of the surveillance camera 11 is evaluated, and it is certainly determined that the intruder is a human being. In the example of FIG. 11, it is detected that an intruder invades beyond the yellow belt Y.
By detecting an intruder on an elevation, it is possible to eliminate the invasion of animals and the false detection of movement due to the wind of planting.

<Verification by time>
FIG. 12 is a diagram showing an example of intruder verification by time, in which the left side of FIG. 12 shows a normal state in time and the right side of FIG. 12 shows an abnormal state in time.
As shown by the reference numeral c on the right side of FIG. 12, the digital safety response security system 1000 repeats the evaluation every second for the detection of the intruder obtained by the intruder detection on the elevation. As shown on the right side of FIG. 12, the intruder is walking on the yellow belt Y. The digital safety response security system 1000 determines that the intruder has certainly invaded after the intruder has been continuously detected on the yellow belt Y.

<Technology for determining intrusion from an elevation: Mapping>
A technique for determining intrusion in an elevational manner will be described.
As a technique for determining intrusion from an elevation, the plane layout information of the site boundary is mapped to the camera image.
FIG. 13 is a diagram showing an example of mapping the site boundary to the camera image, FIG. 13 left is a plan view of the site boundary, and FIG. 13 right is an example of mapping the site boundary to the camera image. Mapping is a technique for synthesizing an image generated by CG (Computer Graphics) with a photographic image. When compositing, the CG can be naturally superimposed and composited on the photographic image by making the background portion of the CG transparent.

As shown on the left side of FIG. 13, when installing a surveillance camera (see the x mark on the left side of FIG. 13), a caution area (home site, office of high-rise complex building, front porch of apartment building, boundary of corridor, etc.) Create an accurate plan view of the outline shape). It also gives the installation position, height and orientation (roll, pitch, yaw information) of the surveillance camera. The roll, pitch, and yaw represent the angle of rotation of the line of sight in a three-dimensional space. Assuming that the line-of-sight direction is the X-axis, the left-hand direction perpendicular to it is the Y-axis, and the upward direction of the viewpoint is the Z-axis, the rotation around the X-axis is called roll, the rotation around the Y-axis is called pitch, and the rotation around the Z-axis is called yaw.

The right side of FIG. 13 shows an example of mapping the image of the surveillance camera of the reference numeral d on the left side of FIG.
The position information of the caution area is subjected to projection transformation and clipping by the viewport from the parameters of the camera, and the part of the image obtained from the surveillance camera is obtained on the site (see the right side of FIG. 13). The viewport represents a two-dimensional limit when recognizing a three-dimensional space as two-dimensional. This corresponds to the range that appears in the picture when the picture is taken with a surveillance camera. The viewport represents the range that can be captured by the surveillance camera. Further, the clipping refers to a process of cutting out an object such as computer graphics represented by three-dimensional data to the size of a viewport.

<Technology for determining intrusion from an elevation: size comparison with a pre-registered object>
The height of the gate, the height of the car, the height of the vegetation, and the height of the person in the site, the office such as the concept complex building, the front porch of the apartment house, and the corridor, which are the mapped security areas. Compare (known person sizes such as head size, upright height, crouching height, etc.).

FIG. 14 is a diagram illustrating an example of registering the height of something that is in advance on the site.
As shown in FIG. 14, the height of the gate, the height of the car, and the height of the vegetation in the site, which is the mapped security area, are registered. In addition, the standard size that a person has, that is, the height of the person (the size of a known person such as the size of the head, the height of standing upright, the height of crouching, etc.) is an image-compatible DB (not shown). Remember in advance. When a person invades, a person has a human height other than the height of the gate, the height of the car, and the height of the vegetation in the site, which is a pre-registered security area. The intruder (see the frame of FIG. 14) is determined by the image of.

[Application example]
An application example of intrusion detection by a digital safety response security system will be described.
<Application example 1>
15 to 17 are views for explaining application example 1 of intrusion detection by the digital safety response security system 1000.
FIG. 15 is a diagram illustrating an automatic door release command by remote control of the digital safety response security system 1000.
As shown in FIG. 15, the surveillance camera 11 and the speaker 12 are connected to the monitoring device 100 of the digital safety response security system 1000 via the LAN cable 501. The surveillance camera 11 and the speaker 12 are installed at the entrance of each house / room of the building. The speaker 12 interlocks with this system to play an automatic voice of attention and voice.

The monitoring device 100 monitors the area of the common area and issues an abnormality alarm. Specifically, when a suspicious person stays in this area for a first predetermined period of time T1, the first notification signal N1 is output, and when the suspicious person stays in this area for a second predetermined period of T2, a second notification signal N2 is output. To do. This system gives a voice warning to the speaker 12 during the first predetermined period T1 stay, and displays a zoomed-up image of the suspicious person on the TV monitor display screen or the like during the second predetermined period T2 stay. Image warning. In addition, during this second predetermined period of stay in T2, an emergency call (such as dialing 110) and an emergency alert are transmitted to the smartphones 50a of the persons concerned together with an image warning.
The emergency call (110th call, etc.) to be executed together with the image warning during the second predetermined period of stay in T2 may be set to execute the emergency call after the predetermined period after the image warning, instead of simultaneously with the image warning.

In an emergency, the smartphone 50a receives the alarm content transmitted from the monitoring device 100 and confirms the display.

As described above, the above-mentioned emergency call can be made by the system or by the system to notify the person concerned.

The LAN cable 501, the input / output device 502, the dedicated cable 503, the automatic door controller 504, the controller 505, the operator 506, and the automatic door 510 together constitute the auto lock device 500.
The input / output device 502 is connected to the monitoring device 100 via the LAN cable 501, and the automatic door controller 504 and the controller 505 are connected to the input / output device 502 via the dedicated cable 503. The automatic door controller 504 is controlled by the controller 505. The controller 505 is operated by the actuator 506.

The input / output device 502 recognizes the door lock release signal from the monitoring device 100 and outputs the door lock release signal to the automatic door controller 504. Further, the controller 505 recognizes the input signal from the operator 506 and transmits the door lock release signal to the automatic door controller 504 by matching the passwords.

The automatic door controller 504 controls the automatic door 510 at the entrance of the building 1F or the like. The automatic door controller 504 receives the door lock release signal and drives the automatic door 510 to the "open" side.

The smartphone 50a can transmit texts and images to the cloud server 301 on the web service cloud 300 via the Internet 303. Further, the smartphone 50a receives a push notification from a push notification server (not shown) via the Internet 303. Further, the cloud server 301 and the push notification server connect to the smartphone 50a equipped with the safety response application via a communication carrier network (fixed network) such as an LTE / 4G / 5G network.

As shown in FIG. 15, for example, 1 to 2 m in front of the automatic door is defined as a yellow belt Y. Further, for example, a peripheral radius of 1.3 to 2 m of the actuator 506 is defined as a green area G which is a range in which the operator can operate.

The surveillance camera 11 near the automatic door controller 504 monitors the yellow belt Y in front of the automatic door and the green area G around the operator, and detects the intrusion of a person into the area.

FIG. 16 is a flowchart showing the operation of the digital safety response security system 1000 in the application example 1 of FIG. FIG. 16 shows an example in which a visitor or the like stops in front of the entrance door of each house / room.
In step S101, the function of detecting the accurate position information of the person detects the accurate position information of the stopped person in cm units. In this case, the location information for each unit and each room is acquired instead of the area unit.

In step S102, it is monitored whether the person concerned is stopped in front of the entrance of each house / room for 3 to 10 seconds based on the accurate position information.

In step S103, after confirming that the person concerned has been stopped for 3 to 10 seconds, for example, "I'm in security now, work to the next day" or "What are you doing?" (Corresponding to step S16 in FIG. 6).

In step S104, after 3 to 10 seconds have passed after the automatic voice warning, if the person concerned does not move out, an image warning is given (corresponding to step S17 in FIG. 6), and an "emergency alert" is sent to the smartphone 50a of the person concerned. (Corresponding to step S18 in FIG. 6).

In step S105, if the person concerned does not move out after 3 to 10 seconds have passed, the relevant organization is notified and a strong automatic voice (emergency information) for warning such as "Your image has been notified to the relevant organization" is output. Shed.
As a result, it is possible to prevent the warning to the suspicious person from being unpowerful and allowing intrusion.

As a result, the suspicious person can be made aware that his / her behavior is constantly monitored, which can be expected to have an effect such as abandoning the suspicious behavior (invasion), and the warning to the suspicious person lacks power and invades. It is possible to prevent forgiveness.

FIG. 17 is a flowchart showing another operation of the digital safety response security system 1000 in the application example 1 of FIG. FIG. 17 is an example when a person related to the building enters the building when the automatic door for entering the building is normally closed at a predetermined time at night.

In step S111, a surveillance camera 11 installed in front of the automatic door detects a person (related person) who has entered the yellow belt Y in front of the automatic door.

In step S112, the surveillance camera 11 monitors whether a person (related person) operates the actuator 506 in the green area G for 20 to 30 seconds to unlock the lock.

In step S113, a person (related person) completes the input of the password to the actuator 506 within 20 to 30 seconds.

In step S114, the controller 505 recognizes the password and determines whether or not they match.

If the passwords match in step S115, the "door lock" of the automatic door is released and the user can enter the building.

In addition to the normal auto-lock / unlock operation in steps S111 to S115, this system performs auto-lock / unlock control based on system judgment. That is, this system includes an image of the person who took the picture and an image of the emergency supporter (image of the person in uniform) stored within the third predetermined period T3 when the measurement is started in response to the emergency call. If they match, unlock the auto lock.

As a result, in order to accept emergency supporters, the auto lock should be unlocked immediately, but there is no party to unlock the auto lock, or the party is upset and takes time to unlock. This can prevent emergency supporters (police officers, paramedics, firefighters, security company employees, etc.) from having trouble getting inside the building.

<Application example 2>
18 and 19 are diagrams for explaining application example 2 of the TV monitor of the digital safety response security system 1000 and the defense function by automatic voice.
As shown in FIG. 18, a surveillance camera 11, a speaker 12, and a TV monitor 13 are installed at the entrance of a common corridor such as a condominium residential area and a veranda, and are connected to the surveillance device 100 via a LAN cable 501. .. A red belt R is set at this entrance and the veranda.
The TV monitor 13 has 1. Normal display and 2. There is a zoom-up image (display image at the time of abnormality).
1. 1. For example, the catch phrase "IoT now and future", the product name "OOOO", and the multilingual telop "Security System operation" are displayed as normal displays. This multilingual telop is available in Japanese, English, Chinese, French, Portuguese, Spanish and Hindi, and can be selected.

2. Zoom-up image When an intruder approaches, 1. From the normal display 2. The image is switched to the zoom-up image, and the image of the intruder taken by the surveillance camera 11 is displayed on the TV monitor 13 (corresponding to step S17 in FIG. 6).

As described above, the TV monitor of the digital safety response security system 1000 and the defense function by the automatic voice install the surveillance camera 11, the speaker 12, and the TV monitor 13 at the entrance of the condominium and the red belt R of the balcony. When an intruder stays in the area of Red Belt R for a predetermined period (10 seconds), an automatic voice is output (corresponding to step S16 in FIG. 6), and when the intruder stays in the area for a predetermined period (20 to 30 seconds), the intruder invades. The image of the person is output to the TV monitor 13, and the intrusion is suppressed and prevented (corresponding to step S17 in FIG. 6).
As a result, it is possible to prevent the warning to the suspicious person from being unpowerful and allowing intrusion.

FIG. 19 is a flowchart showing an outline of the operation of the digital safety response security system 1000 against an intruder (suspicious person) in the application example 2 of FIG. This flow is not necessarily CPU processing, but will be described with step numbers for convenience. Step S is attached to the step of this system, and step I is attached to the invader.

《Digital Safety Response Security System》
In step S201, the digital safety response security system 1000 starts monitoring the living room entrance and the veranda by the surveillance camera 11.

In step S202, an image is acquired from the surveillance camera 11 in front of the entrance of the living room.
In step S203, it is accurately detected whether or not the human body is inside the red belt R.
The count of the intruder's stay time is started in step S204 (corresponding to step S15 in FIG. 6).

In step S205, the image of the intruder is registered in the registrant / suspicious person / emergency supporter information DB165, and an automatic voice such as "Do you want something?" Is output (corresponding to step S16 in FIG. 6).

In step S206, the image of the intruder is zoomed up and displayed on the TV monitor 13 (see “2. Zoomed up image” in FIG. 18) (corresponding to step S17 in FIG. 6), and an automatic voice such as “immediately move out” is output. Output.

Similarly, in step S207, an image is acquired from the surveillance camera 11 on the balcony.
In step S208, it is accurately detected whether or not the human body is inside the red belt R.
In step S209, the count of the intruder's stay time is started.

In step S210, the image of the intruder is registered in the registrant / suspicious person / emergency supporter information DB165, and an automatic voice such as "Do you want something?" Is output.

In step S211 the image of the intruder is zoomed up and displayed on the TV monitor 13 (see “2. Zoomed up image” in FIG. 18), and an automatic voice such as “immediately move out” is output.
As a result, it is possible to prevent the warning to the suspicious person from being unpowerful and allowing intrusion.

"invader"
An intruder invades the red belt R shown in FIG. For example, an intruder invades the red belt R at the entrance of the living room shown in FIG. 18 or the red belt R at the balcony (step I11). In response to this, the digital safety response security system 1000 obtains an image from the surveillance camera 11 and starts counting the staying time of the intruder (steps S204 and S209).

The intruder stays in Red Belt R for a predetermined period of time (eg, 10 seconds) (step I12). In response to this, the digital safety response security system 1000 outputs an automatic voice such as "What do you want?" (Steps S205 and S210).
The intruder stays in Red Belt R for a predetermined period of time (eg, 20-30 seconds) (step I13). In response to this, the digital safety response security system 1000 zooms in on the image of the intruder on the TV monitor 13 and outputs an automatic voice such as "immediately move out" (steps S206 and S211).

Further, following the flow of FIG. 19, a process of image-recognizing the emergency supporter and unlocking the auto-lock device 500 (see FIG. 2) during a predetermined period after the emergency call (see steps S19 to S22 of FIG. 6) is performed. You may want to do it. In this way, it is possible to prevent emergency supporters (police officers, paramedics, firefighters, security company employees, etc.) from having trouble entering the building due to the auto-lock.

As described in detail above, according to the present embodiment, the digital safety response security system 1000 (see FIG. 1) has a person detection unit 111 for detecting a person in a predetermined area in the security area and a person detection unit 111. The time that the person detected by the unit 111 stays in the predetermined area is measured, the first notification signal N1 is output by staying in the first predetermined period (T1), and further, the second predetermined period (T2). A stay period notification unit 112 that outputs a second notification signal N2 by staying, a voice warning unit 113 that receives a first notification signal N1 from the stay period notification unit 112 and gives a voice warning, and a stay period notification unit 112. Therefore, an image warning unit 114 that receives an image warning by receiving the second notification signal N2 and a notification unit 115 that makes an emergency notification together with the image warning are provided.

With this configuration, the suspicious person can be made aware that his / her behavior is constantly monitored, which can be expected to have effects such as abandoning the suspicious behavior (intrusion), and the warning to the suspicious person lacks power and invades. Can be prevented from being forgiven.

In the present embodiment, the digital safety response security system 1000 receives an emergency call from the registrant / suspicious person / emergency supporter information DB 165 that stores the emergency supporter information and the control unit 110, and the time thereafter. A person who collates an image of a person in a predetermined area associated with an auto-lock device with an image stored in the registrant / suspicious person / emergency supporter information DB 165 with the time measuring unit 116 of the control unit 110 for measuring the progress. The collation unit 117, the notification unit 115 that the recognized person makes an emergency call by staying in the predetermined area for a predetermined period, and the person collation unit 117 that the time elapsed measured by the time measurement unit 116 is within the third predetermined period (T3). It is provided with an unlocking unit 118 for unlocking the auto lock in response to the determination that the image of the person and the stored image match.

With this configuration, it is possible to prevent the emergency supporter from taking time to enter the building due to the auto lock.

In the present embodiment, the digital safety response security system 1000 includes an AI accelerator 200 which is a computing resource other than the CPU, and the person detection unit 111 of the control unit 110 uses the AI accelerator 200 to detect a person in the security area. To detect. The AI accelerator 200 can detect a person existing in a wide security area in real time by executing a person detection process on a dedicated hardware separately from the CPU process. Moreover, even if a configuration using an inexpensive camera device is used, a person can be detected in real time.
Further, since the AI accelerator 200 is used, it is possible to detect an intruder with extremely high accuracy as compared with image recognition by a moving object detection type surveillance camera using a conventional image difference.

The above description is an example of a preferred embodiment of the present invention, and the scope of the present invention is not limited thereto.

Further, in the above embodiment, the names of the digital safety response security system and the method are used, but this is for convenience of explanation, and may be a monitoring system, a security system, a smart defense security method, or the like.

The digital safety response security system and method of the present invention are also realized by a program for making a computer function as the digital safety response security system or method of the present invention. The program may be stored on a computer-readable recording medium.

The recording medium on which this program is recorded may be the ROM itself of the Digital Safety Response Security System, or a program reader such as a CD-ROM drive is provided as an external storage device, and the recording medium is placed therein. It may be a CD-ROM or the like that can be read by inserting it.

Further, each of the above configurations, functions, processing units, processing means, etc. may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, each of the above configurations, functions, and the like may be realized by software for the processor to interpret and execute a program that realizes each function. Information such as programs, tables, and files that realize each function can be stored in memory, hard disks, recording devices such as SSDs (Solid State Drives), IC (Integrated Circuit) cards, SD (Secure Digital) cards, optical disks, etc. It can be held on a recording medium.

All publications, patents and patent applications cited herein are incorporated herein by reference only.

The digital safety response security system, method and program according to the present invention are expected to be installed in business establishments requiring a high degree of management such as residences, corporate offices, factories, research institutes, information processing rooms, and money collection rooms. Will be done. In addition, it covers residential and commercial facilities, offices, hospitals, hotels, financial institutions, power plants, air terminals, meeting places, stadiums, museums and other buildings inside and outside, transportation trains, ferries, airplanes, etc. is there.

11 Surveillance camera (shooting means)
20 Motion sensor 30 Wi-Fi master unit 40 Beacon master unit 50 Mobile terminal device (ID terminal)
50a Smartphone (mobile terminal device; ID terminal)
51 Wi-Fi handset 52 Beacon handset 53 GPS
100 Monitoring device 110 Control unit 111 Person detection unit (detection means)
112 Stay period notification unit (stay period notification means)
113 Voice warning section (voice warning means)
114 Image warning section (image warning means)
115 Reporting section (reporting means)
116 Time measurement unit (time measurement means)
117 person collation department (person collation means)
118 Unlocking part (unlocking means)
120 Input unit 130 Storage unit 140 Display unit 150 Output unit 160 Recording unit 165 Registrant / Suspicious person / Emergency support person information DB (image storage means)
170 Image processing unit 180 Interface (I / F) unit 190 Communication unit 200 AI accelerator (human detection means)
500 Auto lock device 501 LAN cable 502 Input / output device 503 Dedicated cable 504 Automatic door controller 505 Controller 506 Operator 510 Automatic door 1000 Digital safety response security system Y, O, R Security belt

Claims (9)

1. Person detection means to detect people in a predetermined area within the security area,
   By measuring the time that the person detected by the person detecting means stays in the predetermined area, the first notification signal is output by staying in the first predetermined period, and further by staying in the second predetermined period. A stay period notification means that outputs a second notification signal, and
   A voice warning means that receives the first notification signal from the stay period notification means and gives a voice warning.
   A digital safety response security system comprising: an image warning means for receiving an image warning by receiving the second notification signal from the stay period notification means.
2. The digital safety response security system according to claim 1, wherein the image warning means includes a reporting means for giving an emergency call as well as giving an image warning.
3. Image saving means to save the image of the emergency supporter,
   A time measuring means for measuring the passage of time after receiving an emergency call,
   A person collation means for collating an image of a person in a predetermined area associated with the auto-lock device with an image stored in the image storage means, and a person collation means.
   The auto-lock is released when the person collating means determines that the image of the person and the stored image match within the third predetermined period of time measured by the time measuring means. The digital safety response security system according to claim 2, further comprising an unlocking means for locking.
4. The digital safety response security system according to claim 3, wherein the emergency supporter is a police officer.
5. The digital safety response security system according to claim 3, wherein the emergency supporter is an ambulance crew member.
6. The digital safety response security system according to claim 3, wherein the emergency supporter is a firefighter.
7. The digital safety response security system according to claim 3, wherein the emergency supporter is an employee of a security company.
8. A person detection step that detects a person in a given area within a security area,
   By measuring the time that the person detected by the person detecting means stays in the predetermined area, the first notification signal is output by staying in the first predetermined period, and further by staying in the second predetermined period. A stay period notification step that outputs a second notification signal, and
   A voice warning step of receiving the first notification signal from the stay period notification means and giving a voice warning,
   A digital safety response security method including an image warning step of receiving an image warning from the stay period notification means and giving an image warning.
9. Computer,
   A person detecting means for detecting a person in a predetermined area in the security area and a person detected by the person detecting means measure the time spent in the predetermined area, and stay in the predetermined area for a first predetermined period. The first notification signal is received from the stay period notification means that outputs the notification signal of the above and further outputs the second notification signal by staying for the second predetermined period, and the stay period notification means, and gives a voice warning. A program for functioning as a digital safety response security system, comprising: a voice warning means and an image warning means that receives an image warning from the stay period notification means and gives an image warning.

Images