JP7222455B2 - Security system, security device and dialogue terminal - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Law Announcement at SECURITY SHOW 2018 Exhibition date: March 6, 2018 [Publications, etc.] Published on the website https://tech. nikkeibp. co. jp/atcl/nxt/news/18/00402/ Publication date: March 9, 2018 [Publications, etc.] Press release Venue: Sony Mobile Communications Inc. (4-12-3 Higashi-Shinagawa, Shinagawa-ku, Tokyo Seaside TS Tower) Date: September 21, 2018 [Publications] Published on the website https://robotstart. info/2018/10/01/xperia-hello-new. html Publication date: October 1, 2018 [Publications, etc.] Published on the website https://www. secom. co. jp/corporate/release/2018/nr_20181001_1. html Publication date: October 1, 2018 [Publications, etc.] Sale Date of sale: October 1, 2018 [Publications, etc.] Published on the website https://www. sony mobile. co. jp/product/smartproducts/g1209/ Publication date: October 1, 2018 [Publications, etc.] Secom Home Security Secom Home Security App Instruction Manual Publisher: Secom Co., Ltd. Distribution date: October 2018 1st [Publications, etc.] Published on the website https://www. secom. co. jp/homesecurity/goods/xperia-hello. html Publication date: October 1, 2018 [Publications, etc.] More fun with SECOM Home Security! Rest assured! Publisher: Secom Co., Ltd. Date of distribution: October 1, 2018 [Publications, etc.] Published on the website https://kyodonewsprwire.com jp/release/201810018594 Publication date: October 1, 2018

TECHNICAL FIELD The present invention relates to security systems, security devices, and interactive terminals.

Conventionally, a security system notifies abnormalities detected by various sensors and operating devices installed in a security target such as a house by ringing a buzzer, etc., and reports to a monitoring center or the like connected via a network. is used.

For example, Patent Literature 1 discloses a security system that has a plurality of security modes such as an alert cancellation mode, an unmanned alert mode, and a manned alert mode, and is configured to be able to switch the security modes as appropriate according to the situation of the security target. An apparatus is disclosed.
Here, the alarm release mode means that the guarded object is manned, and when a fire or an emergency report is detected, an abnormality is reported and the monitoring center is notified. It is in a state of not reporting. Normally, this disarmed mode is used during the day when users are active in the guarded object.
The unmanned alert mode is a state in which the guarded object is unmanned, and an abnormality occurrence is notified to the detection of the occurrence of a fire, an emergency report, and the detection of all intrusion monitoring sensors, and a report is sent to the monitoring center. The unmanned security mode is used when all users leave the security target.
In addition, the manned alert mode means that the security target is manned, and in addition to notifying and reporting abnormal occurrences in response to the detection of fires and emergency reports, for example, from the outside of the security target through windows and doors It is a state in which an abnormality is reported/reported when some specific intrusion monitoring sensors installed to detect an intrusion are detected. On the other hand, when another intrusion monitoring sensor such as a space sensor inside the guard object detects the intrusion, it is not judged as abnormal and no notification is made. This manned alert mode is mainly used at bedtime. If you want to partially monitor with an intrusion sensor, you can also use the block manned alert mode. This mode is used, for example, when there are users only on the first floor and it is desired to monitor the second floor.

By appropriately switching between these security modes according to the situation, the user can use the security system more effectively and ensure safety. However, if the user forgets to switch to an appropriate security mode, the security system will not be able to detect necessary abnormalities depending on the situation, making it difficult to ensure the safety of the security target and the user.
In Patent Document 2, when a sensor for detecting a going-out motion detects that a non-guarded person goes out, the sensor for detecting a non-guarded person does not detect any other user and is in a non-guard mode, Describes a security system that prevents gaps in security due to human error by presenting mode-switching reminder information to remote alarms such as mobile phones to encourage security service users to switch to security mode. It is

JP 2005-275878 A Japanese Patent Application Laid-Open No. 2004-362252

However, what is described in Patent Document 2 is to prompt the user to switch to the unmanned alert mode when the user goes out, and to prompt the user to switch from the alert release mode to the manned alert mode when the guard target is manned. is not listed. Moreover, prompting the user to switch to the manned alert mode more than necessary may make the user feel uncomfortable, so it is important to prompt the user at an appropriate timing.

SUMMARY OF THE INVENTION An object of the present invention is to provide a security system, a security device, and an interactive terminal that prompt a user who has returned home to use the manned security mode at an appropriate timing.

The present invention for solving such problems is a security system that has an unmanned security mode, a manned security mode, and an alert release mode as security modes, and monitors an intrusion of a security target into a monitored space, comprising: a notification unit; , security mode changing means for changing the security mode, user recognition means for recognizing users in the monitored space, the security mode being the security release mode, and the security mode being changed from the unmanned security mode to the security cancellation mode. manned alert prompting means for proposing switching of the security mode to the manned alert mode to the user via the notification unit when the user recognition means recognizes the user within a predetermined prompting period afterward. provide the system.

In this security system, the prompting period preferably does not include the waiting time immediately after the security mode is changed from the unattended alert mode to the alert release mode.

In this security system, the manned alert prompting means switches to the manned alert mode only for the first user recognized by the user recognition means after the security mode is changed from the unmanned alert mode to the alert cancellation mode. Suggestions are preferred.

In this security system, it is preferable that the manned warning prompting means propose switching to the manned warning mode only when the user recognized by the user recognition means is a specific user.

In this security system, when the user recognized by the user recognition means is a specific user, the manned warning means preferably sets the waiting time to be shorter than that of other users or zero.

In this security system, it is preferable that the user recognition means recognize the user in a part of the monitored space.

According to another aspect of the present invention, the security device has an unmanned security mode, a manned security mode, and an alert release mode as security modes, and includes a security device that monitors intrusion of a security target into a monitored space, and a dialogue terminal. In the security system, the security device includes: security mode changing means for changing the security mode; and security mode transmission means for transmitting the changed security mode to the interactive terminal when the security mode changing means changes the security mode. The dialogue terminal includes a dialogue operation unit for inputting and outputting a dialogue with a user, a dialogue storage unit for storing a security mode, and a security unit for receiving a changed security mode from a security device and storing it in the dialogue storage unit. The security mode stored in the mode receiving means, the user recognition means for recognizing the user in the monitored space, and the interaction storage unit is the alert release mode, and the security mode is changed from the unmanned alert mode to the alert release mode. a manned warning prompting means for proposing switching from the security mode to the manned warning mode to the user by speaking from the interactive operation unit when the user recognition means recognizes the user within a predetermined prompting period afterward; provide a security system with

According to another aspect of the present invention, the interactive terminal has an unmanned alert mode, a manned alert mode, and an alert cancellation mode as security modes, and is capable of communicating with a security device that monitors an intrusion into a monitored space to be guarded. a dialogue operation unit for inputting and outputting a dialogue with a user; a dialogue storage unit for storing security modes; A user recognition means for recognizing a user in the monitored space, the security mode stored in the dialogue storage unit is the alert release mode, and a predetermined prompt after the security mode is changed from the unmanned alert mode to the alert release mode. To provide an interactive terminal having a manned alert prompting means for proposing switching from a security mode to a manned alert mode to a user by uttering an utterance from a dialog operation unit when the user recognition means recognizes the user within a period. do.

According to another aspect of the present invention, the security device has an unmanned security mode, a manned security mode, and an alert release mode as security modes, and includes a security device that monitors intrusion of a security target into a monitored space, and a dialogue terminal. In the security system, the security device includes security mode changing means for changing the security mode, recognition information receiving means for receiving recognition information of a recognized user from the interactive terminal, and recognition information receiving means for receiving the recognition information. When the security mode is the alert release mode, and if it is within the predetermined prompting period after the security mode is changed from the unmanned alert mode to the alert release mode, a prompt request to request switching to the manned alert mode is made. a manned warning means for transmitting to the dialogue terminal, the dialogue terminal comprising a dialogue operation unit for inputting and outputting a dialogue with the user; a user recognition means for recognizing the user in the monitored space; When the recognition means recognizes the user, the recognition information transmitting means transmits the recognition information of the recognized user to the security device, the prompt request receiving means receives the prompt request from the security device, and the prompt request receiving means sends the prompt request. To provide a security system having a manned alert prompting means for proposing switching of a guard mode to a manned alert mode to a user by uttering an utterance from an interactive operation part when receiving the information.

According to another aspect of the present invention, it is possible to communicate with an interactive terminal that recognizes and interacts with a user, has an unmanned alert mode, a manned alert mode, and an alert release mode as security modes, and moves to a monitored space to be guarded. a security device for monitoring an intrusion of a security mode, comprising: security mode changing means for changing the security mode; recognition information receiving means for receiving recognition information of a user recognized from an interactive terminal; and recognition information receiving means for receiving the recognition information. , the security mode is the alert release mode, and if it is within the predetermined prompt period after the security mode is changed from the unmanned alert mode to the alert release mode, a prompt request is sent to the interactive terminal to switch to the manned alert mode. and a manned alert prompting means for uttering a proposal to switch to a security device.

The security system, security device, and interactive terminal according to the present invention can prompt the user to use the manned security mode at an appropriate timing.

It is a figure showing a schematic structure of a security system concerning one embodiment of the present invention. 4 is a flow chart showing an example of operations by the security device 30. FIG. 4 is a flow chart showing an example of an operation by the interactive terminal 40; FIG. 4 is a flow chart showing an example of a manned alert prompting determination process in FIG. 3 ; FIG. It is a figure which shows an example of a series of operation|movement of each apparatus performed from a user's return home to switching to a manned alert mode.

A security system according to an embodiment of the present invention will be described below with reference to the drawings. However, it should be understood that the invention is not limited to the drawings or the embodiments described below.

FIG. 1 is a diagram showing a schematic configuration of a security system according to one embodiment of the present invention. As shown in FIG. 1, the security system 1 includes a monitoring server 10 installed in a monitoring center, a security device 30 connected to the monitoring server 10 for communication, and installed in a security target such as a house, and a security device 30. and an interactive terminal 40 connected via wireless communication. The security device 30 is also connected to various sensors such as the building entry operation terminal 21, the building entry regulation terminal 22, the intrusion sensor 23, and the fire sensor 24 via wire/wireless communication.

The monitoring server 10 is a cloud server or the like in a wide area communication network such as the Internet, and is used by a monitoring staff to monitor the security system 1 as a whole at the monitoring center. The monitoring server 10 is connected for communication with one or a plurality of security devices 30 and receives reports such as abnormality detection from the security devices 30 .

The entrance operation terminal 21 is an operation terminal installed outside the entrance door to be guarded and used by the user to request entry into the building to be guarded. It has a card reader, an IC stick container, a camera, a microphone, etc. for inputting authentication information used for authentication of information.
The entrance regulation terminal 22 is an electric lock that is installed at an entrance door or the like to regulate entry into a security target, and is unlocked/locked according to an unlock/lock signal transmitted from the security device 30 .
In this embodiment, the entry operation terminal 21 and the entry regulation terminal 22 are separate devices and are connected to the security device 30, respectively. It may operate independently from security device 30 . Note that a physical key and lock may be used instead of the entrance operation terminal 21 and the entrance regulation terminal 22 .

The intrusion sensor 23 includes a sensor that detects the opening and closing of doors and windows to be guarded by reed switches, magnets, etc., a sensor that detects heat generated by the human body as a heat source, a sensor that detects that infrared rays are blocked by the human body, and the like. is a sensor for detecting intruders. As will be described later, the intrusion sensors 23 include outer perimeter intrusion sensors 23-1 and 23-2 installed in outer areas such as the outside of the guarded object and the boundary between the outside and the inside of the guarded object, and in the inner area of the guarded object. It is an example of a sensor that is roughly divided into the installed internal intrusion sensor 23-3, and whether or not to report an abnormality depending on the security mode.
The fire sensor 24 is a sensor that detects the heat and smoke associated with the occurrence of a fire, and is an example of a sensor that notifies and reports an abnormality in all security modes.
When the intrusion sensor 23 and the fire sensor 24 detect an abnormality, they transmit an abnormality detection to the security device 30 .

The security device 30 is an information processing device that monitors abnormalities detected by the intrusion sensor 23, the fire sensor 24, etc., and guards the security target according to the security mode set by the user. The security device 30 includes an interface unit 31, a first security communication unit 32, a second security communication unit 33, a security operation unit 34, a notification unit 35, a security storage unit 36, and a security control unit 37. have.

The interface unit 31 has an interface circuit conforming to a serial bus standard such as USB, and communicates with the admission operation terminal 21, the admission control terminal 22, the intrusion sensor 23, and the fire sensor 24 to transmit and receive various information. The interface unit 31 may have an interface circuit conforming to wired/wireless communication standards such as Ethernet (registered trademark), IEEE802.11, Bluetooth (registered trademark), etc., instead of the interface circuit conforming to the serial bus standard. .

The first security communication unit 32 has a communication interface circuit that complies with short-range wireless communication standards such as IEEE802.11, Bluetooth (registered trademark), and specified low-power radio, and communicates with the dialogue terminal 40 to transmit and receive various information. do.
The second security communication unit 33 has a communication interface circuit conforming to wired/wireless communication standards such as Ethernet (registered trademark) and IEEE802.11, and communicates with the monitoring server 10 in a wide area communication network such as the Internet via LAN. Connect to send and receive various information.

The security operation unit 34 has a user input/output interface such as a touch panel and buttons, and the user operates the security device 30 to switch the security mode, make an emergency call, and the like. Further, the security operation unit 34 is a card reader for inputting authentication information according to the type of information used for user authentication (user ID, authentication code, biometric information such as fingerprint/face/voice, etc.). , IC stick container, camera, microphone, etc.

The notification unit 35 notifies an abnormality detected by the intrusion sensor 23, the fire sensor 24, etc., and has a user output interface such as a buzzer, a speaker, a lamp, and a display.

The security storage unit 36 has a semiconductor memory such as ROM and RAM, a magnetic disk (HDD), or an optical disk drive such as CD-ROM and DVD-RAM and their storage media. The security storage unit 36 stores computer program codes and various data that the security control unit 37 executes to control the operation of the security device 30 . The computer program may be installed in the security storage unit 36 by a known setup program or the like via a computer-readable portable storage medium such as a CD-ROM or DVD-ROM or a communication line.
The security storage unit 36 stores authentication information 361, security information 362, and security status 363 as data. The authentication information 361 stores in advance the authentication information used for authentication of the user to be guarded. The security information 362 stores in advance security information necessary for security, such as effective sensors in each security mode, types of anomalies detected by each sensor, types of anomalies, and notification methods and destinations according to the security mode. . The security state 363 stores information indicating the current security mode, the security state such as the sensor that is detecting an abnormality, and the like.

The security control unit 37 has processors such as CPU and MPU and their peripheral circuits, and the processor controls the operation of the security device 30 by executing a computer program stored in the security storage unit 36 . A DSP, LSI, ASIC, FPGA, or the like may be used as the security control unit 37 . The security control unit 37 may have a timer or the like for measuring time.
The security control unit 37 includes, as functional modules of a program running on a processor, an admission control means 371 that authenticates a user in response to a request to enter the building and permits the user to enter the building, and changes the security mode in response to a request to change the security mode. and security mode transmission means 373 for transmitting the changed security mode to the interactive terminal 40 . The operation of the security control unit 37 and its respective units will be described in detail in the explanation of the operation of the security device 30, which will be described later.

The interactive terminal 40 is an information processing device such as a communication robot that has a function of interacting with a user through voice and images. The dialog terminal 40 has a dialog communication section 41 , an image acquisition section 42 , a dialog operation section 43 , a dialog storage section 44 , and a dialog control section 45 .

The dialogue communication unit 41 has a communication interface circuit conforming to a short-range wireless communication standard corresponding to the first security communication unit 32 of the security device 30 such as IEEE802.11, Bluetooth (registered trademark), specified low-power radio, etc. It communicates with the device 30 to transmit and receive various information.

The image acquisition unit 42 includes a photoelectric conversion element sensitive to visible light, such as a CCD element or a C-MOS element, an imaging optical system that forms an image on the photoelectric conversion element, and an image output from the photoelectric conversion element. It is a built-in camera or the like having an A/D converter that amplifies an electric signal and converts it from analog to digital (A/D), and sequentially acquires digital images such as RGB images of the monitored space to be guarded.

The interactive operation unit 43 has an audio input/output device such as a microphone and a speaker, and inputs/outputs audio data to interact with the user. The interactive operation unit 43 may have other input/output devices such as a touch panel, buttons, and lamps. Note that the interactive operation unit 43 functions as a notification unit of the present invention.

The dialog storage unit 44 has a semiconductor memory similar to the security storage unit 36, a magnetic disk or an optical disk drive and its storage medium. The dialogue storage unit 44 stores computer program codes and various data executed by the dialogue control unit 45 to control the operation of the dialogue terminal 40 . The computer program may be installed in the interaction memory 44 using a known setup program or the like, similar to the security memory 36 .
The dialogue storage unit 44 stores a security mode 441 and user information 442 as data.
The security mode 441 stores the security mode received from the security device 30 .
The user information 442 stores in advance information related to the user, such as user identification information and a registered face image having features of the front face of the user used for recognizing the user. The user information 442 may also include attribute information such as the age of the user and whether or not the user is protected.

The dialog control unit 45 has a processor such as a CPU and an MPU and peripheral circuits thereof, and the processor controls the operation of the dialog terminal 40 by executing a computer program stored in the dialog storage unit 44 . A DSP, LSI, ASIC, FPGA, or the like may be used as the dialogue control unit 45 . The dialogue control unit 45 may have a timer or the like for measuring time.
The interaction control unit 45 includes, as functional modules of a program running on the processor, a security mode receiving means 451 that receives and stores the security mode from the security device 30, and a user It has recognition means 452, speech processing means 453 for analyzing/synthesizing input/output voice data, and manned alert prompting means 454 for proposing switching to the manned alert mode to the user. The operation of the dialogue control unit 45 and its respective units will be described in detail in the explanation of the operation of the dialogue terminal 40, which will be described later.

FIG. 2 is a flow chart showing an example of the operation of the security device 30 according to this embodiment. The operations described below are realized in cooperation with other units of the security device 30 by the security control unit 37 executing a program pre-stored in the security storage unit 36 . The following operations are started by turning on the power of the security device 30 or performing an operation start operation.

In step S201, when the admission control means 371 receives a request to enter the guarded object from the admission operation terminal 21 together with the authentication information (Yes in step S201), the received authentication information is compared with the authentication information 361 to verify that the correct user has entered the building. It is determined whether or not there is an entry request. If it is determined that the user is the correct user (Yes in step S202), an unlocking signal is transmitted to the admission control terminal 22 to permit entry to the guarded object during a delay time of, for example, one minute (step S203). If there is no entry request (No in step S201) or if the user is not the correct user (No in step S202), the security control unit 37 proceeds to step S204.

In step S204, when a security mode change request is received from the security operation unit 34 or from the interaction terminal 40 via the first security communication unit 32 (Yes in step S204), the security mode changing unit 372 The security mode is changed by changing the security state 363 according to the security mode of the request (step S205). At this time, the security mode changing means 372 determines the type of security mode before and after the change, whether the source of the request is the security operation unit 34 or the interactive terminal 40, and so on. The security mode is changed after confirming whether the security is operating normally and whether all doors and windows are locked. For example, when receiving a change request regarding switching between the unmanned security mode and the security cancellation mode, the security mode changing means 372 checks the user's authentication information included in the change request with the authentication information 361 to determine whether the correct usage is possible. If it is authenticated as a change request by a person, it changes to the alert release mode. On the other hand, user authentication may be omitted when a change request is received for switching between the armed alert mode and the manned alert mode. Further, when the request source is the dialog terminal 40 and receives a change request other than switching from the unattended alert mode to the alert release mode, the security mode changing means 372 is recognized as a user by the dialog terminal 40, so the user can use it. It is also possible to switch to the manned guard mode after confirming that the guard is normal without authenticating the person.
After changing the security mode, the security mode changing means 372 transmits a security mode change notification having the changed security mode to the interaction terminal 40 (step S206). If there is no request to change the security mode (No in step S204), the security control unit 37 proceeds to step S207. In this case, when the security control unit 37 receives another request such as a security mode inquiry, the security control unit 37 may perform processing such as sending reply information to the interactive terminal 40 in response to the request.

In step S207, when the security control unit 37 receives an abnormality detection from the intrusion sensor 23, the fire sensor 24, or the security operation unit 34 (Yes in step S207), the security storage unit 36 stores the type of abnormality indicated by the abnormality detection. In accordance with the security mode, using the security information 362, the anomaly is reported from the notification unit 35, and the abnormality is reported to the monitoring server 10, the dialogue terminal 40, etc. (step S208). For example, in the case of the alert cancellation mode, the security control unit 37 notifies and reports only the abnormality detected by the fire sensor 24 and the emergency report from the security operation unit 34, and the abnormality detected by the intrusion sensors 23-1 to 23-3. do nothing. In addition, in the case of the manned alert mode, the security control unit 37 notifies and reports abnormalities detected by the outer intrusion sensors 23-1 and 2 and the fire sensor 24 and emergency reports, and reports abnormalities detected by the internal intrusion sensor 23-3. do nothing about it. However, in the block manned alert mode, an anomaly detected by an internal intrusion sensor installed in an area where no user is present is notified and notified. Furthermore, in the case of the unmanned alert mode, the security control unit 37 notifies and reports abnormalities and emergency reports detected by all the intrusion sensors 23-1 to 3 and the fire sensor 24 installed in the security target.

When the intrusion sensor 23, the fire sensor 24, and the security operation unit 34 do not send an abnormality detection (No in step S207), the security control unit 37 proceeds to step S209.
In step S209, the security control unit 37 repeats steps S201 to S209 until termination is instructed by power-off of the security device 30, operation termination operation, or the like.

FIG. 3 is a flow chart showing an example of the operation of the interactive terminal 40 according to this embodiment. The operations described below are realized in cooperation with other sections of the dialogue terminal 40 by the dialogue control section 45 executing a program pre-stored in the dialogue storage section 44 . The following operations are started by turning on the power of the interactive terminal 40 or performing a use start operation.
When the interaction terminal 40 starts to operate, the interaction control unit 45 may inquire of the security device 30 about the security mode at that point in time and perform initial setting of the security mode 441 .

In step S<b>301 , when a change notification of the security mode is received from the security device 30 (Yes in step S<b>301 ), the interaction control unit 45 compares the security mode before change stored in the security mode 441 with the change received from the security device 30 . Based on the security mode after change included in the notification, it is determined whether or not the change is from the unattended security mode to the security cancellation mode (step S302). Note that the dialogue control unit 45 receives from the security device 30 a flag or the like indicating a change from the unmanned security mode or the unmanned security mode to the security cancellation mode together with the change notification, and changes from the unmanned security mode to the security cancellation mode. It may be determined whether or not there is a change. If no change notification is received (No in step S301), the interaction control unit 45 proceeds to step S305.
In step S302, in the case of a change from the unmanned alert mode to the alert release mode (Yes in step S302), the dialogue control unit 45 determines that the user has returned home and switched from the unmanned alert mode to the alert release mode. is started (step S303), and if not (No in step S302), the process proceeds to step S304. Instead of starting the timer, the dialogue control unit 45 may store the time at this point in the dialogue storage unit 44 as the return home time.
In step S304, the dialog control unit 45 stores the received changed security mode in the security mode 441, and the speech processing unit 453 utters "security has been canceled", "changed to home security", and the like. to report to the user that the security mode has been changed.

In step S305, the user recognition means 452 analyzes the image captured by the image acquisition unit 42 of the specific space in the area where the interactive terminal 40 is installed within the security target. The user recognition means 452 refers to a face model representing general facial features, and has a size and shape corresponding to a person's head from a photographed image, and has features such as eyes, nose, and mouth. Detect the region as a person's head region. Then, the user recognition means 452 collates the image of the detected head region with the registered face image of the user information 442, and if they match, determines that the user is the user of the matched registered face image. recognize. At this time, the user recognition means 452 may store recognition information such as the identification information of the recognized user, the number of times of recognition, and the time of recognition in the dialogue storage section 44, for example. Note that known methods can be used for the method of detecting the head area of a person using an image and the method of recognizing a user.

When the user recognition means 452 recognizes the user (Yes in step S306), the dialogue control unit 45 performs the manned alert determination process (step S307), and when the user is not recognized (No in step S306), Proceed to step S308. In the latter case, for example, when the user recognition means 452 detects a suspicious person other than the user during the unmanned security mode, the dialogue control section 45 may transmit an abnormality detection to the security device 30 .

FIG. 4 is a flow chart showing an example of the manned alert prompting determination process in FIG. From step S307 in FIG. 3, the following manned alert prompting determination process is started.
Based on the security mode 441 and the recognition information of the recognized user stored in the dialogue storage unit 44, the manned alert prompting means 454 recognizes that the security mode is the alert release mode (Yes in step S401). The user is the first user to be recognized after the security mode is changed from the unmanned security mode to the security cancellation mode (Yes in step S402), and this is the first recognition of this user (step S403). Yes), the elapsed time after returning home has passed a predetermined waiting period (waiting time immediately after returning home) such as 15 minutes (Yes in step S404), and the elapsed time after returning home has passed a predetermined waiting period such as 2 hours later. If the prompting period is not exceeded (No in step S405), the speech processing unit 453 synthesizes voice data of a prompting sentence proposing to the user to switch the guard mode to the manned guard mode by language analysis, and outputs the voice data to the interactive operation unit 43. speaks from (step S406). For example, the utterance processing means 453 may randomly select and utter a plurality of prompting sentences such as "Are you guarding your home?", "Would you like to guard your home?" good. Then, the manned alert urging means 454 may start a timer for timing the request acceptance period, and may accept the change request of the security mode from the user by voice.

On the other hand, if the security mode is not the alert release mode (No in step S401), if it is not the first user recognized after returning home (No in step S402), if it is not the first recognition (No in step S403), If the elapsed time after returning has not passed the waiting period (No in step S404), or if the elapsed time after returning home exceeds the prompting period (Yes in step S405), the dialogue control unit 45 determines whether the manned warning prompting End the process. In this case, the dialogue control unit 45 may perform other processing according to the recognized user's recognition information. For example, when the user is recognized for the first time within a predetermined time after changing from the unmanned alert mode to the alert cancellation mode, the utterance processing means 453 responds to the recognized user by saying, "Mr. You may utter a greeting when returning home.

Returning to FIG. 3, in step S308, while the user recognition means 452 is recognizing the user, the speech processing means 453 language-analyzes the voice data input from the interactive operation section 43, to get At this time, the utterance processing means 453 has a frequency range of a human voice, and when voice data of a predetermined volume or more and a predetermined period or longer is input, the speech processing means 453 analyzes the waveform of the input voice data and decomposes it into phonemes. . The utterance processing unit 453 acquires the contents of the utterance uttered by the user by analyzing the relationship between words extracted from the decomposed series of phonemes using a dictionary, language model, or the like. For example, when the speech processing means 453 receives a speech input such as "guard at home" or "guard off" from the interactive operation unit 43, the speech processing means 453 issues a change request to change the guard mode to the manned guard mode or the guard release mode. , can be acquired as the contents of the utterance from the user.
When the utterance processing means 453 acquires a request to change the security mode as the utterance content (Yes in step S309), the utterance processing means 453 transmits the acquired request to change the security mode to the security device 30 together with the recognition information of the user who made the utterance (step S310).

On the other hand, if the utterance processing unit 453 does not acquire a request to change the security mode (No in step S309), the process proceeds to step S311. In this case, the dialogue control unit 45 may perform processing according to the utterance content, if another effective utterance content is acquired. For example, when the utterance contents of a greeting such as "Hello" are acquired, if the user recognition means 452 recognizes the user, the utterance processing means 453 synthesizes voice data of a reply corresponding to the uttered greeting. Then, you can say something like "Hello, Mr. XX". Further, when the activation keyword for the dialogue terminal 40 is acquired from the user, the dialogue control unit 45 may start a timer for timing the request reception period to receive the security mode change request from the user. Furthermore, when acquiring utterance content indicating going to bed such as "good night" or utterance content including a specific keyword, if the security mode 441 is the alert cancellation mode, the utterance processing means 453 uses switching to the manned alert mode. You may utter a prompting sentence to prompt the person.

In step S311, the dialog control unit 45 repeats steps S301 to S311 until termination is instructed by turning off the power of the dialog terminal 40, using termination operation, or the like.

FIG. 5 is a diagram showing an example of a series of operations performed by each device from when the user returns home until switching to the manned alert mode.
When the user who has returned home unlocks and opens the door of the entrance to be guarded which is set to the unmanned alert mode, the intrusion sensor 23-2 detects the entry through the entrance and starts counting the delay time (step S501). ). The user enters the guarded building through the unlocked door, and inserts, for example, an IC stick or the like into the guard operation unit 34 of the guard device 30 during the delay time to change the guard mode to the guard release mode. A request operation is performed, and the security device 30 receives a change request associated with the request operation (step S502). The security device 30 authenticates the user using authentication information such as user identification information and an authentication code read from the IC stick, and permits the change to the alarm release mode when the user is authenticated as a registered user. (Step S503). The security device 30 changes the security mode from the unmanned security mode to the security cancellation mode (step S504), and transmits a security mode change notification to the interactive terminal 40 (step S505).

Upon receiving a change notification from the security device 30 to change from the unattended alert mode to the alert release mode, the interactive terminal 40 stores the alert release mode in the security mode 441 and starts measuring the elapsed time after returning home (step S506). When the interactive terminal 40 recognizes the first user for the first time during the prompting period after the elapsed time after returning home has passed the waiting period (step S507), the user is alerted to a manned warning. The user utters an utterance to prompt the user to switch to the mode (step S508). In response to this, when the prompted user speaks to switch the guard mode to the manned guard mode, and acquires a change request from the user (step S509), the dialogue terminal 40 receives the acquired change request as a guard. It is transmitted to the device 30 (step S510).

Upon receiving a request to change to the manned guard mode from the dialogue terminal 40, the security device 30 changes the guard mode to the manned guard mode (step S511), and transmits a guard mode change notice to the dialogue terminal 40 (step S512). .
The interactive terminal 40, which has received the notification of the change to the manned guard mode from the security device 30, stores the manned guard mode in the guard mode 441 (step S513), and utters that the guard mode has been changed to the manned guard mode. (step S514).

As explained above, the security system 1 according to the present invention recognizes the user within a predetermined time after the user returns home and enters the building to be guarded. , Proposals to encourage the use of the manned warning mode are made through the interactive functions of communication robots, etc., so that the user after returning home is given the opportunity to set the manned warning mode at an appropriate timing without causing discomfort. It is possible to secure the safety of the user more reliably. In addition, the security system 1 according to the present invention puts the first recognized user into the manned alert mode only once within a predetermined prompting period after a predetermined waiting period has elapsed after the user has returned home. Since switching is urged, user's trouble can be avoided.

Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments.
For example, in the above-described embodiment, the security device 30 and the interaction terminal 40 are shown as separate separate devices, but they may be an integrated device.

In addition, in the above-described embodiment, an interactive terminal such as a communication robot is used as the interactive terminal 40 that cooperates with the security device 30. , a mobile terminal such as a tablet PC may be used. In this case, even if the user is away from the security target, the user can use the mobile terminal to check and switch the security mode, and can receive and display a message prompting switching to the manned security mode. can.

Furthermore, in the above-described embodiment, the manned alert urging means 454 of the interactive terminal 40 prompts the first user recognized by the user recognition means 452 after the user returns home to switch to the manned alert mode. Only when the user (protected person) who needs to be prompted to enter the mode is recognized, it may be urged to switch to the manned alert mode. Alternatively, when the recognized user is a protected person, the manned alert prompting means 454 sets the waiting period shorter than that of other users, or sets the manned alert mode without setting the waiting period (waiting period=0). You can encourage them to switch. At this time, the manned warning means 454 may determine whether or not the recognized user is a protected person based on attribute information such as age of the user information 442 . Also, the manned alert urging means 454 may use the result of estimating the age of the user recognized from the photographed image by the user recognition means 452 and determining whether the user is a protected person. Further, the security device 30 detects whether the user who has returned home is Information indicating whether or not the user is a protected person may be transmitted to the interactive terminal 40, and the manned warning means 454 may determine whether or not the recognized user is a protected person using the information. As a result, the security system 1 can more reliably ensure safety when a protected person such as a child or an elderly person returns home to an unmanned security target.

Further, in the above embodiment, the manned alert prompting means 454 of the interactive terminal 40 prompts the user first recognized by the user recognition means 452 after the user returns home to switch to the manned alert mode only once. , the first recognized user may be prompted after a predetermined period of time until the number of times of recognition reaches a plurality of times (for example, three times). Alternatively, not only the first recognized user but also each recognized user may be prompted to switch to the manned alert mode. Also in this case, it is preferable to set a period during which no prompting is performed for a predetermined period of time from the first recognition of the user.

In the above-described embodiment, the user recognition means 452 of the interactive terminal 40 is configured to recognize the user from the image, but it may also recognize the user from the voice. In this case, voiceprint data for identifying each user is registered as user information 442 in the dialog storage unit 44, and the voice data acquired via the dialog operation unit 43 is analyzed to determine whether the user is in a specific space. recognize the person
Further, in the above-described embodiment, the proposal to switch to the manned alert mode is made using the dialogue function by voice, but the proposal may be made using other means such as an image. For example, the security device 30 or the interactive terminal 40 may be provided with a screen for displaying image information such as characters and pictures, and a message prompting switching to the manned alert mode may be output along with a notification sound.

In the above-described embodiment, the security device 30 and the interactive terminal 40 are directly connected via short-range wireless communication, but are connected via a cloud server or the like in a wide area communication network such as the monitoring server 10. You may transmit and receive various information.
In this case, the monitoring server 10 receives security mode change notifications from the plurality of security devices 30 of the security system 1, manages the security mode of each security device 30, and transmits the change notifications to the interactive terminal 40. good.

Also, some functions of the interactive terminal 40 may be implemented by a cloud server (not shown) in a wide area network such as the Internet. For example, the cloud server is provided with a dialog function for recognizing voice data and determining the contents of the utterance. may be spoken.
Also, the monitoring server 10 may be connected to the cloud server described above via a wide area network such as the Internet, and may transmit and receive information to and from the interaction terminal 40 via the cloud server.

In the above embodiment, the manned alert prompting means 454 of the interactive terminal 40 determines whether or not to prompt the user after returning home to switch to the manned alert mode. good. In this case, the security mode changing means 372 of the security device 30 starts a timer for measuring the elapsed time after returning home when the security mode is changed from the unmanned security mode to the security cancellation mode. On the other hand, when the user recognition means 452 of the dialogue terminal 40 recognizes the user, the recognition information transmission means (not shown) of the dialogue terminal 40 transmits the user's recognition information to the security device 30 . When the recognition information receiving means (not shown) of the security device 30 receives the recognition information transmitted from the dialogue terminal 40, the manned alert urging means (not shown), based on the received recognition information and the security state 363, etc. , the security mode is the alert release mode, the recognized user is the first user recognized after returning home, this is the first recognition of this user, and the elapsed time after returning home is a predetermined waiting period and the elapsed time after returning home does not exceed the predetermined prompting period, a prompting request requesting switching to the manned alert mode may be sent to the interactive terminal 40 . When the prompt request receiving means (not shown) of the interactive terminal 40 receives the prompt request, the speech processing means 453 speaks from the interactive operation unit 43 to prompt the user to switch the guard mode to the manned guard mode. Note that the recognition information transmitting means of the dialogue terminal 40 may transmit the recognition information of the recognized user to the security device 30 only when the security mode is the unmanned security mode.

When managing the security mode of each security device 30, the monitoring server 10 switches to the manned security mode based on the user's recognition information received from the dialogue terminal 40, similarly to the security device 30 that performs the prompt determination. It is also possible to determine whether or not to prompt, and to transmit a prompt request to the dialogue terminal 40 when prompting to switch to the manned alert mode.

As described above, various modifications can be made within the scope of the present invention according to the embodiment.

1 security system, 10 monitoring server, 21 admission operation terminal, 22 admission regulation terminal, 23-1 to 2 perimeter intrusion sensor, 23-3 internal intrusion sensor, 24 fire sensor, 30 security device, 31 interface section, 32 first security Communication unit 33 Second security communication unit 34 Security operation unit 35 Notification unit 36 Security storage unit 37 Security control unit 40 Dialogue terminal 41 Dialogue communication unit 42 Image acquisition unit 43 Dialogue operation unit 44 Dialogue storage unit, 45 dialogue control unit

Claims (10)

A security system having an unmanned alert mode, a manned alert mode, and an alert release mode as security modes, and monitoring an intrusion into a monitored space to be guarded,
a reporting unit;
security mode changing means for changing the security mode;
user recognition means for recognizing a user in the monitored space;
When the security mode is the security release mode and the user recognition means recognizes the user within a predetermined prompting period after the security mode is changed from the unattended security mode to the security cancellation mode, A security system comprising manned warning prompting means for proposing switching of the security mode to the manned warning mode to the user via the notification unit. 2. The security system of claim 1, wherein the prompt period does not include a waiting time immediately after the security mode is changed from the unattended alert mode to the disarmed mode. The manned alert prompting means switches to the manned alert mode only for the first user recognized by the user recognition means after the security mode is changed from the unmanned alert mode to the alert cancellation mode. 3. A security system according to claim 1 or 2, which offers: 4. The manned warning prompting means according to any one of claims 1 to 3, wherein said manned warning prompting means proposes switching to said manned warning mode only when the user recognized by said user recognition means is a specific user. security system. 3. The security system according to claim 2, wherein said manned alert urging means sets said waiting time to a time shorter than that of other users or zero when the user recognized by said user recognition means is a specific user. . The security system according to any one of claims 1 to 5, wherein said user recognition means recognizes a user in a part of space within said monitored space. A security system having an unmanned alert mode, a manned alert mode, and an alert release mode as security modes, and comprising a security device for monitoring intrusion into a monitored space to be guarded, and a dialogue terminal,
The security device
security mode changing means for changing the security mode;
security mode transmission means for transmitting the changed security mode to the interaction terminal when the security mode change means changes the security mode;
The interactive terminal is
a dialogue operation unit for inputting and outputting dialogue with a user;
a dialog storage unit that stores the security mode;
security mode receiving means for receiving the changed security mode from the security device and storing the changed security mode in the interaction storage unit;
user recognition means for recognizing a user in the monitored space;
The security mode stored in the dialog storage unit is the alert release mode, and the user recognition means is activated within a predetermined prompting period after the security mode is changed from the unmanned alert mode to the alert release mode. a manned warning prompting means for proposing switching from the guard mode to the manned guard mode to the user by uttering an utterance from the interactive operation unit when the user is recognized. An interactive terminal having an unmanned alert mode, a manned alert mode, and an alert release mode as security modes, and capable of communicating with a security device that monitors intrusions into a monitored space to be guarded,
a dialogue operation unit for inputting and outputting dialogue with a user;
a dialog storage unit that stores the security mode;
security mode receiving means for receiving the changed security mode from the security system and storing it in the interaction storage unit;
user recognition means for recognizing a user in the monitored space;
The security mode stored in the dialog storage unit is the alert release mode, and the user recognition means is activated within a predetermined prompting period after the security mode is changed from the unmanned alert mode to the alert release mode. a manned alert prompting means for proposing switching from the security mode to the manned alert mode to the user by speaking from the dialog operation unit when the user is recognized. A security system having an unmanned alert mode, a manned alert mode, and an alert release mode as security modes, and comprising a security device for monitoring intrusion into a monitored space to be guarded, and a dialogue terminal,
The security device
security mode changing means for changing the security mode;
recognition information receiving means for receiving recognition information of a user recognized from the interactive terminal;
When the recognition information receiving means receives the recognition information, the security mode is the security cancellation mode, and within a predetermined prompting period after the security mode is changed from the unmanned security mode to the security cancellation mode In some cases, manned alert prompting means for transmitting a prompt request requesting prompting to switch to the manned alert mode to the interaction terminal;
The interactive terminal is
a dialogue operation unit for inputting and outputting dialogue with a user;
user recognition means for recognizing a user in the monitored space;
recognition information transmission means for transmitting recognition information of the recognized user to the security device when the user recognition means recognizes the user;
prompt request receiving means for receiving the prompt request from the security device;
a manned warning urging means for proposing switching from the guard mode to the manned warning mode to the user by speaking from the interactive operation unit when the prompt request receiving means receives the prompt request. A security device capable of communicating with an interactive terminal that recognizes and interacts with a user, has an unmanned alert mode, a manned alert mode, and an alert release mode as security modes, and monitors intrusion into a monitored space to be guarded. ,
security mode changing means for changing the security mode;
recognition information receiving means for receiving recognition information of a user recognized from the interactive terminal;
When the recognition information receiving means receives the recognition information, the security mode is the security cancellation mode, and within a predetermined prompting period after the security mode is changed from the unmanned security mode to the security cancellation mode In some cases, a manned alert prompting means for transmitting a prompt request to the interactive terminal to utter a proposal to switch to the manned alert mode.

Images