JP7353047B2 - Monitoring system and server equipment - Google Patents

Description

The present invention relates to a monitoring system in facilities and residences.

Conventionally, sensors were installed in the residences of people to be watched, such as elderly people living alone, to monitor their activities, and if abnormal activity was observed, the system would confirm the safety of users living in remote areas. A monitoring system is used that sends notification signals to user terminals to prompt users.

For example, in Patent Document 1, a sensor is installed in the living space of the person to be watched, and data indicating the living situation of the person to be watched is distributed to the person being watched regularly or in response to a data distribution request from the person being watched. A living situation confirmation system has been disclosed.

Further, Patent Document 2 discloses a living situation confirmation system that automatically detects abnormalities of a person being watched over and contacts the person being watched by email. This living situation confirmation system compares the operation status of home appliances with past operation history, and if a difference occurs, it sends an email to notify the user of the difference.

Japanese Patent Application Publication No. 2004-295232 Japanese Patent Application Publication No. 2011-227699

The monitoring system has users who wish to receive a notification signal when there is even the slightest change in the activity status of the person being monitored, and a notification signal that is sent when the change is at a level that does not require urgent response. There are users who wish not to be Furthermore, in the monitoring system, there are users who wish to have notification signals sent in real time at any timing, and users who want notification signals not to be sent when they are sleeping or the like. In this manner, in the monitoring system, the level or timing of change in the activity status at which the notification signal is transmitted, which each user desires, differs from user to user.

An object of the present invention is to provide a monitoring system and a server device that can appropriately determine for each user whether or not to prompt the user to confirm the safety of the activity status of the person to be monitored.

In order to solve such problems, the present invention is a monitoring system having a server device and a terminal device, which uses an activity situation acquisition means for acquiring the activity situation of a person to be watched over in a residence, and a learning model. A determining means for determining whether or not to transmit a notification signal regarding the safety of the person to be watched over to the user terminal; a transmitting means for transmitting the notification signal to the user terminal according to the determination result by the determining means; and a notification signal by the user. A monitoring system is provided, which includes a confirmation status acquisition means for acquiring a confirmation status for an object, and an updating means for updating a learning model based on the confirmation status.

In this monitoring system, the confirmation status acquisition means determines the time from when a notification signal is sent to a user terminal until when a response signal to the notification signal is received from the user terminal, or when the notification signal is sent to the user terminal and It is preferable that the number of times a response signal to the notification signal is not received from the user terminal is acquired as the confirmation status.

In this monitoring system, it is preferable that the determining means determines to transmit the notification signal to the user terminal without using the learning model when the activity status satisfies a preset emergency condition.

In this monitoring system, the learning model is an action value function that determines the value of sending and not sending a notification signal, and the updating means is the activity status when the user confirms the notification signal regarding safety that was sent in the past. It is preferable to specify the state as a state, set a reward based on the confirmation situation, and update the action value function based on the specified state and the set reward.

Furthermore, in order to solve such problems, the present invention utilizes an activity status acquisition means for acquiring the activity status of the person to be watched over in a residence and a learning model to send a notification signal regarding the safety of the person to be watched to the user based on the activity status. a determining means for determining whether to transmit the notification signal to the terminal; a transmitting means for transmitting the notification signal to the user terminal according to the determination result by the determining means; and a confirmation status acquisition means for acquiring the status of confirmation of the notification signal by the user. , and updating means for updating a learning model based on a confirmation situation.

The monitoring system and server device according to the present invention can appropriately determine for each user whether or not to prompt the user to confirm the safety of the activity status of the person being watched.

1 is a diagram showing the overall system configuration of a monitoring system 1. FIG. 3 is a schematic diagram showing an example of a data structure of a condition table 322. FIG. 3 is a schematic diagram showing an example of a data structure of a confirmation table 323. FIG. FIG. 3 is a diagram illustrating an example of an operation sequence regarding transmission and reception of notification signals. (a) to (c) are schematic diagrams showing examples of display screens. 3 is a flowchart illustrating an example of the operation of determination processing. FIG. 7 is a diagram illustrating an example of an operation sequence regarding transmission and reception of a second notification signal.

Hereinafter, a monitoring system according to an embodiment will be described with reference to the drawings.

FIG. 1 is a diagram showing the overall system configuration of a monitoring system 1 according to an embodiment. As shown in FIG. 1, the monitoring system 1 includes a user terminal 10, a target person terminal 20, a server device 30, and the like. The user terminal 10 is a terminal used by a user who is a watcher. The target person terminal 20 is installed in a facility or residence (hereinafter sometimes simply referred to as "inside the residence") where the person to be watched resides. The user terminal 10 and the target person terminal 20 are provided for each user and each person to be watched over, and the monitoring system 1 may have a plurality of user terminals 10 and multiple target person terminals 20. The user terminal 10, the target person terminal 20, and the server device 30 are connected to each other via a communication network such as the Internet or a mobile phone network. Further, the target person terminal 20 is connected to a sub-terminal 25 and one or more sensors 26 installed in the residence of the person to be watched.

The user terminal 10 is, for example, a home security controller. The user terminal 10 includes an imaging section 11, a sound input section 12, an operation section 13, a display section 14, a sound output section 15, a first communication section 16, a first storage section 17, a first control section 18, and the like.

The imaging unit 11 includes a photoelectric conversion element that is sensitive to visible light, such as a CCD element or a C-MOS element, an imaging optical system that forms an image on the photoelectric conversion element, and electricity output from the photoelectric conversion element. It has an A/D converter that amplifies the signal and performs analog/digital (A/D) conversion. The imaging unit 11 converts the photographed RGB color images into digital image data in which each pixel has a luminance value in the range of 0 to 255, and outputs the digital image data to the first control unit 18.

The sound input unit 12 includes a microphone and an A/D converter that amplifies the electrical signal output from the photoelectric conversion element and performs analog/digital (A/D) conversion. The sound input section 12 converts the input sound into digital audio data and outputs it to the first control section 18 .

The operation unit 13 is, for example, a touch panel or the like, and accepts an operation by a user, and outputs a signal corresponding to the accepted operation to the first control unit 18. The display unit 14 is, for example, a liquid crystal display, an organic EL display, or the like, and displays various information such as images and text according to instructions from the first control unit 18. The sound output section 15 is, for example, a speaker or the like, and outputs sound according to instructions from the first control section 18.

The first communication unit 16 has a communication interface circuit compliant with, for example, the W-CDMA system or the LTE system, and connects to a communication network such as a mobile communication network via a base station. Alternatively, the first communication unit 16 includes a communication interface circuit compliant with, for example, TCP/IP, and is connected to a communication network such as the Internet. The first communication unit 16 outputs data received from the communication network to the first control unit 18, and transmits data input from the first control unit 18 to the communication network.

The first storage unit 17 includes a semiconductor memory such as ROM or RAM, a magnetic disk or an optical disk drive such as CD-ROM or DVD-ROM, and its recording medium. The first storage unit 17 stores computer programs and various data for controlling the user terminal 10, and inputs and outputs this information to and from the first control unit 18. The computer program may be installed in the first storage unit 17 from a computer-readable portable recording medium such as a CD-ROM or DVD-ROM using a known setup program or the like. The first storage unit 17 also stores, as data, a user ID, password, etc. assigned to each user.

The first control unit 18 includes a processor such as a CPU or an MPU, a memory such as a ROM or a RAM, and peripheral circuits thereof, and executes various signal processing of the user terminal 10. Note that as the first control unit 18, a DSP, LSI, ASIC, FPGA, etc. may be used.
Note that when the user terminal 10 is implemented as a home security controller, the user terminal 10 has a crime prevention function for the residence of the person to be watched, etc., but a detailed explanation thereof will be omitted.

The target person terminal 20 is an example of a terminal device, and like the user terminal 10, it is a controller or the like used in a home security system. The target person terminal 20 includes an interface section 21, a second communication section 22, a second storage section 23, a second control section 24, and the like.

The interface unit 21 has an interface circuit conforming to a communication interface standard such as a serial bus standard such as USB, and is communicatively connected to the sub-terminal 25 and/or the sensor 26 to transmit and receive various information. Note that the interface unit 21 may include an interface circuit that complies with short-range wireless communication standards such as WiFi, Bluetooth (registered trademark), and NFC.

The second communication unit 22 has a communication interface circuit compliant with, for example, TCP/IP, and is connected to a communication network such as the Internet. The second communication unit 22 outputs data received from the communication network to the second control unit 24, and transmits data input from the second control unit 24 to the communication network.

The second storage section 23 includes a semiconductor memory, a magnetic disk or an optical disk drive, and its recording medium, similar to the first storage section 17 . The second storage unit 23 stores computer programs and various data for controlling the subject terminal 20, and inputs and outputs this information to and from the second control unit 24. The computer program may be installed in the second storage unit 23 from a computer-readable portable recording medium such as a CD-ROM or DVD-ROM using a known setup program or the like. Further, the second storage unit 23 stores the device ID of the sub-terminal 25, address information, the sensor ID of each sensor 26, etc. as data.

The second control unit 24 has a processor, memory, and peripheral circuits similar to those of the first control unit 18, and executes various signal processing of the subject terminal 20. Note that as the second control unit 24, a DSP, LSI, ASIC, FPGA, etc. may be used.

The sub-terminal 25 is an example of a terminal device, and is, for example, an operation display device having the same functions as the subject terminal 20. The sub-terminal 25 receives information such as text, images, and/or audio from the target person's terminal 20, displays the received information, and outputs the received information as audio. The sub-terminal 25 accepts operations by the person to be watched over, and controls display of each information and audio output according to the accepted operations. Further, the sub-terminal 25 may be a liquid crystal display or an organic EL display that simply displays images, or a speaker that simply outputs audio.

The sensor 26 is a sensor for detecting the activity status of the person being watched.
The activity status refers to the situation regarding the movement of the person to be watched within the residence and/or the situation of the surrounding environment of the person to be watched within the residence. The situation regarding the movements of the person to be watched includes whether or not the person to be watched exists in the residence, whether the person to be watched is moving, or whether the person to be watched is connected to the sub terminal 25 or other home appliances such as an air conditioner. For example, whether or not an operation is being performed. Conditions of the surrounding environment of the person to be monitored include air quality such as PM2.5 in the residence of the person to be watched, atmospheric pressure, amount of ultraviolet rays, presence or absence of smoke, brightness, temperature, humidity, etc.

When the target person terminal 20 is a home security controller, various sensors installed for crime prevention purposes are used as the sensor 26 in order to detect the situation regarding the movements of the person being watched. For example, as the sensor 26, a so-called human sensor, which detects human movement based on changes in infrared rays generated by the human body, or an opening/closing detection sensor, which detects opening/closing of a window, or the like is used. In that case, the output of each sensor is wirelessly communicated to the subject terminal 20. The outputs of these crime prevention sensors are transmitted to the target person's terminal 20 regardless of whether the target residence is on guard or off guard. Moreover, as the sensor 26, various sensors such as a mat sensor that detects getting out of bed may be used in addition to the security sensor described above. This sensor also includes an interface for transmitting the output of the sensor to the subject terminal 20, similarly to the crime prevention sensor. Moreover, in order to detect the situation related to the movement of the person being watched over, a specific home appliance device having a communication function with the person terminal 20 may be used as the sensor 26. In that case, the operation, power consumption, etc. are detected.

In addition, in order to detect the situation of the surrounding environment of the person being watched over, the sensors 26 include a sensor that measures PM2.5 and CO2 concentration that detects the quality of the air contained in the residence, a sensor that measures atmospheric pressure, and a sensor that measures the amount of ultraviolet rays. A sensor for detecting smoke density, a sensor for detecting smoke concentration, an illuminance sensor for detecting illuminance in a residence, a temperature sensor for detecting temperature in a residence, and/or a humidity sensor for detecting humidity, etc. are used.
These sensors 26 transmit detection signals indicating detection results to the subject terminal 20.

The server device 30 includes a third communication section 31, a third storage section 32, a third control section 33, and the like.

The third communication unit 31 has a communication interface circuit similar to that of the second communication unit 22, and is connected to a communication network. The third communication unit 31 outputs data received from the communication network to the third control unit 33, and transmits data input from the third control unit 33 to the communication network.

The third storage section 32 includes a semiconductor memory, a magnetic disk or an optical disk drive, and its recording medium similar to the first storage section 17. The third storage unit 32 stores computer programs and various data for controlling the server device 30, and inputs and outputs this information to and from the third control unit 33. The computer program may be installed in the third storage unit 32 from a computer-readable portable recording medium such as a CD-ROM or DVD-ROM using a known setup program or the like. Further, the third storage unit 32 stores a learning model 321, a condition table 322, a confirmation table 323, etc. as data. Furthermore, the third storage unit 32 stores, for each user, the user ID and password of each user, the terminal ID of the user terminal 10, address information, the name of the person being watched by each user, and the target. The device ID of the user terminal 20, address information, the sensor ID of each sensor 26, etc. are stored in association with each other.

The learning model 321 is a determination model used to determine whether or not to transmit a notification signal regarding the safety of the person to be watched in the residence to the user terminal 10. The notification signal is used to prompt the user to confirm the safety of the person to be monitored in the residence.
The condition table 322 is a table in which conditions related to the activity status of the person to be watched are stored. Details of the condition table 322 will be described later.
The confirmation table 323 is a table in which the confirmation status, which is the status of detailed confirmation performed by the user, is stored. Details of the confirmation table 323 will be described later.

The third control unit 33 has a processor, memory, and peripheral circuits similar to those of the first control unit 18, and executes various signal processing of the server device 30. The third control unit 33 includes an activity status acquisition unit 331, a determination unit 332, a transmission unit 333, a confirmation status acquisition unit 334, an update unit 335, a reception unit 336, etc., which are implemented as functional modules of a program running on the processor. . Note that as the third control unit 33, a DSP, LSI, ASIC, FPGA, etc. may be used.

FIG. 2 is a schematic diagram showing an example of the data structure of the condition table 322.
As shown in FIG. 2, the condition table 322 stores the identification number (condition ID), content, degree of urgency, message, etc. of each condition in association with each preset condition regarding the activity status.
As the contents of each condition, time (period including time), time (continuous time), area, situation regarding the movement of the person to be watched, and/or situation of the surrounding environment of the person to be watched, etc. are set. For example, the contents of each condition include being absent from a predetermined area (such as a bedroom) during a predetermined period of time (such as 1 to 8 AM), being absent from a predetermined area for a predetermined period of time (such as 24 hours), and being absent from a predetermined area for a predetermined period of time (such as 24 hours). It is set that the temperature of the predetermined area is at least a predetermined temperature (40° C., etc.) for at least 2 hours, 3 hours, etc. Note that a combination of a plurality of situations (a situation related to the movement of the person to be watched and a situation of the surrounding environment) may be set as the content of one condition. The degree of urgency is the degree of urgency generally assumed for the activity situation that satisfies the condition.
Furthermore, different predetermined time and predetermined period conditions may be set for the same area, the situation regarding the movement of the person to be watched, and/or the situation of the surrounding environment of the person to be watched. For example, as shown in FIG. 2, conditions such as "absent from a predetermined area for 24 hours or more" and "absent from a predetermined area for 48 hours or more" may be set.
The message is a message sent when notifying the user that an activity status that satisfies the condition has been observed.

FIG. 3 is a schematic diagram showing an example of the data structure of the confirmation table 323.
As shown in FIG. 3, the confirmation table 323 includes each notification signal's identification number (notification ID), activity status, fulfillment condition, notification time, and confirmation for each notification signal sent from the server device 30 to the user terminal 10. The situation etc. are stored in association with each other.
The activity status is an activity status corresponding to each notification signal. The satisfied conditions are conditions set in the condition table 322 that are satisfied by the activity status. The notification time is the time when the server device 30 transmitted each notification signal. The confirmation status is a confirmation status in which the user confirms the detailed status of each simple notification signal notified by push notification or the like. The confirmation status includes confirmation status, confirmation time, difference time, and the like. The presence or absence of confirmation indicates whether the user of the user terminal 10 has confirmed the details of the activity status indicated in each notification signal after the server device 30 receives each notification signal. The confirmation time is the time when the user confirmed the details. The difference time is the time from the notification time to the confirmation time.

FIG. 4 is a diagram illustrating an example of an operation sequence regarding transmission and reception of notification signals of the monitoring system 1. This operation sequence is executed mainly by each control section of each device in cooperation with each element of each device, based on a program stored in advance in each storage section of each device.

First, the second control unit 24 of the target person's terminal 20 receives a detection signal from each sensor 26 via the interface unit 21, and acquires the activity status of the person being watched over in the residence from the received detection signal (step S101 ). The second control unit 24 periodically acquires detection signals from each sensor 26, and determines the time at which the detection signal was received, the area observed by each sensor 26 that transmitted the detection signal, and the content (watching) indicated in the detection signal. The presence or absence of the subject, presence or absence of movement, presence or absence of operation of a specific device, air quality, brightness, temperature or humidity, etc.) are acquired as the activity status.
Next, the second control unit 24 transmits an activity status signal indicating the acquired activity status to the server device 30 via the second communication unit 22 (step S102). Note that the second control unit 24 may temporarily store the acquired activity status in the second storage unit 23 and transmit an activity status signal to the server device 30 at predetermined intervals (for example, every minute). In that case, the second control unit 24 determines the presence or absence of the person to be monitored within each cycle, the presence or absence of movement, or the presence or absence of operation on a specific device, or the carbon dioxide concentration, brightness, temperature, humidity, etc. within each cycle. Obtain the average value or maximum value as the activity status.

On the other hand, the activity status acquisition means 331 of the server device 30 receives the activity status signal from the subject terminal 20 via the third communication unit 31, and acquires the activity status indicated in the activity status signal (step S103).
Next, the determination means 332 executes determination processing (step S104). The determining means 332 determines whether or not to transmit the notification signal to the user terminal 10 in the determination process. Details of the determination process will be described later.
Next, the transmitting means 333 transmits a notification signal to the user terminal 10 via the third communication unit 31 according to the determination result by the determining means 332 (step S105).
If it is determined in the determination process that the notification signal should be transmitted to the user terminal 10, the transmitting means 333 transmits the notification signal to the user terminal 10. The notification signal includes the notification ID, the name of the person to be monitored, the notification time, the fulfillment condition of the activity status, the degree of urgency, the message, and the like. The transmitting means 333 stores the notification ID, activity status, satisfaction condition, and notification time corresponding to the transmitted notification signal in the confirmation table 323. Note that, in the confirmation table 323, the transmitting means 333 sets "Unconfirmed" as the confirmation presence/absence corresponding to the notification signal, and sets blank as the confirmation time and the difference time.
On the other hand, if it is determined in the determination process that the notification signal is not to be transmitted to the user terminal 10, the transmitting means 333 does not transmit the notification signal. In this case, subsequent processing is omitted.

When the transmitting means 333 transmits a notification signal to the user terminal 10, the first control unit 18 of the user terminal 10 receives the notification signal from the server device 30 via the first communication unit 16, and receives the notification signal included in the notification signal. The user is notified of each piece of information that will be displayed (step S106). The first control unit 18 receives a notification signal such as a push notification using, for example, general-purpose email software, and displays each piece of information included in the notification signal on the display unit 14. Note that the first control unit 18 may output each piece of information included in the notification signal as a sound using the sound output unit 15.

FIG. 5A is a schematic diagram showing an example of a display screen 500 showing each piece of information included in the notification signal. As shown in FIG. 5(a), the display screen 500 displays the name 501 of the person to be monitored, notification time 502, summary of activity status 503, degree of urgency 504, message 505, and the like. As the activity status summary 503, the fulfillment conditions of the activity status included in the notification signal are displayed.

Next, the first control unit 18 receives a detailed display instruction from the user using the operation unit 13 (step S107). First, the first control unit 18 receives an instruction to start a dedicated application for checking details based on a push notification received by the user, and starts the dedicated application.

FIG. 5(b) is a schematic diagram showing an example of a display screen 510 of a dedicated application. As shown in FIG. 5B, the display screen 510 displays a text 511, a details confirmation button 512, a rush request button 513, and the like. In the text 511, each piece of information shown on the display screen 500 is displayed. Note that the degree of urgency 504 may not be displayed. Further, the rush request button 513 may be displayed only when the degree of urgency 504 is high. When the details confirmation button 512 is pressed, detailed confirmation by the user is executed. When the rush request button 513 is pressed, a request is made to the administrator of the monitoring system 1 (for example, a security company) to visit the residence of the person to be monitored, and a security guard or the like from the security company rushes to the home.

When the details confirmation button 512 is pressed, the first control unit 18 accepts the press of the details confirmation button 512 as an instruction to confirm details by the user, and sends a response signal to the received notification signal via the first communication unit 16. and transmits it to the server device 30 (step S108). The response signal is a signal for requesting detailed confirmation, and includes the notification ID included in the received notification signal.

On the other hand, the confirmation status acquisition means 334 of the server device 30 receives a response signal from the user terminal 10 via the third communication unit 31, and updates the confirmation table 323 based on the received response signal. In the confirmation table 323, the confirmation status acquisition means 334 sets confirmation as the confirmation presence/absence corresponding to the notification ID included in the received response signal, and sets the current time as the confirmation time. The confirmation status acquisition means 334 also uses the difference time between the confirmation time and the notification time, that is, the time from when the notification signal is sent to the user terminal until when the response signal to the notification signal is received from the user terminal 10, as the difference time. Set. Further, the confirmation status acquisition unit 334 transmits detailed information to the user terminal 10 via the third communication unit 31 (step S109). The detailed information indicates the activity status for a predetermined period (for example, the most recent 24 hours) corresponding to the notification ID included in the received response signal.

On the other hand, the first control unit 18 of the user terminal 10 receives detailed information from the server device 30 via the first communication unit 16, and displays the activity status indicated in the detailed information on the display unit 14 (step S106). . The first control unit 18 displays the activity status on the display screen of the dedicated confirmation application.

FIG. 5(c) is a schematic diagram showing an example of a display screen 520 that displays activity status. As shown in FIG. 5C, the display screen 520 displays the name 521 of the person to be watched, the activity status 522, and the like. In the activity status 522, each activity status acquired by the server device 30 from the subject terminal 20 is displayed for each acquired time. Note that the activity status may be displayed in a graph or the like. This allows the user to recognize the activity status of the person being watched at any time.

Further, when the confirmation status acquisition means 334 of the server device 30 receives a response signal from the user terminal 10, it reads each information corresponding to the received response signal from the confirmation table 323, and confirms the confirmation status of detailed confirmation by the user. is acquired (step S111). The confirmation status acquisition means 334 reads the activity status, sufficiency condition, and notification time corresponding to the received response signal from the confirmation table 323, and also acquires confirmation status, confirmation time, time difference, etc. as the confirmation status. In addition, the confirmation status acquisition means 334 transmits the number of items for which confirmation status is set to unconfirmed for each satisfaction condition or notification time period, that is, a notification signal to the user terminal 10, and also sends the notification signal to the user terminal 10. The number of times a response signal to a signal is not received from the user terminal 10 may be counted and obtained as the confirmation status. Note that the confirmation status acquisition means 334 acquires the confirmation status not only at the timing when the response signal is received, but also at the timing when the response signal is not received even after a predetermined period of time (for example, one day) has passed since the notification signal was sent. You may obtain it.

Next, the updating unit 335 updates the learning model 321 based on the confirmation status acquired by the confirmation status acquisition unit 334 (step S112).

式（１）において、ｓ_t及びａ_tはそれぞれ時刻ｔにおける状態及び行動であり、行動ａ_tにより状態はｓ_tからｓ_t+1に変化する。ｒ_t+1は、状態がｓ_tからｓ_t+1に変化したことで得られる報酬である。ｍａｘＱの項は、時刻ｔ＋１で最大の価値Ｑになる（と時刻ｔで考えられている）行動ａを行ったときのＱを意味する。α及びγはそれぞれ学習係数及び割引率であり、０＜α≦１、０＜γ≦１で任意に設定される。 The server device 30 uses, as the learning model 321, a learning model learned in advance by reinforcement learning. For example, the server device 30 uses Q learning as reinforcement learning, and uses an action value function that determines the value of transmitting and not transmitting the latest notification signal as a learning model. In Q-learning, an action value function Q(s, a) representing the value of the action when action a is selected in state s is created by using the environmental state s and the action a selected in that state s as independent variables. be learned. In Q-learning, learning starts in a state where the correlation between state s and action a is unknown, and by repeating trial and error to select various actions a in any state s, the action value function Q is repeatedly Updated. In addition, in Q learning, when an action a in a certain state s is selected, a reward r is obtained, and an action value function Q is learned.
The update formula for the action value function Q is expressed as the following formula (1).

In equation (1), s _t and a _t are the state and action at time t, respectively, and the state changes from s _t to s _t+1 due to action a _t . r _t+1 is a reward obtained when the state changes from s _t to s _t+1 . The term maxQ means Q when action a is performed (which is thought to be at time t) to have the maximum value Q at time t+1. α and γ are a learning coefficient and a discount rate, respectively, and are arbitrarily set as 0<α≦1 and 0<γ≦1.

The initial state of the action value function Q is learned in advance in the same way as the updating procedure by the updating means 335 using samples obtained in a preliminary monitor test.
The updating means 335 assigns a number to each activity situation in the order in which an activity situation that satisfies any of the conditions stored in the condition table 322 occurs, and uses the assigned number as the time in equation (1). The updating unit 335 specifies the activity status when the user confirms each of the notification signals related to the safety that have been transmitted in the past as the status _st . For example, the updating means 335 updates the user with the presence/absence of the person to be monitored for each time period and area, the presence/absence of movement (number of times), and the presence/absence of operation on a specific device (number of times), which have already been notified to the user before time t. ), the situation of the surrounding environment of the person to be watched over, and the duration of each situation are specified as the state _st . Furthermore, the updating means 335 specifies transmitting or not transmitting a notification signal corresponding to the activity status at time t as an action a _t .

Furthermore, the updating means 335 sets the reward r based on the confirmation situation. When the updating means 335 transmits a notification signal corresponding to the activity status at time t and receives a response signal to the notification signal, the updating means 335 sets a value larger than 0 as the reward r for the action _at , and updates the notification signal with a value larger than 0. If a response signal is not received within a predetermined time after transmission, 0 is set as the reward r for the action _at . Note that the updating unit 335 may set the reward r to a larger value as the difference time is shorter. Furthermore, the updating unit 335 updates the notification signal corresponding to the activity status at time t and the notification signal whose fulfillment condition of the activity status and/or time zone of the notification time coincides with the item whose confirmation status is set to unconfirmed. The smaller the number, the larger the reward r may be set.
On the other hand, if the updating means 335 does not transmit the notification signal corresponding to the activity status at time t, then the updating unit 335 transmits the notification signal corresponding to the same activity status as that activity status for the first time within a predetermined period of time. When the response signal is not received, a value larger than 0 is set as the reward r for the action a _t , and when the response signal is received, the reward r for the action a _t is set to 0. Note that the updating unit 335 may set the reward r to a larger value as the time elapsed from the occurrence of the activity situation at time t to the current time is longer. Furthermore, the updating unit 335 updates the notification signal corresponding to the activity status at time t and the notification signal whose fulfillment condition of the activity status and/or time zone of the notification time coincides with the item whose confirmation status is set to unconfirmed. The larger the number, the larger the reward r may be set.

As a result, if a safety confirmation is made for an activity, a notification signal corresponding to that activity will be more likely to be sent from now on, and if a safety confirmation is not made for an activity, from now on Notification signals corresponding to the situation are less likely to be sent. Additionally, if a safety confirmation is made for an activity, a notification signal will be more likely to be sent during that time, and if a safety confirmation is not made for an activity, notifications will be sent during that time. It becomes difficult for the signal to be transmitted. Further, the shorter the difference time, the easier it is to transmit a notification signal corresponding to that activity status, and the longer the difference time, the harder it is to transmit a notification signal corresponding to that activity status. Furthermore, the larger the number of unconfirmed items, the more difficult it becomes to send a notification signal corresponding to the activity status from now on.

The updating means 335 updates the action value function Q(s, a) according to the above formula (1) based on the specified state s _t and the set reward r, and finally updates each of the updated Q(s, The combination (action value table) of the values (action values) of a) is stored in the third storage unit 32 as the learning model 321. With the above, the operation sequence regarding transmission and reception of notification signals is completed.

FIG. 6 is a flowchart illustrating an example of the operation of the determination process. The flow of operations shown in FIG. 6 is executed in step S104 of the flowchart shown in FIG.

First, the determination unit 332 determines whether the activity status acquired by the activity status acquisition unit 331 satisfies any of the conditions stored in the condition table 322 (step S201).
If the activity status does not satisfy any of the conditions, the determining means 332 determines not to transmit the notification signal to the user terminal 10 (step S202), and ends the series of steps.
On the other hand, if the activity status satisfies any condition, the determining means 332 determines whether the activity status satisfies a preset emergency condition among the conditions stored in the condition table 322 ( Step S203). As the emergency condition, a condition with a high degree of urgency among the conditions stored in the condition table 322 is set, for example, a condition whose degree of urgency is set to "high."
If the activity status satisfies the emergency condition, the determining means 332 determines to transmit the notification signal to the user terminal 10 without using the learning model 321 (step S204), and ends the series of steps. Thereby, when a highly urgent situation occurs, the determining means 332 can immediately notify the user of the situation.

On the other hand, if the activity status does not satisfy the emergency condition, the determining means 332 uses the learning model 321 to acquire the action value of transmitting a notification signal corresponding to the acquired activity status (step S205).
The determining means 332 determines the presence or absence of the person to be watched for each time period and area, the presence or absence of movement (number of times), the presence or absence of operation on a specific device (number of times), and the surroundings of the person to be watched, which have already been notified to the user. The environmental situation and the duration of each situation are specified as the state s. Further, the determining means 332 specifies transmitting a notification signal corresponding to the acquired activity status as an action _a1 , and refers to the learning model 321 to determine a combination of the specified state s and the action _a1. The value of Q(s, a ₁ ) is acquired as the action value of transmitting the notification signal. Further, the determining means 332 specifies not transmitting a notification signal corresponding to the acquired activity status as behavior a ₂ , and refers to the learning model 321 to determine a combination of the specified state s and behavior a ₂ . The value of Q(s, a ₂ ) is obtained as the action value of not transmitting the notification signal.

Next, the determining means 332 determines whether the action value of transmitting a notification signal is greater than or equal to the action value of not transmitting a notification signal (step S206). If the action value of sending a notification signal is greater than or equal to the action value of not sending a notification signal, the determining means 332 determines to send the notification signal to the user terminal 10 (step S207); If the action value is less than the action value of not transmitting a notification signal, it is determined not to transmit the notification signal to the user terminal 10 (step S208), and the series of steps ends. In this manner, the determining means 332 uses the learning model 321 to determine whether or not to transmit the notification signal to the user terminal 10.

Note that the processing in steps S201 and S202 may be omitted. Further, the processing in steps S203 to S204 may also be omitted.

FIG. 7 is a diagram illustrating an example of an operation sequence regarding transmission and reception of the second notification signal of the monitoring system 1. This operation sequence is executed mainly by each control section of each device in cooperation with each element of each device, based on a program stored in advance in each storage section of each device.

First, the first control unit 18 of the user terminal 10 generates a message including text data, image data, or audio data according to an instruction from a user using the operation unit 13, and acquires the message as specific information (step S301). Note that the first control unit 18 may cause the imaging unit 11 and/or the sound input unit 12 to generate image data and/or audio data, and may acquire the data as the specific information.
Next, the first control unit 18 transmits the acquired specific information and its identification information, together with the user ID and password, to the server device 30 via the first communication unit 16 (step S302).
On the other hand, the receiving means 336 of the server device 30 receives the specific information, identification information, user ID, and password transmitted from the user terminal 10 via the third communication unit 31, and receives the received user ID and password. is compared with the user ID and password stored in the third storage unit 32. If the verification is successful, the receiving means 336 stores the received specific information and identification information in the third storage section 32, and transmits them to the subject terminal 20 via the third communication section 31 (step S303). Note that the receiving means 336 may delete the specific information and identification information from the third storage unit 32 after transmitting the information to the target person terminal 20.

On the other hand, the second control unit 24 of the target person terminal 20 receives the specific information and identification information from the server device 30 via the second communication unit 22, and stores the received specific information and identification information in the second storage unit 23. At the same time, it is transmitted to the subterminal 25 via the interface unit 21 (step S304).

On the other hand, when the subterminal 25 receives the specific information and identification information from the target person terminal 20, it displays and notifies the user that the specific information has been received. Next, the subterminal 25 receives an instruction to output and display specific information from the person to be watched (step S305).
Upon receiving the output display instruction, the subterminal 25 displays specific information and/or outputs audio (step S306).
Next, the sub-terminal 25 transmits to the target person terminal 20 an opening notification indicating that the specific information has been output and displayed by the person to be watched (step S307). The opening notification includes identification information of the specific information.

On the other hand, the second control unit 24 of the target person's terminal 20 receives the opening notification from the sub-terminal 25 via the interface unit 21 and transmits the received opening notification to the server device 30 via the second communication unit 22. (Step S308).

On the other hand, when the transmission means 333 of the server device 30 receives the opening notification from the target person's terminal 20 via the third communication unit 31, that is, when the specific information is output and displayed by the person being watched, the transmitting means 333 of the server device 30 transmits A second notification signal indicating that the output has been displayed by the target person is transmitted to the user terminal 10 via the third communication unit 31 (step S309). The second notification signal includes identification information of the specific information.

On the other hand, the first control unit 18 of the user terminal 10 receives a second notification signal from the server device 30 via the first communication unit 16, and indicates on the display unit 14 that the specific information has been output and displayed by the person being watched. is displayed to notify the user (step S310). With the above, the operation sequence regarding transmission and reception of the second notification signal is completed.

The user can recognize that the person being watched is living safely by watching each content such as e-mail, image, or audio and recognizing that the person being watched has opened it.

Note that in step S309, the server device 30 may transmit the second notification signal not immediately, but at a predetermined period (for example, a period excluding late-night hours).

Further, when the sub-terminal 25 is a display and a speaker, the processes of steps S304 and S307 are omitted, and the processes of steps S305 to S307 are executed by the subject terminal 20. In that case, the second control unit 24 displays on the sub-terminal 25 via the interface unit 21 to notify the user that the specific information has been received. Next, the second control unit 24 receives an instruction to view specific information from the user using the sub-terminal 25 via the interface unit 21 . Upon receiving the viewing instruction, the second control unit 24 causes the specific information to be displayed on the subterminal 25 via the interface unit 21 and/or output as audio. Then, the second control unit 24 transmits the viewing notification to the server device 30 via the second communication unit 22.

As described above, the monitoring system 1 according to the present invention uses the learning model 321 for determining whether or not to prompt the user to confirm the safety of the person being watched over based on the activity status of the person to be watched over. Update based on the situation. Thereby, the monitoring system 1 can appropriately determine for each user whether or not to prompt the user to confirm the safety of the activity status of the person to be watched.

Note that the present invention is not limited to these embodiments. For example, the server device 30 may use, as the state s of the learning model 321, the activity status itself that has already been notified to the user, instead of the sufficiency condition of the activity status that has already been notified to the user.

Further, instead of the server device 30, the target person terminal 20 uses the learning model 321 to determine whether or not to transmit the notification signal to the user terminal 10, and transmits the notification signal to the user terminal 10, The learning model 321 may be updated based on the confirmation status of the user's safety confirmation. In that case, the second storage unit 23 of the target person terminal 20 stores each program and each data stored in the third storage unit 32 of the server device 30, and the second control unit 24 of the target person terminal 20 It operates as each means realized by the third control section 33 of the device 30. The processes in steps S102 and S103 in FIG. 4 are omitted, and the processes in steps S104 and S105 are executed by the second control unit 24 of the subject terminal 20. Further, in step S108, the first control unit 18 of the user terminal 10 transmits a response signal to the target person terminal 20, and the processes of steps S109, S111, and S112 are executed by the second control unit 24 of the target person terminal 20. be done.

Further, the learning model 321 may be stored in an external device instead of being stored in the server device 30, and may be used in the form of cloud computing. In that case, the determining means 332 specifies the state s and behavior a for the acquired activity status, and transmits the identified state s and behavior a via the third communication unit 31 in the same way as the process of step S205 in FIG. and send it to an external device. The determining means 332 receives the value of Q(s, a) corresponding to the combination of the state s and the action a from the external device via the third communication unit 31, and acquires it as the action value of transmitting the notification signal. Further, the updating means 335 specifies the state _{s t} , the action _{a t} and the reward r in a manner similar to the process of step S112 in FIG. The learning model 321 is transmitted to the external device via the unit 31, and the learning model 321 is caused to be updated by the external device. Thereby, the monitoring system can use a device that does not have sufficient processing speed and storage capacity as the server device 30.

Further, in step S205 of FIG. 6, the server device 30 uses a learning model (discriminator) determined by another learning method such as supervised learning, instead of the learning model (behavior value function) determined by reinforcement learning. may be used to obtain the behavioral value.
In that case, the determining means 332 calculates the action value using a discriminator trained in advance to output the action value of transmitting a notification signal corresponding to the activity status. This discriminator is trained in advance so that the higher the possibility that the user will respond to the notification signal, the higher the action value it will output. This discriminator uses deep learning, for example, to collect multiple samples of correct answer data for activity situations that are likely to be responded to by the user, and multiple samples of incorrect answer data for activity situations that are unlikely to be responded to by the user. The learning model 321 is stored in advance in the third storage unit 32 as a learning model 321. The determining means 332 inputs the acquired activity status into the discriminator, acquires the action value output from the discriminator, and determines to send a notification signal to the user terminal 10 if the action value is equal to or higher than the threshold, If the action value is less than the threshold, it is determined that the notification signal is not to be transmitted to the user terminal 10.
On the other hand, in step S112 in FIG. 4, the updating unit 335 updates the discriminator stored as the learning model 321 based on the confirmation status of the user's safety confirmation. When the updating means 335 receives a response signal to the notification signal, it adds the activity status corresponding to the notification signal to the sample correct answer data and retrains the classifier. On the other hand, if a response signal is not received within a predetermined period of time after transmitting the notification signal, the updating means 335 adds the activity status corresponding to the notification signal to the sample incorrect data and retrains the discriminator. do.
In this case as well, the monitoring system can update the learning model 321 appropriately, and as a result, appropriately determines for each user whether or not to prompt the user to confirm the safety of the person under monitoring. becomes possible.

Further, the subject terminal 20 may be provided separately for each sub-terminal 25 and/or sensor 26. Alternatively, the target person's terminal 20 is omitted, and the sub-terminal 25 and/or the sensor 26 have a communication interface circuit for communicating with the server device 30, and directly communicate with the server device 30 without going through the target person's terminal 20. You may communicate.
Furthermore, the target person terminal 20 may be configured to include the functions of the sub-terminal 25. In that case, another sub-terminal 25 may be further connected to the subject terminal 20.

Further, the user terminal 10 is not limited to a home security controller, and may be a multifunctional mobile phone (so-called smart phone), a tablet PC, a personal computer, or the like. As the operation unit 13, a mouse, a keyboard, etc. may be used. Further, the target person terminal 20 may be a built-in computer, a personal computer, a home server, a gateway device, or the like.
Further, the sub-terminal 25 may be a multi-function mobile phone (so-called smart phone), a tablet PC, a personal computer, or the like.
Further, the sub-terminal 25 may be a multifunctional mobile phone (so-called smart phone), a tablet PC, a personal computer, or the like, which has a wireless communication function with the subject terminal 20.

As described above, various changes can be made within the scope of the present invention according to the embodiment.

1 monitoring system, 30 server device, 331 activity status acquisition means, 332 determination means, 333 transmission means, 334 confirmation status acquisition means, 335 update means, 336 reception means

Claims (5)

A monitoring system having a server device and a terminal device,
an activity status acquisition means for acquiring the activity status of a person to be monitored in a residence;
A determining means that uses a learning model to determine whether or not to transmit a notification signal regarding the safety of the person to be watched over the activity status to a user terminal used by the user who is watching over the person to be watched ;
Transmitting means for transmitting the notification signal to a user terminal according to a determination result by the determining means;
A response signal is received from the user terminal indicating that the user has performed a confirmation operation to display the detailed information on the safety status in response to the transmitted notification signal, and based on the response signal, the user Confirmation status acquisition means for acquiring confirmation status regarding the notification signal;
updating means for updating the learning model based on the confirmation status;
A monitoring system characterized by having. A monitoring system having a server device and a terminal device,
an activity status acquisition means for acquiring the activity status of a person to be monitored in a residence;
A determining means that uses a learning model to determine whether or not to transmit a notification signal regarding the safety of the person to be watched over the activity status to a user terminal;
Transmitting means for transmitting the notification signal to a user terminal according to a determination result by the determining means;
Confirmation status acquisition means for acquiring confirmation status of the notification signal by the user;
updating means for updating the learning model based on the confirmation status,
The confirmation status acquisition means is configured to determine the time from when the notification signal is sent to the user terminal until the time when a response signal to the notification signal is received from the user terminal, or from when the notification signal is sent to the user terminal and when the response signal to the notification signal is received from the user terminal. obtaining the number of times a response signal to the notification signal is not received from the user terminal as the confirmation status;
A monitoring system characterized by : A monitoring system having a server device and a terminal device,
an activity status acquisition means for acquiring the activity status of a person to be monitored in a residence;
A determining means that uses a learning model to determine whether or not to transmit a notification signal regarding the safety of the person to be watched over the activity status to a user terminal;
Transmitting means for transmitting the notification signal to a user terminal according to a determination result by the determining means;
Confirmation status acquisition means for acquiring confirmation status of the notification signal by the user;
updating means for updating the learning model based on the confirmation status,
The determining means determines to transmit the notification signal to the user terminal without using the learning model if the activity status satisfies a preset emergency condition.
A monitoring system characterized by : A monitoring system having a server device and a terminal device,
an activity status acquisition means for acquiring the activity status of a person to be monitored in a residence;
A determining means that uses a learning model to determine whether or not to transmit a notification signal regarding the safety of the person to be watched over the activity status to a user terminal;
Transmitting means for transmitting the notification signal to a user terminal according to a determination result by the determining means;
Confirmation status acquisition means for acquiring confirmation status of the notification signal by the user;
updating means for updating the learning model based on the confirmation status,
The learning model is an action value function that determines the value of transmitting and not transmitting the notification signal,
The updating means includes:
The activity status when the user confirmed the safety notification signal sent in the past is identified as the status,
Set the reward based on the confirmation status,
updating the action value function based on the identified state and the set reward;
A monitoring system characterized by : an activity status acquisition means for acquiring the activity status of a person to be monitored in a residence;
A determining means that uses a learning model to determine whether or not to transmit a notification signal regarding the safety of the person to be watched over the activity status to a user terminal used by the user who is watching over the person to be watched ;
Transmitting means for transmitting the notification signal to a user terminal according to a determination result by the determining means;
A response signal is received from the user terminal indicating that the user has performed a confirmation operation to display the detailed information on the safety status in response to the transmitted notification signal, and based on the response signal, the user Confirmation status acquisition means for acquiring confirmation status regarding the notification signal;
updating means for updating the learning model based on the confirmation status;
A server device comprising:

Images