WO2017188156A1

WO2017188156A1 - Terminal apparatus of monitored person monitoring system, terminal apparatus control method, and monitored person monitoring system

Info

Publication number: WO2017188156A1
Application number: PCT/JP2017/016060
Authority: WO
Inventors: 篤広野田; 山下　雅宣; 琢哉村田; 雅史西角; 古川　学
Original assignee: コニカミノルタ株式会社
Priority date: 2016-04-28
Filing date: 2017-04-21
Publication date: 2017-11-02
Also published as: JP6946276B2; JPWO2017188156A1

Abstract

In the terminal apparatus of a monitored person monitoring system, the control method therefor, and the monitored person monitoring system according to the present invention, if a notification of a prescribed event relating to a monitored person, being a monitoring target, has been received, a notification sound is output, and if a notification of a new event is received while the notification sound is being output, the notification sound being output continues.

Description

Terminal device of monitored person monitoring system, control method of terminal device, and monitored person monitoring system

The present invention relates to a terminal device in a monitored person monitoring system for monitoring a monitored person, a control method for the terminal apparatus, and the monitored person monitoring system.

Japan (Japan) is an aging society, more specifically the ratio of population over 65 years old to the total population due to the improvement of living standards accompanying the post-war high economic growth, improvement of sanitary environment and improvement of medical standards, etc. It is a super-aging society with an aging rate exceeding 21%. In 2005, the total population was about 126.5 million, while the elderly population over the age of 65 was about 25.56 million. In 2020, the total population was about 124.11 million. There is also a prediction that the elderly population will be about 34.56 million. In such an aging society, nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care (such as those who require nursing care) are those who need nursing in a normal society that is not an aging society. This is expected to increase more than Japan, for example, is a society with a declining birthrate with a total fertility rate of 1.43 in 2013. For this reason, elderly care has been taking place in which elderly nurses, etc., are cared for by an elderly family (spouse, child, brother).

Employees requiring nursing care, etc. enter hospitals and facilities for welfare for the elderly (Japanese elderly law short-term entrance facilities, nursing homes for the elderly and special nursing homes for the elderly, etc.) and receive nursing and care. In such a facility, a situation in which a nurse or the like needs to be injured or fallen out of the bed, for example, by falling from the bed or falling while walking can occur. It is necessary to respond to such a situation as quickly as possible. Moreover, if such a situation is left unattended, it may develop into a more serious situation. For this reason, in the facility, nurses and caregivers regularly check their safety and state by patrol.

However, the increase in the number of nurses etc. cannot keep up with the increase in the number of nurses required, and the nursing industry and the care industry are chronically short of manpower. Furthermore, since the number of nurses, caregivers and the like is reduced in the semi-night shift and night shift hours compared to the day shift hours, the work load per person increases, and thus the work load is required to be reduced. In addition, the situation of the elderly care is not an exception in the facility, and it is often seen that elderly nurses and the like care for elderly nurses and the like. In general, physical strength declines when older, so the burden of nursing etc. becomes heavier than young nurses etc. even if they are healthy, and their movements and judgments are also delayed.

In order to reduce the labor shortage and the burden on nurses, a technology that complements nursing work and nursing care work is required. For this reason, in recent years, monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.

For example, there is a nurse call system disclosed in Patent Document 1 as one of such techniques. The nurse call system disclosed in Patent Document 1 includes a mat sensor that detects that an object is on the mat and outputs a detection signal, and a call signal that is connected to the mat sensor and receives the detection signal. A nurse call system comprising: a transmitter that wirelessly transmits a call; and a receiver that receives a call signal transmitted from the transmitter and calls a nurse call parent device, wherein the transmitter includes the mat sensor When the detection signal is input from, a one-shot call signal is transmitted to the receiver, and then the one-shot call signal is not transmitted even if the detection signal is input until a predetermined time elapses thereafter. When the predetermined time has elapsed since the one-shot call control unit transmits the one-shot call signal. A continuous call control unit for confirming whether a detection signal is input and transmitting the continuous call signal for instructing continuous calls to the receiver when the detection signal is input; and A call recovery control unit for confirming whether or not the detection signal is input after transmitting the continuous call signal and transmitting a call recovery signal to the receiver when the detection signal is not input; The receiver makes a one-shot call of the nurse call parent device when receiving the one-shot call signal, and calls the nurse call parent device when receiving the continuous call signal. A call control unit is provided which performs continuously and stops the continuous call of the nurse call parent device when the call recovery signal is received. More specifically, according to the paragraph [0036] of Patent Document 1, as long as the mat sensor 1 is stepped on by the patient, the nurse call parent device 6 is first called by a one-shot call signal, Thereafter, after a predetermined time has elapsed, the nurse call parent device 6 is continuously called by a continuous call signal instructing continuous call. Further, the call by the continuous call signal is recovered by the call recovery signal transmitted from the transmitter to the receiver. Therefore, even if an operation to restore the call with the nurse call master unit 6 or the corridor lamp 4 is performed while continuous calls are being performed, the call of the nurse call master unit 6 is performed again. Until the sensor 1 is not stepped on, the call notification in the nurse call parent device 6 can be continued.

On the other hand, in terms of safety confirmation, a single person living alone is the same as the care recipient and the like and is a subject to be monitored.

By the way, if the notification sound is output from the terminal device in response to the notification from the sensor device, the user can recognize the notification from the sensor device by hearing, which is convenient. However, if there is a new notification before one phrase of the notification sound is completed, and the notification sound is newly output in response to this, the user feels annoying and annoying. For example, when one phrase of the notification sound is “pull roux”, if there is a notification from four sensor devices before each phrase of the notification sound ends, “pull, pull, pull, pull roux” becomes “user” Feels annoying and annoying.

The above-mentioned patent document 1 discloses the control of the call signal, but there is no disclosure regarding the output of the notification sound at the nurse call master according to the call signal.

JP 2011-239944 A

The present invention has been made in view of the above-described circumstances, and is a monitoring target person monitoring system that can reduce annoyance and annoyance even when a new notification is made before one phrase of the notification sound is completed. A terminal device, a control method for the terminal device, and a monitored person monitoring system are provided.

In the terminal device of the monitored person monitoring system and the control method thereof, and the monitored person monitoring system according to the present invention, a notification sound is output when notification of a predetermined event related to the monitored person that is the monitoring target is received. When a notification of a new event is received while the notification sound is being output, the notification sound being output is continued. Therefore, the terminal device of the monitored person monitoring system and the control method thereof, and the monitored person monitoring system according to the present invention can be used even when there is a new notification before one phrase of the notification sound is completed. Annoyance can be reduced.

The above and other objects, features and advantages of the present invention will become apparent from the following detailed description and the accompanying drawings.

It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. It is a figure which shows the structure of the sensor apparatus in the said to-be-monitored person monitoring system shown in FIG. It is a figure which shows the structure of the portable terminal device in the to-be-monitored person monitoring system shown in FIG. It is a figure which shows the structure of the monitoring information table memorize | stored in the said portable terminal device shown in FIG. It is a figure which shows the structure of the sensor information table memorize | stored in the said portable terminal device shown in FIG. It is a figure which shows the structure of the notification sound information table memorize | stored in the said portable terminal device shown in FIG. It is a flowchart which shows operation | movement of the said sensor apparatus shown in FIG. 4 is a flowchart showing an operation related to a monitoring process in the mobile terminal device shown in FIG. 3. 4 is a flowchart showing an operation related to a first notification sound output process in the portable terminal device shown in FIG. 3. 4 is a flowchart showing an operation related to a second output process of a notification sound in the mobile terminal device shown in FIG. 3. 4 is a flowchart showing an operation related to an input operation of a “corresponding” button in the mobile terminal device shown in FIG. 3. It is a figure which shows an example of the standby screen displayed on the said portable terminal device shown in FIG. It is a figure which shows an example of the monitoring information screen displayed on the said portable terminal device shown in FIG. It is a figure which shows an example of the nurse call reception screen displayed on the said portable terminal device shown in FIG. FIG. 4 is a state diagram showing a specific example for explaining an operation in the mobile terminal device shown in FIG. 3.

Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached the suffix.

The monitored person monitoring system in the embodiment is a system that uses a plurality of devices to monitor a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched), and a terminal device and And a monitored person monitoring apparatus that is connected to the terminal apparatus so as to be communicable, detects a predetermined event (event) related to the monitored person Ob, and notifies the terminal apparatus of the event. The terminal device includes a sound output unit that outputs a sound, and a notification sound control unit that outputs a notification sound from the sound output unit when a notification of the event is received. In this embodiment, when the notification sound control unit receives a notification of a new event while outputting the notification sound from the sound output unit, the notification sound control unit continues the notification sound being output. The monitored person monitoring device may be integrally configured by a single device, but in this embodiment, the monitored person monitoring device is connected to the sensor device and the sensor device and the terminal device so as to communicate with each other. By providing the management server device (central processing unit), the two types of devices are configured separately. This sensor device detects the predetermined event related to the monitored person Ob and notifies (reports or transmits) the management server device. Upon receiving the notification from the sensor device, the management server device manages the event that has received the notification, and re-notifies the event to a predetermined terminal device associated with the sensor device. Send. Although the terminal device may be one type of device, in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, while the portable terminal device is operated by being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the mobile terminal device are substantially the same, in the following embodiments, the mobile terminal device will be mainly described.

FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram showing a configuration of a sensor device in the monitored person monitoring system shown in FIG. FIG. 3 is a diagram showing the configuration of the mobile terminal device in the monitored person monitoring system shown in FIG. FIG. 4 is a diagram showing a configuration of a monitoring information table stored in the mobile terminal device shown in FIG. FIG. 5 is a diagram showing a configuration of a sensor information table stored in the mobile terminal device shown in FIG. FIG. 6 is a diagram showing a configuration of a notification sound information table stored in the portable terminal device shown in FIG.

More specifically, such a monitored person monitoring system MS includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, A fixed terminal device SP and one or a plurality of portable terminal devices TA (TA-1, TA-2) are provided. These are wired or wireless, such as a LAN (Local Area Network), a telephone network, and a data communication network. Communication is established via a network (network, communication line) NW. The network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the plurality of portable terminal devices TA-1 and TA-2 are wireless including an access point AP. A LAN (for example, a LAN according to the IEEE 802.11 standard) NW is connected to be communicable with each other.

The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.

The sensor device SU has a communication function that communicates with other devices SV, SP, TA via the network NW, detects a predetermined event related to the monitored person Ob, and sends the detected event to the management server device SV. To the terminal devices SP and TA, generate an image including a moving image, and distribute the moving image to the terminal devices SP and TA. The predetermined event preferably includes an event that needs to be dealt with (responded). In the present embodiment, the predetermined event includes a predetermined action in the monitored person Ob and includes a nurse call. For example, as shown in FIG. 2, the sensor device SU includes a sensor unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process. Unit (SU control processing unit) 14, sensor side communication interface unit (SU communication IF unit) 15, and sensor side storage unit (SU storage unit) 16.

The sensor unit 11 is a device that is connected to the SU control processing unit 14 and detects predetermined various amounts set in advance in the monitored person Ob in accordance with the control of the SU control processing unit 14. The predetermined amounts are appropriately determined according to a predetermined action to be detected in the monitored person Ob. In the present embodiment, the predetermined behavior includes, for example, getting up when the monitored person Ob occurred, leaving the monitored person Ob away from the bedding, falling over when the monitored person Ob collapsed, and the body of the monitored person Ob For example, the sensor unit 11 includes an imaging unit 111 and a body motion measurement unit 112 in order to detect the four behaviors of abnormal microscopic motion whose motion is abnormal. The predetermined action may further include a fall of the monitored person Ob from the bedding.

The imaging unit 111 is an apparatus that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The imaging unit 111 is arranged so as to be able to monitor a space where the monitored person Ob is scheduled (location space, in the example shown in FIG. 1, the room RM of the installation location), and above the location space as an imaging target The image (image data) overlooking the imaging target is generated, and the imaging target image (target image) is output to the SU control processing unit 14. Preferably, since there is a high probability that the entire monitored person Ob can be imaged, the imaging unit 111 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed). The sensor device SU uses the imaging unit 111 to obtain an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.

Such an imaging unit 111 may be a device that generates an image of visible light, but in this embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. . For example, in the present embodiment, such an imaging unit 111 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface. An image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and image data that represents an infrared image in the imaging target by performing image processing on the output of the image sensor It is a digital infrared camera provided with the image processing part etc. which produce | generate. In the present embodiment, the imaging optical system of the imaging unit 111 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 111 is disposed. .

The body movement measuring unit 112 is connected to the SU control processing unit 14 and is a device that measures a predetermined body movement in the monitored person Ob according to the control of the SU control processing unit 14. In the present embodiment, the predetermined body movement is a movement of the body surface of the chest associated with breathing. For this reason, the body movement measurement unit 112 includes, for example, a Doppler sensor. This Doppler sensor is a body motion sensor that transmits a transmission wave, receives a reflection wave of the transmission wave reflected by an object, and outputs a Doppler signal having a Doppler frequency component based on the transmission wave and the reflection wave. . When the object is moving, the frequency of the reflected wave is shifted in proportion to the moving speed of the object due to the so-called Doppler effect. Arise. The Doppler sensor generates a signal of the Doppler frequency component as a Doppler signal and outputs it to the SU control processing unit 14. The transmission wave may be an ultrasonic wave, a microwave, or the like, but is a microwave in the present embodiment. Since the microwave can be transmitted through the clothing and reflected from the body surface of the monitored person Ob, the movement of the body surface can be detected even when the monitored person Ob is wearing clothes.

The SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and acquires an external sound and inputs it to the sensor device SU, and represents an electric signal representing the sound according to the control of the SU control processing unit 14 It is a circuit for generating and outputting a sound according to. The SU sound input / output unit 12 includes, for example, a microphone that converts sound acoustic vibrations into electrical signals, and a speaker that converts sound electrical signals into sound acoustic vibrations. The SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, converts the electric signal input from the SU control processing unit 14 into an acoustic vibration of sound, and outputs the sound.

The nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SU. Note that the nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.

The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication according to the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing the data to be transferred input from the SU control processing unit 14 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. The data is converted into data in a proper format and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.

The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. The various predetermined programs include, for example, a SU control program that controls each unit of the sensor device SU according to the function of each unit, and a predetermined action in the monitored person Ob based on the output of the sensor unit 11 Then, when the behavior detection processing program for notifying the management server device SV or the nurse call reception operation unit 13 accepts the nurse call, the management server device SV is notified of the fact, and the SU sound input / output unit 12 or the like is used. A nurse call processing program for making a voice call with the terminal devices SP and TA, a SU streaming processing program for streaming the moving image generated by the imaging unit 111 to the terminal device SP and TA that requested the moving image, and the like. A control processing program is included. For the various types of predetermined data, each program such as a sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the own device and a communication address of the management server device SV is executed. Data necessary for the above is included. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) that serves as a working memory of the so-called SU control processing unit 14 that stores data generated during the execution of the predetermined program.

The SU control processing unit 14 controls each unit of the sensor device SU according to the function of each unit, detects a predetermined event related to the monitored person Ob, and notifies the management server device SV of the detected event. This is a circuit for performing a voice call with the terminal devices SP and TA, generating an image including a moving image, and distributing the moving image to the terminal devices SP and TA. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SU control processing unit 14 executes a sensor processing unit (SU control unit) 141, a behavior detection processing unit 142, a nurse call processing unit 143, and a sensor side streaming processing unit (SU streaming processing) by executing the control processing program. Part) 144 is functionally provided.

The SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.

The behavior detection processing unit 142 detects a predetermined behavior set in advance in the monitored person Ob based on the output of the sensor unit 11, and notifies the management server device SV. More specifically, in the present embodiment, as described above, the predetermined behavior is awakening, getting out of bed, falling over, and abnormal micromotion. These getting up, getting out of bed, and falling are detected based on the output (target image) of the imaging unit 111, and the minute body movement abnormality is detected based on the output (Doppler signal) of the body movement measuring unit 112. More specifically, for example, the behavior detection processing unit 142 detects the head of the monitored person Ob based on the target image captured by the imaging unit 11, and the size of the head of the detected monitored person Ob is detected. Based on the time change, the wake-up, getting-off and falling of the monitored person Ob are detected. More specifically, first, the SU storage unit 16 stores the location area of the bedding BT and the first to third threshold values Th1 to Th3 as one of the various predetermined data. The first threshold Th1 is a value for identifying the size of the head in the lying posture and the size of the head in the sitting posture in the region where the bedding BT is located. The second threshold Th2 is a value for identifying whether or not the head is in the standing posture in the living room RM excluding the region where the bedding BT is located. The third threshold Th3 is a value for identifying whether or not the head is in the lying position in the living room RM excluding the area where the bedding BT is located. And the action detection process part 142 extracts a moving body area | region as a human body area | region of the to-be-monitored person Ob from a target image by the background difference method or the frame difference method, for example. Next, the behavior detection processing unit 142 uses, for example, a circular or elliptical Hough transform from the extracted moving object region, for example, by pattern matching using a head model prepared in advance, or for example, for head detection. The head region of the monitored person Ob is extracted by the neural network learned in step (b). And the action detection process part 142 detects awakening, getting out of bed, and a fall from the position and magnitude | size of this extracted head. For example, the action detection processing unit 142 determines that the position of the extracted head is within the region where the bedding BT is located, and the size of the extracted head uses the first threshold Th1 to determine the size of the lying posture. When the time changes from the sitting posture to the size of the sitting posture, it is determined that the user gets up and the rising is detected. For example, the behavior detection processing unit 142 is a case where the position of the extracted head changes over time from the location of the bedding BT to the outside of the location of the bedding BT, and the size of the extracted head is the first When the time changes from a certain size to the size of the standing posture by using the threshold value Th2, it is determined that the user has left the bed, and the bed is detected. For example, the behavior detection processing unit 142 uses the third threshold value Th1 when the extracted head position is in the room RM excluding the area where the bedding BT is located and the size of the extracted head is the third threshold Th1. When the time changes from the size to the size of the recumbent posture, it is determined that the vehicle has fallen, and the fall is detected. In the case of detecting a fall, for example, the behavior detection processing unit 142 is a case where the position of the extracted head changes over time from within the region where the bedding BT is located to outside the region where the bedding BT is located, If the size of the extracted head changes with time from a certain size to the size of the lying posture by using the third threshold value Th3, it is determined that the head has fallen and the fall is detected. Then, the behavior detection processing unit 142 detects the movement of the body surface of the chest (the vertical movement of the chest) accompanying the breathing motion of the monitored person Ob based on the output of the body movement measurement unit 112, and the movement of the body surface of the chest is detected. When the amplitude of the movement of the body surface of the chest that is less than a preset threshold or less than a preset threshold is detected, it is determined that the minute movement abnormality is detected, and the minute movement abnormality is detected.

When the predetermined behavior is detected in this way, the behavior detection processing unit 142 notifies the event containing event information (event information) representing the content of the predetermined event (phenomenon) related to the monitored person Ob. The first event notification communication signal is notified to the management server device SV by the SU communication IF unit 15. More specifically, the behavior detection processing unit 142 includes the sensor ID of the own device, the event information indicating the content of the event, and a communication signal (first signal) that contains the target image used when detecting the rising, leaving, and falling. Event notification communication signal) is transmitted to the management server device SV via the SU communication IF unit 15. In the present embodiment, the event information is one or more of getting up, getting out of bed, falling, abnormal movement of the minute body, and nurse call (NC). Here, the behavior detection processing unit 142 detects the getting up, getting out of bed. One or more of the fall and abnormal micromotion are accommodated in the first event notification communication signal as the event information. The image may be at least one of a still image and a moving image. In the present embodiment, as described later, first, a still image is notified, and the moving image is distributed in response to a user request. First, a moving image may be distributed, a still image and a moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.

The nurse call processing unit 143 notifies the management server device SV of a first event notification communication signal accommodated as another example of the predetermined event when the nurse call reception operation unit 13 receives a nurse call. A voice call is performed with the terminal devices SP and TA by using the SU sound input / output unit 12 or the like. More specifically, when the nurse call reception operation unit 13 is input and operated, the nurse call processing unit 143 transmits the first event notification communication signal containing the nurse call as the sensor ID of the own device and the event information as the SU communication. The data is transmitted to the management server device SV via the IF unit 15. The nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to make a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

When there is a video distribution request from the fixed terminal device SP or the mobile terminal device TA via the communication IF unit 3, the SU streaming processing unit 144 sends the request to the fixed terminal device SP or the mobile terminal device TA that has made the request. The moving image generated by the imaging unit 11 (for example, a live moving image) is distributed via the SU communication IF unit 15 by streaming reproduction.

FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob. The second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.

The management server device SV has a communication function that communicates with other devices SU, SP, TA via the network NW, and receives a notification of a predetermined event related to the monitored person Ob from the sensor device SU. It is a device that manages information related to monitoring Ob (monitoring information). When the management server device SV receives the first event notification communication signal from the sensor device SU as the event notification, the management server device SV relates to the monitoring of the monitored person Ob based on each information accommodated in the first event notification communication signal. A predetermined terminal device that stores (records) monitoring information and associates a communication signal (second event notification communication signal) containing the monitoring information related to monitoring of the monitored person Ob in advance with the sensor device SU. Send to SP, TA. For this purpose, the management server device SV indicates the notification destination (re-notification destination, re-notification destination, transmission destination) such as the first event notification communication signal transmitted from the sensor device SU and the notification of the sensor ID that is the transmission source. The correspondence relationship (notification destination correspondence relationship) with the terminal ID (re-notification destination) and the communication address thereof are stored. The terminal ID (terminal device identifier) is an identifier for identifying and identifying the terminal devices SP and TA. In the second event notification communication signal, when the event information accommodated in the first event notification communication signal is the predetermined action (one or more of getting up, getting out of bed, falling, and abnormal micromotion) Is a communication corresponding to the sensor device SU having the sensor ID accommodated in the first event notification communication signal as the download destination of the sensor ID, the event information and the target image, and the moving image accommodated in the first event notification communication signal. Address is accommodated. When the event information accommodated in the first event notification communication signal is nurse call reception information, the sensor ID and the event information accommodated in the first event notification communication signal are included in the second event notification communication signal. Be contained. The management server device SV provides the client with data corresponding to the request of the client (in this embodiment, the fixed terminal device SP and the portable terminal device TA). Such a management server device SV can be configured by, for example, a computer with a communication function.

The fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. The user interface (UI) of the monitored person monitoring system MS is input by inputting predetermined instructions and data to be given to the management server device SV and the portable terminal device TA, or displaying the monitoring information obtained by the sensor device SU. ). Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. The fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in this specification, a mobile terminal device TA that is another example of the terminal device will be described.

The mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. A monitoring function (including moving images) obtained by the sensor device SU by inputting a predetermined instruction or data to be provided to the management server device SV or the sensor device SU, or by notification from the management server device SV. It is a device for displaying or making a nurse call response or calling out by voice call with the sensor device SU. In the present embodiment, the mobile terminal device TA outputs a predetermined notification sound when receiving an event notification by the second event notification communication signal from the sensor device SU via the management server device SV. When a notification of a new event is received during the output, the notification sound being output is continued based on the notification of the new event. In the present embodiment, for example, as shown in FIG. 3, such a mobile terminal device TA includes a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, and A terminal side storage unit (TA storage unit) 33, a terminal side sound input / output unit (TA sound input / output unit) 34, a terminal side input unit (TA input unit) 35, and a terminal side display unit (TA display unit). 36 and a terminal-side interface unit (TAIF unit) 37.

The TA sound input / output unit 34 is connected to the TA control processing unit 32 and is a circuit for acquiring an external sound and inputting it to the portable terminal device TA. It is a circuit for generating and outputting sound corresponding to a signal. Similar to the SU sound input / output unit 12, the TA sound input / output unit 34 includes, for example, a microphone that converts acoustic vibration into an electric signal, and a speaker that converts an electric signal of sound into an acoustic vibration of sound. Composed. The TA sound input / output unit 34 outputs an electric signal representing an external sound to the TA control processing unit 32, converts the electric signal input from the TA control processing unit 32 into an acoustic vibration of sound, and outputs the sound.

The TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a circuit that accepts a predetermined operation and inputs it to the mobile terminal device TA, for example, a plurality of input switches assigned with a predetermined function. . The predetermined operation includes, for example, an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the notified monitored person. Various operations necessary for monitoring, such as an input operation indicating that there is an intention to respond (correspond) to the detection result of the event with respect to Ob (execution intention information) are included. The TA display unit 36 is connected to the TA control processing unit 32, and under the control of the TA control processing unit 32, the predetermined operation content input from the TA input unit 35 and the monitored target MS monitored by the monitored person monitoring system MS. This is a circuit that displays the monitoring information related to monitoring of the monitoring person Ob (for example, the type of a predetermined action detected by the sensor device SU, the image (still image and moving image) of the monitored person Ob), the reception of a nurse call, etc. A display device such as an LCD (Liquid Crystal Display) and an organic EL display. In the present embodiment, the TA input unit 35 and the TA display unit 36 constitute a touch panel. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user such as a nurse or a caregiver ( When the monitor) touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal device TA as the operation input content of the user. Entered.

The TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device according to the control of the TA control processing unit 32. For example, the TAIF unit 37 uses the Bluetooth (registered trademark) standard. An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard.

The TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication according to the control of the TA control processing unit 32, similarly to the SU communication IF unit 15. The TA communication IF unit 31 generates a communication signal containing the data to be transferred input from the TA control processing unit 32 in accordance with the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SU, SV, SP via the network NW. The TA communication IF unit 31 receives a communication signal from another device SU, SV, SP via the network NW, extracts data from the received communication signal, and the TA control processing unit 32 can process the extracted data. The data is converted into data of a proper format and output to the TA control processing unit 32. The TA communication IF unit 31 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.

The TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. Examples of the various predetermined programs include a TA control program for controlling each part of the mobile terminal device TA according to the function of each part, and a TA monitoring process for executing predetermined information processing related to monitoring of the monitored person Ob. A program, a call processing program for making a voice call with the sensor device SU by using the TA sound input / output unit 34, and the like. A control processing program such as a TA streaming processing program displayed on the TA display unit 36 is included. The TA monitoring processing program includes a log program for storing (recording) information related to monitoring (monitoring information) for the monitored person Ob in the TA storage unit 33 upon receiving an event notification from the management server device SV, and the event notification. Notification sound control program for outputting a notification sound corresponding to the type of event received from the TA sound input / output unit 34, a display control program for displaying the monitoring information on the TA display unit 36, etc. Various programs are included. In the various predetermined data, the terminal ID of the own device, the screen information displayed on the TA display unit 36, the monitoring information related to the monitoring of the monitored person Ob, the sensor information related to the sensor device SU, and the notification of the event are received. In this case, data necessary for executing each program such as notification sound information related to notification sound output from the TA sound input / output unit is included. In order to store each of the monitoring information, the sensor information, and the notification sound information, the TA storage unit 33 includes a terminal side monitoring information storage unit (TA monitoring information storage unit) 331, a terminal side sensor information storage unit (TA sensor information storage unit). ) 332 and notification sound information 333 functionally.

The TA monitoring information storage unit 331, as the monitoring information, in this embodiment, the sensor ID accommodated in the second event notification communication signal received from the management server device SV, event information (in this embodiment, getting up, getting out of bed, falling down) , Abnormal movement and nurse call), the communication address of the sensor device SU to which images and videos are downloaded, and the monitoring of the monitored person Ob, such as the reception time of the second event notification communication signal. The monitoring information of the monitored person Ob transmitted / received to / from each of SP, TA is stored.

In the present embodiment, this monitoring information is stored in the TA monitoring information storage unit 331 in a table format. The terminal-side monitoring information table (TA monitoring information table) MT-TA for registering this monitoring information includes, for example, sensor IDs contained in communication signals received from the devices SU, SP, and TA as shown in FIG. A sensor ID field 3311 to be registered, an event field (event field) 3312 for registering event information accommodated in the received communication signal, a reception time field 3313 for registering a reception time of the received communication signal, and the reception The still image field 3314 for registering the still image accommodated in the received communication signal, and the communication address (for example, IP address) of the sensor device SU corresponding to the sensor ID accommodated in the received communication signal as the acquisition destination of the live video Etc.) and the received video signal 3315 and the received communication signal. A corresponding field 3316 for registering the presence or absence of the corresponding reception to the event information comprises a record for each communication signal thus received (for each event). In the still image field 3314, for example, still image data may be registered, and for example, a file name of still image data may be registered. In the response field 3316, as will be described later, the terminal devices SP and TA accept that there is an intention (“corresponding”) to handle (corresponding, treating, or taking measures) the event information accommodated in the received communication signal. A flag (corresponding flag) indicating whether or not has been registered. For example, in this embodiment, the correspondence field 3316 indicates that there is an intention to deal with event information (event information registered in the event field 3312) contained in the received communication signal (“corresponding”). The terminal device SP or TA indicates that the corresponding flag “1” means that it has been received by the devices SP and TA, or the intention to deal with the event information contained in the received communication signal (“corresponding”). Corresponding flag “0” meaning that it is not accepted is registered. Note that, by default, the correspondence field “3316” is registered with a correspondence flag “0” meaning “not accepted”. When the second event notification communication signal contains the detection time when the predetermined action is detected or the nurse call reception time when the nurse call is received, the detection time or the nurse is used instead of the reception time. The call reception time may be registered.

The TA sensor information storage unit 332 stores the sensor information. In the present embodiment, the sensor information is information related to the sensor device SU, and is information in which the sensor ID of the sensor device SU and the monitored person name of the monitored person Ob are associated with each other.

In this embodiment, such sensor information is stored in the TA sensor information storage unit 332 in a table format. More specifically, the terminal side sensor information table (TA sensor information table) ST-TA is registered in a sensor ID field 3321 for registering a sensor ID and the sensor ID field 3321 as shown in FIG. An installation location field 3322 for registering the location of the sensor device SU having the sensor ID being monitored, and a monitored person Ob (ie, monitored by the sensor device SU having the sensor ID registered in the sensor ID field 3321). The monitored person name field 3323 for registering the monitored person name of the monitored person Ob) at the location where the sensor device SU having the sensor ID registered in the sensor ID field 3321 is provided, and the sensor ID field 3321 A sensor device SU having a sensor ID registered in the Of a remarks field 3324 for registering the remarks regarding the monitored person Ob, sensor ID by (i.e., sensor devices SU another) to have a record.

The notification sound information storage unit 333 stores the notification sound information. The notification sound information is information related to the notification sound output from the TA sound input / output unit 34 when the event notification is received. In the present embodiment, the event includes a plurality of types of the predetermined action and nurse call, and the predetermined action also includes a plurality of awakening, getting out of bed, falling, and abnormal micromotion. In this embodiment, the notification sound is set in advance according to the event type so that the event type can be audibly recognized by the notification sound. Therefore, more specifically, the notification sound information is information in which a plurality of different event types are associated with a plurality of different notification sounds according to the event type.

In this embodiment, such notification sound information is stored in the notification sound information storage unit 333 in a table format. More specifically, the notification sound information table TT is set in advance in accordance with, for example, an event field 3331 for registering an event type and an event type registered in the event field 3331 as shown in FIG. A notification sound field 3332 for registering the notified notification sound (notification sound data), and a record for each event type. In the present embodiment, as described above, the types of events are awakening, getting out of bed, falling, abnormal movement of the minute body, and nurse call. For this reason, in the example shown in FIG. 6, the event field 3331 of each record contains wake-up, getting-off, falling, minute movement abnormality, and nurse call, respectively, and the notification sound field 3332 of each record includes each of them. Corresponding wake-up notification sound data (Totetototote), get-off notification sound data (Popane Popain), fall notification sound data (Tin-Contin-Tin-Con), separation body movement abnormality notification sound data (B-B) and nurse call notification sound data (Pico Pico) ) Are registered for each phrase. In this embodiment, the notification sound is output again in order to prompt (remind) after the output of the notification sound. Therefore, the remind is not an event type but an event type, and an event field of one record. In 331, remind is registered, and in the notification sound field of this record, remind notification sound data (ton tempo rolon) is registered as data for one phrase.

The TA control processing unit 32 controls each part of the mobile terminal device TA according to the function of each part, receives and displays the monitoring information for the monitored person Ob, receives input of implementation intention information, It is a circuit for responding and calling out. The TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 32 executes a terminal processing unit (TA control unit) 321, a terminal side monitoring processing unit (TA monitoring processing unit) 322, a call processing unit 323, and a terminal side streaming process by executing a control processing program Unit (TA streaming processing unit) 324 functionally.

The TA control unit 321 controls each part of the mobile terminal apparatus TA according to the function of each part, and controls the entire mobile terminal apparatus TA.

The TA monitoring processing unit 322 executes predetermined information processing related to monitoring of the monitored person Ob. More specifically, when the TA monitoring processing unit 322 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU. The monitoring information of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331 based on each information (each data) accommodated in the received second event notification communication signal. The TA monitoring processing unit 322 displays a screen corresponding to each piece of information contained in the received second event notification communication signal on the TA display unit 36. Then, when receiving a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process corresponding to the input operation.

In this embodiment, the TA monitoring processing unit 322 functionally includes a notification sound control unit 3221. The notification sound control unit 3221 outputs a predetermined notification sound from the TA sound input / output unit 34 when an event notification is received by the second event notification communication signal, and the notification sound is input to the TA sound input unit. When a notification of a new event is received by a new second event notification communication signal during output from the output unit 34, the notification sound being output is continued. More specifically, when the notification sound control unit 3221 receives an event notification by the second event notification communication signal, the notification sound control unit 3221 displays a notification sound corresponding to the event type of the received notification as a notification sound information storage unit. Based on the notification sound information stored in 333, the TA sound input / output unit 34 outputs a new event by a new second event notification communication signal while the notification sound is being output from the TA sound input / output unit 34. If the event type of the newly received notification is the same as the event type corresponding to the notification sound being output, the notification sound being output is continued. To do. On the other hand, the notification sound control unit 3221, when the event type of the newly received notification is not the same (different) as the event type corresponding to the notification sound being output, The notification sound is stopped, and a notification sound corresponding to the type of the newly received notification event is output from the TA sound input / output unit 34 based on the notification sound information. The notification sound control unit 3221 stops the notification sound being output when an input operation of a “corresponding” button 524 described later is received while the notification sound is being output from the TA sound input / output unit 34. .

The notification sound control unit 3221 continuously outputs the notification sound from the TA sound input / output unit 34 for a predetermined first time. After the output of the notification sound is finished, the notification sound control unit 3221 Is output from the TA sound input / output unit. The reminder notification sound is preset with a melody different from the melody of the notification sound set according to the type of event. In order to time each of the first time and the second time, as shown by a broken line in FIG. 3, the TA monitoring processing unit 322 functionally counts the time from the start of notification sound output as necessary. , The first timer 3222 for measuring the first time is generated and deleted, and the second timer 3223 for measuring the second time is generated and deleted. The starting point of starting the time measurement in the second timer 3223 may be the time when the output of the notification sound is finished, but in the present embodiment, when the predetermined first time has elapsed from the time of the latest notification. is there. For this reason, as indicated by a broken line in FIG. 3, the TA monitoring processing unit 322 functionally starts counting from the time when the latest notification is received and counts the first time as necessary. Timer 3224 is created and deleted. Each of these first and second times is set to an appropriate arbitrary time length such as 30 seconds, 1 minute, 2 minutes, 5 minutes, and the like.

Furthermore, in this embodiment, notification priority is assigned to each of the plurality of different event types. The notification priority order is an order in which notification of an event for outputting a notification sound is determined from notification of a plurality of events when a notification of a plurality of events of different types is received. For example, in the present embodiment, the nurse call has a high probability that the monitored person Ob requests the response (response) of the monitor (user), and therefore, the priority of notification in the nurse call is set to be the highest. ing. In the present embodiment, for example, in the present embodiment, the priority levels of the remaining notifications other than the nurse call in the plurality of event types are set in the order of remind, fall, get out of bed, and wake up (nurse call> remind). > Tumble> Get out of bed> Wake up). There may be an event type with the same priority. When the notification sound control unit 3221 receives a notification of a new event while outputting the notification sound from the TA sound input / output unit 34, the notification sound control unit 3221 corresponds to the priority order corresponding to the type of the event of the newly received notification. Is lower than the priority corresponding to the type of event corresponding to the notification sound being output, the notification sound being output is continued. On the other hand, when the notification sound control unit 3221 receives a notification of a new event while the notification sound is being output from the TA sound input / output unit 34, the notification sound control unit 3221 corresponds to the type of the newly received notification event. If the priority is higher than the priority corresponding to the type of event corresponding to the notification sound being output, the notification sound being output is stopped, and the newly received event type of notification is received. A corresponding notification sound is output from the TA sound input / output unit based on the notification sound information.

The call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 or the like. More specifically, for example, the call processing unit 323 transmits the first event notification communication signal that causes the transmission of the second event notification communication signal to the management server device SV using the TA sound input / output unit 34 or the like. For example, VoIP is performed with the transmission source sensor device SU.

The TA streaming processing unit 324 receives the distribution of the moving image from the sensor device SU, and displays the distributed moving image on the TA display unit 36 by streaming reproduction.

Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.

Next, the operation of this embodiment will be described. FIG. 7 is a flowchart showing the operation of the sensor device shown in FIG. FIG. 8 is a flowchart showing an operation related to the monitoring process in the mobile terminal device shown in FIG. FIG. 9 is a flowchart showing an operation related to the first output processing of the notification sound in the mobile terminal device shown in FIG. FIG. 10 is a flowchart showing an operation related to the second output processing of the notification sound in the portable terminal device shown in FIG. FIG. 11 is a flowchart showing an operation related to an input operation of a “corresponding” button in the mobile terminal device shown in FIG. FIG. 12 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. FIG. 13 is a diagram showing an example of a monitoring information screen displayed on the mobile terminal device shown in FIG. FIG. 14 is a diagram showing an example of a nurse call reception screen displayed on the mobile terminal device shown in FIG.

In such a monitored person monitoring system MS, each device SU, SV, SP, TA performs initialization of each necessary part and starts its operation when the power is turned on. In the sensor device SU, by executing the control processing program, the SU control processing unit 14 is functionally configured with a SU control unit 141, a behavior detection processing unit 142, a nurse call processing unit 143, and a SU streaming processing unit 144. . In the portable terminal device TA, by executing the control processing program, the TA control processing unit 32 is functionally configured with a TA control unit 321, a TA monitoring processing unit 322, a call processing unit 323, and a TA streaming processing unit 324. The TA monitoring processing unit 322 is functionally configured with a notification sound control unit 3221 and, as will be described later, first to third timers 3222 to 3224 are configured and removed as necessary.

First, the operation of the sensor device SU will be described. The sensor device SU operates as follows for each frame or every several frames, thereby detecting a predetermined operation in the monitored person Ob and determining whether or not a nurse call is accepted.

In FIG. 7, first, the sensor device SU acquires an image (image data) for one frame from the imaging unit 111 of the sensor unit 11 as the target image by the SU control unit 141 of the SU control processing unit 14 (S11). .

Next, the sensor device SU detects a first behavior that can be detected by the behavior detection processing unit 142 of the SU control processing unit 14 based on a target image among predetermined behaviors of the monitored person Ob. Is executed based on the target image acquired in the process S11, and the first detection result is stored in the SU storage unit 16 (S12). In the present embodiment, the first action is getting up, getting out of bed, and falling, and the action detection processing unit 142 determines whether or not to get up, determines whether or not to get out of bed, and determines whether or not to fall.

Next, the sensor device SU acquires the output of the body movement measurement unit 112 of the sensor unit 11 by the SU control unit 141 of the SU control processing unit 14 (S13).

Next, the sensor device SU detects the second behavior that can be detected based on the output of the body motion measurement unit 112 among the predetermined behaviors of the monitored person Ob by the behavior detection processing unit 142 of the SU control processing unit 14. The second action detection process is executed based on the output of the body movement measurement unit 112 acquired in the process S13, and the second detection result is stored in the SU storage unit 16 (S14). In the present embodiment, the second action is a minute movement abnormality, and the action detection processing unit 142 determines whether the minute movement abnormality is successful.

Next, the sensor device SU uses the behavior detection processing unit 142 based on the first detection result and the second detection result stored in the SU storage unit 16 in the processing S12 and the processing S14 to perform the predetermined detection in the monitored person Ob. It is determined whether or not an action has been detected (S15). As a result of the determination, when the predetermined action is not detected (No), the sensor device SU next executes the process S17, while when the predetermined action is detected (Yes). The sensor device SU executes the process S17 after executing the next process S16.

In this process S16, in order to notify the detected predetermined behavior to the predetermined terminal devices SP and TA via the management server device SV, the sensor device SU is used as the predetermined event by the behavior detection processing unit 142. A first event notification communication signal relating to detection of the predetermined action is transmitted to the management server device SV. More specifically, the behavior detection processing unit 142 includes a sensor ID of the own device, event information (here, one or more of getting up, getting out of bed, falling, and abnormal micromotion) and a first event containing a target image. The notification communication signal is transmitted to the management server device SV via the SU communication IF unit 15.

In the process S17, the sensor device SU determines whether the nurse call is accepted by the nurse call processing unit 143. That is, the processes S11 to S18 shown in FIG. 7 are repeatedly executed for each frame or every several frames, but during the period from the previous execution of the process S17 to the current execution of the process S17, It is determined whether or not the call reception operation unit 13 has been operated. As a result of this determination, when the nurse call reception operation unit 13 is not operated and the nurse call is not received (No), the sensor device SU ends the current process, while the nurse call reception operation unit 13 Is operated and the nurse call is accepted (Yes), the sensor device SU ends the current process after executing the next process S18.

In this process S18, the sensor device SU uses the nurse call processing unit 143 to notify the predetermined terminal device SP, TA of the nurse call whose reception is found in the process S17 via the management server device SV. The first event notification communication signal related to the nurse call is transmitted to the management server device SV as the event. More specifically, the nurse call processing unit 143 sends a first event notification communication signal containing the sensor ID and event information (here, nurse call reception information) of the own device via the SU communication IF unit 15 to the management server. Send to device SV.

The sensor device SU operates as described above with respect to each of detection of a predetermined action and reception of a nurse call in the monitored person Ob.

When the management server device SV receives the first event notification communication signal from the sensor device SU via the network NW, the management server device SV receives monitoring information relating to monitoring of the monitored person Ob contained in the received first event notification communication signal. Remember (record). Then, the management server device SV transmits a second event notification communication signal to the notification destination terminal devices SP and TA corresponding to the sensor device SU that has transmitted the received first event notification communication signal. In the second event notification communication signal, the event information accommodated in the received first event notification communication signal is the predetermined action (one or more of awakening, getting out of bed, falling, and abnormal body movement). In the case, it corresponds to the sensor device SU having the sensor ID accommodated in the first event notification communication signal as the download destination of the sensor ID, the event information and the target image, and the moving image accommodated in the first event notification communication signal. The communication address to be stored is accommodated. When the event information accommodated in the first event notification communication signal is nurse call reception information, the sensor ID and the event information accommodated in the first event notification communication signal are included in the second event notification communication signal. Be contained.

As a result, a predetermined action or nurse call in the monitored person Ob is notified from the sensor device SU to the terminal devices SP and TA via the management server device SV, and, for example, a nurse or a caregiver is transmitted via the terminal devices SP and TA. A supervisor (user) such as an expert is notified.

Next, the operation of the terminal devices SP and TA will be described. Here, as an example, the operation of the mobile terminal device TA will be described. As described above, when the power is turned on and the operation starts, the portable terminal device TA accepts a login operation by a monitor (user) such as a nurse or a caregiver, and the TA monitor processing unit 322 automatically performs the login operation. A standby screen for waiting for a communication signal addressed to the machine is displayed on the TA display unit 36. For example, as shown in FIG. 12, the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating standby (for example, “no notification”) and an icon. 512, a time area 513 for displaying the current time, a year / month / sunday area 514 for displaying the current year / month / sunday, and a user name area 515 for displaying the name of the user who is currently logged in to the portable terminal device TA. Is provided.

In FIG. 8, the portable terminal device TA determines whether or not the TA communication IF unit 31 has received a communication signal by the TA control unit 321 of the TA control processing unit 32 (S31). As a result of this determination, when the communication signal is not received (No), the mobile terminal device TA returns the process to S31, and as a result of the determination, when the communication signal is received (Yes), The portable terminal device TA executes the following process S32. That is, the mobile terminal device TA is waiting for reception of a communication signal.

In process S32, the portable terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the communication signal received in the process S31 is the second event notification communication signal (second event notification), the portable terminal device TA executes the next process S33, and in the process S31. When the received communication signal is not the second event notification communication signal (others), the process ends after executing the process S38 for performing an appropriate process according to the communication signal received in the process S31.

In the process S33, the mobile terminal device TA monitors the monitored person Ob contained in the second event notification communication signal received from the management server apparatus SV in the process S31 by the TA monitoring processing unit 322 of the TA control processing unit 32. Is stored (recorded) in the TA monitoring information storage unit 331.

After this processing S33, the TA monitoring processing unit 322 performs a first notification sound output process for outputting a predetermined notification sound from the TA sound input / output unit 34 by the notification sound control unit 3221.

More specifically, in FIG. 9, the notification sound control unit 3221 first determines whether or not a notification sound is output from the TA sound input / output unit 34 (S341). If the result of this determination is that a notification sound is being output (Yes, outputting), the notification sound control unit 3221 executes the next process S342, while the result of the determination is that a notification sound is being output. If not (No), the notification sound control unit 3221 executes the next process S345.

In this process S342, the notification sound control unit 3221 determines the event type corresponding to the event information accommodated in the second event notification communication signal received in process S31, and the event type corresponding to the notification sound being output. It is determined whether or not is the same kind. Note that the type of event corresponding to the notification sound being output is recognized from the type of event stored in the TA storage unit 33 in association with the first timer 3222 as will be described later. If the result of this determination is the same type (Yes), the notification sound control unit 3221 executes the next process S344, while if the result of the determination is that it is not the same type (different) (No). The notification sound control unit 3221 executes the next process S343.

In this process S343, the notification sound control unit 3221 determines that the notification priority given to the event type corresponding to the event information accommodated in the second event notification communication signal received in process S31 is the notification being output. It is determined whether or not the priority of the notification given to the event type corresponding to the sound is higher. If the result of this determination is high (Yes), the notification sound control unit 3221 executes the next process S346. On the other hand, if the result of the determination is not high (below), the notification sound control unit 3221 performs notification. The sound control unit 3221 executes the next process S344.

In the process S344, the notification sound control unit 3221 continues the notification sound being output as it is. Therefore, when the event type corresponding to the event information accommodated in the second event notification communication signal received in step S31 is the same type as the event type corresponding to the notification sound being output, the output The notification sound inside is continued as it is. The notification given to the event type corresponding to the notification sound being output, the priority of the notification given to the event type corresponding to the event information accommodated in the second event notification communication signal received in step S31 If the priority order is lower than the priority order, the notification sound being output is continued as it is.

When the third timer 3224 is generated in the TA monitoring processing unit 322 after this processing S344, the notification sound control unit 3221 deletes the existing third timer 3224, and again starts the third timer. 3224 is functionally formed in the TA monitoring processing unit 322, the time measurement is started (S345), this processing is terminated, and the processing S35 shown in FIG. 8 is executed.

In the process S346, the notification sound control unit 3221 newly generates a notification sound corresponding to the event type corresponding to the event information accommodated in the second event notification communication signal received in the process S31 from the TA sound input / output unit 34. Output. More specifically, the notification sound control unit 3221 registers, in the event field 3331, the event type corresponding to the event information accommodated in the second event notification communication signal received in step S31 from the notification sound information table TT. A record to be selected is selected (searched), a notification sound (notification sound data) registered in the notification sound field 3333 of the selected record is extracted, and the extracted notification sound is newly output from the TA sound input / output unit 34. In this embodiment, since the notification sound data is only for one phrase, the notification sound for one phrase is repeated while the notification sound is being output. Therefore, when the notification sound is not output, a notification sound is newly output. The notification given to the event type corresponding to the notification sound being output, the priority of the notification given to the event type corresponding to the event information accommodated in the second event notification communication signal received in step S31 If it is higher than the priority, the notification sound is newly output.

And after this process S346, the notification sound control part 3221 performs the predetermined | prescribed process of the 1st timer 3222 (S347). More specifically, when the first timer 3222 is generated in the TA monitoring processing unit 322, the notification sound control unit 3221 deletes the existing first timer 3222. Then, the notification sound control unit 3221 stores the event type corresponding to the event information accommodated in the second event notification communication signal received in the process S31 in the TA storage unit 33 and associates it with the first timer 3222. Is functionally formed in the TA monitoring processing unit 322, the time measurement is started, this processing is terminated, and processing S35 shown in FIG. 8 is executed.

Returning to FIG. 8, the TA monitoring processing unit 322 displays a screen corresponding to each piece of information contained in the second event notification communication signal received in step S31 on the TA display unit 36 (S35), and the next processing S36. Execute. More specifically, when the event information accommodated in the second event notification communication signal received in step S31 is the predetermined action, the TA monitoring processing unit 322, for example, the monitoring information screen illustrated in FIG. 52 is displayed on the TA display unit 36. On the other hand, when the event information accommodated in the second event notification communication signal received in the process S31 is the nurse call, for example, a nurse call reception screen 53 shown in FIG. Is displayed on the TA display unit 36.

The monitoring information screen 52 is a screen for displaying the monitoring information related to the monitoring of the monitored person Ob. For example, as shown in FIG. 13, the monitoring information screen 52 includes a menu bar area 511, an arrangement location of the sensor device SU having the sensor ID accommodated in the second event notification communication signal received in the process S <b> 31, and the The monitored person name area 521 for displaying the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and the reception time of the second event notification communication signal received in the process S31 (or the predetermined action) A detection information display area 522 for displaying the elapsed time from the detection time) and the event information (the detection result of the predetermined action) contained in the second event notification communication signal received in the process S31; The image accommodated in the received second event notification communication signal (that is, the pair imaged by the sensor device SU having the sensor ID). Image) (here includes an image area 523 for displaying a still image), "corresponding" button 524, a "talk" button 525, a "See LIVE" button 526.

In order to display the location of the sensor device SU and the name of the monitored person Ob in the monitored person name area 521, the sensor ID contained in the second event notification communication signal received in step S31 is used as a search key. The location of the device SU and the name of the monitored person Ob are retrieved from the TA sensor information storage unit 332 and displayed. In the detection information display area 522, the detection results (in this embodiment, the names of getting up, getting out of bed, falling over, and abnormal movement of the micro body) contained in the second event notification communication signal received in step S31 are displayed as they are. However, in this embodiment, the detection result is displayed as an icon that symbolically represents the detection result. In order to display with this icon, the TA storage unit 33 stores each action and an icon representative of the action in association with each other in advance. In the example illustrated in FIG. 13, the detection information display area 522 displays a wake-up icon that symbolizes wake-up. In the monitoring information screen 52, the “corresponding” button 524 has an intention to perform a predetermined response (response, response) such as lifesaving, nursing, care, and assistance for the detection result displayed on the monitoring information screen 52. It is a button for inputting execution intention information indicating that the user of the mobile terminal device TA is present to the mobile terminal device TA. The “speak” button 525 is a button for requesting a voice call, and is used to input an instruction to connect the sensor device SU of the sensor ID and the mobile terminal device TA via the network NW. It is a button. The “LIVE” button 526 is a button for requesting a live video, and is a button for inputting an instruction to display a video captured by the sensor device SU of the sensor ID.

The nurse call reception screen 53 is a screen for displaying reception of a nurse call. For example, as shown in FIG. 14, the nurse call reception screen 53 includes a menu bar area 511, a monitored person name area 521, a detection information display area 522, and a message (for example, “ Nurse call reception notification display area 531 for displaying “This is a nurse call”, a “corresponding” button 524, and a “speak” button 525. In the nurse call reception screen 53, the detection information display area 522 displays only the elapsed time from the reception time of the second event notification communication signal received in step S31 (or the reception time of reception of the nurse call). .

Note that the nurse call reception screen 53 may further include a “view LIVE” button 526.

In the process S36, the portable terminal device TA determines whether or not the TA control processing unit 32 has accepted an input operation on the touch panel including the TA input unit 35 and the TA display unit 36. If the input operation is not accepted as a result of this determination (No), the mobile terminal device TA returns the process to step S36. On the other hand, if the input operation is accepted as a result of the determination, the mobile terminal The apparatus TA executes the next process S37.

In this process S37, the portable terminal device TA performs an appropriate process according to the content of the input operation by the TA control processing unit 32, and ends this process.

For example, in FIG. 11, when the mobile terminal device TA receives an input operation of the “corresponding” button 524 from the TA input unit 35 constituting the touch panel by the TA control processing unit 32 (that is, the intention to execute the correspondence) (S51), first, the monitoring information of the monitored person Ob currently displayed on the TA display unit 36 is added to the monitoring information Ob, indicating that “corresponding” has been received, and stored in the TA monitoring information storage unit 331. (S52). More specifically, the TA control processing unit 32 displays the current information on the TA display unit 36 in the TA monitoring information table MT-TA stored in the TA monitoring information storage unit 331 by the TA monitoring processing unit 322. In the correspondence field 3316 of the record in which the monitoring information of the monitored person Ob is registered (here, the record in which the monitoring information contained in the second event notification communication signal received in the processing S31 is registered) Corresponding flag “1” is registered.

Next, the TA control processing unit 32 indicates that the TA monitoring processing unit 322 has received the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 and “corresponding”. A communication signal (correspondence acceptance notification communication signal) containing (correspondence acceptance information) is transmitted to the management server device SV (S53). The management server device SV that has received the correspondence reception notification communication signal broadcasts the communication signal (correspondence reception well-known communication signal) containing the sensor ID and the correspondence reception information contained in the received correspondence reception notification communication signal. Transmit to the terminal devices SP and TA. As a result, regarding the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36, the fact that “corresponding” has been received is synchronized between the terminal devices SP and TA.

Next, the TA control processing unit 32 determines whether or not the notification sound is output from the TA sound input / output unit 34 by the notification sound control unit 3221 of the TA monitoring processing unit 322 (S54). If the result of this determination is that a notification sound is being output (Yes, outputting), the notification sound control unit 3221 executes the next process S55, while the result of the determination is that a notification sound is being output. If not (No), the notification sound control unit 3221 executes the next process S57.

In this process S55, the notification sound processing unit 3221 stops the notification sound being output. As a result, the notification sound being output is stopped by the input operation of the “corresponding” button 524. The TA input unit 35 constituting the touch panel corresponds to an example of a corresponding input unit that receives an input indicating that the user has an intention to perform a predetermined response to the received notification event.

Next, the notification sound processing unit 3221 deletes the first timer 3222 functionally generated in the TA monitoring processing unit 322 (S56), and executes the next processing S57.

In this process S57, the notification sound processing unit 3221 erases the second timer 3223 functionally generated in the TA monitoring processing unit 322 as will be described later, and ends this process.

Returning to FIG. 8, for example, when the portable terminal device TA receives an input operation of the “speak” button 525 by the TA control processing unit 32, the call processing unit 323 displays the object displayed on the TA display unit 36. A communication signal (call request communication signal) containing information such as requesting a voice call is transmitted to the sensor device SU that monitors the monitoring person Ob, and the voice call is made via the sensor device SU and the network NW according to the communication signal. Connect as possible. As a result, a voice call can be made between the mobile terminal device TA and the sensor device SU. When the TA control processing unit 32 receives an input operation of an “end” button (not shown) that is a button for inputting an instruction to end a voice call, the portable terminal device TA causes the TA processing unit 323 to A communication signal (call end communication signal) containing information such as a request to end the voice call is transmitted to the sensor device SU that monitors the monitored person Ob displayed on the display unit 36. Thereby, the voice call between the mobile terminal device TA and the sensor device SU is terminated.

Further, for example, when the mobile terminal device TA receives an input operation of the “watch live” button 526 by the TA control processing unit 32, the TA streaming processing unit 324 displays the monitored object currently displayed on the TA display unit 36. A communication signal (video distribution request communication signal) containing information such as requesting live video distribution is transmitted to the sensor device SU that monitors the person Ob, and the sensor device SU and the network NW corresponding thereto are transmitted. The video is connected to be downloadable via the sensor device SU, receives live video distribution from the sensor device SU, and displays the distributed video on the TA display unit 36 by streaming playback. On the monitoring information screen 52 that displays the live video, the video is displayed in the image area 523, and a “live end” button (not shown) is displayed instead of the “view live” button 526. As a result, live video is displayed on the mobile terminal device TA. The “live end” button (not shown) is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image picked up by the sensor device SU of the sensor ID and ends (stops) the display. This is a button for inputting an instruction to be performed. When the TA control processing unit 32 receives an input operation of the “live end” button, the portable terminal device TA monitors the monitored person Ob currently displayed on the TA display unit 36 by the TA streaming processing unit 324. A communication signal (moving image distribution end communication signal) containing information such as requesting the end of moving image distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. Accordingly, the mobile terminal device TA ends the live video display.

On the other hand, after accepting the login operation, the mobile terminal device TA performs notification sound stop processing and notification sound re-output processing (remind processing) shown in FIG. 10 by the notification sound control unit 3221 of the TA monitoring processing unit 322. The notification sound second output process is repeatedly executed.

In FIG. 10, first, the notification sound control unit 3221 determines whether or not the first timer 3222 is functionally generated in the TA monitoring processing unit 322 (S41). If the result of this determination is that the first timer 3222 is present (Yes), the notification sound control unit 3221 executes the next process S42, while the result of this determination is that there is no first timer 3222 (No). The notification sound control unit 3221 executes the next process S46.

In this process S42, the notification sound control unit 3221 determines whether or not the first timer 3222 has finished counting the first time and has timed up. If the result of this determination is that the first timer 3222 has timed up (Yes), the notification sound control unit 3221 executes the next process S43, while the result of this determination is that the first timer 3222 If not up (No), the notification sound control unit 3221 executes the next process S46.

In this process S43, the notification sound control unit 3221 stops the notification sound being output. As a result, the notification sound being output is stopped as the first time elapses.

After the process S43, the notification sound processing unit 3221 is associated with the type of event stored in the TA storage unit 33 in association with the first timer 3222 functionally generated in the TA monitoring processing unit 322. The second timer 3223 is functionally formed in the TA monitor processing unit 322. When the third timer 3224 is not provided, the time is started. When the third timer 3224 is provided, the third timer 3224 is up. Starting the time measurement, the first timer 3222 functionally generated in the TA monitoring processor 322 is deleted (S44), and the next process S46 is executed. If the third timer 3224 is present, the third timer 3224 is deleted after the time is up. Thus, the starting point for starting the time measurement in the second timer 3223 is the time when the predetermined first time has elapsed from the time of the latest notification (the time of reception of the second event notification communication signal).

In process S46, the notification sound control unit 3221 determines whether or not the second timer 3223 is functionally generated in the TA monitoring processing unit 322. If the result of this determination is that the second timer 3223 is present (Yes), the notification sound control unit 3221 executes the next process S47, while the result of this determination is that there is no second timer 3223 (No). The notification sound control unit 3221 ends the current process.

In this process S47, the notification sound control unit 3221 determines whether or not the second timer 3223 has finished counting the second time and has timed up. If the result of this determination is that the second timer 3223 has timed up (Yes), the notification sound control unit 3221 executes the next process S48, while the result of this determination is that the first timer 3222 has timed out. If not up (No), the notification sound control unit 3221 ends the current process.

In process S48, the notification sound control unit 3221 extracts the remind notification sound data stored in the notification sound information storage unit 333 of the TA storage unit 33, and outputs the remind notification sound from the TA sound input / output unit 34. Therefore, even if the notification sound ends when the first time elapses, if the input operation of the “corresponding” button 524 is not accepted for the notification, a remind notification sound is output after the second time elapses. Is done.

Then, after the process S48, the notification sound processing unit 3221 corresponds to the type of event stored in the TA storage unit 33 in association with the second timer 3222 that is functionally generated in the TA monitoring processing unit 322. In addition, the first timer 3223 is functionally formed in the TA monitoring processing unit 322, and the second timer 3222 that has been functionally generated in the TA monitoring processing unit 322 is deleted, and the current processing of this time is started. Exit.

Regarding the second event notification communication signal received from the management server device SV, the mobile terminal device TA operates as described above.

Next, the operation related to the notification sound in the mobile terminal device TA will be described based on a specific example. FIG. 15 is a state diagram showing a specific example for explaining the operation of the portable terminal device shown in FIG. The upper state C0 indicates the overall notification sound reproduction state in the mobile terminal device TA, and the lower states C1 to C7 indicate the state of the mobile terminal device TA at the time when each second event notification communication signal is received. Indicates the notification sound playback state.

First, when the mobile terminal device TA displays the standby screen 51 and receives a second event notification communication signal whose event information is awake at time T1, the mobile terminal device TA performs processing S31, processing S32, By executing each of the processes S341 and S346 in the processes S33 and S34, a wake-up notification sound (tutetotote ...) is output, and the processes S347, S35, and S36 of the process S34 are executed.

Next, when the second event notification communication signal whose event information is getting out of bed is received at time T2 while the wake-up notification sound is being output, the portable terminal device TA performs processing S31, processing S32, processing S33, and processing S34. Step S341, Step S342, Step S343, and Step S346 are executed to output a notification sound for getting out of bed (popeen popein ...), and Steps S347, S35, and S36 of Step S34 are executed. For this reason, the reminder notification sound for the wake-up notification sound is not output.

Next, when the second event notification communication signal whose event information is falling is received at time T3 while the notification sound for leaving the bed is being output, the portable terminal device TA performs processing S31, processing S32, processing S33, and processing S34. In step S341, step S342, step S343, and step S346, the fall notification sound (Tin Contin Contin....) Is output, and Steps S347, S35, and S36 in Step S34 Execute. For this reason, the reminder notification sound for the notification sound of leaving the bed is not output.

Next, when the second event notification communication signal whose event information is falling is received at time T4 while the falling notification sound is being output, the portable terminal device TA performs processing S31, processing S32, processing S33, and processing S34. Steps S341, S342, and S344 are executed to continuously output a fall notification sound (Tin-Contin-Tin-Contin ...), and Steps S345, S35, and S36 of Step S34 are performed. Execute. Accordingly, a third timer 3224 is generated for the second event notification communication signal received at time T4.

During such an operation, each process shown in FIG. 10 is repeatedly executed, and at time T5, if the first timer 3222 has expired due to the elapse of the first time ΔT1 in process S42, the process falls over in process S43. In step S44, after the time-up of the third timer 3224 due to the elapse of the first time ΔT1, the second timer 3223 starts measuring time and the first timer 3222 is deleted. Then, each process shown in FIG. 10 is repeatedly executed, and at time T7, when the second timer 3223 has timed up due to the elapse of the second time ΔT2 in process S47, a reminder notification sound is generated in process S48. Is output.

When the second event notification communication signal whose event information is a nurse call is received at time T8 during the output of the remind notification sound, the portable terminal device TA performs steps S31, S32, S33, and S34. By executing each of the processes S341, S342, S343, and S346, a nurse call notification sound (Pico Pico ...) is output, and processes S347, S35, and S36 of process S34 are executed.

Next, when the second event notification communication signal whose event information is a nurse call is received at time T9 while the notification sound of the nurse call is being output, the portable terminal device TA performs processes S31, S32, S33, By executing the processes S341, S342, and S344 in the process S34, the nurse call notification sound Pico Pico is continuously output, and the processes S345, S35, and S36 of the process S34 are executed. . Therefore, a third timer 3224 is generated for the second event notification communication signal received at time T9.

Next, when the second event notification communication signal whose event information is awakening is received at time T15 during the output of the remind notification sound, the portable terminal device TA performs processing S31, processing S32, processing S33, and processing S34. In step S341, step S342, and step S344, a remind notification sound is continuously output, and steps S345, S35, and S36 of step S34 are executed. Accordingly, a third timer 3224 is generated for the second event notification communication signal received at time T15.

Hereinafter, similarly, the portable terminal device TA operates, and in this example, a reminder notification sound is repeatedly output.

As described above, in the present embodiment, the monitored person monitoring system MS, the terminal device SP, TA of the monitored person monitoring system MS, and the control method of the terminal device SP, TA mounted thereon, the notification sound is a TA sound. When a notification of a new event is received during output from the input / output unit 34, the notification sound control unit 3221 that continues the notification sound being output is provided, so one phrase of the notification sound does not end Even if there is a new notification, a notification sound is not newly output from the beginning in response to the new notification. In other words, in the case where the notification sound control unit 3221 is not provided, when notification of a nurse call is continuously notified, a notification sound is generated as in the case of a beeping beepy beep and the user (monitoring person) However, in this embodiment, since the notification sound control unit 3221 is provided, even if the notification of the nurse call is continuously notified, like Pico Pico Pico Coop ... A notification tone sounds. Therefore, the monitored person monitoring system MS, the terminal devices SP, TA and the control method thereof can reduce annoyance and annoyance even when a new notification is received before one phrase of the notification sound is completed.

When the event includes a plurality of types, the monitored person monitoring system MS, the terminal device SP, TA, and the control method thereof include a plurality of notification sounds different from each other according to the type of the event, Since the notification sound corresponding to the event type is output, the user can not only recognize the notification by hearing, but can also recognize the event type. Then, when the notification sound is being output from the sound output unit and the type of event of the newly received notification is the same as the type of event corresponding to the notification sound being output, the newly received notification Accordingly, even if a notification sound is newly output from the beginning, the user does not obtain new information in addition to the information obtained from the notification sound being output. I just feel it. However, the monitored person monitoring system MS, the terminal device SP, TA and the control method thereof are newly received when a notification of a new event is received while the notification sound is being output from the TA sound input / output unit 34. When the event type of the notification is the same as the event type corresponding to the notification sound being output, the notification sound control unit 3221 that continues the notification sound being output is provided. Even if there is a new notification before the end of one phrase, there is no meaning and no new notification sound is output from the beginning in response to the newly received notification, reducing the annoyance and annoyance it can.

The monitored person monitoring system MS, the terminal devices SP, TA, and the control method thereof, when the event type of the newly received notification is not the same as the event type corresponding to the notification sound being output The notification sound controller 3221 outputs the notification sound corresponding to the type of the newly received notification event from the TA sound input / output unit 34 based on the notification sound information. Therefore, an event different from the event being notified can be notified to the user (monitor) by the notification sound.

The monitored person monitoring system MS, the terminal devices SP and TA, and the control method thereof are configured to output a reminder notification sound from the sound output unit after a predetermined second time has elapsed after finishing outputting the notification sound. Since the sound control unit 3221 is provided, it is possible to prompt the user to deal with the event.

In the monitored person monitoring system MS, the terminal devices SP, TA and the control method thereof, the notification sound is being output from the sound output unit, and the priority corresponding to the type of the newly received notification event is being output. If the priority is lower than the priority corresponding to the type of event corresponding to the notification sound, the notification sound control unit 3221 that continues the notification sound being output is provided, so that notification of an event having a higher notification priority is provided. Can be maintained.

In the monitored person monitoring system MS, the terminal devices SP, TA and the control method thereof, the notification sound is being output from the sound output unit, and the priority corresponding to the type of the newly received notification event is being output. If it is higher than the priority corresponding to the type of event corresponding to the notification sound, the notification sound being output is stopped, and the notification sound corresponding to the type of the newly received notification event is displayed as the notification sound information. Since the notification sound control unit 3221 that outputs from the TA sound input / output unit 34 is provided based on the above, an event having a higher notification priority can be preferentially notified. The nurse call has a high probability that the monitored person Ob requests the monitoring person (user) to deal with, but the monitored person monitoring system MS, the terminal devices SP and TA, and the control method thereof are the nurse call. Since the priority order of notifications is the highest, notification of such nurse calls can be prioritized, and it becomes possible to promptly respond to the request of the monitored person Ob.

When the user inputs an intention to perform a predetermined response to the received notification event, even if the notification sound is continued, the user has new information in addition to the information obtained from the continued notification sound. It is never obtained, and it just feels annoying with the above-mentioned harshness. The monitored person monitoring system MS, the terminal device SP, TA, and the control method thereof, the notification sound being output when the notification sound is being output from the TA sound input / output unit 34 and the input of the intention is received. Since the notification sound control unit 3221 is stopped, the notification sound is meaningless without being continued, and the annoyance and annoyance can be reduced.

In the above-described embodiment, the remind notification sound is a melody different from the notification sound according to the event type, but may be a notification sound according to the event type. In such a case, the notification sound control unit 3221 continuously outputs the notification sound from the TA sound input / output unit 34 for a predetermined first time, and after outputting the notification sound, After the elapse of time, the TA notification input / output unit 34 outputs the completed notification sound. The type of event in the notification sound that has ended may be referred to the type of event stored in the TA storage unit 33 in association with the second timer 3223.

This specification discloses various modes of technology as described above, and the main technologies are summarized below.

A terminal device of a monitored person monitoring system according to one aspect is connected to the terminal device and the terminal device so as to be communicable, and detects a predetermined event related to a monitored person who is a monitoring target and transmits the event to the terminal device. It is the said terminal device of a monitoring person monitoring system provided with a monitoring person monitoring apparatus which notifies to. The terminal device includes a sound output unit that outputs a sound, and a notification sound control unit that outputs a notification sound from the sound output unit when a notification of the event is received, and the notification sound control unit includes the notification sound control unit, When a notification of a new event is received while a notification sound is being output from the sound output unit, the notification sound being output is continued. Preferably, in the above-described terminal device, the predetermined event includes an event that needs to be dealt with. Preferably, in the above-described terminal device, the predetermined event includes a predetermined action in the monitored person. Preferably, in the above-described monitored person monitoring apparatus, the predetermined event includes a nurse call.

When the terminal device of such a monitored person monitoring system receives a notification of a new event (event) while outputting the notification sound from the sound output unit, the notification sound that continues the notification sound being output Since the control unit is provided, even if there is a new notification before one phrase of the notification sound is completed, the notification sound is not newly output from the beginning in response to the new notification. For this reason, the terminal device can reduce annoyance and annoyance even when there is a new notification before one phrase of the notification sound is completed.

In another aspect, in the terminal device of the above-described monitored person monitoring system, the event includes a plurality of types, a plurality of different event types, and a plurality of notification sounds that are different from each other according to the event type. And a notification sound information storage unit that stores them as notification sound information in association with each other, and the notification sound control unit corresponds to the event type of the received notification when the notification of the event is received When the notification sound is output from the sound output unit based on the notification sound information, and the notification sound is output from the sound output unit, a new event notification is received. If the type of event is the same as the type of event corresponding to the notification sound being output, the notification sound being output is continued.

When the event includes a plurality of types, the terminal device of the monitored person monitoring system includes a plurality of notification sounds different from each other according to the type of the event, and the notification sound corresponding to the event type of the received notification Therefore, the user can recognize not only the notification by hearing but also the type of event. When the notification sound is output from the sound output unit and the event type of the newly received notification is the same as the event type corresponding to the notification sound being output, the notification sound is received. Thus, even if the notification sound is newly output from the beginning, the user does not obtain new information in addition to the information obtained from the notification sound being output, and feels annoying and annoying as described above. It just ends up. When the terminal device receives a notification of a new event while outputting the notification sound from the sound output unit, the event type of the notification newly received is an event corresponding to the notification sound being output. In the case of the same type, a notification sound control unit that continues the notification sound being output is provided, so that even if a new notification is received before one phrase of the notification sound is completed, it is meaningless. In response to the newly received notification, the notification sound is not newly output from the beginning, and the annoyance and annoyance can be reduced.

In another aspect, in the terminal device of the above-described monitored person monitoring system, the notification sound control unit is configured such that a newly received event type corresponds to the event sound corresponding to the output notification sound. If they are not the same, the notification sound being output is stopped, and a notification sound corresponding to the type of the newly received notification event is output from the sound output unit based on the notification sound information.

The terminal device of such a monitored person monitoring system, when the event type of the newly received notification is not the same as the event type corresponding to the notification sound being output, Since a notification sound control unit that stops the notification sound and outputs a notification sound corresponding to the type of event of the newly received notification from the sound output unit based on the notification sound information, the notification sound is being notified. It is possible to notify the user of an event different from this event.

In another aspect, in the terminal device of the above-described monitored person monitoring system, the notification sound control unit continuously outputs the notification sound from the sound output unit for a predetermined first time, After the output ends, a reminder notification sound is output from the sound output unit after a predetermined second time has elapsed. Preferably, in the above-described terminal device, the notification sound control unit sets a time when the predetermined first time has elapsed from the time of the notification received most recently as a starting point for measuring the predetermined second time.

The terminal device of such a monitored person monitoring system includes a notification sound control unit that outputs a reminder notification sound from the sound output unit after a predetermined second time has elapsed after the output of the notification sound. The user can be prompted to deal with the event corresponding to the ended notification sound.

In another aspect, in the terminal device of the above-described monitored person monitoring system, each of the plurality of different event types has a priority of notification, and the notification sound control unit outputs the notification sound as the sound. When receiving a notification of a new event during output from the output unit, the priority corresponding to the type of event of the newly received notification corresponds to the type of event corresponding to the notification sound being output. If it is lower than the priority, the notification sound being output is continued.

The terminal device of such a monitored person monitoring system has an event in which the priority corresponding to the type of the newly received notification event corresponds to the notification sound being output while the notification sound is being output from the sound output unit. If the priority is lower than the priority corresponding to the type, the notification sound control unit that continues the notification sound being output is provided, so that notification of an event having a higher notification priority can be maintained.

In another aspect, in the terminal device of the above-described monitored person monitoring system, the notification sound control unit receives a new event notification while the notification sound is being output from the sound output unit. If the priority corresponding to the event type of the notification received is higher than the priority corresponding to the event type corresponding to the notification sound being output, the notification sound being output is stopped, A notification sound corresponding to the newly received event type is output from the sound output unit based on the notification sound information.

The terminal device of such a monitored person monitoring system has an event in which the priority corresponding to the type of the newly received notification event corresponds to the notification sound being output while the notification sound is being output from the sound output unit. The notification sound being output is stopped, and the notification sound corresponding to the type of the newly received notification event is output based on the notification sound information. Since the notification sound control unit output from the unit is provided, an event having a higher notification priority can be preferentially notified.

In another aspect, in the terminal device of the above-described monitored person monitoring system, the plurality of event types include a nurse call, and the priority of notification in the nurse call is the highest.

There is a high probability that the nurse call will require the supervisor (user) to take action. Since the terminal device of the monitored person monitoring system has the highest notification priority in the nurse call, priority can be given to notification of such a nurse call, and it becomes possible to quickly respond to the request of the monitored person.

In another aspect, the terminal device of the above-described monitored person monitoring system further includes a response input unit that receives an input indicating that the user has an intention to perform a predetermined response to the received notification event, The notification sound control unit stops the notification sound being output when the notification sound is being output from the sound output unit and the input is received by the corresponding input unit.

When the user inputs an intention to perform a predetermined response to the received notification event in the response input unit, even if the notification sound is continued, the user can add to the information obtained from the continued notification sound. No new information is obtained, and the above-mentioned harshness just makes you feel annoying. Since the terminal device includes a notification sound control unit that stops the notification sound being output when the notification sound is being output from the sound output unit and an input is received by the corresponding input unit, the terminal device is meaninglessly described above. The notification sound is not continued and the annoyance and annoyance can be reduced.

According to another aspect of the present invention, there is provided a control method for a terminal device of a monitored person monitoring system, wherein the terminal device is connected to the terminal device so as to be communicable and detects a predetermined event related to a monitored person to be monitored. A method for controlling the terminal device of a monitored person monitoring system comprising: a monitored person monitoring device that notifies an event to the terminal device. The terminal device control method includes: a notification receiving step for receiving notification of the event; and a notification sound control for outputting a notification sound from a sound output unit that outputs a sound when receiving the notification of the event in the notification receiving step. The notification sound control step continues the notification sound being output when the notification sound is being output from the sound output unit and a notification of a new event is received in the notification reception step. To do.

Since the control method of such a terminal device includes a notification sound control step of continuing the notification sound being output when a notification of a new event is received while the notification sound is being output from the sound output unit, Even if there is a new notification before one phrase of the notification sound ends, the notification sound is not newly output from the beginning in response to the new notification. For this reason, the control method of the terminal device can reduce annoyance and annoyance even when a new notification is made before one phrase of the notification sound is completed.

A monitored person monitoring system according to another aspect is connected to a terminal device and the terminal device so as to be communicable, detects a predetermined event relating to a monitored person who is a monitoring target, and transmits the event to the terminal device. A monitored person monitoring system comprising a monitored person monitoring apparatus for notification, wherein the terminal device is any one of the above-described terminal devices.

Such a monitored person monitoring system uses any of the above-described terminal devices, so that it is possible to reduce annoyance and annoyance even when a new notification is received before one phrase of the notification sound is completed.

This application is based on Japanese Patent Application No. 2016-90362 filed on April 28, 2016, the contents of which are included in this application.

In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.

According to the present invention, it is possible to provide a terminal device of a monitored person monitoring system, a control method for the terminal device, and a monitored person monitoring system.

Claims

A monitored person comprising a terminal device and a monitored person monitoring device connected to the terminal device so as to be communicable and detecting a predetermined event relating to the monitored person to be monitored and notifying the terminal device of the event The terminal device of the monitoring system,
A sound output unit for outputting sound;
A notification sound control unit that outputs a notification sound from the sound output unit when receiving the notification of the event;
The notification sound control unit continues the notification sound being output when receiving a notification of a new event while outputting the notification sound from the sound output unit.
Terminal device.
The event includes a plurality of types,
A notification sound information storage unit that stores a plurality of different types of events and a plurality of different notification sounds according to the type of the event in association with each other and stores them as notification sound information,
When the notification sound control unit receives a notification of the event, the notification sound control unit outputs a notification sound corresponding to the event type of the received notification from the sound output unit based on the notification sound information, and the notification sound is output. When a notification of a new event is received during output from the sound output unit, the event type of the notification newly received is the same as the event type corresponding to the notification sound being output Continues the notification sound during the output,
The terminal device according to claim 1.
The notification sound control unit stops the notification sound being output when the event type of the notification newly received is not the same as the event type corresponding to the notification sound being output, A notification sound corresponding to the type of event of the notification newly received is output from the sound output unit based on the notification sound information.
The terminal device according to claim 2.
The notification sound control unit continuously outputs the notification sound from the sound output unit for a predetermined first time, ends the output of the notification sound, and after a predetermined second time elapses, Is output from the sound output unit,
The terminal device according to any one of claims 1 to 3.
Each of the plurality of different event types has a notification priority,
When the notification sound control unit receives a notification of a new event while outputting the notification sound from the sound output unit, the priority corresponding to the type of the newly received event is being output. If the priority is less than or equal to the event type corresponding to the notification sound, the notification sound being output is continued.
The terminal device according to any one of claims 2 to 4.
When the notification sound control unit receives a notification of a new event while outputting the notification sound from the sound output unit, the priority corresponding to the type of the newly received event is being output. If the priority is higher than the priority corresponding to the event type corresponding to the notification sound, the notification sound being output is stopped, and the notification sound corresponding to the newly received event type is notified. Output from the sound output unit based on the sound information,
The terminal device according to claim 5.
The plurality of event types include a nurse call,
The priority of notification in the nurse call is the highest,
The terminal device according to claim 5 or 6.
A response input unit that receives an input indicating that the user has an intention to perform a predetermined response to the received notification event;
The notification sound control unit stops the notification sound being output when the input is received by the corresponding input unit while the notification sound is being output from the sound output unit.
The terminal device according to any one of claims 1 to 7.
A monitored person comprising a terminal device and a monitored person monitoring device connected to the terminal device so as to be communicable and detecting a predetermined event relating to the monitored person to be monitored and notifying the terminal device of the event A control method for the terminal device of a monitoring system, comprising:
A notification receiving step of receiving notification of the event;
A notification sound control step of outputting a notification sound from a sound output unit that outputs a sound when receiving the notification of the event in the notification reception step;
The notification sound control step continues the notification sound being output when a notification of a new event is received in the notification reception step while the notification sound is being output from the sound output unit.
A control method of a terminal device.
A monitored person comprising a terminal device and a monitored person monitoring device connected to the terminal device so as to be communicable and detecting a predetermined event relating to the monitored person to be monitored and notifying the terminal device of the event A monitoring system,
The terminal device is the terminal device according to any one of claims 1 to 8.
Monitored person monitoring system.