WO2017130684A1 - Dispositif de surveillance de personne surveillée, procédé associé et système associé - Google Patents

Dispositif de surveillance de personne surveillée, procédé associé et système associé Download PDF

Info

Publication number
WO2017130684A1
WO2017130684A1 PCT/JP2017/000450 JP2017000450W WO2017130684A1 WO 2017130684 A1 WO2017130684 A1 WO 2017130684A1 JP 2017000450 W JP2017000450 W JP 2017000450W WO 2017130684 A1 WO2017130684 A1 WO 2017130684A1
Authority
WO
WIPO (PCT)
Prior art keywords
monitored person
nurse call
terminal device
monitoring
processing unit
Prior art date
Application number
PCT/JP2017/000450
Other languages
English (en)
Japanese (ja)
Inventor
雅史 西角
篤広 野田
安紀 辻
山下　雅宣
Original Assignee
コニカミノルタ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コニカミノルタ株式会社 filed Critical コニカミノルタ株式会社
Priority to JP2017563778A priority Critical patent/JPWO2017130684A1/ja
Publication of WO2017130684A1 publication Critical patent/WO2017130684A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G12/00—Accommodation for nursing, e.g. in hospitals, not covered by groups A61G1/00 - A61G11/00, e.g. trolleys for transport of medicaments or food; Prescription lists
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/04—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using a single signalling line, e.g. in a closed loop

Definitions

  • the present invention relates to a monitored person monitoring apparatus, a monitored person monitoring method, and a monitored person monitoring system for monitoring a monitored person to be monitored.
  • Japan is an aging society, more specifically the ratio of population over 65 years old to the total population due to the improvement of living standards accompanying the post-war high economic growth, improvement of sanitary environment and improvement of medical standards, etc. It is a super-aging society with an aging rate exceeding 21%.
  • the elderly population aged 65 and over was about 25.56 million compared to the total population of 127.65 million, whereas in 2020, the elderly population was about 124.11 million.
  • the population is predicted to be about 34.56 million.
  • nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care are those who need nursing in a normal society that is not an aging society.
  • monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.
  • the nurse call system disclosed in Patent Document 1 is a nurse call slave unit that is installed in a bed and a patient calls a nurse, and a nurse call slave unit that is installed in a nurse station and responds to a call by the nurse call slave unit.
  • a nurse call system having a nurse call parent device, a camera for imaging a patient on a bed from above the bed, and a state in which the patient wakes up from a captured image of the camera and a state in which the patient is separated from the bed State judging means for judging the occurrence of at least one of them and outputting a caution state occurrence signal, and the nurse call master unit has a notifying means for performing a notification operation upon receiving the caution state occurrence signal.
  • the nurse call system transmits a captured image of the camera to the portable terminal upon receiving the attention state generation signal and a portable terminal carried by a nurse to respond to a call from the nurse call slave. Communication control means.
  • the present invention is an invention made in view of the above-described circumstances, and the object thereof is a monitored person monitoring apparatus and a monitored person that can reduce the burden on the supervisor more with less time lag in dealing with nurse calls. To provide a monitoring method and a monitored person monitoring system.
  • the behavior of the monitored person is detected, the detection result is notified to the terminal device, the nurse call is accepted, and the nurse call is received.
  • the terminal device is notified.
  • the detection result is notified to the terminal device, the detection result is notified to the terminal device together with the image of the monitored person, and when the nurse call is notified to the terminal device, the image of the monitored person Ob.
  • the nurse call is notified to the terminal device without accompanying.
  • movement of the portable terminal device in the to-be-monitored person monitoring system of embodiment It is a figure which shows an example of the standby screen displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment. It is a figure which shows an example of the monitoring information screen displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment. It is a figure which shows an example of the nurse call reception screen displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment. It is a figure which shows the structure of the sensor apparatus in the to-be-monitored person monitoring system of 2nd Embodiment. It is a figure which shows the structure of the management server apparatus in the to-be-monitored person monitoring system of 2nd Embodiment.
  • the monitored person monitoring system in the embodiment monitors a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched).
  • the monitored person monitoring system is communicably connected to the terminal device and the terminal device, detects a predetermined action in the monitored person Ob, notifies the terminal device of the detection result, accepts a nurse call, and And a monitored person monitoring device for notifying the terminal device of a nurse call.
  • the monitored person monitoring device in this embodiment includes an image acquisition unit that acquires an image of the monitored person Ob, and the detection result together with the image of the monitored person Ob when the detection result is notified to the terminal device.
  • a monitoring processing unit that notifies the terminal device of the nurse call without an image of the monitored person Ob when the terminal device is notified and the nurse call is notified to the terminal device.
  • a monitored person monitoring device may be integrally configured by a single device, but in this embodiment, the monitored person monitoring device can communicate with the sensor device, and each of the sensor device and the terminal device. And a management server device connected to each other, the two types of devices are configured separately.
  • the sensor device detects a predetermined action in the monitored person Ob, notifies (transmits) the detection result to the management server device, accepts a nurse call, and notifies (transmits) the nurse call to the management server device. .
  • the management server device When the notification of the detection result is received from the sensor device, the management server device notifies (re-notifies, retransmits) the detection result to a predetermined terminal device associated with the sensor device, for example.
  • the nurse call is notified (re-notification, re-transmission) to the predetermined terminal device.
  • the terminal device displays the detection result when the notification of the detection result is received from the management server device, and displays the nurse call when the notification of the nurse call is received from the management server device.
  • the monitored person monitoring device configured as described above includes, for example, two modes, a first mode and a second mode.
  • the monitored person monitoring device is configured to display the detection result together with the image of the monitored person Ob when the sensor device notifies the terminal device of the detection result via the management server device.
  • the nurse call is notified to the terminal device without the image of the monitored person.
  • the sensor device notifies the detection result and the nurse call with the image of the monitored person Ob
  • the management server device notifies the detection result to the terminal device.
  • the detection result is notified to the terminal device together with the image of the monitored person, and when the nurse call is notified to the terminal device, the nurse call is not performed without the image of the monitored person. Notify the terminal device.
  • the said terminal device may be one type of apparatus, in the 1st and 2nd embodiment, the said terminal device is two types of apparatuses, a fixed terminal device and a portable terminal device.
  • the main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, while the portable terminal device is operated by being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the mobile terminal device are substantially the same, in the first and second embodiments, the mobile terminal device will be mainly described.
  • FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment.
  • FIG. 2 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system according to the first embodiment.
  • FIG. 3 is a diagram illustrating a configuration of the management server device in the monitored person monitoring system according to the first embodiment.
  • FIG. 4 is a diagram illustrating a configuration of the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • the monitored person monitoring system MSa in the first embodiment using the monitored person monitoring apparatus of the first aspect is, for example, as shown in FIG. 1, one or more sensor devices SUa (SUa -1 to SUa-4), a management server device SVa, a fixed terminal device SP, and one or a plurality of portable terminal devices TA (TA-1, TA-2), which are wired or wireless, Communication is established via a network (network, communication line) NW such as a LAN (Local Area Network), a telephone network, and a data communication network.
  • NW network, communication line
  • the network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals.
  • the plurality of sensor devices SUa-1 to SUa-4, the management server device SVa, the fixed terminal device SP, and the plurality of portable terminal devices TA-1 and TA-2 are wireless including an access point AP.
  • a LAN for example, a LAN according to the IEEE 802.11 standard
  • NW is connected to be communicable with each other.
  • the monitored person monitoring system MSa is arranged at an appropriate place according to the monitored person Ob.
  • the monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like.
  • the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable.
  • the monitored person monitoring system MSa is suitably arranged in a building such as a hospital, an elderly welfare facility, or a dwelling unit according to the type of the monitored person Ob.
  • the monitored person monitoring system MSa is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob and a plurality of rooms such as a nurse station.
  • the sensor device SUa has a communication function that communicates with other devices SVa, SP, and TA via the network NW, detects a predetermined action in the monitored person Ob, and notifies (transmits) the detection result to the management server device SVa.
  • the nurse call is received, the nurse call is notified (transmitted) to the management server device SVa, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is generated to generate the terminal device SP.
  • a device that distributes moving images to TA When the sensor device SUa according to the first embodiment notifies the predetermined terminal device SP, TA of the detection result via the management server device SVa, the sensor device SUa displays the detection result together with the image of the monitored person Ob.
  • the nurse call is transmitted without the image of the monitored person Ob.
  • the sensor device SUa includes an imaging unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process.
  • the imaging unit 11 is an apparatus that is connected to the SU control processing unit 14a and generates an image (image data) under the control of the SU control processing unit 14a.
  • the image includes a still image (still image data) and a moving image (moving image data).
  • the imaging unit 11 is disposed so as to be able to monitor a space (location space, in the example shown in FIG. 1, where the monitored person Ob that is a monitoring target to be monitored) is located.
  • the space is imaged as an imaging target from above, an image (image data) overlooking the imaging target is generated, and the imaging target image (target image) is output to the SU control processing unit 14a.
  • the imaging unit 11 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed).
  • the sensor device SUa uses the imaging unit 11 to acquire an image of the monitored person Ob captured from above the monitored person Ob, preferably an image captured from directly above the planned head position.
  • Such an imaging unit 11 may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place.
  • the imaging unit 11 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface.
  • An image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and image data that represents an infrared image in the imaging target by performing image processing on the output of the image sensor It is a digital infrared camera provided with the image processing part etc. which produce
  • the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 11 is disposed. .
  • the SU sound input / output unit 12 is a circuit that inputs and outputs sound. That is, the SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14a, acquires external sound, and inputs the sound to the sensor device SUa, and represents the sound according to the control of the SU control processing unit 14a. It is a circuit for generating and outputting a sound corresponding to an electrical signal (sound data).
  • the SU sound input / output unit 12 includes, for example, a microphone that converts sound acoustic vibrations into electrical signals (sound data), and a speaker that converts sound electrical signals (sound data) into sound acoustic vibrations. Composed.
  • the SU sound input / output unit 12 outputs an electric signal (sound data) representing an external sound to the SU control processing unit 14a, and the electric signal (sound data) input from the SU control processing unit 14a is used as a sound sound. Convert to vibration and output.
  • the nurse call reception operation unit 13 is connected to the SU control processing unit 14a and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SUa.
  • the nurse call acceptance operation unit 13 may be connected to the SU control processing unit 14a by wire, or may be connected to the SU control processing unit 14a by short-range wireless communication such as Bluetooth (registered trademark) standard.
  • the SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14a and performs communication according to the control of the SU control processing unit 14a.
  • the SU communication IF unit 15 generates a communication signal containing data to be transferred input from the SU control processing unit 14a according to the communication protocol used in the network NW of the monitored person monitoring system MSa, and the generated communication The signal is transmitted to other devices SVa, SP and TA via the network NW.
  • the SU communication IF unit 15 receives communication signals from other devices SVa, SP, and TA via the network NW, extracts data from the received communication signals, and can process the extracted data by the SU control processing unit 14a. The data is converted into a simple format and output to the SU control processing unit 14a.
  • the SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
  • the SU storage unit 16 is a circuit that is connected to the SU control processing unit 14a and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14a.
  • the various predetermined programs include, for example, a SU control program that controls each part of the sensor device SUa according to the function of each part, a predetermined action in the monitored person Ob, and a detection result as a management server device
  • An SU monitoring processing program for notifying a predetermined terminal device SP, TA via SVa, accepting a nurse call, and notifying the predetermined terminal device SP, TA via the management server device SVa;
  • the SU call processing program for making a voice call with the terminal devices SP and TA, and the moving image generated by the imaging unit 11 can be streamed to the terminal device SP and TA that requested the moving image.
  • a control processing program such as a SU streaming processing program to be distributed is included.
  • programs such as a sensor device identifier (sensor ID), which is an identifier for identifying and identifying the sensor device SUa, and a communication address of the management server device SVa are executed. Data necessary for doing this is included.
  • the SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like.
  • the SU storage unit 16 includes a RAM (Random Access Memory) serving as a working memory of a so-called SU control processing unit 14a that stores data generated during execution of the predetermined program.
  • the SU control processing unit 14a controls each unit of the sensor device SUa according to the function of each unit, detects a predetermined action in the monitored person Ob, and notifies (transmits) the detection result to the management server device SVa.
  • the nurse call is received, the nurse call is notified (transmitted) to the management server device SVa, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is generated to generate the terminal device SP and TA.
  • the SU control processing unit 14a includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.
  • the SU control processing unit 14a is configured to execute the control processing program, so that the sensor side control unit (SU control unit) 141, the sensor side monitoring processing unit (SU monitoring processing unit) 142a, and the sensor side call processing unit (SU call) A processing unit) 143 and a sensor-side streaming processing unit (SU streaming processing unit) 144.
  • the SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.
  • the SU monitoring processing unit 142a detects a predetermined action in the monitored person Ob, notifies the detection result to a predetermined terminal device SP, TA via the management server device SVa, receives a nurse call, and manages the nurse call
  • the predetermined terminal device SP, TA is notified via the server device SVa.
  • the SU monitoring processing unit 142a when notifying the detection result to the predetermined terminal device SP, TA via the management server device SVa, displays the detection result together with the image of the monitored person Ob.
  • Terminal device SP, TA is notified, and when the nurse call is notified to the predetermined terminal device SP, TA via the management server device SVa, the nurse call is not accompanied with the image of the monitored person Ob.
  • the predetermined terminal devices SP and TA are notified.
  • the SU monitoring processing unit 142a stores a nurse, which will be described later, indicating that the nurse call has been received in advance and stored in the predetermined terminal devices SP and TA.
  • a communication signal (first nurse call notification communication signal) containing a command (command) for displaying a call reception screen on the predetermined terminal devices SP and TA is transmitted to the predetermined terminal devices SP and TA as notification of the nurse call. To do.
  • the predetermined action is set in advance.
  • the SU monitoring processing unit 142a detects the head of the monitored person Ob based on the image (target image) of the imaging target captured by the imaging unit 11, and the size of the detected head of the monitored person Ob is detected. Based on this time change, the monitored person Ob is detected from getting up, getting out of bed, falling, and falling. More specifically, first, the SU storage unit 16 stores the location area of the bedding BT and the first to third threshold values Th1 to Th3 as one of the various predetermined data.
  • the first threshold Th1 is a value for identifying the size of the head in the lying posture and the size of the head in the sitting posture in the region where the bedding BT is located.
  • the second threshold Th2 is a value for identifying whether or not the head is in the standing posture in the living room RM excluding the region where the bedding BT is located.
  • the third threshold Th3 is a value for identifying whether or not the head is in the lying position in the living room RM excluding the area where the bedding BT is located.
  • the SU monitoring processing unit 142a extracts a moving object region from the target image as a human body region of the monitored person Ob, for example, by a background difference method or a frame difference method.
  • the SU monitoring processing unit 142a uses, for example, a circular or elliptical Hough transform from the extracted moving body region, for example, by pattern matching using a head model prepared in advance, or for example, for head detection.
  • the head region of the monitored person Ob is extracted by the neural network learned in step (b).
  • the SU monitoring processing unit 142a detects wake-up, getting-off, falling, and falling from the extracted position and size of the head. For example, the SU monitoring processing unit 142a determines that the position of the extracted head is within the location area of the bedding BT, and the size of the extracted head uses the first threshold Th1 to determine the size of the lying posture.
  • the SU monitoring processing unit 142a is a case where the position of the extracted head changes over time from the location of the bedding BT to the outside of the location of the bedding BT, and the size of the extracted head is the first
  • the threshold value Th2 it is determined that the user has left the bed, and the bed is detected.
  • the SU monitoring processing unit 142a is a case where the position of the extracted head changes over time from the location of the bedding BT to the outside of the location of the bedding BT, and the size of the extracted head is the first
  • the SU monitoring processing unit 142a uses the third threshold value Th1 when the extracted head position is in the room RM excluding the location area of the bedding BT, and the extracted head size is the third threshold Th1.
  • the time changes from the size to the size of the recumbent posture it is determined that the vehicle has fallen, and the fall is detected.
  • the SU monitoring processing unit 142a uses this communication result and the target image used when obtaining the detection result as an image of the monitored person Ob.
  • the IF unit 15 notifies the management server device SVa. More specifically, the SU monitoring processing unit 142a is used to detect the sensor ID of the own device, the detection result (one or more of getting up, getting out of bed, falling and falling) in the present embodiment and the predetermined action.
  • a communication signal (first monitoring information communication signal) containing the target image is transmitted to the management server device SVa via the SU communication IF unit 15.
  • the image may be at least one of a still image and a moving image.
  • a still image is notified, and the moving image is distributed in response to a user request.
  • a moving image may be distributed, a still image and a moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.
  • the SU monitoring processing unit 142a notifies the management server device SVa of this nurse call by the SU communication IF unit 15 without the image of the monitored person Ob. . More specifically, the SU monitoring processing unit 142a transmits the first nurse call notification communication signal containing the sensor ID of the own device and information indicating that the nurse call has been received (nurse call reception information) to the SU communication IF unit 15. To the management server device SVa.
  • the nurse call reception information is stored in advance in the terminal devices SP and TA, and a nurse call reception screen (for example, the nurse call reception screen 53 shown in FIG. 10) indicating that the nurse call has been received is displayed on the terminal devices SP and TA. It also functions as a command to be executed.
  • the SU call processing unit 143 performs a voice call with the terminal devices SP and TA by using the SU sound input / output unit 12 or the like.
  • the SU call processing unit 143 receives a communication signal (first sound accommodation communication signal) containing information (first sound information, first sound data) representing the first sound input from the SU sound input / output unit 12 as the terminal.
  • a communication signal (second sound accommodation communication signal) containing information (second sound information, second sound data) representing the second sound is received from the terminal devices SP and TA is transmitted to the devices SP and TA.
  • the second sound accommodated in the second sound accommodation communication signal is output from the SU sound input / output unit 12.
  • the SU call processing unit 143 performs a voice call by VoIP (Voice over Internet Protocol) with the terminal devices SP and TA, for example, using the SU sound input / output unit 12 or the like.
  • VoIP Voice over Internet Protocol
  • the SU streaming processing unit 144 When there is a video distribution request from the terminal devices SP and TA via the communication IF unit 3, the SU streaming processing unit 144 generates the request to the terminal device SP and the terminal device TA by the imaging unit 11.
  • the moving image (for example, a live moving image) is distributed via the SU communication IF unit 15 by streaming reproduction.
  • FIG. 1 shows four first to fourth sensor devices SUa-1 to SUa-4 as an example, and the first sensor device SUa-1 is one of the monitored persons Ob.
  • the second sensor device SUa-2 is disposed in the room RM-1 (not shown) of Ob-1, and the second sensor device SUa-2 is arranged in the room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob.
  • the third sensor device SUa-3 is disposed in a room RM-3 (not shown) of Mr. C Ob-3 who is one of the monitored subjects Ob, and the fourth sensor device SUa-4 is It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.
  • the management server device SVa includes a communication function that communicates with other devices SUa, SP, and TA via the network NW, and relates to monitoring the monitored person Ob such as the detection result received from the sensor device SUa and the nurse call. Information (monitoring information) is managed, the detection result and the nurse call are notified (re-notification, transmission) to a predetermined terminal device SP, TA, and the request of the client (terminal device SP, TA, etc. in this embodiment) It is a device that provides the corresponding data to the client and manages the entire monitored person monitoring system MSa.
  • the management server device SVa includes a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22a, and a server-side storage unit. (SV storage unit) 23.
  • the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22a and performs communication according to the control of the SV control processing unit 22a.
  • the SV communication IF unit 21 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
  • the SV storage unit 23 is a circuit that is connected to the SV control processing unit 22a and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22a.
  • the various predetermined programs include, for example, an SV control program for controlling each part of the management server device SV according to the function of each part, a monitored result such as the detection result received from the sensor device SUa, and the nurse call.
  • a control processing program such as an SV monitoring processing program for managing monitoring information related to the monitoring of the person Ob and notifying (re-notifying and transmitting) the detection result and the nurse call to a predetermined terminal device SP or TA.
  • the various predetermined data include a server identifier (server ID) for identifying the management server device SVa and identifying the management server device SV, monitoring information related to monitoring of the monitored person Ob, and the detection Data necessary for executing each program such as inter-device information representing information between the devices SUa, SP, and TA such as the result and the nurse call notification destination are included.
  • the SV storage unit 23 functionally includes a server-side monitoring information storage unit (SV monitoring information storage unit) 231 and an inter-device information storage unit 232.
  • the SV monitoring information storage unit 231 stores monitoring information of the monitored person Ob transmitted / received to / from each of the devices SUa, SP, and TA. More specifically, in the present embodiment, the SV monitoring information storage unit 231 includes, as the monitoring information, the sensor ID, the detection result, and the target image that are accommodated in the first monitoring information communication signal received from the sensor device SUa, and The reception time of the first monitoring information communication signal is stored in association with each other, the sensor ID and nurse call reception information accommodated in the first nurse call notification communication signal received from the sensor device SUa, and the first The reception time of the nurse call notification communication signal is stored in association with each other.
  • the inter-device information storage unit 232 stores a report correspondence relationship, a communication address correspondence relationship, and the like as the inter-device information.
  • the notification destination correspondence is a transmission source indicating a notification destination (re-notification destination, transfer destination, transmission destination) of the first monitoring information communication signal and the first nurse call notification communication signal transmitted from the sensor device SUa. This is a correspondence relationship between a sensor ID and a terminal ID that is a notification destination (re-notification destination).
  • the communication address correspondence relationship is a correspondence relationship between IDs (sensor IDs and terminal IDs) of the devices SUa, SP, and TA and their communication addresses.
  • the terminal ID is an identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.
  • each of the sensor ID, server ID, and terminal ID may be, for example, a serial number composed of a predetermined symbol string, or may be a communication address (in this case, communication address correspondence can be omitted).
  • the SV control processing unit 22a controls each unit of the management server device SVa according to the function of each unit, and information related to monitoring the monitored person Ob such as the detection result or the nurse call received from the sensor device SUa (monitoring). Information), the detection result and the nurse call are notified (re-notification, transmission) to a predetermined terminal device SP, TA, and data according to a request from a client (terminal device SP, TA, etc. in this embodiment) Is a circuit for managing the entire monitored person monitoring system MSa.
  • the SV control processing unit 22a includes, for example, a CPU and its peripheral circuits.
  • the SV control processing unit 22a functionally includes a server side control unit (SV control unit) 221 and a server side monitoring processing unit (SV monitoring processing unit) 222a by executing the control processing program.
  • the SV control unit 221 controls each unit of the management server device SV according to the function of each unit, and controls the entire management server device SV.
  • the SV monitoring processing unit 222a manages monitoring information related to monitoring of the monitored person Ob such as the detection result or the nurse call received from the sensor device SUa, and the detection result or the nurse call is transmitted to a predetermined terminal device SP, TA. Notification (re-notification, transmission). More specifically, when the SV monitoring processing unit 222a receives a first monitoring information communication signal as a notification of the detection result from the sensor device SUa, the monitored person accommodated in the received first monitoring information communication signal. Ob monitoring information is stored (recorded) in the SV monitoring information storage unit 231. Then, the SV monitoring processing unit 222a notifies (re-notifies) the received notification of the detection result to the predetermined terminal devices SP and TA.
  • the SV monitoring processing unit 222a stores the notification destination (re-notification destination, transfer destination, transmission destination) corresponding to the sensor device SUa that has transmitted the received first monitoring information communication signal in the inter-device information storage unit 232.
  • a selection is performed from the stored correspondence relationship of the report destinations, and a second monitoring information communication signal is transmitted to the selected terminal devices SP and TA. This selection (search process) is performed based on the sensor ID corresponding to the sensor device SUa that has transmitted the received first monitoring information communication signal.
  • the second monitoring information communication signal includes a sensor ID stored in the first monitoring information communication signal, a sensor ID stored in the first monitoring information communication signal as a download destination of the detection result and the target image, and a moving image.
  • a communication address corresponding to the sensor device SUa having the ID is accommodated. This communication address is selected (searched) from the communication address correspondence relationship based on the sensor ID corresponding to the sensor device SUa that has transmitted the received first monitoring information communication signal.
  • the SV monitoring processing unit 222a receives the first nurse call notification communication signal from the sensor device SUa as the nurse call notification, the SV monitoring processing unit 222a displays the monitoring information of the monitored person Ob contained in the received first nurse call communication signal. The information is stored (recorded) in the SV monitoring information storage unit 231. Then, the SV monitoring processing unit 222a notifies (re-notifies) the received nurse call to the predetermined terminal devices SP and TA.
  • the SV monitoring processing unit 222a sets the notification destination (re-notification destination, transfer destination, transmission destination) corresponding to the sensor device SUa that has transmitted the received first nurse call notification communication signal as the inter-device information storage unit 232. Is selected (searched) from the correspondence relationship of the notification destination stored in the terminal, and a second nurse call notification communication signal is transmitted to the selected terminal devices SP and TA.
  • the second nurse call notification communication signal includes the sensor ID and nurse call reception information stored in the first nurse call notification communication signal.
  • the management server device SVa is connected to the SV control processing unit 22a as necessary by a server side input unit (SV input unit) for inputting, for example, various commands and various data, as indicated by broken lines in FIG. 24)
  • Server side output unit (SV output unit) 25 that outputs various commands and various data input by the SV input unit 24 and monitoring information related to monitoring of the monitored person Ob, and data between external devices
  • a server-side interface unit (SVIF unit) 26 or the like for performing input / output may be provided.
  • Such a management server device SVa can be configured by a computer with a communication function, for example.
  • the fixed terminal device SP includes a communication function for communicating with other devices SUa, SVa, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like.
  • the user interface (UI) of the monitored person monitoring system MSa is input by inputting a predetermined instruction or data to be given to the management server SVa or the mobile terminal device TA, or displaying monitoring information obtained by the sensor device SUa. ).
  • Such a fixed terminal device SP can be configured by, for example, a computer with a communication function.
  • the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in this specification, a mobile terminal device TA that is another example of the terminal device will be described.
  • the mobile terminal device TA communicates with other devices SVa, SP, SUa via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call.
  • a monitoring function (including a moving image) obtained by the sensor device SUa by inputting a predetermined instruction or data to be provided to the management server device SVa or the sensor device SUa, or having a call function or the like to be performed, or by a report from the management server device SVa
  • such a portable terminal device TA includes a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, and A terminal side storage unit (TA storage unit) 33, a terminal side sound input / output unit (TA sound input / output unit) 34, a terminal side input unit (TA input unit) 35, and a terminal side display unit (TA display unit). 36 and a terminal-side interface unit (TAIF unit) 37.
  • the TA sound input / output unit 34 is connected to the TA control processing unit 32, and is a circuit for acquiring external sound and inputting it to the portable terminal device TA. It is a circuit for generating and outputting a sound corresponding to an electrical signal representing a sound according to the control of the processing unit 32.
  • the TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a circuit that accepts a predetermined operation and inputs it to the mobile terminal device TA, for example, a plurality of input switches assigned with a predetermined function.
  • the predetermined operation include an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the informed monitored person.
  • various operations necessary for monitoring such as an input operation indicating that there is an intention to perform (response, response) such as lifesaving, nursing, nursing care, and assistance for Ob, are included.
  • the TA display unit 36 is connected to the TA control processing unit 32, and under the control of the TA control processing unit 32, the predetermined operation content input from the TA input unit 35 and the monitored target MSa monitored by the monitored person monitoring system MSa.
  • a circuit that displays the monitoring information related to the monitoring of the monitoring person Ob for example, the type of a predetermined action detected by the sensor device SU, the image (still image and moving image) of the monitored person Ob, reception of a nurse call, etc.
  • display devices such as an LCD (Liquid Crystal Display) and an organic EL display.
  • the TA input unit 35 and the TA display unit 36 constitute a touch panel.
  • the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method.
  • a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36.
  • a user such as a nurse or a caregiver ( When the monitor) touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal device TA as the operation input content of the user. Entered.
  • the TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device according to the control of the TA control processing unit 32.
  • the TAIF unit 37 uses the Bluetooth (registered trademark) standard.
  • An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard are examples of the Bluetooth (registered trademark) standard.
  • the TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication according to the control of the TA control processing unit 32, similarly to the SU communication IF unit 15.
  • the TA communication IF unit 31 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.
  • the TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32.
  • the various predetermined programs include a TA control program for controlling each unit of the mobile terminal device TA according to the function of each unit, the detection result received from the sensor device SUa via the management server device SVa, By storing (recording) monitoring information related to monitoring of the monitored person Ob, such as the nurse call, and using the TA monitoring processing program for displaying the detection result and the nurse call, the TA sound input / output unit 12, and the like, the sensor device Control processing program such as a TA call processing program for performing a voice call with SUa, a streaming processing program for receiving distribution of moving images from the sensor device SUa, and displaying the distributed moving images on the TA display unit 36 by streaming playback Is included.
  • the TA storage unit 33 includes, for example, a ROM and an EEPROM.
  • the TA storage unit 33 includes a RAM serving as a working memory for the so-called TA control processing unit 32 that stores data generated during execution of the predetermined program.
  • the TA storage unit 33 functionally includes a terminal-side monitoring information storage unit (TA monitoring information storage unit) 331 for storing the monitoring information.
  • the TA monitoring information storage unit 331 stores monitoring information of the monitored person Ob transmitted / received to / from each device SVa, SP, SUa. More specifically, in this embodiment, the TA monitoring information storage unit 331 includes, as the monitoring information, a sensor ID, a detection result, a target image, and a sensor image stored in the second monitoring information communication signal received from the management server device SVa.
  • the communication address of the sensor device SUa to which the moving image is downloaded and the reception time of the second monitoring information communication signal are stored in association with each other, and are stored in the second nurse call notification communication signal received from the management server device SVa.
  • the sensor ID, nurse call reception information, and the reception time of the second nurse call notification communication signal are stored in association with each other.
  • the TA control processing unit 32 is a circuit for controlling each unit of the mobile terminal device TA according to the function of each unit, receiving and displaying the monitoring information for the monitored person Ob, and answering or calling a nurse call. It is.
  • the TA control processing unit 32 includes, for example, a CPU and its peripheral circuits.
  • the TA control processing unit 32 executes a control processing program, so that a terminal side control unit (TA control unit) 321, a terminal side monitoring processing unit (TA monitoring processing unit) 322, a terminal side call processing unit (TA call processing unit) Unit) 323 and a terminal-side streaming processing unit (TA streaming processing unit) 324 functionally.
  • the TA control unit 321 controls each part of the mobile terminal apparatus TA according to the function of each part, and controls the entire mobile terminal apparatus TA.
  • the TA monitoring processing unit 322 stores (records) monitoring information related to monitoring of the monitored person Ob such as the detection result or the nurse call received from the sensor device SUa via the management server device SVa, and records the detection result or the A nurse call is displayed. More specifically, when the TA monitoring processing unit 322 receives the second monitoring information communication signal from the management server device SVa, the TA monitoring processing unit 322 returns the monitoring information of the monitored person Ob contained in the received second monitoring information communication signal. Store (record) in the TA monitoring information storage unit 331. The TA monitoring processing unit 322 displays a screen corresponding to each piece of information contained in the received second monitoring information communication signal on the TA display unit 36.
  • the TA monitoring processing unit 322 When receiving the second nurse call notification communication signal from the management server device SVa, the TA monitoring processing unit 322 stores the monitoring information of the monitored person Ob stored in the received second nurse call notification communication signal in the TA monitoring information storage. Store (record) in the unit 331. The TA monitoring processing unit 322 displays a nurse call reception screen pre-stored in the TA storage unit 33 on the TA display unit 36 according to the nurse call reception information accommodated in the received second nurse call notification communication signal. . When receiving a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process corresponding to the input operation.
  • the TA call processing unit 323 performs a voice call with the sensor device SUa by using the TA sound input / output unit 34 or the like.
  • the TA call processing unit 323 receives a communication signal (second sound accommodation communication signal) containing information (second sound information and second sound data) representing the second sound input from the TA sound input / output unit 34 as the sensor.
  • the TA sound input / output unit 34 outputs the first sound accommodated in the first sound accommodation communication signal. More specifically, the TA call processing unit 323 uses the TA sound input / output unit 34 and the like, for example, VoIP with the source sensor device SUa that has transmitted the first nurse call notification communication signal to the management server device SVa. Make a voice call.
  • the TA streaming processing unit 324 receives distribution of a moving image from the sensor device SUa, and displays the distributed moving image on the TA display unit 36 by streaming reproduction.
  • Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.
  • the imaging unit 11 of the sensor device SUa corresponds to an example of an image acquisition unit that acquires the image of the monitored person.
  • the SU monitoring processing unit 142a of the sensor device SUa notifies the terminal device of the detection result
  • the detection result is notified to the terminal device together with the image of the monitored person, and the nurse call is notified to the terminal device.
  • this corresponds to an example of a monitoring processing unit that notifies the terminal device of the nurse call without the image of the monitored person.
  • FIG. 5 is a flowchart illustrating the operation of the sensor device in the monitored person monitoring system according to the embodiment.
  • FIG. 6 is a flowchart illustrating the operation of the management server device in the monitored person monitoring system according to the embodiment.
  • FIG. 7 is a flowchart illustrating the operation of the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 8 is a diagram illustrating an example of a standby screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 9 is a diagram illustrating an example of a monitoring information screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 10 is a diagram illustrating an example of a nurse call reception screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • the SU control processing unit 14a is functionally configured with the SU control unit 141, the SU monitoring processing unit 142a, the SU call processing unit 143, and the SU streaming processing unit 144.
  • an SV control processing unit 22a and an SV monitoring processing unit 222a are functionally configured in the SV control processing unit 22a by executing the control processing program.
  • the TA control processing unit 32 is functionally configured with a TA control unit 321, a TA monitoring processing unit 322, a TA call processing unit 323, and a TA streaming processing unit 324.
  • the sensor device SUa operates as follows for each frame or every several frames, thereby detecting a predetermined operation in the monitored person Ob and determining whether or not a nurse call is accepted.
  • the sensor device SUa acquires an image (image data) for one frame from the imaging unit 11 as the target image by the SU control unit 141 of the SU control processing unit 14a (S11).
  • the sensor device SUa executes a behavior detection process for detecting a predetermined behavior in the monitored person Ob by the SU monitoring processing unit 142a of the SU control processing unit 14a based on the acquired target image (S12).
  • the sensor device SUa determines whether or not a predetermined action in the monitored person Ob is detected in the action detection process S12 by the SU monitoring processing unit 142a. As a result of this determination, when the behavior is not detected (No), the sensor device SUa next executes the process S15, whereas when the behavior is detected (Yes), the sensor device SUa The device SUa executes step S15 after executing the next step S14.
  • the sensor apparatus SUa in order to notify the predetermined behavior detected in the processes S12 and S13 to the predetermined terminal apparatus SP, TA via the management server apparatus SVa, the sensor apparatus SUa is operated by the SU monitoring processor 142a. 1
  • the monitoring information communication signal is transmitted to the management server device SVa. More specifically, the SU monitoring processing unit 142a sends the first monitoring information communication signal containing the sensor ID of the own device, the detection result, and the target image to the management server device SVa via the SU communication IF unit 15. Send. Therefore, the first monitoring information communication signal for notifying the detection result includes the target image as the image of the monitored person Ob together with the detection result.
  • the sensor device SUa determines whether or not the nurse call is accepted by the SU monitoring processing unit 142a. That is, the processes S11 to S16a shown in FIG. 5 are repeatedly executed for each frame or every several frames, but during the period from the previous execution of the process S15 to the current execution of the process S15, It is determined whether or not the call reception operation unit 13 has been operated. As a result of this determination, if the nurse call reception operation unit 13 is not operated and the nurse call is not received (No), the sensor device SUa ends the current process, while the nurse call reception operation unit 13 Is operated and the nurse call is accepted (Yes), the sensor device SUa executes the next process S16a, and then ends the present process.
  • the sensor apparatus SUa uses the SU monitoring processor 142a to A nurse call notification communication signal is transmitted to the management server device SVa. More specifically, the SU monitoring processing unit 142a transmits a first nurse call notification communication signal containing the sensor ID of the own device and nurse call reception information to the management server device SVa via the SU communication IF unit 15. . Therefore, in the first nurse call notification communication signal for notifying the nurse call, the target image is not accompanied by the nurse call as the image of the monitored person Ob.
  • the sensor device SUa operates as described above with respect to detection of a predetermined action and reception of a nurse call in the monitored person Ob.
  • the management server device SVa determines whether or not the SV communication IF unit 21 has received a communication signal by the SV control unit 221 of the SV control processing unit 22a (S21). As a result of the determination, if the communication signal is not received (No), the management server device SVa returns the process to S21. If the result of the determination is that the communication signal is received (Yes), The management server device SVa executes the following process S22. That is, the management server device SVa waits for reception of a communication signal.
  • the management server device SVa determines the type of the received communication signal by the SV control unit 221. As a result of this determination, when the received communication signal is the first monitoring information communication signal (first monitoring information), the management server device SVa executes the processing S26 after executing the processing S23, and receives the received When the communication signal is the first nurse call notification communication signal (first NC notification), the process S26a is executed after the process S24a, and the received communication signal is the first monitoring information communication signal and the first monitor information communication signal. If it is not a 1 nurse call notification communication signal (others), the process S26 is executed after the process S25.
  • the management server device SVa processes the first monitoring information communication signal received from the sensor device SUa in the processing S21 by the SV monitoring processing unit 222a of the SV control processing unit 22a. More specifically, first, the SV monitoring processing unit 222a displays monitoring information related to monitoring of the monitored person Ob contained in the first monitoring information communication signal received from the sensor device SUa in step S21. 231 is stored (recorded).
  • the SV monitoring processing unit 222a selects a notification destination corresponding to the sensor device SUa that has transmitted the first monitoring information communication signal received in step S21 from the notification destination correspondence stored in the inter-device information storage unit 232 ( Search) to the selected terminal device SP, TA, the sensor ID contained in the received first monitoring information communication signal, the detection result and the target image, and the received first as the download destination of the moving image.
  • the second monitoring information communication signal containing the communication address corresponding to the sensor device SUa having the sensor ID accommodated in the one monitoring information communication signal is transmitted.
  • the second monitoring information communication signal includes the target image together with the detection result as an image of the monitored person Ob, similarly to the first monitoring information communication signal.
  • the management server device SVa processes the first nurse call notification communication signal (first NC notification communication signal) received from the sensor device SUa in the processing S21 by the SV monitoring processing unit 222a of the SV control processing unit 22a. More specifically, first, the SV monitoring processing unit 222a stores monitoring information regarding monitoring of the monitored person Ob contained in the first nurse call notification communication signal received from the sensor device SUa in step S21. Store (record) in the unit 231. Then, the SV monitoring processing unit 222a selects a notification destination corresponding to the sensor device SUa that has transmitted the first nurse call notification communication signal received in step S21 from the notification destination correspondence stored in the inter-device information storage unit 232.
  • the management server apparatus SVa performs an appropriate process according to the communication signal received in the process S21 by the SV control processing unit 22a.
  • the management server apparatus SVa determines whether or not its operation is completed (stopped) by the SV control processing unit 22a. As a result of this determination, when the operation is finished (stopped) (Yes), the management server device SVa finishes this process. On the other hand, when the operation is not finished (stopped) (No), the management server device SVa The server apparatus SVa returns the process to process S21.
  • the monitoring server device SVa operates as described above with respect to the detection results received from the sensor device SUa and each notification (each re-notification) of the nurse call.
  • the operation of the terminal devices SP and TA will be described.
  • the operation of the mobile terminal device TA will be described.
  • the portable terminal device TA accepts a login operation by a monitor (user) such as a nurse or a caregiver, and the TA monitor processing unit 322 automatically performs the login operation.
  • a standby screen for waiting for a communication signal addressed to the machine is displayed on the TA display unit 36.
  • the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating standby (for example, “no notification”) and an icon.
  • a time area 513 for displaying the current time a year / month / sunday area 514 for displaying the current year / month / sunday, and a user name area 515 for displaying the name of the user who is currently logged in to the portable terminal device TA.
  • the mobile terminal device TA determines whether or not the TA communication IF unit 31 has received a communication signal by the TA control unit 321 of the TA control processing unit 32 (S31). As a result of this determination, when the communication signal is not received (No), the mobile terminal device TA returns the process to S31, and as a result of the determination, when the communication signal is received (Yes), The portable terminal device TA executes the following process S32. That is, the mobile terminal device TA is waiting for reception of a communication signal.
  • the portable terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the received communication signal is the second monitoring information communication signal (second monitoring information), the portable terminal device TA executes the next processing S33 and processing S34 in sequence and then processing S37. When the received communication signal is the second nurse call notification communication signal (second NC notification), the process S37 and the process S36 are sequentially executed, and then the process S37 is executed. When the communication signal is not the second monitoring information communication signal and the second nurse call notification communication signal (others), the process is performed after executing the process S39 for performing an appropriate process according to the communication signal received in the process S31. finish.
  • the received communication signal is the second monitoring information communication signal (second monitoring information)
  • the portable terminal device TA executes the next processing S33 and processing S34 in sequence and then processing S37.
  • the received communication signal is the second nurse call notification communication signal (second NC notification)
  • the process S37 and the process S36 are sequentially executed, and then the process S37
  • the mobile terminal device TA monitors the monitored person Ob contained in the second monitoring information communication signal received from the management server apparatus SVa in the process S31 by the TA monitoring processing unit 322 of the TA control processing unit 32. Is stored (recorded) in the TA monitoring information storage unit 331.
  • the TA monitoring processing unit 322 displays a screen corresponding to each information contained in the second monitoring information communication signal received in processing S31, for example, the monitoring information screen 52 shown in FIG. 36 (S34).
  • the monitoring information screen 52 is a screen for displaying the monitoring information related to the monitoring of the monitored person Ob.
  • the monitoring information screen 52 includes a menu bar area 511, a monitored person name area 521, a detection information display area 522, an image area 523, a “corresponding” button 524, A “speak” button 525 and a “watch live” button 526 are provided.
  • the monitored person name area 521 includes the location where the sensor device SUa having the sensor ID accommodated in the second monitoring information communication signal received in step S31 and the monitored device monitored by the sensor device SUa having the sensor ID. This is an area for displaying the name of the supervisor Ob.
  • the detection information display area 522 includes an elapsed time from the reception time of the second monitoring information communication signal received in the process S31 (or the detection time of the predetermined action), and the second monitoring information communication signal received in the process S31. It is an area
  • the image area 523 displays an image (that is, a target image captured by the sensor device SUa having the sensor ID) (here, a still image) contained in the second monitoring information communication signal received in step S31. It is an area.
  • the TA storage unit 33 In order to display the location of the sensor device SUa and the name of the monitored subject Ob in the monitored person name area 521, the TA storage unit 33 has the sensor ID and the location of the sensor device SUa having the sensor ID. And the name of the monitored person Ob monitored by the sensor device SUa having the sensor ID is stored in advance in association with each other.
  • the detection result in this embodiment, the names of getting up, getting out of bed, falling down, and falling
  • the detection result is displayed with an icon that symbolically represents the detection result.
  • the TA storage unit 33 stores each action and an icon representative of the action in association with each other in advance.
  • the detection information display area 522 displays a wake-up icon that symbolizes wake-up.
  • the “corresponding” button 524 has an intention to perform a predetermined response (response, response) such as lifesaving, nursing, care, and assistance for the detection result displayed on the monitoring information screen 52. It is a button for inputting execution intention information indicating that the user of the mobile terminal device TA is present to the mobile terminal device TA.
  • a “speak” button 525 is a button for requesting a voice call, and is used to input an instruction to connect the sensor device SUa with the sensor ID and the mobile terminal device TA via the network NW. It is a button.
  • the “LIVE” button 526 is a button for requesting a live video, and is a button for inputting an instruction to display a video captured by the sensor device SUa with the sensor ID.
  • the portable terminal device TA is monitored by the TA monitoring processing unit 322 of the TA control processing unit 32, which is accommodated in the second nurse call notification communication signal received from the management server device SVa in the process S31.
  • Monitoring information related to monitoring Ob is stored (recorded) in the TA monitoring information storage unit 331.
  • the TA monitoring processing unit 322 receives a nurse call stored in advance in the TA storage unit 33 in accordance with the nurse call reception information accommodated in the second monitoring information communication signal received in step S31. For example, a nurse call reception screen 53 shown in FIG. 10 is displayed on the TA display unit 36 (S36).
  • the nurse call reception screen 53 shown in FIG. 10 includes a menu bar area 511, a monitored person name area 521, a detection information display area 522, and a message indicating that a nurse call has been received (for example, “Nurse call is ”), A nurse call reception notification display area 531, a“ corresponding ”button 524, and a“ speak ”button 525.
  • the detection information display area 522 displays only the elapsed time from the reception time of the second nurse call notification communication signal received in step S31 (or the reception time of reception of the nurse call).
  • the nurse call reception screen 53 does not include the “watch live” button 526, and viewing of moving images in a live state is prohibited.
  • portable terminal device TA performs input operation with the touch panel which comprises TA input part 35 and TA display part 36 by TA control process part 32. It is determined whether or not it has been accepted. If the input operation is not accepted as a result of this determination (No), the mobile terminal device TA returns the process to step S37. On the other hand, if the input operation is accepted as a result of the determination, the mobile terminal TA The apparatus TA executes the next process S38.
  • the portable terminal device TA performs an appropriate process according to the content of the input operation by the TA control processing unit 32, and ends this process.
  • the portable terminal device TA when the mobile terminal device TA accepts an input operation of the “corresponding” button 524 by the TA control processing unit 32 (that is, when accepting the correspondence intention), the portable terminal device TA is currently displayed on the TA display unit 36.
  • a sensor corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 with the fact that “corresponding” has been received is added to the monitoring information of the monitoring person Ob and stored in the TA monitoring information storage unit 331.
  • a communication signal (correspondence acceptance notification communication signal) containing information indicating that the ID and “corresponding” are accepted (correspondence acceptance information) is transmitted to the management server device SVa.
  • the management server device SVa that has received the correspondence reception notification communication signal, by the SV control processing unit 22a, has received a communication signal (correspondence reception known communication) containing the sensor ID and the correspondence reception information contained in the received correspondence reception notification communication signal. Signal) to the terminal devices SP and TA by broadcast communication.
  • a communication signal correlateence reception known communication
  • the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36
  • the fact that “corresponding” has been received is synchronized between the terminal devices SP and TA.
  • the TA call processing unit 323 monitors the monitored person Ob displayed on the TA display unit 36.
  • a communication signal (call request communication signal) containing information such as requesting a voice call is transmitted to the sensor device SUa, and the corresponding sensor device SUa is connected to the sensor device SUa via the network NW so that the voice call can be made.
  • a voice call can be performed between the mobile terminal device TA and the sensor device SUa.
  • the mobile terminal device TA When the TA control processing unit 32 receives an input operation of an “end” button (not shown) that is a button for inputting an instruction to end a voice call, the mobile terminal device TA receives the TA call processing unit 323. A communication signal (call end communication signal) containing information such as a request to end the voice call is transmitted to the sensor device SUa that monitors the monitored person Ob displayed on the TA display unit 36. Thereby, the voice call between the portable terminal device TA and the sensor device SUa is terminated.
  • an “end” button not shown
  • a communication signal call end communication signal
  • the TA streaming processing unit 324 displays the monitored object currently displayed on the TA display unit 36.
  • a communication signal moving image distribution request communication signal
  • the video is connected to be downloadable via the sensor device SUa, and the live video is distributed from the sensor device SUa.
  • the received video is displayed on the TA display unit 36 by streaming playback.
  • the “live end” button is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image captured by the sensor device SUa of the sensor ID and ends (stops) the display. This is a button for inputting an instruction to be performed.
  • the TA control processing unit 32 receives an input operation of the “live end” button, the portable terminal device TA monitors the monitored person Ob currently displayed on the TA display unit 36 by the TA streaming processing unit 324.
  • a communication signal (moving image distribution end communication signal) containing information such as requesting the end of moving image distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. Accordingly, the mobile terminal device TA ends the live video display.
  • the mobile terminal device TA operates as described above regarding the detection results received from the sensor device SUa via the management server device SVa and each notification of each nurse call (re-notification).
  • the monitored person monitoring system MSa, the sensor apparatus SUa and the management server apparatus SVa as an example of the monitored person monitoring apparatus, and the monitored person monitoring method implemented in these embodiments are nurses.
  • the nurse call is notified to the terminal devices SP and TA without accompanying the image of the monitored person Ob, so that the terminal devices SP and TA are the images of the monitored person Ob.
  • the nurse call notification is output without accompanying. For this reason, it is possible to prevent the monitor (user) handling the terminal devices SP and TA from habitually seeing the image of the monitored person Ob when the nurse call is made.
  • the monitored person monitoring system MSa, the monitored person monitoring device (the sensor device SUa and the management server device SVa), and the monitored person monitoring method have a smaller time lag in response to the nurse call, and the burden on the supervisor. Can be reduced more.
  • the monitored person monitoring system MSa, the monitored person monitoring device (the sensor device SUa and the management server device SVa), and the monitored person monitoring method do not accommodate the image of the monitored person Ob, and receive a nurse call reception screen 53. Since the nurse call notification communication signal containing the nurse call reception information is transmitted to the terminal devices SP and TA as a command (command) for displaying the terminal device SP and TA on the terminal devices SP and TA, the terminal devices SP and TA are images of the monitored person Ob.
  • the nurse call reception screen 53 is displayed without accompanying. Therefore, the monitored person monitoring system MSa, the monitored person monitoring device (the sensor device SUa and the management server device SVa), and the monitored person monitoring method have a smaller time lag in response to the nurse call, and the burden on the supervisor. Can be reduced more.
  • the monitored person monitoring device (the sensor device SUa and the management server device SVa) and the monitored person monitoring method can perform a voice call with the terminal devices SP and TA
  • the terminal device SP The supervisor who handles TA can respond to the nurse call of the monitored person Ob by voice call when the nurse call is notified. For this reason, depending on the content of the nurse call grasped by the voice call, it is possible to deal with the nurse call only by the voice call, or to go to the person being monitored Ob after preparing for the handling of the nurse call in advance.
  • FIG. 11 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system according to the second embodiment.
  • FIG. 12 is a diagram illustrating a configuration of the management server device in the monitored person monitoring system according to the second embodiment.
  • the monitored person monitoring system MSb in the second embodiment using the monitored person monitoring apparatus of the second aspect is, for example, as shown in FIG. 1, one or more sensor devices SUb (SUb-1 to SUb-4). ), A management server device SVb, a fixed terminal device SP, and one or a plurality of portable terminal devices TA (TA-1, TA-2).
  • the fixed terminal device SP and the portable terminal device TA in the monitored person monitoring system MSb of the second embodiment are the same as the fixed terminal device SP and the portable terminal device TA in the monitored person monitoring system MSa of the first embodiment, respectively. Since there is, explanation is omitted.
  • the sensor device SUb in the second embodiment includes an imaging unit 11, an SU sound input / output unit 12, a nurse call reception operation unit 13, a SU control processing unit 14b, and a SU communication IF.
  • Unit 15 and SU storage unit 16, and SU control processing unit 14 b functionally includes SU control unit 141, SU monitoring processing unit 142 b, SU call processing unit 143, and SU streaming processing unit 144.
  • the sensor device SUb in the second embodiment is functionally replaced with the SU monitoring processing unit 142b in the SU control processing unit 14b instead of the SU monitoring processing unit 142a of the SU control processing unit 14a in the sensor device SUa of the first embodiment.
  • the SU monitoring processing unit 142b is similar to the SU monitoring processing unit 142a of the first embodiment, detects a predetermined action in the monitored person Ob, and sends a detection result to the predetermined terminal device SP, TA via the management server device SVb. And receiving the nurse call and notifying the nurse call to the predetermined terminal devices SP and TA via the management server device SVb. In the notification of the detection result, the SU monitoring processing unit 142a according to the first embodiment transmits the detection result to the management server device SVa along with the image of the monitored person Ob, while in the notification of the nurse call, the monitored person is notified.
  • the SU monitoring processing unit 142b in the second embodiment notifies the detection result with the image of the monitored person Ob in the notification of the detection result. Is transmitted to the management server device SVa, and the nurse call is transmitted to the management server device SVa with the image of the monitored person Ob even in the notification of the nurse call.
  • the SU monitoring processing unit 142b in the second embodiment is different from the SU monitoring processing unit 142a in the first embodiment.
  • the SU monitoring processor 142b in the second embodiment is the same as the SU monitoring processor 142a in the first embodiment. Therefore, in the operation shown in FIG.
  • the sensor device SUb uses the SU monitoring processor 142b to detect its own sensor ID and nurse call reception information. And the process S16b which transmits the 1st nurse call notification communication signal which accommodated the object image to management server apparatus SVb is performed.
  • the target image accommodated in the first nurse call notification communication signal may be an image acquired in the process S11, or may be an image newly acquired from the imaging unit 11 in the process S16b.
  • the management server device SVb in the second embodiment includes, for example, as shown in FIG. 12, an SV communication IF unit 21, an SV control processing unit 22b, and an SV storage unit 23.
  • the SV control processing unit 22b A control unit 221 and an SV monitoring processing unit 222b are functionally provided. That is, the management server device SVb in the second embodiment functions as an SV control processing unit 222b instead of the SV monitoring processing unit 222a of the SV control processing unit 22a in the management server device SVa of the first embodiment.
  • the management server device SVa in the first embodiment is the same as the management server device SVa in the first embodiment except for the specific provisions. For this reason, the description of the SV communication IF unit 21, the SV control unit 221 of the SV control processing unit 22b, and the SV storage unit 23 is omitted.
  • the SV monitoring processing unit 222b is similar to the SV monitoring processing unit 222a of the first embodiment, manages monitoring information related to monitoring of the monitored person Ob such as the detection result and the nurse call received from the sensor device SUa, and The detection result and the nurse call are notified (re-notification and transmission) to predetermined terminal devices SP and TA.
  • the SV monitoring processing unit 222a in the first embodiment generates a second nurse call notification communication signal containing the sensor ID and nurse call reception information stored in the first nurse call notification communication signal received from the sensor device SUa. The generated second nurse call notification communication signal is transmitted to predetermined terminal devices SP and TA.
  • the SV monitoring processing unit 222a changes the transmission destination of the first nurse call notification communication signal from the management server device SVa to the predetermined terminal devices SP and TA, thereby the first nurse call notification communication signal.
  • the second nurse call notification communication signal can be generated.
  • the SV monitoring processing unit 222b of the second embodiment It is necessary to generate the second nurse call notification communication signal by removing the image of the monitored person Ob included in the first nurse call notification communication signal.
  • the SV monitoring processing unit 222b in the second embodiment is different from the SV monitoring processing unit 222a in the first embodiment.
  • the SV monitoring processing unit 222b in the second embodiment is the same as the SV monitoring processing unit 222a in the first embodiment. Therefore, in the operation illustrated in FIG. 6, in the second embodiment, instead of the process S24a of the first embodiment described above, the management server apparatus SVb uses the SV monitoring processing unit 222b to perform the first nurse according to the second embodiment.
  • a process S24b for transmitting the second nurse call notification communication signal containing the sensor ID and the nurse call reception information to the predetermined terminal devices SP and TA without accommodating the target image accommodated in the call notification communication signal is executed. .
  • the monitored person monitoring system MSb, the monitored person monitoring device (the sensor device SUb and the management server device SVb) and the monitored person monitoring method in the second embodiment are the same as the monitored person monitoring system in the first embodiment.
  • the same effects as the MSa, the monitored person monitoring device (the sensor device SUa and the management server device SVa), and the monitored person monitoring method are obtained.
  • the SV communication IF unit 21 corresponds to another example of an image acquisition unit that acquires an image of a monitored person.
  • the SV monitoring processing unit 222b of the management server device SVb notifies the terminal device of the detection result, the detection result is notified to the terminal device together with the image of the monitored person, and the nurse call is transmitted to the terminal device.
  • notification it corresponds to another example of a monitoring processing unit that notifies the terminal device of the nurse call without an image of the monitored person.
  • the monitored person monitoring apparatus detects a predetermined action in the monitored person who is a monitoring target, notifies a detection result to a terminal device connected to be communicable, accepts a nurse call, and receives the nurse call.
  • a monitored person monitoring device for notifying the terminal device, an image acquisition unit for acquiring the image of the monitored person, and the notification result to the terminal device together with the image of the monitored person
  • a monitoring processing unit that notifies the terminal device of the nurse call without an image of the monitored person when the terminal device is notified of the detection result and the terminal device is notified of the nurse call.
  • the sensor device detects a predetermined action in the monitored person that is a monitoring target, and a detection result
  • the management server device accepts a nurse call, notifies the management server device of the nurse call, and the management server device receives the notification of the detection result from the sensor device.
  • the nurse call is notified (re-recorded) to the predetermined terminal device associated with the sensor device.
  • the terminal device displays the detection result when receiving the notification of the detection result from the management server device.
  • the notification of the nurse call displays the nurse call and received from the management server device
  • the sensor device comprises the image acquisition unit and the monitoring processor.
  • the sensor device detects a predetermined action in the monitored person that is a monitoring target, and a detection result
  • the management server device accepts a nurse call, notifies the management server device of the nurse call, and the management server device receives the notification of the detection result from the sensor device.
  • the nurse call is notified (re-recorded) to the predetermined terminal device associated with the sensor device.
  • the terminal device displays the detection result when receiving the notification of the detection result from the management server device.
  • the notification of the nurse call displays the nurse call and received from the management server apparatus, the management server apparatus comprises the image acquisition unit and the monitoring processor.
  • the monitored person monitoring apparatus has a smaller time lag in dealing with the nurse call and can further reduce the burden on the observer.
  • the monitoring processing unit when the monitoring processing unit notifies the terminal device of the nurse call, it is stored in advance in the terminal device and indicates that the nurse call has been accepted.
  • a nurse call notification communication signal containing an instruction to display a nurse call reception screen on the terminal device is transmitted to the terminal device as a notification of the nurse call.
  • Such a monitored person monitoring device transmits a nurse call notification communication signal containing a command to display the nurse call reception screen on the terminal device without accommodating the image of the monitored person to the terminal device. Therefore, the terminal device displays the nurse call reception screen without the image of the monitored person. Therefore, the monitored person monitoring apparatus has a smaller time lag in dealing with the nurse call and can further reduce the burden on the observer.
  • a sound input / output unit that inputs / outputs a sound and a first sound (information representing the first sound) input from the sound input / output unit are accommodated.
  • the first sound accommodation communication signal is transmitted to the terminal device, and the second sound accommodation signal is received when the second sound accommodation communication signal containing the second sound (information representing the second sound) is received from the terminal device.
  • a call processing unit for outputting the second sound accommodated in the communication signal from the sound input / output unit;
  • the supervisor who handles the terminal device can receive a nurse call of the monitored person when the nurse call is notified. Can respond. For this reason, depending on the content of the nurse call grasped by the voice call, the nurse call can be dealt with only by the voice call, or the preparation for dealing with the nurse call can be executed in advance, and the monitored person can be permitted.
  • a predetermined action in a monitored person to be monitored is detected, a detection result is notified to a terminal device connected to be communicable, a nurse call is received, and the nurse is received.
  • a monitored person monitoring method for notifying the terminal device of a call, an image obtaining step for obtaining an image of the monitored person, and an image of the monitored person when notifying the terminal device of the detection result And a monitoring processing step of notifying the terminal device of the nurse call without an image of the monitored person when notifying the terminal device of the detection result and notifying the terminal device of the nurse call.
  • the nurse call when the nurse call is notified to the terminal device by the monitoring processing step, the nurse call is notified to the terminal device without the image of the monitored person.
  • the terminal device outputs the nurse call notification without the image of the monitored person. For this reason, it is possible to prevent the monitor handling the terminal device from habitually seeing the image of the monitored person in the case of a nurse call. Accordingly, it is possible to prevent an unnecessary burden on the monitor from causing a time lag in the response of the nurse call to the monitor or watching the video due to viewing the image of the monitored person. Therefore, the monitored person monitoring method has a smaller time lag in dealing with the nurse call, and can further reduce the burden on the observer.
  • a monitored person monitoring system is connected to a terminal device and the terminal device so as to be communicable, detects a predetermined action in the monitored person to be monitored, and notifies the terminal device of a detection result. And a monitored person monitoring system that receives a nurse call and notifies the terminal device of the nurse call, wherein the monitored person monitoring apparatus is one of the above-described monitored objects Person monitoring device.
  • the monitored person monitoring system includes any one of the above-described monitored person monitoring devices, so that the time lag is less when responding to the nurse call, and the burden on the observer can be further reduced.
  • a monitored person monitoring apparatus it is possible to provide a monitored person monitoring apparatus, a monitored person monitoring method, and a monitored person monitoring system for monitoring a monitored person to be monitored.

Landscapes

  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Emergency Management (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Nursing (AREA)
  • Accommodation For Nursing Or Treatment Tables (AREA)
  • Interconnected Communication Systems, Intercoms, And Interphones (AREA)
  • Alarm Systems (AREA)

Abstract

La présente invention concerne un dispositif de surveillance de personne surveillée, un procédé de surveillance de personne surveillée et un système de surveillance de personne surveillée, dans lesquels le comportement d'une personne surveillée est détecté, le résultat de détection est rapporté à un dispositif terminal, un appel à une infirmière est reçu et l'appel à une infirmière est rapporté au dispositif terminal. Lorsque le résultat de détection est rapporté au dispositif terminal, le résultat de détection est rapporté au dispositif terminal conjointement à une image de la personne surveillée et, lorsque l'appel à une infirmière est rapporté au dispositif terminal, l'appel à une infirmière est rapporté au dispositif terminal sans être accompagné d'une image de la personne surveillée.
PCT/JP2017/000450 2016-01-29 2017-01-10 Dispositif de surveillance de personne surveillée, procédé associé et système associé WO2017130684A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2017563778A JPWO2017130684A1 (ja) 2016-01-29 2017-01-10 被監視者監視装置、該方法および該システム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-015633 2016-01-29
JP2016015633 2016-01-29

Publications (1)

Publication Number Publication Date
WO2017130684A1 true WO2017130684A1 (fr) 2017-08-03

Family

ID=59398085

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/000450 WO2017130684A1 (fr) 2016-01-29 2017-01-10 Dispositif de surveillance de personne surveillée, procédé associé et système associé

Country Status (2)

Country Link
JP (1) JPWO2017130684A1 (fr)
WO (1) WO2017130684A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007228982A (ja) * 2006-02-27 2007-09-13 Keakomu:Kk ナースコール装置
JP2015126361A (ja) * 2013-12-26 2015-07-06 アイホン株式会社 ナースコールシステム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007228982A (ja) * 2006-02-27 2007-09-13 Keakomu:Kk ナースコール装置
JP2015126361A (ja) * 2013-12-26 2015-07-06 アイホン株式会社 ナースコールシステム

Also Published As

Publication number Publication date
JPWO2017130684A1 (ja) 2018-11-15

Similar Documents

Publication Publication Date Title
JP6680352B2 (ja) 被監視者監視装置、該方法および該システム
JP6146555B1 (ja) 被監視者監視システムの中央処理装置および中央処理方法ならびに被監視者監視システム
WO2017212995A1 (fr) Dispositif, procédé, et système destinés à surveiller une personne surveillée
JP6880811B2 (ja) 被監視者監視装置、該方法および該システム
JP6226110B1 (ja) 被監視者監視装置、該方法および該システム
JP6740633B2 (ja) 被監視者監視システムの中央処理装置および中央処理方法、ならびに、前記被監視者監視システム
JP6150025B1 (ja) 被監視者監視システムの表示装置および表示方法ならびに被監視者監視システム
JP6686523B2 (ja) 被監視者監視装置、該方法および該システム
WO2017179605A1 (fr) Système de surveillance et serveur de gestion
JP6673382B2 (ja) 端末装置、プログラムおよび方法
JP6213699B1 (ja) 被監視者監視システムの中央処理装置および中央処理方法ならびに被監視者監視システム
JP6172424B1 (ja) 端末装置および端末装置の制御方法ならびに被監視者監視システム
WO2017130684A1 (fr) Dispositif de surveillance de personne surveillée, procédé associé et système associé
JP6187732B1 (ja) 端末装置、端末装置の動作制御方法および被監視者監視システム
JP6135832B1 (ja) 被監視者監視システム、被監視者監視システムの作動方法および被監視者監視システムの中央処理装置
WO2017141629A1 (fr) Dispositif terminal, procédé d'affichage pour dispositif terminal, dispositif capteur et système de surveillance de personne à surveiller
WO2017145832A1 (fr) Dispositif, procédé et système de surveillance de personnes à surveiller
WO2017188156A1 (fr) Appareil terminal de système de surveillance de personne surveillée, procédé de commande d'appareil terminal et système de surveillance de personne surveillée
JP6245415B1 (ja) 端末装置および端末装置の動作制御方法ならびに被監視者監視システム
JP6150026B1 (ja) 被監視者監視システムの中央処理装置および該方法ならびに被監視者監視システム
JP2020188487A (ja) 中央処理装置、被監視者監視方法および被監視者監視システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17743915

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017563778

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17743915

Country of ref document: EP

Kind code of ref document: A1