WO2018230103A1 - Dispositif de surveillance de personne surveillée et procédé associé, et système d'aide à la surveillance de personne surveillée - Google Patents

Dispositif de surveillance de personne surveillée et procédé associé, et système d'aide à la surveillance de personne surveillée Download PDF

Info

Publication number
WO2018230103A1
WO2018230103A1 PCT/JP2018/014111 JP2018014111W WO2018230103A1 WO 2018230103 A1 WO2018230103 A1 WO 2018230103A1 JP 2018014111 W JP2018014111 W JP 2018014111W WO 2018230103 A1 WO2018230103 A1 WO 2018230103A1
Authority
WO
WIPO (PCT)
Prior art keywords
detection
notification
monitored person
event
behavior
Prior art date
Application number
PCT/JP2018/014111
Other languages
English (en)
Japanese (ja)
Inventor
雅史 西角
三嘉 宮井
Original Assignee
コニカミノルタ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コニカミノルタ株式会社 filed Critical コニカミノルタ株式会社
Priority to JP2019525115A priority Critical patent/JP7063333B2/ja
Publication of WO2018230103A1 publication Critical patent/WO2018230103A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G12/00—Accommodation for nursing, e.g. in hospitals, not covered by groups A61G1/00 - A61G11/00, e.g. trolleys for transport of medicaments or food; Prescription lists
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/04—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using a single signalling line, e.g. in a closed loop
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/10—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using wireless transmission systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to a monitored person monitoring device and a monitored person monitoring method for monitoring a monitored person to be monitored, and a monitored person monitoring support system using the same.
  • the nurse call system disclosed in Patent Document 1 is a nurse call slave set that is installed in a bed and a patient calls a nurse, and a nurse call set that is installed in a nurse station and responds to a call by the nurse call slave set.
  • a nurse call system having a nurse call parent device, a camera for imaging a patient on a bed from above the bed, and a state in which the patient wakes up from a captured image of the camera and a state in which the patient is separated from the bed State judging means for judging the occurrence of at least one of them and outputting a caution state occurrence signal, and the nurse call master unit has a notifying means for performing a notification operation upon receiving the caution state occurrence signal.
  • the nurse call system transmits a captured image of the camera to the portable terminal upon receiving the attention state generation signal and a portable terminal carried by a nurse to respond to a call from the nurse call slave. Communication control means.
  • the supervisor When the predetermined behavior is notified, the supervisor often performs countermeasures such as going to the site of the notified person being monitored, but if the notification is a false alarm, the supervisor , It ’s wasted and it ’s a loss of effort. Therefore, an apparatus that can reduce the misreporting and misreporting in such a trade-off relationship is desired.
  • the present invention is an invention made in view of the above-described circumstances, and its purpose is to be able to notify the behavior more appropriately, reduce the false alarm and the false alarm, the monitored person monitoring method and the monitored person monitoring method, and It is to provide a monitored person monitoring support system using the monitored person monitoring apparatus.
  • a monitored person monitoring apparatus, a monitored person monitoring method, and a monitored person monitoring support system reflecting one aspect of the present invention can generate a moving image, and the same type of behavior is the same as that described above.
  • Detection is performed with a plurality of detection conditions including at least first and second detection conditions different from each other set for the type of action, and the action is detected when the action is detected with the first detection condition.
  • 1 notification destination is notified, and when the behavior is detected under the second detection condition, the detection of the behavior and the video are notified to a second notification destination different from the first notification destination, and the second notification
  • the detection of the behavior is further notified to the first notification destination.
  • the monitored person monitoring support system in the present embodiment is a system that supports monitoring when monitoring a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched). .
  • the monitored person monitoring support system is provided corresponding to the monitored person Ob that is a monitoring target, detects a predetermined event related to the monitored person Ob, and generates a moving image, the sensor A central processing unit that is communicably connected to a device and manages an event detected by the sensor device and received from the sensor device; and the sensor that is communicably connected to the central processing unit and passes through the central processing unit
  • a terminal device first terminal device
  • the monitored person monitoring support system further includes a second terminal device that is communicably connected to the sensor device.
  • the sensor device includes a monitored person monitoring device.
  • the monitored person monitoring device is a device that detects a predetermined action in the monitored person Ob and notifies a device connected to be communicable, and the same type of action as the imaging unit that generates the moving image
  • a detection unit that detects a plurality of detection conditions including at least first and second detection conditions that are different from each other set for the same type of action, and the action is detected by the detection unit under the first detection condition
  • the action is detected and generated by the imaging unit.
  • a notification control unit that notifies a second notification destination second device that is different from the first notification destination first device.
  • the predetermined event includes the predetermined action
  • the first device that is the first notification destination is the central processing unit
  • the second device that is the second notification destination is the second device. It is a terminal device.
  • the notification control unit detects the behavior when the second notification destination second device receives an instruction to notify the first notification of the behavior detection to the first notification destination first device. Further notification is made to the first device to be notified.
  • the first terminal device may be one type of device, in the present embodiment, the first terminal device is two types of devices: a fixed terminal device and a mobile terminal device.
  • the main difference between the fixed terminal device and the mobile terminal device is that the fixed terminal device is fixedly operated, while the mobile terminal device is carried by a monitor (service provider, user) such as a nurse or a caregiver.
  • the fixed terminal device and the portable terminal device are substantially the same.
  • Such a monitored person monitoring support system will be described in more detail below, taking the management server apparatus SV as an example of the central processing apparatus and the authenticity determination terminal apparatus as an example of the second terminal apparatus.
  • FIG. 1 is a diagram showing a configuration of a monitored person monitoring support system in the embodiment.
  • FIG. 2 is a diagram showing a configuration of a sensor device in the monitored person monitoring support system.
  • FIG. 3 is a diagram showing the configuration of the management server device in the monitored person monitoring support system.
  • FIG. 4 is a diagram showing a configuration of a monitoring information table stored in the management server device.
  • FIG. 5 is a diagram showing a configuration of an inter-device information table stored in the management server device.
  • FIG. 5A shows a notification destination correspondence information table
  • FIG. 5B shows a communication address correspondence information table.
  • FIG. 6 is a diagram showing a configuration of a sensor information table stored in the management server device.
  • the monitored person monitoring support system MS in the embodiment is a system that supports monitoring of the monitored person.
  • the sensor device SU, management server device SV, fixed terminal device SP, portable terminal device TA, and private branch exchange CX are wired or wirelessly and are a network (network, communication line) NW such as a LAN (Local Area Network).
  • NW local area Network
  • the authenticity determination terminal device JT can communicate with the private branch exchange CX via the public network PN.
  • the network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals.
  • the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1, TA-2, and the private branch exchange CX include an L2 switch.
  • a wired / wireless LAN for example, a LAN in accordance with the IEEE 802.11 standard
  • NW including the LS and the access point AP.
  • the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1, TA-2. Is connected to the line concentrator LS via the access point AP.
  • the network NW constitutes a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).
  • the private branch exchange (line switching machine) CX is connected to the network NW, and performs extension calls between the portable terminal devices TA by controlling extension calls such as outgoing calls, incoming calls and calls between the portable terminal devices TA.
  • an unillustrated external telephone such as a fixed telephone or a mobile telephone through a public network PN such as a fixed telephone network, a mobile telephone network or a digital communication network, and outgoing and incoming calls between the external telephone and the mobile terminal device TA
  • the external telephone such as a telephone call is controlled to perform the external telephone between the external telephone and the portable terminal TA, and the authenticity determination terminal device JT is connected to the network NW via the public network PN.
  • the private branch exchange CX is, for example, a digital exchange or an IP-PBX (Internet Protocol Private Branch eXchange).
  • the devices SU, SV, SP, TA, and CX other than the authenticity determination terminal device JT in the monitored person monitoring support system MS are arranged at appropriate locations according to the monitored person Ob.
  • Observed persons (persons to be watched over, service beneficiaries) Ob are, for example, those who need nursing due to illness or injury, those who need nursing care due to decline in physical ability, etc. is there.
  • the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable.
  • the devices SU, SV, SP, TA, and CX except for the authenticity determination terminal device JT in the monitored person monitoring support system MS are hospitals, elderly welfare facilities, dwelling units, etc. according to the type of the monitored person Ob. It is suitably arranged in a building.
  • each of the devices SU, SV, SP, TA, and CX except for the authenticity determination terminal device JT in the monitored person monitoring support system MS includes a plurality of living rooms RM in which a plurality of monitored persons Ob It is arranged in a building of a nursing facility having a plurality of rooms such as a nurse station.
  • Each of these devices SU, SV, SP, TA, CX is handled by the first operator, in this example, the operator of the care facility.
  • the care facility is an example of a first installation location related to a first operator.
  • the authenticity determination terminal device JT is installed in another appropriate building different from the care facility, such as an office building, and is different from the first operator, and specializes in authenticity determination as described later.
  • the office building is an example of a second installation location related to the second operator.
  • the sensor device SU has a communication function that communicates with other devices SV, SP, TA via the network NW, and communicates with the authenticity determination terminal device JT via the network NW, the private branch exchange CX, and the public network PN.
  • a predetermined event (event) related to the monitored person Ob is detected, and directly to the management server device SV or indirectly through the authenticity determination terminal device JT according to the detection condition used in the detection. This is a device that notifies the management server device SV.
  • the predetermined event is preferably a predetermined event that needs to be dealt with, for example, a predetermined action and a nurse call (NC) set in advance in the monitored person Ob. For example, as shown in FIG.
  • the sensor device SU includes a sensor unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process.
  • Unit (SU control processing unit) 14 sensor side communication interface unit (SU communication IF unit) 15, and sensor side storage unit (SU storage unit) 16.
  • the sensor unit 11 is a device that is connected to the SU control processing unit 14 and detects predetermined various amounts set in advance in the monitored person Ob in accordance with the control of the SU control processing unit 14.
  • the predetermined amounts are appropriately determined according to the predetermined action to be detected by the monitored person Ob.
  • the predetermined behavior includes, for example, getting up when the monitored person Ob occurred, leaving the monitored person Ob from the bedding, falling over when the monitored person Ob collapsed, and the body of the monitored person Ob
  • the sensor unit 11 includes an imaging unit 111 and a body motion measurement unit 112 in order to detect these four actions of stopping the body motion.
  • the fall may include a fall in which the monitored person Ob falls from the bedding, or the predetermined action may include the fall separately from the fall.
  • the imaging unit 111 is an apparatus that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14.
  • the image includes a still image (still image data) and a moving image (moving image data).
  • the imaging unit 111 is arranged so as to be able to monitor a space where the monitored person Ob is scheduled (location space, in the example shown in FIG. 1, the room RM of the installation location), and above the location space as an imaging target
  • location space in the example shown in FIG. 1, the room RM of the installation location
  • the image (image data) overlooking the imaging target is generated, and the imaging target image (target image) is output to the SU control processing unit 14.
  • the imaging unit 111 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed).
  • the sensor device SU uses the imaging unit 111 to obtain an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.
  • Such an imaging unit 111 may be a device that generates an image of visible light, but in this embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place.
  • such an imaging unit 111 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface.
  • An image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and image data that represents an infrared image in the imaging target by performing image processing on the output of the image sensor It is a digital infrared camera provided with the image processing part etc. which produce
  • the imaging optical system of the imaging unit 111 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 111 is disposed. .
  • the body movement measuring unit 112 is connected to the SU control processing unit 14 and is a device that measures a predetermined body movement in the monitored person Ob according to the control of the SU control processing unit 14.
  • the predetermined body movement is a movement of the body surface of the chest associated with breathing.
  • the body movement measurement unit 112 includes, for example, a Doppler sensor.
  • This Doppler sensor is a body motion sensor that transmits a transmission wave, receives a reflection wave of the transmission wave reflected by an object, and outputs a Doppler signal having a Doppler frequency component based on the transmission wave and the reflection wave. .
  • the Doppler sensor When the object is moving, the frequency of the reflected wave is shifted in proportion to the moving speed of the object due to the so-called Doppler effect. Arise.
  • the Doppler sensor generates a signal of the Doppler frequency component as a Doppler signal and outputs it to the SU control processing unit 14.
  • the transmission wave may be an ultrasonic wave, a microwave, or the like, but is a microwave in the present embodiment. Since the microwave can be transmitted through the clothing and reflected from the body surface of the monitored person Ob, the movement of the body surface can be detected even when the monitored person Ob is wearing clothes.
  • the SU sound input / output unit 12 is a circuit connected to the SU control processing unit 14 for acquiring external sound and inputting it to the sensor device SU. It is a circuit for generating and outputting a sound according to.
  • the SU sound input / output unit 12 includes, for example, a microphone that converts sound acoustic vibrations into electrical signals, and a speaker that converts sound electrical signals into sound acoustic vibrations.
  • the SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and converts the electric signal input from the SU control processing unit 14 into an acoustic vibration of the sound and outputs the sound.
  • the nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SU.
  • the nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.
  • the SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication according to the control of the SU control processing unit 14.
  • the SU communication IF unit 15 generates a communication signal containing the data to be transferred input from the SU control processing unit 14 according to the communication protocol used in the network NW of the monitored person monitoring support system MS.
  • a communication signal is transmitted to other devices SV, SP, TA, and JT via the network NW.
  • the SU communication IF unit 15 receives communication signals from other devices SV, SP, TA, and JT via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 extracts the extracted data.
  • the data is converted into a processable format and output to the SU control processing unit 14.
  • the SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
  • the SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14.
  • the various predetermined programs include, for example, a SU control program that controls each unit of the sensor device SU according to the function of each unit, and a predetermined action in the monitored person Ob based on the output of the sensor unit 11 Then, depending on the detection conditions used for the detection, the management server device SV is notified directly or indirectly to the management server device SV via the authenticity determination terminal device JT, and the detection is performed.
  • a moving image (event moving image) of a predetermined time length related to a predetermined action is transferred to the management server device SV only, or to the management server device SV and the authenticity determination terminal device JT, depending on the detection condition used in the detection.
  • the management server device SV is notified of this, and the SU sound
  • the nurse call processing program for making a voice call with the terminal devices SP and TA by using the output unit 12 and the like, and the moving image generated by the imaging unit 111, the terminal device SP, TA and authenticity determination that requested the moving image A control processing program such as a SU streaming processing program distributed by streaming to the terminal device JT is included.
  • the various predetermined data include a sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the own device, a communication address of the management server device SV, and a true / false determination terminal device JT.
  • the data necessary for executing each program such as the communication address of the program is included.
  • the SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like.
  • the SU storage unit 16 includes a RAM (Random Access Memory) serving as a working memory of the so-called SU control processing unit 14 that stores data generated during execution of the predetermined program.
  • storage part 16 is the following.
  • a sensor-side moving image storage unit (SU moving image storage unit) 161 is functionally provided.
  • the SU moving image storage unit 161 is a ring buffer that stores a moving image having a predetermined time length.
  • the predetermined time length is, for example, several minutes such as 1 minute, 1 and a half, 2 minutes, and 3 minutes.
  • the processing time required to transfer the moving image stored in the SU moving image storage unit 161 to the management server device SV is taken into account, and the SU moving image storage unit 161 adds a margin of, for example, several seconds to the predetermined time length.
  • the SU control processing unit 14 controls each part of the sensor device SU according to the function of each part, detects a predetermined event (event) related to the monitored person Ob, and sets the detection condition used in the detection.
  • a notification is sent directly to the management server device SV or indirectly to the management server device SV via the authenticity determination terminal device JT, and a moving image of a predetermined time length related to the detected predetermined action ( Event video) is transmitted to only the management server device SV or to each of the management server device SV and the authenticity determination terminal device JT according to the detection conditions used at the time of detection, and the terminal devices SP and TA Is a circuit for performing a voice call between the terminals, generating an image including a moving image, and distributing the moving image to the terminal devices SP, TA and the authenticity determination terminal device JT.
  • the SU control processing unit 14 stores the moving image generated by the imaging unit 111 of the sensor unit 11 in the SU moving image storage unit 161.
  • the SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.
  • the SU control processing unit 14 executes the control processing program so that the sensor side control unit (SU control unit) 141, the behavior detection processing unit 142, the nurse call processing unit (nurse call processing unit) 143, and the sensor side streaming are performed.
  • a processing unit (SU streaming processing unit) 144 is functionally provided.
  • the SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.
  • the SU control unit 141 stores the moving image generated by the imaging unit 111 of the sensor unit 11 in the SU moving image storage unit 161 of the SU storage unit 16. More specifically, the SU control unit 141 sequentially stores the moving images generated by the imaging unit 111 from the beginning to the end of the storage area allocated as the SU moving image storage unit 161 of the SU storage unit 16, When the end of the storage area is reached, the process returns to the beginning of the storage area, and similarly, the moving images generated by the imaging unit 111 are sequentially stored from the start to the end of the storage area (stored by overwriting). Thereafter, the same is repeated. Thereby, the SU moving image storage unit 161 stores moving images for the past from the present time for the predetermined time length.
  • the behavior detection processing unit 142 detects a predetermined behavior set in advance in the monitored person Ob based on the output of the sensor unit 11, and notifies the management server device SV.
  • the behavior detection processing unit 142 detects the same type of behavior in the predetermined behavior based on a plurality of detection conditions including at least first and second detection conditions different from each other set for the same type of behavior.
  • the behavior detection processing unit 142 notifies the management server device SV that is the first device of the first notification destination of the detection of the behavior, and the detection
  • the sensor unit 11 and the behavior detection processing unit 142 are configured to detect the same type of behavior with a plurality of detection conditions including at least first and second detection conditions different from each other set for the same type of behavior. This corresponds to an example of a detection unit for detection.
  • the behavior detection processing unit 142 notifies the first device of the first notification destination of the detection of the behavior when the behavior is detected by the detection unit under the first detection condition, and the second detection unit performs the second detection. Notification for notifying the second device of the second notification destination different from the first device of the first notification destination when the behavior is detected under the detection condition, the motion detection and the moving image generated by the imaging unit It corresponds to an example of a control unit.
  • the predetermined actions are awakening, getting out of bed, falling, and stopping body movement. These getting up, getting out of bed and falling are detected based on the output (target image) of the imaging unit 111, and the stop of the body movement is detected based on the output (Doppler signal) of the body movement measuring unit 112.
  • the behavior detection processing unit 142 for example, based on the amount of protrusion of the bedding area in the target image captured by the imaging unit 11 from the pre-stored bedding location area, the monitored person Ob Are detected at two levels: a probable wakeup and a possible wakeup.
  • the wake-up with high probability means a case where detection is performed under relatively strict first detection conditions, and an event that has occurred in the monitored person Ob is highly likely to be wake-up.
  • the possible wake-up refers to a case where detection is performed under a relatively loose second detection condition, and an event occurring in the monitored person Ob may be wake-up, and wake-up is suspected.
  • first, thresholds for determining a possible wake-up from the region where the bedding BT is located and the amount of protrusion are 1 of the various predetermined data.
  • a suspicion wake-up threshold for determining a possible wake-up from the region where the bedding BT is located and the amount of protrusion
  • second A An example of the detection condition an example of the detection condition
  • a threshold value an example of the wake-up determination threshold value and an example of the first detection condition (first A detection condition) for determining a wake-up with a high probability from the amount of protrusion
  • the SU storage unit 16 is stored in advance.
  • the wake-up suspicion determination threshold and the wake-up determination threshold are appropriately set in advance using a plurality of samples.
  • the wake-up suspect determination threshold is used to determine the possibility of wake-up
  • the wake-up suspect determination threshold is more than the wake-up determination threshold. Set to a small value. This makes it possible to detect a case where wake-up is suspected while wake-up is detected with a relatively high probability. Note that wake-up may be detected at each of multiple levels by further increasing the threshold.
  • the action detection process part 142 calculates
  • the behavior detection processing unit 142 compares the obtained protrusion amount with the wake-up suspicion determination threshold and the wake-up determination threshold. As a result of the comparison, when the calculated amount of protrusion is less than the wake-up suspicion determination threshold, the behavior detection processing unit 142 determines that there is neither a possible wake-up nor a highly probable wake-up, and the calculated squeeze-out. When the amount is greater than or equal to the wake-up suspicion determination threshold and less than the wake-up determination threshold, the behavior detection processing unit 142 determines that the wake-up is possible, detects the wake-up, and obtains the request.
  • the behavior detection processing unit 142 determines that the wake-up is highly likely and detects the wake-up with a high probability.
  • the wake-up suspicion determination threshold value may be 0. In this case, if even a slight protrusion amount is obtained from the target image, it is determined that the wake-up is possible, and the wake-up is detected.
  • the behavior detection processing unit 142 has a high probability of leaving the monitored person Ob based on the amount of overlap between the bedding location area stored in advance and the human body area in the target image captured by the imaging unit 11. Detect at two levels: getting out and possible getting out.
  • the high probability of getting out means a case where detection is performed under a relatively strict first detection condition, and the probability that an event that has occurred in the monitored person Ob is truly getting out of bed is high.
  • the possibility of getting out of the floor means a case where detection is performed under a relatively loose second detection condition, and an event that has occurred in the monitored person Ob is likely to be out of bed, and leaving is suspected.
  • a threshold value for determining a possible bed leaving area from the overlapping area of the bedding BT (a bed leaving doubt determination threshold, a second detection condition) (An example of the second B detection condition)) and thresholds for determining a high probability of getting out of bed from the overlap amount (an example of the bed detection threshold, an example of the first detection condition (the first B detection condition))
  • the SU storage unit 16 is stored in advance as one of the data.
  • the suspected bed leaving determination threshold value and the leaving bed judgment threshold value are appropriately set in advance using a plurality of samples.
  • the bed leaving determination threshold is used to determine the probability of getting out of bed
  • the bed leaving doubt determining threshold is used to determine the possibility of getting out of bed, so the bed leaving determination threshold is higher than the bed leaving doubt determining threshold.
  • the bed leaving determination threshold is higher than the bed leaving doubt determining threshold.
  • the behavior detection processing unit 142 obtains an overlap amount between the human body region (moving body region) in the obtained target image and the bedding location region stored in advance.
  • the behavior detection processing unit 142 compares the obtained overlap amount with each of the bed leaving doubt determination threshold and the bed leaving determination threshold. As a result of the comparison, when the obtained overlap amount is larger than the suspected bed leaving determination threshold, the behavior detection processing unit 142 determines that there is no possibility of getting out of bed or a high probability of leaving, and the obtained overlap amount. Is lower than the suspected bed leaving determination threshold value and greater than the leaving bed determination threshold value, the behavior detection processing unit 142 determines that there is a possible bed leaving, detects the possible bed leaving, and the obtained overlap.
  • the behavior detection processing unit 142 determines that the bed has a high probability, and detects the bed with a high probability.
  • the bed leaving determination threshold may be 0. In this case, when there is no overlap amount in the target image, it is determined that the bed is highly likely to be left, and the bed leaving with high probability is detected.
  • the behavior detection processing unit 142 is a region other than the pre-stored bedding location region, and the monitored person is based on the speed at which the size of the head of the monitored person Ob changes (the changing speed of the head).
  • Ob falls are detected at two levels: a probable fall and a potential fall.
  • the fall with high probability means a case where detection is performed under relatively strict first detection conditions, and an event that has occurred in the monitored person Ob is highly likely to fall.
  • the above-mentioned possible fall means a case in which an event that has been detected under the relatively loose second detection condition and an event that has occurred in the monitored person Ob is likely to fall, and a fall is suspected.
  • a threshold for determining a possible fall from the location area of the bedding BT and the change speed of the head (fall suspect determination threshold, second detection condition) (An example of the second C detection condition)) and threshold values (an example of the fall determination threshold, an example of the first detection condition (the first C detection condition)) for determining a fall with high probability from the change speed of the head
  • the SU storage unit 16 is stored in advance as one of the predetermined data.
  • the fall suspect determination threshold and the fall determination threshold are appropriately set in advance using a plurality of samples.
  • the fall determination threshold is used to determine the probability of a fall, while the fall suspect determination threshold is used to determine the possibility of a fall.
  • the fall determination threshold is greater than the suspected fall determination threshold.
  • the action detection process part 142 extracts a moving body area
  • the behavior detection processing unit 142 uses, for example, a circular or elliptical Hough transform from the extracted moving object region, for example, by pattern matching using a head model prepared in advance, or for example, for head detection.
  • the head region of the monitored person Ob is extracted by the neural network learned in step (b).
  • the behavior detection processing unit 142 obtains the change speed of the head from the extracted head region and the head region extracted in the previous detection processing. From the change in the size of each head region extracted in each detection process from the size of the head in the standing posture to the size of the head in the lying recumbent posture, The rate of change may be determined.
  • the behavior detection processing unit 142 compares the calculated change rate of the head with the fall suspect determination threshold and the fall determination threshold. As a result of the comparison, when the obtained head change speed is smaller than the fall suspect determination threshold, the behavior detection processing unit 142 determines that there is no possibility of fall or a high probability fall, and the request.
  • the behavior detection processing unit 142 determines that there is a possible fall and determines the possible fall. If the detected change speed of the head is equal to or higher than the fall determination threshold, the behavior detection processing unit 142 determines that the fall is highly likely, and detects the fall that is highly likely.
  • the behavior detection processing unit 142 detects the body motion stop of the monitored person Ob based on the output of the body motion measurement unit 112 at two levels, ie, a highly probable body motion stop and a possible body motion stop.
  • the highly probable body motion stop means a case where detection is performed under relatively strict first detection conditions, and an event that has occurred in the monitored person Ob has a high probability that the body motion is truly stopped.
  • the possible movement stoppage is detected when the second detection condition is relatively loose, and an event that has occurred in the monitored person Ob may be a movement stoppage, and the movement stoppage is suspected. .
  • Threshold for determining body motion Threshold determination threshold
  • threshold for determining possible body motion stoppage based on the duration of the body surface without motion threshold for body motion stoppage
  • the SU storage unit 16 stores in advance a threshold value (body motion stoppage determination threshold value) for determining body motion stoppage with a high probability of body movement from the duration time without any movement as one of the various predetermined data.
  • the body movement suspicion determination threshold and the body movement stop determination threshold are appropriately set in advance using a plurality of samples.
  • the body motion stop determination threshold is used to determine the probability of body motion stop, while the body motion stop suspect determination threshold is used to determine the possibility of body motion stop.
  • the determination threshold is set to a value larger than the body movement suspicion determination threshold.
  • body motion stoppage is detected with a relatively high probability, while a case where body motion stoppage is suspected can also be detected.
  • body motion stop may be detected at each of multiple levels by further increasing the threshold.
  • the action detection process part 142 compares the output of the body movement measurement part 112 with the said body surface movement determination threshold value.
  • the behavior detection processing unit 142 determines that there is a motion of the body surface, and the output of the body motion measurement unit 112 Is equal to or less than the body surface movement determination threshold, the behavior detection processing unit 142 determines that there is no movement of the body surface, and refers to the determination result determined in the previous detection process, thereby determining the body surface. Determine the duration of time when it is determined that there is no movement. Next, the behavior detection processing unit 142 compares the obtained duration with each of the body motion stop suspicion determination threshold and the body motion stop determination threshold.
  • the behavior detection processing unit 142 when the obtained duration time is smaller (shorter) than the body motion suspicion determination threshold, the behavior detection processing unit 142 is neither a possible body motion stop nor a highly likely body motion stop. And the behavior detection processing unit 142 determines that there is a possibility of stopping body motion when the obtained duration time is equal to or greater than the body motion stoppage determination threshold value and less than the body motion stoppage determination threshold value. Then, when the potential body motion stop is detected, and the obtained duration is equal to or greater than the body motion stop determination threshold, the behavior detection processing unit 142 determines that the body motion stop has a high probability, The body motion stop with high probability is detected.
  • the behavior detection processing unit 142 performs a predetermined event related to the monitored person Ob.
  • the SU communication IF unit 15 notifies the management server device SV of a communication signal (first event notification communication signal) for notifying the event, in which event information (event information) representing the content of the event is stored. More specifically, the behavior detection processing unit 142 receives a first event notification communication signal containing a sensor ID of the own device, event information indicating the content of the event, and a target image used when detecting the predetermined behavior. And transmitted to the management server apparatus SV via the SU communication IF unit 15.
  • the event information is one or more of body movement stop, wake-up, getting-off, falling, and nurse call (NC).
  • the action detection processing unit 142 detects the body with high probability.
  • One or more of motion stop, wake-up, getting-off and falling are accommodated in the first event notification communication signal as the event information.
  • the action detection process part 142 will be the predetermined time length before and behind the detection of the sensor ID of the own machine, the event information showing the content of the said event,
  • a communication signal containing the event moving image (event moving image notification communication signal) is transmitted to the management server device SV via the SU communication IF unit 15.
  • the behavior detection processing unit 142 determines whether the detected event is true or false.
  • the SU communication IF unit 15 notifies the authenticity determination terminal device JT of a communication signal for requesting (authentication determination request notification communication signal). More specifically, the behavior detection processing unit 142 includes information (authentication determination request information) indicating a request for authenticity determination for the detected event, the sensor ID of the own device, and event information (possibility of the event).
  • the authenticity determination request notification communication signal containing the communication address of the own device as the acquisition destination of the live video is sent to the SU communication IF unit 15 Is transmitted to the authenticity determination terminal device JT.
  • the behavior detection processing unit 142 has a sensor ID of the own device, event information indicating the content of the event, and a predetermined time length before and after the detection of the event.
  • the event video notification communication signal containing the event video is transmitted to the management server device SV and the authenticity determination terminal device JT via the SU communication IF unit 15.
  • the nurse call processing unit 143 notifies the management server device SV of a first event notification communication signal accommodated as another example of the predetermined event when the nurse call reception operation unit 13 receives a nurse call.
  • a voice call is performed with the terminal devices SP and TA by using the SU sound input / output unit 12 or the like. More specifically, when the nurse call reception operation unit 13 is input, the nurse call processing unit 143 transmits the first event notification communication signal containing the nurse call as the sensor ID of the own device and the event information as SU communication.
  • the data is transmitted to the management server device SV via the IF unit 15.
  • the nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to perform a voice call with the terminal devices SP and TA, for example, using VoIP (Voice over Internet Protocol).
  • VoIP Voice over Internet Protocol
  • the SU streaming processing unit 144 when there is a video distribution request from the fixed terminal device SP, the mobile terminal device TA, or the authenticity determination terminal device JT via the communication IF unit 3, is the fixed terminal device that has made this request.
  • a moving image (for example, a live moving image) generated by the imaging unit 11 is distributed to the SP, the mobile terminal device TA, or the authenticity determination terminal device JT via the SU communication IF unit 15 by streaming reproduction.
  • FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob.
  • the second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob.
  • the third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.
  • the management server device SV has a communication function for communicating with other devices SU, TA, SP via the network NW.
  • the management server device SV has information on monitoring of the monitored person Ob ( Monitoring information (in this embodiment, for example, the predetermined event (the type of the predetermined action detected by the sensor device SU or the nurse call received by the sensor device SU), the still image of the monitored person Ob, and the notification received) Time)), the predetermined event is notified (re-notification, re-notification, transmission) to the predetermined terminal device SP and TA, and when the event video is received, the event video is managed, and the client (this embodiment) Then, a device that provides the client with data according to the request of the terminal device SP, TA, etc., and manages the entire monitored person monitoring support system MS (medium It is an example) of the processing apparatus.
  • the management server device SV includes a server-side communication interface unit (SV communication IF unit)
  • the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication according to the control of the SV control processing unit 22.
  • the SV communication IF unit 21 is, for example, a data communication card, a communication interface circuit according to the IEEE 802.11 standard, or the like.
  • the SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22.
  • the various predetermined programs include an SV control program for controlling each part of the management server device SV according to the function of each part, and an SV monitoring process for executing predetermined information processing related to monitoring of the monitored person Ob.
  • a control processing program such as a program is included.
  • the various predetermined data includes each program such as a server identifier (server ID) of the own device, the monitoring information of the monitored person Ob, information between devices, sensor information regarding the sensor device SU, and an event video. Data necessary for execution is included.
  • the server ID is an identifier for identifying the management server device SV and identifying the management server device SV.
  • the inter-device information represents information between the devices SU, SP, and TA such as a notification destination of the predetermined event.
  • the SV storage unit 23 includes, for example, a ROM that is a nonvolatile storage element, an EEPROM that is a rewritable nonvolatile storage element, and the like.
  • the SV storage unit 23 includes a RAM serving as a working memory for the so-called SV control processing unit 22 that stores data generated during execution of the predetermined program.
  • SV storage part 23 is a server side monitoring information storage part (SV monitoring information storage part) 231, Inter-device information storage part 232, A server-side sensor information storage unit (SV sensor information storage unit) 233 and a server-side moving image storage unit (SV moving image storage unit) 234 are functionally provided.
  • the SV monitoring information storage unit 231 stores monitoring information of the monitored person Ob transmitted / received to / from each device SU, SP, TA. More specifically, in the SV monitoring information storage unit 231, in this embodiment, as the monitoring information, the sensor ID and the event information are based on each information accommodated in a communication signal such as a first event notification communication signal. (Event information, in this embodiment, getting up, getting out of bed, falling and stopping body motion and nurse call), reception time, target image, and presence / absence of countermeasure are stored in association with each other.
  • Event information in this embodiment, getting up, getting out of bed, falling and stopping body motion and nurse call
  • reception time, target image, and presence / absence of countermeasure are stored in association with each other.
  • this monitoring information is stored in the SV monitoring information storage unit 231 in a table format.
  • the server-side monitoring information table (SV monitoring information table) MT for registering the monitoring information registers the sensor ID accommodated in the communication signal received from each device SU, SP, TA, for example, as shown in FIG.
  • a corresponding field 2316 for registering the presence or absence of the corresponding reception for information comprises a record for each communication signal thus received (for each event).
  • still image data may be registered, and for example, a file name of still image data may be registered.
  • a flag (correspondence flag) indicating whether or not the terminal device SP or TA has accepted that there is an intention to cope (corresponding, treating, or taking measures) on the event information accommodated in the received communication signal.
  • the terminal field SP or TA accepts that the correspondence field 2316 has an intention to deal with event information (event information registered in the event field 2312) contained in the received communication signal.
  • Correspondence flag “1” indicating that the terminal device SP or TA does not accept that there is an intention to deal with the event information accommodated in the received communication signal. Is registered.
  • the correspondence field 2316 registers a correspondence flag “0” meaning “not accepted”.
  • the first event notification communication signal contains the detection time when the predetermined action is detected or the nurse call reception time when the nurse call is received, the detection time or the nurse is used instead of the reception time.
  • the call reception time may be registered.
  • the inter-device information storage unit 232 stores a notification destination correspondence relationship, a communication address correspondence relationship, and the like as the inter-device information.
  • the notification destination correspondence relationship includes a sensor ID and a notification destination (re-transmission destination) indicating a notification destination (re-notification destination, re-notification destination, transmission destination) such as a first event notification communication signal transmitted from the sensor device SU. This is the correspondence relationship with the terminal ID that is the notification destination.
  • the communication address correspondence relationship is a correspondence relationship between IDs (sensor IDs and terminal IDs) of the devices SU, SP, and TA and their communication addresses.
  • the terminal ID (terminal identifier) is an identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.
  • the notification destination correspondence information table AT for registering the notification destination correspondence relationship includes, for example, a transmission source field for registering the sensor ID of the sensor device SU that is the transmission source of the first event notification communication signal and the like, as shown in FIG. 5A. 2321, a transmission destination terminal device SP that transmits an event or the like notified from the sensor device SU corresponding to the sensor ID registered in the transmission source field 2321, and a notification destination field 2322 that registers the terminal ID of the TA.
  • a record is provided for each sensor ID (sensor device SU).
  • the communication address correspondence relationship table DT for registering the communication address correspondence relationship is registered in the terminal ID field 2323 for registering the terminal IDs of the terminal devices SP and TA and the terminal ID field 2323, for example, as shown in FIG. 5B. And a communication address field 2324 for registering the communication address of the terminal device SP and TA corresponding to the terminal ID, and a record for each terminal ID (terminal device SP and TA).
  • each of the sensor ID, server ID, and terminal ID may be, for example, a serial number composed of a predetermined symbol string, or may be a communication address, for example (in this case, communication address correspondence can be omitted).
  • a plurality of sensor devices SU may be associated with one terminal device SP, TA (including broadcast communication such as multicast or broadcast).
  • the SV sensor information storage unit 233 stores the sensor information.
  • the sensor information is information related to the sensor device SU, and is information in which the sensor ID of the sensor device SU and the monitored person name of the monitored person Ob are associated with each other.
  • the server-side sensor information table (SV sensor information table) ST for registering sensor information includes, for example, a sensor ID field 2331 for registering a sensor ID and the sensor ID field 2331 as shown in FIG.
  • the SV moving image storage unit 234 stores (records) the event moving image.
  • the SV moving image storage unit 234 stores the sensor ID, the event information, and the event moving image stored in the event moving image notification communication signal in association with each other. More specifically, the SV moving image storage unit 234 stores the event moving image (event moving image file) accommodated in the bent moving image notification communication signal with a file name, and accommodates the file name in the event moving image notification communication signal.
  • the associated sensor ID and event information are stored in association with each other.
  • the SV control processing unit 22 controls each unit of the management server device SV according to the function of each unit, and upon receiving the notification of the predetermined event from the sensor device SU, Monitoring information related to monitoring is managed, the predetermined event is notified (re-notification, re-notification, transmission) to the predetermined terminal device SP and TA, and when the event video is received, the event video is managed, and the client (this embodiment) Then, it is a circuit for providing data corresponding to the request of the terminal device SP, TA, etc.) to the client and controlling the entire management server device SV.
  • the SV control processing unit 22 includes, for example, a CPU and its peripheral circuits.
  • the SV control processing unit 22 functionally includes a server side control unit (SV control unit) 221 and a server side monitoring processing unit (SV monitoring processing unit) by executing the control processing program.
  • the SV control unit 221 controls each unit of the management server device SV according to the function of each unit, and controls the entire management server device SV.
  • the SV monitoring processing unit 222 executes predetermined information processing related to monitoring of the monitored person Ob. More specifically, when the notification of the predetermined event is received from the sensor device SU, the SV monitoring processing unit 222 manages monitoring information related to monitoring of the monitored person Ob, and the predetermined event is transmitted to the predetermined terminal device SP, Notify TA. More specifically, when the SV monitoring processing unit 222 receives the first event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 displays the monitoring information regarding the monitoring of the monitored person Ob contained in the received first event notification communication signal. The information is stored (recorded) in the monitoring information storage unit 231.
  • the SV monitoring processing unit 222 transmits the third event notification communication signal to the notification destination (re-notification destination, notification destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the first event notification communication signal.
  • the notification destination re-notification destination, notification destination, transfer destination, transmission destination
  • the SV monitoring processing unit 222 transmits the third event notification communication signal to the notification destination (re-notification destination, notification destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the first event notification communication signal.
  • the predetermined action one or more of body movement stop, falling, getting out of bed, and getting up
  • the communication address corresponding to the sensor device SU having the sensor ID accommodated in the first event notification communication signal as the download destination of the sensor ID, the event information and the target image, and the moving image accommodated in the first event notification communication signal. Is housed.
  • the third event notification communication signal includes the sensor ID and event information (nurse) accommodated in the first event notification communication signal. Call) is accommodated. Even when the second event notification communication signal is received from the sensor device SU, the SV monitoring processing unit 222 stores the monitoring information in the same manner as when the first event notification communication signal is received from the sensor device SU. The third event notification communication signal is transmitted.
  • the SV monitoring processing unit 222 processes the received second event notification communication signal in the same manner as the processing for the first event notification communication signal described above. .
  • the management server device SV is connected to the SV control processing unit 22 as necessary, as shown by a broken line in FIG. 3, for example, a server side input unit (SV input unit) for inputting various commands, various data, and the like.
  • Server side output unit (SV output unit) 25 that outputs various commands and various data input by the SV input unit 24 and monitoring information related to monitoring of the monitored person Ob, and data between external devices
  • a server-side interface unit (SVIF unit) 26 or the like for performing input / output may be provided.
  • Such a management server device SV can be configured by a computer with a communication function, for example.
  • the fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. By inputting a predetermined instruction or data to be given to the management server device SV or the portable terminal device TA, displaying monitoring information obtained by the sensor device SU by a notification from the management server device SV, etc.
  • This is a device that functions as a user interface (UI) of the monitoring support system MS.
  • UI user interface
  • Such a fixed terminal device SP can be configured by, for example, a computer with a communication function.
  • the mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. Including a call function to perform, inputting a predetermined instruction or data to be given to the management server device SV or the sensor device SU, displaying the monitoring information obtained by the sensor device SU by a notification from the management server device SV, This is a device for answering or calling a nurse call by voice call with the sensor device SU, receiving live video from the sensor device SU by streaming, and displaying it.
  • a portable terminal device TA can be configured by, for example, a tablet computer with a communication function or a so-called smartphone.
  • the authenticity determination terminal device JT includes a communication function for communicating with the sensor device SU via the public network PN and the network NW, a display function for displaying predetermined information, and an input function for inputting predetermined instructions and data. Receiving and displaying live video distribution by streaming from the sensor device SU, displaying the event video received from the sensor device SU, accepting the true / false determination result of the event determined by the authenticity determination person (operator), This is a device for transmitting the determination result of the accepted event to the sensor device SU that is the transmission source of the live video and the event video.
  • Such authenticity determination terminal device JT can be configured by, for example, a desktop or node type computer with a communication function.
  • the SU control processing unit 14 is functionally configured with a SU control unit 141, a behavior detection processing unit 142, a nurse call processing unit 143, and a SU streaming processing unit 144.
  • the SV control processing unit 22 is functionally configured with the SV control processing unit 221 and the SV monitoring processing unit 222 by executing the control processing program.
  • FIG. 7 is a flowchart showing operations related to event detection processing and first event notification communication signal transmission processing in the sensor device.
  • FIG. 8 is a flowchart showing the operations of the first and second preparation processes for event moving image transmission in the flowchart shown in FIG.
  • a first preparation process for event moving image transmission and a first preparation process for event moving image transmission, which will be described later, are substantially the same, and are collectively shown in FIG.
  • FIG. 9 is a flowchart showing an operation related to the transmission process of the second event notification communication signal in the sensor device.
  • the SU control unit 141 of the SU control processing unit 14 When the sensor device SU starts operating, the SU control unit 141 of the SU control processing unit 14 operates the sensor unit 11, and the moving image generated by the imaging unit 111 of the sensor unit 11 is stored in the SU moving image of the ring buffer. The data is stored in the unit 161 as described above. Thereby, the SU moving image storage unit 161 stores moving images for the past from the present time for the predetermined time length. Then, the sensor device SU detects the predetermined operation in the monitored person Ob by performing the following operation every frame or every several frames, and determines whether or not the nurse call is accepted. is doing.
  • the sensor device SU acquires, as the target image, an image (image data) for one frame from the imaging unit 111 of the sensor unit 11 by the SU control unit 141 of the SU control processing unit 14 (S10). .
  • the sensor device SU detects a first behavior that can be detected by the behavior detection processing unit 142 of the SU control processing unit 14 based on a target image among predetermined behaviors of the monitored person Ob. Is executed based on the target image acquired in the process S10, and the first detection result is stored in the SU storage unit 16 (S11).
  • the first action is awakening, leaving the floor, and falling, each of which is a first detection condition (in the present embodiment, the suspected getting up determination threshold, the suspected leaving floor determination threshold, and the suspected falling over determination threshold).
  • detection is performed at each of two levels by using each of the second detection conditions (in the present embodiment, the wake-up determination threshold, the bed leaving determination threshold, and the fall determination threshold).
  • the behavior detection processing unit 142 determines the success / failure level at each of the possible wake-up and probable wake-up levels, and determines the success / failure level at each of the possible wake-up and probable wake-up levels. Judgment is made, and the success or failure is determined at each level of a fall that has a possibility of falling and a highly likely fall.
  • the sensor device SU acquires the output of the body movement measurement unit 112 of the sensor unit 11 by the SU control unit 141 of the SU control processing unit 14 (S12).
  • the sensor device SU detects the second behavior that can be detected based on the output of the body motion measurement unit 112 among the predetermined behaviors of the monitored person Ob by the behavior detection processing unit 142 of the SU control processing unit 14.
  • the second action detection process is executed based on the output of the body movement measurement unit 112 acquired in the process S12, and the second detection result is stored in the SU storage unit 16 (S13).
  • the second action is a body movement stop
  • the action detection processing unit 142 detects the body movement stop by using a first detection condition (the body movement stop suspicion determination threshold in this embodiment) and a second detection.
  • the success or failure is determined at each of two levels of possible body motion stop and highly probable body motion stop.
  • the sensor device SU uses the behavior detection processing unit 142 based on the first detection result and the second detection result stored in the SU storage unit 16 in the processing S11 and the processing S13 to perform the predetermined detection in the monitored person Ob. Whether or not an action has been detected is determined at each of the two levels (S14). As a result of this determination, when the predetermined action is not detected (No), the sensor device SU next executes step S19, while the predetermined action is detected under the first detection condition. (Ie, when at least one of wake-up, getting-off, falling, and body movement stop with high probability is detected) (first detection condition), the sensor device SU sequentially performs the next processing S15 and processing S16.
  • the sensor device SU executes the process S19 after sequentially executing the next process S17 and process S18.
  • the sensor device SU uses the behavior detection processing unit 142 to execute a first preparation process for transmitting event videos having a predetermined time length before and after the detection of the predetermined behavior to the management server device SV. . More specifically, the behavior detection processing unit 142 manages the detected predetermined behavior and transmission destination, which is set after a predetermined time length of the moving image, which is required after the predetermined behavior is detected. It is generated in association with the server device SV (server ID, communication address of the management server device SV), and the generated timer is started (see process S151 in FIG. 8).
  • the SU moving image storage unit 161 stores a moving image of about two and a half minutes (about two minutes and thirty seconds), about thirty seconds before the predetermined action is detected and about two minutes after the predetermined action is detected.
  • a timer that times up in 2 minutes is generated and started.
  • the SU moving image storage unit 161 stores a moving image of about 3 minutes, and an event moving image of about 3 minutes composed of each moving image of about 1 and a half before and after the predetermined action is detected, 1 minute A timer that times up in half is generated and started.
  • the SU moving image storage unit 161 stores about 2 minutes of moving images, and includes about 2 seconds of moving images of about 30 seconds before detection of the predetermined behavior and about 1 and a half minutes of moving images after detection of the predetermined behavior.
  • a timer that times up in one and a half minutes is generated and started.
  • the sensor apparatus SU uses the action detection processing unit 142 to execute the predetermined action.
  • a first event notification communication signal relating to the detection of the predetermined action is transmitted as an event to the management server device SV (S16), and then the process S19 is executed.
  • the behavior detection processing unit 142 includes a sensor ID of the own device, event information (here, one or more of getting up, getting out of bed, falling, and stopping body motion) and a first event notification containing a target image.
  • the communication signal is transmitted to the management server device SV via the SU communication IF unit 15.
  • the sensor device SU uses the behavior detection processing unit 142 to transmit event videos having a predetermined time length before and after the detection of the predetermined behavior to the management server device SV and the authenticity determination terminal device JT.
  • a second preparation process is performed for the purpose. More specifically, the behavior detection processing unit 142 manages the detected predetermined behavior and the transmission destination by using a timer set with a preset length of time of the moving image that is required after the predetermined behavior is detected.
  • server device SV server ID, communication address of management server device SV
  • authenticity determination terminal device JT identity of authenticity determination terminal device (determination terminal ID), communication address of authenticity determination terminal device JT
  • the sensor apparatus SU includes an action detection processing unit. 142 transmits a true / false determination request notification communication signal relating to detection of the predetermined action as the predetermined event to the authenticity determination terminal device JT, and transmits data necessary for transmission of the second event notification communication signal to the SU storage unit 16. Is temporarily stored (S18), and then step S19 is executed.
  • the behavior detection processing unit 142 includes authenticity determination request information, its own sensor ID, event information (here, one or more of getting up, getting out of bed, falling and stopping body movement), and live A true / false determination request notification communication signal accommodating the communication address of the own device as a moving image acquisition destination is transmitted to the authenticity determination terminal device JT via the SU communication IF unit 15. Then, the behavior detection processing unit 142 stores the event information representing the detected predetermined behavior and the target image used when detecting the predetermined behavior contained in the second event notification communication signal. The information is temporarily stored in the unit 16.
  • the sensor device SU determines whether the nurse call is accepted by the nurse call processing unit 143. That is, the processes S10 to S20 shown in FIG. 7 are repeatedly executed for each frame or every several frames, but during the period from the previous execution of the process S19 to the current execution of the process S19, It is determined whether or not the call reception operation unit 13 has been operated. As a result of this determination, when the nurse call reception operation unit 13 is not operated and the nurse call is not received (No), the sensor device SU ends the current process, while the nurse call reception operation unit 13 Is operated and a nurse call is received (Yes), the sensor device SU ends the current process after executing the next process S20.
  • the sensor device SU uses the nurse call processing unit 143 to notify the predetermined terminal device SP, TA of the nurse call whose reception has been found in the process S19 via the management server device SV.
  • the first event notification communication signal related to the nurse call is transmitted to the management server device SV as the event. More specifically, the nurse call processing unit 143 sends a first event notification communication signal containing the sensor ID and event information (here, nurse call reception information) of the own device via the SU communication IF unit 15 to the management server. Send to device SV.
  • the action detection processing unit 142 sets the time of the preset moving image required after the detection of the predetermined action.
  • the behavior detection processing unit 142 determines whether or not the timer has expired (S152). As a result of this determination, if the timer has not timed up (No), the behavior detection processing unit 142 returns the process to step S152, while if the result of the determination is that the timer has timed up (Yes), The behavior detection processing unit 142 generates an event moving image (event moving image file) using the moving image stored in the SU moving image storage unit 161 as one moving image file (S153).
  • an event moving image event moving image file
  • the behavior detection processing unit 142 is the event video notification communication that accommodates the sensor ID of the own device, the detected predetermined behavior associated with the timer as the event information, and the generated event video.
  • a signal is generated for the transmission destination management server apparatus SV associated with the timer, the generated event video notification communication signal is transmitted to the management server apparatus SV, and this process ends.
  • the behavior detection processing unit 142 performs the processes S151 to S154 in parallel with the processes S10 to S20 described above with reference to FIG.
  • the action detection processing unit 142 sets the time of the preset moving image that is required after the predetermined action is detected.
  • the behavior detection processing unit 142 determines whether or not the timer has expired (S172). If the timer is not up as a result of this determination (No), the behavior detection processing unit 142 returns the process to step S172. On the other hand, as a result of the determination, the timer is up (Yes), The behavior detection processing unit 142 generates an event moving image (event moving image file) using the moving image stored in the SU moving image storage unit 161 as one moving image file (S173).
  • the behavior detection processing unit 142 is the event video notification communication that accommodates the sensor ID of the own device, the detected predetermined behavior associated with the timer as the event information, and the generated event video.
  • a signal is generated for the destination management server device SV and the authenticity determination terminal device JT associated with the timer, and the generated event video notification communication signal is transmitted to the management server device SV and the authenticity determination terminal device JT, respectively. Send by multicast and end this process.
  • the behavior detection processing unit 142 processes the processes S171 to S174 in parallel with the processes S10 to S20 described above with reference to FIG.
  • the authenticity determination terminal device JT that has received the authenticity determination request notification communication signal transmitted from the sensor device SU in the process S18 obtains the live video contained in the received authenticity determination request notification communication signal.
  • a communication signal live video request communication signal
  • streaming video is received from the sensor device SU
  • the live video is displayed. indicate.
  • the authenticity determination terminal device JT displays the event video accommodated in the received event video notification communication signal.
  • a user (authentication judgment person or operator) of the authenticity determination terminal device JT determines whether the predetermined action has occurred by referring to a live video (live video) or an event video (the predetermined It is determined whether or not an action has occurred), and whether or not notification of detection of the predetermined action is necessary is input to the authenticity determination terminal device JT.
  • the authenticity determination terminal device sends a communication signal (notification required notification communication signal) for notifying the sensor device SU of an instruction that requires notification, as a true / false determination request notification signal.
  • a reply is sent to the sender sensor device SU.
  • the notification necessary notification communication signal contains an instruction (command, command) that requires notification, and the sensor ID and event information contained in the true / false determination request notification signal.
  • the authenticity determination terminal device uses a communication signal (notification notification notification communication signal) for notifying the sensor device SU of an instruction that does not require notification, as a true / false determination request notification communication. Is returned to the sensor device SU that is the source of the issue.
  • the notification-unnecessary notification communication signal contains an instruction (command, command) that does not require notification, and the sensor ID and event information contained in the true / false determination request notification signal.
  • the sensor device SU first receives a communication signal from the SU communication IF unit 15 by the SU control unit 141 of the SU control processing unit 14. It is determined whether or not (S21). As a result of this determination, if the communication signal is not received (No), the sensor device SU returns the process to S21, and if the result of the determination is that a communication signal is received (Yes), the sensor device SU The device SU executes the next process S22. That is, the sensor device SU waits for reception of a communication signal.
  • the sensor device SU determines the type of the received communication signal by the SU control unit 141. As a result of this determination, when the received communication signal is a notification required notification communication signal (notification required notification), the sensor device SU executes the processing S26 after executing the processing S23, and the received communication signal is When it is a notification unnecessary notification communication signal (notification unnecessary notification), the processing S26 is executed after executing the processing S24, and the received communication signal is not a notification required notification communication signal or a notification unnecessary notification communication signal. For (others), the process S26 is performed after the process S25 is performed.
  • the sensor apparatus SU manages the second event notification communication signal according to the notification-required communication signal received from the authenticity determination terminal apparatus JT in process S21 by the action detection processing unit 142 of the SU control processing unit 14.
  • the behavior detection processing unit 142 stores the sensor ID of the own device and the SU storage unit 16 using the event information and the target image temporarily stored in the SU storage unit 16 in the process S18.
  • the second event notification communication signal containing the received event information (here, one or more of getting up, getting out of bed, falling and stopping body movement) and the target image is sent to the management server device SV via the SU communication IF unit 15. Send.
  • a detection result detected as an action that may be detected under the second detection condition is notified as a correct detection, and the misreporting can be reduced.
  • the sensor device SU is temporarily stored in the SU storage unit 16 according to the notification-unnecessary communication signal received from the authenticity determination terminal device JT in the process S21 by the behavior detection processing unit 142 of the SU control processing unit 14.
  • the stored event information and target image are deleted.
  • a detection result detected as an action that may be detected under the second detection condition is erased as an erroneous detection, and false alarms can be reduced.
  • the sensor device SU performs an appropriate process according to the communication signal received in the process S21 by the SU control processing unit 14.
  • sensor device SU judges whether the operation is completed (stopped) by SU control processing part 14. As a result of this determination, when the operation is finished (stopped) (Yes), the sensor device SU finishes this process, while when the operation is not finished (stopped) (No), the sensor device SU The SU returns the process to step S21.
  • the sensor device SU operates as described above with respect to each of detection of a predetermined action and reception of a nurse call in the monitored person Ob.
  • FIG. 10 is a flowchart showing the operation of the management server device.
  • the management server device SV determines whether or not the SV communication IF unit 21 has received a communication signal by the SV control unit 221 of the SV control processing unit 22 (S31). As a result of the determination, when the communication signal is not received (No), the management server device SV returns the process to S31. When the communication signal is received as a result of the determination (Yes), The management server device SV executes the following process S32. That is, the management server device SV is waiting for reception of a communication signal.
  • the management server device SV determines the type of the received communication signal by the SV control unit 221. As a result of this determination, the management server device SV, when the received communication signal is either the first event notification communication signal or the second event notification communication signal (first event notification, second event notification), If the received communication signal is an event video notification communication signal (event video notification) after executing the process S33, the process S36 is executed after executing the process S34, and the reception If the communication signal is not the first event notification communication signal, the second event notification communication signal, or the event moving image notification communication signal (others), the process S36 is executed after the process S35 is executed.
  • the management server apparatus SV monitors the first event notification communication signal and the second event notification communication signal received from the sensor apparatus SU in the process S31 by the SV monitoring processing section 222 of the SV control processing section 22. Execute the process. More specifically, first, the SV monitoring processing unit 222 performs SV monitoring on monitoring information regarding the monitored person Ob contained in the first or second event notification communication signal received from the sensor device SU in step S31. The information is stored (recorded) in the information storage unit 231. Then, the SV monitoring processing unit 222 stores the notification destination corresponding to the sensor device SU that has transmitted the first or second event notification communication signal received in the processing S31 in the inter-device information storage unit 232.
  • the SV monitoring processing unit 222 transmits a third event notification communication signal to the selected notification destination terminal devices SP and TA.
  • the third event notification communication signal as described above, when the event information contained in the first or second event notification communication signal received in the process S31 is the predetermined action, the process S31 is performed.
  • the sensor ID contained in the first or second event notification communication signal is used as the download destination of the sensor ID, the event information and the target image, and the moving image stored in the first or second event notification communication signal received at A communication address corresponding to the sensor device SU is accommodated.
  • the event information accommodated in the first event notification communication signal received in the process S31 is a nurse call
  • the sensor ID and event information accommodated in the first event notification communication signal received in the process S31 Is housed.
  • the management server device SV executes the processing of the event video accommodated in the event video notification communication signal received from the sensor device SU in the process S31 by the SV monitoring processing unit 222 of the SV control processing unit 22. More specifically, the SV monitoring processing unit 222 extracts the sensor ID, the event information, and the event video accommodated in the event video notification communication signal received from the sensor device SU in the process S31, and the file name is included in the extracted event video. And the event video (event video file) is stored in the SV video storage unit 234 of the SV storage unit 23, and the extracted sensor ID and event information are associated with the file name and stored in the SV video storage unit 234. .
  • the file name of the event video may be set as appropriate.
  • the movie can be associated with each of the generated sensor device SU and the reception time by the file name, and the file name may be duplicated in one monitored person monitoring support system MS. Absent.
  • the management server apparatus SV performs an appropriate process according to the communication signal received in the process S31 by the SV control processing unit 22.
  • the management server apparatus SV determines whether or not the operation is finished (stopped) by the SV control processing unit 22. As a result of this determination, when the operation is finished (stopped) (Yes), the management server device SV finishes this process. On the other hand, when the operation is not finished (stopped) (No), the management server device SV The server device SV returns the process to step S31.
  • the management server device SV operates as described above.
  • the fixed terminal device SP and the mobile terminal device TA receive the second event notification communication signal from the management server device SV via the network NW, the sensor ID and the event information accommodated in the second event notification communication signal, etc. Is stored (recorded) as monitoring information of the monitored person Ob monitored by the sensor device SU having this sensor ID, and the monitoring information is displayed. Thereby, the event detected by the sensor device SU is displayed on the fixed terminal device SP and the portable terminal device TA and notified (notified).
  • the user (monitor) of the fixed terminal device SP or the portable terminal device TA downloads and references the event video from the management server device SV as needed, calls out using the portable terminal device TA, or makes a nurse call. In response to this, a voice call is made using the mobile terminal device TA, a moving image is distributed from the sensor device SU by streaming, and the moving image is referred to live.
  • FIG. 11 is a sequence diagram showing the operation of the monitored person monitoring support system in the first case.
  • FIG. 12 is a sequence diagram showing the operation of the monitored person monitoring support system in the second case.
  • FIG. 13 is a diagram illustrating an example of the authenticity determination screen displayed on the authenticity determination terminal device in the first case.
  • FIG. 14 is a diagram showing a true / false determination screen on which only a live video is displayed in the second case.
  • FIG. 15 is a diagram showing a true / false determination screen on which an event video and a live video are displayed in the second case.
  • the sensor apparatus SU executes the process S15, and the process S16 performs the first process.
  • An event notification communication signal is transmitted to the management server device SV (C11), processing S19 and processing S20 are sequentially executed, and this processing is terminated.
  • the management server device SV receives the first event notification communication signal by each of the above-described processing S31 to S33 shown in FIG. 9, the management server device SV stores (records) the monitoring information accommodated therein, and performs the third event notification.
  • the communication signal is transmitted to the predetermined terminal devices SP and TA (C12), and the process S36 is executed. In this example, the process returns to the process S31. Further, the sensor device SU generates an event moving image and transmits an event moving image notification communication signal to the management server device SV by each of the processes S151 to S154 shown in FIG. 8 (C13). When the management server device SV receives the event video notification communication signal by the above-described processing S31, processing S32, and processing S34 shown in FIG. 9, the management server device SV stores (records) the event video stored therein, and performs processing S36. In this example, the process returns to the process S31.
  • the authenticity determination terminal device JT Upon receiving the authenticity determination request notification communication signal, the authenticity determination terminal device JT transmits a live moving image request communication signal to the sensor device SU (C22), and receives distribution of moving images from the sensor device SU (C23). , Display live video on the authenticity screen.
  • This authenticity determination screen is a screen for displaying an image referred to in order to determine the authenticity of detection of the predetermined action and accepting the determination result. An example thereof is shown in FIG. .
  • the authenticity determination screen 61 shown in FIG. 13 includes a detection moving image display area 611, a live moving image display area 612, a “notification required” button 613, and a “notification required” button 614.
  • the detection moving image display area 611 is an area for displaying an event moving image.
  • the live video display area 612 is an area for displaying a video live.
  • the “notification required” button 613 is a button for inputting an instruction to notify the sensor device SU of detection of the predetermined action.
  • the authenticity determination person inputs the “notification required” button 613 when it is determined that the predetermined action occurs in the monitored person Ob and the detection of the predetermined action is correct. .
  • the “notification unnecessary” button 614 is a button for inputting an instruction not to notify the sensor device SU of detection of the predetermined action. As a result of the authenticity determination, the authenticity determination person inputs the “notification unnecessary” button 614 when determining that the predetermined action has not occurred in the monitored person Ob and the detection of the predetermined action is incorrect. Manipulate.
  • the authenticity determination terminal device JT transmits a notification required notification communication signal for notifying the sensor device SU of an instruction that requires notification, as a true / false determination request notification communication signal. Is sent back to the source sensor device SU (C24).
  • the sensor device SU generates a second event notification communication signal by the processes S21 to S23 shown in FIG. 9, and transmits the generated second event notification communication signal to the management server device SV (C25). S26 is executed, and in this example, the process returns to the process S21.
  • the management server device SV receives the second event notification communication signal by each of the above-described processing S31 to S33 shown in FIG. 9, the management server device SV stores (records) the monitoring information accommodated therein, and performs the third event notification.
  • the communication signal is transmitted to the predetermined terminal devices SP and TA (C26), and the process S36 is executed. In this example, the process returns to the process S31.
  • the sensor device SU generates an event moving image by each of the processes S171 to S174 shown in FIG. 8, and transmits an event moving image notification communication signal to each of the authenticity determination terminal device JT and the management server device SV (C27). -1, 27-2).
  • the management server device SV receives the event video notification communication signal by the above-described processing S31, processing S32, and processing S34 shown in FIG. 9, the management server device SV stores (records) the event video stored therein, and performs processing S36. In this example, the process returns to the process S31.
  • the third event notification communication signal can be transmitted to the predetermined terminal device SP, TA earlier, and the detection of the event can be performed earlier. , TA can be notified.
  • the first event notification communication is performed as in FIG.
  • the management server device SV stores (records) the monitoring information accommodated in the first event notification communication signal. It transmits to predetermined terminal device SP and TA (C12).
  • the sensor device SU generates an event video and transmits an event video notification communication signal to the management server device SV (C13).
  • the management server device SV receives the event video notification communication signal, the sensor device SU is accommodated therein. Store (record) event video.
  • the process S17 is executed as in the process C21, and the authenticity is determined by the process S18.
  • a request notification communication signal is transmitted to the authenticity determination terminal device JT (C31), processing S19 and processing S20 are sequentially executed, and this processing is terminated.
  • the authenticity determination terminal device JT Upon receiving the authenticity determination request notification communication signal, the authenticity determination terminal device JT transmits a live video request communication signal to the sensor device SU (C32) and performs streaming from the sensor device SU, similarly to the processing C22 and the processing C23.
  • the moving image is displayed live on the authenticity determination screen 61.
  • An example is shown in FIG. Also in the authenticity determination screen 61 of the example shown in FIG. 14, since the event moving image is not received at this time, the detected moving image display area 611 is displayed in the same manner as the authenticity determination screen 61 of the example shown in FIG. , Event video is not displayed.
  • the live video display area 612 in the example shown in FIG.
  • the sensor device SU While the authenticity determination person is worried about the determination, the sensor device SU generates an event moving image by each of the processes S171 to S174 shown in FIG. 8 and transmits the event moving image notification communication signal to the authenticity determining terminal device JT. And transmitted to each of the management server devices SV (C34-1 and 34-2).
  • the management server device SV receives the event video notification communication signal by the above-described processing S31, processing S32, and processing S34 shown in FIG. 9, the management server device SV stores (records) the event video stored therein, and performs processing S36. In this example, the process returns to the process S31.
  • the authenticity determination terminal device JT displays the event moving image accommodated in the event moving image display area 611 on the authenticity determination screen 61. An example is shown in FIG.
  • the reproduction of the event moving image proceeds, and the moving image at the time of the fall is displayed in the moving image display area 611 at the time of detection. For this reason, the authenticity determination person can determine that the fall of the monitored person Ob occurs as the predetermined action and that the detection of the fall is correct by referring to the event video. Accordingly, the authenticity determination person performs an input operation on the “notification required” button 613.
  • the authenticity determination terminal device JT transmits a notification required notification communication signal for notifying the sensor device SU of an instruction that requires notification, as a true / false determination request notification communication signal. Is sent back to the source sensor device SU (C35-1).
  • the sensor device SU Similarly to the process C25, the sensor device SU generates a second event notification communication signal by each of the processes S21 to S23 shown in FIG. 9, and transmits the generated second event notification communication signal to the management server apparatus SV. (C36), the process S26 is executed, and in this example, the process returns to the process S21.
  • the management server device SV stores (records) the monitoring information accommodated in the second event notification communication signal when it receives the second event notification communication signal by the above-described processing S31 to S33 shown in FIG. Then, the third event notification communication signal is transmitted to the predetermined terminal devices SP and TA (C37), and the process S36 is executed. In this example, the process returns to the process S31.
  • the authenticity determination terminal device detects an indication that notification is not necessary.
  • a notification unnecessary notification communication signal for notifying the device SU is returned to the sensor device SU that is the transmission source of the authenticity determination request notification communication signal.
  • the sensor device SU receives the notification-unnecessary communication signal from the authenticity determination terminal device JT by the processes S21, S22, and S24 shown in FIG. 9, the event information temporarily stored in the SU storage unit 16 Then, the target image is deleted, and the process S26 is executed. In this example, the process returns to the process S21. Therefore, in this case, the second event notification communication signal is not transmitted from the sensor device SU to the management server device SV. This can reduce false alarms.
  • the monitored person monitoring support system MS, the sensor apparatus SU as an example of the monitored person monitoring apparatus in the present embodiment, and the monitored person monitoring method implemented therein include a plurality of actions of the same type. Since the detection is performed under the detection condition, it is possible to detect the same type of behavior under relatively severe detection conditions and relatively loose detection conditions. The detection of the action under the relatively loose detection condition may be a false alarm.
  • such a relatively loose detection condition can be set as the second detection condition, and the monitored person monitoring support system MS, the sensor device SU And the method of notifying the detection of the behavior under the second detection condition to the authenticity determination terminal device JT (an example of the second device as the second notification destination), and from the authenticity determination terminal device JT,
  • the management server device SV an example of the first device that is the first notification destination
  • the detection of the behavior is further notified to the management server device SV, so that false alarms can be reduced.
  • the user who handles the authenticity determination terminal device JT can refer to the moving image notified from the sensor device SU, the action can be determined visually, so the occurrence of the action is more accurately detected. Can be judged. Therefore, the monitored person monitoring support system MS, the sensor device SU, and the method thereof can notify the behavior more appropriately, and can reduce both misreporting and misreporting.
  • the monitored person monitoring support system MS, the sensor device SU, and the method thereof are relatively inexpensive because the management server device SV and the authenticity determination terminal device JT are handled by different first and second operators, respectively.
  • the second operator can be made to handle the authenticity determination terminal device JT, and the cost can be reduced.
  • the monitored person monitoring support system MS, the sensor device SU, and the method thereof transmit the action detection moving image (event moving image) and the live moving image to the authenticity determination terminal device JT. For this reason, since the user (determination person) who handles the authenticity determination terminal device JT can refer to these, the occurrence of the behavior can be determined more accurately.
  • the sensor device SU transmits the event video to each of the management server device SV and the authenticity determination terminal device JT in the case of the second detection condition, but the sensor device SU manages the event video.
  • the information is transmitted to only the server apparatus SV, and information for downloading the event video transmitted to the management server apparatus SV from the management server apparatus SV (event video download information) is transmitted to the authenticity determination terminal apparatus JT. , May be configured.
  • the event video download information is, for example, the communication address of the management server device SV and information (event video file name) for identifying the event video.
  • the number of the authenticity determination terminal devices JT is one, but there may be a plurality. According to this, since there are a plurality of authenticity determination terminal devices JT as the second notification destination, the visual determination can be shared. In such a case, the plurality of authenticity determination terminal devices JT may be configured to operate in different time zones in which one day is divided into a plurality of times. According to this, since the plurality of authenticity determination terminal devices JT operate in different time zones that divide a day into a plurality of times, the visual determination can be shared in a time division manner. In particular, as shown in FIG.
  • each of the three first to third authenticity determination terminal devices JT-1, JT-2, and JT-3 is separated from the first to third positions at a longitude of about 120 degrees.
  • the three first to third authenticity determination terminal devices JT-1, JT-2, and JT-3 can be operated in the daytime zone at the first to third positions.
  • FIG. 16 is a diagram for explaining a modification of the monitored person monitoring support system.
  • the first authenticity determination terminal device JT-1 is disposed in the Central American region
  • the second authenticity determination terminal device JT-2 is disposed in the Middle East region
  • the third authenticity determination terminal device JT-3 is For example, the islands such as the Indonesian Islands are located in Southeast Asia.
  • each of the plurality of time zones includes the time zone before and after the time zone and an overlap portion, and the authenticity determination terminal device JT operating in the later time zone operates in the time zone.
  • the operation of the own device may be notified by transmitting a communication signal (operation start notification communication signal) containing operation information indicating the operation of the own device to the authenticity determining terminal device JT. For example, as shown by broken lines in FIG. 13 to FIG.
  • a “business start” button 616 for instructing transmission of the operation start notification communication signal is further provided on the authenticity determination screen 61, and the authenticity determination person JM Upon accepting an input operation of the “business start” button 616, the authenticity determination terminal device JT is configured to transmit an operation start notification communication signal to the authenticity determination terminal device JT operating in the previous time zone. According to this, when the visual determination is shared by time division, the visual determination can be performed continuously for 24 hours.
  • a monitored person monitoring apparatus is a monitored person monitoring apparatus that detects a predetermined action of a monitored person who is a monitoring target and notifies a connected apparatus to be communicable, and generates an animation
  • a detection unit that detects the same type of behavior with a plurality of detection conditions including at least first and second detection conditions different from each other set for the same type of behavior, and the detection unit sets the first When the behavior is detected under the detection condition, the detection of the behavior is notified to the first device as the first notification destination, and the behavior is detected when the detection unit detects the behavior under the second detection condition.
  • a notification control unit that notifies a second notification destination second device that is different from the first notification destination first device, and the notification control unit includes: 2 From the second device to notify When accepting an instruction for notifying the detection of the action to the first device of the first notification destination, further notifies the detection of the action to the first device of the first notification destination.
  • the notification control unit stores information indicating that the behavior is detected when the behavior is detected by the detection unit under the first detection condition. By transmitting one communication signal to the first device as the first notification destination, the detection of the behavior is notified to the first device as the first notification destination, and the behavior is detected by the detection unit under the second detection condition.
  • the second notification destination second device is notified by transmitting a second communication signal containing information indicating that the behavior has been detected to the second device that is the second notification destination. Then, a behavior detection video (event video) that is a video of a predetermined time length generated by the imaging unit including before and after the detection of the behavior, or information for acquiring the behavior detection video is stored in the second notification destination. Sending to the second device Accordingly, the moving image generated by the imaging unit is notified to the second device that is the second notification destination, and the detection of the action is detected from the second device that is the second notification destination to the first device that is the first notification destination.
  • a behavior detection video event video
  • the moving image generated by the imaging unit is notified to the second device that is the second notification destination, and the detection of the action is detected from the second device that is the second notification destination to the first device that is the first notification destination.
  • a fourth communication signal containing information indicating that the action has been detected is transmitted to the first device that is the first notification destination.
  • the detection is further notified to the first device as the first notification destination.
  • the notification control unit is configured to stream the moving image generated by the imaging unit when the action is detected by the detection unit under the second detection condition. 2 Further distribution to the second device of the notification destination.
  • the notification control unit does not accept an instruction to notify the first device of the first notification destination of the action detection from the second device of the second notification destination. In the case, the detection of the action is not notified to the first device of the first notification destination.
  • the predetermined behavior includes a plurality of types including waking up, getting out of bed, falling and stopping body movement, and different first 1A and second A set for the waking up.
  • the detection of the wake-up in the first A detection condition is a highly probable wake-up
  • the detection of the wake-up in the second A detection condition is a possible wake-up.
  • the detection of the bed leaving in the first B detection condition among the different 1B and 2B detection conditions set different from each other is assumed to be a bed with high probability, and the bed detection under the 2B detection condition is possible.
  • the detection of the fall under the first C detection condition among the different 1C and 2C detection conditions set for the fall is assumed to be a highly likely fall, and the second C Detection The detection of the fall in the case is a possible fall, and the body motion is stopped in the first D detection condition among the different 1D and 2D detection conditions set for the body motion stop. This detection is a highly probable body motion stop, and the detection of the body motion stop under the second D detection condition is a possible body motion stop.
  • Such a monitored person monitoring device detects the same type of behavior under a plurality of detection conditions, it is possible to detect the same type of behavior under relatively severe detection conditions and relatively loose detection conditions. , Reduce false alarms.
  • the detection of the action under the relatively loose detection condition may be a false alarm.
  • such a relatively loose detection condition can be set as the second detection condition, and the monitored person monitoring apparatus detects the behavior under the second detection condition. 2
  • the behavior detection is performed Is further notified to the first device of the first notification destination, so that false alarms can be reduced.
  • the user authentication judgment person
  • the monitored person monitoring apparatus can notify the behavior more appropriately, and can reduce both the false alarm and the false alarm.
  • the first device that is the first notification destination is handled by a first operator
  • the second device that is the second notification destination is the first operator. Is handled by a different second operator.
  • the first device of the first notification destination is installed at a first installation location related to the first operator
  • the second device of the second notification destination is the first device. It is installed at a second installation location different from the first installation location related to a second operator different from the one operator.
  • each of the first and second installation locations is in a different building.
  • the first and second devices are handled by the first and second operators different from each other, so the second device is handled by a relatively low-cost second operator. This can reduce the cost.
  • the second device as the second notification destination is plural.
  • Such a monitored person monitoring apparatus can share the visual determination because there are a plurality of second apparatuses as the second notification destinations.
  • the plurality of second devices operate in different time zones in which one day is divided into a plurality of times.
  • each of the plurality of time zones includes a time zone before and after the time zone and an overlap portion, and the second device operating in a later time zone is the time zone.
  • the operation of the own device is notified by transmitting a communication signal containing operation information indicating the operation of the own device to the second device operating at
  • each of the three second devices is arranged in the first to third positions at longitudes of about 120 degrees apart, so that each of the three second devices in the daytime zone of each of the first to third positions. Can be operated.
  • the moving image is a behavior detection moving image that is a moving image of a predetermined time length generated by the imaging unit including before and after the detection of the behavior, and the imaging And live video generated and distributed live.
  • Such a monitored person monitoring device transmits the action detection moving image and the live moving image to the second device that is the second notification destination. For this reason, since the user (authenticity determination person) who handles the 2nd notification destination 2nd apparatus can refer to the said action detection moving image and the said live moving image, it can determine generation
  • a monitored person monitoring method is a monitored person monitoring method for detecting a predetermined action in a monitored person who is a monitoring target and notifying a device connected to be communicable, and generating a moving image
  • a detecting step for detecting the same type of action with a plurality of detection conditions including at least different first and second detection conditions set for the same type of action, and the detecting step When the behavior is detected under the first detection condition, the detection of the behavior is notified to the first device as the first notification destination, and when the behavior is detected under the second detection condition by the detection step.
  • a notification control step of notifying the second device of the second notification destination that is different from the first device of the first notification destination, of the motion detection and the moving image generated in the moving image generation step, the notification control step The second When an instruction to notify the first device of the first notification destination is received from the second device of the knowledge destination, the first device of the first notification destination is further notified of the detection of the behavior. .
  • the first device as the first notification destination is handled by a first operator
  • the second device as the second notification destination is different from the first operator. Handled by a second operator.
  • Such a monitored person monitoring method detects the same type of behavior under a plurality of detection conditions, so that the same type of behavior can be detected under relatively severe detection conditions and relatively loose detection conditions. , Reduce false alarms.
  • the detection of the action under the relatively loose detection condition may be a false alarm.
  • such a relatively loose detection condition can be set as the second detection condition, and the monitored person monitoring device detects the behavior under the second condition.
  • the notification is sent to the second device that is the notification destination, and when the instruction to notify the first device that is the first notification destination is received from the second device that is the second notification destination, the detection of the behavior is performed. Further notification to the first device of the first notification destination can also reduce false alarms.
  • the user (determination person) who handles the second device as the second notification destination can refer to the moving image notified from the monitored person monitoring apparatus, so the action can be determined visually, so the occurrence of the action Can be determined more accurately. Therefore, the monitored person monitoring method can notify the behavior more appropriately, and can reduce both the false alarm and the false alarm.
  • a monitored person monitoring support system for a monitored person who is a monitoring target, detects a predetermined event related to the monitored person, and generates a moving image
  • the sensor A central processing unit that is communicably connected to a device and manages an event detected by the sensor device and received from the sensor device; and the sensor that is communicably connected to the central processing unit and passes through the central processing unit
  • a monitored terminal monitoring support system for supporting monitoring of the monitored person comprising a terminal device that receives notification of an event detected by the apparatus, wherein the second terminal apparatus is communicably connected to the sensor device
  • the sensor device comprises the monitored person monitoring device according to any one of claims 1 to 4, wherein the predetermined event is the predetermined action. Seen, the first notification destination first device, said a central processing unit, the second device of the second notification destination is the second terminal device.
  • Such a monitored person monitoring support system includes any one of the above-described monitored person monitoring devices, it is possible to notify the behavior more appropriately and reduce both false alarms and false alarms.
  • the present invention it is possible to provide a monitored person monitoring apparatus and a monitored person monitoring method for monitoring a monitored person to be monitored, and a monitored person monitoring support system using the same.

Landscapes

  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Emergency Management (AREA)
  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Nursing (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Alarm Systems (AREA)
  • Accommodation For Nursing Or Treatment Tables (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention concerne un dispositif de surveillance de personne surveillée, un procédé de surveillance de personne surveillée et un système d'aide à la surveillance de personne surveillée, selon lesquels une vidéo peut être créée, le même type de comportement est détecté par une pluralité de conditions de détection comprenant au moins des première et seconde conditions de détection différentes l'une de l'autre réglées pour le même type de comportement, et lorsque le comportement est détecté par la première condition de détection, la détection du comportement est notifiée à une première destination de notification, et lorsque le comportement est détecté par la seconde condition de détection, la détection du comportement et la vidéo sont notifiées à une seconde destination de notification différente de la première destination de notification, et lorsqu'une instruction pour notifier la détection du comportement à la première destination de notification est reçue de la seconde destination de notification, la détection du comportement est également notifiée à la première destination de notification.
PCT/JP2018/014111 2017-06-15 2018-04-02 Dispositif de surveillance de personne surveillée et procédé associé, et système d'aide à la surveillance de personne surveillée WO2018230103A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019525115A JP7063333B2 (ja) 2017-06-15 2018-04-02 被監視者監視装置および該方法ならびに被監視者監視支援システム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017117650 2017-06-15
JP2017-117650 2017-06-15

Publications (1)

Publication Number Publication Date
WO2018230103A1 true WO2018230103A1 (fr) 2018-12-20

Family

ID=64660265

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/014111 WO2018230103A1 (fr) 2017-06-15 2018-04-02 Dispositif de surveillance de personne surveillée et procédé associé, et système d'aide à la surveillance de personne surveillée

Country Status (2)

Country Link
JP (1) JP7063333B2 (fr)
WO (1) WO2018230103A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002252725A (ja) * 2001-02-23 2002-09-06 Hitachi Plant Eng & Constr Co Ltd 緊急通報システム及び通信端末
JP2002298268A (ja) * 2001-03-29 2002-10-11 Matsushita Electric Ind Co Ltd 情報処理装置
JP2005025625A (ja) * 2003-07-04 2005-01-27 Omron Corp 浴室内挙動検知装置および浴室内挙動検知方法
JP2007124526A (ja) * 2005-10-31 2007-05-17 Hitachi Ltd 画像監視記録装置及び画像監視記録システム
WO2016093274A1 (fr) * 2014-12-12 2016-06-16 コニカミノルタ株式会社 Dispositif de réception, procédé de réception et programme de réception pour système de surveillance de sujet de surveillance, et système de surveillance de sujet de surveillance
WO2016199749A1 (fr) * 2015-06-10 2016-12-15 コニカミノルタ株式会社 Système de traitement d'image, dispositif de traitement d'image, procédé de traitement d'image et programme de traitement d'image

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002252725A (ja) * 2001-02-23 2002-09-06 Hitachi Plant Eng & Constr Co Ltd 緊急通報システム及び通信端末
JP2002298268A (ja) * 2001-03-29 2002-10-11 Matsushita Electric Ind Co Ltd 情報処理装置
JP2005025625A (ja) * 2003-07-04 2005-01-27 Omron Corp 浴室内挙動検知装置および浴室内挙動検知方法
JP2007124526A (ja) * 2005-10-31 2007-05-17 Hitachi Ltd 画像監視記録装置及び画像監視記録システム
WO2016093274A1 (fr) * 2014-12-12 2016-06-16 コニカミノルタ株式会社 Dispositif de réception, procédé de réception et programme de réception pour système de surveillance de sujet de surveillance, et système de surveillance de sujet de surveillance
WO2016199749A1 (fr) * 2015-06-10 2016-12-15 コニカミノルタ株式会社 Système de traitement d'image, dispositif de traitement d'image, procédé de traitement d'image et programme de traitement d'image

Also Published As

Publication number Publication date
JP7063333B2 (ja) 2022-05-09
JPWO2018230103A1 (ja) 2020-04-16

Similar Documents

Publication Publication Date Title
WO2017082037A1 (fr) Dispositif de traitement central et procédé pour système de surveillance de personnes, et système de surveillance de personnes
JP6108052B1 (ja) 被監視者監視システムの中央処理装置および中央処理方法、ならびに、前記被監視者監視システム
WO2017146012A1 (fr) Dispositif, procédé et système de surveillance d'une personne sous surveillance
WO2017209094A1 (fr) Système de surveillance
JP7044060B2 (ja) 被監視者監視装置、該方法および該システム
WO2018186042A1 (fr) Dispositif de détection de comportement, procédé de détection de comportement et système d'aide à la surveillance d'une personne surveillée
WO2018230104A1 (fr) Dispositif et procédé de traitement central pour système d'aide à la surveillance d'une personne surveillée, et système d'aide à la surveillance d'une personne surveillée
WO2018230103A1 (fr) Dispositif de surveillance de personne surveillée et procédé associé, et système d'aide à la surveillance de personne surveillée
WO2020100461A1 (fr) Dispositif de capteur pour un système d'aide à la surveillance de personne à surveiller, procédé de stockage d'image de surveillance, et système d'aide à la surveillance de personne à surveiller
JP6673382B2 (ja) 端末装置、プログラムおよび方法
JP6135832B1 (ja) 被監視者監視システム、被監視者監視システムの作動方法および被監視者監視システムの中央処理装置
JP2017151676A (ja) 被監視者監視装置、該方法および該システム
JP2017151675A (ja) 被監視者監視システムの中央処理装置および中央処理方法、ならびに、前記被監視者監視システム
WO2019142566A1 (fr) Système et procédé de support à la surveillance de personne surveillée et procédé de support à la surveillance de personne surveillée
JP6172424B1 (ja) 端末装置および端末装置の制御方法ならびに被監視者監視システム
JP6187732B1 (ja) 端末装置、端末装置の動作制御方法および被監視者監視システム
WO2017188156A1 (fr) Appareil terminal de système de surveillance de personne surveillée, procédé de commande d'appareil terminal et système de surveillance de personne surveillée
WO2019031012A1 (fr) Dispositif de détection d'action et procédé associé, et système d'aide à la surveillance d'une personne surveillée
WO2017141629A1 (fr) Dispositif terminal, procédé d'affichage pour dispositif terminal, dispositif capteur et système de surveillance de personne à surveiller
JP7251476B2 (ja) 被監視者監視支援システムの中央処理装置および該方法ならびに被監視者監視支援システム
JP7264066B2 (ja) 被監視者監視支援システム
JP7338268B2 (ja) 見守りシステムおよび見守り方法
JP7234931B2 (ja) 被監視者監視支援システムのセンサ装置、該センサ装置の処理方法および被監視者監視支援システム
JP7247898B2 (ja) 被監視者監視システム
WO2020031531A1 (fr) Dispositif de détermination d'anomalie de comportement de mouvement et procédé correspondant, et système de support de surveillance de personne à surveiller

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18818139

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019525115

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18818139

Country of ref document: EP

Kind code of ref document: A1