WO2017141629A1 - Dispositif terminal, procédé d'affichage pour dispositif terminal, dispositif capteur et système de surveillance de personne à surveiller - Google Patents

Dispositif terminal, procédé d'affichage pour dispositif terminal, dispositif capteur et système de surveillance de personne à surveiller Download PDF

Info

Publication number
WO2017141629A1
WO2017141629A1 PCT/JP2017/002079 JP2017002079W WO2017141629A1 WO 2017141629 A1 WO2017141629 A1 WO 2017141629A1 JP 2017002079 W JP2017002079 W JP 2017002079W WO 2017141629 A1 WO2017141629 A1 WO 2017141629A1
Authority
WO
WIPO (PCT)
Prior art keywords
person
image
display
unit
data
Prior art date
Application number
PCT/JP2017/002079
Other languages
English (en)
Japanese (ja)
Inventor
山下　雅宣
篤広 野田
琢哉 村田
雅史 西角
Original Assignee
コニカミノルタ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コニカミノルタ株式会社 filed Critical コニカミノルタ株式会社
Priority to JP2018500001A priority Critical patent/JP6804510B2/ja
Publication of WO2017141629A1 publication Critical patent/WO2017141629A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G7/00—Beds specially adapted for nursing; Devices for lifting patients or disabled persons
    • A61G7/05—Parts, details or accessories of beds
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/04—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using a single signalling line, e.g. in a closed loop

Definitions

  • the present invention relates to a terminal device suitably used for a monitored person monitoring system for monitoring a monitored person to be monitored, a display control method for the terminal apparatus, and a sensor suitably used for the monitored person monitoring system.
  • the present invention relates to an apparatus and the monitored person monitoring system.
  • Japan is an aging society, more specifically the ratio of population over 65 years old to the total population due to the improvement of living standards accompanying the post-war high economic growth, improvement of sanitary environment and improvement of medical standards, etc. It is a super-aging society with an aging rate exceeding 21%.
  • the elderly population aged 65 and over was about 25.56 million compared to the total population of 127.65 million, whereas in 2020, the elderly population was about 124.11 million.
  • the population is predicted to be about 34.56 million.
  • nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care are those who need nursing in a normal society that is not an aging society.
  • monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.
  • the nurse call system disclosed in Patent Document 1 is a nurse call slave set that is installed in a bed and a patient calls a nurse, and a nurse call set that is installed in a nurse station and responds to a call by the nurse call slave set.
  • a nurse call system having a nurse call parent device, a camera for imaging a patient on a bed from above the bed, and a state in which the patient wakes up from a captured image of the camera and a state in which the patient is separated from the bed State judging means for judging the occurrence of at least one of them and outputting a caution state occurrence signal, and the nurse call master unit has a notifying means for performing a notification operation upon receiving the caution state occurrence signal.
  • the nurse call system transmits a captured image of the camera to the portable terminal upon receiving the attention state generation signal and a portable terminal carried by a nurse to respond to a call from the nurse call slave. Communication control means.
  • the monitor such as a nurse visually indicates the status of the monitored person such as a nurse. It is convenient because it can be grasped. However, if the monitored person appears small or the display has a low resolution, it is difficult for the monitoring person to find the monitored person in the image.
  • the terminal device is a mobile terminal device such as a tablet or a smart phone
  • the monitor screen is relatively small, and thus it is difficult for the monitor to find the monitored person in the image.
  • the present invention has been made in view of the above circumstances, and an object thereof is to provide a terminal device, a display method for the terminal device, a sensor device, and a monitored person monitoring system that can easily find a monitored person in an image. It is to be.
  • the terminal device and the display method thereof receive the monitoring information communication signal containing the image data of the image of the monitored person and the person position data relating to the position of the person appearing in the image on the image, An image of the image data and a person position indicator representing the position of the person based on the person position data are displayed on the display unit.
  • the sensor device generates person position data relating to the position of the person in the image captured by the image capturing unit, and transmits a monitoring information communication signal that accommodates the person position data.
  • the monitored person monitoring system includes such a sensor device and a terminal device.
  • FIG. 1 It is a figure which shows an example of the monitoring information screen which expanded the area
  • the monitored person monitoring system in the embodiment is a system that monitors a monitored person (watched person) Ob that is a monitored object (watched object) to be monitored (watched).
  • the monitored person monitoring system includes a sensor device and a terminal device connected to the sensor device so as to be communicable, and performs predetermined behavior in a monitored person based on an image captured by the imaging unit. And the detection result is notified to the terminal device.
  • the sensor device in such a monitored person monitoring system includes: a first communication unit that performs communication; an imaging unit that performs imaging; and person position data related to a position in the image of a person captured in an image captured by the imaging unit
  • generated by the said person position processing part by the said 1st communication part is provided.
  • the terminal device in the monitored person monitoring system includes a second communication unit that receives the monitoring information communication signal, a display unit that performs display, and the monitoring information communication signal received by the second communication unit.
  • a detection result and an image of the image data are displayed on the display unit, and a person position indicator indicating the position of the person based on the person position data stored in the monitoring information communication signal is displayed on the display unit.
  • a second monitoring processing unit having a display processing unit for displaying.
  • the monitoring information communication signal may be transmitted directly from the sensor device to the terminal device, or indirectly from the sensor device to the terminal device via another device (for example, the following management server device). May be sent.
  • the said terminal device may be one type of apparatus, in the following description, the said terminal device is two types of apparatuses, a fixed terminal device and a portable terminal device.
  • the main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, while the portable terminal device is operated by being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the mobile terminal device are substantially the same, the mobile terminal device will be mainly described below.
  • FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment.
  • FIG. 2 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system according to the embodiment.
  • FIG. 3 is a diagram for explaining person position data and person position signs in the first mode.
  • FIG. 4 is a diagram for explaining person position data (person area data) and person position signs in the second mode.
  • FIG. 5 is a diagram for explaining person position data (person area data) and person position signs in the third mode.
  • FIG. 6 is a diagram for explaining person position data (person area data) and person position signs in the fourth mode.
  • FIG. 7 is a diagram for explaining person position data (person area data) and person position signs of the fifth aspect.
  • FIG. 8 is a diagram illustrating a configuration of the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • the monitored person monitoring system MS includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, and a fixed terminal device.
  • SP one or more portable terminal devices TA (TA-1, TA-2), and private branch exchange (PBX) CX, which are wired or wireless, LAN (Local Area Network) Or the like via a network (network, communication line) NW.
  • the network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals.
  • the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1, TA-2, and the private branch exchange CX include an L2 switch.
  • a wired / wireless LAN for example, a LAN in accordance with the IEEE 802.11 standard
  • NW including the LS and the access point AP.
  • the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1, TA-2. Is connected to the line concentrator LS via the access point AP.
  • the network NW constitutes a so-called intranet by using Internet protocol groups such as TCP (Transmission control protocol) and IP (Internet protocol).
  • the monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob.
  • the monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like.
  • the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable.
  • the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob.
  • the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.
  • a private branch exchange (line switching unit) CX is connected to the network NW, controls extension calls such as outgoing calls, incoming calls, and calls between the portable terminal devices TA, and performs extension calls between the portable terminal devices TA, and For example, outgoing calls, incoming calls, and calls between the external telephone TL and the mobile terminal device TA are connected to an external telephone TL such as a fixed telephone or a mobile telephone via a public telephone network PN such as a fixed telephone network or a mobile telephone network.
  • This is a device that performs an outside line telephone call between the outside line telephone TL and the portable terminal device TA by controlling the outside line telephone.
  • the private branch exchange CX is, for example, a digital exchange or an IP-PBX (Internet Protocol Private Branch eXchange).
  • the sensor device SU has a communication function that communicates with other devices SV, SP, TA via the network NW, detects a predetermined action in the monitored person Ob, and notifies the management server device SV of the detection result.
  • the sensor device SU when transmitting an image to the terminal devices SP and TA, transmits the person to the terminal devices SP and TA, and the person related to the position of the person in the image on the image. Position data is generated and transmitted to the management server device SV together with the image.
  • such a sensor device SU includes an imaging unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process.
  • Unit (SU control processing unit) 14 sensor-side communication interface unit (SU communication IF unit) 15, and sensor-side storage unit (SU storage unit) 16.
  • the imaging unit 11 is an apparatus that is connected to the SU control processing unit 14 and performs imaging in accordance with the control of the SU control processing unit 14 to generate an image (image data).
  • the image includes a still image (still image data) and a moving image (moving image data).
  • the imaging unit 11 is disposed so as to be able to monitor a space (location space, in the example shown in FIG. 1, where the monitored person Ob that is a monitoring target to be monitored) is located.
  • the space is imaged as an imaging target from above, an image (image data) overlooking the imaging target is generated, and the imaging target image (target image) is output to the SU control processing unit 14.
  • the imaging unit 11 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed).
  • the sensor device SU uses the imaging unit 11 to acquire an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.
  • Such an imaging unit 11 may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place.
  • the imaging unit 11 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface.
  • An image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and image data that represents an infrared image in the imaging target by performing image processing on the output of the image sensor It is a digital infrared camera provided with the image processing part etc. which produce
  • the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 11 is disposed. .
  • the SU sound input / output unit 12 is a circuit that inputs and outputs sound. That is, the SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and generates and outputs a sound corresponding to an electrical signal representing sound according to the control of the SU control processing unit 14. It is a circuit for acquiring the sound of and inputting it into the sensor device SU.
  • the SU sound input / output unit 12 includes, for example, a speaker that converts a sound electrical signal (sound data) into a sound mechanical vibration signal (acoustic signal), and a microphone that converts a sound mechanical vibration signal in the audible region into an electrical signal. And so on.
  • the SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and converts the electric signal input from the SU control processing unit 14 into a sound mechanical vibration signal and outputs the sound. .
  • the nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SU.
  • the nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.
  • the SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication according to the control of the SU control processing unit 14.
  • the SU communication IF unit 15 generates a communication signal containing data to be transferred input from the SU control processing unit 14 in accordance with a communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SV, SP, TA via the network NW.
  • the SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data.
  • the data is converted into data in a proper format and output to the SU control processing unit 14.
  • the SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
  • the SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14.
  • Examples of the various predetermined programs include a SU control program that controls each unit of the sensor device SU according to the function of each unit, and a person related to the position of the person in the image captured by the imaging unit 11 in the image.
  • a person position processing program for generating position data, an image (image data) obtained by detecting a predetermined action in the monitored person Ob and picking up the detection result by the image pickup unit 11, and the person position data generated by the person position processing program
  • the management server device SV is notified of this
  • a nurse call processing program for making a voice call with the terminal devices SP and TA by using the SU sound input / output unit 12 or the like
  • the videos generated by the imaging unit 11, the terminal apparatus SP requested the video, which contains control program of SU streaming processing program for broadcast streaming to TA.
  • the SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like.
  • the SU storage unit 16 includes a RAM (Random Access Memory) that serves as a working memory of the so-called SU control processing unit 14 that stores data generated during the execution of the predetermined program.
  • the SU control processing unit 14 controls each part of the sensor device SU according to the function of each part, detects a predetermined action in the monitored person Ob, and detects the detection result as the image (image data) and the person position data.
  • the management server device SV is notified, the nurse call is accepted, the management server device SV is notified of that, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is generated to generate a terminal.
  • This is a circuit for distributing a moving image to the devices SP and TA.
  • the SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.
  • the SU control processing unit 14 executes a sensor processing unit (SU control unit) 141, a sensor side monitoring processing unit (SU monitoring processing unit) 142, a person position processing unit 143, and a nurse call by executing the control processing program.
  • a processing unit (nurse call processing unit) 144 and a sensor-side streaming processing unit (SU streaming processing unit) 145 are functionally provided.
  • the SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.
  • the SU monitoring processing unit 142 detects a predetermined action (state, situation) set in advance in the monitored person Ob based on the image, and the person generated by the person position processing unit 143 as described above and the person described later. Along with the position data, the management server device SV is notified (notified and transmitted).
  • the predetermined action includes, for example, wake-up when the monitored person Ob occurred, leaving the monitored person Ob away from the bedding, falling down when the monitored person Ob fell from the bedding, And four actions of the fall where the monitored person Ob fell.
  • the SU monitoring processing unit 142 detects the head of the monitored person Ob based on the target image captured by the imaging unit 11, and based on the time change in the size of the detected head of the monitored person Ob. Detects the monitored person's getting up, getting out of bed, falling and falling. More specifically, first, the bedding location area and the first to third threshold values Th1 to Th3 are stored in advance in the SU storage unit 16 as one of the various predetermined data.
  • the first threshold Th1 is a value for discriminating between the size of the head in the lying posture and the size of the head in the sitting posture in the bedding location region.
  • the second threshold Th2 is a value for identifying whether or not the head is in the standing posture in the living room RM excluding the bedding location area.
  • the third threshold Th3 is a value for identifying whether the head is in the lying position in the living room RM excluding the bedding location area.
  • the SU monitoring processing unit 142 uses, for example, a circular or elliptical Hough transform from the extracted moving object region, for example, by pattern matching using a head model prepared in advance, or for example for head detection.
  • the head region of the monitored person Ob is extracted by the neural network learned in step (b).
  • the SU monitoring processing unit 142 detects wakeup, getting out of bed, falling, and falling from the position and size of the extracted head. For example, the SU monitoring processing unit 142 determines that the position of the extracted head is within the bedding location area, and the size of the extracted head uses the first threshold Th1 to determine the size of the lying posture. When the time changes to the size of the sitting posture, it is determined that the user is getting up and the rising is detected.
  • the SU monitoring processing unit 142 is a case where the position of the extracted head changes with time from within the bedding location area to outside the bedding location area, and the size of the extracted head is the second threshold value.
  • the time changes from a certain size to the size of the standing posture by using Th2 it is determined that the user has left the bed and the bed is detected.
  • the SU monitoring processing unit 142 is a case where the position of the extracted head changes over time from the bedding location area to the outside of the bedding location area, and the size of the extracted head is the third threshold value.
  • the time changes from a certain size to the size of the recumbent posture by using Th3 it is determined as a fall and the fall is detected.
  • the SU monitoring processing unit 142 has the extracted head position in the living room RM excluding the bedding location area, and the extracted head size is determined by using the third threshold Th3.
  • the time changes from the size to the size of the recumbent posture it is determined that the vehicle falls and the fall is detected.
  • the moving object area to be extracted as the person area is also within the predetermined size (width, size). It becomes. For this reason, a range to be extracted as a moving body region is preset, and when a moving body region is extracted from the target image, for example, by a background difference method or a frame difference method, The moving object region extracted from the target image by, for example, the background difference method or the frame difference method may be excluded from the moving object region extracted as the person region.
  • the SU monitoring processing unit 142 uses the SU communication IF to detect the detection result, the target image used when obtaining the detection result, and the person position data with respect to the target image.
  • the unit 15 notifies the management server device SV. More specifically, the SU monitoring processing unit 142 is used for detecting the sensor ID of the own device, the detection result (one or more of getting up, getting out of bed, falling, and falling in this embodiment) and the predetermined action.
  • a communication signal (first monitoring information communication signal) containing the target image and person position data for the target image is transmitted to the management server device SV via the SU communication IF unit 15.
  • the image may be at least one of a still image and a moving image.
  • a still image is notified, and the moving image is distributed in response to a user request.
  • a moving image may be distributed, a still image and a moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.
  • the person position data is generated by the person position processing unit 143 as described later, and is stored in the first monitoring information communication signal as metadata in the image data of the target image.
  • the image data and the person position data are accommodated in an Exif (Exchangeable image file format) file.
  • the Exif file is a file conforming to a JPEG (Joint Photographic Experts Group) file format, and so-called Exif information such as shooting conditions is stored in an application marker segment.
  • the person position data is stored in the application marker segment.
  • the image data and the person position data are accommodated as form data in a multipart file in HTTP (Hypertext Transfer Protocol). More specifically, the image data is accommodated as one form data in a multi-part format file, and the person position data is accommodated as another form data in the multi-part format file.
  • the person position processing unit 143 generates person position data regarding the position of the person in the image captured by the image capturing unit 11.
  • the image is the target image used for detecting a predetermined action in the monitored person.
  • the person position data for example, data of the following first to fifth modes can be used.
  • the person position data of the first aspect is the coordinate data of the position of the person in the image itself on the image.
  • the person position processing unit 143 first, like the SU monitoring processing unit 142, for example, a background difference from the target image captured by the imaging unit 11.
  • the moving object region MB is extracted as a person region by the method or the frame difference method.
  • the coordinate data (x, y) is given in the same way as the human position data of the following second to fifth modes, for example, at a pixel position with the upper left vertex of the target image as the coordinate origin.
  • the person position indicator displayed on the mobile terminal device TA is an image of a point represented by the coordinate data (x, y) of the gravity center position P1. HP1.
  • the person position data of the second aspect is person area data relating to the person area including a position of the person in the image (for example, the center of gravity position P1), and the person area data is the person area data.
  • This is coordinate data representing a rectangle including all or part of the area.
  • the person position processing unit 143 extracts the moving object area MB as the person area as described above, and as shown in FIG. A rectangle including all or part of the moving object region MB (for example, a circumscribed rectangle for the moving object region MB) is obtained, and coordinate data representing the obtained rectangle is obtained as person position data (person region data) of the second mode.
  • the coordinate data representing the rectangle includes, for example, coordinate data (x0, y0) and (x1, y1) of both end points P20 and P21 of one diagonal line in the rectangle. Further, for example, the coordinate data representing the rectangle is composed of coordinate data of four vertices in the rectangle (not shown).
  • the person position indicator displayed on the mobile terminal device TA is represented by the person area data (x0, y0) and (x1, y1) as described later.
  • Image that is, a rectangular image (rectangular contour image) HP2.
  • the person position data of the third aspect is person area data relating to the person area including a position of the person in the image (for example, the center of gravity position P1), and the person area data is the person area data. This is coordinate data representing the outline of the area.
  • the person position processing unit 143 extracts the moving object area MB as the person area as described above, and as shown in FIG. A contour line of the moving body region MB is obtained, and coordinate data representing the obtained contour line is obtained as person position data (person region data) of the third mode.
  • the coordinate data representing the contour line of the moving object region MB is coordinate data (x0, y0), (x1, y1), (x1, y1), (P3C) of the vertexes P30, P31, P32,. x2, y2), ..., (xpc, ypc). More specifically, when the moving object region MB has a relatively complicated shape, the number of vertices on the contour line of the moving object region MB is large, and the data given to the person position data in the first monitoring information communication signal There is a possibility that the capacity (for example, the data capacity of several to dozens of coordinate data) is exceeded.
  • the person position processing unit 143 forms a mosaic by combining the pixels constituting the moving object region MB as the person region with a plurality of adjacent pixels, thereby forming the moving object region MB with a plurality of mosaics (
  • the moving object area MB is made into a mosaic).
  • the person position processing unit 143 sequentially increases the size of the mosaic and adjusts the size of the mosaic until the data capacity is equal to or less than the data capacity given to the person position data in the first monitoring information communication signal.
  • the person position indicator displayed on the mobile terminal device TA is the person area data (x0, y0), (x1, y1), (x2) as will be described later. , Y2),..., (Xpc, ypc), that is, an image HP3 of a contour line in a person region.
  • the person position data of the fourth aspect is person area data relating to the person area including the position of the person in the image (for example, the center of gravity position P1), and the person area data is the person area data. Is coordinate data representing a circle including all or part of the area.
  • the person position processing unit 143 extracts the moving object area MB as the person area as described above, and as shown in FIG. A circle including all or part of the moving object region MB (for example, a circumscribed circle for the moving object region MB) is obtained, and coordinate data representing the obtained circle is obtained as person position data (person region data) of the fourth mode.
  • the coordinate data representing the circle includes, for example, coordinate data (x, y) and a radius r of the center point P4 in the circle. Further, for example, the coordinate data representing the circle includes coordinate data (x, y) of the gravity center position P4 in the moving object region MB and a preset radius r.
  • the person position indicator displayed on the mobile terminal device TA is an image represented by the person area data (x, y), r, that is, A circular image (circular contour image) HP4 is obtained.
  • the person position data of the fifth aspect is person area data relating to the person area including a position (for example, the barycentric position P1) of the person shown in the image, and the person area data is the person area data. Coordinate data representing an ellipse including all or part of the region.
  • the person position processing unit 143 extracts the moving object area MB as the person area as described above, and as shown in FIG. An ellipse including all or part of the moving object region MB is obtained, and coordinate data representing the obtained ellipse is obtained as person position data (person region data) of the fifth mode.
  • the person position processing unit 143 provides an appropriate one first set point P51 on the contour line in the moving body region MB as the person region, and the person position processing unit 143 is on the contour line farthest from the first set point P51.
  • a point is obtained as a second set point P53, and a line segment P51P53 connecting the first set point P51 and the second set point P53 is defined as an elliptical long axis.
  • the person position processing unit 143 passes through the center point P50 of the line segment P51P53 connecting the first set point P51 and the second set point P53 as the long axis, and the straight line orthogonal to the line segment P51P53 and the contour
  • the two intersections with the line are obtained, the lengths of each of the obtained two intersections and the center point P50 are obtained, and an intersection giving a longer length is selected from the two intersections as an intersection P52 between the minor axis and the ellipse.
  • the major axis, the minor axis, and the intersection of the major axis and the minor axis are obtained, and an ellipse is obtained.
  • the coordinate data representing the ellipse is, for example, an intersection P50 between the major axis and the minor axis, one intersection (first set point) P51 with the major axis on the ellipse, and one intersection P52 with the minor axis on the ellipse.
  • Coordinate data (x0, y0), (x1, y1), (x2, y2).
  • the coordinate data representing the ellipse includes coordinate data (x0, y0) of an intersection P50 between the major axis and the minor axis, an angle formed by the major axis (or minor axis) and the x axis (or y axis), It consists of the length of the major axis and the length of the minor axis.
  • the person position indicator displayed on the mobile terminal device TA is the person area data (x0, y0), (x1, y1), (x2, y2).
  • the person position processing unit 143 notifies the SU monitoring processing unit 142 of the person position data generated in this way.
  • the person position data of the second mode is used, and the person position processing unit 143 notifies the SU monitoring processing unit 142 of the person position data of the second mode.
  • the nurse call processing unit 144 reports the fact to the management server device SV and uses the SU sound input / output unit 12 or the like to communicate with the terminal devices SP and TA. Voice calls are made between the two. More specifically, when the nurse call reception operation unit 13 is input, the nurse call processing unit 144 stores the sensor ID of the own device and nurse call reception information indicating that the nurse call is received. A 1 nurse call notification communication signal is transmitted to the management server device SV via the SU communication IF unit 15. The nurse call processing unit 144 uses the SU sound input / output unit 12 and the like to perform a voice call with the terminal devices SP and TA, for example, by VoIP (Voice over Internet Protocol).
  • VoIP Voice over Internet Protocol
  • the SU streaming processing unit 145 receives the request from the fixed terminal device SP or the portable terminal device TA.
  • the moving image generated by the imaging unit 11 (for example, a live moving image) is distributed via the SU communication IF unit 15 by streaming reproduction.
  • FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob.
  • the second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob.
  • the third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.
  • the management server device SV has a communication function for communicating with other devices SU, TA, SP via the network NW, and receives the detection result, the target image, and the person position data regarding the monitored person Ob from the sensor device SU.
  • information monitoring information
  • the management server device SV is a correspondence relationship between the notification source sensor device SU (sensor ID) and the notification destination (re-notification destination) terminal device SP, TA (terminal ID) (notification destination correspondence relationship).
  • each device SU, SP, TA each ID
  • the terminal ID is an identifier for identifying and identifying the terminal devices SP and TA.
  • the management server device SV identifies the notification destination terminal devices SP and TA corresponding to the notification source sensor device SU in the received first monitoring information communication signal from the notification destination correspondence relationship, and The second monitoring information communication signal is transmitted to the terminal devices SP and TA.
  • the sensor ID contained in the received first monitoring information communication signal, the detection result, the target image and the person position data, and the received as the download destination of the moving image is accommodated.
  • the communication address is obtained from the communication address correspondence relationship.
  • the management server device SV when the management server device SV receives the first nurse call notification communication signal, the management server device SV is accommodated in the notification source sensor device in the received first nurse call notification communication signal and the received first nurse call notification communication signal. The data is associated with each other and stored (recorded) as monitoring information of the monitored person Ob. Then, the management server device SV identifies the notification destination terminal devices SP and TA corresponding to the notification source sensor device in the received first nurse call notification communication signal from the notification destination correspondence relationship, and A second nurse call notification communication signal is transmitted to the terminal devices SP and TA.
  • the second nurse call notification communication signal includes the sensor ID and nurse call reception information stored in the received first nurse call notification communication signal.
  • the second nurse call notification communication signal may include a communication address corresponding to the sensor device SU having the sensor ID stored in the received first nurse call notification communication signal as a download destination of the moving image.
  • the management server device SV provides the client with data corresponding to the request of the client (terminal device SP, TA, etc. in this embodiment).
  • Such a management server device SV can be configured by, for example, a computer with a communication function.
  • the fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like.
  • the user interface (UI) of the monitored person monitoring system MS is input by inputting predetermined instructions and data to be given to the management server device SV and the portable terminal device TA, or displaying the monitoring information obtained by the sensor device SU. ).
  • Such a fixed terminal device SP can be configured by, for example, a computer with a communication function.
  • the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in this specification, a mobile terminal device TA that is another example of the terminal device will be described.
  • the mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call.
  • a monitoring function (including moving images) obtained from the sensor device SU by inputting a predetermined instruction or data to be provided to the management server device SV or the sensor device SU, or by a report from the management server device SV. This is a device for displaying or answering or calling a nurse call by voice call with the sensor device SU.
  • such a portable terminal device TA includes a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, and A terminal side storage unit (TA storage unit) 33, a terminal side sound input / output unit (TA sound input / output unit) 34, a terminal side input unit (TA input unit) 35, and a terminal side display unit (TA display unit). 36 and a terminal-side interface unit (TAIF unit) 37.
  • the TA communication IF unit 31 is a communication circuit that is connected to the TA control processing unit 32 and performs communication according to the control of the TA control processing unit 32, similarly to the SU communication IF unit 15.
  • the TA communication IF unit 31 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.
  • the TA sound input / output unit 34 is connected to the TA control processing unit 32, and generates and outputs a sound corresponding to an electrical signal representing sound according to the control of the TA control processing unit 32.
  • This is a circuit for acquiring external sound and inputting it to the mobile terminal device TA.
  • the TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a circuit that accepts a predetermined operation and inputs it to the mobile terminal device TA, for example, a plurality of input switches assigned with a predetermined function.
  • the predetermined operation include an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the informed monitored person.
  • an input operation indicating that there is an intention to perform a response (response, response) such as lifesaving, nursing, care, and assistance to “Ob” (“correspond”)
  • an instruction command
  • Various operations necessary for monitoring such as an input operation of an enlarged display instruction that is a command
  • the TA display unit 36 is connected to the TA control processing unit 32, and under the control of the TA control processing unit 32, the predetermined operation content input from the TA input unit 35 and the monitored target MS monitored by the monitored person monitoring system MS.
  • the monitoring information related to the monitoring of the monitoring person Ob for example, the type of the predetermined action detected by the sensor device SU, the image (still image and moving image) of the monitored person Ob, and the person position representing the position of the person based on the person position data
  • a display device such as an LCD (Liquid Crystal Display) and an organic EL display.
  • the TA input unit 35 and the TA display unit 36 constitute a touch panel.
  • the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method.
  • a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36.
  • a user such as a nurse or a caregiver ( When the monitor) touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal device TA as the operation input content of the user. Entered.
  • the TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device according to the control of the TA control processing unit 32.
  • the TAIF unit 37 uses the Bluetooth (registered trademark) standard.
  • An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard are examples of the Bluetooth (registered trademark) standard.
  • the TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32.
  • the various predetermined programs include, for example, a TA control program for controlling each unit of the mobile terminal device TA according to the function of each unit, the detection result received from the sensor device SU via the management server device SV, Sensor information is stored by recording (recording) monitoring information relating to monitoring of the monitored person Ob, such as the nurse call, and using the TA monitoring processing program for displaying the detection result and the nurse call, the TA sound input / output unit 34, and the like.
  • Control processing program such as a TA call processing program for making a voice call with the SU and a streaming processing program for receiving the distribution of the moving image from the sensor device SU and displaying the distributed moving image on the TA display unit 36 by streaming playback Is included.
  • the TA monitoring processing program the detection result and the image data stored in the second monitoring information communication signal are displayed on the TA display unit 36, and the person based on the person position data stored in the second monitoring information communication signal is displayed.
  • a display processing program for displaying the position indicator in the image displayed on the TA display unit 36 is included.
  • the TA storage unit 33 includes, for example, a ROM and an EEPROM.
  • the TA storage unit 33 includes a RAM serving as a working memory for the so-called TA control processing unit 32 that stores data generated during execution of the predetermined program.
  • the TA storage unit 33 functionally includes a terminal-side monitoring information storage unit (TA monitoring information storage unit) 331 for storing the monitoring information.
  • the TA monitoring information storage unit 331 stores monitoring information of the monitored person Ob transmitted / received to / from each of the devices SV, SP, and SU. More specifically, in the present embodiment, the TA monitoring information storage unit 331 includes, as the monitoring information, the sensor ID, the detection result, the target image, and the sensor ID that are accommodated in the second monitoring information communication signal received from the management server device SV.
  • the second nurse call notification communication received from the management server device SV is stored in association with the communication address of the sensor device SU to which the person position data and video are downloaded, the reception time of the second monitoring information communication signal, and the like.
  • the sensor ID and nurse call reception information accommodated in the signal, the reception time of the second nurse call notification communication signal, and the like are stored in association with each other.
  • the TA control processing unit 32 is a circuit for controlling each unit of the mobile terminal device TA according to the function of each unit, receiving and displaying the monitoring information for the monitored person Ob, and answering or calling a nurse call. It is.
  • the TA control processing unit 32 includes, for example, a CPU and its peripheral circuits.
  • the TA control processing unit 32 executes a terminal processing unit (TA control unit) 321, a terminal side monitoring processing unit (TA monitoring processing unit) 322, a call processing unit 323, and a terminal side streaming process by executing a control processing program.
  • Unit (TA streaming processing unit) 324 functionally.
  • the TA monitoring processing unit 322 functionally includes a display processing unit 3221.
  • the TA control unit 321 controls each part of the mobile terminal apparatus TA according to the function of each part, and controls the entire mobile terminal apparatus TA.
  • the TA monitoring processing unit 322 stores (records) monitoring information related to monitoring of the monitored person Ob such as the detection result or the nurse call received from the sensor device SU via the management server device SV. A nurse call is displayed. More specifically, when the TA monitoring processing unit 322 receives the second monitoring information communication signal from the management server device SV, the TA monitoring processing unit 322 displays the monitoring information of the monitored person Ob contained in the received second monitoring information communication signal. Store (record) in the TA monitoring information storage unit 331. The TA monitor processor 322 causes the display processor 3221 to display a screen corresponding to each piece of information contained in the received second monitor information communication signal on the TA display 36.
  • the display processing unit 3221 displays the detection result and the target image accommodated in the received second monitoring information communication signal on the TA display unit 36, and accommodates in the received second monitoring information communication signal.
  • a person position indicator based on the person position data thus displayed is displayed in the target image displayed on the TA display unit 36.
  • the display processing unit 3221 receives the enlarged display instruction from the TA input unit 35, the display processing unit 3221 enlarges the size of the person's area being displayed on the TA display unit 36, and Display area.
  • the TA monitoring processing unit 322 receives the second nurse call notification communication signal from the management server device SV, the TA monitoring processing unit 322 stores the monitoring information of the monitored subject Ob contained in the received second nurse call notification communication signal.
  • the TA monitor processing unit 322 displays a nurse call reception screen pre-stored in the TA storage unit 33 on the TA display unit 36 according to the nurse call reception information accommodated in the received second nurse call notification communication signal. . Then, when receiving a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process corresponding to the input operation.
  • the call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 or the like. More specifically, the call processing unit 323 uses the TA sound input / output unit 34 and the like, and the notification source sensor device SU that has transmitted the first monitoring information communication signal and the first nurse call notification communication signal to the management server device SV. In addition, a voice call is performed, for example, by VoIP with the sensor device SU or the like selected and designated by the user (monitor) of the mobile terminal device TA.
  • the TA streaming processing unit 324 receives the distribution of the moving image from the sensor device SU, and displays the distributed moving image on the TA display unit 36 by streaming reproduction.
  • Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.
  • the TA input unit 35 and the TA display unit 36 constituting the touch panel have an instruction input unit (first instruction input unit) that receives an enlarged display instruction that is an instruction to enlarge and display a person shown in the image. ) And an example of a second instruction input unit that receives an operation instruction that is an instruction to perform a predetermined operation.
  • first instruction input unit receives an enlarged display instruction that is an instruction to enlarge and display a person shown in the image.
  • second instruction input unit that receives an operation instruction that is an instruction to perform a predetermined operation.
  • FIG. 9 is a flowchart illustrating an operation related to monitoring information of the sensor device in the monitored person monitoring system according to the embodiment.
  • FIG. 10 is a flowchart illustrating an operation related to monitoring information of the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 11 is a diagram illustrating an example of a standby screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 12 is a diagram illustrating an example of a monitoring information screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 13 is a diagram illustrating an example of a monitoring information screen in which a person's area is enlarged, which is displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • each device SU, SV, SP, TA performs initialization of each necessary part and starts its operation when the power is turned on.
  • the SU control processing unit 14 includes the SU control unit 141, the SU monitoring processing unit 142, the person position processing unit 143, the nurse call processing unit 144, and the SU streaming processing unit 145. Functionally configured.
  • the TA control processing unit 32 is functionally configured with a TA control unit 321, a TA monitoring processing unit 322, a call processing unit 323, and a TA streaming processing unit 324.
  • a display processing unit 3221 is functionally configured in the TA monitoring processing unit 322.
  • the operation of the sensor device SU will be described.
  • the sensor device SU operates as follows for each frame or every several frames, thereby detecting a predetermined operation in the monitored person Ob and determining whether or not a nurse call is accepted.
  • the sensor device SU acquires an image (image data) for one frame from the imaging unit 11 as the target image by the SU control unit 141 of the SU control processing unit 14 (S11).
  • the sensor device SU performs a behavior detection process for detecting a predetermined behavior in the monitored person Ob by the SU monitoring processing unit 142 of the SU control processing unit 14 based on the acquired target image (S12).
  • the sensor device SU determines whether or not a predetermined behavior in the monitored person Ob is detected by the SU monitoring processing unit 142 in the behavior detection processing S12. As a result of this determination, when the action is not detected (No), the sensor device SU next executes the process S16, while when the action is detected (Yes), the sensor device SU The device SU executes step S16 after sequentially executing the next step S14 and step S15.
  • the sensor apparatus SU uses the person position processing unit 143 of the SU control processing unit 14 to generate person position data related to the position of the person in the acquired target image in the image.
  • the person position data may be any of the person position data in the first to fifth aspects described above. In the present embodiment, for example, the person position data in the second aspect is employed.
  • the person position processing unit 143 first extracts the moving object region MB as a person region from the acquired target image by, for example, the background difference method or the frame difference method.
  • the person position processing unit 143 acquires the moving object area MB extracted by the SU monitoring processing unit 142 in the process S12 from the SU monitoring processing unit 142.
  • the person position processing unit 143 obtains a rectangle that includes all or part of the moving object area MB, and obtains coordinate data representing the obtained rectangle as person position data (person area data).
  • the coordinate data representing the rectangle includes, for example, coordinate data of both end points of one diagonal line in the rectangle (P20 (x0, y0), P21 (x1, y1) in the example shown in FIG. 4)).
  • the person position processing unit 143 notifies the SU monitoring processing unit 142 of the obtained person position data (person area data).
  • the person position data may be a plurality corresponding to each of the plurality of moving object regions MB.
  • the sensor apparatus SU performs the SU monitoring process in order to notify the predetermined action detected in the processes S12 and S13 to the predetermined terminal apparatuses SP and TA via the management server apparatus SV.
  • the unit 142 transmits the first monitoring information communication signal to the management server device SV.
  • the SU monitoring processing unit 142 is a first monitoring information communication signal that contains its own sensor ID, the detection result, the target image, and the person position data (rectangular person area data in this example). Is transmitted to the management server device SV via the SU communication IF unit 15. Therefore, the first monitoring information communication signal for notifying the detection result includes the target image as the image of the monitored person Ob together with the detection result, and the person position data related to the position of the person shown in the target image is the target. Included with the image.
  • the sensor device SU determines whether or not the nurse call is accepted by the nurse call processing unit 144 of the SU control processing unit 14. That is, the processes S11 to S17 shown in FIG. 9 are repeatedly executed for each frame or every several frames, but during the period from the previous execution of the process S16 to the current execution of the process S16, It is determined whether or not the call reception operation unit 13 has been operated. As a result of this determination, when the nurse call reception operation unit 13 is not operated and the nurse call is not received (No), the sensor device SU ends the current process, while the nurse call reception operation unit 13 Is operated and the nurse call is accepted (Yes), the sensor device SU ends the present process after executing the next process S17.
  • the sensor device SU performs the first call by the nurse call processing unit 144.
  • a nurse call notification communication signal is transmitted to the management server device SV. More specifically, the nurse call processing unit 144 transmits a first nurse call notification communication signal containing the sensor ID of the own device and nurse call reception information to the management server device SV via the SU communication IF unit 15. .
  • the sensor device SU operates as described above with respect to detection of a predetermined action and reception of a nurse call in the monitored person Ob.
  • the management server device SV When receiving the first monitoring information communication signal from the sensor device SU via the network NW, the management server device SV receives the sensor ID, the determination result, the target image, and the person position data (this book) contained in the first monitoring information communication signal. In the embodiment, rectangular person area data) is stored (recorded) as monitoring information of the monitored person Ob monitored by the sensor device SU having this sensor ID. Then, the management server device SV identifies the notification destination terminal devices SP and TA corresponding to the notification source sensor device SU in the received first monitoring information communication signal from the notification destination correspondence relationship, and The second monitoring information communication signal is transmitted to the terminal devices SP and TA.
  • the management server device SV when the management server device SV receives the first nurse call notification communication signal from the sensor device SU via the network NW, the management server device SV obtains the sensor ID, nurse call reception information, etc. accommodated in the first nurse call notification communication signal, The information is stored (recorded) as monitoring information of the monitored person Ob monitored by the sensor device SU having this sensor ID. Then, the management server device SV identifies the notification destination terminal devices SP and TA corresponding to the notification source sensor device SU in the received first nurse call notification communication signal from the notification destination correspondence relationship, and this notification destination The second nurse call notification communication signal is transmitted to the terminal devices SP and TA.
  • the fixed terminal device SP and the mobile terminal device TA When the fixed terminal device SP and the mobile terminal device TA receive the second monitoring information communication signal from the management server device SV via the network NW, the fixed terminal device SP and the portable terminal device TA relate to monitoring the monitored person Ob accommodated in the second monitoring information communication signal.
  • the monitoring information is displayed. The operation of displaying the monitoring information by the mobile terminal device TA will be described in detail below.
  • the sensor ID contained in the second nurse call notification communication signal is received. It is displayed that a nurse call has been received from the monitored person Ob monitored by the sensor device SU.
  • the monitored person monitoring system MS detects a predetermined action in each monitored person Ob roughly by each sensor device SU, management server device SV, fixed terminal device SP, and portable terminal device TA. Each monitored person Ob is monitored.
  • the portable terminal device TA accepts a login operation by a monitor (user) such as a nurse or a caregiver, and the display process of the TA monitor processing unit 322 is performed.
  • a standby screen waiting for a communication signal addressed to the own device is displayed on the TA display unit 36.
  • the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating that the user is waiting (for example, “no notification”) and an icon.
  • the menu bar area 511 is provided with an off-hook button 5111 for inputting an instruction for an extension call with another mobile terminal device TA or an outgoing call with an external telephone TL.
  • the portable terminal device TA determines whether or not the TA communication IF unit 31 has received a communication signal by the TA control unit 321 of the TA control processing unit 32 (S21). If the result of this determination is that a communication signal has not been received (No), the portable terminal device TA returns the processing to S21. If the result of the determination is that a communication signal has been received (Yes), The portable terminal device TA executes the following process S22. That is, the mobile terminal device TA is waiting for reception of a communication signal.
  • the portable terminal device TA determines the type of the received communication signal by the TA control unit 321. As a result of this determination, when the received communication signal is the second monitoring information communication signal (second monitoring information), the portable terminal device TA performs the following processing S23 and processing S24 in sequence and then processing S27. When the received communication signal is the second nurse call notification communication signal (second NC notification), the process S27 and the process S26 are sequentially executed, and then the process S27 is executed. When the communication signal is not the second monitoring information communication signal and the second nurse call notification communication signal (others), the process is performed after executing the process S29 for performing an appropriate process according to the communication signal received in the process S21. finish.
  • the received communication signal is the second monitoring information communication signal (second monitoring information)
  • the portable terminal device TA performs the following processing S23 and processing S24 in sequence and then processing S27.
  • the process S27 and the process S26 are sequentially executed, and then the process S27 is executed.
  • the communication signal is not the second monitoring information communication signal and the second
  • the portable terminal device TA monitors the monitored person Ob contained in the second monitoring information communication signal received from the management server apparatus SV in the process S21 by the TA monitoring processing unit 322 of the TA control processing unit 32. Is stored (recorded) in the TA monitoring information storage unit 331.
  • the TA monitoring processing unit 322 displays, for example, the monitoring information shown in FIG.
  • the screen 52 is displayed on the TA display unit 36 (S24).
  • the monitoring information screen 52 is a screen for displaying the monitoring information related to the monitoring of the monitored person Ob.
  • the monitoring information screen 52 includes a menu bar area 511 and an arrangement location of the sensor device SU having the sensor ID accommodated in the second monitoring information communication signal received in the process S21.
  • the monitored person name area 521 for displaying the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and the reception time of the second monitoring information communication signal received in the process S21 (or the predetermined action) Detection time), a detection information display area 522 for displaying the detection result accommodated in the second monitoring information communication signal received in step S21, and a second monitoring information communication signal received in step S21.
  • the TA storage unit 33 In order to display the installation location of the sensor device SU and the name of the monitored subject Ob in the monitored person name area 521, the TA storage unit 33 displays the installation location of the sensor device SU having the sensor ID and the sensor ID. And the name of the monitored person Ob monitored by the sensor device SU having the sensor ID is stored in advance in association with each other.
  • the detection results (names of getting up, getting out of bed, falling down, and falling down in this embodiment) contained in the second monitoring information communication signal received in step S21 may be displayed as they are.
  • the detection result is displayed as an icon that symbolically represents the detection result.
  • the TA storage unit 33 stores each action and an icon representative of the action in association with each other in advance.
  • the detection information display area 522 displays a wake-up icon that symbolizes wake-up.
  • a person position indicator HP2 based on the person position data is displayed in the target image being displayed.
  • the bedding BD and the monitored person Ob are shown in the target image.
  • the person position data accommodated in the second monitoring information communication signal received in step S21 is rectangular person area data, and the display processing unit 3221 displays the upper left in the front view of the target image being displayed.
  • a rectangular image HP2 represented by person area data (here, each coordinate data (x0, y0), (x1, y1) of both end points of a diagonal line) with a vertex as a coordinate origin, an object being displayed as a person position indicator HP2 Display it superimposed on the image.
  • the region surrounded by the person position indicator HP2 is for inputting the enlarged display instruction, which is an instruction to enlarge and display the person shown in the target image being displayed, to the mobile terminal device TA. It is a button.
  • the display processing unit 3221 may display an image in the person's area by a second display method different from the display method of the target image (first display method).
  • the first display method is normal display
  • the second display method is mosaic display
  • the display processing unit 3221 uses the image in the rectangular person position mark HP as the image in the person area.
  • An image outside the rectangular person position sign HP is displayed as usual, and the image inside the rectangular person position sign HP is displayed in a mosaic manner.
  • the first display method is color display
  • the second display method is monochrome display (single color display)
  • the display processing unit 3221 displays the image in the rectangular person position mark HP as the region of the person.
  • the inside image an image outside the rectangular person position sign HP is displayed in color
  • an image inside the rectangular person position sign HP is displayed in monochrome.
  • the first display method is monochrome display
  • the second display method is color display
  • the display processing unit 3221 uses the image in the rectangular person position mark HP as an image in the person area.
  • An image outside the rectangular person position sign HP is displayed in monochrome
  • an image inside the rectangular person position sign HP is displayed in color.
  • the first display method is positive display
  • the second display method is negative display
  • the display processing unit 3221 uses the image in the rectangular person position marker HP as the image in the person area.
  • An image outside the rectangular person position sign HP is displayed in a positive manner, and an image inside the rectangular person position sign HP is displayed in a negative form.
  • the first display method is negative display
  • the second display method is positive display
  • the display processing unit 3221 uses the image in the rectangular person position mark HP as the image in the person area.
  • the image outside the rectangular person position sign HP is displayed as a negative
  • the image inside the rectangular person position sign HP is displayed as a positive.
  • the “corresponding” button 524 has an intention to perform a predetermined response (response, response) such as lifesaving, nursing, care, and assistance for the detection result displayed on the monitoring information screen 52. It is a button for inputting execution intention information indicating that the user of the mobile terminal device TA is present to the mobile terminal device TA.
  • the “speak” button 525 is a button for requesting a voice call, and is used to input an instruction to connect the sensor device SU of the sensor ID and the mobile terminal device TA via the network NW. It is a button.
  • the “LIVE” button 526 is a button for requesting a live video, and is a button for inputting an instruction to display a video captured by the sensor device SU of the sensor ID.
  • the portable terminal device TA is accommodated in the second nurse call notification communication signal received from the management server apparatus SV in the process S21 by the TA monitoring processing unit 322 of the TA control processing unit 32.
  • the monitoring information related to the monitoring of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331.
  • the TA monitoring processing unit 322 performs a nurse call stored in advance in the TA storage unit 33 in accordance with the nurse call reception information accommodated in the second nurse call notification communication signal received in the processing S21.
  • An unillustrated nurse call acceptance screen indicating acceptance is displayed on the TA display unit 36 (S26).
  • portable terminal device TA performs input operation with the touch panel which comprises TA input part 35 and TA display part 36 by TA control process part 32. It is determined whether or not it has been accepted. If the input operation is not accepted as a result of the determination (No), the portable terminal device TA returns the process to step S27. On the other hand, if the input operation is accepted as a result of the determination, the portable terminal TA The apparatus TA executes the next process S28.
  • the portable terminal device TA performs an appropriate process according to the content of the input operation by the TA control processing unit 32, and ends this process.
  • the portable terminal device TA performs an input operation (for example, a tap operation) of an area surrounded by the person position marker HP2 that also functions as a button for inputting an enlarged display instruction by the TA control processing unit 32.
  • the display processing section 3221 displays the person area enlarged in size than the area of the person currently displayed on the TA display section 36.
  • the area surrounded by the person position mark HP2 shown in FIG. 12 is enlarged about four times (doubled in each of the vertical and horizontal directions), and the area surrounded by the person position mark HPE shown in FIG. Is displayed.
  • the pixel value of a pixel generated by enlargement is generated by interpolating from the pixel value of a pixel adjacent thereto, for example. Since the person area is enlarged and displayed in this manner, the user (monitoring person) of the portable terminal device TA can easily find the monitored person Ob in the image, and can easily recognize the state of the monitored person Ob in the image. .
  • the portable terminal device TA when the TA control processing unit 32 receives an input operation of the “corresponding” button 524 (that is, when the corresponding intention is received), the portable terminal device TA is currently displaying on the TA display unit 36.
  • the monitoring information of the monitored person Ob is stored in the TA monitoring information storage unit 331 with the indication that “corresponding” has been received, and corresponds to the monitoring information of the monitored person Ob displayed on the TA display unit 36.
  • a communication signal (correspondence acceptance notification communication signal) containing information indicating that the sensor ID and “corresponding” are accepted (correspondence acceptance information) is transmitted to the management server device SV.
  • the management server device SV that has received the correspondence reception notification communication signal broadcasts the communication signal (correspondence reception well-known communication signal) containing the sensor ID and the correspondence reception information contained in the received correspondence reception notification communication signal. Transmit to the terminal devices SP and TA. As a result, regarding the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36, the fact that “corresponding” has been received is synchronized between the terminal devices SP and TA.
  • the call processing unit 323 monitors the monitored person Ob displayed on the TA display unit 36.
  • a communication signal (call request communication signal) containing information such as requesting a voice call is transmitted to the sensor device SU, and the sensor device SU is connected to the sensor device SU via the network NW so as to be able to make a voice call.
  • a voice call can be made between the mobile terminal device TA and the sensor device SU.
  • the portable terminal device TA When the TA control processing unit 32 receives an input operation of an “end” button (not shown) that is a button for inputting an instruction to end a voice call, the portable terminal device TA causes the TA processing unit 323 to A communication signal (call end communication signal) containing information such as a request to end the voice call is transmitted to the sensor device SU that monitors the monitored person Ob displayed on the display unit 36. Thereby, the voice call between the mobile terminal device TA and the sensor device SU is terminated.
  • an “end” button not shown
  • a communication signal call end communication signal
  • the TA streaming processing unit 324 displays the monitored object currently displayed on the TA display unit 36.
  • a communication signal video distribution request communication signal
  • the video is connected to be downloadable via the sensor device SU, receives live video distribution from the sensor device SU, and displays the distributed video on the TA display unit 36 by streaming playback.
  • the video is displayed in the image area 523 instead of the still image, and the “live end” button (not shown) is displayed instead of the “view live” button 526. .
  • live video is displayed on the mobile terminal device TA.
  • the “live end” button (not shown) is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image picked up by the sensor device SU of the sensor ID and ends (stops) the display. This is a button for inputting an instruction to be performed.
  • the portable terminal device TA monitors the monitored person Ob currently displayed on the TA display unit 36 by the TA streaming processing unit 324.
  • a communication signal (moving image distribution end communication signal) containing information such as requesting the end of moving image distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit 36. Accordingly, the mobile terminal device TA ends the live video display.
  • the mobile terminal device TA operates as described above regarding the detection results received from the sensor device SU via the management server device SV and each notification (re-notification of each nurse call reception).
  • the monitored person monitoring system MS, the terminal device SP, TA, and the display method implemented therein according to the present embodiment are based on the first monitoring information communication signal received by the TA communication IF unit 31. 2
  • the image of the image data accommodated in the monitoring information communication signal is displayed on the TA display unit 36, and the person position indicator HP2 based on the person position data accommodated in the second monitoring information communication signal is displayed on the TA display unit.
  • a display processing unit 3221 for displaying in an image is provided. Therefore, in the monitored person monitoring system MS, the terminal devices SP and TA, and the display method, the person position indicator HP2 is displayed in the image being displayed, so that the user (monitorer) displays the person position indicator HP2.
  • the monitored person Ob in the image can be found with the clue, and the monitored person Ob in the image can be easily found. Since the sensor device SU in the present embodiment accommodates not only images but also person position data (person area data in the present embodiment) in the first monitoring information communication signal, the terminal device SP that has received the second monitoring information communication signal. TA can display the person position sign HP2 on the displayed image. Therefore, as described above, the users of the terminal devices SP and TA can find the monitored person Ob in the image using the person position indicator HP2 as a clue, and can easily find the monitored person Ob in the image.
  • person position data person area data in the present embodiment
  • buttons for inputting an operation instruction which is an instruction for performing a predetermined operation, such as a “corresponding” button 524, a “speak” button 525, and a “watch live” button 526 to the mobile terminal device TA, are displayed in the image area.
  • an operation instruction which is an instruction for performing a predetermined operation, such as a “corresponding” button 524, a “speak” button 525, and a “watch live” button 526 to the mobile terminal device TA.
  • FIG. 14 is a diagram illustrating an example of a monitoring information screen in which a person area and a “corresponding” button overlap each other displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 15 is a diagram illustrating an example of a monitoring information screen that displays a person area at the center position of an image display area, which is displayed on the mobile terminal device in the monitored person monitoring system of the embodiment.
  • FIG. 16 is a diagram illustrating an example of a monitoring information screen that is displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment and displays a person region and a “corresponding” button so as not to overlap each other.
  • the display processing unit 3221 has a center position SC of the image area 523 for displaying the target image on the TA display unit 36 and a position HPC of the person appearing in the target image on the target image.
  • the position HPC is, for example, the barycentric position P1 in the moving object region MB.
  • the position HPC is a position of an intersection of diagonal lines in the rectangle.
  • the position HPC is a center point in the circle.
  • the position HPC is the position of the intersection of the major axis and the minor axis in the ellipse. More specifically, the pixel position (coordinate data) of the center position SC is stored in advance in the TA storage unit 33, and the display processing unit 3221 stores the pixel position in the TA storage unit 33, for example, as shown in FIG.
  • the display positions of the target image and the person position indicator HP are adjusted so that the position HPC (in this example, the position of the intersection of diagonal lines in a rectangle) is positioned at the pixel position of the center position SC. Is displayed on the TA display unit 36. According to this, since the user (monitoring person) of the portable terminal device TA has only to watch the center position of the image area 523, it becomes easy to find the monitored person Ob in the image.
  • the display processing unit 3221 inputs an operation instruction, which is an instruction for performing a predetermined operation, to the remaining area excluding the person area in the display area of the TA display unit 36.
  • the button for displaying Preferably, the display processing unit 3221 displays the button in a remaining area excluding the person area in the image area 523 for displaying the target image on the TA display unit 36.
  • the button is displayed in the image area 523, as shown in FIG. 14, for example, a button corresponding to a part of the person's area (the area in the person position indicator HP2 in the example shown in FIG. 14) In the case where it overlaps with 524, the display processing unit 3221, as shown in FIG.
  • a “corresponding” button 524 is displayed in the area. Since the display positions of the buttons such as the “corresponding” button 524, the “speak” button 525, and the “view live” button 526 are preset, an area where the person area overlaps the button is It is known in advance. For this reason, the remaining area excluding the person area can be predicted and stored in the TA storage unit 33 in advance.
  • the display processing unit 3221 may display the button in the remaining area stored in advance in the TA storage unit 33 when all or part of the person's area overlaps the button. According to this, the person's area is not hidden by the button, and the user (monitoring person) of the mobile terminal device TA can easily find the monitored person Ob in the image.
  • the terminal device receives a monitoring information communication signal containing image data of an image of a monitored person to be monitored and person position data relating to a position of the person shown in the image on the image.
  • An image of the image data accommodated in the monitoring information communication signal received by the communication unit is displayed on the display unit, and based on the person position data accommodated in the monitoring information communication signal
  • a display processing unit for displaying a person position indicator representing the position of the person in an image displayed on the display unit.
  • the person position data is accommodated in the monitoring information communication signal as metadata of the image data.
  • the image data and the person position data are accommodated in an Exif (Exchangeable image file format) file.
  • the image data and the person position data are accommodated as form data in a multipart format file in HTTP (Hypertext Transfer Protocol).
  • the person position data is person area data of the person area including a position on the image of the person shown in the image.
  • the person position data is person area data relating to the person area including a position of the person in the image on the image, and the person area data is the person area data.
  • coordinate data representing any one of a rectangle, a circle, and an ellipse including all or a part thereof
  • the person position indicator is an image represented by the person region data.
  • the person position data is person area data relating to the person area including a position of the person in the image on the image, and the person area data is the person area data.
  • the person position marker is an image represented by the person area data.
  • Such a terminal device displays an image of the image data contained in the monitoring information communication signal received by the communication unit on the display unit, and determines the position of the person based on the person position data contained in the monitoring information communication signal.
  • a display processing unit is provided for displaying the person position sign to be displayed in the image displayed on the display unit. Therefore, since the person position sign is displayed in the displayed image in the terminal device, the user of the terminal device can find the person to be monitored in the image using the person position sign as a clue. Makes it easier to find the person being monitored.
  • the person position data is person area data related to the person area including a position of the person in the image on the image
  • the person position indicator is The image is represented by person area data
  • the display processing unit displays an image in the person area by a second display method different from the image display method.
  • the second display method is a method of displaying an image in the area of the person in a mosaic.
  • the image display method is a method of displaying the image in color or monochrome
  • the second display method is an image in the person's area in monochrome or color. How to display.
  • the display method of the image is a method of displaying the image positively or negatively
  • the second display method is a method of displaying the image in the person area negatively or positively. How to display.
  • the display processing unit displays the image in the person's area by a second display method different from the image display method (first display method). For this reason, the user of the terminal device can easily find the person's area in the image, in other words, the monitored person in the image.
  • the display processing unit includes a central position of an image display area for displaying the image on the display unit, and a position on the image of a person appearing in the image.
  • the image and the person position indicator are displayed on the display unit so that they coincide with each other.
  • Such a terminal device displays a person position indicator at the center position of the image display area by the display processing unit. For this reason, since the user of the said terminal device should just watch the center position of an image display area, it becomes easy to find the to-be-monitored person in an image.
  • the above-described terminal device further includes an instruction input unit that receives an enlarged display instruction that is an instruction for enlarging and displaying the person shown in the image, and the person position data is the person shown in the image
  • the person area data relating to the person area including the position on the image, the person position indicator is an image represented by the person area data
  • the display processing unit is the instruction input unit
  • Such a terminal device further includes an instruction input unit, and when the display processing unit accepts an enlarged display instruction by the instruction input unit, the terminal device expands more than the size of the area of the person being displayed on the display unit. Display the person area. Therefore, since the area of the person is enlarged and displayed, the user of the terminal device can easily find the person to be monitored in the image.
  • the above-described terminal device further includes a second instruction input unit that receives an operation instruction that is an instruction to perform a predetermined operation, and the second instruction input unit forms a touch panel with the display unit
  • the person position data is person area data relating to the person area including the position of the person in the image on the image
  • the person position indicator is the person position indicator.
  • the display processing unit displays the button in a remaining area excluding the person area in the display area of the display unit.
  • the display processing unit displays the button in a remaining area excluding the person area in the image display area for displaying the image on the display unit.
  • the display processing unit displays a button for receiving an operation instruction in the remaining area excluding the person area. For this reason, the region of the person is not hidden by the button, and the user of the terminal device can easily find the monitored person in the image.
  • a display method for a terminal device in which monitoring data communication that stores image data of an image of a monitored person to be monitored and person position data relating to a position of a person appearing in the image on the image
  • a receiving step for receiving the signal, and an image of the image data accommodated in the monitoring information communication signal received in the receiving step is displayed on a display unit for displaying, and the person position data accommodated in the monitoring information communication signal is displayed.
  • Such a display method of the terminal device displays an image of the image data accommodated in the monitoring information communication signal received in the receiving step on the display unit, and the person based on the person position data accommodated in the monitoring information communication signal
  • a sensor device includes a communication unit that performs communication, an imaging unit that performs imaging, and a person position process that generates person position data related to the position of the person in the image captured by the imaging unit in the image And a monitoring processing unit that transmits the image data of the image captured by the imaging unit and the monitoring information communication signal that stores the person position data generated by the person position processing unit by the communication unit.
  • Such a sensor device accommodates not only the image but also the person position data in the monitoring information communication signal, so that the terminal device that has received the monitoring information communication signal can display the person position indicator on the displayed image. Therefore, the user of the terminal device can find the monitored person in the image using the person position sign as a clue, and can easily find the monitored person in the image.
  • a monitored person monitoring system includes the above-described sensor device and any one of the above-described terminal devices.
  • Such a monitored person monitoring system includes the above-described sensor device and any one of the above-described terminal devices, it is easy to find the monitored person in the image.
  • a terminal device a display method for the terminal device, a sensor device, and a monitored person monitoring system can be provided.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Nursing (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Alarm Systems (AREA)
  • Emergency Alarm Devices (AREA)
  • Accommodation For Nursing Or Treatment Tables (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Telephonic Communication Services (AREA)
  • Telephone Function (AREA)

Abstract

L'invention concerne un dispositif terminal et un procédé d'affichage associé faisant appel à la réception d'un signal de communication d'informations de surveillance contenant des données d'image d'une image d'une personne à surveiller et des données de position de personne relatives à une position, dans l'image, de la personne de l'image, et l'affichage, sur une unité d'affichage, de l'image des données d'image et d'un marqueur de position de personne indiquant la position de la personne sur la base des données de position de personne dans l'image. Un dispositif capteur génère des données de position de personne relatives à une position, dans une image, d'une personne de l'image prise par une unité de capture d'image, et transmet un signal de communication d'informations de surveillance contenant les données générées. L'invention concerne également un système de surveillance de personne à surveiller pourvu du dispositif capteur et du dispositif terminal décrits ci-dessus.
PCT/JP2017/002079 2016-02-15 2017-01-23 Dispositif terminal, procédé d'affichage pour dispositif terminal, dispositif capteur et système de surveillance de personne à surveiller WO2017141629A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018500001A JP6804510B2 (ja) 2016-02-15 2017-01-23 検知システムおよび検知システムの表示方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016025856 2016-02-15
JP2016-025856 2016-02-15

Publications (1)

Publication Number Publication Date
WO2017141629A1 true WO2017141629A1 (fr) 2017-08-24

Family

ID=59624976

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/002079 WO2017141629A1 (fr) 2016-02-15 2017-01-23 Dispositif terminal, procédé d'affichage pour dispositif terminal, dispositif capteur et système de surveillance de personne à surveiller

Country Status (2)

Country Link
JP (2) JP6804510B2 (fr)
WO (1) WO2017141629A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102484784B1 (ko) * 2022-04-19 2023-01-04 김종환 네가티브 촬영 방식의 호흡 감지 응급 알림 시스템

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010157119A (ja) * 2008-12-26 2010-07-15 Fujitsu Ltd 監視装置、監視方法、及び監視プログラム
JP2013206012A (ja) * 2012-03-28 2013-10-07 Nippon Telegraph & Telephone West Corp 監視システム、及び監視方法
JP2014166197A (ja) * 2013-02-28 2014-09-11 Nk Works Co Ltd 情報処理装置、情報処理方法、及び、プログラム
WO2015011591A1 (fr) * 2013-07-22 2015-01-29 Koninklijke Philips N.V. Surveillance continue automatique de mouvements de patient

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001145101A (ja) * 1999-11-12 2001-05-25 Mega Chips Corp 人物画像圧縮装置
JP3979902B2 (ja) * 2001-08-30 2007-09-19 株式会社日立国際電気 監視映像配信システムおよび監視映像配信方法
JP4718950B2 (ja) * 2005-09-26 2011-07-06 Ｎｅｃカシオモバイルコミュニケーションズ株式会社 画像出力装置及びプログラム
JP2007150702A (ja) * 2005-11-28 2007-06-14 Keakomu:Kk ナースコール装置
JP5270962B2 (ja) * 2008-05-29 2013-08-21 京セラ株式会社 動作検出システム
JP2010237873A (ja) * 2009-03-30 2010-10-21 Sogo Keibi Hosho Co Ltd 姿勢変化検出装置、姿勢変化検出方法、及び姿勢変化検出プログラム
JP2011138178A (ja) * 2009-12-25 2011-07-14 Takenaka Komuten Co Ltd 発光装置、不審者検出システムおよびプログラム
JP5672183B2 (ja) * 2011-07-15 2015-02-18 富士通株式会社 情報処理装置、情報処理方法、および情報処理プログラム
JP5953673B2 (ja) * 2011-08-11 2016-07-20 日本電気株式会社 行動識別装置、行動識別方法、及びプログラム
JP5812948B2 (ja) * 2012-07-13 2015-11-17 アイホン株式会社 患者認識装置
JP5858940B2 (ja) * 2013-02-01 2016-02-10 キング通信工業株式会社 離床監視システム
JP2015032125A (ja) * 2013-08-02 2015-02-16 アズビル株式会社 見守り装置および見守りシステム
JP6281249B2 (ja) * 2013-11-09 2018-02-21 富士通株式会社 情報処理装置、情報処理システム、プログラム及び情報処理方法
JP6417670B2 (ja) * 2014-02-21 2018-11-07 オムロン株式会社 監視装置、監視システム、監視方法、監視プログラム、および監視プログラムを記録したコンピュータ読み取り可能な記録媒体
JP6336309B2 (ja) * 2014-03-26 2018-06-06 株式会社ドワンゴ 端末装置、動画配信装置、プログラム
JP6413310B2 (ja) * 2014-04-10 2018-10-31 富士通株式会社 見守り装置、表示方法及びプログラム
JP6282923B2 (ja) * 2014-05-12 2018-02-21 株式会社ケアコム ナースコールシステム用携帯端末装置およびナースコールシステム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010157119A (ja) * 2008-12-26 2010-07-15 Fujitsu Ltd 監視装置、監視方法、及び監視プログラム
JP2013206012A (ja) * 2012-03-28 2013-10-07 Nippon Telegraph & Telephone West Corp 監視システム、及び監視方法
JP2014166197A (ja) * 2013-02-28 2014-09-11 Nk Works Co Ltd 情報処理装置、情報処理方法、及び、プログラム
WO2015011591A1 (fr) * 2013-07-22 2015-01-29 Koninklijke Philips N.V. Surveillance continue automatique de mouvements de patient

Also Published As

Publication number Publication date
JP6804510B2 (ja) 2020-12-23
JP2019149172A (ja) 2019-09-05
JPWO2017141629A1 (ja) 2018-10-25
JP6895090B2 (ja) 2021-06-30

Similar Documents

Publication Publication Date Title
WO2017146012A1 (fr) Dispositif, procédé et système de surveillance d'une personne sous surveillance
WO2017082037A1 (fr) Dispositif de traitement central et procédé pour système de surveillance de personnes, et système de surveillance de personnes
JP6226110B1 (ja) 被監視者監視装置、該方法および該システム
JP6696606B2 (ja) 介護支援システム、介護支援方法及びプログラム
JP6895090B2 (ja) 検知システムおよび検知システムの表示処理方法
JP6740633B2 (ja) 被監視者監視システムの中央処理装置および中央処理方法、ならびに、前記被監視者監視システム
JP6150025B1 (ja) 被監視者監視システムの表示装置および表示方法ならびに被監視者監視システム
JP6292363B2 (ja) 端末装置および端末装置の表示方法ならびに被監視者監視システム
JP2017151676A (ja) 被監視者監視装置、該方法および該システム
JP6187732B1 (ja) 端末装置、端末装置の動作制御方法および被監視者監視システム
WO2020100461A1 (fr) Dispositif de capteur pour un système d'aide à la surveillance de personne à surveiller, procédé de stockage d'image de surveillance, et système d'aide à la surveillance de personne à surveiller
WO2019235068A1 (fr) Dispositif d'aide à la surveillance de sujet, procédé d'aide à la surveillance de sujet, système d'aide à la surveillance de sujet et dispositif serveur d'aide à la surveillance de sujet
JP6172424B1 (ja) 端末装置および端末装置の制御方法ならびに被監視者監視システム
JP6150026B1 (ja) 被監視者監視システムの中央処理装置および該方法ならびに被監視者監視システム
JP6213699B1 (ja) 被監視者監視システムの中央処理装置および中央処理方法ならびに被監視者監視システム
JP6245415B1 (ja) 端末装置および端末装置の動作制御方法ならびに被監視者監視システム
WO2017145832A1 (fr) Dispositif, procédé et système de surveillance de personnes à surveiller
JP7234931B2 (ja) 被監視者監視支援システムのセンサ装置、該センサ装置の処理方法および被監視者監視支援システム
WO2017188156A1 (fr) Appareil terminal de système de surveillance de personne surveillée, procédé de commande d'appareil terminal et système de surveillance de personne surveillée
WO2017130684A1 (fr) Dispositif de surveillance de personne surveillée, procédé associé et système associé
JP2020188487A (ja) 中央処理装置、被監視者監視方法および被監視者監視システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17752893

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018500001

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17752893

Country of ref document: EP

Kind code of ref document: A1