WO2017026220A1 - Terminal device for system for monitoring person to be monitored, terminal-side monitoring processing method for said terminal device, and system for monitoring person to be monitored - Google Patents

Terminal device for system for monitoring person to be monitored, terminal-side monitoring processing method for said terminal device, and system for monitoring person to be monitored Download PDF

Info

Publication number
WO2017026220A1
WO2017026220A1 PCT/JP2016/070598 JP2016070598W WO2017026220A1 WO 2017026220 A1 WO2017026220 A1 WO 2017026220A1 JP 2016070598 W JP2016070598 W JP 2016070598W WO 2017026220 A1 WO2017026220 A1 WO 2017026220A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
unit
nurse call
moving image
call
Prior art date
Application number
PCT/JP2016/070598
Other languages
French (fr)
Japanese (ja)
Inventor
雅史 西角
篤広 野田
安紀 辻
山下 雅宣
Original Assignee
コニカミノルタ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コニカミノルタ株式会社 filed Critical コニカミノルタ株式会社
Priority to JP2016572342A priority Critical patent/JP6123961B1/en
Publication of WO2017026220A1 publication Critical patent/WO2017026220A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61GTRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G12/00Accommodation for nursing, e.g. in hospitals, not covered by groups A61G1/00 - A61G11/00, e.g. trolleys for transport of medicaments or food; Prescription lists
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/04Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using a single signalling line, e.g. in a closed loop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M11/00Telephonic communication systems specially adapted for combination with other electrical systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M9/00Arrangements for interconnection not involving centralised switching

Definitions

  • the present invention relates to a terminal device in a monitored person monitoring system for monitoring a monitored person, a terminal side monitoring processing method of the terminal apparatus, and the monitored person monitoring system.
  • Japan is an aging society, more specifically the ratio of population over 65 years old to the total population due to the improvement of living standards accompanying the post-war high economic growth, improvement of sanitary environment and improvement of medical standards, etc. It is a super-aging society with an aging rate exceeding 21%.
  • the total population was about 126.5 million, while the elderly population over the age of 65 was about 25.56 million.
  • the total population was about 124.11 million.
  • the elderly population will be about 34.56 million.
  • nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care need to take care in a normal society that is not an aging society.
  • Japan for example, is a society with a declining birthrate with a total fertility rate of 1.43 in 2013.
  • elderly care has been taking place in which elderly nurses, etc., are cared for by an elderly family (spouse, child, brother).
  • monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.
  • the nurse call system disclosed in Patent Document 1 is installed on each bed in each hospital room such as a hospital or a welfare facility for the elderly, and is installed on a bed slave for a nurse to call a nurse and on the bedside.
  • a plate slave unit that is detachably connected to a machine, a call-response camera installed in each hospital room for capturing images of the patient, and a call placed from a bed slave unit installed in a nurse center.
  • a nurse call parent device for the caller to answer and confirm the call, and the nurse call parent device is provided with the nurse call imaged by the call corresponding camera.
  • An external call support monitor for displaying the video of the above is connected, and the external call support monitor is connected to the call support camera and detects a call from the bed slave unit.
  • a camera selection table for selecting a corresponding camera corresponding to a camera number corresponding to a slave unit number of the plate slave unit to which the call slave unit is connected and controlled by the nurse call master unit is stored.
  • the call corresponding camera having a camera number corresponding to the slave unit number of the slave unit connected to the call slave unit that is read from the storage unit and the caller bed slave unit read from the storage unit And a camera drive circuit for displaying the person's video on the external call monitor.
  • the present invention is an invention made in view of the above-mentioned circumstances, and its purpose is to prioritize establishment of a call, and to achieve both the distribution of moving images and the establishment of a call while reducing the interruption of the video and the interruption of the call. It is an object of the present invention to provide a terminal device of a monitored person monitoring system, a terminal side monitoring processing method of the terminal device, and the monitored person monitoring system that can be achieved as much as possible.
  • the terminal device and the terminal-side monitoring processing method of the monitored person monitoring system according to the present invention, and the monitored person monitoring system including the terminal device are displaying the moving image received from the nurse call reception device.
  • the video distribution condition setting for instructing the setting of the video distribution condition so that the communication capacity is reduced as compared with the video distribution condition in the case of a non-call A communication signal is transmitted to the nurse call reception device.
  • FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment.
  • FIG. 2 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system according to the embodiment.
  • FIG. 3 is a diagram illustrating a configuration of the management server device in the monitored person monitoring system according to the embodiment.
  • FIG. 4 is a diagram illustrating a configuration of the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • the monitored person monitoring system in the embodiment monitors a monitored person (monitoring target) Ob that is a monitoring target (monitoring target) to be monitored (monitored), receives a nurse call, and includes an image.
  • a nurse call reception device that generates a voice call, and is connected to the nurse call reception device in a communicable manner, performs a voice call with the nurse call reception device, and receives the distribution of the video generated by the nurse call reception device.
  • a terminal device that displays a moving image, the nurse call reception device, and the terminal device are communicably connected to each other, and receive the nurse call notification received by the nurse call reception device and report the nurse call to the terminal device.
  • a central processing unit that
  • such a monitored person monitoring system MS includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, A fixed terminal device SP and one or a plurality of portable terminal devices TA (TA-1, TA-2) are provided. These are wired or wireless, such as a LAN (Local Area Network), a telephone network, and a data communication network. Communication is established via a network (network, communication line) NW.
  • the network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals.
  • the network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals.
  • the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the plurality of portable terminal devices TA-1 and TA-2 are wireless including an access point AP.
  • a LAN for example, a LAN according to the IEEE 802.11 standard
  • NW is connected to be communicable with each other.
  • the sensor device SU is an example of the nurse call reception device
  • the management server device SV is an example of the central processing unit
  • each of the fixed terminal device SP and the portable terminal device TA. is an example of the terminal device.
  • the monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob.
  • the monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like.
  • the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable.
  • the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob.
  • the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.
  • the sensor device SU has a communication function for communicating with other devices SV, SP, TA via the network NW, detects a predetermined action in the monitored person Ob, and transmits the detection result to the management server device SV. , Accepts the nurse call, sends a message to the management server SV, makes a voice call with the terminal devices SP and TA, generates an image including a moving image, and distributes the moving image to the terminal devices SP and TA It is a device to do.
  • a sensor device SU includes an imaging unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process.
  • Unit (SU control processing unit) 14 sensor side communication interface unit (SU communication IF unit) 15, and sensor side storage unit (SU storage unit) 16.
  • the imaging unit 11 is an apparatus that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14.
  • the image includes a still image (still image data) and a moving image (moving image data).
  • the imaging unit 11 is disposed so as to be able to monitor a space (location space, in the example shown in FIG. 1, where the monitored person Ob that is a monitoring target to be monitored) is located.
  • the space is imaged as an imaging target from above, an image (image data) overlooking the imaging target is generated, and the imaging target image is output to the SU control processing unit 14.
  • the imaging unit 11 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed).
  • the sensor device SU uses the imaging unit 11 to acquire an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.
  • Such an imaging unit 11 may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place.
  • the imaging unit 11 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface.
  • An image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and image data that represents an infrared image in the imaging target by performing image processing on the output of the image sensor It is a digital infrared camera provided with the image processing part etc. which produce
  • the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 11 is disposed. .
  • the SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and acquires an external sound and inputs it to the sensor device SU, and represents an electric signal representing the sound according to the control of the SU control processing unit 14 It is a circuit for generating and outputting a sound according to.
  • the SU sound input / output unit 12 includes, for example, a microphone that converts sound acoustic vibrations into electrical signals, and a speaker that converts sound electrical signals into sound acoustic vibrations.
  • the SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and converts the electric signal input from the SU control processing unit 14 into an acoustic vibration of the sound and outputs the sound.
  • the nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SU.
  • the nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.
  • the SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication according to the control of the SU control processing unit 14.
  • the SU communication IF unit 15 generates a communication signal containing the data to be transferred input from the SU control processing unit 14 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SV, SP, TA via the network NW.
  • the SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data.
  • the data is converted into data in a proper format and output to the SU control processing unit 14.
  • the SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
  • the SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14.
  • the various predetermined programs include, for example, controls such as a SU control program that controls each part of the sensor device SU according to the function of each part, and a monitoring process program that executes information processing related to monitoring of the monitored person Ob.
  • a processing program is included.
  • the monitoring processing program includes a behavior detection processing program for detecting a predetermined behavior in the monitored person Ob based on the image generated by the imaging unit 1 and reporting the detection result to the management server device SV, and a nurse call reception operation unit.
  • a SU nurse call processing program for notifying the management server device SV to that effect and performing a voice call with the terminal devices SP and TA by using the SU sound input / output unit 12 and the like
  • a moving image distribution processing program for distributing the moving image generated by the imaging unit 11 to the terminal device SP or TA that requested the moving image.
  • the various kinds of predetermined data include a sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the own device, a moving image distribution condition that is a condition for distributing a moving image, and management Data necessary for executing each program such as a communication address of the server apparatus SV is included.
  • the SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like.
  • the SU storage unit 16 includes a RAM (Random Access Memory) that serves as a working memory of the so-called SU control processing unit 14 that stores data generated during the execution of the predetermined program.
  • the SU storage unit 16 functionally includes a sensor-side video distribution condition storage unit (SU video distribution condition storage unit) 161 for storing the video distribution conditions.
  • the moving image distribution conditions stored in the SU moving image distribution condition storage unit 161 include a moving image frame rate, a moving image frame size, a moving image color number, and the like.
  • the moving image distribution condition stored in the SU moving image distribution condition storage unit 161 is a predetermined default value set in advance in the initial setting. As described later, the moving image distribution condition is first or from the terminal device SP or TA that is the moving image distribution destination. When the second moving image distribution setting communication signal is received, it is rewritten and updated to the value accommodated in the received first or second moving image distribution setting communication signal.
  • the SU control processing unit 14 controls each unit of the sensor device SU according to the function of each unit, detects a predetermined action in the monitored person Ob, transmits the detection result to the management server device SV, and makes a nurse call. Is transmitted to the management server device SV, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is distributed to the terminal devices SP and TA.
  • the SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.
  • the SU control processing unit 14 executes the control processing program so that a sensor side control unit (SU control unit) 141, a behavior detection processing unit 142, a sensor side nurse call processing unit (SU nurse call processing unit) 143, and A moving image distribution processing unit 144 is functionally provided.
  • a sensor side control unit SU control unit
  • a behavior detection processing unit 142
  • a sensor side nurse call processing unit SU nurse call processing unit
  • a moving image distribution processing unit 144 is functionally provided.
  • the SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.
  • the behavior detection processing unit 142 detects a predetermined behavior set in advance in the monitored person Ob based on the image generated by the imaging unit 11, and the detection result is transmitted to the management server device via the SU communication IF unit 15. This is sent to the SV.
  • the predetermined action is, for example, getting up, getting out of bed, falling, and falling of the monitored person Ob.
  • the behavior detection processing unit 142 detects wakeup, getting out of bed, falling, and falling of the monitored person Ob based on an image generated by the imaging unit 11 by a known technique.
  • the behavior detection processing unit 142 extracts a moving body region as a human body region of the monitored person Ob from the image generated by the imaging unit 11 by, for example, the background difference method or the frame difference method, and the aspect ratio (The posture of the monitored person Ob (for example, standing position, sitting position, lying down, etc.) is determined from the aspect ratio, and the position of the detected moving body region is detected. Based on these determinations and the detected posture and position of the monitored person Ob To determine whether to wake up, get out of bed, fall and fall. More specifically, for example, the behavior detection processing unit 142 sequentially determines each posture of lying down, sitting down and standing as the aspect ratio decreases from a horizontally long aspect ratio, and the posture on the bedding such as a bed is determined from lying down.
  • the posture of the monitored person Ob for example, standing position, sitting position, lying down, etc.
  • the action detection process part 142 detects the predetermined action in the to-be-monitored person Ob, the detection action information showing the kind of this detected action (In this example, one or more of getting up, getting out of bed, falling, and falling)
  • the communication signal (event notification communication signal) containing the sensor ID of the own device and the still image used in the detection (for example, the last image when the detection is performed by a plurality of images)
  • the data is transmitted to the management server device SV via the IF unit 15.
  • the SU nurse call processing unit 143 When the nurse call accepting operation unit 13 accepts the nurse call, the SU nurse call processing unit 143 notifies the management server device SV to that effect, and uses the SU sound input / output unit 12 and the like to connect the terminal devices SP and TA. Voice calls between the two. More specifically, when the nurse call reception operation unit 13 is input, the SU nurse call processing unit 143 is a communication signal that contains nurse call reception information indicating that the nurse call has been received and the sensor ID of the own device. (Event report communication signal) is transmitted to the management server device SV via the SU communication IF unit 15. It should be noted that the event notification communication signal for reporting acceptance of the nurse call may contain a still image when the nurse call is accepted. Then, the SU nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to perform a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).
  • VoIP Voice over Internet Protocol
  • the moving image distribution processing unit 144 streams the moving image generated by the imaging unit 11 to the terminal devices SP and TA that requested the moving image according to the moving image distribution condition stored in the SU moving image distribution condition storage unit 161. It is delivered via.
  • the imaging unit 11 generates a moving image of an infrared image with a frame rate of 30 f / s and a frame size of 1366 ⁇ 768
  • the moving image distribution condition stored in the SU moving image distribution condition storage unit 161 is the frame rate of 15 f. / S and the frame size is 683 ⁇ 384
  • the moving image distribution processing unit 144 thins out every other frame of the moving image generated by the image capturing unit 11 and extracts the pixels of the moving image generated by the image capturing unit 11.
  • a video that matches the video delivery conditions stored in the SU video delivery condition storage unit 161 is generated and streamed to the terminal devices SP and TA that requested the video via the SU communication IF unit 15.
  • the imaging unit 11 when the imaging unit 11 generates a full-color moving image, if the moving image distribution condition stored in the SU moving image distribution condition storage unit 161 is a single color (monochrome), the moving image includes a luminance signal and a color difference signal. Data (when the imaging unit 11 generates moving image data of an RGB signal, the RGB signal is converted into a luminance signal and a color difference signal using a known conversion formula), and the luminance signal is converted into a moving image. Distribution is performed via the SU communication IF unit 15 by streaming to the requested terminal devices SP and TA.
  • the moving image distribution processing unit 144 uses the moving image distribution condition accommodated in the received first moving image distribution condition setting communication signal.
  • the contents stored in the SU video distribution condition storage unit 161 are rewritten and updated.
  • the moving image distribution processing unit 144 receives a second moving image distribution condition setting communication signal to be described later via the SU communication IF unit 15, the moving image distribution processing unit 144 performs the SU moving image according to the moving image distribution condition accommodated in the received second moving image distribution condition setting communication signal.
  • the contents stored in the distribution condition storage unit 161 are rewritten and updated.
  • FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob.
  • the second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob.
  • the third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.
  • the management server device SV includes a communication function that communicates with other devices SU, SP, and TA via the network NW, receives information about the event report from the sensor device SU, and monitors information about the monitored person Ob (monitoring). Information), the received event report communication signal is reported (re-reported, transferred, transmitted) to a predetermined terminal device SP, TA, and in response to a request from a client (terminal device SP, TA, etc. in this embodiment) It is a device that provides the data to the client and manages the entire monitored person monitoring system MS.
  • the management server device SV includes a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23.
  • the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication according to the control of the SV control processing unit 22.
  • the SV communication IF unit 21 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
  • the SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22.
  • Examples of the various predetermined programs include an SV control program for controlling each part of the management server device SV in accordance with the function of each part, and an SV monitoring process program for executing a predetermined process related to monitoring of the monitored person Ob. And the like.
  • the various types of predetermined data include a server identifier (server ID) for identifying the management server device SV and identifying the management server device SV, monitoring information related to monitoring of the monitored person Ob, and the event Data necessary for executing each program such as inter-device information indicating information between devices such as a notification destination of the notification communication signal is included.
  • the SV storage unit 23 functionally includes a server-side monitoring information storage unit (SV monitoring information storage unit) 231 and an inter-device information storage unit 232.
  • the SV monitoring information storage unit 231 receives, as the monitoring information, the type of action accommodated in the event notification communication signal or reception of a nurse call (type of event), sensor ID and still image, and event notification The reception times of communication signals are stored in association with each other.
  • the inter-device information storage unit 232 includes a sensor ID that is a transmission source of the event notification communication signal and a notification destination notification destination of the event notification communication signal (rereport destination, transfer destination, transmission destination). ) Corresponding to the terminal ID (report destination correspondence) and the correspondence (communication address correspondence) between the ID of each device SU, SP, TA (sensor ID, terminal ID) and its communication address, etc. It is something to remember.
  • the terminal ID is a terminal identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA.
  • each of the sensor ID, server ID, and terminal ID may be, for example, a serial number composed of a predetermined symbol string, or may be a communication address (in this case, communication address correspondence can be omitted).
  • the SV control processing unit 22 controls each unit of the management server device SV according to the function of each unit, receives an event notification communication signal from the sensor device SU, and receives information (monitoring information) related to monitoring the monitored person Ob. Managing, reporting the received event report communication signal to a predetermined terminal device SP, TA, providing the client with data according to the request of the client (in this embodiment, the terminal device SP, TA, etc.), and being monitored This is a circuit for managing the entire person monitoring system MS.
  • the SV control processing unit 22 includes, for example, a CPU and its peripheral circuits.
  • the SV control processing unit 22 functionally includes a server side control unit (SV control unit) 221 and a server side monitoring processing unit (SV monitoring processing unit) 222 by executing the control processing program.
  • the SV control unit 221 controls each unit of the management server device SV according to the function of each unit, and controls the entire management server device SV.
  • the SV monitoring processing unit 222 When the SV monitoring processing unit 222 receives an event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 stores (records) monitoring information related to monitoring of the monitored person Ob in the SV monitoring information storage unit 231, and receives the received event notification communication
  • the reporting destination (re-reporting destination, transfer destination, transmission destination) corresponding to the sensor device SU that transmitted the signal is selected (searched) from the reporting destination correspondence stored in the inter-device information storage unit 232, and the selected terminal
  • the event notification communication signal is transmitted to the devices SP and TA. This selection (search process) is performed based on the sensor ID corresponding to the sensor device SU that has transmitted the received event notification communication signal.
  • the event notification communication signal to be re-reported corresponds to the sensor device SU that has transmitted the received event notification communication signal as the reception time of the event notification communication signal from the sensor device SU and the download destination of the moving image.
  • the communication address to be stored is further accommodated. This communication address is selected (searched) from the communication address correspondence relationship based on the sensor ID corresponding to the sensor device SU that has transmitted the received event notification communication signal.
  • the management server device SV is connected to the SV control processing unit 22 as necessary, as shown by a broken line in FIG. 3, for example, a server side input unit (SV input unit) for inputting various commands, various data, and the like.
  • Server side output unit (SV output unit) 25 that outputs various commands and various data input by the SV input unit 24 and monitoring information related to monitoring of the monitored person Ob, and data between external devices
  • a server-side interface unit (SVIF unit) 26 or the like for performing input / output may be provided.
  • Such a management server device SV can be configured by a computer with a communication function, for example.
  • the fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like.
  • the user interface (UI) of the monitored person monitoring system MS is input by inputting predetermined instructions and data to be given to the management server device SV and the portable terminal device TA, or displaying the monitoring information obtained by the sensor device SU. ).
  • Such a fixed terminal device SP can be configured by, for example, a computer with a communication function.
  • the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in the present specification, an embodiment of the terminal device is described as an example of the mobile terminal device TA. Is done.
  • the mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call.
  • a monitoring function (including moving images) obtained from the sensor device SU by inputting a predetermined instruction or data to be provided to the management server device SV or the sensor device SU, or by a report from the management server device SV. It is a device for receiving and displaying the monitoring information for the monitored person Ob and displaying a response to a nurse call or calling out by displaying or making a voice call with the sensor device SU. In the present embodiment, for example, as shown in FIG.
  • such a portable terminal device TA includes a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, and A terminal side storage unit (TA storage unit) 33, a terminal side sound input / output unit (TA sound input / output unit) 34, a terminal side input unit (TA input unit) 35, and a terminal side display unit (TA display unit). 36 and a terminal-side interface unit (TAIF unit) 37.
  • the TA sound input / output unit 34 is connected to the TA control processing unit 32 and is a device for acquiring an external sound and inputting it to the mobile terminal device TA. It is a device for generating and outputting sound corresponding to a signal. Similar to the SU sound input / output unit 12, the TA sound input / output unit 34 includes, for example, a microphone that converts acoustic vibration into an electrical signal, a speaker that converts an electrical signal of sound into an acoustic vibration of sound, and the like. Is done. The TA sound input / output unit 34 outputs an electric signal representing an external sound to the TA control processing unit 32, and converts the electric signal input from the TA control processing unit 32 into sound acoustic vibration and outputs the sound.
  • the TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a device that accepts a predetermined operation and inputs it to the mobile terminal device TA, for example, a plurality of input switches assigned with a predetermined function.
  • the predetermined operation include an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the reported monitored person.
  • various operations necessary for monitoring such as an input operation indicating that there is an intention to perform (response, response) such as lifesaving, nursing, nursing care, and assistance for Ob, are included.
  • the TA display unit 36 is connected to the TA control processing unit 32, and is monitored by the monitored person monitoring system MS according to predetermined operation contents input from the TA input unit 35 according to the control of the TA control processing unit 32. It is a device that displays the monitoring information related to the monitoring of the monitored person Ob (for example, the type of predetermined action detected by the sensor device SU, the reception of a nurse call, the image (still image and moving image) of the monitored person Ob), and the like.
  • a display device such as an LCD (Liquid Crystal Display) and an organic EL display.
  • the TA input unit 35 and the TA display unit 36 constitute a touch panel.
  • the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method.
  • a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36.
  • a user such as a nurse or a caregiver ( When the monitor) touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal device TA as the operation input content of the user. Entered.
  • the TAIF unit 37 is a device that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device according to the control of the TA control processing unit 32.
  • the TAIF unit 37 uses the Bluetooth (registered trademark) standard.
  • An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard are examples of the Bluetooth (registered trademark) standard.
  • the TA communication IF unit 31 is a communication device that is connected to the TA control processing unit 32 and performs communication according to the control of the TA control processing unit 32, similarly to the SU communication IF unit 15.
  • the TA communication IF unit 31 generates a communication signal containing the data to be transferred input from the TA control processing unit 32 in accordance with the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SU, SV, SP via the network NW.
  • the TA communication IF unit 31 receives a communication signal from another device SU, SV, SP via the network NW, extracts data from the received communication signal, and the TA control processing unit 32 can process the extracted data.
  • the data is converted into data of a proper format and output to the TA control processing unit 32.
  • the TA communication IF unit 31 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.
  • the TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32.
  • the various predetermined programs include a TA control program for controlling each part of the mobile terminal device TA according to the function of each part, and a TA monitoring process program for executing a predetermined process related to monitoring of the monitored person Ob.
  • a TA nurse call processing program for performing a voice call with the sensor device SU by using the TA sound input / output unit 12 or the like, and a moving image received from the sensor device SU are displayed on the TA display unit 36.
  • the TA storage unit 33 includes, for example, a ROM and an EEPROM.
  • the TA storage unit 33 includes a RAM serving as a working memory for the so-called TA control processing unit 32 that stores data generated during execution of the predetermined program.
  • the TA storage unit 33 includes a terminal side monitoring information storage unit (TA monitoring information storage unit) 331 for storing the monitoring information, and a terminal side moving image distribution condition storage unit (for storing the moving image distribution conditions).
  • TA animation distribution condition storage unit) 332 is functionally provided.
  • the TA monitoring information storage unit 331 receives the type of action or reception of a nurse call (type of event), sensor ID, still image, The communication address of the moving image download destination, the reception time of the event notification communication signal received by the management server device SV from the sensor device SU, and the like are stored in association with each other.
  • the TA moving image distribution condition storage unit 332 stores in advance moving image distribution conditions that are preset when the sensor device SU distributes moving images.
  • the moving image distribution conditions stored in advance in the TA moving image distribution condition storage unit 332 include moving image distribution conditions (non-call moving image distribution conditions, default values) used for non-calls, and moving image distribution conditions used for calls. (Calling video distribution condition), and the calling video distribution condition is set in advance so that the communication capacity is reduced as compared with the non-calling video distribution condition. More specifically, the call video distribution condition is such that one or more of a video frame rate, a video frame size, and a video color number are reduced in communication capacity compared to the non-call video distribution condition. It is preset as follows.
  • the on-call moving image delivery condition is set in advance so that the frame rate is lower than the frame rate of the non-call on-call moving image delivery condition.
  • the frame rate of the non-call moving picture delivery condition is preset to 30 f / s
  • the frame rate of the call moving picture delivery condition is preset to 15 f / s.
  • the on-call moving image distribution condition is set in advance so that the frame size is smaller than the frame size of the non-call moving image distribution condition.
  • the frame size of the non-call video distribution condition is preset to 1366 ⁇ 768
  • the frame size of the call video distribution condition is preset to 683 ⁇ 384.
  • the on-call video distribution condition is set in advance so that the number of colors is smaller than the number of colors on the non-call video distribution condition.
  • the number of colors in the non-call video distribution condition is preset to full color, and the number of colors in the video distribution condition during call is preset to a single color (monochrome).
  • the on-call moving picture distribution conditions are set in advance such that the frame rate and the frame size are lower than the frame rate and the frame size in the non-call moving picture distribution conditions, respectively.
  • the frame rate for the non-call video delivery condition is preset to 30 f / s
  • the frame size is preset to a size of 1366 ⁇ 768
  • the frame rate for the call video delivery condition is 15 f / s.
  • s is preset
  • its frame size is preset to 683 ⁇ 384.
  • each of the non-call video delivery conditions and the call video delivery conditions may be downloaded from the management server device SV via the TA communication IF unit 31 and stored in the TA video delivery condition storage unit 332 in advance. According to this, in the case where the monitored person monitoring system MS includes a plurality of terminal devices SP and TA, it is possible to store a moving image distribution condition equal to all the terminal devices SP and TA.
  • the TA control processing unit 32 is a circuit for controlling each unit of the mobile terminal device TA according to the function of each unit, receiving and displaying the monitoring information for the monitored person Ob, and answering or calling a nurse call. It is. Similar to the SU control processing unit 14, the TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 32 executes a terminal processing unit (TA control unit) 321, a terminal side monitoring processing unit (TA monitoring processing unit) 322, a terminal side nurse call processing unit (TA nurse) by executing a control processing program. A call processing unit 323 and a moving image reception processing unit 324 are functionally provided.
  • the TA control unit 321 controls each part of the mobile terminal apparatus TA according to the function of each part, and controls the entire mobile terminal apparatus TA.
  • the TA monitoring processing unit 322 executes predetermined processing related to monitoring of the monitored person Ob. More specifically, when the TA monitoring processing unit 322 receives an event notification communication signal for re-reporting from the management server device SV, the TA monitoring processing unit 322 is based on each information (each data) accommodated in the received event notification communication signal. The monitoring information related to the monitoring of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331 according to each information contained in the received re-reporting event notification communication signal. The displayed screen is displayed on the TA display unit 36. Then, when receiving a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process corresponding to the input operation.
  • the TA monitor processing unit 322 when the TA monitor processing unit 322 receives a live video request operation from the TA input unit 35, the TA monitor processing unit 322 requests the sensor device SU to distribute the video and displays the video on the TA display unit 36.
  • the sensor device SU When the end operation is received from the TA input unit 35, the sensor device SU is requested to stop moving image distribution, and the display of the moving image on the TA display unit 36 is ended.
  • the TA monitoring processing unit 322 indicates that there is an intention to perform, for example, lifesaving, nursing, nursing care, assistance, etc. for the monitored person Ob related to the re-reported event notification communication signal (“correspond”).
  • the input operation is accepted, the fact is notified to the other terminal devices SP and TA via the management server device SV.
  • the TA nurse call processing unit 323 requests a voice call to the sensor device SU by the TA nurse call processing unit 323 and performs voice communication with the sensor device SU.
  • the TA nurse call processing unit 323 requests the sensor device SU to end the voice call and ends the voice call with the sensor device SU.
  • the TA nurse call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 or the like. More specifically, the TA nurse call processing unit 323 uses, for example, the VoIP (Voice) with the transmission source sensor device SU that has transmitted the event notification communication signal to the management server device SV using the TA sound input / output unit 34 or the like. Make a voice call using the Over Internet Protocol.
  • VoIP Voice
  • a first video distribution condition setting communication signal for instructing the setting of the video distribution conditions is transmitted to the sensor device SU via the TA communication IF unit 31 so as to reduce the communication capacity compared to the video distribution conditions in the case of a call.
  • the TA communication IF unit 31 sends a second video distribution condition setting communication signal for instructing the setting of the video distribution condition in the case of non-call. Is transmitted to the sensor device SU.
  • the moving image reception processing unit 324 starts a voice call with the sensor device SU at the TA input unit 35 when the moving image received from the sensor device SU is displayed on the TA display unit 36.
  • information video distribution
  • the TA video distribution condition storage unit 332 When received, information (video distribution) indicating that the video distribution conditions during a call stored in the TA video distribution condition storage unit 332 are taken out and that video distribution is instructed (commanded) under the extracted video distribution conditions during a call Condition setting instruction information, moving image distribution condition setting command), and the first moving image distribution condition setting communication signal containing the sensor ID corresponding to the sensor device SU that distributes the moving image to the mobile terminal device TA. It transmits to sensor device SU via 31.
  • the video reception processing unit 324 takes out the non-call video distribution conditions stored in the TA video distribution condition storage unit 332, Video distribution condition setting instruction information (video distribution condition setting command) indicating that a video distribution is instructed (commanded) under the extracted non-call video distribution conditions, and a video is distributed to the mobile terminal device TA.
  • Video distribution condition setting instruction information (video distribution condition setting command) indicating that a video distribution is instructed (commanded) under the extracted non-call video distribution conditions, and a video is distributed to the mobile terminal device TA.
  • a second moving image distribution condition setting communication signal containing a sensor ID corresponding to the sensor device SU is transmitted to the sensor device SU via the TA communication IF unit 31.
  • Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.
  • FIG. 5 is a sequence diagram illustrating the operation of the monitored person monitoring system according to the embodiment.
  • FIG. 6 is a flowchart illustrating an operation related to receiving an input operation of the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 7 is a diagram illustrating an example of a standby screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 8 is a diagram illustrating an example of a monitoring information screen displaying a still image displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 9 is a diagram illustrating an example of a monitoring information screen displaying a moving image displayed on the mobile terminal device in the monitored person monitoring system of the embodiment.
  • each device SU, SV, SP, TA performs initialization of each necessary part and starts its operation when the power is turned on.
  • the SU control processing unit 14 is functionally provided with the SU control unit 141, the behavior detection processing unit 142, the SU nurse call processing unit 143, and the moving image distribution processing unit 144. Composed.
  • the SV control processing unit 22 is functionally configured with the SV control processing unit 221 and the SV monitoring processing unit 222 by executing the control processing program.
  • the TA control processing unit 32 is functionally provided with a TA control unit 321, a TA monitoring processing unit 322, a TA nurse call processing unit 323, and a moving image reception processing unit 324 by executing the control processing program. Configured.
  • the portable terminal device TA for example, when a login operation by a supervisor (user) such as a nurse or a caregiver is accepted, a standby screen waiting for a communication signal addressed to the own device is displayed on the TA display unit 36 by the TA monitoring processing unit 322. Is done.
  • the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating standby (for example, “no notification”) and an icon.
  • a time area 513 for displaying the current time a year / month / sunday area 514 for displaying the current year / month / sunday, and a user name area 515 for displaying the name of the user who is currently logged in to the portable terminal device TA.
  • the sensor device SU acquires an image by the imaging unit 11 at a time interval according to a predetermined frame rate (for example, 24 f / s, 30 f / s, etc.), and the action detection process of the SU control processing unit 14
  • the unit 142 determines a predetermined action (state, situation) in the monitored person Ob based on the image acquired by the imaging unit 11.
  • the event notification communication signal is sent to the SU communication IF.
  • the data is transmitted to the management server device SV via the unit 15 (C2).
  • the SV monitoring processing unit 222 of the SV control processing unit 22 performs monitoring information on monitoring of the monitored person Ob based on the received event notification communication signal. Is stored (recorded) in the SV monitoring information storage unit 231. Then, the notification destination notification destination (re-report destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the received event notification communication signal is determined from the notification destination correspondence stored in the inter-device information storage unit 232. Select (search) and transmit (re-report) the event notification communication signal to the selected terminal devices SP and TA via the SV communication IF unit 21 (C3). As a result, the state (situation) of the monitored person Ob is notified to a monitor such as a nurse or a caregiver via the terminal devices SP and TA.
  • the mobile terminal device TA When the mobile terminal device TA receives the re-report event notification communication signal from the management server device SV, the mobile terminal device TA stores monitoring information related to monitoring of the monitored person Ob based on the received re-report event notification communication signal. A screen (monitoring information screen) corresponding to the information stored in (recorded) in the unit 331 and accommodated in the received re-report event notification communication signal is displayed on the TA display unit 36 (C4).
  • the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. Here, the operation is described for the mobile terminal device TA.
  • the monitoring information screen 52a includes a menu bar area 511, an arrangement location of the sensor device SU of the sensor ID, and the monitored person Ob monitored by the sensor device SU of the sensor ID.
  • Monitored person name area 521 for displaying a name
  • icon area 522 for displaying an icon that represents an elapsed time from the reception time and a determination result
  • an image captured by the sensor device SU of the sensor ID here , A still image
  • the “corresponding” button 524 indicates that the user of the mobile terminal device TA has the intention to execute the response such as nursing to the monitored person Ob monitored by the sensor device SU of the sensor ID. It is a button for inputting to the portable terminal device SU an instruction to input to the device TA and notify the other terminal devices SP and TA that the intention has been input.
  • the “speak” button 525 is a button for inputting an instruction to connect the sensor device SU of the sensor ID and the mobile terminal device TA so as to be able to talk over the network NW.
  • the “LIVE” button 526 is a button for inputting an instruction to distribute and display a moving image captured by the sensor device SU with the sensor ID.
  • An icon that symbolically represents the correspondence between the sensor ID, the location of the sensor device SU of the sensor ID, and the name of the monitored person Ob monitored by the sensor device SU of the sensor ID, and the determination result. Is stored in the TA storage unit 33 as one of the various predetermined data by being notified from the management server device SV or by being input in advance.
  • a communication signal (video distribution request communication signal) containing information such as a request for live video distribution to the sensor device SU having the sensor ID contained in the received re-report event notification communication signal. Is transmitted via the TA communication IF unit 31 (C6).
  • the sensor device SU that has received the video distribution request communication signal causes the video distribution processing unit 144 to transfer the video generated by the imaging unit 11 to the mobile terminal device TA that is the transmission source of the video distribution request communication signal that requested the video.
  • the streaming is distributed via the SU communication IF unit 15 in accordance with the moving image distribution conditions stored in the SU moving image distribution condition storage unit 161 (C7).
  • the portable terminal device TA displays the distributed video on the TA display unit 36 by streaming reproduction by the TA monitoring processing unit 322 (C8).
  • the monitoring information screen 52b that displays the live moving image is an image region 523b that displays a moving image instead of the image region 523a that displays a still image in the monitoring information screen 52a illustrated in FIG.
  • a “LIVE END” button 527 is provided instead of the “VIEW LIVE” button 526.
  • the “live end” button 527 is a button for inputting an instruction to end (stop) the distribution of the moving image captured by the sensor device SU of the sensor ID and end (stop) the display.
  • the mobile terminal device TA transmits a communication signal (call communication) containing information such as requesting a voice call to the sensor device SU having the sensor ID contained in the received re-report event notification communication signal by the TA nurse call processing unit 323. Request communication signal) is transmitted via the TA communication IF unit 31 (C10).
  • call communication a communication signal containing information such as requesting a voice call to the sensor device SU having the sensor ID contained in the received re-report event notification communication signal by the TA nurse call processing unit 323.
  • Request communication signal is transmitted via the TA communication IF unit 31 (C10).
  • the mobile terminal device TA uses the video reception processing unit 324 to extract the on-call video distribution conditions stored in the TA video distribution condition storage unit 332 and instruct the video distribution under the extracted on-call video distribution conditions ( Command distribution condition setting instruction information (moving image distribution condition setting command) indicating that the instruction is to be performed) and a sensor ID corresponding to the sensor device SU that is distributing the moving image to the mobile terminal device TA (in this example, the received re-transmission command).
  • the first video distribution condition setting communication signal containing the sensor ID accommodated in the notification event notification communication signal is sent to the sensor device SU having the sensor ID accommodated in the received re-report event notification communication signal. Transmission is performed via the communication IF unit 31 (C11).
  • the call request communication signal and the first video distribution condition setting communication signal may be combined into one communication signal.
  • the “speak” button 525 on the monitoring information screens 52a and 52b is changed to an “end” button (not shown) that is a button for inputting a voice call end instruction.
  • the sensor device SU that has received the call request communication signal uses the SU nurse call processing unit 143 to use the SU sound input / output unit 12 and the like to communicate with the mobile terminal device TA that is the transmission source of the received call request communication signal. For example, a voice call is performed with the portable terminal device TA by transmitting / receiving a VoIP communication signal (call communication signal) via the SU communication IF unit 15 (C12).
  • the sensor device SU that has received the first video distribution condition setting communication signal, by the video distribution processing unit 144, receives the video distribution condition (video communication condition during call) accommodated in the received first video distribution condition setting communication signal.
  • the sensor device SU causes the moving image distribution processing unit 144 to transfer the moving image generated by the imaging unit 11 to the mobile terminal device TA that is the transmission source of the moving image distribution request communication signal in the process C6 and to the SU moving image distribution condition storage unit 161.
  • streaming is distributed via the SU communication IF unit 15 (C13).
  • the moving image is distributed under a moving image distribution condition in which the communication capacity is reduced compared to the moving image distribution condition in the case of a non-call.
  • the TA terminal call processing unit 323 causes the portable terminal device TA to perform a voice call.
  • a call end communication signal is transmitted via the TA communication IF unit 31 (C15).
  • the mobile terminal device TA extracts the non-call video distribution conditions stored in the TA video distribution condition storage unit 332 by the video reception processing unit 324, and distributes the video according to the extracted non-call video distribution conditions.
  • Video distribution condition setting instruction information (video distribution condition setting command) indicating instruction (command) and a sensor ID corresponding to the sensor device SU that distributes the video to the mobile terminal device TA (in this example, the reception)
  • the second video distribution condition setting communication signal containing the sensor ID accommodated in the rereport event notification communication signal) to the sensor device SU having the sensor ID accommodated in the received rereport event notification communication signal. And transmitted via the TA communication IF unit 31 (C16). Note that the call end communication signal and the second moving image distribution condition setting communication signal may be combined into one communication signal.
  • the sensor device SU that has received the call end communication signal ends the voice call with the mobile terminal device TA that is the transmission source of the received call end communication signal by the SU nurse call processing unit 143.
  • the sensor device SU that has received the second moving image distribution condition setting communication signal causes the moving image distribution processing unit 144 to move the moving image distribution condition (non-call moving image distribution) accommodated in the received second moving image distribution condition setting communication signal.
  • the contents stored in the SU video distribution condition storage unit 161 are rewritten and updated. Therefore, the sensor device SU causes the moving image distribution processing unit 144 to transfer the moving image generated by the imaging unit 11 to the mobile terminal device TA that is the transmission source of the moving image distribution request communication signal in the process C6 and to the SU moving image distribution condition storage unit 161.
  • streaming is distributed via the SU communication IF unit 15 (C17).
  • the portable terminal device TA When receiving the live video distribution, the portable terminal device TA displays the distributed video on the TA display unit 36 by streaming reproduction by the TA monitoring processing unit 322 (C18). As a result, at the time of non-calling, the moving-image distribution conditions in the case of non-calling are automatically restored with the end of the voice call, and the moving images are distributed under the restored moving-image distribution conditions.
  • the mobile terminal device TA uses the TA monitoring processing unit 322 to detect the moving image distribution source sensor device SU (that is, the received re-report event).
  • a communication signal (moving image distribution end communication signal) containing information such as requesting the end of moving image distribution is transmitted via the TA communication IF unit 31 to the sensor device SU having the sensor ID accommodated in the notification communication signal. (C20).
  • the distribution of the moving image is terminated, and the monitoring information screen 52a is displayed on the TA display unit 36.
  • the still image contained in the received re-report event notification communication signal may be displayed in the image area 523a of the monitoring information screen 52a, and is displayed when the moving image distribution end communication signal is transmitted.
  • the moving image that has been displayed may be continuously displayed as a still image.
  • the TA control processing unit 32 determines the type of the received input operation (S12).
  • the mobile terminal device TA performs the TA monitoring process.
  • the unit 322 transmits a moving image distribution request communication signal to the sensor device SU having the sensor ID accommodated in the received re-report event notification communication signal (S13), and ends this process.
  • the TA control processing unit 32 When the received input operation is an operation of the “speak” button 525 as a result of the determination in the process S12 (“speak”), the TA control processing unit 32, as described in the processes C10 and C11, The nurse call processing unit 323 transmits a call request communication signal to the sensor device SU having the sensor ID accommodated in the received re-report event notification communication signal.
  • the processing unit 324 retrieves the on-call moving image distribution condition from the TA moving image distribution condition storage unit 332, the moving image distribution condition setting instruction information regarding the retrieved on-call moving image distribution condition, and the sensor ID corresponding to the moving image distribution source sensor device SU. Is transmitted to the sensor device SU (S14), and the process ends.
  • the TA control processing unit 32 transmits a moving image distribution end communication signal to the moving image distribution source sensor device SU (S15), and ends this processing.
  • the TA control processing unit 32 As a result of the determination in the step S12, when the received input operation is an “end” operation (not shown) (“end”), the TA control processing unit 32 as described in the processing C15 and the processing C16.
  • the TA nurse call processing unit 323 transmits a call end communication signal to the voice call destination sensor device SU, and when moving image distribution is in progress, the moving image reception processing unit 324 stores the TA moving image distribution condition storage.
  • the non-call video distribution condition is extracted from the unit 332, and the second video distribution condition containing the video distribution condition setting instruction information related to the extracted non-call video distribution condition and the sensor ID corresponding to the sensor device SU of the video distribution source
  • a setting communication signal is transmitted to the sensor device SU (S16), and this process is terminated.
  • the received input operations include the operations of the “watch live” button 526, the operation of the “speak” button 525, the operation of the “live end” button 527, and “ In the case of another operation that is not one of the operations of the “End” button (others), the TA control processing unit 32 executes an appropriate process according to the other and ends this process.
  • the TA sound input / output unit 34 and the TA nurse call processing unit 323 of the TA control processing unit 32 are connected via a terminal side communication unit (in this embodiment, the TA communication IF unit 31 is an example).
  • This corresponds to an example of a terminal-side voice call unit that makes a voice call with a nurse call reception device (in this embodiment, the sensor device SU is an example thereof).
  • the “speak” button 525 and the “end” button 532 of the touch panel constituted by the TA input unit 35 and the TA display unit 36 and the TA control processing unit 32 that executes the processing are a nurse call accepting device (in this embodiment, a sensor device).
  • SU corresponds to an example of a terminal-side voice call accepting unit that accepts the start and end of a voice call with SU.
  • the monitored person monitoring system MS, its terminal devices SP and TA, and its terminal side monitoring processing method use the moving image received from the sensor device SU (an example of a nurse call reception device).
  • the second is for instructing the setting of the video distribution condition so that the communication capacity is reduced as compared with the video distribution condition in the case of a non-call.
  • the moving image reception processing unit 324 that transmits a moving image distribution condition setting communication signal to the sensor device SU is provided, the communication capacity of the moving image distribution condition is reduced compared to the moving image distribution condition in the case of a non-call with the start of a voice call. To be changed. For this reason, the monitored person monitoring system MS, the terminal devices SP and TA, and the terminal-side monitoring processing method give priority to establishment of a call, reduce video interruptions and call interruptions, and distribute video and establish calls. Can be achieved as much as possible.
  • the monitored person monitoring system MS, the terminal devices SP and TA, and the terminal-side monitoring processing method can change the one or more of the moving image frame rate, the moving image frame size, and the moving image color number to make non-calling. It is possible to instruct the setting of the moving image distribution condition so that the communication capacity is reduced as compared with the moving image distribution condition.
  • the moving image reception processing unit 324 instructs the setting of the moving image distribution condition in the case of non-calling. Since the second moving image distribution condition setting communication signal for transmitting is transmitted to the sensor device SU, it is possible to automatically return to the moving image distribution condition in the case of a non-call as the voice call ends.
  • the moving image reception processing unit 324 of the mobile terminal device TA displays the moving image received from the sensor device SU on the TA display unit 36, and the TA input unit 35 uses the sensor device SU.
  • the first video distribution condition setting communication signal for instructing the setting of the video distribution condition so as to reduce the communication capacity compared to the video distribution condition in the case of non-call is TA.
  • the frame rate of the moving image may be 0 for the moving image distribution condition accommodated in the first moving image distribution condition setting communication signal. According to this, since the frame rate of the moving image distribution condition is 0, the distribution of the moving image is substantially stopped and a voice call can be made more reliably.
  • FIG. 10 is a diagram illustrating an example of a call screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • the video reception processing unit 324 received the start of a voice call with the sensor device SU at the TA input unit 35 while displaying the video received from the sensor device SU on the TA display unit 36.
  • a first moving image distribution condition setting communication signal for instructing setting of a moving image distribution condition in which the frame rate of the moving image is 0 is transmitted to the sensor device SU via the TA communication IF unit 31, and A call screen indicating that a voice call is possible is displayed on the TA display unit 36. For example, as shown in FIG.
  • the in-call screen 53 includes a menu bar area 511, a monitored person name area 521, an icon area 522, and a message indicating that a call is possible (for example, “in call”). ) And an icon for displaying a call main area 531, a “corresponding” button 524, and an “end” button 532.
  • the “end” button 532 is a button for inputting an instruction to end the voice call with the sensor device SU.
  • the TA display unit 36 uses the TA monitoring processing unit 322 instead of the call screen 53 to set the first moving image distribution condition for instructing the setting of the moving image distribution condition where the moving image frame rate is 0.
  • the display of the moving image displayed when the communication signal is transmitted to the sensor device SU via the TA communication IF unit 31 may be continued as a still image. According to this, since the image of the moving image displayed when the first moving image distribution stop communication signal is transmitted continues to be displayed as a still image, for example, a user such as a monitor can monitor the monitored person Ob during the call. You can also check the situation in the image.
  • the terminal-side voice call accepting unit that accepts the start and end of the voice call includes the “speak” button 525 and “end” of the touch panel configured by the TA input unit 35 and the TA display unit 36. ”Button 532 and a TA control processing unit 32 for executing the process, the terminal side voice call accepting unit is replaced with“ speak ”button 525 and“ end ”button 532 or“ speak ”.
  • a voice activation function that accepts the start and end of the voice call according to the presence or absence of voice may be used.
  • the TA control processing unit 32 determines that the start of the voice call has been accepted when the volume of the sound input to the TA sound input / output unit 34 is equal to or higher than a preset first threshold value. The same processing as when the input operation of the “speak” button 525 is received is executed, and the volume of the sound input to the TA sound input / output unit 34 is equal to or lower than a preset second threshold value, and the state is in advance. If it has been continued for a predetermined time or more, it is determined that the end of the voice call has been accepted, and the same processing as when the input operation of the “end” button 532 is accepted is executed. According to this, since the mobile terminal device TA has a voice activation function, the user can input the start and end of a voice call with the sensor device SU to the mobile terminal device TA without performing an input operation.
  • FIG. 11 is a diagram illustrating another example of a monitoring information screen displaying a still image displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • the monitoring information screen 52 c accompanied with such a voice activation function on / off display is displayed on the monitoring information screens 52 a and 52 b shown in FIGS. 8 and 9.
  • a VAF on / off display area 541 for display is provided.
  • FIG. 11 is a diagram illustrating another example of a monitoring information screen displaying a still image displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • the monitoring information screen 52 c accompanied with such a voice activation function on / off display is displayed on the monitoring information screens 52 a and 52 b shown in FIGS. 8 and 9.
  • a VAF on / off display area 541 for display is provided.
  • FIG. 11 is a diagram illustrating another example of a monitoring information screen displaying a still image displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment.
  • FIG. 11 shows a monitoring information screen 52c configured by further providing a VAF on / off display area 541 on the monitoring information screen 52a shown in FIG. According to this, ON / OFF of the voice activation function is clearly indicated on the TA display unit 36.
  • the terminal device of the monitored person monitoring system receives a nurse call, generates an image including a moving image, and makes a voice call, and is connected to the nurse call reception device so as to be able to communicate with the nurse call reception device.
  • a terminal device that performs a voice call with the call reception device receives the distribution of the moving image generated by the nurse call reception device, and displays the moving image, and is connected to the nurse call reception device and the terminal device in a communicable manner, and the nurse
  • a terminal-side communication unit that performs communication, the terminal device of the monitored person system comprising: a central processing unit that receives the notification of the nurse call received by the call reception device and reports the nurse call to the terminal device; A terminal-side voice call unit that makes a voice call with the nurse call reception device via the terminal-side communication unit; and the terminal-side communication unit.
  • a terminal-side display unit that displays a video received from the nurse call reception device, a terminal-side voice call reception unit that receives start and end of a voice call with the nurse call reception device, and the nurse call reception device
  • the terminal-side voice call accepting unit accepts the start of the voice call with the nurse call accepting device while the video received from the terminal is displayed on the terminal-side display unit.
  • a moving image reception processing unit that transmits a moving image distribution condition setting communication signal for instructing setting of the moving image distribution condition to the nurse call reception device via the terminal side communication unit so that the communication capacity is reduced as compared with the moving image distribution condition With.
  • the terminal-side voice call accepting unit may be configured to store the same video distribution conditions for all the terminal devices.
  • the moving image distribution condition when the start of the voice call with the nurse call reception device is received is downloaded from the central processing unit via the terminal side communication unit.
  • the terminal side voice call reception unit When such a terminal device displays a video received from the nurse call reception device on the terminal side display unit, the terminal side voice call reception unit has accepted the start of a voice call with the nurse call reception device.
  • a video delivery condition setting communication signal for instructing the setting of the video delivery condition so as to reduce the communication capacity compared to the video delivery condition in the case of non-call is sent to the nurse call reception device via the terminal side communication unit. Since the moving image reception processing unit to be transmitted is provided, the moving image distribution condition is changed so that the communication capacity is reduced as compared with the moving image distribution condition in the case of a non-call with the start of the voice call. For this reason, the terminal device gives priority to establishment of a call, and can achieve both the distribution of a moving image and the establishment of a call as much as possible while reducing the interruption of the video and the interruption of the call.
  • the moving image distribution condition is one or more of a frame rate of the moving image, a frame size of the moving image, and the number of colors of the moving image.
  • the terminal side voice call receiving unit starts the voice call with the nurse call receiving device.
  • the communication capacity can be reduced by reducing the frame rate of the moving image from the frame rate in the case of non-calling.
  • the communication capacity can be reduced by reducing the frame size from the frame size in the case of non-calling.
  • the communication capacity can be reduced by changing from three colors of RGB to one color (monochrome).
  • the communication capacity can be reduced by reducing the frame rate of the moving image from the frame rate in the case of non-calling and reducing the frame size from the frame size in the case of non-calling.
  • the moving image distribution condition is that a frame rate of the moving image is zero.
  • the terminal-side display unit transmits a video distribution condition setting communication signal for instructing setting of a video distribution condition in which the frame rate of the video is 0.
  • the image of the moving image that has been displayed when transmitted to the nurse call accepting device via is continued to be displayed as a still image.
  • Such a terminal device displays a moving image displayed as a still image when transmitting the moving image distribution end communication signal for instructing setting of a moving image distribution condition where the frame rate of the moving image is 0. Since it continues, the user (for example, monitoring person etc.) can also confirm the state of a monitoring person also with an image during a telephone call.
  • the moving image reception processing unit receives a termination of a voice call with the nurse call reception device in the terminal-side voice call reception unit, and in a case of a non-call A second moving image distribution condition setting communication signal for instructing setting of moving image distribution conditions is transmitted to the nurse call reception device via the terminal side communication unit.
  • the terminal-side voice call accepting unit includes a voice activation function that accepts the start and end of the voice call according to the presence or absence of voice.
  • Such a terminal device has a voice activation function, the user can input the start and end of a voice call with the nurse call reception device to the terminal device without performing a reception operation.
  • the terminal-side monitoring processing method for a terminal device includes a nurse call reception device that receives a nurse call, generates an image including a moving image, and performs a voice call, and is communicably connected to the nurse call reception device.
  • a voice call with the nurse call reception device receiving the distribution of the video generated by the nurse call reception device and displaying the video, and connected to each of the nurse call reception device and the terminal device so as to be able to communicate,
  • a terminal-side monitoring processing method of the terminal device in a monitored person monitoring system comprising a central processing unit that receives a notification of a nurse call received by the nurse call reception device and reports the nurse call to the terminal device,
  • the terminal side communication step for communicating by the terminal side communication unit, and the terminal side voice call unit through the terminal side communication unit
  • a terminal-side voice call step for making a voice call with the nurse call reception device, a terminal-side display step for displaying a video received from the nurse call reception device via the terminal-side communication unit by a terminal-side display unit, and
  • the terminal-side monitoring processing method of the terminal device in such a monitored person monitoring system is such that the terminal-side audio is displayed when the terminal-side display process displays the video received from the nurse call reception device on the terminal-side display unit.
  • the terminal side voice call acceptance unit accepts the start of the voice call with the nurse call acceptance device in the call acceptance process
  • the setting of the video delivery condition is set so that the communication capacity is reduced as compared with the video delivery condition in the case of non-call.
  • Video delivery condition setting communication signal for instructing the video delivery condition is transmitted to the nurse call reception device via the terminal side communication unit, so that the video delivery condition is a non-call with the start of a voice call Is changed so that the communication capacity is reduced as compared with the moving image distribution condition in FIG.
  • the terminal-side monitoring processing method gives priority to establishment of a call, and can achieve both the distribution of moving images and the establishment of a call as much as possible while reducing the interruption of the video and the interruption of the call.
  • the monitored person monitoring system includes a nurse call reception device that receives a nurse call, generates an image including a moving image, and performs a voice call, and is communicably connected to the nurse call reception device.
  • a terminal device that performs voice communication with the reception device, receives the distribution of the video generated by the nurse call reception device, and displays the video, and is connected to each of the nurse call reception device and the terminal device so as to be communicable, and the nurse call
  • a monitored person monitoring system comprising a central processing unit that receives a notification of a nurse call received by a reception device and reports the nurse call to the terminal device, wherein the terminal device is one of the above-described terminal devices It is.
  • Such a monitored person monitoring system includes any one of the above-described terminal devices, priority is given to establishment of a call, and both video distribution and call establishment are achieved while reducing interruptions in video and calls. Can be achieved as much as possible.
  • the present invention it is possible to provide a terminal device of a monitored person monitoring system, a terminal side monitoring processing method of the terminal apparatus, and the monitored person monitoring system.

Abstract

The present invention provides a terminal device for a system for monitoring a person to be monitored, a terminal-side monitoring processing method, and a system for monitoring a person to be monitored, said system being provided with said terminal device, wherein if initiation of a voice call with a nurse call reception device is received when a motion video delivered from the nurse call reception device is being displayed, a motion video delivery condition setting communication signal, which indicates a motion video delivery condition setting such that communication capacity decreases below that of a motion video delivery condition outside of call time, is transmitted to the nurse call reception device.

Description

被監視者監視システムの端末装置および該端末装置の端末側監視処理方法ならびに被監視者監視システムTerminal device of monitored person monitoring system, terminal side monitoring processing method of the terminal device, and monitored person monitoring system
 本発明は、被監視者を監視するための被監視者監視システムにおける端末装置および該端末装置の端末側監視処理方法ならびに前記被監視者監視システムに関する。 The present invention relates to a terminal device in a monitored person monitoring system for monitoring a monitored person, a terminal side monitoring processing method of the terminal apparatus, and the monitored person monitoring system.
 我が国(日本)は、戦後の高度経済成長に伴う生活水準の向上、衛生環境の改善および医療水準の向上等によって、高齢化社会、より詳しくは、総人口に対する65歳以上の人口の割合である高齢化率が21%を超える超高齢化社会になっている。また、2005年では、総人口約1億2765万人に対し65歳以上の高齢者人口は、約2556万人であったのに対し、2020年では、総人口約1億2411万人に対し高齢者人口は、約3456万人となる予測もある。このような高齢化社会では、病気や怪我や高齢等による看護や介護を必要とする要看護者や要介護者(要看護者等)は、高齢化社会ではない通常の社会で生じる要看介護者よりもその増加が見込まれる。そして、我が国は、例えば2013年の合計特殊出生率が1.43という少子化社会でもある。そのため、高齢な要看護者等を高齢の家族(配偶者、子、兄弟)が介護する老老介護も起きて来ている。 Japan (Japan) is an aging society, more specifically the ratio of population over 65 years old to the total population due to the improvement of living standards accompanying the post-war high economic growth, improvement of sanitary environment and improvement of medical standards, etc. It is a super-aging society with an aging rate exceeding 21%. In 2005, the total population was about 126.5 million, while the elderly population over the age of 65 was about 25.56 million. In 2020, the total population was about 124.11 million. There is also a prediction that the elderly population will be about 34.56 million. In such an aging society, nurses who need nursing or nursing care due to illness, injury, elderly age, etc., or those who need nursing care (such as those who need nursing care) need to take care in a normal society that is not an aging society. It is expected to increase compared to those who are. Japan, for example, is a society with a declining birthrate with a total fertility rate of 1.43 in 2013. For this reason, elderly care has been taking place in which elderly nurses, etc., are cared for by an elderly family (spouse, child, brother).
 要看護者等は、病院や、老人福祉施設(日本の法令では老人短期入所施設、養護老人ホームおよび特別養護老人ホーム等)等の施設に入所し、その看護や介護を受ける。このような施設では、要看護者等が、例えばベッドからの転落や歩行中の転倒等によって怪我を負ったり、ベッドから抜け出して徘徊したりするなどの事態が生じ得る。このような事態に対し、可及的速やかに対応する必要があり、また、このような事態を放置しておくとさらに重大な事態に発展してしまう可能性もあるため、前記施設では、看護師や介護士等は、定期的に巡視することによってその安否や様子を確認している。 Employees requiring nursing care, etc. enter hospitals and facilities for welfare for the elderly (Japanese elderly law short-term entrance facilities, nursing homes for the elderly and special nursing homes for the elderly, etc.) and receive nursing and care. In such a facility, a situation in which a nurse or the like needs to be injured or fallen out of the bed, for example, by falling from the bed or falling while walking can occur. It is necessary to respond to such a situation as quickly as possible, and if such a situation is left unattended, it may develop into a more serious situation. Teachers and caregivers regularly check their safety and condition by patrols.
 しかしながら、要看護者等の増加数に対し看護師等の増加数が追い付かずに、看護業界や介護業界では、慢性的に人手不足になっている。さらに、日勤の時間帯に較べ、準夜勤や夜勤の時間帯では、看護師や介護士等の人数が減るため、一人当たりの業務負荷が増大するので、前記業務負荷の軽減が要請される。また、前記老老介護の事態は、前記施設でも例外ではなく、高齢の要看護者等を高齢の看護師等がケアすることもしばしば見られる。一般に高齢になると体力が衰えるため、健康であっても若い看護師等に比し看護等の負担が重くなり、また、その動きや判断も遅くなる。 However, the increase in the number of nurses etc. cannot keep up with the increase in the number of nurses required, and the nursing industry and the care industry are chronically short of manpower. Furthermore, since the number of nurses, caregivers and the like is reduced in the semi-night shift and night shift hours compared to the day shift hours, the work load per person increases, and thus the work load is required to be reduced. In addition, the situation of the elderly care is not an exception in the facility, and it is often seen that elderly nurses and the like care for elderly nurses and the like. In general, physical strength declines when older, so the burden of nursing etc. becomes heavier than young nurses etc. even if they are healthy, and their movements and judgments are also delayed.
 このような人手不足や看護師等の負担を軽減するため、看護業務や介護業務を補完する技術が求められている。このため、近年では、要看護者等の、監視すべき監視対象である被監視者を監視(モニタ)する被監視者監視技術が研究、開発されている。 In order to reduce the labor shortage and the burden on nurses, a technology that complements nursing work and nursing care work is required. For this reason, in recent years, monitored person monitoring techniques for monitoring a monitored person to be monitored, such as a care recipient, have been researched and developed.
 このような技術の一つとして、例えば特許文献1に開示されたナースコールシステムがある。この特許文献1に開示されたナースコールシステムは、病院、老人福祉施設等の病室毎の各病床に設置され被看護者が看護者を呼び出すためのベッド子機およびベッドサイドに設置され前記ベッド子機に着脱自在で接続されるプレート子機と、前記病室毎に設置され前記被看護者の映像を撮像するための呼出対応カメラと、ナースセンターに設置され前記ベッド子機からの呼び出しを検出して報知し、前記呼び出しを確認した前記看護者が応答して通話を成立するためのナースコール親機とを設け、前記ナースコール親機は、前記呼出対応カメラにて撮像された前記被看護者の映像を出画するための外付け呼出対応モニタが接続され、前記外付け呼出対応モニタは、前記呼出対応カメラが接続され、前記ベッド子機からの呼び出しを検出した前記ナースコール親機により制御され、前記呼出元のベッド子機が接続される前記プレート子機が有する子機番号に対応したカメラ番号を有する当該呼出対応カメラを選択するためのカメラ選択テーブルが記憶された記憶部と、前記記憶部から読み出される前記呼出元のベッド子機が接続される前記プレート子機が有する子機番号に対応したカメラ番号を有する当該呼出対応カメラを駆動して前記被看護者の映像を前記外付け呼出対応モニタに出画するためのカメラ駆動回路とを備える。 For example, there is a nurse call system disclosed in Patent Document 1 as one of such techniques. The nurse call system disclosed in Patent Document 1 is installed on each bed in each hospital room such as a hospital or a welfare facility for the elderly, and is installed on a bed slave for a nurse to call a nurse and on the bedside. A plate slave unit that is detachably connected to a machine, a call-response camera installed in each hospital room for capturing images of the patient, and a call placed from a bed slave unit installed in a nurse center. And a nurse call parent device for the caller to answer and confirm the call, and the nurse call parent device is provided with the nurse call imaged by the call corresponding camera. An external call support monitor for displaying the video of the above is connected, and the external call support monitor is connected to the call support camera and detects a call from the bed slave unit. A camera selection table for selecting a corresponding camera corresponding to a camera number corresponding to a slave unit number of the plate slave unit to which the call slave unit is connected and controlled by the nurse call master unit is stored. The call corresponding camera having a camera number corresponding to the slave unit number of the slave unit connected to the call slave unit that is read from the storage unit and the caller bed slave unit read from the storage unit And a camera drive circuit for displaying the person's video on the external call monitor.
 一方、安否確認の点では、一人暮らしの独居者も前記要介護者等と同様であり、被監視対象者となる。 On the other hand, in terms of safety confirmation, a single person living alone is the same as the care recipient and the like and is a subject to be monitored.
 ところで、前記特許文献1に開示されたナースコールシステムでは、外付け呼出対応モニタに映像が出画されるとともに、ナースコール親機とプレート子機との間で通話もできる(例えば特許文献1の[0029]段落参照)。一般に、映像を収容する一連の通信信号は、比較的大容量となる。このため、通信回線は、大容量な回線が必要となり、コスト高となってしまう。あるいは、大容量な通信回線が利用できない場合では、映像が途切れたり、通話が途切れたりする虞がある。また、通話の確立を優先した場合、映像にディレイが生じる。特に、映像を収容する一連の通信信号の通信を想定していない既設の通信回線が利用される場合、このような場合が生じ易い。 By the way, in the nurse call system disclosed in Patent Document 1, a video is displayed on an external call compatible monitor and a call can be made between the nurse call parent device and the plate child device (for example, Patent Document 1). [0029] See paragraph). In general, a series of communication signals for accommodating video has a relatively large capacity. For this reason, the communication line requires a large capacity line, which increases the cost. Alternatively, when a large-capacity communication line cannot be used, the video may be interrupted or the call may be interrupted. In addition, when priority is given to establishment of a call, a delay occurs in the video. In particular, such a case is likely to occur when an existing communication line that does not assume communication of a series of communication signals that accommodate video is used.
特許第4989172号公報Japanese Patent No. 4989172
 本発明は、上述の事情に鑑みて為された発明であり、その目的は、通話の確立を優先し、映像の途切れと通話の途切れを低減しつつ動画の配信と通話の確立との両立を可能な限り図ることができる被監視者監視システムの端末装置および該端末装置の端末側監視処理方法ならびに前記被監視者監視システムを提供することである。 The present invention is an invention made in view of the above-mentioned circumstances, and its purpose is to prioritize establishment of a call, and to achieve both the distribution of moving images and the establishment of a call while reducing the interruption of the video and the interruption of the call. It is an object of the present invention to provide a terminal device of a monitored person monitoring system, a terminal side monitoring processing method of the terminal device, and the monitored person monitoring system that can be achieved as much as possible.
 本発明にかかる被監視者監視システムの端末装置および端末側監視処理方法ならびに前記端末装置を備えた前記被監視者監視システムは、ナースコール受付装置から配信を受けた動画を表示している際に、前記ナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための動画配信条件設定通信信号を前記ナースコール受付装置へ送信する。 The terminal device and the terminal-side monitoring processing method of the monitored person monitoring system according to the present invention, and the monitored person monitoring system including the terminal device are displaying the moving image received from the nurse call reception device. When the start of a voice call with the nurse call reception device is received, the video distribution condition setting for instructing the setting of the video distribution condition so that the communication capacity is reduced as compared with the video distribution condition in the case of a non-call A communication signal is transmitted to the nurse call reception device.
 上記並びにその他の本発明の目的、特徴及び利点は、以下の詳細な記載と添付図面から明らかになるであろう。 The above and other objects, features and advantages of the present invention will become apparent from the following detailed description and the accompanying drawings.
実施形態における被監視者監視システムの構成を示す図である。It is a figure which shows the structure of the to-be-monitored person monitoring system in embodiment. 実施形態の被監視者監視システムにおけるセンサ装置の構成を示す図である。It is a figure which shows the structure of the sensor apparatus in the to-be-monitored person monitoring system of embodiment. 実施形態の被監視者監視システムにおける管理サーバ装置の構成を示す図である。It is a figure which shows the structure of the management server apparatus in the to-be-monitored person monitoring system of embodiment. 実施形態の被監視者監視システムにおける携帯端末装置の構成を示す図である。It is a figure which shows the structure of the portable terminal device in the to-be-monitored person monitoring system of embodiment. 実施形態における被監視者監視システムの動作を示すシーケンス図である。It is a sequence diagram which shows operation | movement of the to-be-monitored person monitoring system in embodiment. 実施形態の被監視者監視システムにおける携帯端末装置の操作受付に関する動作を示すフローチャートである。It is a flowchart which shows the operation | movement regarding operation reception of the portable terminal device in the to-be-monitored person monitoring system of embodiment. 実施形態の被監視者監視システムにおける携帯端末装置に表示される待受け画面の一例を示す図である。It is a figure which shows an example of the standby screen displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment. 実施形態の被監視者監視システムにおける携帯端末装置に表示される、静止画を表示した監視情報画面の一例を示す図である。It is a figure which shows an example of the monitoring information screen which displayed the still image displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment. 実施形態の被監視者監視システムにおける携帯端末装置に表示される、動画を表示した監視情報画面の一例を示す図である。It is a figure which shows an example of the monitoring information screen which displayed the moving image displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment. 実施形態の被監視者監視システムにおける携帯端末装置に表示される通話中画面の一例を示す図である。It is a figure which shows an example of the screen during a call displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment. 実施形態の被監視者監視システムにおける携帯端末装置に表示される、静止画を表示した監視情報画面の他の一例を示す図である。It is a figure which shows another example of the monitoring information screen which displayed the still image displayed on the portable terminal device in the to-be-monitored person monitoring system of embodiment.
 以下、本発明にかかる実施の一形態を図面に基づいて説明する。なお、各図において同一の符号を付した構成は、同一の構成であることを示し、適宜、その説明を省略する。本明細書において、総称する場合には添え字を省略した参照符号で示し、個別の構成を指す場合には添え字を付した参照符号で示す。 Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached the suffix.
 図1は、実施形態における被監視者監視システムの構成を示す図である。図2は、実施形態の被監視者監視システムにおけるセンサ装置の構成を示す図である。図3は、実施形態の被監視者監視システムにおける管理サーバ装置の構成を示す図である。図4は、実施形態の被監視者監視システムにおける携帯端末装置の構成を示す図である。 FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system according to the embodiment. FIG. 3 is a diagram illustrating a configuration of the management server device in the monitored person monitoring system according to the embodiment. FIG. 4 is a diagram illustrating a configuration of the mobile terminal device in the monitored person monitoring system according to the embodiment.
 実施形態における被監視者監視システムは、監視すべき(見守るべき)監視対象(見守り対象)である被監視者(見守り対象者)Obを監視するものであり、ナースコールを受け付け、動画を含む画像を生成し、音声通話するナースコール受付装置と、前記ナースコール受付装置と通信可能に接続され、前記ナースコール受付装置と音声通話し、前記ナースコール受付装置で生成した動画の配信を受けて前記動画を表示する端末装置と、前記ナースコール受付装置および前記端末装置それぞれと通信可能に接続され、前記ナースコール受付装置で受け付けたナースコールの通報を受けて前記端末装置へ前記ナースコールを通報する中央処理装置とを備える。 The monitored person monitoring system in the embodiment monitors a monitored person (monitoring target) Ob that is a monitoring target (monitoring target) to be monitored (monitored), receives a nurse call, and includes an image. A nurse call reception device that generates a voice call, and is connected to the nurse call reception device in a communicable manner, performs a voice call with the nurse call reception device, and receives the distribution of the video generated by the nurse call reception device. A terminal device that displays a moving image, the nurse call reception device, and the terminal device are communicably connected to each other, and receive the nurse call notification received by the nurse call reception device and report the nurse call to the terminal device. A central processing unit.
 このような被監視者監視システムMSは、より具体的には、例えば、図1に示すように、1または複数のセンサ装置SU(SU-1~SU-4)と、管理サーバ装置SVと、固定端末装置SPと、1または複数の携帯端末装置TA(TA-1、TA-2)とを備え、これらは、有線や無線で、LAN(Local Area Network)、電話網およびデータ通信網等の網(ネットワーク、通信回線)NWを介して通信可能に接続される。ネットワークNWには、通信信号を中継する例えばリピーター、ブリッジ、ルーターおよびクロスコネクト等の中継機が備えられても良い。図1に示す例では、これら複数のセンサ装置SU-1~SU-4、管理サーバ装置SV、固定端末装置SPおよび複数の携帯端末装置TA-1、TA-2は、アクセスポイントAPを含む無線LAN(例えばIEEE802.11規格に従ったLAN等)NWによって互いに通信可能に接続されている。 More specifically, such a monitored person monitoring system MS includes, for example, as shown in FIG. 1, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, A fixed terminal device SP and one or a plurality of portable terminal devices TA (TA-1, TA-2) are provided. These are wired or wireless, such as a LAN (Local Area Network), a telephone network, and a data communication network. Communication is established via a network (network, communication line) NW. The network NW may be provided with relays such as repeaters, bridges, routers, and cross-connects that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the plurality of portable terminal devices TA-1 and TA-2 are wireless including an access point AP. A LAN (for example, a LAN according to the IEEE 802.11 standard) NW is connected to be communicable with each other.
 なお、後述から明らかなように、センサ装置SUは、前記ナースコール受付装置の一例であり、管理サーバ装置SVは、前記中央処理装置の一例であり、前記固定端末装置SPおよび携帯端末装置TAそれぞれは、前記端末装置の一例である。 As will be apparent from the description below, the sensor device SU is an example of the nurse call reception device, the management server device SV is an example of the central processing unit, and each of the fixed terminal device SP and the portable terminal device TA. Is an example of the terminal device.
 被監視者監視システムMSは、被監視者Obに応じて適宜な場所に配設される。被監視者(見守り対象者)Obは、例えば、病気や怪我等によって看護を必要とする者や、身体能力の低下等によって介護を必要とする者や、一人暮らしの独居者等である。特に、早期発見と早期対処とを可能にする観点から、被監視者Obは、例えば異常状態等の所定の不都合な事象がその者に生じた場合にその発見を必要としている者であることが好ましい。このため、被監視者監視システムMSは、被監視者Obの種類に応じて、病院、老人福祉施設および住戸等の建物に好適に配設される。図1に示す例では、被監視者監視システムMSは、複数の被監視者Obが入居する複数の居室RMや、ナースステーション等の複数の部屋を備える介護施設の建物に配設されている。 The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person (person to be watched) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, a single person living alone, or the like. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.
 センサ装置SUは、ネットワークNWを介して他の装置SV、SP、TAと通信する通信機能等を備え、被監視者Obにおける所定の行動を検知してその検知結果を管理サーバ装置SVへ送信し、ナースコールを受け付けてその旨を管理サーバ装置SVへ送信し、端末装置SP、TAとの間で音声通話を行い、そして、動画を含む画像を生成して端末装置SP、TAへ動画を配信する装置である。このようなセンサ装置SUは、例えば、図2に示すように、撮像部11と、センサ側音入出力部(SU音入出力部)12と、ナースコール受付操作部13と、センサ側制御処理部(SU制御処理部)14と、センサ側通信インターフェース部(SU通信IF部)15と、センサ側記憶部(SU記憶部)16とを備える。 The sensor device SU has a communication function for communicating with other devices SV, SP, TA via the network NW, detects a predetermined action in the monitored person Ob, and transmits the detection result to the management server device SV. , Accepts the nurse call, sends a message to the management server SV, makes a voice call with the terminal devices SP and TA, generates an image including a moving image, and distributes the moving image to the terminal devices SP and TA It is a device to do. For example, as shown in FIG. 2, such a sensor device SU includes an imaging unit 11, a sensor side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor side control process. Unit (SU control processing unit) 14, sensor side communication interface unit (SU communication IF unit) 15, and sensor side storage unit (SU storage unit) 16.
 撮像部11は、SU制御処理部14に接続され、SU制御処理部14の制御に従って、画像(画像データ)を生成する装置である。前記画像には、静止画(静止画データ)および動画(動画データ)が含まれる。撮像部11は、監視すべき監視対象である被監視者Obが所在を予定している空間(所在空間、図1に示す例では配設場所の居室RM)を監視可能に配置され、前記所在空間を撮像対象としてその上方から撮像し、前記撮像対象を俯瞰した画像(画像データ)を生成し、前記撮像対象の画像をSU制御処理部14へ出力する。好ましくは、被監視者Ob全体を撮像できる蓋然性が高いことから、撮像部11は、被監視者Obが横臥する寝具(例えばベッド等)における、被監視者Obの頭部が位置すると予定されている予め設定された頭部予定位置(通常、枕の配設位置)の直上から撮像対象を撮像できるように配設される。センサ装置SUは、この撮像部11によって、被監視者Obを、被監視者Obの上方から撮像した画像、好ましくは前記頭部予定位置の直上から撮像した画像を取得する。 The imaging unit 11 is an apparatus that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The image includes a still image (still image data) and a moving image (moving image data). The imaging unit 11 is disposed so as to be able to monitor a space (location space, in the example shown in FIG. 1, where the monitored person Ob that is a monitoring target to be monitored) is located. The space is imaged as an imaging target from above, an image (image data) overlooking the imaging target is generated, and the imaging target image is output to the SU control processing unit 14. Preferably, since there is a high probability that the entire monitored person Ob can be imaged, the imaging unit 11 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed). The sensor device SU uses the imaging unit 11 to acquire an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.
 このような撮像部11は、可視光の画像を生成する装置であって良いが、比較的暗がりでも被監視者Obを監視できるように、本実施形態では、赤外線の画像を生成する装置である。このような撮像部11は、例えば、本実施形態では、撮像対象における赤外の光学像を所定の結像面上に結像する結像光学系、前記結像面に受光面を一致させて配置され、前記撮像対象における赤外の光学像を電気的な信号に変換するイメージセンサ、および、イメージセンサの出力を画像処理することで前記撮像対象における赤外の画像を表すデータである画像データを生成する画像処理部等を備えるデジタル赤外線カメラである。撮像部11の前記結像光学系は、本実施形態では、その配設された居室RM全体を撮像できる画角を持つ広角な光学系(いわゆる広角レンズ(魚眼レンズを含む))であることが好ましい。 Such an imaging unit 11 may be a device that generates an image of visible light, but in the present embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. . For example, in this embodiment, the imaging unit 11 has an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that matches the imaging surface. An image sensor that is arranged and converts an infrared optical image in the imaging target into an electrical signal, and image data that represents an infrared image in the imaging target by performing image processing on the output of the image sensor It is a digital infrared camera provided with the image processing part etc. which produce | generate. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view that can image the entire living room RM in which the imaging unit 11 is disposed. .
 SU音入出力部12は、SU制御処理部14に接続され、外部の音を取得してセンサ装置SUに入力するための回路であって、SU制御処理部14の制御に従って音を表す電気信号に応じた音を生成して出力するための回路である。SU音入出力部12は、例えば、音の音響振動を電気信号に変換するマイクロホン等と、音の電気信号を音の音響振動に変換するスピーカ等とを備えて構成される。SU音入出力部12は、外部の音を表す電気信号をSU制御処理部14へ出力し、また、SU制御処理部14から入力された電気信号を音の音響振動に変換して出力する。 The SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and acquires an external sound and inputs it to the sensor device SU, and represents an electric signal representing the sound according to the control of the SU control processing unit 14 It is a circuit for generating and outputting a sound according to. The SU sound input / output unit 12 includes, for example, a microphone that converts sound acoustic vibrations into electrical signals, and a speaker that converts sound electrical signals into sound acoustic vibrations. The SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, and converts the electric signal input from the SU control processing unit 14 into an acoustic vibration of the sound and outputs the sound.
 ナースコール受付操作部13は、SU制御処理部14に接続され、ナースコールを当該センサ装置SUに入力するための例えば押しボタン式スイッチ等のスイッチ回路である。なお、ナースコール受付操作部13は、有線でSU制御処理部14に接続されて良く、また、例えばBluetooth(登録商標)規格等の近距離無線通信でSU制御処理部14に接続されて良い。 The nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting the nurse call to the sensor device SU. Note that the nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.
 SU通信IF部15は、SU制御処理部14に接続され、SU制御処理部14の制御に従って通信を行うための通信回路である。SU通信IF部15は、SU制御処理部14から入力された転送すべきデータを収容した通信信号を、この被監視者監視システムMSのネットワークNWで用いられる通信プロトコルに従って生成し、この生成した通信信号をネットワークNWを介して他の装置SV、SP、TAへ送信する。SU通信IF部15は、ネットワークNWを介して他の装置SV、SP、TAから通信信号を受信し、この受信した通信信号からデータを取り出し、この取り出したデータをSU制御処理部14が処理可能な形式のデータに変換してSU制御処理部14へ出力する。SU通信IF部15は、例えば、IEEE802.11規格等に従った通信インターフェース回路を備えて構成される。 The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication according to the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing the data to be transferred input from the SU control processing unit 14 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SV, SP, TA via the network NW. The SU communication IF unit 15 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 14 can process the extracted data. The data is converted into data in a proper format and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
 SU記憶部16は、SU制御処理部14に接続され、SU制御処理部14の制御に従って、各種の所定のプログラムおよび各種の所定のデータを記憶する回路である。前記各種の所定のプログラムには、例えば、センサ装置SUの各部を当該各部の機能に応じてそれぞれ制御するSU制御プログラムや、被監視者Obに対する監視に関する情報処理を実行する監視処理プログラム等の制御処理プログラムが含まれる。前記監視処理プログラムには、撮像部1で生成した画像に基づいて被監視者Obにおける所定の行動を検知し、その検知結果を管理サーバ装置SVへ通報する行動検知処理プログラム、ナースコール受付操作部13でナースコールを受け付けた場合にその旨を管理サーバ装置SVへ通報し、SU音入出力部12等を用いることで端末装置SP、TAとの間で音声通話を行うSUナースコール処理プログラム、および、撮像部11で生成した動画を、その動画を要求した端末装置SP、TAへストリーミングで配信する動画配信処理プログラム等が含まれる。前記各種の所定のデータには、自機の、センサ装置SUを特定し識別するための識別子であるセンサ装置識別子(センサID)、動画を配信する際の条件である動画配信条件、および、管理サーバ装置SVの通信アドレス等の各プログラムを実行する上で必要なデータ等が含まれる。SU記憶部16は、例えば不揮発性の記憶素子であるROM(Read Only Memory)や書き換え可能な不揮発性の記憶素子であるEEPROM(Electrically Erasable Programmable Read Only Memory)等を備える。そして、SU記憶部16は、前記所定のプログラムの実行中に生じるデータ等を記憶するいわゆるSU制御処理部14のワーキングメモリとなるRAM(Random Access Memory)等を含む。 The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. The various predetermined programs include, for example, controls such as a SU control program that controls each part of the sensor device SU according to the function of each part, and a monitoring process program that executes information processing related to monitoring of the monitored person Ob. A processing program is included. The monitoring processing program includes a behavior detection processing program for detecting a predetermined behavior in the monitored person Ob based on the image generated by the imaging unit 1 and reporting the detection result to the management server device SV, and a nurse call reception operation unit. 13, when a nurse call is accepted, a SU nurse call processing program for notifying the management server device SV to that effect and performing a voice call with the terminal devices SP and TA by using the SU sound input / output unit 12 and the like, In addition, a moving image distribution processing program for distributing the moving image generated by the imaging unit 11 to the terminal device SP or TA that requested the moving image is included. The various kinds of predetermined data include a sensor device identifier (sensor ID) that is an identifier for identifying and identifying the sensor device SU of the own device, a moving image distribution condition that is a condition for distributing a moving image, and management Data necessary for executing each program such as a communication address of the server apparatus SV is included. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) that serves as a working memory of the so-called SU control processing unit 14 that stores data generated during the execution of the predetermined program.
 そして、SU記憶部16は、前記動画配信条件を記憶するためのセンサ側動画配信条件記憶部(SU動画配信条件記憶部)161を機能的に備える。SU動画配信条件記憶部161に記憶される動画配信条件は、動画のフレームレート、動画のフレームサイズおよび動画の色数等である。このSU動画配信条件記憶部161に記憶される動画配信条件は、初期設定では予め設定された所定のデフォルト値であり、後述するように、動画の配信先の端末装置SP、TAから第1または第2動画配信設定通信信号を受信すると、この受信した第1または第2動画配信設定通信信号に収容された値に書き換えられて更新される。 The SU storage unit 16 functionally includes a sensor-side video distribution condition storage unit (SU video distribution condition storage unit) 161 for storing the video distribution conditions. The moving image distribution conditions stored in the SU moving image distribution condition storage unit 161 include a moving image frame rate, a moving image frame size, a moving image color number, and the like. The moving image distribution condition stored in the SU moving image distribution condition storage unit 161 is a predetermined default value set in advance in the initial setting. As described later, the moving image distribution condition is first or from the terminal device SP or TA that is the moving image distribution destination. When the second moving image distribution setting communication signal is received, it is rewritten and updated to the value accommodated in the received first or second moving image distribution setting communication signal.
 SU制御処理部14は、センサ装置SUの各部を当該各部の機能に応じてそれぞれ制御し、被監視者Obにおける所定の行動を検知してその検知結果を管理サーバ装置SVへ送信し、ナースコールを受け付けてその旨を管理サーバ装置SVへ送信し、端末装置SP、TAとの間で音声通話を行い、そして、動画を含む画像を端末装置SP、TAへ配信するための回路である。SU制御処理部14は、例えば、CPU(Central Processing Unit)およびその周辺回路を備えて構成される。SU制御処理部14は、前記制御処理プログラムが実行されることによって、センサ側制御部(SU制御部)141、行動検知処理部142、センサ側ナースコール処理部(SUナースコール処理部)143および動画配信処理部144を機能的に備える。 The SU control processing unit 14 controls each unit of the sensor device SU according to the function of each unit, detects a predetermined action in the monitored person Ob, transmits the detection result to the management server device SV, and makes a nurse call. Is transmitted to the management server device SV, a voice call is performed with the terminal devices SP and TA, and an image including a moving image is distributed to the terminal devices SP and TA. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. The SU control processing unit 14 executes the control processing program so that a sensor side control unit (SU control unit) 141, a behavior detection processing unit 142, a sensor side nurse call processing unit (SU nurse call processing unit) 143, and A moving image distribution processing unit 144 is functionally provided.
 SU制御部141は、センサ装置SUの各部を当該各部の機能に応じてそれぞれ制御し、センサ装置SUの全体制御を司るものである。 The SU control unit 141 controls each part of the sensor device SU according to the function of each part, and governs overall control of the sensor device SU.
 行動検知処理部142は、撮像部11によって生成された画像に基づいて被監視者Obにおける、予め設定された所定の行動を検知し、その検知結果をSU通信IF部15を介して管理サーバ装置SVへ送信するものである。本実施形態では、前記所定の行動は、例えば、被監視者Obの起床、離床、転倒および転落である。行動検知処理部142は、公知技術によって、撮像部11によって生成された画像に基づいて被監視者Obの起床、離床、転倒および転落を検知する。例えば、行動検知処理部142は、撮像部11によって生成された画像から例えば背景差分法やフレーム差分法によって被監視者Obの人体領域として動体領域を抽出し、この抽出した動体領域の縦横比(アスペクト比)から被監視者Obの姿勢(例えば立位、座位および横臥等)を判定し、この検出した動体領域の位置を検出し、これら判定、検出した被監視者Obの姿勢および位置に基づいて前記起床、離床、転倒および転落の別を判定する。より詳しくは、行動検知処理部142は、例えば、横長なアスペクト比から前記アスペクト比が小さくなるに従って横臥、座位および立位の各姿勢が順次に判定され、ベッド等の寝具上における姿勢が横臥から座位へ変化した場合には起床と判定し、寝具内から立位の姿勢で寝具外へ変化した場合には離床と判定し、寝具の周囲で姿勢が横臥である場合には転落と判定し、そして、前記寝具の周囲の他で姿勢が横臥である場合には転倒と判定する。そして、行動検知処理部142は、被監視者Obにおける所定の行動を検知すると、この検知した行動の種類(この例では起床、離床、転倒および転落のうちの1または複数)を表す検知行動情報、自機のセンサIDおよび前記検知の際に用いられた静止画(前記検知が複数の画像によって実施された場合には例えば最後の画像)を収容した通信信号(イベント通報通信信号)をSU通信IF部15を介して管理サーバ装置SVへ送信する。 The behavior detection processing unit 142 detects a predetermined behavior set in advance in the monitored person Ob based on the image generated by the imaging unit 11, and the detection result is transmitted to the management server device via the SU communication IF unit 15. This is sent to the SV. In the present embodiment, the predetermined action is, for example, getting up, getting out of bed, falling, and falling of the monitored person Ob. The behavior detection processing unit 142 detects wakeup, getting out of bed, falling, and falling of the monitored person Ob based on an image generated by the imaging unit 11 by a known technique. For example, the behavior detection processing unit 142 extracts a moving body region as a human body region of the monitored person Ob from the image generated by the imaging unit 11 by, for example, the background difference method or the frame difference method, and the aspect ratio ( The posture of the monitored person Ob (for example, standing position, sitting position, lying down, etc.) is determined from the aspect ratio, and the position of the detected moving body region is detected. Based on these determinations and the detected posture and position of the monitored person Ob To determine whether to wake up, get out of bed, fall and fall. More specifically, for example, the behavior detection processing unit 142 sequentially determines each posture of lying down, sitting down and standing as the aspect ratio decreases from a horizontally long aspect ratio, and the posture on the bedding such as a bed is determined from lying down. When it changes to the sitting position, it is determined to wake up, when it changes from the bedding to the outside of the bedding in a standing posture, it is determined to get out of bed, and when the posture is lying down around the bedding, it is determined to fall. Then, when the posture is lying on the other side of the bedding, it is determined to fall. And if the action detection process part 142 detects the predetermined action in the to-be-monitored person Ob, the detection action information showing the kind of this detected action (In this example, one or more of getting up, getting out of bed, falling, and falling) The communication signal (event notification communication signal) containing the sensor ID of the own device and the still image used in the detection (for example, the last image when the detection is performed by a plurality of images) The data is transmitted to the management server device SV via the IF unit 15.
 SUナースコール処理部143は、ナースコール受付操作部13でナースコールを受け付けた場合にその旨を管理サーバ装置SVへ通報し、SU音入出力部12等を用いることで端末装置SP、TAとの間で音声通話を行うものである。より具体的には、SUナースコール処理部143は、ナースコール受付操作部13が入力操作されると、ナースコールを受け付けた旨を表すナースコール受付情報および自機のセンサIDを収容した通信信号(イベント通報通信信号)をSU通信IF部15を介して管理サーバ装置SVへ送信する。なお、このナースコールの受付を通報するイベント通報通信信号には、ナースコールを受け付けた際の静止画が収容されても良い。そして、SUナースコール処理部143は、SU音入出力部12等を用い、端末装置SP、TAとの間で例えばVoIP(Voice over Internet Protocol)によって音声通話を行う。 When the nurse call accepting operation unit 13 accepts the nurse call, the SU nurse call processing unit 143 notifies the management server device SV to that effect, and uses the SU sound input / output unit 12 and the like to connect the terminal devices SP and TA. Voice calls between the two. More specifically, when the nurse call reception operation unit 13 is input, the SU nurse call processing unit 143 is a communication signal that contains nurse call reception information indicating that the nurse call has been received and the sensor ID of the own device. (Event report communication signal) is transmitted to the management server device SV via the SU communication IF unit 15. It should be noted that the event notification communication signal for reporting acceptance of the nurse call may contain a still image when the nurse call is accepted. Then, the SU nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to perform a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).
 動画配信処理部144は、撮像部11で生成した動画を、その動画を要求した端末装置SP、TAへ、SU動画配信条件記憶部161に記憶された動画配信条件に従ってストリーミングでSU通信IF部15を介して配信するものである。例えば、撮像部11がフレームレート30f/sであってフレームサイズ1366×768で赤外線画像の動画を生成している場合に、SU動画配信条件記憶部161に記憶された動画配信条件がフレームレート15f/sであってフレームサイズ683×384である場合には、動画配信処理部144は、撮像部11で生成した動画のフレームを1つおきに間引くとともに、撮像部11で生成した動画の画素を1つおきに間引くことによって、SU動画配信条件記憶部161に記憶された動画配信条件に合致した動画を生成し、動画を要求した端末装置SP、TAへストリーミングでSU通信IF部15を介して配信する。なお、撮像部11がフルカラーの動画を生成している場合に、SU動画配信条件記憶部161に記憶された動画配信条件が単色(モノクロ)である場合には、輝度信号と色差信号とで動画データを構成し(撮像部11がRGB信号の動画データを生成している場合にはRGB信号は公知の変換式を用いて輝度信号および色差信号に変換される)、その輝度信号を、動画を要求した端末装置SP、TAへストリーミングでSU通信IF部15を介して配信する。 The moving image distribution processing unit 144 streams the moving image generated by the imaging unit 11 to the terminal devices SP and TA that requested the moving image according to the moving image distribution condition stored in the SU moving image distribution condition storage unit 161. It is delivered via. For example, when the imaging unit 11 generates a moving image of an infrared image with a frame rate of 30 f / s and a frame size of 1366 × 768, the moving image distribution condition stored in the SU moving image distribution condition storage unit 161 is the frame rate of 15 f. / S and the frame size is 683 × 384, the moving image distribution processing unit 144 thins out every other frame of the moving image generated by the image capturing unit 11 and extracts the pixels of the moving image generated by the image capturing unit 11. By thinning out every other video, a video that matches the video delivery conditions stored in the SU video delivery condition storage unit 161 is generated and streamed to the terminal devices SP and TA that requested the video via the SU communication IF unit 15. To deliver. In addition, when the imaging unit 11 generates a full-color moving image, if the moving image distribution condition stored in the SU moving image distribution condition storage unit 161 is a single color (monochrome), the moving image includes a luminance signal and a color difference signal. Data (when the imaging unit 11 generates moving image data of an RGB signal, the RGB signal is converted into a luminance signal and a color difference signal using a known conversion formula), and the luminance signal is converted into a moving image. Distribution is performed via the SU communication IF unit 15 by streaming to the requested terminal devices SP and TA.
 そして、動画配信処理部144は、後述の第1動画配信条件設定通信信号をSU通信IF部15を介して受信すると、この受信した第1動画配信条件設定通信信号に収容された動画配信条件でSU動画配信条件記憶部161の記憶内容を書き換えて更新する。動画配信処理部144は、後述の第2動画配信条件設定通信信号をSU通信IF部15を介して受信すると、この受信した第2動画配信条件設定通信信号に収容された動画配信条件でSU動画配信条件記憶部161の記憶内容を書き換えて更新する。 Then, when the moving image distribution processing unit 144 receives a first moving image distribution condition setting communication signal to be described later via the SU communication IF unit 15, the moving image distribution processing unit 144 uses the moving image distribution condition accommodated in the received first moving image distribution condition setting communication signal. The contents stored in the SU video distribution condition storage unit 161 are rewritten and updated. When the moving image distribution processing unit 144 receives a second moving image distribution condition setting communication signal to be described later via the SU communication IF unit 15, the moving image distribution processing unit 144 performs the SU moving image according to the moving image distribution condition accommodated in the received second moving image distribution condition setting communication signal. The contents stored in the distribution condition storage unit 161 are rewritten and updated.
 図1には、一例として、4個の第1ないし第4センサ装置SU-1~SU-4が示されており、第1センサ装置SU-1は、被監視者Obの一人であるAさんOb-1の居室RM-1(不図示)に配設され、第2センサ装置SU-2は、被監視者Obの一人であるBさんOb-2の居室RM-2(不図示)に配設され、第3センサ装置SU-3は、被監視者Obの一人であるCさんOb-3の居室RM-3(不図示)に配設され、そして、第4センサ装置SU-4は、被監視者Obの一人であるDさんOb-4の居室RM-4(不図示)に配設されている。 FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob. The second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.
 管理サーバ装置SVは、ネットワークNWを介して他の装置SU、SP、TAと通信する通信機能等を備え、センサ装置SUからイベント通報通信信号を受信して被監視者Obに対する監視に関する情報(監視情報)を管理し、前記受信したイベント通報通信信号を所定の端末装置SP、TAへ通報(再通報、転送、送信)し、クライアント(本実施形態では端末装置SP、TA等)の要求に応じたデータを前記クライアントに提供し、被監視者監視システムMS全体を管理する装置である。このような管理サーバ装置SVは、例えば、図3に示すように、サーバ側通信インターフェース部(SV通信IF部)21と、サーバ側制御処理部(SV制御処理部)22と、サーバ側記憶部(SV記憶部)23とを備える。 The management server device SV includes a communication function that communicates with other devices SU, SP, and TA via the network NW, receives information about the event report from the sensor device SU, and monitors information about the monitored person Ob (monitoring). Information), the received event report communication signal is reported (re-reported, transferred, transmitted) to a predetermined terminal device SP, TA, and in response to a request from a client (terminal device SP, TA, etc. in this embodiment) It is a device that provides the data to the client and manages the entire monitored person monitoring system MS. For example, as shown in FIG. 3, the management server device SV includes a server-side communication interface unit (SV communication IF unit) 21, a server-side control processing unit (SV control processing unit) 22, and a server-side storage unit. (SV storage unit) 23.
 SV通信IF部21は、SU通信IF部15と同様に、SV制御処理部22に接続され、SV制御処理部22の制御に従って通信を行うための通信回路である。SV通信IF部21は、例えば、IEEE802.11規格等に従った通信インターフェース回路を備えて構成される。 Similarly to the SU communication IF unit 15, the SV communication IF unit 21 is a communication circuit that is connected to the SV control processing unit 22 and performs communication according to the control of the SV control processing unit 22. The SV communication IF unit 21 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.
 SV記憶部23は、SV制御処理部22に接続され、SV制御処理部22の制御に従って、各種の所定のプログラムおよび各種の所定のデータを記憶する回路である。前記各種の所定のプログラムには、例えば、管理サーバ装置SVの各部を当該各部の機能に応じてそれぞれ制御するSV制御プログラムや、被監視者Obに対する監視に関する所定の処理を実行するSV監視処理プログラム等の制御処理プログラムが含まれる。前記各種の所定のデータには、自機の、管理サーバ装置SVを特定し管理サーバ装置SVを識別するためのサーバ識別子(サーバID)や、被監視者Obに対する監視に関する監視情報や、前記イベント通報通信信号の通報先等の装置間の情報を表す装置間情報等の各プログラムを実行する上で必要なデータ等が含まれる。これら監視情報および装置間情報それぞれを記憶するために、SV記憶部23は、サーバ側監視情報記憶部(SV監視情報記憶部)231および装置間情報記憶部232を機能的に備える。 The SV storage unit 23 is a circuit that is connected to the SV control processing unit 22 and stores various predetermined programs and various predetermined data under the control of the SV control processing unit 22. Examples of the various predetermined programs include an SV control program for controlling each part of the management server device SV in accordance with the function of each part, and an SV monitoring process program for executing a predetermined process related to monitoring of the monitored person Ob. And the like. The various types of predetermined data include a server identifier (server ID) for identifying the management server device SV and identifying the management server device SV, monitoring information related to monitoring of the monitored person Ob, and the event Data necessary for executing each program such as inter-device information indicating information between devices such as a notification destination of the notification communication signal is included. In order to store each of the monitoring information and the inter-device information, the SV storage unit 23 functionally includes a server-side monitoring information storage unit (SV monitoring information storage unit) 231 and an inter-device information storage unit 232.
 SV監視情報記憶部231は、前記監視情報として、本実施形態では、イベント通報通信信号に収容された行動の種類またはナースコールの受付(イベントの種類)、センサIDおよび静止画、ならびに、イベント通報通信信号の受信時刻等を互いに対応付けて記憶するものである。 In the present embodiment, the SV monitoring information storage unit 231 receives, as the monitoring information, the type of action accommodated in the event notification communication signal or reception of a nurse call (type of event), sensor ID and still image, and event notification The reception times of communication signals are stored in association with each other.
 装置間情報記憶部232は、前記装置間情報として、本実施形態では、イベント通報通信信号の送信元であるセンサIDとイベント通報通信信号の通報先通報先(再通報先、転送先、送信先)である端末IDとの対応関係(通報先対応関係)、および、各装置SU、SP、TAのID(センサID、端末ID)とその通信アドレスとの対応関係(通信アドレス対応関係)等を記憶するものである。端末IDは、端末装置SP、TAを特定し端末装置SP、TAを識別するための端末識別子である。なお、センサID、サーバIDおよび端末IDそれぞれは、例えば所定の記号列から成るシリアル番号等であって良く、また例えば通信アドレスであって良い(この場合通信アドレス対応関係は省略できる)。 In the present embodiment, the inter-device information storage unit 232, as the inter-device information, includes a sensor ID that is a transmission source of the event notification communication signal and a notification destination notification destination of the event notification communication signal (rereport destination, transfer destination, transmission destination). ) Corresponding to the terminal ID (report destination correspondence) and the correspondence (communication address correspondence) between the ID of each device SU, SP, TA (sensor ID, terminal ID) and its communication address, etc. It is something to remember. The terminal ID is a terminal identifier for identifying the terminal devices SP and TA and identifying the terminal devices SP and TA. Note that each of the sensor ID, server ID, and terminal ID may be, for example, a serial number composed of a predetermined symbol string, or may be a communication address (in this case, communication address correspondence can be omitted).
 SV制御処理部22は、管理サーバ装置SVの各部を当該各部の機能に応じてそれぞれ制御し、センサ装置SUからイベント通報通信信号を受信して被監視者Obに対する監視に関する情報(監視情報)を管理し、前記受信したイベント通報通信信号を所定の端末装置SP、TAへ通報し、クライアント(本実施形態では端末装置SP、TA等)の要求に応じたデータを前記クライアントに提供し、被監視者監視システムMS全体を管理するための回路である。SV制御処理部22は、例えば、CPUおよびその周辺回路を備えて構成される。SV制御処理部22は、前記制御処理プログラムが実行されることによって、サーバ側制御部(SV制御部)221およびサーバ側監視処理部(SV監視処理部)222を機能的に備える。 The SV control processing unit 22 controls each unit of the management server device SV according to the function of each unit, receives an event notification communication signal from the sensor device SU, and receives information (monitoring information) related to monitoring the monitored person Ob. Managing, reporting the received event report communication signal to a predetermined terminal device SP, TA, providing the client with data according to the request of the client (in this embodiment, the terminal device SP, TA, etc.), and being monitored This is a circuit for managing the entire person monitoring system MS. The SV control processing unit 22 includes, for example, a CPU and its peripheral circuits. The SV control processing unit 22 functionally includes a server side control unit (SV control unit) 221 and a server side monitoring processing unit (SV monitoring processing unit) 222 by executing the control processing program.
 SV制御部221は、管理サーバ装置SVの各部を当該各部の機能に応じてそれぞれ制御し、管理サーバ装置SVの全体制御を司るものである。 The SV control unit 221 controls each unit of the management server device SV according to the function of each unit, and controls the entire management server device SV.
 SV監視処理部222は、センサ装置SUからイベント通報通信信号を受信した場合に、被監視者Obに対する監視に関する監視情報をSV監視情報記憶部231に記憶(記録)し、前記受信したイベント通報通信信号を送信したセンサ装置SUに対応する通報先(再通報先、転送先、送信先)を装置間情報記憶部232に記憶された前記通報先対応関係から選定(検索)し、この選定した端末装置SP、TAへ前記イベント通報通信信号を送信するものである。この選定(検索処理)は、前記受信したイベント通報通信信号を送信したセンサ装置SUに対応するセンサIDに基づいて実施される。ここで、前記再通報されるイベント通報通信信号には、センサ装置SUからイベント通報通信信号の受信時刻、および、動画のダウンロード先として、前記受信したイベント通報通信信号を送信したセンサ装置SUに対応する通信アドレスがさらに収容される。この通信アドレスは、前記受信したイベント通報通信信号を送信したセンサ装置SUに対応するセンサIDに基づいて通信アドレス対応関係から選定(検索)される。 When the SV monitoring processing unit 222 receives an event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 stores (records) monitoring information related to monitoring of the monitored person Ob in the SV monitoring information storage unit 231, and receives the received event notification communication The reporting destination (re-reporting destination, transfer destination, transmission destination) corresponding to the sensor device SU that transmitted the signal is selected (searched) from the reporting destination correspondence stored in the inter-device information storage unit 232, and the selected terminal The event notification communication signal is transmitted to the devices SP and TA. This selection (search process) is performed based on the sensor ID corresponding to the sensor device SU that has transmitted the received event notification communication signal. Here, the event notification communication signal to be re-reported corresponds to the sensor device SU that has transmitted the received event notification communication signal as the reception time of the event notification communication signal from the sensor device SU and the download destination of the moving image. The communication address to be stored is further accommodated. This communication address is selected (searched) from the communication address correspondence relationship based on the sensor ID corresponding to the sensor device SU that has transmitted the received event notification communication signal.
 なお、管理サーバ装置SVは、図3に破線で示すように、必要に応じて、さらに、SV制御処理部22に接続され例えば各種コマンドや各種データ等を入力するサーバ側入力部(SV入力部)24、SV入力部24で入力された各種コマンドや各種データおよび被監視者Obに対する監視に関する監視情報等を出力するサーバ側出力部(SV出力部)25、および、外部機器との間でデータの入出力を行うサーバ側インターフェース部(SVIF部)26等を備えても良い。 The management server device SV is connected to the SV control processing unit 22 as necessary, as shown by a broken line in FIG. 3, for example, a server side input unit (SV input unit) for inputting various commands, various data, and the like. 24) Server side output unit (SV output unit) 25 that outputs various commands and various data input by the SV input unit 24 and monitoring information related to monitoring of the monitored person Ob, and data between external devices A server-side interface unit (SVIF unit) 26 or the like for performing input / output may be provided.
 このような管理サーバ装置SVは、例えば、通信機能付きのコンピュータによって構成可能である。 Such a management server device SV can be configured by a computer with a communication function, for example.
 固定端末装置SPは、ネットワークNWを介して他の装置SU、SV、TAと通信する通信機能、所定の情報を表示する表示機能、および、所定の指示やデータを入力する入力機能等を備え、管理サーバ装置SVや携帯端末装置TAに与える所定の指示やデータを入力したり、センサ装置SUで得られた監視情報を表示したり等することによって、被監視者監視システムMSのユーザインターフェース(UI)として機能する機器である。このような固定端末装置SPは、例えば、通信機能付きのコンピュータによって構成可能である。なお、前記端末装置の一例としての固定端末装置SPは、携帯端末装置TAと同様に動作するが、本明細書では、前記端末装置の一実施形態は、その一例である携帯端末装置TAについて説明される。 The fixed terminal device SP includes a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and the like. The user interface (UI) of the monitored person monitoring system MS is input by inputting predetermined instructions and data to be given to the management server device SV and the portable terminal device TA, or displaying the monitoring information obtained by the sensor device SU. ). Such a fixed terminal device SP can be configured by, for example, a computer with a communication function. The fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in the present specification, an embodiment of the terminal device is described as an example of the mobile terminal device TA. Is done.
 携帯端末装置TAは、ネットワークNWを介して他の装置SV、SP、SUと通信する通信機能、所定の情報を表示する表示機能、所定の指示やデータを入力する入力機能、および、音声通話を行う通話機能等を備え、管理サーバ装置SVやセンサ装置SUに与える所定の指示やデータを入力したり、管理サーバ装置SVからの通報によってセンサ装置SUで得られた監視情報(動画を含む)を表示したり、センサ装置SUとの間で音声通話したり等することによって、被監視者Obに対する前記監視情報を受け付けて表示し、ナースコールの応答や声かけするための機器である。このような携帯端末装置TAは、本実施形態では、例えば、図4に示すように、端末側通信インターフェース部(TA通信IF部)31と、端末側制御処理部(TA制御処理部)32と、端末側記憶部(TA記憶部)33と、端末側音入出力部(TA音入出力部)34と、端末側入力部(TA入力部)35と、端末側表示部(TA表示部)36と、端末側インターフェース部(TAIF部)37とを備える。 The mobile terminal device TA has a communication function for communicating with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. A monitoring function (including moving images) obtained from the sensor device SU by inputting a predetermined instruction or data to be provided to the management server device SV or the sensor device SU, or by a report from the management server device SV. It is a device for receiving and displaying the monitoring information for the monitored person Ob and displaying a response to a nurse call or calling out by displaying or making a voice call with the sensor device SU. In the present embodiment, for example, as shown in FIG. 4, such a portable terminal device TA includes a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, and A terminal side storage unit (TA storage unit) 33, a terminal side sound input / output unit (TA sound input / output unit) 34, a terminal side input unit (TA input unit) 35, and a terminal side display unit (TA display unit). 36 and a terminal-side interface unit (TAIF unit) 37.
 TA音入出力部34は、TA制御処理部32に接続され、外部の音を取得して携帯端末装置TAに入力するためのデバイスであって、TA制御処理部32の制御に従って音を表す電気信号に応じた音を生成して出力するためのデバイスである。TA音入出力部34は、SU音入出部12と同様に、例えば、音響振動を電気信号に変換するマイクロホン等と、音の電気信号を音の音響振動に変換するスピーカ等とを備えて構成される。TA音入出力部34は、外部の音を表す電気信号をTA制御処理部32へ出力し、また、TA制御処理部32から入力された電気信号を音の音響振動に変換して出力する。 The TA sound input / output unit 34 is connected to the TA control processing unit 32 and is a device for acquiring an external sound and inputting it to the mobile terminal device TA. It is a device for generating and outputting sound corresponding to a signal. Similar to the SU sound input / output unit 12, the TA sound input / output unit 34 includes, for example, a microphone that converts acoustic vibration into an electrical signal, a speaker that converts an electrical signal of sound into an acoustic vibration of sound, and the like. Is done. The TA sound input / output unit 34 outputs an electric signal representing an external sound to the TA control processing unit 32, and converts the electric signal input from the TA control processing unit 32 into sound acoustic vibration and outputs the sound.
 TA入力部35は、TA制御処理部32に接続され、例えば、所定の操作を受け付け、携帯端末装置TAに入力するデバイスであり、例えば、所定の機能を割り付けられた複数の入力スイッチ等である。前記所定の操作には、例えば、ログインするためのIDの入力操作や、音声通話の要求操作およびその終了操作や、ライブでの動画の要求操作およびその終了操作や、前記通報された被監視者Obに対する例えば救命、看護、介護および介助等の対応(対処、応対)を実行する意思がある旨(“対応する”)の入力操作等の、監視する上で必要な各種操作等が含まれる。TA表示部36は、TA制御処理部32に接続され、TA制御処理部32の制御に従って、TA入力部35から入力された所定の操作内容、および、被監視者監視システムMSによって監視されている被監視者Obに対する監視に関する前記監視情報(例えばセンサ装置SUで検知した所定の行動の種類やナースコールの受付や被監視者Obの画像(静止画および動画)等)等を表示するデバイスであり、例えばLCD(液晶ディスプレイ)および有機ELディスプレイ等の表示装置である。そして、本実施形態では、TA入力部35およびTA表示部36からタッチパネルが構成されている。この場合において、TA入力部35は、例えば抵抗膜方式や静電容量方式等の操作位置を検出して入力する位置入力デバイスである。このタッチパネルでは、TA表示部36の表示面上に位置入力デバイスが設けられ、TA表示部36に入力可能な1または複数の入力内容の候補が表示され、例えば看護師や介護士等のユーザ(監視者)が、入力したい入力内容を表示した表示位置を触れると、位置入力デバイスによってその位置が検出され、検出された位置に表示された表示内容がユーザの操作入力内容として携帯端末装置TAに入力される。 The TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a device that accepts a predetermined operation and inputs it to the mobile terminal device TA, for example, a plurality of input switches assigned with a predetermined function. . Examples of the predetermined operation include an ID input operation for logging in, a voice call request operation and its end operation, a live video request operation and its end operation, and the reported monitored person. For example, various operations necessary for monitoring, such as an input operation indicating that there is an intention to perform (response, response) such as lifesaving, nursing, nursing care, and assistance for Ob, are included. The TA display unit 36 is connected to the TA control processing unit 32, and is monitored by the monitored person monitoring system MS according to predetermined operation contents input from the TA input unit 35 according to the control of the TA control processing unit 32. It is a device that displays the monitoring information related to the monitoring of the monitored person Ob (for example, the type of predetermined action detected by the sensor device SU, the reception of a nurse call, the image (still image and moving image) of the monitored person Ob), and the like. A display device such as an LCD (Liquid Crystal Display) and an organic EL display. In the present embodiment, the TA input unit 35 and the TA display unit 36 constitute a touch panel. In this case, the TA input unit 35 is a position input device that detects and inputs an operation position such as a resistance film method or a capacitance method. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more input content candidates that can be input are displayed on the TA display unit 36. For example, a user such as a nurse or a caregiver ( When the monitor) touches the display position where the input content to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the portable terminal device TA as the operation input content of the user. Entered.
 TAIF部37は、TA制御処理部32に接続され、TA制御処理部32の制御に従って、外部機器との間でデータの入出力を行うデバイスであり、例えば、Bluetooth(登録商標)規格を用いたインターフェース回路、IrDA規格等の赤外線通信を行うインターフェース回路、および、USB規格を用いたインターフェース回路等である。 The TAIF unit 37 is a device that is connected to the TA control processing unit 32 and inputs / outputs data to / from an external device according to the control of the TA control processing unit 32. For example, the TAIF unit 37 uses the Bluetooth (registered trademark) standard. An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, and an interface circuit that uses the USB standard.
 TA通信IF部31は、SU通信IF部15と同様に、TA制御処理部32に接続され、TA制御処理部32の制御に従って通信を行うための通信デバイスである。TA通信IF部31は、TA制御処理部32から入力された転送すべきデータを収容した通信信号を、この被監視者監視システムMSのネットワークNWで用いられる通信プロトコルに従って生成し、この生成した通信信号をネットワークNWを介して他の装置SU、SV、SPへ送信する。TA通信IF部31は、ネットワークNWを介して他の装置SU、SV、SPから通信信号を受信し、この受信した通信信号からデータを取り出し、この取り出したデータをTA制御処理部32が処理可能な形式のデータに変換してTA制御処理部32へ出力する。TA通信IF部31は、例えば、IEEE802.11規格等に従った通信インターフェース回路を備えて構成される。 The TA communication IF unit 31 is a communication device that is connected to the TA control processing unit 32 and performs communication according to the control of the TA control processing unit 32, similarly to the SU communication IF unit 15. The TA communication IF unit 31 generates a communication signal containing the data to be transferred input from the TA control processing unit 32 in accordance with the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SU, SV, SP via the network NW. The TA communication IF unit 31 receives a communication signal from another device SU, SV, SP via the network NW, extracts data from the received communication signal, and the TA control processing unit 32 can process the extracted data. The data is converted into data of a proper format and output to the TA control processing unit 32. The TA communication IF unit 31 includes, for example, a communication interface circuit that conforms to the IEEE 802.11 standard or the like.
 TA記憶部33は、TA制御処理部32に接続され、TA制御処理部32の制御に従って、各種の所定のプログラムおよび各種の所定のデータを記憶する回路である。前記各種の所定のプログラムには、例えば、携帯端末装置TAの各部を当該各部の機能に応じてそれぞれ制御するTA制御プログラムや、被監視者Obに対する監視に関する所定の処理を実行するTA監視処理プログラムや、TA音入出力部12等を用いることでセンサ装置SUとの間で音声通話を行うTAナースコール処理プログラムや、センサ装置SUから配信を受けた動画をTA表示部36に表示している際に、TA入力部35でセンサ装置SUとの音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための通信信号(第1動画配信条件設定通信信号)をTA通信IF部31を介してセンサ装置SUへ送信し、TA入力部35でセンサ装置SUとの音声通話の終了を受け付けた場合に、非通話の場合における動画配信条件の設定を指示するための通信信号(第2動画配信条件設定通信信号)をTA通信IF部31を介してセンサ装置SUへ送信する動画受信処理プログラム等の制御処理プログラムが含まれる。前記各種の所定のデータでは、自機の端末ID、TA表示部36に表示される画面情報、被監視者Obに対する監視に関する前記監視情報、および、センサ装置SUが動画を配信する際の条件である動画配信条件等の各プログラムを実行する上で必要なデータ等が含まれる。TA記憶部33は、例えばROMやEEPROM等を備える。TA記憶部33は、前記所定のプログラムの実行中に生じるデータ等を記憶するいわゆるTA制御処理部32のワーキングメモリとなるRAM等を含む。そして、TA記憶部33は、前記監視情報を記憶するための端末側監視情報記憶部(TA監視情報記憶部)331、および、前記動画配信条件を記憶するための端末側動画配信条件記憶部(TA動画配信条件記憶部)332を機能的に備える。 The TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. Examples of the various predetermined programs include a TA control program for controlling each part of the mobile terminal device TA according to the function of each part, and a TA monitoring process program for executing a predetermined process related to monitoring of the monitored person Ob. In addition, a TA nurse call processing program for performing a voice call with the sensor device SU by using the TA sound input / output unit 12 or the like, and a moving image received from the sensor device SU are displayed on the TA display unit 36. When the start of a voice call with the sensor device SU is received at the TA input unit 35, the setting of the moving image distribution condition is instructed so that the communication capacity is reduced as compared with the moving image distribution condition in the case of a non-call. Communication signal (first video distribution condition setting communication signal) is transmitted to the sensor device SU via the TA communication IF unit 31, and the TA input unit 35 transmits the sensor device SU. When the termination of the voice call is accepted, a communication signal (second moving image distribution condition setting communication signal) for instructing the setting of the moving image distribution condition in the case of non-call is sent via the TA communication IF unit 31 to the sensor device SU. A control processing program such as a moving image reception processing program to be transmitted to is included. In the various predetermined data, the terminal ID of the own device, the screen information displayed on the TA display unit 36, the monitoring information related to the monitoring of the monitored person Ob, and the conditions when the sensor device SU distributes the moving image Data necessary for executing each program such as certain moving image distribution conditions is included. The TA storage unit 33 includes, for example, a ROM and an EEPROM. The TA storage unit 33 includes a RAM serving as a working memory for the so-called TA control processing unit 32 that stores data generated during execution of the predetermined program. The TA storage unit 33 includes a terminal side monitoring information storage unit (TA monitoring information storage unit) 331 for storing the monitoring information, and a terminal side moving image distribution condition storage unit (for storing the moving image distribution conditions). TA animation distribution condition storage unit) 332 is functionally provided.
 TA監視情報記憶部331は、前記監視情報として、本実施形態では、前記再通報のイベント通報通信信号に収容された行動の種類またはナースコールの受付(イベントの種類)、センサID、静止画、動画のダウンロード先の通信アドレス、および、センサ装置SUから管理サーバ装置SVが受信したイベント通報通信信号の受信時刻等を互いに対応付けて記憶するものである。 In this embodiment, the TA monitoring information storage unit 331 receives the type of action or reception of a nurse call (type of event), sensor ID, still image, The communication address of the moving image download destination, the reception time of the event notification communication signal received by the management server device SV from the sensor device SU, and the like are stored in association with each other.
 TA動画配信条件記憶部332は、予め設定された、センサ装置SUが動画を配信する際の条件である動画配信条件を予め記憶するものである。TA動画配信条件記憶部332に予め記憶される動画配信条件は、非通話の場合に用いられる動画配信条件(非通話時動画配信条件、デフォルト値)、および、通話の場合に用いられる動画配信条件(通話時動画配信条件)を備えて成り、前記通話時動画配信条件は、前記非通話時動画配信条件よりも通信容量が低減するように予め設定される。より具体的には、前記通話時動画配信条件は、動画のフレームレート、動画のフレームサイズおよび動画の色数のうちの1または複数を、前記非通話時動画配信条件よりも通信容量が低減するように予め設定される。例えば、前記通話時動画配信条件は、そのフレームレートが前記非通話時動画配信条件のフレームレートより低下するように予め設定される。一例では、前記非通話時動画配信条件のフレームレートは、30f/sに予め設定され、前記通話時動画配信条件のフレームレートは、15f/sに予め設定される。また例えば、前記通話時動画配信条件は、そのフレームサイズが前記非通話時動画配信条件のフレームサイズより小さくなるように予め設定される。一例では、前記非通話時動画配信条件のフレームサイズは、1366×768に予め設定され、前記通話時動画配信条件のフレームサイズは、683×384に予め設定される。また例えば、前記通話時動画配信条件は、その色数が前記非通話時動画配信条件の色数より少なくなるように予め設定される。一例では、前記非通話時動画配信条件の色数は、フルカラーに予め設定され、前記通話時動画配信条件の色数は、単色(モノクロ)に予め設定される。また例えば、前記通話時動画配信条件は、そのフレームレートおよびフレームサイズそれぞれが前記非通話時動画配信条件におけるフレームレートおよびフレームサイズそれぞれより低下するように予め設定される。一例では、前記非通話時動画配信条件のフレームレートは、30f/sに予め設定され、そのフレームサイズは、サイズ1366×768に予め設定され、前記通話時動画配信条件のフレームレートは、15f/sに予め設定され、そのフレームサイズは、683×384に予め設定される。 The TA moving image distribution condition storage unit 332 stores in advance moving image distribution conditions that are preset when the sensor device SU distributes moving images. The moving image distribution conditions stored in advance in the TA moving image distribution condition storage unit 332 include moving image distribution conditions (non-call moving image distribution conditions, default values) used for non-calls, and moving image distribution conditions used for calls. (Calling video distribution condition), and the calling video distribution condition is set in advance so that the communication capacity is reduced as compared with the non-calling video distribution condition. More specifically, the call video distribution condition is such that one or more of a video frame rate, a video frame size, and a video color number are reduced in communication capacity compared to the non-call video distribution condition. It is preset as follows. For example, the on-call moving image delivery condition is set in advance so that the frame rate is lower than the frame rate of the non-call on-call moving image delivery condition. In one example, the frame rate of the non-call moving picture delivery condition is preset to 30 f / s, and the frame rate of the call moving picture delivery condition is preset to 15 f / s. For example, the on-call moving image distribution condition is set in advance so that the frame size is smaller than the frame size of the non-call moving image distribution condition. In one example, the frame size of the non-call video distribution condition is preset to 1366 × 768, and the frame size of the call video distribution condition is preset to 683 × 384. In addition, for example, the on-call video distribution condition is set in advance so that the number of colors is smaller than the number of colors on the non-call video distribution condition. In one example, the number of colors in the non-call video distribution condition is preset to full color, and the number of colors in the video distribution condition during call is preset to a single color (monochrome). Further, for example, the on-call moving picture distribution conditions are set in advance such that the frame rate and the frame size are lower than the frame rate and the frame size in the non-call moving picture distribution conditions, respectively. In one example, the frame rate for the non-call video delivery condition is preset to 30 f / s, the frame size is preset to a size of 1366 × 768, and the frame rate for the call video delivery condition is 15 f / s. s is preset, and its frame size is preset to 683 × 384.
 なお、これら非通話時動画配信条件および通話時動画配信条件それぞれは、TA通信IF部31を介して管理サーバ装置SVからダウンロードされ、TA動画配信条件記憶部332に予め記憶されても良い。これによれば、被監視者監視システムMSが複数の端末装置SP、TAを備える場合に全ての端末装置SP、TAに等しい動画配信条件を記憶させることができる。 Note that each of the non-call video delivery conditions and the call video delivery conditions may be downloaded from the management server device SV via the TA communication IF unit 31 and stored in the TA video delivery condition storage unit 332 in advance. According to this, in the case where the monitored person monitoring system MS includes a plurality of terminal devices SP and TA, it is possible to store a moving image distribution condition equal to all the terminal devices SP and TA.
 TA制御処理部32は、携帯端末装置TAの各部を当該各部の機能に応じてそれぞれ制御し、被監視者Obに対する前記監視情報を受け付けて表示し、ナースコールの応答や声かけするための回路である。TA制御処理部32は、SU制御処理部14と同様に、例えば、CPUおよびその周辺回路を備えて構成される。TA制御処理部32は、制御処理プログラムが実行されることによって、端末側制御部(TA制御部)321、端末側監視処理部(TA監視処理部)322、端末側ナースコール処理部(TAナースコール処理部)323および動画受信処理部324を機能的に備える。 The TA control processing unit 32 is a circuit for controlling each unit of the mobile terminal device TA according to the function of each unit, receiving and displaying the monitoring information for the monitored person Ob, and answering or calling a nurse call. It is. Similar to the SU control processing unit 14, the TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. The TA control processing unit 32 executes a terminal processing unit (TA control unit) 321, a terminal side monitoring processing unit (TA monitoring processing unit) 322, a terminal side nurse call processing unit (TA nurse) by executing a control processing program. A call processing unit 323 and a moving image reception processing unit 324 are functionally provided.
 TA制御部321は、携帯端末装置TAの各部を当該各部の機能に応じてそれぞれ制御し、携帯端末装置TAの全体制御を司るものである。 The TA control unit 321 controls each part of the mobile terminal apparatus TA according to the function of each part, and controls the entire mobile terminal apparatus TA.
 TA監視処理部322は、被監視者Obに対する監視に関する所定の処理を実行するものである。より具体的には、TA監視処理部322は、管理サーバ装置SVから再通報のイベント通報通信信号を受信した場合に、この受信したイベント通報通信信号に収容された各情報(各データ)に基づき、被監視者Obに対する監視に関する前記被監視者Obに対する監視に関する監視情報をTA監視情報記憶部331に記憶(記録)し、前記受信した再通報のイベント通報通信信号に収容された各情報に応じた画面をTA表示部36に表示する。そして、TA監視処理部322は、TA入力部35から所定の入力操作を受け付けると、その入力操作に応じた所定の処理を実行する。より詳しくは、例えば、TA監視処理部322は、ライブでの動画の要求操作をTA入力部35から受け付けると、センサ装置SUへ動画の配信を要求して動画をTA表示部36に表示し、その終了操作をTA入力部35から受け付けると、センサ装置SUへ動画の配信の停止を要求してTA表示部36での動画の表示を終了する。また例えば、TA監視処理部322は、再通報されたイベント通報通信信号にかかる被監視者Obに対する例えば救命、看護、介護および介助等の対応を実行する意思がある旨(“対応する”)の入力操作を受け付けると、その旨を他の端末装置SP、TAへ管理サーバ装置SVを介して通報する。また例えば、TA監視処理部322は、音声通話の要求操作をTA入力部35から受け付けると、TAナースコール処理部323によって、センサ装置SUへ音声通話を要求してセンサ装置SUとの間で音声通話を行い、その終了操作をTA入力部35から受け付けると、TAナースコール処理部323によって、センサ装置SUへ音声通話の終了を要求してセンサ装置SUとの間での音声通話を終了する。 The TA monitoring processing unit 322 executes predetermined processing related to monitoring of the monitored person Ob. More specifically, when the TA monitoring processing unit 322 receives an event notification communication signal for re-reporting from the management server device SV, the TA monitoring processing unit 322 is based on each information (each data) accommodated in the received event notification communication signal. The monitoring information related to the monitoring of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331 according to each information contained in the received re-reporting event notification communication signal. The displayed screen is displayed on the TA display unit 36. Then, when receiving a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process corresponding to the input operation. More specifically, for example, when the TA monitor processing unit 322 receives a live video request operation from the TA input unit 35, the TA monitor processing unit 322 requests the sensor device SU to distribute the video and displays the video on the TA display unit 36. When the end operation is received from the TA input unit 35, the sensor device SU is requested to stop moving image distribution, and the display of the moving image on the TA display unit 36 is ended. Further, for example, the TA monitoring processing unit 322 indicates that there is an intention to perform, for example, lifesaving, nursing, nursing care, assistance, etc. for the monitored person Ob related to the re-reported event notification communication signal (“correspond”). When the input operation is accepted, the fact is notified to the other terminal devices SP and TA via the management server device SV. Further, for example, when the TA monitoring processing unit 322 receives a voice call request operation from the TA input unit 35, the TA nurse call processing unit 323 requests a voice call to the sensor device SU by the TA nurse call processing unit 323 and performs voice communication with the sensor device SU. When a call is made and an end operation is accepted from the TA input unit 35, the TA nurse call processing unit 323 requests the sensor device SU to end the voice call and ends the voice call with the sensor device SU.
 TAナースコール処理部323は、TA音入出力部34等を用いることでセンサ装置SUとの間で音声通話を行うものである。より具体的には、TAナースコール処理部323は、TA音入出力部34等を用い、イベント通報通信信号を管理サーバ装置SVへ送信した送信元のセンサ装置SUとの間で例えばVoIP(Voice over Internet Protocol)によって音声通話を行う。 The TA nurse call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 or the like. More specifically, the TA nurse call processing unit 323 uses, for example, the VoIP (Voice) with the transmission source sensor device SU that has transmitted the event notification communication signal to the management server device SV using the TA sound input / output unit 34 or the like. Make a voice call using the Over Internet Protocol.
 動画受信処理部324は、センサ装置SUから配信を受けた動画をTA表示部36に表示している際に、TA入力部35でセンサ装置SUとの音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための第1動画配信条件設定通信信号をTA通信IF部31を介してセンサ装置SUへ送信し、TA入力部35でセンサ装置SUとの音声通話の終了を受け付けた場合に、非通話の場合における動画配信条件の設定を指示するための第2動画配信条件設定通信信号をTA通信IF部31を介してセンサ装置SUへ送信するものである。より具体的には、動画受信処理部324は、センサ装置SUから配信を受けた動画をTA表示部36に表示している際に、TA入力部35でセンサ装置SUとの音声通話の開始を受け付けた場合に、TA動画配信条件記憶部332に記憶されている通話時動画配信条件を取り出し、この取り出した通話時動画配信条件で動画の配信を指示(命令)する旨を表す情報(動画配信条件設定指示情報、動画配信条件設定コマンド)、および、当該携帯端末装置TAに動画を配信しているセンサ装置SUに対応するセンサIDを収容した第1動画配信条件設定通信信号をTA通信IF部31を介してセンサ装置SUへ送信する。そして、動画受信処理部324は、TA入力部35でセンサ装置SUとの音声通話の終了を受け付けた場合に、TA動画配信条件記憶部332に記憶されている非通話時動画配信条件を取り出し、この取り出した非通話時動画配信条件で動画の配信を指示(命令)する旨を表す動画配信条件設定指示情報(動画配信条件設定コマンド)、および、当該携帯端末装置TAに動画を配信しているセンサ装置SUに対応するセンサIDを収容した第2動画配信条件設定通信信号をTA通信IF部31を介してセンサ装置SUへ送信する。 When the moving image receiving processing unit 324 displays the moving image received from the sensor device SU on the TA display unit 36 and the TA input unit 35 receives the start of a voice call with the sensor device SU, A first video distribution condition setting communication signal for instructing the setting of the video distribution conditions is transmitted to the sensor device SU via the TA communication IF unit 31 so as to reduce the communication capacity compared to the video distribution conditions in the case of a call. When the TA input unit 35 accepts the end of the voice call with the sensor device SU, the TA communication IF unit 31 sends a second video distribution condition setting communication signal for instructing the setting of the video distribution condition in the case of non-call. Is transmitted to the sensor device SU. More specifically, the moving image reception processing unit 324 starts a voice call with the sensor device SU at the TA input unit 35 when the moving image received from the sensor device SU is displayed on the TA display unit 36. When received, information (video distribution) indicating that the video distribution conditions during a call stored in the TA video distribution condition storage unit 332 are taken out and that video distribution is instructed (commanded) under the extracted video distribution conditions during a call Condition setting instruction information, moving image distribution condition setting command), and the first moving image distribution condition setting communication signal containing the sensor ID corresponding to the sensor device SU that distributes the moving image to the mobile terminal device TA. It transmits to sensor device SU via 31. Then, when the TA input unit 35 accepts the end of the voice call with the sensor device SU, the video reception processing unit 324 takes out the non-call video distribution conditions stored in the TA video distribution condition storage unit 332, Video distribution condition setting instruction information (video distribution condition setting command) indicating that a video distribution is instructed (commanded) under the extracted non-call video distribution conditions, and a video is distributed to the mobile terminal device TA. A second moving image distribution condition setting communication signal containing a sensor ID corresponding to the sensor device SU is transmitted to the sensor device SU via the TA communication IF unit 31.
 このような携帯端末装置TAは、例えば、いわゆるタブレット型コンピュータやスマートフォンや携帯電話機等の、持ち運び可能な通信端末装置によって構成可能である。 Such a portable terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, a smartphone, or a mobile phone.
 次に、本実施形態における被監視者監視システムMSの動作および携帯端末装置TAにおける入力操作を受け付けた際の動作について説明する。図5は、実施形態における被監視者監視システムの動作を示すシーケンス図である。図6は、実施形態の被監視者監視システムにおける携帯端末装置の入力操作の受付けに関する動作を示すフローチャートである。図7は、実施形態の被監視者監視システムにおける携帯端末装置に表示される待受け画面の一例を示す図である。図8は、実施形態の被監視者監視システムにおける携帯端末装置に表示される、静止画を表示した監視情報画面の一例を示す図である。図9は、実施形態の被監視者監視システムにおける携帯端末装置に表示される、動画を表示した監視情報画面の一例を示す図である。 Next, the operation of the monitored person monitoring system MS in this embodiment and the operation when an input operation in the portable terminal device TA is received will be described. FIG. 5 is a sequence diagram illustrating the operation of the monitored person monitoring system according to the embodiment. FIG. 6 is a flowchart illustrating an operation related to receiving an input operation of the mobile terminal device in the monitored person monitoring system according to the embodiment. FIG. 7 is a diagram illustrating an example of a standby screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment. FIG. 8 is a diagram illustrating an example of a monitoring information screen displaying a still image displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment. FIG. 9 is a diagram illustrating an example of a monitoring information screen displaying a moving image displayed on the mobile terminal device in the monitored person monitoring system of the embodiment.
 このような被監視者監視システムMSでは、各装置SU、SV、SP、TAは、電源が投入されると、必要な各部の初期化を実行し、その稼働を始める。また、センサ装置SUでは、その制御処理プログラムの実行によって、SU制御処理部14には、SU制御部141、行動検知処理部142、SUナースコール処理部143および動画配信処理部144が機能的に構成される。管理サーバ装置SVでは、その制御処理プログラムの実行によって、SV制御処理部22には、SV制御部221およびSV監視処理部222が機能的に構成される。そして、携帯端末装置TAでは、その制御処理プログラムの実行によって、TA制御処理部32には、TA制御部321、TA監視処理部322、TAナースコール処理部323および動画受信処理部324が機能的に構成される。 In such a monitored person monitoring system MS, each device SU, SV, SP, TA performs initialization of each necessary part and starts its operation when the power is turned on. Further, in the sensor device SU, by executing the control processing program, the SU control processing unit 14 is functionally provided with the SU control unit 141, the behavior detection processing unit 142, the SU nurse call processing unit 143, and the moving image distribution processing unit 144. Composed. In the management server device SV, the SV control processing unit 22 is functionally configured with the SV control processing unit 221 and the SV monitoring processing unit 222 by executing the control processing program. In the portable terminal device TA, the TA control processing unit 32 is functionally provided with a TA control unit 321, a TA monitoring processing unit 322, a TA nurse call processing unit 323, and a moving image reception processing unit 324 by executing the control processing program. Configured.
 携帯端末装置TAでは、例えば看護師や介護士等の監視者(ユーザ)によるログイン操作を受け付けると、TA監視処理部322によって、自機宛の通信信号を待ち受ける待受け画面がTA表示部36に表示される。この待受け画面51は、例えば、図7に示すように、メニューバーを表示するメニューバー領域511と、待ち受け中であることを表すメッセージ(例えば「通知はありません」)およびアイコンを表示する待受けメイン領域512と、現在時刻を表示する時刻領域513と、今日の年月日曜日を表示する年月日曜日領域514と、今、当該携帯端末装置TAにログインしているユーザ名を表示するユーザ名領域515とを備える。 In the portable terminal device TA, for example, when a login operation by a supervisor (user) such as a nurse or a caregiver is accepted, a standby screen waiting for a communication signal addressed to the own device is displayed on the TA display unit 36 by the TA monitoring processing unit 322. Is done. For example, as shown in FIG. 7, the standby screen 51 includes a menu bar area 511 for displaying a menu bar, and a standby main area for displaying a message indicating standby (for example, “no notification”) and an icon. 512, a time area 513 for displaying the current time, a year / month / sunday area 514 for displaying the current year / month / sunday, and a user name area 515 for displaying the name of the user who is currently logged in to the portable terminal device TA. Is provided.
 そして、図5において、センサ装置SUは、所定のフレームレート(例えば24f/sや30f/s等)に応じた時間間隔で撮像部11によって画像を取得し、SU制御処理部14の行動検知処理部142によって、この撮像部11で取得した画像に基づいて被監視者Obにおける所定の行動(状態、状況)を判定する。この判定の結果、被監視者Obが予め設定された前記所定の行動(例えば、本実施形態では起床、離床、転倒および転落)であると判定すると(C1)、イベント通報通信信号をSU通信IF部15を介して管理サーバ装置SVへ送信する(C2)。 In FIG. 5, the sensor device SU acquires an image by the imaging unit 11 at a time interval according to a predetermined frame rate (for example, 24 f / s, 30 f / s, etc.), and the action detection process of the SU control processing unit 14 The unit 142 determines a predetermined action (state, situation) in the monitored person Ob based on the image acquired by the imaging unit 11. As a result of this determination, if it is determined that the monitored person Ob is the predetermined action set in advance (for example, in this embodiment, getting up, getting out of the floor, falling and falling) (C1), the event notification communication signal is sent to the SU communication IF. The data is transmitted to the management server device SV via the unit 15 (C2).
 管理サーバ装置SVは、センサ装置SUからイベント通報通信信号を受信すると、SV制御処理部22のSV監視処理部222によって、この受信したイベント通報通信信号に基づき、被監視者Obに対する監視に関する監視情報をSV監視情報記憶部231に記憶(記録)する。そして、前記受信したイベント通報通信信号を送信したセンサ装置SUに対応する通報先通報先(再通報先、転送先、送信先)を装置間情報記憶部232に記憶された前記通報先対応関係から選定(検索)し、この選定した端末装置SP、TAへ前記イベント通報通信信号をSV通信IF部21を介して送信(再通報)する(C3)。これによって被監視者Obの状態(状況)が端末装置SP、TAを介して例えば看護師や介護士等の監視者に報知される。 When the management server device SV receives the event notification communication signal from the sensor device SU, the SV monitoring processing unit 222 of the SV control processing unit 22 performs monitoring information on monitoring of the monitored person Ob based on the received event notification communication signal. Is stored (recorded) in the SV monitoring information storage unit 231. Then, the notification destination notification destination (re-report destination, transfer destination, transmission destination) corresponding to the sensor device SU that has transmitted the received event notification communication signal is determined from the notification destination correspondence stored in the inter-device information storage unit 232. Select (search) and transmit (re-report) the event notification communication signal to the selected terminal devices SP and TA via the SV communication IF unit 21 (C3). As a result, the state (situation) of the monitored person Ob is notified to a monitor such as a nurse or a caregiver via the terminal devices SP and TA.
 携帯端末装置TAは、前記再通報のイベント通報通信信号を管理サーバ装置SVから受信すると、この受信した再通報のイベント通報通信信号に基づき、被監視者Obに対する監視に関する監視情報をTA監視情報記憶部331に記憶(記録)し、前記受信した再通報のイベント通報通信信号に収容された情報に応じた画面(監視情報画面)をTA表示部36に表示する(C4)。なお、上述したように、前記端末装置の一例としての固定端末装置SPは、携帯端末装置TAと同様に動作するが、ここでは、その動作は、携帯端末装置TAについて説明される。 When the mobile terminal device TA receives the re-report event notification communication signal from the management server device SV, the mobile terminal device TA stores monitoring information related to monitoring of the monitored person Ob based on the received re-report event notification communication signal. A screen (monitoring information screen) corresponding to the information stored in (recorded) in the unit 331 and accommodated in the received re-report event notification communication signal is displayed on the TA display unit 36 (C4). As described above, the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. Here, the operation is described for the mobile terminal device TA.
 前記監視情報画面52aは、例えば、図8に示すように、メニューバー領域511と、センサIDのセンサ装置SUの配設場所および前記センサIDの前記センサ装置SUによって監視される被監視者Obの名前を表示する被監視者名領域521と、受信時刻からの経過時間および判定結果を象徴的に表すアイコンを表示するアイコン領域522と、前記センサIDの前記センサ装置SUによって撮像された画像(ここでは静止画)を表示する画像領域523aと、「対応する」ボタン524と、「話す」ボタン525と、「LIVEを見る」ボタン526とを備える。「対応する」ボタン524は、前記センサIDの前記センサ装置SUによって監視される被監視者Obに対する例えば看護等の前記対応を実行する意思が当該携帯端末装置TAのユーザにあることを当該携帯端末装置TAに入力し、前記意思が入力されたことを他の端末装置SP、TAに通報させる指示を、当該携帯端末装置SUに入力するためのボタンである。「話す」ボタン525は、前記センサIDの前記センサ装置SUと当該携帯端末装置TAとをネットワークNWを介して通話可能に接続する指示を入力するためのボタンである。「LIVEを見る」ボタン526は、前記センサIDの前記センサ装置SUによって撮像される動画を配信させ表示させる指示を入力するためのボタンである。なお、センサIDと、そのセンサIDのセンサ装置SUの配設場所と、そのセンサIDのセンサ装置SUによって監視される被監視者Obの名前との対応関係や、判定結果を象徴的に表すアイコンは、管理サーバ装置SVから通知されることによって、あるいは、予め入力されることによって、TA記憶部33に前記各種の所定のデータの1つとして記憶されている。 For example, as shown in FIG. 8, the monitoring information screen 52a includes a menu bar area 511, an arrangement location of the sensor device SU of the sensor ID, and the monitored person Ob monitored by the sensor device SU of the sensor ID. Monitored person name area 521 for displaying a name, icon area 522 for displaying an icon that represents an elapsed time from the reception time and a determination result, and an image captured by the sensor device SU of the sensor ID (here , A still image) image area 523a, a “corresponding” button 524, a “speak” button 525, and a “watch live” button 526. The “corresponding” button 524 indicates that the user of the mobile terminal device TA has the intention to execute the response such as nursing to the monitored person Ob monitored by the sensor device SU of the sensor ID. It is a button for inputting to the portable terminal device SU an instruction to input to the device TA and notify the other terminal devices SP and TA that the intention has been input. The “speak” button 525 is a button for inputting an instruction to connect the sensor device SU of the sensor ID and the mobile terminal device TA so as to be able to talk over the network NW. The “LIVE” button 526 is a button for inputting an instruction to distribute and display a moving image captured by the sensor device SU with the sensor ID. An icon that symbolically represents the correspondence between the sensor ID, the location of the sensor device SU of the sensor ID, and the name of the monitored person Ob monitored by the sensor device SU of the sensor ID, and the determination result. Is stored in the TA storage unit 33 as one of the various predetermined data by being notified from the management server device SV or by being input in advance.
 このような監視情報画面52aがTA表示部36に表示されている場合に、ユーザによって「LIVEを見る」ボタン526が入力操作されると(C5)、携帯端末装置TAは、TA監視処理部322によって、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SUへ、ライブでの動画の配信を要求する旨等の情報を収容した通信信号(動画配信要求通信信号)をTA通信IF部31を介して送信する(C6)。この動画配信要求通信信号を受信したセンサ装置SUは、動画配信処理部144によって、撮像部11で生成した動画を、その動画を要求した動画配信要求通信信号の送信元の携帯端末装置TAへ、SU動画配信条件記憶部161に記憶された動画配信条件に従ってストリーミングでSU通信IF部15を介して配信する(C7)。ライブでの動画の配信を受けると、携帯端末装置TAは、TA監視処理部322によって、この配信された動画をストリーミング再生でTA表示部36に表示する(C8)。このライブでの動画を表示する監視情報画面52bは、例えば、図9に示すように、図8に示す監視情報画面52aにおいて、静止画を表示する画像領域523aに代え動画を表示する画像領域523bを備え、そして、「LIVEを見る」ボタン526に代え「LIVE終了」ボタン527を備えて構成される。「LIVE終了」ボタン527は、前記センサIDの前記センサ装置SUによって撮像される動画の配信を終了(停止)させ表示を終了(停止)させる指示を入力するためのボタンである。 When such a monitoring information screen 52 a is displayed on the TA display unit 36, when the user performs an input operation on the “LIVE” button 526 (C 5), the portable terminal device TA is switched to the TA monitoring processing unit 322. A communication signal (video distribution request communication signal) containing information such as a request for live video distribution to the sensor device SU having the sensor ID contained in the received re-report event notification communication signal. Is transmitted via the TA communication IF unit 31 (C6). The sensor device SU that has received the video distribution request communication signal causes the video distribution processing unit 144 to transfer the video generated by the imaging unit 11 to the mobile terminal device TA that is the transmission source of the video distribution request communication signal that requested the video. The streaming is distributed via the SU communication IF unit 15 in accordance with the moving image distribution conditions stored in the SU moving image distribution condition storage unit 161 (C7). When receiving the live video distribution, the portable terminal device TA displays the distributed video on the TA display unit 36 by streaming reproduction by the TA monitoring processing unit 322 (C8). For example, as shown in FIG. 9, the monitoring information screen 52b that displays the live moving image is an image region 523b that displays a moving image instead of the image region 523a that displays a still image in the monitoring information screen 52a illustrated in FIG. In addition, a “LIVE END” button 527 is provided instead of the “VIEW LIVE” button 526. The “live end” button 527 is a button for inputting an instruction to end (stop) the distribution of the moving image captured by the sensor device SU of the sensor ID and end (stop) the display.
 このようにセンサ装置SUから配信を受けた動画を監視情報画面52bでTA表示部36に表示している際に、ユーザによって「話す」ボタン525が入力操作されると(C9)、携帯端末装置TAは、TAナースコール処理部323によって、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SUへ、音声通話を要求する旨等の情報を収容した通信信号(通話要求通信信号)をTA通信IF部31を介して送信する(C10)。そして、携帯端末装置TAは、動画受信処理部324によって、TA動画配信条件記憶部332に記憶されている通話時動画配信条件を取り出し、この取り出した通話時動画配信条件で動画の配信を指示(命令)する旨を表す動画配信条件設定指示情報(動画配信条件設定コマンド)、および、当該携帯端末装置TAに動画を配信しているセンサ装置SUに対応するセンサID(この例では前記受信した再通報のイベント通報通信信号に収容されたセンサID)を収容した第1動画配信条件設定通信信号を、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SUへ、TA通信IF部31を介して送信する(C11)。なお、通話要求通信信号と第1動画配信条件設定通信信号とは、1つの通信信号に纏められても良い。また、監視情報画面52a、52bの「話す」ボタン525は、音声通話の終了の指示を入力するためのボタンである図略の「終了」ボタンに変更される。 When the user presses the “speak” button 525 while the moving image received from the sensor device SU is displayed on the TA display unit 36 on the monitoring information screen 52b (C9), the mobile terminal device TA transmits a communication signal (call communication) containing information such as requesting a voice call to the sensor device SU having the sensor ID contained in the received re-report event notification communication signal by the TA nurse call processing unit 323. Request communication signal) is transmitted via the TA communication IF unit 31 (C10). Then, the mobile terminal device TA uses the video reception processing unit 324 to extract the on-call video distribution conditions stored in the TA video distribution condition storage unit 332 and instruct the video distribution under the extracted on-call video distribution conditions ( Command distribution condition setting instruction information (moving image distribution condition setting command) indicating that the instruction is to be performed) and a sensor ID corresponding to the sensor device SU that is distributing the moving image to the mobile terminal device TA (in this example, the received re-transmission command). The first video distribution condition setting communication signal containing the sensor ID accommodated in the notification event notification communication signal is sent to the sensor device SU having the sensor ID accommodated in the received re-report event notification communication signal. Transmission is performed via the communication IF unit 31 (C11). Note that the call request communication signal and the first video distribution condition setting communication signal may be combined into one communication signal. In addition, the “speak” button 525 on the monitoring information screens 52a and 52b is changed to an “end” button (not shown) that is a button for inputting a voice call end instruction.
 この通話要求通信信号を受信したセンサ装置SUは、SUナースコール処理部143によって、SU音入出力部12等を用い、この受信した通話要求通信信号の送信元の携帯端末装置TAとの間で例えばVoIPの通信信号(通話通信信号)をSU通信IF部15を介して送受信することで、前記携帯端末装置TAとの間で音声通話を行う(C12)。 The sensor device SU that has received the call request communication signal uses the SU nurse call processing unit 143 to use the SU sound input / output unit 12 and the like to communicate with the mobile terminal device TA that is the transmission source of the received call request communication signal. For example, a voice call is performed with the portable terminal device TA by transmitting / receiving a VoIP communication signal (call communication signal) via the SU communication IF unit 15 (C12).
 そして、この第1動画配信条件設定通信信号を受信したセンサ装置SUは、動画配信処理部144によって、この受信した第1動画配信条件設定通信信号に収容された動画配信条件(通話時動画配信条件)でSU動画配信条件記憶部161の記憶内容を書き換えて更新する。したがって、センサ装置SUは、動画配信処理部144によって、撮像部11で生成した動画を、前記処理C6の動画配信要求通信信号の送信元の携帯端末装置TAへ、SU動画配信条件記憶部161に書き換えられて更新された動画配信条件(通話時動画配信条件)に従ってストリーミングでSU通信IF部15を介して配信する(C13)。これによって通話時では、非通話の場合における動画配信条件よりも通信容量が低減する動画配信条件で動画が配信される。 Then, the sensor device SU that has received the first video distribution condition setting communication signal, by the video distribution processing unit 144, receives the video distribution condition (video communication condition during call) accommodated in the received first video distribution condition setting communication signal. ) To rewrite and update the contents stored in the SU video distribution condition storage unit 161. Therefore, the sensor device SU causes the moving image distribution processing unit 144 to transfer the moving image generated by the imaging unit 11 to the mobile terminal device TA that is the transmission source of the moving image distribution request communication signal in the process C6 and to the SU moving image distribution condition storage unit 161. In accordance with the rewritten and updated moving image distribution conditions (calling moving image distribution conditions), streaming is distributed via the SU communication IF unit 15 (C13). As a result, during a call, the moving image is distributed under a moving image distribution condition in which the communication capacity is reduced compared to the moving image distribution condition in the case of a non-call.
 ここで、ユーザによって、音声通話の終了の指示を入力するための図略の前記「終了」ボタンが入力操作されると(C14)、携帯端末装置TAは、TAナースコール処理部323によって、音声通話先のセンサ装置SU(すなわち、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SU)へ、音声通話の終了を要求する旨等の情報を収容した通信信号(通話終了通信信号)をTA通信IF部31を介して送信する(C15)。そして、携帯端末装置TAは、動画受信処理部324によって、TA動画配信条件記憶部332に記憶されている非通話時動画配信条件を取り出し、この取り出した非通話時動画配信条件で動画の配信を指示(命令)する旨を表す動画配信条件設定指示情報(動画配信条件設定コマンド)、および、当該携帯端末装置TAに動画を配信しているセンサ装置SUに対応するセンサID(この例では前記受信した再通報のイベント通報通信信号に収容されたセンサID)を収容した第2動画配信条件設定通信信号を、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SUへ、TA通信IF部31を介して送信する(C16)。なお、通話終了通信信号と第2動画配信条件設定通信信号とは、1つの通信信号に纏められても良い。 Here, when the user performs an input operation on the “end” button (not shown) for inputting an instruction to end the voice call (C14), the TA terminal call processing unit 323 causes the portable terminal device TA to perform a voice call. A communication signal containing information such as a request to terminate the voice call to the sensor device SU at the call destination (that is, the sensor device SU having the sensor ID accommodated in the received re-report event notification communication signal) A call end communication signal) is transmitted via the TA communication IF unit 31 (C15). Then, the mobile terminal device TA extracts the non-call video distribution conditions stored in the TA video distribution condition storage unit 332 by the video reception processing unit 324, and distributes the video according to the extracted non-call video distribution conditions. Video distribution condition setting instruction information (video distribution condition setting command) indicating instruction (command) and a sensor ID corresponding to the sensor device SU that distributes the video to the mobile terminal device TA (in this example, the reception) The second video distribution condition setting communication signal containing the sensor ID accommodated in the rereport event notification communication signal) to the sensor device SU having the sensor ID accommodated in the received rereport event notification communication signal. And transmitted via the TA communication IF unit 31 (C16). Note that the call end communication signal and the second moving image distribution condition setting communication signal may be combined into one communication signal.
 この通話終了通信信号を受信したセンサ装置SUは、SUナースコール処理部143によって、この受信した通話終了通信信号の送信元の携帯端末装置TAとの間での音声通話を終了する。 The sensor device SU that has received the call end communication signal ends the voice call with the mobile terminal device TA that is the transmission source of the received call end communication signal by the SU nurse call processing unit 143.
 そして、この第2動画配信条件設定通信信号を受信したセンサ装置SUは、動画配信処理部144によって、この受信した第2動画配信条件設定通信信号に収容された動画配信条件(非通話時動画配信条件)でSU動画配信条件記憶部161の記憶内容を書き換えて更新する。したがって、センサ装置SUは、動画配信処理部144によって、撮像部11で生成した動画を、前記処理C6の動画配信要求通信信号の送信元の携帯端末装置TAへ、SU動画配信条件記憶部161に書き換えられて更新された動画配信条件(非通話時動画配信条件)に従ってストリーミングでSU通信IF部15を介して配信する(C17)。ライブでの動画の配信を受けると、携帯端末装置TAは、TA監視処理部322によって、この配信された動画をストリーミング再生でTA表示部36に表示する(C18)。これによって非通話時では、音声通話の終了に伴って非通話の場合における動画配信条件に自動的に復帰し、この復帰した動画配信条件で動画が配信される。 Then, the sensor device SU that has received the second moving image distribution condition setting communication signal causes the moving image distribution processing unit 144 to move the moving image distribution condition (non-call moving image distribution) accommodated in the received second moving image distribution condition setting communication signal. Condition), the contents stored in the SU video distribution condition storage unit 161 are rewritten and updated. Therefore, the sensor device SU causes the moving image distribution processing unit 144 to transfer the moving image generated by the imaging unit 11 to the mobile terminal device TA that is the transmission source of the moving image distribution request communication signal in the process C6 and to the SU moving image distribution condition storage unit 161. In accordance with the rewritten and updated moving image distribution condition (non-call moving image distribution condition), streaming is distributed via the SU communication IF unit 15 (C17). When receiving the live video distribution, the portable terminal device TA displays the distributed video on the TA display unit 36 by streaming reproduction by the TA monitoring processing unit 322 (C18). As a result, at the time of non-calling, the moving-image distribution conditions in the case of non-calling are automatically restored with the end of the voice call, and the moving images are distributed under the restored moving-image distribution conditions.
 そして、ユーザによって「LIVE終了」ボタン527が入力操作されると(C19)、携帯端末装置TAは、TA監視処理部322によって、動画配信元のセンサ装置SU(すなわち、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SU)へ、動画配信の終了を要求する旨等の情報を収容した通信信号(動画配信終了通信信号)をTA通信IF部31を介して送信する(C20)。これによって動画の配信が終了され、TA表示部36には、監視情報画面52aが表示される。なお、この監視情報画面52aの画像領域523aには、前記受信した再通報のイベント通報通信信号に収容された静止画が表示されて良く、また、前記動画配信終了通信信号を送信する場合に表示されていた動画の画像が静止画として継続的に表示されて良い。 When the “live end” button 527 is input by the user (C19), the mobile terminal device TA uses the TA monitoring processing unit 322 to detect the moving image distribution source sensor device SU (that is, the received re-report event). A communication signal (moving image distribution end communication signal) containing information such as requesting the end of moving image distribution is transmitted via the TA communication IF unit 31 to the sensor device SU having the sensor ID accommodated in the notification communication signal. (C20). As a result, the distribution of the moving image is terminated, and the monitoring information screen 52a is displayed on the TA display unit 36. The still image contained in the received re-report event notification communication signal may be displayed in the image area 523a of the monitoring information screen 52a, and is displayed when the moving image distribution end communication signal is transmitted. The moving image that has been displayed may be continuously displayed as a still image.
 このように被監視者監視システムMSが動作している際に、携帯端末装置TAにおける入力操作を受け付けた際の動作について説明する。図6において、TA制御処理部32は、TA入力部35およびTA表示部36で構成されるタッチパネルで入力操作を受け付けると(S11)、この受け付けた入力操作の種別を判定する(S12)。 The operation when the input operation in the portable terminal device TA is received while the monitored person monitoring system MS is operating will be described. In FIG. 6, when the TA control processing unit 32 receives an input operation on the touch panel constituted by the TA input unit 35 and the TA display unit 36 (S11), the TA control processing unit 32 determines the type of the received input operation (S12).
 この判定の結果、前記受け付けた入力操作が「LIVEを見る」ボタン526の操作である場合(「LIVEを見る」)には、処理C6で説明したように、携帯端末装置TAは、TA監視処理部322によって、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SUへ動画配信要求通信信号を送信し(S13)、この処理を終了する。 As a result of this determination, when the received input operation is an operation of the “watch live” button 526 (“watch live”), as described in process C6, the mobile terminal device TA performs the TA monitoring process. The unit 322 transmits a moving image distribution request communication signal to the sensor device SU having the sensor ID accommodated in the received re-report event notification communication signal (S13), and ends this process.
 前記処理S12の判定の結果、前記受け付けた入力操作が「話す」ボタン525の操作である場合(「話す」)には、処理C10およびC11で説明したように、TA制御処理部32は、TAナースコール処理部323によって、前記受信した再通報のイベント通報通信信号に収容されたセンサIDを持つセンサ装置SUへ通話要求通信信号を送信し、そして、動画配信中である場合には、動画受信処理部324によって、TA動画配信条件記憶部332から通話時動画配信条件を取り出し、この取り出した通話時動画配信条件にかかる動画配信条件設定指示情報および動画配信元のセンサ装置SUに対応するセンサIDを収容した第1動画配信条件設定通信信号を前記センサ装置SUへ送信し(S14)、この処理を終了する。 When the received input operation is an operation of the “speak” button 525 as a result of the determination in the process S12 (“speak”), the TA control processing unit 32, as described in the processes C10 and C11, The nurse call processing unit 323 transmits a call request communication signal to the sensor device SU having the sensor ID accommodated in the received re-report event notification communication signal. The processing unit 324 retrieves the on-call moving image distribution condition from the TA moving image distribution condition storage unit 332, the moving image distribution condition setting instruction information regarding the retrieved on-call moving image distribution condition, and the sensor ID corresponding to the moving image distribution source sensor device SU. Is transmitted to the sensor device SU (S14), and the process ends.
 前記処理S12の判定の結果、前記受け付けた入力操作が「LIVE終了」ボタン527の操作である場合(「LIVE終了」)には、処理C20で説明したように、TA制御処理部32は、TA監視処理部322によって、動画配信元のセンサ装置SUへ動画配信終了通信信号を送信し(S15)、この処理を終了する。 As a result of the determination in the process S12, when the received input operation is an operation of the “live end” button 527 (“live end”), as described in the process C20, the TA control processing unit 32 The monitoring processing unit 322 transmits a moving image distribution end communication signal to the moving image distribution source sensor device SU (S15), and ends this processing.
 前記処理S12の判定の結果、前記受け付けた入力操作が前記図略の「終了」の操作である場合(「終了」)には、処理C15および処理C16で説明したように、TA制御処理部32は、TAナースコール処理部323によって、音声通話先のセンサ装置SUへ、通話終了通信信号を送信し、そして、動画配信中である場合には、動画受信処理部324によって、TA動画配信条件記憶部332から非通話時動画配信条件を取り出し、この取り出した非通話時動画配信条件にかかる動画配信条件設定指示情報および動画配信元のセンサ装置SUに対応するセンサIDを収容した第2動画配信条件設定通信信号を前記センサ装置SUへ送信し(S16)、この処理を終了する。 As a result of the determination in the step S12, when the received input operation is an “end” operation (not shown) (“end”), the TA control processing unit 32 as described in the processing C15 and the processing C16. The TA nurse call processing unit 323 transmits a call end communication signal to the voice call destination sensor device SU, and when moving image distribution is in progress, the moving image reception processing unit 324 stores the TA moving image distribution condition storage. The non-call video distribution condition is extracted from the unit 332, and the second video distribution condition containing the video distribution condition setting instruction information related to the extracted non-call video distribution condition and the sensor ID corresponding to the sensor device SU of the video distribution source A setting communication signal is transmitted to the sensor device SU (S16), and this process is terminated.
 また、前記処理S12の判定の結果、前記受け付けた入力操作が、これら「LIVEを見る」ボタン526の操作、「話す」ボタン525の操作、「LIVE終了」ボタン527の操作および前記図略の「終了」ボタンの操作のうちのいずれでもない他の操作である場合(その他)には、TA制御処理部32は、前記その他に応じた適宜な処理を実行し、この処理を終了する。 In addition, as a result of the determination in the process S12, the received input operations include the operations of the “watch live” button 526, the operation of the “speak” button 525, the operation of the “live end” button 527, and “ In the case of another operation that is not one of the operations of the “End” button (others), the TA control processing unit 32 executes an appropriate process according to the other and ends this process.
 なお、上述の実施形態において、TA音入出力部34およびTA制御処理部32のTAナースコール処理部323は、端末側通信部(本実施例ではTA通信IF部31がその一例)を介してナースコール受付装置(本実施形態ではセンサ装置SUがその一例)と音声通話する端末側音声通話部の一例に相当する。TA入力部35およびTA表示部36で構成されるタッチパネルの「話す」ボタン525および「終了」ボタン532ならびにその処理を実行するTA制御処理部32は、ナースコール受付装置(本実施形態ではセンサ装置SUがその一例)との音声通話の開始および終了を受け付ける端末側音声通話受付部の一例に相当する。 In the above-described embodiment, the TA sound input / output unit 34 and the TA nurse call processing unit 323 of the TA control processing unit 32 are connected via a terminal side communication unit (in this embodiment, the TA communication IF unit 31 is an example). This corresponds to an example of a terminal-side voice call unit that makes a voice call with a nurse call reception device (in this embodiment, the sensor device SU is an example thereof). The “speak” button 525 and the “end” button 532 of the touch panel constituted by the TA input unit 35 and the TA display unit 36 and the TA control processing unit 32 that executes the processing are a nurse call accepting device (in this embodiment, a sensor device). SU corresponds to an example of a terminal-side voice call accepting unit that accepts the start and end of a voice call with SU.
 以上説明したように、本実施形態における被監視者監視システムMS、その端末装置SP、TAおよびその端末側監視処理方法は、センサ装置SU(ナースコール受付装置の一例)から配信を受けた動画をTA表示部に表示している際に、音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための第1動画配信条件設定通信信号を前記センサ装置SUへ送信する動画受信処理部324を備えるので、動画配信条件は、音声通話の開始に伴って非通話の場合における動画配信条件よりも通信容量が低減するように変更される。このため、上記被監視者監視システムMS、端末装置SP、TAおよび端末側監視処理方法は、通話の確立を優先し、映像の途切れと通話の途切れを低減しつつ動画の配信と通話の確立との両立を可能な限り図ることができる。 As described above, the monitored person monitoring system MS, its terminal devices SP and TA, and its terminal side monitoring processing method according to the present embodiment use the moving image received from the sensor device SU (an example of a nurse call reception device). When the start of a voice call is accepted while displaying on the TA display unit, the second is for instructing the setting of the video distribution condition so that the communication capacity is reduced as compared with the video distribution condition in the case of a non-call. Since the moving image reception processing unit 324 that transmits a moving image distribution condition setting communication signal to the sensor device SU is provided, the communication capacity of the moving image distribution condition is reduced compared to the moving image distribution condition in the case of a non-call with the start of a voice call. To be changed. For this reason, the monitored person monitoring system MS, the terminal devices SP and TA, and the terminal-side monitoring processing method give priority to establishment of a call, reduce video interruptions and call interruptions, and distribute video and establish calls. Can be achieved as much as possible.
 上記被監視者監視システムMS、端末装置SP、TAおよび端末側監視処理方法は、動画のフレームレート、動画のフレームサイズおよび動画の色数のうちの1または複数を変更することで、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示できる。 The monitored person monitoring system MS, the terminal devices SP and TA, and the terminal-side monitoring processing method can change the one or more of the moving image frame rate, the moving image frame size, and the moving image color number to make non-calling. It is possible to instruct the setting of the moving image distribution condition so that the communication capacity is reduced as compared with the moving image distribution condition.
 上記被監視者監視システムMS、端末装置SP、TAおよび端末側監視処理方法は、音声通話の終了を受け付けた場合に、動画受信処理部324によって、非通話の場合における動画配信条件の設定を指示するための第2動画配信条件設定通信信号を前記センサ装置SUへ送信するので、音声通話の終了に伴って非通話の場合における動画配信条件に自動的に復帰できる。 In the monitored person monitoring system MS, the terminal devices SP and TA, and the terminal side monitoring processing method, when the end of the voice call is received, the moving image reception processing unit 324 instructs the setting of the moving image distribution condition in the case of non-calling. Since the second moving image distribution condition setting communication signal for transmitting is transmitted to the sensor device SU, it is possible to automatically return to the moving image distribution condition in the case of a non-call as the voice call ends.
 なお、上述の実施形態では、携帯端末装置TAの動画受信処理部324は、センサ装置SUから配信を受けた動画をTA表示部36に表示している際に、TA入力部35でセンサ装置SUとの音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための第1動画配信条件設定通信信号をTA通信IF部31を介してセンサ装置SUへ送信したが、前記第1動画配信条件設定通信信号に収容される記動画配信条件は、動画のフレームレートが0であってもよい。これによれば、動画配信条件のフレームレートが0であるので、実質的に、動画の配信が停止され、より確実に音声通話が可能となる。 In the above-described embodiment, the moving image reception processing unit 324 of the mobile terminal device TA displays the moving image received from the sensor device SU on the TA display unit 36, and the TA input unit 35 uses the sensor device SU. When the start of the voice call is received, the first video distribution condition setting communication signal for instructing the setting of the video distribution condition so as to reduce the communication capacity compared to the video distribution condition in the case of non-call is TA. Although it transmitted to the sensor device SU via the communication IF unit 31, the frame rate of the moving image may be 0 for the moving image distribution condition accommodated in the first moving image distribution condition setting communication signal. According to this, since the frame rate of the moving image distribution condition is 0, the distribution of the moving image is substantially stopped and a voice call can be made more reliably.
 図10は、実施形態の被監視者監視システムにおける携帯端末装置に表示される通話中画面の一例を示す図である。この場合では、動画受信処理部324は、センサ装置SUから配信を受けた動画をTA表示部36に表示している際に、TA入力部35でセンサ装置SUとの音声通話の開始を受け付けた場合に、動画のフレームレートが0である動画配信条件の設定を指示するための第1動画配信条件設定通信信号をTA通信IF部31を介してセンサ装置SUへ送信し、センサ装置SUとの間で音声通話が可能である旨を表す通話中画面をTA表示部36に表示する。この通話中画面53は、例えば、図10に示すように、メニューバー領域511と、被監視者名領域521と、アイコン領域522と、通話可能であることを表すメッセージ(例えば「通話中です」)およびアイコンを表示する通話メイン領域531と、「対応する」ボタン524と、「終了」ボタン532とを備える。「終了」ボタン532は、センサ装置SUとの間での音声通話の終了の指示を入力するためのボタンである。 FIG. 10 is a diagram illustrating an example of a call screen displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment. In this case, the video reception processing unit 324 received the start of a voice call with the sensor device SU at the TA input unit 35 while displaying the video received from the sensor device SU on the TA display unit 36. In this case, a first moving image distribution condition setting communication signal for instructing setting of a moving image distribution condition in which the frame rate of the moving image is 0 is transmitted to the sensor device SU via the TA communication IF unit 31, and A call screen indicating that a voice call is possible is displayed on the TA display unit 36. For example, as shown in FIG. 10, the in-call screen 53 includes a menu bar area 511, a monitored person name area 521, an icon area 522, and a message indicating that a call is possible (for example, “in call”). ) And an icon for displaying a call main area 531, a “corresponding” button 524, and an “end” button 532. The “end” button 532 is a button for inputting an instruction to end the voice call with the sensor device SU.
 また、この場合において、通話中画面53に代え、TA表示部36は、TA監視処理部322によって、動画のフレームレートが0である動画配信条件の設定を指示するための第1動画配信条件設定通信信号をTA通信IF部31を介してセンサ装置SUへ送信する場合に表示されていた動画の画像を静止画として表示を継続してもよい。これによれば、前記第1動画配信停止通信信号を送信する場合に表示されていた動画の画像が静止画として表示され続けるので、例えば監視者等のユーザは、通話中に、被監視者Obの様子を画像でも確認できる。 In this case, the TA display unit 36 uses the TA monitoring processing unit 322 instead of the call screen 53 to set the first moving image distribution condition for instructing the setting of the moving image distribution condition where the moving image frame rate is 0. The display of the moving image displayed when the communication signal is transmitted to the sensor device SU via the TA communication IF unit 31 may be continued as a still image. According to this, since the image of the moving image displayed when the first moving image distribution stop communication signal is transmitted continues to be displayed as a still image, for example, a user such as a monitor can monitor the monitored person Ob during the call. You can also check the situation in the image.
 また、上述の実施形態では、音声通話の開始および終了を受け付ける端末側音声通話受付部は、一例として、TA入力部35およびTA表示部36で構成されるタッチパネルの「話す」ボタン525および「終了」ボタン532ならびにその処理を実行するTA制御処理部32を備えて構成されたが、前記端末側音声通話受付部は、「話す」ボタン525および「終了」ボタン532に代え、あるいは、「話す」ボタン525および「終了」ボタン532に追加して、音声の有無に応じて前記音声通話の開始および終了を受け付けるボイスアクティベート機能であっても良い。このボイスアクティベート機能では、TA制御処理部32は、例えば、TA音入出部34に入力された音の音量が予め設定された第1閾値以上である場合に、音声通話の開始を受け付けたと判定し、前記「話す」ボタン525の入力操作を受け付けた場合と同様の処理を実行し、TA音入出部34に入力された音の音量が予め設定された第2閾値以下であってその状態が予め設定された所定の時間以上継続した場合に、音声通話の終了を受け付けたと判定し、前記「終了」ボタン532の入力操作を受け付けた場合と同様の処理を実行する。これによれば、携帯端末装置TAがボイスアクティベート機能を備えるので、ユーザは、入力操作を行わなくても、センサ装置SUとの音声通話の開始および終了を携帯端末装置TAに入力できる。 In the above-described embodiment, as an example, the terminal-side voice call accepting unit that accepts the start and end of the voice call includes the “speak” button 525 and “end” of the touch panel configured by the TA input unit 35 and the TA display unit 36. ”Button 532 and a TA control processing unit 32 for executing the process, the terminal side voice call accepting unit is replaced with“ speak ”button 525 and“ end ”button 532 or“ speak ”. In addition to the button 525 and the “end” button 532, a voice activation function that accepts the start and end of the voice call according to the presence or absence of voice may be used. In this voice activation function, for example, the TA control processing unit 32 determines that the start of the voice call has been accepted when the volume of the sound input to the TA sound input / output unit 34 is equal to or higher than a preset first threshold value. The same processing as when the input operation of the “speak” button 525 is received is executed, and the volume of the sound input to the TA sound input / output unit 34 is equal to or lower than a preset second threshold value, and the state is in advance. If it has been continued for a predetermined time or more, it is determined that the end of the voice call has been accepted, and the same processing as when the input operation of the “end” button 532 is accepted is executed. According to this, since the mobile terminal device TA has a voice activation function, the user can input the start and end of a voice call with the sensor device SU to the mobile terminal device TA without performing an input operation.
 また、携帯端末装置TAが「話す」ボタン525および「終了」ボタン532に追加してボイスアクティベート機能を備える場合において、ボイスアクティベート機能のオンオフがTA表示部36に表示されても良い。図11は、実施形態の被監視者監視システムにおける携帯端末装置に表示される、静止画を表示した監視情報画面の他の一例を示す図である。このようなボイスアクティベート機能のオンオフの表示を伴う監視情報画面52cは、例えば、図11に示すように、図8および図9に示す監視情報画面52a、52bに、さらに、ボイスアクティベート機能のオンオフを表示するVAFオンオフ表示領域541を備えて構成される。図11に示す例では、ボイスアクティベート機能がオンであることがVAFオンオフ表示領域541に表示されている(VAF;ON)。なお、図11には、図8に示す監視情報画面52aにVAFオンオフ表示領域541をさらに備えて構成された監視情報画面52cが図示されている。これによれば、ボイスアクティベート機能のオンオフがTA表示部36に明示される。 In addition, when the mobile terminal device TA is provided with the voice activation function in addition to the “speak” button 525 and the “end” button 532, ON / OFF of the voice activation function may be displayed on the TA display unit 36. FIG. 11 is a diagram illustrating another example of a monitoring information screen displaying a still image displayed on the mobile terminal device in the monitored person monitoring system according to the embodiment. For example, as shown in FIG. 11, the monitoring information screen 52 c accompanied with such a voice activation function on / off display is displayed on the monitoring information screens 52 a and 52 b shown in FIGS. 8 and 9. A VAF on / off display area 541 for display is provided. In the example shown in FIG. 11, it is displayed in the VAF on / off display area 541 that the voice activation function is on (VAF; ON). FIG. 11 shows a monitoring information screen 52c configured by further providing a VAF on / off display area 541 on the monitoring information screen 52a shown in FIG. According to this, ON / OFF of the voice activation function is clearly indicated on the TA display unit 36.
 本明細書は、上記のように様々な態様の技術を開示しているが、そのうち主な技術を以下に纏める。 This specification discloses various modes of technology as described above, and the main technologies are summarized below.
 一態様にかかる被監視者監視システムの端末装置は、ナースコールを受け付け、動画を含む画像を生成し、音声通話するナースコール受付装置と、前記ナースコール受付装置と通信可能に接続され、前記ナースコール受付装置と音声通話し、前記ナースコール受付装置で生成した動画の配信を受けて前記動画を表示する端末装置と、前記ナースコール受付装置および前記端末装置それぞれと通信可能に接続され、前記ナースコール受付装置で受け付けたナースコールの通報を受けて前記端末装置へ前記ナースコールを通報する中央処理装置とを備える被監視者監視システムの前記端末装置であって、通信を行う端末側通信部と、前記端末側通信部を介して前記ナースコール受付装置と音声通話する端末側音声通話部と、前記端末側通信部を介して前記ナースコール受付装置から配信を受けた動画を表示する端末側表示部と、前記ナースコール受付装置との音声通話の開始および終了を受け付ける端末側音声通話受付部と、前記ナースコール受付装置から配信を受けた動画を前記端末側表示部に表示している際に、前記端末側音声通話受付部で前記ナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する動画受信処理部とを備える。被監視者監視システムが複数の端末装置を備える場合に全ての端末装置に等しい動画配信条件を記憶させることができる観点から、好ましくは、上述の端末装置において、前記端末側音声通話受付部で前記ナースコール受付装置との音声通話の開始を受け付けた場合における動画配信条件は、前記端末側通信部を介して前記中央処理装置からダウンロードされる。 The terminal device of the monitored person monitoring system according to one aspect receives a nurse call, generates an image including a moving image, and makes a voice call, and is connected to the nurse call reception device so as to be able to communicate with the nurse call reception device. A terminal device that performs a voice call with the call reception device, receives the distribution of the moving image generated by the nurse call reception device, and displays the moving image, and is connected to the nurse call reception device and the terminal device in a communicable manner, and the nurse A terminal-side communication unit that performs communication, the terminal device of the monitored person system comprising: a central processing unit that receives the notification of the nurse call received by the call reception device and reports the nurse call to the terminal device; A terminal-side voice call unit that makes a voice call with the nurse call reception device via the terminal-side communication unit; and the terminal-side communication unit. A terminal-side display unit that displays a video received from the nurse call reception device, a terminal-side voice call reception unit that receives start and end of a voice call with the nurse call reception device, and the nurse call reception device When the terminal-side voice call accepting unit accepts the start of the voice call with the nurse call accepting device while the video received from the terminal is displayed on the terminal-side display unit. A moving image reception processing unit that transmits a moving image distribution condition setting communication signal for instructing setting of the moving image distribution condition to the nurse call reception device via the terminal side communication unit so that the communication capacity is reduced as compared with the moving image distribution condition With. In the case where the monitored person monitoring system includes a plurality of terminal devices, preferably, in the above-described terminal device, the terminal-side voice call accepting unit may be configured to store the same video distribution conditions for all the terminal devices. The moving image distribution condition when the start of the voice call with the nurse call reception device is received is downloaded from the central processing unit via the terminal side communication unit.
 このような端末装置は、ナースコール受付装置から配信を受けた動画を端末側表示部に表示している際に、端末側音声通話受付部でナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための動画配信条件設定通信信号を端末側通信部を介してナースコール受付装置へ送信する動画受信処理部を備えるので、動画配信条件は、音声通話の開始に伴って非通話の場合における動画配信条件よりも通信容量が低減するように変更される。このため、上記端末装置は、通話の確立を優先し、映像の途切れと通話の途切れを低減しつつ動画の配信と通話の確立との両立を可能な限り図ることができる。 When such a terminal device displays a video received from the nurse call reception device on the terminal side display unit, the terminal side voice call reception unit has accepted the start of a voice call with the nurse call reception device. In this case, a video delivery condition setting communication signal for instructing the setting of the video delivery condition so as to reduce the communication capacity compared to the video delivery condition in the case of non-call is sent to the nurse call reception device via the terminal side communication unit. Since the moving image reception processing unit to be transmitted is provided, the moving image distribution condition is changed so that the communication capacity is reduced as compared with the moving image distribution condition in the case of a non-call with the start of the voice call. For this reason, the terminal device gives priority to establishment of a call, and can achieve both the distribution of a moving image and the establishment of a call as much as possible while reducing the interruption of the video and the interruption of the call.
 他の一態様では、上述の端末装置において、前記動画配信条件は、前記動画のフレームレート、前記動画のフレームサイズおよび前記動画の色数のうちの1または複数である。 In another aspect, in the above-described terminal device, the moving image distribution condition is one or more of a frame rate of the moving image, a frame size of the moving image, and the number of colors of the moving image.
 このような端末装置は、動画のフレームレート、動画のフレームサイズおよび動画の色数のうちの1または複数を変更することで、端末側音声通話受付部でナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示できる。例えば、動画のフレームレートを、非通話の場合におけるフレームレートより低減することで、通信容量が低減できる。また例えばフレームサイズを、非通話の場合におけるフレームサイズより低減することで、通信容量が低減できる。また例えば、RGBの3色から1色(モノクロ)にすることで、通信容量が低減できる。また例えば、動画のフレームレートを、非通話の場合におけるフレームレートより低減するとともに、フレームサイズを、非通話の場合におけるフレームサイズより低減することで、通信容量が低減できる。 In such a terminal device, by changing one or more of the frame rate of the moving image, the frame size of the moving image, and the number of colors of the moving image, the terminal side voice call receiving unit starts the voice call with the nurse call receiving device. Can be instructed to set the moving image distribution condition so that the communication capacity is reduced as compared with the moving image distribution condition in the case of non-call. For example, the communication capacity can be reduced by reducing the frame rate of the moving image from the frame rate in the case of non-calling. For example, the communication capacity can be reduced by reducing the frame size from the frame size in the case of non-calling. Further, for example, the communication capacity can be reduced by changing from three colors of RGB to one color (monochrome). Further, for example, the communication capacity can be reduced by reducing the frame rate of the moving image from the frame rate in the case of non-calling and reducing the frame size from the frame size in the case of non-calling.
 他の一態様では、これら上述の端末装置において、前記動画配信条件は、前記動画のフレームレートが0である。 In another aspect, in the above-described terminal devices, the moving image distribution condition is that a frame rate of the moving image is zero.
 このような端末装置は、動画配信条件のフレームレートが0であるので、実質的に、動画の配信が停止され、より確実に音声通話が可能となる。 In such a terminal device, since the frame rate of the moving image distribution condition is 0, the moving image distribution is substantially stopped, and a voice call can be performed more reliably.
 他の一態様では、上述の端末装置において、前記端末側表示部は、前記動画のフレームレートが0である動画配信条件の設定を指示するための動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する場合に表示されていた動画の画像を静止画として表示を継続する。 In another aspect, in the terminal device described above, the terminal-side display unit transmits a video distribution condition setting communication signal for instructing setting of a video distribution condition in which the frame rate of the video is 0. The image of the moving image that has been displayed when transmitted to the nurse call accepting device via is continued to be displayed as a still image.
 このような端末装置は、前記動画のフレームレートが0である動画配信条件の設定を指示するための前記動画配信終了通信信号を送信する場合に表示されていた動画の画像を静止画として表示を継続するので、ユーザ(例えば監視者等)は、通話中に、被監視者の様子を画像でも確認できる。 Such a terminal device displays a moving image displayed as a still image when transmitting the moving image distribution end communication signal for instructing setting of a moving image distribution condition where the frame rate of the moving image is 0. Since it continues, the user (for example, monitoring person etc.) can also confirm the state of a monitoring person also with an image during a telephone call.
 他の一態様では、これら上述の端末装置において、前記動画受信処理部は、前記端末側音声通話受付部で前記ナースコール受付装置との音声通話の終了を受け付けた場合に、非通話の場合における動画配信条件の設定を指示するための第2動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する。 In another aspect, in the above-described terminal devices, the moving image reception processing unit receives a termination of a voice call with the nurse call reception device in the terminal-side voice call reception unit, and in a case of a non-call A second moving image distribution condition setting communication signal for instructing setting of moving image distribution conditions is transmitted to the nurse call reception device via the terminal side communication unit.
 このような端末装置は、動画受信処理部によって、端末側音声通話受付部でナースコール受付装置との音声通話の終了を受け付けた場合に、非通話の場合における動画配信条件の設定を指示するための第2動画配信条件設定通信信号を端末側通信部を介して前記ナースコール受付装置へ送信するので、ナースコール受付装置との音声通話の終了に伴って非通話の場合における動画配信条件に自動的に復帰できる。 In such a terminal device, when the end of the voice call with the nurse call reception device is received by the terminal-side voice call reception unit by the video reception processing unit, in order to instruct the setting of the video distribution condition in the case of a non-call Since the second video distribution condition setting communication signal is transmitted to the nurse call reception device via the terminal side communication unit, the video distribution condition in the case of a non-call is automatically set upon termination of the voice call with the nurse call reception device. Can be restored.
 他の一態様では、これら上述の端末装置において、前記端末側音声通話受付部は、音声の有無に応じて前記音声通話の開始および終了を受け付けるボイスアクティベート機能を備える。 In another aspect, in the above-described terminal devices, the terminal-side voice call accepting unit includes a voice activation function that accepts the start and end of the voice call according to the presence or absence of voice.
 このような端末装置は、ボイスアクティベート機能を備えるので、ユーザは、受付操作を行わなくても、ナースコール受付装置との音声通話の開始および終了を端末装置に入力できる。 Since such a terminal device has a voice activation function, the user can input the start and end of a voice call with the nurse call reception device to the terminal device without performing a reception operation.
 他の一態様にかかる端末装置の端末側監視処理方法は、ナースコールを受け付け、動画を含む画像を生成し、音声通話するナースコール受付装置と、前記ナースコール受付装置と通信可能に接続され、前記ナースコール受付装置と音声通話し、前記ナースコール受付装置で生成した動画の配信を受けて前記動画を表示する端末装置と、前記ナースコール受付装置および前記端末装置それぞれと通信可能に接続され、前記ナースコール受付装置で受け付けたナースコールの通報を受けて前記端末装置へ前記ナースコールを通報する中央処理装置とを備える被監視者監視システムにおける前記端末装置の端末側監視処理方法であって、端末側通信部によって通信を行う端末側通信工程と、端末側音声通話部によって前記端末側通信部を介して前記ナースコール受付装置と音声通話する端末側音声通話工程と、端末側表示部によって前記端末側通信部を介して前記ナースコール受付装置から配信を受けた動画を表示する端末側表示工程と、端末側音声通話受付部によって前記ナースコール受付装置との音声通話の開始および終了を受け付ける端末側音声通話受付工程と、前記端末側表示工程によって前記ナースコール受付装置から配信を受けた動画を前記端末側表示部に表示している際に、前記端末側音声通話受付工程によって前記端末側音声通話受付部で前記ナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する動画受信制御工程とを備える。 The terminal-side monitoring processing method for a terminal device according to another aspect includes a nurse call reception device that receives a nurse call, generates an image including a moving image, and performs a voice call, and is communicably connected to the nurse call reception device. A voice call with the nurse call reception device, receiving the distribution of the video generated by the nurse call reception device and displaying the video, and connected to each of the nurse call reception device and the terminal device so as to be able to communicate, A terminal-side monitoring processing method of the terminal device in a monitored person monitoring system comprising a central processing unit that receives a notification of a nurse call received by the nurse call reception device and reports the nurse call to the terminal device, The terminal side communication step for communicating by the terminal side communication unit, and the terminal side voice call unit through the terminal side communication unit A terminal-side voice call step for making a voice call with the nurse call reception device, a terminal-side display step for displaying a video received from the nurse call reception device via the terminal-side communication unit by a terminal-side display unit, and a terminal side A terminal-side voice call accepting step for accepting the start and end of a voice call with the nurse call accepting device by a voice call accepting unit, and the terminal-side display of the video received from the nurse call accepting device in the terminal-side display step When the terminal side voice call accepting unit accepts the start of the voice call with the nurse call accepting device in the terminal side voice call accepting step, the video delivery condition in the case of non-calling The terminal-side communication unit sends a video distribution condition setting communication signal for instructing the setting of the video distribution conditions so as to reduce the communication capacity. To and a video reception control step of transmitting to the nurse call reception device.
 このような被監視者監視システムにおける端末装置の端末側監視処理方法は、端末側表示工程によってナースコール受付装置から配信を受けた動画を端末側表示部に表示している際に、端末側音声通話受付工程によって端末側音声通話受付部でナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための動画配信条件設定通信信号を端末側通信部を介してナースコール受付装置へ送信する動画受信制御工程を備えるので、動画配信条件は、音声通話の開始に伴って非通話の場合における動画配信条件よりも通信容量が低減するように変更される。このため、上記端末側監視処理方法は、通話の確立を優先し、映像の途切れと通話の途切れを低減しつつ動画の配信と通話の確立との両立を可能な限り図ることができる。 The terminal-side monitoring processing method of the terminal device in such a monitored person monitoring system is such that the terminal-side audio is displayed when the terminal-side display process displays the video received from the nurse call reception device on the terminal-side display unit. When the terminal side voice call acceptance unit accepts the start of the voice call with the nurse call acceptance device in the call acceptance process, the setting of the video delivery condition is set so that the communication capacity is reduced as compared with the video delivery condition in the case of non-call. Video delivery condition setting communication signal for instructing the video delivery condition is transmitted to the nurse call reception device via the terminal side communication unit, so that the video delivery condition is a non-call with the start of a voice call Is changed so that the communication capacity is reduced as compared with the moving image distribution condition in FIG. For this reason, the terminal-side monitoring processing method gives priority to establishment of a call, and can achieve both the distribution of moving images and the establishment of a call as much as possible while reducing the interruption of the video and the interruption of the call.
 他の一態様にかかる被監視者監視システムは、ナースコールを受け付け、動画を含む画像を生成し、音声通話するナースコール受付装置と、前記ナースコール受付装置と通信可能に接続され、前記ナースコール受付装置と音声通話し、前記ナースコール受付装置で生成した動画の配信を受けて前記動画を表示する端末装置と、前記ナースコール受付装置および前記端末装置それぞれと通信可能に接続され、前記ナースコール受付装置で受け付けたナースコールの通報を受けて前記端末装置へ前記ナースコールを通報する中央処理装置とを備える被監視者監視システムであって、前記端末装置は、これら上述のいずれかの端末装置である。 The monitored person monitoring system according to another aspect includes a nurse call reception device that receives a nurse call, generates an image including a moving image, and performs a voice call, and is communicably connected to the nurse call reception device. A terminal device that performs voice communication with the reception device, receives the distribution of the video generated by the nurse call reception device, and displays the video, and is connected to each of the nurse call reception device and the terminal device so as to be communicable, and the nurse call A monitored person monitoring system comprising a central processing unit that receives a notification of a nurse call received by a reception device and reports the nurse call to the terminal device, wherein the terminal device is one of the above-described terminal devices It is.
 このような被監視者監視システムは、これら上述のいずれかの端末装置を備えるので、通話の確立を優先し、映像の途切れと通話の途切れを低減しつつ動画の配信と通話の確立との両立を可能な限り図ることができる。 Since such a monitored person monitoring system includes any one of the above-described terminal devices, priority is given to establishment of a call, and both video distribution and call establishment are achieved while reducing interruptions in video and calls. Can be achieved as much as possible.
 この出願は、2015年8月7日に出願された日本国特許出願特願2015-157396を基礎とするものであり、その内容は、本願に含まれるものである。 This application is based on Japanese Patent Application No. 2015-157396 filed on August 7, 2015, the contents of which are included in the present application.
 本発明を表現するために、上述において図面を参照しながら実施形態を通して本発明を適切且つ十分に説明したが、当業者であれば上述の実施形態を変更および/または改良することは容易に為し得ることであると認識すべきである。したがって、当業者が実施する変更形態または改良形態が、請求の範囲に記載された請求項の権利範囲を離脱するレベルのものでない限り、当該変更形態または当該改良形態は、当該請求項の権利範囲に包括されると解釈される。 In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.
 本発明によれば、被監視者監視システムの端末装置および該端末装置の端末側監視処理方法ならびに前記被監視者監視システムを提供できる。
 
According to the present invention, it is possible to provide a terminal device of a monitored person monitoring system, a terminal side monitoring processing method of the terminal apparatus, and the monitored person monitoring system.

Claims (8)

  1.  ナースコールを受け付け、動画を含む画像を生成し、音声通話するナースコール受付装置と、前記ナースコール受付装置と通信可能に接続され、前記ナースコール受付装置と音声通話し、前記ナースコール受付装置で生成した動画の配信を受けて前記動画を表示する端末装置と、前記ナースコール受付装置および前記端末装置それぞれと通信可能に接続され、前記ナースコール受付装置で受け付けたナースコールの通報を受けて前記端末装置へ前記ナースコールを通報する中央処理装置とを備える被監視者監視システムの前記端末装置であって、
     通信を行う端末側通信部と、
     前記端末側通信部を介して前記ナースコール受付装置と音声通話する端末側音声通話部と、
     前記端末側通信部を介して前記ナースコール受付装置から配信を受けた動画を表示する端末側表示部と、
     前記ナースコール受付装置との音声通話の開始および終了を受け付ける端末側音声通話受付部と、
     前記ナースコール受付装置から配信を受けた動画を前記端末側表示部に表示している際に、前記端末側音声通話受付部で前記ナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する動画受信処理部とを備える、
     端末装置。
    A nurse call reception device that accepts a nurse call, generates an image including a video, and communicates with the nurse call reception device, and is communicably connected to the nurse call reception device. The terminal device that receives the generated moving image and displays the moving image, the nurse call reception device and the terminal device are communicably connected to each other, and receives the notification of the nurse call received by the nurse call reception device. The terminal device of the monitored person monitoring system comprising a central processing unit that reports the nurse call to the terminal device,
    A terminal-side communication unit that performs communication;
    A terminal-side voice call unit that makes a voice call with the nurse call reception device via the terminal-side communication unit;
    A terminal-side display unit that displays the video received from the nurse call reception device via the terminal-side communication unit;
    A terminal-side voice call acceptance unit for accepting start and end of a voice call with the nurse call acceptance device;
    When displaying the video received from the nurse call reception device on the terminal side display unit, when receiving the start of the voice call with the nurse call reception device in the terminal side voice call reception unit, A video distribution condition setting communication signal for instructing the setting of the video distribution condition is transmitted to the nurse call reception device via the terminal side communication unit so that the communication capacity is reduced as compared with the video distribution condition in the case of non-calling. A moving image reception processing unit
    Terminal device.
  2.  前記動画配信条件は、前記動画のフレームレート、前記動画のフレームサイズおよび前記動画の色数のうちの1または複数である、
     請求項1に記載の端末装置。
    The moving image delivery condition is one or more of a frame rate of the moving image, a frame size of the moving image, and the number of colors of the moving image.
    The terminal device according to claim 1.
  3.  前記動画配信条件は、前記動画のフレームレートが0である、
     請求項1に記載の端末装置。
    The moving image distribution condition is that a frame rate of the moving image is 0.
    The terminal device according to claim 1.
  4.  前記端末側表示部は、前記動画のフレームレートが0である動画配信条件の設定を指示するための動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する場合に表示されていた動画の画像を静止画として表示を継続する、
     請求項3に記載の端末装置。
    The terminal-side display unit transmits a video distribution condition setting communication signal for instructing setting of a video distribution condition where the frame rate of the video is 0 to the nurse call reception device via the terminal-side communication unit. Continue to display the video image that was displayed in as a still image,
    The terminal device according to claim 3.
  5.  前記動画受信処理部は、前記端末側音声通話受付部で前記ナースコール受付装置との音声通話の終了を受け付けた場合に、非通話の場合における動画配信条件の設定を指示するための第2動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する、
     請求項1ないし請求項4のいずれか1項に記載の端末装置。
    The video reception processing unit is a second video for instructing setting of video distribution conditions in the case of a non-call when the terminal-side voice call reception unit receives the end of the voice call with the nurse call reception device. Transmitting a delivery condition setting communication signal to the nurse call reception device via the terminal-side communication unit;
    The terminal device according to any one of claims 1 to 4.
  6.  前記端末側音声通話受付部は、音声の有無に応じて前記音声通話の開始および終了を受け付けるボイスアクティベート機能を備える、
     請求項1ないし請求項5のいずれか1項に記載の端末装置。
    The terminal-side voice call acceptance unit includes a voice activation function that accepts the start and end of the voice call according to the presence or absence of voice,
    The terminal device according to any one of claims 1 to 5.
  7.  ナースコールを受け付け、動画を含む画像を生成し、音声通話するナースコール受付装置と、前記ナースコール受付装置と通信可能に接続され、前記ナースコール受付装置と音声通話し、前記ナースコール受付装置で生成した動画の配信を受けて前記動画を表示する端末装置と、前記ナースコール受付装置および前記端末装置それぞれと通信可能に接続され、前記ナースコール受付装置で受け付けたナースコールの通報を受けて前記端末装置へ前記ナースコールを通報する中央処理装置とを備える被監視者監視システムにおける前記端末装置の端末側監視処理方法であって、
     端末側通信部によって通信を行う端末側通信工程と、
     端末側音声通話部によって前記端末側通信部を介して前記ナースコール受付装置と音声通話する端末側音声通話工程と、
     端末側表示部によって前記端末側通信部を介して前記ナースコール受付装置から配信を受けた動画を表示する端末側表示工程と、
     端末側音声通話受付部によって前記ナースコール受付装置との音声通話の開始および終了を受け付ける端末側音声通話受付工程と、
     前記端末側表示工程によって前記ナースコール受付装置から配信を受けた動画を前記端末側表示部に表示している際に、前記端末側音声通話受付工程によって前記端末側音声通話受付部で前記ナースコール受付装置との音声通話の開始を受け付けた場合に、非通話の場合における動画配信条件よりも通信容量が低減するように前記動画配信条件の設定を指示するための動画配信条件設定通信信号を前記端末側通信部を介して前記ナースコール受付装置へ送信する動画受信制御工程とを備える、
     端末側監視処理方法。
    A nurse call reception device that accepts a nurse call, generates an image including a video, and communicates with the nurse call reception device, and is communicably connected to the nurse call reception device. The terminal device that receives the generated moving image and displays the moving image, the nurse call reception device and the terminal device are communicably connected to each other, and receives the notification of the nurse call received by the nurse call reception device. A terminal-side monitoring processing method for the terminal device in a monitored person monitoring system comprising a central processing unit that reports the nurse call to a terminal device,
    A terminal side communication step of performing communication by the terminal side communication unit;
    A terminal-side voice call step for making a voice call with the nurse call reception device via the terminal-side communication unit by a terminal-side voice call unit;
    A terminal-side display step of displaying a video received from the nurse call reception device via the terminal-side communication unit by the terminal-side display unit;
    A terminal-side voice call accepting step for accepting start and end of a voice call with the nurse call accepting device by a terminal-side voice call accepting unit;
    When the video received from the nurse call reception device in the terminal side display step is displayed on the terminal side display unit, the nurse call is performed in the terminal side voice call reception unit by the terminal side voice call reception step. When receiving the start of the voice call with the accepting device, the video distribution condition setting communication signal for instructing the setting of the video distribution condition so as to reduce the communication capacity than the video distribution condition in the case of non-calling A moving image reception control step for transmitting to the nurse call reception device via the terminal side communication unit,
    Terminal-side monitoring processing method.
  8.  ナースコールを受け付け、動画を含む画像を生成し、音声通話するナースコール受付装置と、前記ナースコール受付装置と通信可能に接続され、前記ナースコール受付装置と音声通話し、前記ナースコール受付装置で生成した動画の配信を受けて前記動画を表示する端末装置と、前記ナースコール受付装置および前記端末装置それぞれと通信可能に接続され、前記ナースコール受付装置で受け付けたナースコールの通報を受けて前記端末装置へ前記ナースコールを通報する中央処理装置とを備える被監視者監視システムであって、
     前記端末装置は、請求項1ないし請求項6のいずれか1項に記載の端末装置である、
     被監視者監視システム。
    A nurse call reception device that accepts a nurse call, generates an image including a video, and communicates with the nurse call reception device, and is communicably connected to the nurse call reception device. The terminal device that receives the generated moving image and displays the moving image, the nurse call reception device and the terminal device are communicably connected to each other, and receives the notification of the nurse call received by the nurse call reception device. A monitored person monitoring system comprising a central processing unit that reports the nurse call to a terminal device,
    The terminal device is the terminal device according to any one of claims 1 to 6.
    Monitored person monitoring system.
PCT/JP2016/070598 2015-08-07 2016-07-12 Terminal device for system for monitoring person to be monitored, terminal-side monitoring processing method for said terminal device, and system for monitoring person to be monitored WO2017026220A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2016572342A JP6123961B1 (en) 2015-08-07 2016-07-12 Terminal device of monitored person monitoring system, terminal side monitoring processing method of the terminal device, and monitored person monitoring system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-157396 2015-08-07
JP2015157396 2015-08-07

Publications (1)

Publication Number Publication Date
WO2017026220A1 true WO2017026220A1 (en) 2017-02-16

Family

ID=57983129

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/070598 WO2017026220A1 (en) 2015-08-07 2016-07-12 Terminal device for system for monitoring person to be monitored, terminal-side monitoring processing method for said terminal device, and system for monitoring person to be monitored

Country Status (2)

Country Link
JP (1) JP6123961B1 (en)
WO (1) WO2017026220A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111419584A (en) * 2020-04-13 2020-07-17 南京林业大学 Intelligence endowment rehabilitation and nursing bed

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003125365A (en) * 2001-10-10 2003-04-25 Minolta Co Ltd Controlling device, program, and recording medium
JP2005071064A (en) * 2003-08-25 2005-03-17 Hitachi Hybrid Network Co Ltd Home security system
JP2011146802A (en) * 2010-01-12 2011-07-28 Panasonic Electric Works Co Ltd Intercom system
JP2012105142A (en) * 2010-11-11 2012-05-31 Nec Casio Mobile Communications Ltd Video telephone device, and method of controlling the same
JP4989172B2 (en) * 2006-09-27 2012-08-01 アイホン株式会社 Nurse call system
JP2014171191A (en) * 2013-03-05 2014-09-18 Aiphone Co Ltd Nurse call system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003125365A (en) * 2001-10-10 2003-04-25 Minolta Co Ltd Controlling device, program, and recording medium
JP2005071064A (en) * 2003-08-25 2005-03-17 Hitachi Hybrid Network Co Ltd Home security system
JP4989172B2 (en) * 2006-09-27 2012-08-01 アイホン株式会社 Nurse call system
JP2011146802A (en) * 2010-01-12 2011-07-28 Panasonic Electric Works Co Ltd Intercom system
JP2012105142A (en) * 2010-11-11 2012-05-31 Nec Casio Mobile Communications Ltd Video telephone device, and method of controlling the same
JP2014171191A (en) * 2013-03-05 2014-09-18 Aiphone Co Ltd Nurse call system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111419584A (en) * 2020-04-13 2020-07-17 南京林业大学 Intelligence endowment rehabilitation and nursing bed
CN111419584B (en) * 2020-04-13 2021-05-07 南京林业大学 Intelligence endowment rehabilitation and nursing bed

Also Published As

Publication number Publication date
JPWO2017026220A1 (en) 2017-08-10
JP6123961B1 (en) 2017-05-10

Similar Documents

Publication Publication Date Title
JP6443493B2 (en) Display device and display method of monitored person monitoring system, and monitored person monitoring system
JP7021634B2 (en) Central processing unit and central processing method of the monitored person monitoring system and the monitored person monitoring system
JP6244201B2 (en) Nurse call system
JP6226110B1 (en) Monitored person monitoring apparatus, method and system
JP6123961B1 (en) Terminal device of monitored person monitoring system, terminal side monitoring processing method of the terminal device, and monitored person monitoring system
JP6493450B2 (en) Display device and display method of monitored person monitoring system, and monitored person monitoring system
JP6740633B2 (en) Central processing unit and central processing method of monitored person monitoring system, and monitored person monitoring system
JP6895090B2 (en) Detection system and display processing method of detection system
JP2017151676A (en) Monitored person monitor device, method of monitoring monitored person and program thereof
JP6187732B1 (en) Terminal device, terminal device operation control method, and monitored person monitoring system
JP6673382B2 (en) Terminal device, program and method
JP7047762B2 (en) Central processing unit and central processing method of the monitored person monitoring system and the monitored person monitoring system
JP6172424B1 (en) Terminal device, terminal device control method, and monitored person monitoring system
JP6213699B1 (en) Central processing unit and central processing method for monitored person monitoring system, and monitored person monitoring system
JP6150026B1 (en) Central processing unit and method of monitored person monitoring system, and monitored person monitoring system
JP7234931B2 (en) Sensor Device of Monitored Person Monitoring Support System, Processing Method of Sensor Device, and Monitored Person Monitoring Support System
WO2017130684A1 (en) Monitored-person monitoring device, method thereof, and system thereof
JP2020188487A (en) Central processing device, monitored person monitoring method, and monitored person monitoring system
WO2017141721A1 (en) Terminal device, terminal device operation contol method, and monitored person monitoring system
WO2017145520A1 (en) Terminal device, control method for terminal device, and system for monitoring persons to be monitored

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2016572342

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16834917

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16834917

Country of ref document: EP

Kind code of ref document: A1