JP6673382B2 - Terminal device, program and method - Google Patents

Description

  The present invention relates to a terminal device suitably used for a monitored person monitoring system for monitoring a monitored person to be monitored, a display method of the terminal device, and the monitored person monitoring system.

  Japan (Japan) is an aging society, more specifically the ratio of the population aged 65 and over to the total population, due to the improvement of living standards, the improvement of sanitary conditions, and the improvement of medical standards due to the postwar economic growth. The super-aging society has an aging rate exceeding 21%. In 2005, the total population was about 127.65 million, while the elderly population aged 65 and over was about 2.556 million. In 2020, the total population was about 124.11 million and the elderly were older. The population is projected to be about 3,456,000. In such an aging society, those who need nursing or care due to illness, injuries, or elderly people, and those who need nursing care (such as those requiring nursing care) are those who need to be nursing in a non-aging society. It is expected to increase more than the above. Japan is also a declining birthrate society, for example, with a total fertility rate of 1.33 in 2013. For this reason, elderly care has also been taking place where elderly family members (spouse, child, brother) care for elderly nurses and the like.

  Nurses who require nursing care enter nursing and nursing care facilities such as hospitals and nursing homes for the elderly (short-term nursing homes, nursing homes and nursing homes, etc. in Japanese law). In such a facility, a situation may occur in which a nurse or the like needs to be injured due to, for example, falling off from a bed or falling while walking, or get out of bed and wander. It is necessary to respond to such a situation as soon as possible. Moreover, if such a situation is left unchecked, it may be more serious. For this reason, at the facility, nurses, caregivers, and the like regularly check the safety and appearance of the patrols.

  However, the increase in the number of nurses and the like cannot keep up with the increase in the number of nurses requiring care and the like, and the nursing industry and the nursing care industry are chronically short of manpower. Furthermore, the number of nurses, caregivers, and the like decreases in the quasi-night shift and night shift hours as compared with the day shift hours, and the work load per person increases. Therefore, reduction of the work load is required. In addition, the situation of the elderly care is not an exception even in the facility, and it is often seen that elderly nurses and the like take care of elderly nurses and the like. In general, as a person becomes older, their physical strength declines, so even if they are healthy, the burden of nursing and the like is heavier than that of young nurses and the like, and their movements and judgments are slow.

  In order to reduce the labor shortage and the burden on nurses and the like, there is a need for a technology that complements nursing and care services. For this reason, in recent years, a monitored person monitoring technology for monitoring (monitoring) a monitored person to be monitored, such as a nurse requiring nursing, has been researched and developed.

  As one of such techniques, for example, there is a nurse call system disclosed in Patent Document 1. The nurse call system disclosed in Patent Document 1 is installed in a bed to allow a patient to call a nurse, and a nurse call slave is installed in a nurse station to respond to a call by the nurse call slave. A nurse call system having a nurse call master device, a camera for imaging a patient on a bed from above the bed, and a state in which the patient is upright and a state in which the patient is away from the bed based on an image captured by the camera. And a state determining means for determining the occurrence of at least one of them and outputting a caution state generation signal, and the nurse call master unit has a notification means for performing a notification operation upon receiving the caution state generation signal. The nurse call system transmits a captured image of the camera to the mobile terminal in response to a portable terminal carried by a nurse to respond to a call from the nurse call slave unit and the attention state generation signal. Communication control means.

  On the other hand, in terms of safety confirmation, a single person living alone is also the same as the person requiring care, and is a monitored person.

JP 2014-90913 A

  By the way, when an image of a camera is displayed on a terminal device as in a nurse call system disclosed in Patent Document 1, a monitor such as a nurse visually recognizes a situation of a monitored person such as a nurse requiring care. It is convenient because it can be grasped. An area image sensor (an image sensor such as a CCD or a CMOS) of a camera, an image (including a still image and a moving image) captured by the camera, and a display surface of a display device are usually viewed from the front with the upper left vertex at the coordinate origin Has an XY rectangular coordinate system in which a directed line segment from left to right along the horizontal direction is set on the X axis, and a directed line segment from top to bottom along the vertical direction is set on the Y axis. Are displayed on the display surface of the display device with their coordinate systems matched. For this reason, in the terminal device arranged in the regular arrangement mode, the observer who looks at the image of the camera, when viewed from the front, sees that the lower side of the display surface is the floor surface, the near position, the arrangement position of the entrance, etc. The image is viewed with a prejudice that the upper side of the display surface is a ceiling surface, a depth position, a window arrangement position, or the like. For this reason, when the camera is disposed above the room where the monitored person is located, for example, on the ceiling surface, with the imaging direction being vertically downward, the lower side of the area image sensor of the camera is closer to the entrance of the room. If the camera is provided, the image of the camera provided in such a manner is displayed on the display surface of the display device so as to match the above-mentioned prejudice. However, a plurality of cameras arranged in each room of a plurality of monitored persons, for example, in a certain room, the lower side of the area image sensor of the camera is on the right wall side when viewed from the entrance position of the room. Or in other rooms, such that the lower side of the area image sensor of the camera is located on the opposite side (for example, the window side) when viewed from the entrance position of the room, and so on. When arranged in different places, the image displayed on the display surface of the display device is contrary to the prejudice, and the lower side of the display surface is the right wall side of the room or the opposite side (for example, the window side). It will be on the wall side, etc. Since the observer needs to quickly grasp the situation of the monitored person by looking at the image, the observer tends to judge the image based on the preconception. Therefore, even if the monitored person does not fall, the monitored person's head is positioned below the display surface and the monitored person's legs are positioned above the display surface. There is a possibility that the observer who sees the image of the lying posture of the subject may mistakenly recognize that the monitored person has fallen. Alternatively, the observer who sees an image in which the monitored person has fallen on the upper side of the display surface while the monitored person has fallen in front of the room, If you rush to think that it is, the monitored person falls down immediately after entering the room from the entrance, and the monitored person may contact the monitored person. On the other hand, even if the observer grasps the display direction of the image on the display surface for each room, if the display direction is different for each room, the observer determines the situation from the image. Takes a long time.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a terminal device and a terminal device display method that can appropriately display an image on a display surface regardless of the arrangement direction of an imaging unit that generates an image. And to provide a monitored person monitoring system.

  The terminal device and the display method thereof according to the present invention, when receiving an event notification communication signal containing an event information representing the content of a predetermined event related to the monitored person and an image of the monitored person related to the event Then, an event screen for displaying the content of the event and the image in the received event notification communication signal is displayed on the display unit. At this time, the terminal device and its display method, the display direction of the display surface of the display unit and the image direction of the image, the image is displayed on the display unit so as to have a specific relationship set in advance. indicate. The monitored person monitoring system according to the present invention includes the terminal device.

  The above and other objects, features and advantages of the present invention will become apparent from the following detailed description and the accompanying drawings.

  The terminal device, the display method of the terminal device, and the monitored person monitoring system according to the present invention can appropriately display the image on the display surface regardless of the arrangement direction of the imaging unit that generates the image.

It is a figure showing composition of a monitored person monitoring system in an embodiment. FIG. 2 is a diagram illustrating a configuration of a sensor device in the monitored person monitoring system illustrated in FIG. 1. FIG. 3 is a diagram for explaining an installation state of the sensor device shown in FIG. 2. FIG. 2 is a diagram illustrating a configuration of a mobile terminal device in the monitored person monitoring system illustrated in FIG. 1. FIG. 5 is a diagram showing a configuration of a monitoring information table stored in the mobile terminal device shown in FIG. FIG. 5 is a diagram illustrating a configuration of a sensor information table stored in the mobile terminal device illustrated in FIG. 4. 5 is a flowchart showing an operation of a setting process in the mobile terminal device shown in FIG. 5 is a flowchart showing an operation of a monitoring process in the mobile terminal device shown in FIG. FIG. 5 is a diagram illustrating an example of a sensor device selection screen of a setting process displayed on the mobile terminal device illustrated in FIG. 4. FIG. 5 is a diagram illustrating an example of a positioning information setting screen (angle information setting screen) of a setting process displayed on the mobile terminal device illustrated in FIG. 4. FIG. 5 is a diagram illustrating an example of a standby screen displayed on the mobile terminal device illustrated in FIG. 4. FIG. 5 is a diagram illustrating an example of a monitoring information screen displayed on the mobile terminal device illustrated in FIG. 4. FIG. 5 is a diagram illustrating an example of a nurse call reception screen displayed on the mobile terminal device illustrated in FIG. 4.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In each of the drawings, components denoted by the same reference numerals indicate the same components, and the description thereof will be omitted as appropriate. In this specification, a generic name is denoted by a reference numeral with a suffix omitted, and an individual configuration is denoted by a reference numeral with a suffix.

  The monitored person monitoring system according to the embodiment monitors a monitored person (watching target) Ob, which is a monitoring target (watching target) to be monitored (watched), and communicates with a terminal device and the terminal device. And a monitored person monitoring device operably connected. The monitored person monitoring apparatus in the monitored person monitoring system includes event information indicating the content of a predetermined event (event) related to the monitored person Ob and requiring action, and an image of the monitored person Ob related to the event. The terminal device is notified of an event notification communication signal for notifying the event, which accommodates the event. Such a monitored person monitoring device may be integrally configured with one device, but in the present embodiment, the monitored person monitoring device can communicate with the sensor device, and each of the sensor device and the terminal device. And a management server device connected to the device, the two types of devices are configured separately. The sensor device detects the predetermined event relating to the monitored person Ob and notifies (notifies, transmits) to the management server device. Upon receiving the notification from the sensor device, the management server device re-notifies (re-notifies and re-transmits) the notification to a predetermined terminal device associated with the sensor device. A terminal device in the monitored person monitoring system, a communication unit that performs communication, a display unit that displays on a display surface, and when the event notification communication signal is received by the communication unit, the received event notification communication signal A display processing unit for displaying on the display unit an event screen for displaying the content of the event represented by the event information contained in the received event notification communication signal and the image contained in the received event notification communication signal. Then, the display processing unit defines a direction from bottom to top as a display direction of the display surface when the display surface of the display unit is viewed from the front, and a front view of the area image sensor that generates the image. In the case where the direction from the bottom to the top is defined as the image direction of the image, the image is displayed on the display unit such that the display direction and the image direction have a predetermined specific relationship. . The terminal device may be one type of device, but in the present embodiment, the terminal device is two types of devices, a fixed terminal device and a portable terminal device. The main difference between these fixed terminal devices and portable terminal devices is that while the fixed terminal device is fixedly operated, the portable terminal device is operated while being carried by a supervisor (user) such as a nurse or a caregiver. Since the fixed terminal device and the portable terminal device are substantially the same, the following embodiments will mainly describe the portable terminal device.

  FIG. 1 is a diagram illustrating a configuration of a monitored person monitoring system according to the embodiment. FIG. 2 is a diagram showing a configuration of a sensor device in the monitored person monitoring system shown in FIG. FIG. 3 is a diagram for explaining an installation state of the sensor device shown in FIG. FIG. 3A is a diagram of the room viewed from the side, and FIG. 3B is a diagram of the room viewed from the top. FIG. 4 is a diagram illustrating a configuration of the mobile terminal device in the monitored person monitoring system of the embodiment. FIG. 5 is a diagram showing a configuration of a monitoring information table stored in the mobile terminal device shown in FIG. FIG. 6 is a diagram showing a configuration of a sensor information table stored in the mobile terminal device shown in FIG.

  More specifically, the monitored person monitoring system MS in the embodiment includes, for example, one or a plurality of sensor devices SU (SU-1 to SU-4) and a management server device SV, as illustrated in FIG. It includes a fixed terminal device SP, one or a plurality of portable terminal devices TA (TA-1, TA-2), and a private branch exchange (PBX) CX, which are wired or wireless, LAN (Local). It is communicably connected via a network (network, communication line) NW such as an Area Network. The network NW may be provided with a repeater that relays a communication signal, such as a repeater, a bridge, and a router. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1, TA-2, and the private branch exchange CX are L2 switches. (Hubs, hubs) LS and access point APs, and are communicably connected to each other by a wired and wireless LAN (for example, a LAN according to the IEEE 802.11 standard) NW. More specifically, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of mobile terminal devices TA-1, TA-2. Is connected to the line concentrator LS via the access point AP. The network NW configures a so-called intranet by using Internet protocol groups such as Transmission Control Protocol (TCP) and Internet Protocol (IP).

  The monitored person monitoring system MS is provided at an appropriate place according to the monitored person Ob. The monitored person (watching target person) Ob is, for example, a person who needs nursing due to illness or injury, a person who needs nursing care due to a decrease in physical ability, or a single person living alone. In particular, from the viewpoint of enabling early detection and early coping, the monitored person Ob may be a person who needs to be detected when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably disposed in a building such as a hospital, a welfare facility for the aged, and dwelling units according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored person monitoring system MS is provided in a building of a nursing facility including a plurality of rooms RM in which a plurality of monitored persons Ob enter, and a plurality of rooms such as nurse stations.

  The sensor device SU includes a communication function for communicating with the other devices SV, SP, and TA via the network NW, and transmits a predetermined event (event) relating to the monitored person Ob, which needs to be dealt with, to the management server device SV. This is a device for notifying to. In the present embodiment, for example, the predetermined event that needs to be dealt with is a predetermined action and a nurse call in the monitored person Ob. Therefore, in the present embodiment, the sensor device SU detects a predetermined behavior of the monitored person Ob, notifies (transmits) the detection result to the management server device SV as an example of the predetermined event, and receives a nurse call. Notify (transmit) the nurse call to the management server SV as another example of the predetermined event, make a voice call with the terminal devices SP and TA, generate an image including a moving image, and , TA to distribute moving images. For example, as shown in FIG. 2, the sensor device SU includes an imaging unit 11, a sensor-side sound input / output unit (SU sound input / output unit) 12, a nurse call reception operation unit 13, and a sensor-side control process. (SU control processing unit) 14, a sensor-side communication interface unit (SU communication IF unit) 15, and a sensor-side storage unit (SU storage unit) 16.

  The imaging unit 11 is a device that is connected to the SU control processing unit 14 and generates an image (image data) under the control of the SU control processing unit 14. The images include a still image (still image data) and a moving image (moving image data). The imaging unit 11 is arranged so as to be able to monitor a space (location space, in the example shown in FIG. 1, a living room (room) RM of the installation location) where the monitored person Ob to be monitored is scheduled to be located. The location space is imaged from above as an imaging target, an image (image data) of the imaging target as viewed from above is generated, and the image of the imaging target (target image) is output to the SU control processing unit 14. Preferably, since it is highly probable that the whole monitored object Ob to be monitored can be imaged, as shown in FIG. 3, the sensor device SU is perpendicular to the ceiling CE in the room RM where the monitored object Ob is located. The imaging direction (the direction of the optical axis of the imaging optical system) coincides with the direction (the direction of the normal to the horizontal ceiling surface of the ceiling). In FIG. 3B, the position of the sensor device SU when the sensor device SU is projected on the floor of the room RM is indicated by a broken-line rectangle. In the example shown in FIG. 3, the sensor device SU is disposed at a center position of the ceiling CE. In the example illustrated in FIG. 3, the room RM has a rectangular shape in a plan view, has an entrance on one of its short sides, and has a window on the opposite side (the other of the short sides) facing the entrance. I have. In the room RM, for example, a rectangular bedding BD such as a bed is arranged, and a wash basin WS is provided. The bedding BD is arranged so that its long direction is along the long side of the room RM, and one of the long sides LL1 of the bedding BD is along one wall of the long side of the room RM. Therefore, the other side LL2 of the long side is the long side that the monitored person Ob crosses when leaving the bed. A pillow PI is placed on the bedding BD from its upper end. The washstand WS is provided on a short-side wall surface having an entrance to the room RM. In addition, the sensor device SU is provided with a preset head scheduled position (usually a pillow) where the head of the monitored person Ob is to be located in the bedding (eg, bed or the like) BD on which the monitored person Ob lies. (Arrangement position) so that the imaging target can be imaged from directly above. The sensor device SU uses the imaging unit 11 to acquire an image of the monitored person Ob from above the monitored person Ob, preferably an image of the monitored object Ob from just above the expected head position.

  Such an imaging unit 11 may be a device that generates a visible light image, but in the present embodiment, is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. . In the present embodiment, for example, such an imaging unit 11 forms an infrared optical image of an object to be imaged on a predetermined imaging surface, and a light-receiving surface coincides with the imaging surface. An area image sensor that is arranged and converts an infrared optical image of the imaging target into an electrical signal, and data representing an infrared image of the imaging target by performing image processing on an output of the area image sensor. This is a digital infrared camera including an image processing unit that generates image data. In the present embodiment, the imaging optical system of the imaging unit 11 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fish-eye lens)) having an angle of view capable of imaging the entire living room RM provided. .

  The SU sound input / output unit 12 is a circuit that inputs and outputs sound. That is, the SU sound input / output unit 12 is a circuit that is connected to the SU control processing unit 14 and generates and outputs a sound corresponding to an electric signal representing the sound according to the control of the SU control processing unit 14. This is a circuit for acquiring the sound of and inputting it to the sensor device SU. The SU sound input / output unit 12 includes, for example, a speaker that converts a sound electric signal (sound data) into a sound mechanical vibration signal (acoustic signal) and a microphone that converts a sound mechanical vibration signal in an audible region into an electric signal. And the like. The SU sound input / output unit 12 outputs an electric signal representing an external sound to the SU control processing unit 14, converts the electric signal input from the SU control processing unit 14 into a sound mechanical vibration signal, and outputs the signal.

  The nurse call reception operation unit 13 is connected to the SU control processing unit 14 and is a switch circuit such as a push button switch for inputting a nurse call to the sensor device SU. The nurse call reception operation unit 13 may be connected to the SU control processing unit 14 by wire, or may be connected to the SU control processing unit 14 by short-range wireless communication such as Bluetooth (registered trademark) standard.

  The SU communication IF unit 15 is a communication circuit that is connected to the SU control processing unit 14 and performs communication under the control of the SU control processing unit 14. The SU communication IF unit 15 generates a communication signal containing data to be transferred input from the SU control processing unit 14 according to a communication protocol used in the network NW of the monitored person monitoring system MS, and generates the generated communication signal. The signal is transmitted to other devices SV, SP, and TA via the network NW. The SU communication IF unit 15 receives a communication signal from another device SV, SP, TA via the network NW, extracts data from the received communication signal, and the SU control processing unit 14 can process the extracted data. The data is converted into data in a simple format and output to the SU control processing unit 14. The SU communication IF unit 15 includes, for example, a communication interface circuit according to the IEEE 802.11 standard or the like.

  The SU storage unit 16 is a circuit that is connected to the SU control processing unit 14 and stores various predetermined programs and various predetermined data under the control of the SU control processing unit 14. The various predetermined programs include, for example, an SU control program that controls each unit of the sensor device SU according to the function of each unit, and an SU monitoring processing program that executes predetermined information processing related to monitoring of the monitored person Ob. And other control processing programs. The SU monitoring processing program detects a predetermined behavior of the monitored person Ob and notifies the detection result to the predetermined terminal devices SP and TA via the management server SV as an example of the predetermined event. When the action detection processing program or the nurse call reception operation unit 13 receives a nurse call, the management server device SV is notified as another example of the predetermined event, and the SU sound input / output unit 12 or the like is used. A nurse call processing program for making a voice call with the terminal devices SP and TA, a SU streaming processing program for distributing a moving image generated by the imaging unit 11 to the terminal devices SP and TA that have requested the moving image, and the like. included. The various types of predetermined data include the execution of each program such as a sensor device identifier (sensor ID), which is an identifier for identifying and identifying the sensor device SU, and a communication address of the management server device SV. Data necessary for the operation. The SU storage unit 16 includes, for example, a ROM (Read Only Memory) which is a nonvolatile storage element, an EEPROM (Electrically Erasable Programmable Read Only Memory) which is a rewritable nonvolatile storage element, and the like. The SU storage unit 16 includes a RAM (Random Access Memory) serving as a working memory of the so-called SU control processing unit 14 for storing data generated during execution of the predetermined program.

  The SU control processing unit 14 controls each unit of the sensor device SU according to the function of each unit, and notifies the management server SV of a predetermined event (event) related to the monitored person Ob which needs to be dealt with. Circuit for More specifically, in the present embodiment, the SU control processing unit 14 detects a predetermined action of the monitored person Ob, and notifies the management server SV of the detection result as an example of the predetermined event (notification, Transmitting), receiving a nurse call, notifying (notifying, transmitting) the nurse call to the management server SV as another example of the predetermined event, making a voice call with the terminal devices SP, TA, and Is generated and the moving image is distributed to the terminal devices SP and TA. The SU control processing unit 14 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits. By executing the control processing program, the SU control processing unit 14 executes a sensor-side control unit (SU control unit) 141, an action detection processing unit 142, a nurse call processing unit 143, and a sensor-side streaming processing unit (SU streaming processing unit). ) 144 are functionally provided.

  The SU control unit 141 controls each unit of the sensor device SU according to the function of each unit, and controls the entire control of the sensor device SU.

  The action detection processing unit 142 detects a predetermined action set in the monitored person Ob and notifies the detection result to the management server device SV as an example of the predetermined event. More specifically, in the present embodiment, the predetermined behavior is, for example, getting up where the monitored person Ob has occurred, leaving the monitored person Ob getting off the bed, falling down when the monitored person Ob has fallen from the bedding, Also, there are four behaviors in which the monitored person Ob falls down. The action detection processing unit 142 detects, for example, the head of the monitored person Ob based on the target image captured by the imaging unit 11, and based on the detected temporal change in the size of the monitored person Ob's head. The wake-up, leaving, falling, and falling of the monitored person Ob are detected. More specifically, the location area of the bedding BD and the first to third thresholds Th1 to Th3 are stored in the SU storage unit 16 in advance as one of the various predetermined data. The first threshold Th1 is a value for identifying the size of the head in the lying posture and the size of the head in the sitting posture in the area where the bedding BD is located. The second threshold value Th2 is a value for identifying whether or not the size of the head in the standing posture in the living room RM excluding the area where the bedding BD is located. The third threshold Th3 is a value for identifying whether or not the size of the head in the reclining posture in the living room RM excluding the area where the bedding BD is located. The behavior detection processing unit 142 first extracts a moving object region from the target image as a region of the person to be monitored Ob by, for example, the background difference method or the frame difference method. Next, from the extracted moving body region, the action detection processing unit 142 performs, for example, a circular or elliptical Hough transform, and also, for example, pattern matching using a prepared head model, The head region of the monitored person Ob is extracted by the neural network learned in (1). Then, the behavior detection processing unit 142 detects rising, leaving the bed, falling, and falling from the extracted position and size of the head. For example, the behavior detection processing unit determines that the position of the extracted head is within the area where the bedding BD is located, and the size of the extracted head is determined from the size of the recumbent posture by using the first threshold Th1. When the time changes to the size of the sitting posture, it is determined that the user has woken up and the wakeup is detected. For example, the behavior detection processing unit 142 may determine that the position of the extracted head is changed from the inside of the area where the bedding BD is located to the outside of the area where the bedding is located, and the size of the extracted head is the second area. When the threshold value Th2 is used to cause a time change from a certain size to the size of the standing posture, it is determined that the user has left the bed, and the leaving of the bed is detected. For example, the behavior detection processing unit 142 may determine that the position of the extracted head changes with time from within the area where the bedding BD is located to outside the area where the bedding BD is located. If the threshold value Th3 is used to cause a temporal change from a certain size to the lying posture size, it is determined that a fall has occurred, and the fall is detected. For example, the behavior detection processing unit 142 determines that the position of the extracted head is within the living room RM excluding the area where the bedding BD is located, and the size of the extracted head is determined by using the third threshold Th3. In the case where the size changes from the size to the recumbent posture over time, it is determined that a fall has occurred, and the fall is detected.

  When the predetermined action is detected in this way, the action detection processing unit 142 notifies the event containing event information (event information) indicating the content of the predetermined event (event) relating to the monitored person Ob. Is notified by the SU communication IF unit 15 to the management server SV. More specifically, the action detection processing unit 142 includes a communication signal (a first event notification communication signal) containing the sensor ID of the own device, event information indicating the content of the event, and a target image used for detecting the predetermined action. ) Is transmitted to the management server SV via the SU communication IF unit 15. In the present embodiment, the event information is one or more of wake-up, wake-up, fall, fall, and nurse call (NC). Here, the behavior detection processing unit 142 detects the wake-up, wake-up, fall, One or more of the falls are contained in the first event notification communication signal as the event information. The image may be at least one of a still image and a moving image. In the present embodiment, as described below, first, a still image is notified, and a moving image is distributed in response to a user request. Note that, first, a moving image may be distributed, or a still image and a moving image may be transmitted, and the still image and the moving image may be displayed on the terminal devices SP and TA by screen division.

  The nurse call processing unit 143 notifies the management server device SV of a first event notification communication signal containing, when the nurse call is received by the nurse call reception operating unit 13, another example of the predetermined event. A voice call is made between the terminal devices SP and TA by using the SU sound input / output unit 12 and the like. More specifically, when the nurse call reception operation unit 13 is operated by inputting, the nurse call processing unit 143 transmits the first event notification communication signal containing the nurse call as the sensor ID of the own device and the event information to the SU communication. The data is transmitted to the management server SV via the IF unit 15. Then, the nurse call processing unit 143 uses the SU sound input / output unit 12 and the like to perform a voice call with the terminal devices SP and TA by, for example, VoIP (Voice over Internet Protocol).

  When receiving a request for distribution of a moving image from the fixed terminal device SP or the mobile terminal device TA via the communication IF unit 3, the SU streaming processing unit 144 sends the request to the fixed terminal device SP or the mobile terminal device TA that has made the request. In addition, a moving image (for example, a live moving image) generated by the imaging unit 11 is distributed via the SU communication IF unit 15 by streaming reproduction.

  FIG. 1 shows, as an example, four first to fourth sensor devices SU-1 to SU-4, and the first sensor device SU-1 is one of the monitored persons Ob, Mr. A The second sensor device SU-2 is disposed in the room RM-1 (not shown) of Ob-1 and is disposed in the room RM-2 (not shown) of Mr. B Ob-2, one of the monitored persons Ob. The third sensor device SU-3 is provided in a living room RM-3 (not shown) of Mr. C Ob-3, which is one of the monitored persons Ob, and the fourth sensor device SU-4 is It is arranged in a room RM-4 (not shown) of Mr. D Ob-4 who is one of the monitored persons Ob.

  The management server SV has a communication function of communicating with the other devices SU, TA, and SP via the network NW, and when receiving the notification of the predetermined event from the sensor device SU, information on monitoring of the monitored person Ob ( Monitoring information (in the present embodiment, for example, the predetermined event (a predetermined action type detected by the sensor device SU or a nurse call received by the sensor device SU), an image (still image and moving image) of the monitored person Ob, and It manages the time at which the notification was received, etc., and notifies (re-notification, re-notification, transmission) the predetermined event to predetermined terminal devices SP, TA, and the client (the terminal devices SP, TA, etc. in the present embodiment). Is a device that provides the client with data according to the request described above and manages the entire monitored person monitoring system MS.

  More specifically, the management server SV associates the sensor device SU (sensor ID) of the notification source with the terminal devices SP and TA (terminal ID) of the notification destination (re-notification destination) (report destination correspondence relationship). ) And the correspondence (communication address correspondence) between each device SU, SP, TA (each ID) and its communication address is stored in advance. The terminal ID is an identifier for specifying and identifying the terminal devices SP and TA. First, upon receiving the first event notification communication signal, the management server device SV receives the first event notification communication signal and the sensor device SU of the notification source (transmission source) in the received first event notification communication signal. The obtained data is stored (recorded) as monitoring information of the monitored person Ob in association with each other. Then, the management server device SV specifies the notification destination terminal devices SP and TA corresponding to the notification source sensor device SU in the received first event notification communication signal from the notification destination correspondence relationship, and specifies the notification destination. A second event notification communication signal is transmitted to the terminal devices SP and TA. If the event information contained in the received first event notification communication signal is the predetermined action, the second event notification communication signal includes a sensor contained in the received first event notification communication signal. An ID, the event information (the detection result of the predetermined action) and the target image, and a download destination of the moving image corresponding to the sensor device SU having the sensor ID contained in the received first event notification communication signal. A communication address is accommodated. The communication address is obtained from the communication address correspondence. When the event information contained in the received first event notification communication signal is the nurse call, the management server SV may include the sensor ID and the event information contained in the received first event notification communication signal. (Nurse call reception) is accommodated. In addition, even if the communication address corresponding to the sensor device SU having the sensor ID contained in the received first event notification communication signal is stored as the download destination of the moving image in the second event notification communication signal according to the nurse call, good. The management server device SV provides data to the client in response to a request from the client (the terminal device SP, TA, or the like in the present embodiment). Such a management server device SV can be configured by, for example, a computer with a communication function.

  The fixed terminal device SP has a communication function of communicating with the other devices SU, SV, and TA via the network NW, a display function of displaying predetermined information, and an input function of inputting predetermined instructions and data, and the like. By inputting predetermined instructions and data given to the management server device SV and the mobile terminal device TA, and displaying monitoring information obtained by the sensor device SU, the user interface (UI) of the monitored person monitoring system MS is displayed. ). Such a fixed terminal device SP can be constituted by, for example, a computer having a communication function. Note that the fixed terminal device SP as an example of the terminal device operates in the same manner as the mobile terminal device TA. However, in this specification, the mobile terminal device TA as another example of the terminal device will be described.

  The mobile terminal device TA has a communication function for communicating with other devices SV, SP, and SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. It has a call function to perform, and inputs predetermined instructions and data given to the management server device SV and the sensor device SU, displays the monitoring information obtained by the sensor device SU by a notification from the management server device SV, This is a device for answering or calling a nurse call by voice communication with the sensor device SU. In the present embodiment, such a mobile terminal device TA includes, for example, a terminal-side communication interface unit (TA communication IF unit) 31, a terminal-side control processing unit (TA control processing unit) 32, as shown in FIG. Terminal-side storage unit (TA storage unit) 33, terminal-side sound input / output unit (TA sound input / output unit) 34, terminal-side input unit (TA input unit) 35, and terminal-side display unit (TA display unit) 36, and a terminal-side interface section (TAIF section) 37.

  The TA sound input / output unit 34 is, similarly to the SU sound input / output unit 12, connected to the TA control processing unit 32 and is a circuit for acquiring an external sound and inputting it to the portable terminal device TA. This is a circuit for generating and outputting a sound corresponding to an electric signal representing the sound under the control of the processing unit 32.

  The TA input unit 35 is connected to the TA control processing unit 32 and is, for example, a circuit that receives a predetermined operation and inputs the operation to the portable terminal device TA, and is, for example, a plurality of input switches to which predetermined functions are assigned. . In the predetermined operation, for example, an input operation of an ID for logging in, or a specific relationship between the display direction of the TA display unit 36 and the image direction of the image for the arrangement mode of the sensor device SU is set. For example, a setting operation, an operation for requesting and ending a voice call, an operation for requesting and ending a live video, and operations such as rescue, nursing, nursing, and assistance for the monitored person Ob related to the notified event. Various operations necessary for monitoring, such as an input operation indicating that there is an intention to perform a response (response, response) (“correspond”), and the like are included. The TA display unit 36 is connected to the TA control processing unit 32 and, under the control of the TA control processing unit 32, performs a predetermined operation content input from the TA input unit 35 or a target monitored by the monitored person monitoring system MS. The monitoring information (for example, the predetermined event (a type of a predetermined action detected by the sensor device SU or a nurse call received by the sensor device SU)) relating to monitoring of the monitoring person Ob, an image (still image and moving image) of the monitored person Ob , And the time at which the notification was received) and a display device such as an LCD (liquid crystal display) and an organic EL display. In the present embodiment, a touch panel is configured by the TA input unit 35 and the TA display unit 36. In this case, the TA input unit 35 is a position input device for detecting and inputting an operation position of, for example, a resistive type or a capacitive type. In this touch panel, a position input device is provided on the display surface of the TA display unit 36, and one or more candidates for input contents that can be input are displayed on the TA display unit 36. For example, a user (such as a nurse or caregiver) When the monitor) touches the display position where the input content desired to be input is displayed, the position is detected by the position input device, and the display content displayed at the detected position is input to the mobile terminal device TA as the user's operation input content. Is entered.

  The TAIF unit 37 is a circuit that is connected to the TA control processing unit 32 and that inputs and outputs data to and from an external device under the control of the TA control processing unit 32. An interface circuit, an interface circuit that performs infrared communication such as the IrDA standard, an interface circuit that uses the USB standard, and the like.

  The TA communication IF unit 31, like the SU communication IF unit 15, is a communication circuit connected to the TA control processing unit 32 for performing communication under the control of the TA control processing unit 32. The TA communication IF unit 31 includes, for example, a communication interface circuit according to the IEEE 802.11 standard or the like.

  The TA storage unit 33 is a circuit that is connected to the TA control processing unit 32 and stores various predetermined programs and various predetermined data under the control of the TA control processing unit 32. The various predetermined programs include, for example, a TA control program that controls each unit of the portable terminal device TA according to the function of each unit, and a TA monitoring process that executes predetermined information processing related to monitoring of the monitored person Ob. A program, a call processing program for making a voice call with the sensor device SU by using the TA sound input / output unit 34, and the like, a distribution of a moving image from the sensor device SU, and a streaming reproduction of the received moving image. A control processing program such as a TA streaming processing program displayed on the TA display section 36 is included. The TA monitoring processing program includes, when the TA communication IF unit 31 receives a second event notification communication signal transmitted from the management server device SV due to the first event notification communication signal transmitted by the sensor device SU, An event screen for displaying the content of the event represented by the event information contained in the received second event notification communication signal and the image contained in the received second event notification communication signal (for example, a monitoring screen described later) A display processing program for displaying the information screen 52 and the nurse call reception screen 53 on the TA display unit 36 is included. The various types of predetermined data are necessary for executing programs such as the terminal ID of the own device, screen information displayed on the TA display unit 36, the monitoring information of the monitored person Ob, and sensor information on the sensor device SU. Data, etc. are included. The TA storage unit 33 includes, for example, a ROM and an EEPROM. The TA storage unit 33 includes a RAM serving as a working memory of the so-called TA control processing unit 32 that stores data and the like generated during execution of the predetermined program. The TA storage unit 33 functions as a terminal-side monitoring information storage unit (TA monitoring information storage unit) 331 and a terminal-side sensor information storage unit (TA sensor information storage unit) 332 to store these monitoring information and sensor information. Be prepared.

  The TA monitoring information storage unit 331 stores the monitoring information. In the present embodiment, the TA monitoring information storage unit 331 stores, as the monitoring information, the sensor ID contained in the second event notification communication signal received from the management server device SV, the event information (event information; (Waking up, falling, falling, and nurse call), the communication address of the sensor device SU to which the image and the moving image are downloaded, the reception time of the second event notification communication signal, the presence / absence of a measure, and the like are stored in association with each other.

  In the present embodiment, the monitoring information is stored in the TA monitoring information storage unit 331 in a table format. The terminal-side monitoring information table (TA monitoring information table) MT for registering the monitoring information includes, for example, as shown in FIG. 5, a sensor ID field 3311 for registering a sensor ID contained in a communication signal, and the received communication information. An event field (event field) 3312 for registering the event information contained in the signal, a reception time field 3313 for registering the reception time of the received communication signal, and a registration of the still image contained in the received communication signal A moving image field 3315 for registering a communication address (for example, an IP address, etc.) of the sensor device SU corresponding to the sensor ID contained in the received communication signal as a live moving image acquisition destination; Register whether to accept the event information contained in the communication signal That a corresponding field 3316 includes a record for each communication signal thus received (for each event). In the still image field 3314, for example, image data of a still image may be registered. For example, a file name of image data of a still image may be registered. In the correspondence field 3316, as will be described later, the terminal devices SP and TA receive an indication ("correspondence") that there is an intention to deal with (correspondence, action, or measure) to the event information contained in the received communication signal. A flag (corresponding flag) indicating whether or not the operation has been performed is registered. For example, in the present embodiment, the correspondence field 3316 indicates that the terminal intends to deal with the event information (event information registered in the event field 3312) contained in the received communication signal (“corresponding”). In the terminal devices SP and TA, a correspondence flag “1” meaning that the device SP or TA has accepted, or the fact that there is an intention to cope with the event information contained in the received communication signal (“corresponding”) is indicated by the terminal device SP or TA. A corresponding flag “0” indicating that the request has not been received is registered. Note that, by default, a correspondence flag “0”, which indicates non-acceptance, is registered in the correspondence field 3316. If the first event notification communication signal contains a detection time at which the predetermined action was detected or a nurse call reception time at which the nurse call was received, the reception time is replaced with the detection time or the nurse time. The call reception time may be registered.

  The TA sensor information storage unit 332 stores the sensor information. In the present embodiment, the sensor information is information on the sensor device SU, and includes a sensor ID of the sensor device SU, a location where the sensor device SU is provided, a monitored person name of the monitored person Ob monitored by the sensor ID, and direction alignment information. Are associated with each other. The orientation information displays an image on the TA display unit 36 such that the display direction of the display surface on the TA display unit 36 and the image direction of the image generated by the area image sensor have a specific relationship set in advance. Information to do. In the present embodiment, rotation direction information indicating a rotation angle of the rotation when an image is rotated and displayed on the TA display unit 36 is used as the direction matching information. The display direction of the display surface is a direction from bottom to top when the display surface of the TA display unit 36 is viewed from the front. The image direction of the image is a direction from bottom to top when the area image sensor that generates the image is viewed from the front.

  In the present embodiment, such sensor information is stored in the TA sensor information storage unit 332 in a table format. More specifically, the terminal-side sensor information table (TA sensor information table) ST for registering sensor information includes, for example, a sensor ID field 3321 for registering a sensor ID and the sensor ID field 3321 as shown in FIG. Location field 3322 for registering the location of the sensor device SU having the sensor ID registered in the sensor ID, and the monitored person monitored by the sensor device SU having the sensor ID registered in the sensor ID field 3321. A monitored person name field 3323 for registering a monitored person name of Ob (that is, a monitored person Ob located at a location where the sensor device SU having the sensor ID registered in the sensor ID field 3321 is disposed); The sensor device SU having the sensor ID registered in the ID field 3321 is described later. And an orienting information field 3324 for registering the orienting information set to have a record for each sensor ID (i.e., sensor devices SU).

  As described above, in the present embodiment, the TA sensor information storage unit 332 is configured to display the image on the TA display unit 36 such that the display direction of the display surface and the image direction of the image have the specific relationship. This corresponds to an example of an alignment information storage unit that stores alignment information that is information.

  The TA control processing unit 32 controls each unit of the portable terminal device TA according to the function of each unit, receives and displays the monitoring information of the monitored person Ob, and responds to or calls out a nurse call. It is. The TA control processing unit 32 includes, for example, a CPU and its peripheral circuits. When the control processing program is executed, the TA control processing unit 32 executes a terminal control unit (TA control unit) 321, a terminal monitoring processing unit (TA monitoring processing unit) 322, a call processing unit 323, and a terminal streaming process. (TA streaming processing unit) 324, and the TA monitoring processing unit 322 functionally includes a display processing unit 3221.

  The TA control unit 321 controls each unit of the portable terminal device TA according to the function of each unit, and controls the overall control of the portable terminal device TA.

  The TA monitoring processing unit 322 executes predetermined information processing relating to monitoring of the monitored person Ob. More specifically, when the TA monitoring processing unit 322 receives the second event notification communication signal transmitted by the management server device SV due to the first event notification communication signal transmitted by the sensor device SU, The monitoring information of the monitored person Ob is stored (recorded) in the TA monitoring information storage unit 331 based on each information (each data) contained in the received second event notification communication signal. The TA monitoring processing unit 322 causes the display processing unit 3221 to display a screen corresponding to each piece of information contained in the received second event notification communication signal on the TA display unit 36.

  More specifically, the display processing unit 3221 includes event information indicating the content of a predetermined event related to the monitored person Ob and a target image of the monitored person Ob related to the event. When the second event notification communication signal is received by the TA communication IF unit 31, the content of the event represented by the event information contained in the received second event notification communication signal and the received second event notification communication An event screen for displaying the target image contained in the signal is displayed on the TA display unit. The event screen is, for example, a monitoring information screen 52 and a nurse call reception screen, which will be described later, in the present embodiment. In this case, the display processing unit 3221 displays the image on the TA display unit 36 such that the display direction of the display surface and the image direction of the image have a specific relationship set in advance. More specifically, the display processing unit 3221 corresponds to the sensor device SU related to the second event notification communication signal containing the image when displaying the image (that is, the display processing unit 3221 responds to the received second event notification communication signal). Based on the orientation information stored in the TA sensor information storage unit 332, the display direction of the display surface and the image direction of the image are determined by the specific sensor device SU having the stored sensor ID). The images are displayed on the TA display unit 36 so as to be related. More specifically, in the present embodiment, since the rotation angle information is used for the direction alignment information, the display processing unit 3221 determines whether the sensor having the sensor ID contained in the received second event notification communication signal has the sensor ID. By rotating the image displayed on the TA display unit 36 based on the rotation angle information stored in the TA sensor information storage unit 332 as the direction alignment information corresponding to the device SU, the display direction of the display surface is changed. The image is displayed on the TA display unit 36 so that the image and the image direction of the image have the specific relationship.

  The specific relationship may be any relationship. Preferably, the specific relationship in the first aspect is a first relationship in which the bedding direction matches the display direction when a direction from the lower end to the upper end of the bedding BT shown in the image is defined as the bedding direction. Also preferably, the specific relationship of the second aspect is that the room direction is the display direction when a direction from the entrance side of the room RM shown in the image toward the opposite side facing the entrance is defined as the room direction. This is the second relationship that matches the direction. Also preferably, in the third aspect, the specific relation is a long side LL2 of the bedding BD shown in the image, and the long side LL2 that the monitored person Ob passes when leaving the bed is the third relation along the display direction; Alternatively, there is a fourth relationship in which the long side LL2 is orthogonal to the display direction. In the example illustrated in FIG. 3, the specific relationship of the first aspect is also the specific relationship of the second aspect, and further, the long side LL2 is a fourth relationship orthogonal to the display direction. Except for the specific relationship of the third aspect.

  Then, when receiving a predetermined input operation from the TA input unit 35, the TA monitoring processing unit 322 executes a predetermined process according to the input operation.

  The call processing unit 323 performs a voice call with the sensor device SU by using the TA sound input / output unit 34 and the like. More specifically, the call processing unit 323 transmits the first event notification communication signal that caused the transmission of the second event notification communication signal to the management server SV using the TA sound input / output unit 34 or the like. A voice call is made with the original sensor device SU by, for example, VoIP.

  The TA streaming processing unit 324 receives distribution of a moving image from the sensor device SU, and displays the received moving image on the TA display unit 36 by streaming reproduction.

  Such a mobile terminal device TA can be configured by a portable communication terminal device such as a so-called tablet computer, smartphone, or mobile phone.

  Next, the operation of the present embodiment will be described. In the monitored person monitoring system MS having the above-described configuration, when the power is turned on, each of the devices SU, SV, SP, and TA executes necessary initialization of each unit and starts operating. In the sensor device SU, by executing the control processing program, the SU control processing unit 14 is functionally configured with the SU control unit 141, the behavior detection processing unit 142, the nurse call processing unit 143, and the SU streaming processing unit 144. . In the portable terminal device TA, the TA control processing unit 32 is functionally configured with the TA control unit 321, the TA monitoring processing unit 322, the call processing unit 323, and the TA streaming processing unit 324 by executing the control processing program. The display processing unit 3221 is functionally configured in the TA monitoring control unit 322.

  Then, the monitored person monitoring system MS configured as described above generally monitors each monitored person Ob by the following operation.

  The sensor device SU operates as follows every frame or every several frames to detect a predetermined operation of the monitored person Ob and determine whether or not a nurse call has been accepted. First, the sensor device SU acquires an image (image data) for one frame from the imaging unit 11 as a target image by the SU control unit 141 of the SU control processing unit 14, and the acquired by the action detection processing unit 142. When a predetermined action in the monitored person Ob is detected based on the target image and the predetermined action is detected, the predetermined result detected as the event information is notified to a predetermined terminal device SP or TA in order to notify the detection result to the predetermined terminal device SP or TA. A first event notification communication signal concerning the detection of the predetermined action, which accommodates the action described above, is transmitted to the management server device SV. While operating in this manner, the sensor device SU determines by the nurse call processing unit 143 whether or not the nurse call is accepted by the nurse call reception operation unit 13, and when the nurse call is accepted, the nurse call is performed. The sensor device SU manages the first event notification communication signal related to the reception of the nurse call containing the received nurse call as the event information in order to notify the predetermined terminal devices SP and TA of the reception of the nurse call. It is transmitted to the server device SV.

  When the management server device SV receives the first event notification communication signal from the sensor device SU via the network NW, the management server SV replaces the sensor ID and the event information and other information contained in the first event notification communication signal with the sensor ID. Is stored (recorded) as monitoring information of the monitored person Ob monitored by the sensor device SU having Then, the management server device SV specifies the terminal devices SP, TA of the notification destination corresponding to the sensor device SU of the notification source in the received first event notification communication signal from the notification destination correspondence relationship, and specifies the notification destination. A second event notification communication signal is transmitted to the terminal devices SP and TA.

  When the fixed terminal device SP and the mobile terminal device TAa receive the second event notification communication signal from the management server device SV via the network NW, the fixed terminal device SP and the mobile terminal device TAa monitor the monitored person Ob contained in the second event notification communication signal. And displaying the monitoring information. The operation of displaying the monitoring information by the mobile terminal device TA will be described in detail below. By such an operation, the monitored person monitoring system MS detects, by the sensor devices SU, the management server device SV, the fixed terminal device SP, and the mobile terminal device TA, a predetermined action in each monitored person Ob, It receives a nurse call and monitors each monitored person Ob.

  Next, the operation of the terminal devices SP and TA in the monitored person monitoring system MS will be described. Here, the operation of the mobile terminal device TA will be representatively described.

  FIG. 7 is a flowchart showing the operation of the setting process in the portable terminal device shown in FIG. FIG. 8 is a flowchart showing the operation of the monitoring process in the portable terminal device shown in FIG. FIG. 9 is a diagram illustrating an example of a sensor device selection screen of a setting process displayed on the mobile terminal device illustrated in FIG. 4. FIG. 10 is a diagram showing an example of a positioning information setting screen (angle information setting screen) of the setting process displayed on the mobile terminal device shown in FIG. FIG. 11 is a diagram showing an example of a standby screen displayed on the mobile terminal device shown in FIG. FIG. 12 is a diagram showing an example of a monitoring information screen displayed on the mobile terminal device shown in FIG. FIG. 13 is a diagram showing an example of a nurse call reception screen displayed on the mobile terminal device shown in FIG.

  As described above, when the power is turned on and the operation starts, the portable terminal device TA accepts a log-in operation by a monitor (user) such as a nurse or a caregiver, and the display process of the TA monitor processing unit 322 is performed. A standby screen for waiting for a communication signal addressed to the own device is displayed on the TA display unit 36 by the unit 3221. For example, as shown in FIG. 11, the standby screen 51 includes a menu bar area 511 for displaying a menu bar, a message (for example, "no notification") indicating that the apparatus is in a standby state, and a standby main area for displaying an icon. 512, a time area 513 for displaying the current time, a year / month / day area 514 for displaying today's date / month / day, and a user name area 515 for displaying the name of the user currently logged in to the portable terminal device TA. Is provided. The menu bar area 511 is provided with a setting button 5111 for setting direction matching information (rotation angle information in the present embodiment).

  Hereinafter, first, an operation of a setting process for setting direction matching information for each sensor device SU will be described, and then, an operation of a monitoring process regarding monitoring of the monitored person Ob will be described.

(Setting process)
This setting process is performed, for example, at the timing before the operation of the monitored person monitoring system MS and its operation, the timing after the replacement of the sensor device SU after the operation, the timing after the addition of the sensor device SU after the operation, and the like. Is done.

  In this setting process, in FIG. 7, first, the TA control unit 321 of the TA control processing unit 32 uses the TA control unit 321 to set the standby screen 51, the monitoring information screen 52 described below, the nurse call reception screen 53, and the like. When the input operation of the button 5111 is received (S11), the TA monitoring processing unit 322 of the TA control processing unit 32 executes a selection process of selecting (designating) the sensor device SU for which the alignment information is to be set (S12). .

  In this selection process, more specifically, the TA monitoring processing unit 322 first uses the display processing unit 3221 to display a sensor device selection screen for selecting (designating) the sensor device SU for which the alignment information is to be set. indicate. The sensor device selection screen 54 includes, for example, as shown in FIG. 9, a menu bar region 511 and a sensor device selection region 541 for selecting (designating) and inputting a sensor device SU for which direction alignment information is to be set. And In the sensor device selection area 541, a list of the sensor devices SU of the monitored person monitoring system MS is displayed. Although the sensor device SU may be represented by the sensor ID, in the example shown in FIG. 9, the sensor device SU is represented at an installation location so that the sensor device SU to be set can be easily understood. That is, the display processing unit 3221 refers to the TA sensor information table ST stored in the TA sensor information storage unit 332, and sequentially records the sensor ID field 3221 and the arrangement location from the first row record to the last row record. The information registered in each of the fields 3322 is extracted, and the arrangement location is displayed in order from the first row 5411-1 of the sensor device selection area 541, while associating the row with the sensor ID. In the example illustrated in FIG. 9, for example, the sensor ID “SU-1” is associated with the first row 5411-1 of the sensor device selection area 541, and “Room 101” is displayed. The second row 5411-2 of the area 541 is associated with the sensor ID “SU-2” and displays “Room 102”. Each row 5411-1 to 5411-4 of the sensor device selection area 541 is a selection button 5411 for selecting and inputting the sensor device SU of the row 5411.

  When the input operation of the selection button 5411 is received, the portable terminal device TA causes the TA monitoring processing unit 322 to set the direction alignment information for the sensor device SU corresponding to the selection button that has received the input operation. The process is executed (S13).

  In this direction matching information setting process, more specifically, the TA monitoring processing unit 322 firstly uses the display processing unit 3221 to send the direction matching information to the sensor device SU corresponding to the selection button 5411 that has received the input operation. Displays the orientation information setting screen for setting. For example, as shown in FIG. 10, the direction alignment information setting screen 55 is a setting for displaying an image generated by the imaging unit 11 of the sensor device SU corresponding to the menu bar area 511 and the selection button that has received the input operation. A target image display area 551 and a direction matching information input button 552 for inputting direction matching information are provided.

  In order to display an image (setting target image) in the setting target image display area 551, before displaying the orientation information setting screen 55, the TA monitoring processing unit 322 corresponds to the selection button 5411 having received the input operation. A communication signal (first setting target image request communication signal) for requesting an image from the sensor device SU is transmitted to the management server device SV. The first setting target image request communication signal contains a terminal ID of the own device, a sensor ID corresponding to the selection button 5411 that has received the input operation, and a command (image request command) for requesting an image. The management server SV that has received the first setting target image request communication signal from the portable terminal device TA requests the sensor device SU having the sensor ID contained in the received first setting target image request communication signal for an image. (A second setting target image request communication signal) is transmitted to the sensor device SU. The second setting target image request communication signal contains the terminal ID, sensor ID, and image request command contained in the received first setting target image request communication signal. The sensor device SU, which has received the second setting target image request communication signal from the management server device SV, generates an image (setting target image) with the imaging unit 11 and returns a communication signal (the second signal) for returning the requested image. (1 setting target image return communication signal) to the monitoring server device. The first setting target image return communication signal includes the sensor ID of the own device, and the terminal ID and the setting target image stored in the received second setting target image request communication signal. The management server device SV that has received the first setting target image return communication signal from the sensor device SU sends the setting target image to the terminal device SP or TA having the terminal ID contained in the received first setting target image return communication signal. Is transmitted to the terminal devices SP and TA. The second setting target image return communication signal includes the sensor ID, the terminal ID, and the setting target image contained in the received first setting target image return communication signal. The portable terminal device TA acquires the setting target image to be displayed in the setting target image display area 551 by receiving the second setting target image return communication signal from the management server device SV. Then, the display processing unit 3221 displays the direction adjustment information setting screen 55.

  The orientation information input button 552 includes a “0 °” button 552-1 for rotating the image clockwise by 0 ° (that is, a “0 °” button 552-1 for not rotating the image) and a 90 ° clockwise rotation. A “90 °” button 552-2 for rotating the image by degrees, a “180 °” button 552-3 for rotating the image clockwise by 180 degrees, and a “270 °” button 552 for rotating the image clockwise by 270 degrees -4. In addition, instead of or in addition to the direction matching information input button 552, the direction matching information setting screen 55 may be configured to directly input a numerical value of the rotation angle.

  When receiving the input operation of the direction adjustment information input button 552, the TA monitoring processing unit 322 sets the rotation angle of the direction adjustment information input button 552 that has received the input operation to the direction alignment information (in the present embodiment, the rotation angle is adjusted by the direction adjustment information input button 552). The rotation angle information, which is an example of the information, is stored in the TA sensor information storage unit 332 in association with the sensor device SU (sensor ID) corresponding to the selection button 5411 that has received the input operation, and the next process S14 is performed. . More specifically, the TA monitoring processing unit 322 determines, from the TA sensor information table ST stored in the TA sensor information storage unit 332, the sensor ID corresponding to the selection button 5411 that has received the input operation, in the sensor ID field 3221. The rotation angle of the alignment information input button 552 that has received the input operation is registered in the alignment information field 3324 of the searched record, and is stored in the TA sensor information storage unit 332. The updated TA sensor information table ST is updated.

  For example, in the room RM illustrated in FIG. 3, the sensor device SU is disposed by construction such that the lower side of the area image sensor of the imaging unit 11 is on the left wall side when viewed from the position where the entrance of the room RM is disposed. In the setting target image display area 551 of the direction adjustment information setting screen 55, in the portable terminal device TA arranged in a regular arrangement mode, as shown in FIG. Is displayed on the lower side of the display surface. The setting target image displayed as shown in FIG. 10A is displayed such that the display direction and the image direction have a specific relationship of the first mode, that is, a first relationship in which the bedding direction matches the display direction. In order to display on the display surface of the TA display unit 36, the user inputs the “90 °” button 552-2 to rotate the setting target image clockwise by 90 degrees. When the input operation of the “90 °” button 552-2 is received, the TA monitoring processing unit 322 uses the rotation angle 90 ° of the “90 °” button 552-2 that has received the input operation as an example of the direction matching information. The rotation angle information is stored in the TA sensor information storage unit 332 in association with the sensor device SU (sensor ID) corresponding to the selection button 5411 that has received the input operation. Thus, in the monitoring process described later, an image is displayed in the image area 523 of the monitoring information screen 52 so that the bedding direction matches the display direction, as shown in FIG.

  Further, for example, in the room RM shown in FIG. 3, when the sensor device SU is disposed by construction such that the lower side of the area image sensor of the imaging unit 11 is on the opposite side when viewed from the position where the entrance of the room RM is disposed. In the setting target image display area 551 of the direction adjustment information setting screen 55, as shown in FIG. 10B, in the portable terminal device TA arranged in a regular arrangement manner, the opposite side is a display surface of the TA display unit 36. Is displayed. To display the setting target image displayed as shown in FIG. 10B on the display surface of the TA display unit 36 so that the display direction and the image direction have the specific relationship of the first mode, Operates the “180 °” button 552-3 to rotate the setting target image clockwise by 180 degrees. When the input operation of the “180 °” button 552-3 is received, the TA monitoring processing unit 322 uses the rotation angle of 180 ° of the “180 °” button 552-3 that has received the input operation as the rotation angle information and performs the input operation. Is stored in the TA sensor information storage unit 332 in association with the sensor device SU (sensor ID) corresponding to the selection button 5411 that has received the request. Thus, in the monitoring process described later, an image is displayed in the image area 523 of the monitoring information screen 52 so that the bedding direction matches the display direction, as shown in FIG.

  In the above description, the case where the specific relation is the first relation has been described. However, in the example shown in FIG. 3, the specific relation is also the second and third relations. Is also the description when the second relationship is the second relationship, and also when the specific relationship is the third relationship. Further, direction matching information may be set such that the specific relationship is the fourth relationship.

  Returning to FIG. 7, in the process S14, the portable terminal device TA determines whether or not the TA control processing unit 32 has received an instruction to return to the selection process of the sensor device SU for a preset predetermined time. As a result of this determination, when an instruction to return to the selection process of the sensor device SU is received (Yes), the process is returned to the process S12, and an instruction to return to the selection process of the sensor device SU is received during the predetermined time. If not (No), the process S15 is executed next. For example, when the input operation of the return button 553 for inputting the instruction to return to the previous screen shown in FIG. 10 is received, the TA control processing unit 32 determines that the instruction to return to the selection processing of the sensor device SU has been received. .

  In the process S15, the portable terminal device TA determines whether or not the TA control processing unit 32 has received an instruction to end the setting process during a predetermined time set in advance, and as a result of this determination, terminates the setting process. If an instruction to perform the setting process has been received (Yes), the process is terminated. If an instruction to terminate the setting process has not been received during the predetermined time (No), the process returns to step S14. For example, upon receiving an input operation of the home button 554 for inputting an instruction to return to the home screen illustrated in FIG. 10, the TA control processing unit 32 determines that the setting processing has ended, ends this processing, and sets the setting button 5111 Is displayed, for example, a standby screen 51 is received.

  Through such processing, the direction matching information is set in the portable terminal device TA in association with the sensor device SU.

(Monitoring process)
Next, in the monitoring process, after the completion of the setting process, in FIG. 8, the mobile terminal apparatus TA determines whether or not the TA control unit 321 of the TA control processing unit 32 has received the communication signal in the TA communication IF unit 31. Is determined (S31). If the result of this determination is that a communication signal has not been received (No), the portable terminal device TA returns the process to S31, and if the result of said determination is that a communication signal has been received (Yes), The mobile terminal device TA performs the following process S32. That is, the mobile terminal device TA is waiting for the reception of the communication signal.

  In the process S32, the portable terminal device TA uses the TA control unit 321 to determine the type of the received communication signal. As a result of this determination, when the communication signal received in the process S31 is the second event notification communication signal (second event notification), the portable terminal device TA executes the next process S33 and performs the following process S33. When the received communication signal is not the second event notification communication signal (others), the process ends after performing a process S37 of performing an appropriate process according to the communication signal received in the process S31.

  In the process S33, the portable terminal device TA monitors the monitored person Ob contained in the second event notification communication signal received from the management server device SV in the process S31 by the TA monitoring processing unit 322 of the TA control processing unit 32. The monitoring information relating to this is stored (recorded) in the TA monitoring information storage unit 331.

  Subsequent to the processing S33, the TA monitoring processing unit 322 causes the display processing unit 3221 to display a screen corresponding to each information contained in the second event notification communication signal received in the processing S31 on the TA display unit 36. More specifically, when the event information contained in the second event notification communication signal received in step S31 is the predetermined action, the display processing unit 3221, for example, displays the monitoring information screen 52 shown in FIG. Is displayed on the TA display unit 36. On the other hand, if the event information contained in the second event notification communication signal received in step S31 is the nurse call, the nurse call reception screen 53 shown in FIG. It is displayed on the TA display section 36.

  The monitoring information screen 52 is a screen for displaying the monitoring information regarding monitoring of the monitored person Ob. The monitoring information screen 52 includes, for example, as shown in FIG. 12, a menu bar area 511, an arrangement location of the sensor device SU having the sensor ID contained in the second event notification communication signal received in the processing S31, and A monitored person name area 521 that displays the name of the monitored person Ob monitored by the sensor device SU having the sensor ID, and a reception time of the second event notification communication signal received in step S31 (or the predetermined action A detection information display area 522 for displaying the elapsed time from the detection time) and the event information (the detection result of the predetermined action) contained in the second event notification communication signal received in step S31; (That is, the target image captured by the sensor device SU having the sensor ID) contained in the second event notification communication signal received at ) (Here it includes an image area 523 for displaying a still image), "corresponding" button 524, a "talk" button 525, a "See LIVE" button 526, a "Temporary OFF" button 527.

  In order to display the location of the sensor device SU and the name of the monitored person Ob in the monitored person name area 521, the TA storage unit 33 stores the sensor ID and the location of the sensor device SU having the sensor ID. The name of the monitored person Ob monitored by the sensor device SU having the sensor ID is stored in advance in association with each other.

  In the detection information display area 522, the detection results (in the present embodiment, the names of rising, leaving, falling, and falling) contained in the second event notification communication signal received in step S31 may be displayed as they are. However, in the present embodiment, the detection result is displayed as an icon symbolically. In order to display with these icons, each action and an icon symbolically representing the action are stored in the TA storage unit 33 in advance in association with each other. In the example illustrated in FIG. 12, a wake-up icon that symbolizes wake-up is displayed in the detection information display area 522.

  When displaying the image contained in the second event notification communication signal received in step S31 in the image area 523, the display processing unit 3221 has the sensor ID contained in the second event notification communication signal received in step S31. By rotating the image displayed on the TA display unit 36 based on the rotation angle information stored in the TA sensor information storage unit 332 as the direction alignment information corresponding to the sensor device SU, the display on the display surface is displayed. The image is displayed on the TA display unit 36 such that the direction and the image direction of the image have the specific relationship. More specifically, the display processing unit 3221 first obtains the sensor ID contained in the second event notification communication signal received in step S31 from the TA sensor information table ST stored in the TA sensor information storage unit 332. Then, the record registered in the sensor ID field 3321 is searched, and the rotation angle information registered in the orientation information field 3324 of the searched record is obtained. Then, the display processing unit 3221 rotates the image contained in the second event notification communication signal received in step S31 clockwise by the rotation angle of the acquired rotation angle information, and displays the image on the TA display unit 36. . Accordingly, the display direction of the display surface and the image direction of the image have the specific relationship, and the image is displayed on the TA display unit 36. For example, as described above, even when the setting target image is displayed on the display surface of the TA display unit 36 as shown in FIGS. 10A and 10B, the image is rotated clockwise by the rotation angle of the rotation angle information. Is displayed on the display surface of the TA display section 36 as shown in FIG.

  The “correspond” button 524 is used in the monitoring information screen 52 to perform a predetermined response (response, coping) such as, for example, rescue, nursing, nursing, and assistance to the detection result displayed on the monitoring information screen 52. This is a button for inputting, to the mobile terminal device TA, implementation intention information indicating that the user of the mobile terminal device TA is present. The “speak” button 525 is a button for requesting a voice call, and is used to input an instruction to connect the sensor device SU of the sensor ID and the portable terminal device TA via a network NW so as to enable a call. Button. The “view LIVE” button 526 is a button for requesting a live moving image, and is a button for inputting an instruction to display a moving image captured by the sensor device SU of the sensor ID. The “temporary OFF” button 527 is a button for inputting the stop of the monitoring function of the sensor ID of the sensor device SU to the portable terminal device TA. The monitoring function of the monitoring server device of the sensor ID of the sensor ID is performed. A button for inputting an instruction to stop the SV.

  The nurse call reception screen 53 is a screen for displaying reception of a nurse call. The nurse call reception screen 53 includes, for example, a menu bar area 511, a monitored person name area 521, a detection information display area 522, and a message indicating that a nurse call has been received (for example, as shown in FIG. 13). A nurse call reception notification display area 531 for displaying "nurse call"), a "correspondence" button 524, a "speak" button 525, and a "temporary OFF" button 527 are provided. In the nurse call reception screen 53, only the elapsed time from the reception time of the second event notification communication signal received in step S31 (or the reception time at which the nurse call was received) is displayed in the detection information display area 522. .

  Note that the nurse call reception screen 53 may further include a “view LIVE” button 526.

  Then, after the process S34, the portable terminal device TA determines whether the TA control processing unit 32 has accepted an input operation on the touch panel including the TA input unit 35 and the TA display unit 36 (S35). If the result of this determination is that an input operation has not been received (No), the mobile terminal device TA returns the process to step S35, while if the result of the determination indicates that an input operation has been received, the mobile terminal device TA The device TA performs the following processing S36.

  In this process S36, the TA control processing unit 32 of the portable terminal device TA executes an appropriate process according to the content of the input operation, and ends this process.

  For example, when the TA control processing unit 32 accepts the input operation of the “correspond” button 524 (that is, accepts the intention to respond) by the TA control processing unit 32, the portable terminal device TA displays the currently displayed message on the TA display unit 36. A sensor corresponding to the monitoring information of the monitored person Ob displayed on the TA display unit 36 is stored in the TA monitoring information storage unit 331 with the fact that “corresponding” has been received added to the monitoring information of the monitoring person Ob. A communication signal (correspondence reception notification communication signal) containing the ID and information (correspondence reception information) indicating that "correspondence" has been received is transmitted to the management server device SV. The management server device SV that has received the correspondence reception notification communication signal broadcasts the communication signal (correspondence well-known communication signal) containing the sensor ID and the correspondence reception information contained in the received correspondence reception notification communication signal. Transmit to terminal devices SP and TA. As a result, regarding the sensor ID corresponding to the monitoring information of the monitored person Ob displayed on the TA display section 36, the fact that "corresponding" has been received is synchronized between the terminal devices SP and TA.

  Further, for example, when the TA control processing unit 32 receives an input operation of the “speak” button 525, the mobile terminal device TA monitors the monitored person Ob displayed on the TA display unit 36 by the call processing unit 323. A communication signal (communication request communication signal) containing information such as a request for a voice call is transmitted to the sensor device SU, and the sensor device SU is connected to the sensor device SU via the network NW so as to enable a voice call. This enables a voice call between the portable terminal device TA and the sensor device SU. When the TA control processing unit 32 accepts an input operation of an unillustrated “end” button, which is a button for inputting an instruction to end the voice call, the TA processing unit 32 causes the call processing unit 323 to execute the TA operation. A communication signal (call end communication signal) containing information such as a request to end the voice call is transmitted to the sensor device SU monitoring the monitored person Ob displayed on the display unit 36. Thereby, the voice communication between the portable terminal device TA and the sensor device SU is terminated.

  Further, for example, when the TA control processing unit 32 receives an input operation of the “view LIVE” button 526 by the TA control processing unit 32, the TA streaming processing unit 324 causes the TA streaming processing unit 324 to display the monitored object currently displayed on the TA display unit 36. A communication signal (moving image distribution request communication signal) containing information such as a request for live video distribution is sent to the sensor device SU monitoring the observer Ob, and the sensor device SU and the network NW corresponding to the communication signal are transmitted. It is connected via a downloadable moving image via the sensor device SU, receives a live moving image distribution from the sensor device SU, and displays the received moving image on the TA display unit 36 by streaming reproduction. On the monitoring information screen 52 for displaying a live moving image, a moving image is displayed in the image area 523, and a “Live end” button (not shown) is displayed in place of the “Live” button 526. As a result, a live moving image is displayed on the portable terminal device TA. The “Live end” button (not shown) is a button for requesting the end of the moving image, and ends (stops) the distribution of the moving image captured by the sensor device SU of the sensor ID, and ends (stops) the display. ) Is a button for inputting an instruction to be performed. When the TA control processing unit 32 receives an input operation of the “LIVE end” button, the mobile terminal device TA monitors the monitored person Ob currently displayed on the TA display unit 36 by the TA streaming processing unit 324. A communication signal (moving image distribution end communication signal) containing information such as a request to end the moving image distribution is transmitted to the sensor device SU, and a still image is displayed on the TA display unit. Thereby, the portable terminal device TA ends the display of the moving image in the live.

  Further, for example, when the TA control processing unit 32 receives an input operation of the “temporary OFF” button 527 by the TA control processing unit 32, the mobile terminal device TA stops the monitoring function of the sensor ID of the sensor ID with the sensor ID of the sensor ID. A communication signal (a monitoring function stop command communication signal) for causing the management server SV to stop transmitting the second event notification communication regarding the device SU is transmitted to the management server SV. Upon receiving the monitoring function stop command communication signal, the management server SV receives the second event notification communication signal received from the sensor device SU having the sensor ID contained in the monitoring function stop command communication signal. Stop sending the event notification communication signal. The suspension of the monitoring function by the input operation of the “temporary OFF” button 527 is automatically released after a predetermined time has elapsed.

  Regarding the second event notification communication signal received from the management server device SV, the portable terminal device TA operates as described above.

  As described above, the monitored person monitoring system MS, the terminal devices SP, TA, and the display method mounted thereon in the present embodiment are configured to display an image such that a display direction and an image direction have the specific relationship. Since the display processing unit 3221 for displaying the image on the TA display unit 36 is provided, regardless of the arrangement direction of the imaging unit 11 that generates the image (in this embodiment, the arrangement direction of the sensor device SU), the image is displayed in the specific relation Can be displayed on the TA display section 36. Therefore, the monitored person monitoring system MS, the terminal devices SP, TA, and the display method can be appropriately displayed on the display surface of the TA display unit 36 regardless of the arrangement direction of the imaging unit 11.

  In the above-described embodiment, when the specific relationship is the first relationship, in the terminal devices SP and TA arranged in a regular arrangement mode, the monitored person monitoring system MS and the terminal The devices SP and TA and the display method described above, when the monitored person Ob is in the lying position on the bedding BD, the monitored person Ob is usually set so that the head is positioned above the display surface of the TA display unit 36. Display the captured image. For this reason, the observer (user) who sees the image displayed on the TA display unit 36 can easily change the situation of the monitored person Ob depending on whether or not the monitored person Ob shown in the image is in the normal lying posture. Can be grasped. Therefore, the monitored person monitoring system MS, the terminal devices SP and TA, and the display method can improve the convenience in grasping the state of the monitored person Ob.

  In the above-described embodiment, when the specific relationship is the second relationship, in the terminal devices SP and TA arranged in a regular arrangement mode, the monitored person monitoring system MS and the terminal The devices SP and TA and the above-described display method always display the image such that the entrance of the room RM is located below the image displayed on the TA display unit 36. For this reason, when the observer who sees the image displayed on the TA display unit 36 enters the room RM shown in the image from the entrance, the observer enters the room RM from below the image. You can easily imagine (image) and enter the room while imagining the situation after entering the room.

  In the above-described terminal device, when the specific relationship is the third relationship or the fourth relationship, the terminal device SP or TA arranged in a regular arrangement manner may be configured to monitor the monitored object in a front view. The person monitoring system MS, the terminal devices SP, TA, and the display method are such that, when the monitored person Ob is sitting on a bedding BD such as a bed, the monitored person is always located at substantially the same position with respect to the entire image. Ob can be displayed, and the face of the monitored person Ob can be displayed in substantially the same direction. A fall accident (fall accident) is relatively easy to occur when leaving the bed, but since the situation at the time of the fall is displayed in a uniform orientation, the observer can easily grasp the situation of the monitored person Ob. This is effective in preventing an accident when the monitor rushes to the monitored person Ob.

  Since the monitored person monitoring system MS, the terminal devices SP and TA, and the display method include the orientation information storage unit 332, the specific relationship can be easily set.

  In the above-described embodiment, the terminal devices SP and TA store the direction matching information. However, the direction matching information is stored in the sensor device SU, and the first event notification communication signal and the second event notification communication resulting therefrom are stored. This alignment information may be contained in the signal. In this case, the direction alignment information is input from, for example, the terminal devices SP and TA, and transmitted from the terminal devices SP and TA to the sensor device SU via the management server device SV, and stored. Further, for example, the sensor device SU further includes a setting switch such as a rotary switch or a dip switch for inputting direction alignment information, and the direction alignment information is input to and stored in the sensor device SU via the setting switch. Further, the direction matching information may be incorporated in the image information of the image contained in the first event notification communication signal and the second event notification communication signal resulting therefrom. For example, when the image is EXIF (exchangeable image file format) data, the direction matching information is incorporated as shooting direction information (camera rotational position information) of the metadata. More specifically, the Exif file is a file that conforms to the JPEG (Joint Photographic Experts Group) file format, and the application marker segment stores so-called Exif information such as shooting conditions. The direction alignment information is stored in this application marker segment as shooting direction information (rotational position information of the camera). Then, the terminal devices SP and TA that have received the second event notification communication signal cause the display processing unit 3221 to display the display direction and the image direction based on the alignment information contained in the second event notification communication signal. The image is displayed on the TA display unit 36 such that the above-mentioned relationship is established.

  Further, the direction matching information may be stored in the management server SV, and the direction matching information may be stored in the second event notification communication signal by the management server SV. In this case, the direction matching information is input from, for example, the terminal devices SP and TA, transmitted from the terminal devices SP and TA to the management server device SV, and stored. Also, for example, the management server SV executes the setting process described with reference to FIG. 7 and stores the direction matching information. The management server device SV stores the direction matching information in the same manner as the terminal devices SP and TA, for example, in a table similar to the TA sensor information table ST illustrated in FIG. When transmitting the second event notification communication signal due to the first event notification communication signal, the management server device SV stores the direction matching information corresponding to the sensor ID contained in the first event notification communication signal in the table. And this is stored in the second event notification communication signal. Then, the terminal devices SP and TA that have received the second event notification communication signal cause the display processing unit 3221 to display the display direction and the image direction based on the alignment information contained in the second event notification communication signal. The image is displayed on the TA display unit 36 such that the above-mentioned relationship is established.

  The terminal devices SP and TA do not need to store the direction alignment information in advance, and use the direction alignment information contained in the second event notification communication signal, so that the display direction and the image direction are in a specific relationship. Thus, the image can be easily displayed on the TA display section 36.

  The present specification discloses various aspects of the technology as described above, and the main technology is summarized below.

  A terminal device according to an aspect includes a communication unit for performing communication, a display unit for displaying on a display surface, event information indicating the content of a predetermined event relating to a monitored person who is a monitoring target, and a terminal related to the event. The event represented by the event information contained in the received event notification communication signal when the communication unit receives an event notification communication signal for notifying the event, which contains the image of the monitored person. And a display processing unit for displaying on the display unit an event screen for displaying the content of the event notification communication signal and the image contained in the received event notification communication signal. The display processing unit, when viewed from the front of the display surface of the display unit, defines a direction upward from the bottom as the display direction of the display surface, when viewed from the front of the area image sensor that generates the image, When the direction from the bottom to the top is defined as the image direction of the image, the image is displayed on the display unit such that the display direction and the image direction have a predetermined specific relationship. Preferably, in the above terminal device, the display processing unit rotates the image to be displayed on the display unit, so that the display direction and the image direction have the specific relationship, so that the image is displayed. The information is displayed on the display unit.

  Such a terminal device includes a display processing unit that displays an image on the display unit such that the display direction and the image direction have a specific relationship set in advance. Regardless, the image can be displayed on the display unit in the specific relationship. Therefore, the terminal device can appropriately display on the display surface of the display unit regardless of the arrangement direction of the imaging unit.

  In another aspect, in the above-described terminal device, the specific relationship is such that, when a direction from a lower end to an upper end of the bedding shown in the image is defined as the bedding direction, the first bedding direction matches the display direction. Relationship.

  In the terminal device arranged in a regular arrangement mode, when viewed from the front, the terminal device is configured such that, when the monitored person is lying on the bedding, the head is usually positioned above the display surface. An image of the monitored person is displayed. Therefore, the observer (user) who sees the image displayed on the display unit can easily grasp the situation of the monitored person based on whether or not the monitored person shown in the image is in the normal lying posture. Therefore, the terminal device can improve the convenience when grasping the situation of the monitored person.

  In another aspect, in the above terminal device, the specific relationship is defined as: a room direction when a direction from a side of an entrance in a room shown in the image to a side opposite to the entrance is defined as a room direction. Is a second relationship that matches the display direction.

  In a terminal device arranged in a regular arrangement mode, when viewed from the front, the terminal device always displays the image such that the entrance of the room is located below the image displayed on the display unit. For this reason, the observer who has watched the image displayed on the display unit enters the room shown in the image from the entrance when entering the room from the lower side of the image. You can imagine (image) and enter the room while imagining the situation after entering the room.

  In another aspect, in the terminal device described above, the specific relationship is a third relationship in which the long side of the bedding shown in the image and the long side that the monitored person crosses when leaving the bed is along the display direction. Or a fourth relation in which the long side is orthogonal to the display direction.

  In the terminal device arranged in the regular arrangement mode, when viewed from the front, the terminal device is always at substantially the same position with respect to the entire image when the monitored person is sitting on a bedding such as a bed. The monitored person can be displayed, and the monitored person can be displayed in substantially the same face direction. A fall accident (fall accident) is relatively easy to occur when leaving the bed, but since the situation at the time of the fall is displayed in a unified orientation, the observer can easily grasp the situation of the monitored person, This is effective in preventing an accident when the observer rushes to the monitored person.

  In another aspect, in the above-described terminal device, direction alignment information that is information for displaying the image on the display unit such that the display direction and the image direction have the specific relationship is stored. Further comprising an orientation information storage unit, wherein the display processing unit is configured such that the display direction and the image direction have the specific relationship based on the orientation information stored in the orientation information storage unit. And displaying the image on the display unit. Preferably, in the terminal device described above, the event notification communication signal is transmitted due to each of a plurality of monitored person monitoring devices that monitor a monitored person, and the direction matching information storage unit stores the direction matching information. The display processing unit stores the orientation matching information corresponding to the monitored object monitoring device of the event notification communication signal containing the image when displaying the image, in association with the monitored person monitoring device. The image is displayed on the display unit based on the direction matching information stored in the unit such that the display direction and the image direction have the specific relationship. Preferably, in these terminal devices described above, the direction matching information is rotation angle information indicating a rotation angle of the rotation when an image is rotated and displayed on the display unit, and the display processing unit is configured to control the direction. By rotating the image displayed on the display unit based on the rotation angle information stored in the alignment information storage unit as alignment information, the display direction and the image direction have the specific relationship. Thus, the image is displayed on the display unit.

  Such a terminal device can easily set the specific relationship by including the orientation information storage unit.

  In another aspect, in the terminal device described above, the event notification communication signal is information for displaying the image on the display unit such that the display direction and the image direction have the specific relationship. Further accommodating certain orientation information, the display processing unit, based on the orientation information contained in the event notification communication signal, so that the display direction and the image direction have the specific relationship, The image is displayed on the display unit.

  Such a terminal device does not need to store the direction matching information in advance, and uses the direction matching information contained in the event notification communication signal so that the display direction and the image direction have a specific relationship. The image can be easily displayed on the display unit.

  The display method of the terminal device according to another aspect, wherein the event information containing the content of a predetermined event related to the monitored person to be monitored, and the image of the monitored person related to the event, Receiving an event notification communication signal for notifying the content of the event represented by the event information contained in the event notification communication signal received in the receiving step and the received event notification communication signal And a display processing step of displaying an event screen for displaying the displayed image on a display unit that displays the event screen on a display surface. The display processing step, when viewed from the front of the display surface of the display unit, defines a direction upward from the bottom as the display direction of the display surface, when the area image sensor that generates the image is viewed from the front, When the direction from the bottom to the top is defined as the image direction of the image, the image is displayed on the display unit such that the display direction and the image direction have a predetermined specific relationship.

  Such a display method of the terminal device includes a display processing step of displaying an image on the display unit so that the display direction and the image direction have a predetermined specific relationship. Regardless of the disposition direction, the image can be displayed on the display unit in the specific relationship. Therefore, the display method of the terminal device can appropriately display the image on the display surface of the display unit regardless of the arrangement direction of the imaging unit.

  A monitored person monitoring system according to another aspect includes a terminal device, event information that is communicably connected to the terminal device, and represents a predetermined event related to a monitored person to be monitored, and the event A monitored person monitoring system including a monitored person monitoring device that notifies the terminal device of an event notification communication signal for notifying the event, containing the image of the monitored person related to the monitored terminal, The device is any of these terminal devices. Preferably, in the above-described monitored person monitoring system, the monitored person monitoring device includes a sensor device and a management server device communicably connected to the sensor device, and the sensor device is a monitored object to be monitored. Notifying the management server device of event information indicating the content of a predetermined event related to a monitor, and an event notification communication signal containing an image of the monitored person related to the event and notifying the event. Upon receiving the notification from the sensor device, the management server device re-notifies the communication to a terminal device communicably connected.

  Since such a monitored person monitoring system includes any one of these terminal devices, it can be appropriately displayed on the display surface regardless of the arrangement direction of the imaging unit that generates an image.

  This application is based on Japanese Patent Application No. 2016-32778 filed on February 24, 2016, the contents of which are included in the present application.

  Although the present invention has been described above appropriately and sufficiently through the embodiments with reference to the drawings in order to express the present invention, it is easy for those skilled in the art to modify and / or improve the above-described embodiments. It should be recognized that it is possible. Therefore, unless a modification or improvement performed by those skilled in the art is at a level that departs from the scope of the claims set forth in the claims, the modification or the improvement will not be included in the scope of the claims. Is interpreted as being included in

MS Monitored person monitoring system SU, SU-1 to SU-4 Sensor device SV Management server device SP Fixed terminal device TA, TA-1, TA-2 Portable terminal device 11 Imaging unit 31 Terminal side communication interface unit (TA communication IF Part)
32 Terminal-side control processing unit (TA control processing unit)
33 Terminal-side storage unit (TA storage unit)
35 Terminal side input unit (TA input unit)
36 Terminal side display unit (TA display unit)
321 Terminal side controller (TA controller)
322 Terminal monitoring processing unit (TA monitoring processing unit)
331 Terminal-side monitoring information storage unit (TA monitoring information storage unit)
332 Terminal side sensor information storage unit (TA sensor information storage unit)
3221 display processing unit 3321 terminal ID field 3324 orientation information field

Claims (3)

An acquisition unit configured to acquire an image generated by the image generation unit, which is associated with a predetermined event regarding a monitored person to be monitored;
A display unit for displaying on the display surface,
A display processing unit that displays a display screen including the obtained image on the display unit,
With
The display processing unit acquires orientation alignment information, which is information for displaying the image on the display unit such that a display direction to be described later and an image direction to be described later have a specific relationship set in advance,
The display processing unit, when viewed from the front of the display surface of the display unit, defines a direction from bottom to top as the display direction of the display surface, and when viewed from the front of the image generation unit, from bottom to top. When the heading direction is defined as the image direction of the image, the display direction and the image direction are in the specific relationship based on the alignment information regardless of the arrangement direction of the image generating unit. to, and displays the image on the display unit,
The specific relationship is:
When the direction from the lower end to the upper end of the bedding appearing in the image is defined as the bedding direction, the bedding direction is the first relationship that matches the display direction, or
When defining a direction from the side of the entrance in the room shown in the image to the opposite side facing the entrance as a room direction, the room direction is the second relationship that matches the display direction, or
A long side of the bedding appearing in the image and a long side that the monitored person crosses when leaving the monitor is a third relationship along the display direction, or a fourth relationship in which the long side is orthogonal to the display direction. ,
Terminal device. A computer of a terminal device including a display unit that performs display on a display surface,
An acquisition step of acquiring an image generated by the image generation unit, which is associated with a predetermined event related to a monitored person to be monitored,
A display processing step of displaying a display screen including the obtained image on the display unit;
An information acquisition step of acquiring orientation alignment information that is information for displaying the image on the display unit so that a display direction to be described later and an image direction to be described later have a specific relationship set in advance,
And execute
The display processing step, when the display surface of the display unit is viewed from the front, defines a direction upward from the bottom as the display direction of the display surface, when viewed from the front of the image generation unit, from the bottom to the top When the heading direction is defined as the image direction of the image, the display direction and the image direction are in the specific relationship based on the alignment information regardless of the arrangement direction of the image generating unit. to, and displays the image on the display unit,
The specific relationship is:
When the direction from the lower end to the upper end of the bedding appearing in the image is defined as the bedding direction, the bedding direction is the first relationship that matches the display direction, or
When defining a direction from the side of the entrance in the room shown in the image to the opposite side facing the entrance as a room direction, the room direction is the second relationship that matches the display direction, or
A long side of the bedding appearing in the image and a long side that the monitored person crosses when leaving the monitor is a third relationship along the display direction, or a fourth relationship in which the long side is orthogonal to the display direction. ,
program. A method performed in a terminal device including a display unit that performs display on a display surface,
An acquisition step of acquiring an image generated by the image generation unit, which is associated with a predetermined event related to a monitored person to be monitored,
A display processing step of displaying a display screen including the obtained image on the display unit;
An information acquisition step of acquiring orientation alignment information that is information for displaying the image on the display unit so that a display direction to be described later and an image direction to be described later have a specific relationship set in advance,
Has,
The display processing step, when the display surface of the display unit is viewed from the front, defines a direction upward from the bottom as the display direction of the display surface, when viewed from the front of the image generation unit, from the bottom to the top When the heading direction is defined as the image direction of the image, the display direction and the image direction are in the specific relationship based on the alignment information regardless of the arrangement direction of the image generating unit. to, and displays the image on the display unit,
The specific relationship is:
When the direction from the lower end to the upper end of the bedding appearing in the image is defined as the bedding direction, the bedding direction is the first relationship that matches the display direction, or
When defining a direction from the side of the entrance in the room shown in the image to the opposite side facing the entrance as a room direction, the room direction is the second relationship that matches the display direction, or
A long side of the bedding shown in the image, which is a long side that the monitored person crosses when leaving the monitor, is a third relation along the display direction, or a fourth relation in which the long side is orthogonal to the display direction. ,
Method.