JP2020129757A - Watching device and program for the same - Google Patents

Abstract

To provide a watching device for facilitating mutual communication between a target person and a person concerned with the target person.SOLUTION: The watching device includes: an imaging unit; a body movement detection unit for detecting a body movement of a target person; a control unit for detecting a predetermined event of the target person based on at least one of a photographed image including the target person photographed by the imaging unit and a body movement detected by the body movement detection unit; and a telephone unit, integrated with the imaging unit, the body movement detection unit, and the control unit to make voice calls using telephone numbers.SELECTED DRAWING: Figure 3

Description

The present invention relates to a watching device and a program for the watching device.

In Japan, the extension of life has become remarkable due to the improvement of living standards, the improvement of sanitary environment, and the improvement of medical standards accompanying the postwar high economic growth. For this reason, an aging society with a high aging rate is being combined with a decrease in the birth rate. In such an aging society, it is expected that the number of people who need care such as nursing care and support will increase due to illness, injury, and aging.

The subject may be injured at home or in a facility such as a hospital or a welfare facility for the elderly while falling while walking or falling from a bed. Therefore, in order to enable caregivers and nurses to rush immediately when the target person is in such a state, the target person's state is detected and the detection result is accessed by the relevant person via the network. A system for sending to possible servers is under development.

In connection with such a system, Patent Document 1 below discloses the following technique. The motion sensor data detected by the motion sensor installed in the residence of the occupant who is to be monitored and the acceleration sensor data detected by the acceleration sensor worn by the resident are stored in the residence via the access points. Send to the server PC inside or outside the room. Then, the server PC determines an event such as a resident's fall based on the resident's location estimated from the motion sensor data, the resident's behavior estimated from the acceleration sensor data, and the like. Save as information. As a result, it becomes possible for the caregiver or the like to browse the information on the event of the resident from a terminal connectable to the server PC via the Internet or the like.

JP, 2014-89494, A

However, the prior art as described above unilaterally notifies a predetermined address such as a caregiver when an event such as a fall of the target person is detected. There is a problem that it is difficult for related persons such as family members and the target person to smoothly communicate with each other.

The present invention has been made to solve such a problem. That is, it is an object of the present invention to provide a watching apparatus for facilitating mutual communication between a target person and a person concerned with the target person.

The above problems of the present invention are solved by the following means.

(1) A photographing unit for photographing a predetermined photographing region, and a body movement detecting unit for irradiating a predetermined irradiation region with a microwave and detecting a reflected wave to detect a body movement of a subject within the irradiation region. And, based on at least one of the body movement of the subject detected by the body movement detection unit, and the photographed image including the subject in the predetermined photographing region, which is photographed by the photographing unit, A watching apparatus having a control unit that detects a predetermined event of the target person, a photographing unit, the body movement detection unit, and a telephone unit that is integrated with the control unit and performs a voice call using a telephone number. ..

(2) The watching apparatus according to (1), wherein the telephone unit has a SIM slot, and makes a voice call by mobile telephone communication using a telephone number stored in a SIM card inserted in the SIM slot. ..

(3) The telephone section has a connection section for connecting a modular cable, and performs a voice call by fixed telephone communication using a telephone number corresponding to a telephone line connected to the modular cable. Alternatively, the watching apparatus according to (2).

(4) The watching apparatus according to any one of (1) to (3), further including a sounding unit that outputs a sound based on sound data received by the telephone unit.

(5) The watching apparatus according to any one of (1) to (4), further including a sound collecting unit that collects sound for generating sound data transmitted by the telephone unit.

(6) The telephone section transmits/receives voice data to/from a child device, which is a separately provided telephone, through wireless communication, and performs a voice call via the child device. The watching apparatus according to any one of 5).

(7) When the telephone unit receives an incoming call, the telephone unit automatically responds to a voice call without requesting an operation by the user, and the voice call is enabled. Watching device.

(8) The mobile phone further includes a storage unit that stores therein a callable phone number in advance, and when the phone call is received, the caller that has received the call is stored in the storage unit. When the telephone number other than the telephone number capable of receiving the call is used as the transmission source, the watching apparatus according to any one of (1) to (7) above, which does not respond to the incoming call. ..

(9) When the telephone unit receives an incoming call, the telephone unit notifies that the incoming call is received, and automatically responds after a predetermined time set in advance to enable the voice call (1) to The watching apparatus according to any one of (8).

(10) The control unit recognizes an instruction by voice or a gesture, and when the telephone unit receives a call, the predetermined time elapses when the control unit recognizes a predetermined instruction. The watching apparatus according to (9) above, which makes a voice call possible by responding even if the user does not do so.

(11) The watching apparatus according to any one of (1) to (10), wherein the telephone unit transmits the photographed image photographed by the photographing unit together with voice data for making a voice call.

(12) The telephone unit further includes an output unit for outputting an image based on the image data, and the telephone unit, together with the voice data for performing the voice call, the image data transmitted from the other party of the voice call. The watching apparatus according to any one of (1) to (11), which receives and transmits to the output unit.

(13) The control unit recognizes a voice or gesture instruction of the target person, and the telephone unit, based on the instruction recognized by the control unit, is associated with the instruction and is registered in advance. The watching apparatus according to any one of the above (1) to (12), which makes a call to the telephone number.

(14) At least one of a first interface for wirelessly communicating with a predetermined terminal and a second interface for wirelessly communicating with a device that detects information from the target person is further integrated. The watching apparatus according to any one of (1) to (13) above.

(15) The watching device according to any one of (1) to (14), wherein the control unit detects the event by detecting the action of the target person based on the captured image.

(16) The watching apparatus according to any one of (1) to (15), wherein the control unit detects the event based on the detected body movement of the target person.

(17) The watching apparatus according to any one of (1) to (16), further including an installation section for installing the watching apparatus on a ceiling.

(18) A program executed in a watching device in which a photographing unit, a body movement detecting unit, a control unit, and a telephone unit are integrated, and a photographed image in which a predetermined photographing region is photographed by the photographing unit. (A) and a step (b) of irradiating a predetermined irradiation area with microwaves by the body movement detection unit and detecting a reflected wave to acquire the body movement of the target person in the irradiation area. ) And at least one of the captured image including the target person in the predetermined shooting region acquired in step (a), and the body motion of the target person detected in step (b). Based on the above, the computer executes a process including a procedure (c) of detecting a predetermined event of the target person by the control unit and a procedure (d) of making a voice call using the telephone number by the telephone unit. The program for the watching device to make it.

A predetermined event is detected based on at least one of the image capturing unit, the body motion detection unit, the captured image including the target person captured by the image capturing unit, and the body motion of the target person detected by the body motion detection unit. The control unit and the telephone unit for making a voice call using the telephone number are integrated. As a result, a person concerned such as a family member of the target person can make a voice call with the target person by a familiar and simple operation of making a call to a predetermined telephone number. Therefore, the related person and the target person can easily realize mutual communication.

It is a figure which shows the whole structure of a watching system. It is a figure which shows the example of the detection part installed in the bed periphery of a subject's room. It is a block diagram which shows the hardware constitutions of a detection part. It is a figure which shows the installation part for installing a detection part on the ceiling of a living room. It is a figure which shows the screen of the contact book displayed on the tablet terminal. It is a figure which shows the screen of the message board displayed on the staff terminal. It is a block diagram which shows the hardware constitutions of a server. It is a figure which shows the example of the screen where the vital data memorize|stored in the server were displayed on the staff terminal. It is a figure which shows the other example of the screen where the vital data memorize|stored in the server were displayed on the staff terminal. It is a figure which shows the other example of the screen where the vital data memorize|stored in the server were displayed on the staff terminal. It is a block diagram which shows the hardware constitutions of an administrator terminal. It is a block diagram which shows the hardware constitutions of a staff terminal. It is explanatory drawing which shows the network structure of a watching system, and the data transmitted/received through a network. It is a flow chart which shows operation of a primary detecting element.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the description of the drawings, the same elements will be denoted by the same reference symbols, without redundant description. Further, the dimensional ratios in the drawings are exaggerated for convenience of description, and may differ from the actual ratios.

(overall structure)
FIG. 1 is a diagram showing the overall configuration of the watching system 1, and FIG. 2 is a diagram showing an example of the detection unit 10 installed around the bed 60 in the room of the subject 70.

As shown in FIG. 1, the watching system 1 includes a plurality of detection units 10, a server 20, an administrator terminal 30, one or more staff terminals 40, and one or more tablet terminals 200. The detection unit 10 constitutes a watching device. The detection unit 10, the server 20, the administrator terminal 30, and the staff terminal 40 are communicably connected to each other via a network 50 by wire or wirelessly. The network 50 may include a repeater such as a repeater, a bridge, a router, or a cross connect that relays communication signals. In the example illustrated in FIG. 1, the staff terminal 40 uses the detection unit 10, the server 20, the administrator terminal 30, and a network 50 including a wireless LAN including an access point 51 (for example, a LAN according to the IEEE 802.11 standard). They are connected so that they can communicate with each other. As described later, the tablet terminal 200 wirelessly communicates with the detection unit 10 by Wi-Fi (registered trademark), for example.

The target person 70 (target person to be watched over) is, for example, a patient who needs nursing care due to illness or injury, a cared person who needs nursing care due to deterioration of physical ability due to aging, a single person living alone, or a hospital facility. Patients who are hospitalized. In particular, from the viewpoint of enabling early detection and early coping, the target person 70 may be a person who needs the discovery when a predetermined inconvenient event such as an abnormal state occurs in the person.

The detection unit 10 may be arranged in the living room of each home, which is the observation region of the target person 70. In the example shown in FIG. 1, four detection units 10 are arranged in the living rooms of the homes of the target persons 70, Mr. A, Mr. B, Mr. C and Mr. D, respectively. A bed 60 is included in the observation region of the detection unit 10. The staff 80 who provides care (eg, care) to the target person 70 in accordance with his/her duties carries around the staff terminal 40, which is a portable terminal.

The administrator terminal 30 is a terminal for the administrator 90. The manager 90 is, for example, a manager who controls the plurality of staffs 80.

The position, the number, and the like of each component included in the watching system 1 are not limited to the example illustrated in FIG.

(Detection unit 10)
FIG. 3 is a block diagram showing the hardware configuration of the detection unit 10. FIG. 4 is a diagram showing an installation unit 10a for the detection unit 10 to be installed on the ceiling of a living room or the like. As shown in FIG. 3, the detection unit 10 includes a control unit 11, a storage unit 12, a camera 13, a body motion sensor 14, a microphone 15, a speaker 16, a router 17, a Wi-Fi (registered trademark) interface 18, and Bluetooth (Bluetooth). (Registered trademark) interface 19, telephone section 100, and output section 110, which are mutually connected by a bus. The camera 13 constitutes a photographing unit. The body movement sensor 14 constitutes a body movement detecting section. The Wi-Fi (registered trademark) interface 18 constitutes a first interface. The Bluetooth interface 19 constitutes a second interface. As shown in FIG. 4, the detection unit 10 has an installation unit 10a formed by at least a part being a flat surface, and may be fixedly arranged so that the flat surface contacts the ceiling of the living room. The installation unit 10a may be configured by fixing a stop plate having a hole through which a bolt for fixing the detection unit 10 is provided on the ceiling of the living room to a part such as a side surface of the detection unit 10.

The detection unit 10 may include constituent elements other than the above constituent elements, and may not include some of the constituent elements. For example, the detection unit 10 may further include a temperature sensor.

Each component of the detection unit 10 is physically integrated. For integration, multiple components are arranged in one housing, multiple components are mounted on one board, and the positions of the multiple components are relatively constant ( It is widely included that the distance is fixed (including the case where the distance is 0).

The control unit 11 is composed of a CPU (Central Processing Unit), and controls each unit of the detection unit 10 and performs arithmetic processing according to a program. The specific operation of the control unit 11 will be described later.

The storage unit 12 includes a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive), and the like, and stores various programs and various data.

The camera 13 is arranged in a position where the detection unit 10 is fixedly arranged on the ceiling of a living room, an upper portion of a fixed stand, an upper portion of a wall, or the like, so that an area including the bed 60 of the target person 70 can be overlooked. As a result, the camera 13 photographs a region including the bed 60 of the target person 70 as a predetermined photographing region (observation region) and outputs a photographed image (image data). Hereinafter, the image captured by the camera 13 is also simply referred to as “captured image”. The captured image includes an image including the target person 70. The captured image includes a still image and a moving image (video). Although the camera 13 is a near-infrared camera, a visible light camera may be used instead of this, or these may be used together.

The body movement sensor 14 detects the Doppler shift of the microwave generated by the body movement (for example, respiratory movement) of the target person 70 as the body movement by transmitting the microwave to the predetermined irradiation area and receiving the reflected wave. .. The predetermined irradiation region is a region in which the subject 70 can be irradiated with microwaves, and may be a region including a part or the whole of the bed 60, for example. The body movement sensor 14 detects the body movement of the chest (up and down movement of the chest) associated with the breathing movement of the subject 70, and the disturbance of the cycle in the body movement of the chest or the body movement of the chest that is less than or equal to a preset threshold value. By detecting the amplitude at, the fine body movement abnormality is detected.

The microphone 15 converts voice into an electric signal and outputs it. The microphone 15 functions as a sound collecting unit.

The speaker 16 converts an electric signal into a sound (sound wave) and outputs it. The speaker 16 functions as a sound generator.

The router 17 has an address (for example, an address for identifying itself as a transmission source) in a captured image, vital data including body movements, and data such as a predetermined event described later (hereinafter, referred to as “detection data or the like”). A global IP address) and an address (for example, a global IP address) for specifying the destination server 20 are added and transmitted to the server 20 via the network 50.

The camera 13 can output the captured image (image data) with an address (local IP address) for identifying the camera 13 added thereto. Further, from the body movement sensor 14, an address (local IP address) for specifying the body movement sensor 14 can be added to the body movement (microwave data) and output. In these cases, the router 17 uniformly converts the local IP address of the camera 13 and the local IP address of the motion sensor 14 into the global IP address of the router 17 (deletes the local IP address and adds the global IP address, etc.). ) And transmit the detection data to the server 20.

An address for identifying the camera 13 or the body movement sensor 14 may not be added to the detection data output from the camera 13 or the body movement sensor 14. In this case, the router 17 simply adds the global IP address or the like to the detected data and sends it to the server 20.

The router 17 includes a wireless router that wirelessly exchanges data using a wireless antenna and a SIM card, and a wired router that has an outlet such as a cable and that exchanges data in a wired manner.

When the router 17 is a wireless router, the router 17 has a SIM slot, and by transmitting the SIM card identification number stored in the SIM card inserted in the SIM slot to the base station, The global IP address dynamically assigned to the SIM card can be obtained and used as the address for specifying the router 17. The global IP address of the router 17 may be set in advance as a dedicated global IP address.

When the router 17 is a wired router, the router 17 transmits detection data and the like via a cable or the like inserted in the insertion port. In this case, an address (for example, a global IP address) for specifying the router 17 may be set in the router 17 in advance. When the router 17 is a wired router, the router 17 has an integrated conversion unit that performs at least one of mutual conversion between an optical signal and an electric signal and between a digital signal and an analog signal. It can be further included by being converted.

The Wi-Fi interface 18 includes a Wi-Fi module (semiconductor chip), and connects the tablet terminal 200, the staff terminal 40, the PC, etc. and the detection unit 10 to each other by Wi-Fi (registered trademark) so that they can wirelessly communicate with each other. To do.

The Bluetooth interface 19 includes a SoC (System-on-a-Chip) for Bluetooth, and can wirelessly communicate with a measuring device (not shown) that acquires vital data of the target person 70 by Bluetooth (registered trademark). Connect to.

The telephone unit 100 is configured to make a voice call via the public telephone line 53 using a telephone number. The telephone unit 100 is controlled by the control unit 11, and makes a voice call by fixed telephone communication or mobile telephone communication. A part of the processing by the telephone unit 100 can be executed by the control unit 11. The telephone unit 100 receives a voice signal of a telephone whose destination is a telephone number corresponding to itself, transmits the voice signal to the speaker 16, and outputs it as voice. The telephone unit 100 uses an electric signal obtained by converting the voice uttered by the target person 70 or the like as a response to the incoming call by the microphone 15 as voice data from the cable through the network 50 (specifically, the public telephone line 53). , To the terminal of the originator of the incoming call (for example, the terminal 92 of the family). Details of the configuration of the telephone unit 100 will be described later.

The output unit 110 is a component for outputting image (including still image and moving image) data received by the detection unit 10. For example, the output unit 110 may be a display or a projector that is provided integrally with the detection unit 10 and that displays or projects image data as an image. Alternatively, the output unit 110 may be a connection terminal for outputting image data to an external display or projector provided separately from the detection unit 10. Alternatively, the output unit 110 may be an arithmetic device that converts the image data acquired by the detection unit 10 into a format that can be displayed on a display or a projector and outputs the converted image data.

The configuration of the telephone unit 100 will be described.

The telephone section 100 performs fixed telephone communication via, for example, a public switched telephone network (PSTN) or a next-generation network (NGN: Next Generation Network) that substitutes for the public switched telephone network (PSTN). In this case, the telephone unit 100 has a connecting portion for connecting a modular cable of 6 poles 2 cores, 6 poles 4 cores, 6 poles 6 cores or the like used for a fixed telephone. In this case, a telephone exchange or the like, which is a facility of a telecommunications carrier, is connected to the terminal of the originator of a telephone whose destination is the telephone number of the home of the target person 70 in which the detection unit 10 is installed and the modular cable. Connected to the telephone line. As a result, the telephone section 100 is connected to the caller's terminal to enable a call. Note that the telephone unit 100 may perform fixed telephone communication via various IP telephone services capable of making and receiving calls using a telephone number.

Alternatively, the telephone unit 100 may perform mobile telephone communication in which wireless communication is performed with a base station via radio waves according to various wireless communication standards. In this case, the telephone unit 100 has a wireless antenna for performing wireless communication with the base station and a SIM slot for inserting a SIM card in which the identification number and the telephone number are stored in association with each other. Note that the telephone section 100 may perform mobile telephone communication via various IP telephone services capable of making and receiving a call using a telephone number.

When a telephone call from an external terminal such as the family terminal 92 is received, the telephone unit 100 does not request the target person 70 to perform an operation such as picking up the handset or pressing a response button. Automatically responds and makes a voice call with the target person 70 through the speaker 16 and the microphone 15.

Further, when a call is received from an external terminal, the telephone unit 100 refers to a preset list of callable telephone numbers in the storage unit 12 and sets a telephone number other than the callable telephone number as the caller. You can reject incoming calls.

Further, the telephone unit 100 may transmit the image captured by the camera 13 in real time to the other party of the telephone together with the voice data when performing communication using the telephone number. Thereby, the other party of the telephone can talk with the target person 70 while confirming the state of the target person 70 in real time by the image captured by the camera 13. Further, the telephone unit 100 receives a photographed image photographed by a camera or the like provided in the terminal of the other party of the telephone, and outputs the received photographed image to the output unit 110 such as a display or a projector provided in the detection unit 10. You may output via. Accordingly, the target person 70 can have a conversation while confirming the state of the other party of the telephone such as a family member in real time by the image captured by the camera of the other party of the telephone.

Further, the telephone unit 100 may function as a base unit of the telephone and may be connected to a handset (not shown) of the telephone provided separately from the detection unit 10 to enable a call using the handset.

In addition, when a telephone call arrives, the telephone unit 100 automatically notifies the incoming call by a voice output from the speaker 16 or an output of light or an image from the output unit 110, and then automatically after a predetermined time elapses. May be responded to.

Further, the telephone unit 100 may answer the call before a predetermined time elapses based on the voice of the target person 70 or an instruction by a gesture or the like. Alternatively, the telephone unit 100 may not automatically respond to the call based on the voice of the target person 70 or an instruction by a gesture or the like. In this case, the control unit 11 applies various known voice recognition processing, gesture recognition processing, or the like to the information indicating the voice or the motion of the target person 70 acquired from the microphone 15, the camera 13, or the like to obtain the voice of the target person 70 or Recognize instructions such as gestures.

Further, the telephone unit 100 may make a call to a predetermined telephone number registered in advance in the storage unit 12 based on the voice of the target person 70 or an instruction by a gesture or the like. A plurality of predetermined telephone numbers may be registered. In this case, a plurality of telephone numbers are registered in association with different voices or gestures. For example, voice data indicating a voice in which the family name of the target person 70 is pronounced may be registered in association with the family telephone number. Accordingly, when the target person 70 calls the family name, a telephone call is made from the telephone unit 100 to the telephone number of the family, and if the family answers the telephone, the voice call is immediately started. You can Alternatively, the data in which the specific gesture of the target person 70 is recorded may be registered in association with the telephone number of the family.

The telephone unit 100 may be integrated with the router 17. The telephone unit 100 and the router 17 may share the configuration of a wireless antenna, a SIM card, or the like.

The operation of the control unit 11 will be described.

The control unit 11 recognizes the behavior of the target person 70 from the captured image captured by the camera 13. The actions to be recognized include "getting up" from the bed 60, "getting away" from the bed 60, "falling" falling from the bed 60, and "falling" falling to the floor or the like.

The control unit 11 detects a silhouette of an image (hereinafter, referred to as “person silhouette”) from a plurality of captured images (moving images). The person silhouette can be detected, for example, by extracting a range of pixels having a relatively large difference by a time difference method that extracts a difference between images whose shooting times are before and after. The person silhouette may be detected by a background difference method that extracts a difference between the captured image and the background image. Waking up, leaving the bed, falling down, and falling are detected from the detected person silhouette from the posture of the target person 70 (for example, standing, sitting and lying down), and the position relative to an installed object such as the bed 60 in the living room. These detections may be performed by a program processed by the CPU of the control unit 11, or may be performed by a built-in processing circuit. The present invention is not limited to this, and all or most of these recognition processes may be performed on the server 20 side, and the control unit 11 may only transmit the captured image to the server 20. When recognizing one of the actions, the control unit 11 sends a notification that the action has occurred to the server 20 or the like as an event notification (alert) that notifies that a predetermined event has been detected. The event notification includes the name of the target person 70, the room number, and the content of the event. The predetermined event notified by the event notification includes falling asleep, an abnormality in minute body movement, and the like detected based on the body movement detected by the body movement sensor 14. Based on a nurse call signal output from the nurse call unit output by pressing a button of the nurse call unit (not shown) and a voice signal converted into an electric signal by the microphone 15, the control unit 11 A nurse call can be detected. The nurse call thus detected may also be included in the predetermined event.

The control unit 11 causes the router 17 to add an address for identifying itself, which is the transmission source, and an address for identifying the server 20, which is the transmission destination, to the detection data and the like, and then through the network 50. , The detection data and the like to the server 20.

The control unit 11 causes a part of the storage unit 12 to function as a ring buffer by continuously storing the captured image of the latest predetermined time in the storage unit 12. The predetermined time may be, for example, 5 minutes. When detecting an event based on the captured image, the control unit 11 notifies the captured image of, for example, one minute before and after the time when the event is detected, among the captured images of the predetermined time stored in the ring buffer. It can be included in the event notification to be transmitted to the server 20.

The control unit 11 receives the data of the contact book from the tablet terminal 200 provided for each room of the target person 70 by the Wi-Fi interface 18. The control unit 11 causes the router 17 to transmit the received contact book data to the server 20. The tablet terminal 200 may be replaced with a PC (personal computer) or the like.

FIG. 5 is a diagram showing a screen of the contact book displayed on the tablet terminal 200. A of FIG. 5 is a screen of the contact book displayed when the tablet terminal 200 is activated. FIG. 5B is a diagram showing an example of entry by the staff 80 on the screen of the contact book on the tablet terminal 200.

As shown in A of FIG. 5, when the tablet terminal 200 is activated, the screen of the contact book in which only the date and time is entered is displayed as the initial screen.

As shown in FIG. 5B, the staff 80 selects his/her name (name, surname, etc.) in the pull-down menu in the “Recorder” column on the screen of the contact book, and Enter your name as the person who describes it. The staff 80 inputs the measured vital data in the fields of "Body temperature", "Blood pressure", and "SPO2" on the screen of the contact book. The staff 80 activates a camera (not shown) included in the tablet terminal 200 by selecting the “activate camera” button, and the subject 70 is photographed by the camera, thereby inputting the image of the subject 70 in the contact book. You can The staff 80 freely describes the contact information in the "free description" column. In the example of B of FIG. 5, it is described that "he seemed to be in good physical condition, and his son talked a lot. Staff A". The entry in the contact book can be performed by handwriting with a touch pen. The entry in the contact book may be made by key input with a touch pen on the screen of the keyboard displayed by selecting the "keyboard input" button. The contents described in the contact book are scrolled and displayed by selecting the white left arrow or right arrow. By selecting another person's or one's own name in the pull-down menu in the "Writing person" column, the contents written in the contact book by the staff 80 having the selected name are displayed on the screen.

The control unit 11 receives the vital data from the measuring device that acquires the vital data of the target person 70 by the Bluetooth interface 19. The control unit 11 transmits the received vital data to the server 20 as detection data and the like.

Of the message boards for each detection unit 10 that can be viewed and posted by a member registered in advance by accessing the server 20, the control unit 11 sends the message board related to the detection unit 10 including the control unit 11 to the target person 70. When a posting is made, the router 17 receives the contents of the posting from the server 20 via the network 50. The control unit 11 projects the content of the received post, for example, by a projector (not shown) included in the detection unit 10 so that the target person 70 can visually recognize it on a screen or the like provided on the wall of the living room.

FIG. 6 is a diagram showing a screen of the message board displayed on the staff terminal 40. By accessing the server 20 from the staff terminal 40 of the staff 80 registered in advance as a member, the message board screen can be displayed on the staff terminal 40.

FIG. 6A shows a screen of a message board on which an event is displayed when the server 20 receives the event notification from the detection unit 10. In the example of FIG. 6, since the server 20 receives the event notification of “wake up” of Mr. A, the event of “wake up” is displayed in the thread of the message board about Mr. A. In the message input field, a check box for selecting a destination to notify the message posted in the message input field is displayed. As the destination candidates, an arbitrary category or group such as the target person 70, medical staff, nursing staff, and family can be set in advance. In addition, in FIG. 6, it is described that one message board thread is created in association with the detection unit 10 corresponding to Mr. A, but a message board thread is created in association with each event and each post related to Mr. A. You may do it.

FIG. 6B shows a screen of the message board when staff B and staff C each post from the staff terminal 40 in response to the event of “wake up” in the message board thread of Mr. A. Among the check boxes displayed in the message input field posted by the staff B, the check boxes for selection are input to the check boxes of the target person 70, the care staff, and the family. Therefore, as described above, the message content posted in the message input field is transmitted from the server 20 to the router 17 of the detection unit 10, and the projector provided in the detection unit 10 causes a screen or the like provided on the wall of the living room. Projected on. For example, an email or the like is transmitted to the terminal of the care staff and the family, and the URL for accessing the message board is described in the email, so that access to the message board can be induced.

The controller 11 transmits the telephone voice signal received by the router 17 to the speaker 16 and outputs it as voice. The control unit 11 transmits an incoming telephone call by the router 17 via the network 50 as an electrical signal, which is an electrical signal obtained by converting the voice uttered by the target person 70 or the like by the microphone 15 in response to the telephone call received by the router 17. Send to the original terminal.

The control unit 11 adjusts the brightness of the captured image based on the output of the image sensor forming the camera 13. The control unit 11 measures the brightness around the camera 13 based on the adjustment amount of the brightness of the captured image to detect forgetting to turn off the light during the sleeping time period. When the control unit 11 detects that the user forgets to turn off the light, the router 17 can send a notification that the user has forgotten to turn off the light to the staff terminal 40 or the like via the network 50.

The control unit 11 measures the temperature in the living room of the target person 70 by a temperature sensor (not shown) included in the detection unit 10. When the measured temperature exceeds a predetermined value, the router 17 controls the target person 70 A notification suggesting the possibility of heat stroke may be transmitted to the staff terminal 40 or the like via the network 50.

The control unit 11 receives an image of a garden photographed by a camera (not shown) whose photographing range is the garden of the home of the target person 70 from the camera via the Wi-Fi interface 18, and the detection unit 10 causes the detection unit 10 to detect. A projector (not shown) is provided to project the image on the screen or the like provided on the wall of the living room so that it can be viewed by the target person 70.

The work performed by the staff 80 may include medical work and nursing care work. Here, in the case where the work of the staff 80 is a care work for the target person 70, the correspondence content regarding each event will be described. If "wake-up" is determined as an event and the determination is within a predetermined time (wake-up time set at the facility (for example, 7 to 8 am), morning care is performed. This morning care includes face washing, tooth brushing assistance, denture wearing, dressing assistance, and the like. In the case of an event of “getting out of bed”, wheelchair transfer and walking assistance may be required. Further, as events other than the events determined by the detection unit 10 (regular time), there are beverages, meal assistance, excretion assistance, wheelchair transfer, walking assistance, and postural change (pressure ulcer prevention). For these regular events, an alert may be generated by a nurse call unit or the like at a fixed time. In addition, in the beverage, the meal assistance, and the excretion assistance, the water intake amount, the urination amount, the excretion amount, and the like of the target person 70 can be grasped by the staff 80, recorded in the correspondence record, and stored in the server 20. The correspondence record is input at the staff terminal 40 and transmitted from the staff terminal 40 to the server 20.

(Server 20)
FIG. 7 is a block diagram showing the hardware configuration of the server 20.

The server 20 includes a control unit 21, a communication unit 22, and a storage unit 23. The server 20 may be a cloud server virtually constructed by a plurality of servers arranged on the network 50 such as the Internet. The server 20 may be a single dedicated server provided at a remote location and connectable via the network 50. The respective components are connected by a bus so that they can communicate with each other. Among the constituent elements of the server 20, those corresponding to the constituent elements of the detection unit 10 have the same basic configuration as the constituent elements of the detection unit 10, and thus duplicated description will be omitted.

The communication unit 22 is a wired communication network interface according to a standard such as Ethernet (registered trademark) or a wireless communication interface according to a standard such as IEEE 802.11, and communicates with each terminal connected to the network 50. The storage unit 23 stores various programs and various data. The above components of the server 20 are controlled by the control unit 21 according to the program. The storage unit 23 stores information about the target person 70 and data such as a message board. The information about the target person 70 includes captured images, vital data, events, room temperature, contact book information, and the like.

When the server 20 receives the event notification from the detection unit 10, the server 20 transfers the event notification to each staff terminal 40 or the like to notify the staff 80 of the occurrence of the event and instructs the staff 80 to respond to the event.

The server 20 transmits the data stored in the storage unit 23 to the staff terminal 40 or the like and displays it on the screen in response to a request from the user of the staff 80 or the like registered in advance. The data includes a message board.

FIG. 8 is a diagram showing an example of a screen on which the vital data stored in the server 20 is displayed on the staff terminal 40.

As shown in FIG. 8, the staff terminal 40 displays the details of the vitals (measured values) and the last update date and time for each vital. By selecting the “room appearance” icon, the image captured by the camera 13 is displayed on the screen. Also, by selecting the "user list" icon, a list of the target persons 70 who are the measurement targets of vitals is displayed in a selectable manner by a pull-down menu or the like, and the vital persons of the target person 70 selected in the pull-down menu or the like are displayed. Details and the last update date and time for each vital are displayed.

FIG. 9 is a diagram showing another example of the screen displayed on the staff terminal 40 for the vital data stored in the server 20.

As shown in FIG. 9, on the staff terminal 40, any of the time zones of sleep, awakening, and absence (absence in the living room) is visually displayed in a graph. The displayed period is selectable and can be, for example, any one week. As in the example of FIG. 8, the “room appearance” icon and the “user list” icon are displayed.

FIG. 10 is a diagram showing still another example of the screen on which the vital data stored in the server 20 is displayed on the staff terminal 40.

As shown in FIG. 10, on the staff terminal 40, the transition of the respiratory rate is visually displayed in a graph. The displayed period is selectable and can be, for example, any one week. As in the example of FIG. 8, the “room appearance” icon and the “user list” icon are displayed.

(Administrator terminal 30)
FIG. 11 is a block diagram showing the hardware configuration of the administrator terminal 30. The administrator terminal 30 is a so-called PC (Personal Computer), and includes a control unit 31, a communication unit 32, a storage unit 33, a display unit 34, and an input unit 35, which are mutually connected by a bus. Among the constituent elements of the administrator terminal 30, those corresponding to the constituent elements of the server 20 have the same basic configuration as the constituent elements of the server 20, and thus duplicated description will be omitted.

The display unit 34 is, for example, a liquid crystal display, and displays various information.

The input unit 35 includes a keyboard, a numeric keypad, a mouse, etc., and inputs various information.

The administrator terminal 30 transmits the image or the like stored in the storage unit 33 to the detection unit 10 according to the instruction input to the input unit 35 by the administrator 90. The image includes a video for explaining taking medicine and a video for explaining rehabilitation.

The administrator terminal 30 can transmit the voice of the administrator 90 acquired by a microphone (not shown) to the detection unit 10 via the network 50. Thereby, for example, by transmitting the sound of the administrator 90 to the detection unit 10 together with the video for explaining the medication, the projector (not shown) included in the detection unit 10 projects the video while the sound is output. Can explain the subject taking the medicine to the target person 70 in the living room. It should be noted that the above-described video is transmitted from the administrator terminal 30 to the detection unit 10 in advance and stored in the storage unit 12 of the detection unit 10 in advance, and a control signal for reproducing the video is transmitted from the administrator terminal 30. The image may be projected by a projector (not shown) included in the detection unit 10 by transmitting the image to the detection unit 10.

(Staff terminal 40)
FIG. 12 is a block diagram showing the hardware configuration of the staff terminal 40. The staff terminal 40 includes a control unit 41, a wireless communication unit 42, a storage unit 43, a display unit 44, an input unit 45, and a voice input/output unit 46, which are mutually connected by a bus. Among the constituent elements of the staff terminal 40, those corresponding to the constituent elements of the server 20 have the same basic configuration as the constituent elements of the server 20, and thus duplicated description will be omitted.

The wireless communication unit 42 enables wireless communication using standards such as 4G, Wi-Fi, and Bluetooth (registered trademark), and wirelessly communicates with each device via the access point 51 or directly. The display unit 44 and the input unit 45 are touch panels, and a touch sensor as the input unit 45 is superimposed on the display surface of the display unit 44 formed of liquid crystal or the like. Various instructions are displayed to the staff 80 by the display unit 44 and the input unit 45. Further, the display unit 44 and the input unit 45 display an operation screen displaying an event notification, and accept various operations such as input of intention to respond to the event and input of care record through the operation screen. In addition, the display unit 44 displays the captured image (including live video) received from the server 20 by requesting the server 20. The voice input/output unit 46 is, for example, a speaker and a microphone, and enables voice communication with other staff terminals 40 and the detection unit 10 via the wireless communication unit 42. The staff terminal 40 can be configured by a portable communication terminal device such as a tablet computer, a smartphone or a mobile phone, for example.

The server 20, the administrator terminal 30, and the staff terminal 40 may include components other than the above-described components, or may not include some of the components described above.

FIG. 13 is an explanatory diagram showing a network configuration of the watching system 1 and data transmitted and received through the network 50. As shown in FIG. 13, the network 50 includes the Internet 52 and a public telephone line 53.

Data such as captured images, vital data, and event notifications (alerts) are transmitted from each detection unit 10 to the server 20 via the Internet 52. Further, these data are transmitted to these terminals via the Internet 52 in response to requests of the staff terminal 40, the administrator terminal 30, the doctor's terminal 91, and the terminal 92 of the family of the target person 70, which are registered in advance. Sent. The message board data is transmitted and received between the server 20, the staff terminal 40, the administrator terminal 30, the doctor terminal 91, and the family terminal 92 via the Internet 52. Of the messages posted to the message board, the message addressed to the target person 70 is transmitted from the server 20 to the detection unit 10 arranged in the room of the target person 70 via the Internet 52.

The voice signal is transmitted and received between the detection unit 10 and the staff terminal 40 and the administrator terminal 30 via the public telephone line 53. When a telephone call is made between the detection unit 10 and the staff terminal 40 or the like by the IP telephone, a voice signal is transmitted and received between the detection unit 10 and the staff terminal 40 via the Internet 52.

The operation of the detection unit 10 in the watching system will be described.

FIG. 14 is a flowchart showing the operation of the detection unit 10. This flowchart can be executed by the control unit 11 or the telephone unit 100 controlled by the control unit 11 according to a program stored in the storage unit 12 of the detection unit 10.

The detection unit 10 acquires a captured image from the camera 13 (S101).

The detection unit 10 acquires the body movement from the body movement sensor 14 (S102).

The detection unit 10 detects a predetermined event of the target person 70 based on at least one of the captured image and the body movement (S103).

The detection unit 10 detects an incoming call using the telephone number (S104).

The detection unit 10 confirms that the telephone number of the originator of the incoming call is a callable telephone number set in the storage unit 12 in advance (S105). If the telephone number is not a callable number, the detection unit 10 rejects the call or leaves the call, and does not answer the call. The process of step S105 may be omitted.

The detection unit 10 confirms that a predetermined time set in advance has elapsed since the call was received (S106). The process of step S106 may be omitted.

The detection unit 10 automatically responds to an incoming call and starts a voice call without requiring a user operation (S107).

This embodiment has the following effects.

A predetermined event is detected based on at least one of the image capturing unit, the body motion detection unit, the captured image including the target person captured by the image capturing unit, and the body motion of the target person detected by the body motion detection unit. The control unit and the telephone unit for making a voice call using the telephone number are integrated. As a result, a person concerned such as a family member of the target person can make a voice call with the target person by a familiar and simple operation of making a call to a predetermined telephone number. Therefore, the related person and the target person can easily realize mutual communication. Since there is no need to download and install a dedicated application and use it, or to perform complicated operations, anyone can easily make a voice call with the target person to communicate.

Further, the telephone unit has a SIM slot, and makes a voice call by mobile telephone communication using the telephone number stored in the SIM card inserted in the SIM slot. As a result, it becomes possible to easily make a voice call by mobile phone communication with a simple configuration. Further, it is not necessary to dispose a telephone line or the like for performing voice communication, and the work of installing or relocating the watching device is facilitated.

Further, the telephone section has a connection section for connecting a modular cable, and makes a voice call by fixed telephone communication using a telephone number corresponding to a telephone line connected to the modular cable. As a result, it becomes possible to easily make a voice call through fixed telephone communication with a simple configuration. In addition, it is possible to reliably make a voice call even in a place where the radio wave of the mobile phone communication is hard to reach, such as in a mountain area, a remote island, a basement or a high floor, or a place where the radio wave of the mobile phone communication cannot be used due to various reasons.

Further, a sounding unit that outputs a sound based on the sound data received by the telephone unit is integrated. This allows the target person to hear the voice of the telephone without having to go to or hold the handset or the like at a predetermined location. In addition, staff members other than the target person can also listen to the voice of the telephone and share the content.

Furthermore, a sound collecting unit that collects sound for generating sound data transmitted by the telephone unit is integrated. This allows the target person to convey the voice to the other party by telephone without the need for the target person to pick up or hold the handset or the like. In addition, staff members other than the target person can simultaneously convey voice to the other party by telephone.

Further, the telephone unit transmits and receives voice data to and from a child device, which is a separately provided telephone, via wireless communication, and performs a voice call via the child device. With this, even when the target person is not near the watching apparatus, it is possible to carry out a voice call with the target person at any time by carrying the handset or handing the handset.

Furthermore, when a telephone call is received, the telephone section automatically responds to a voice call without requiring a user operation. As a result, the voice call is started without requiring the target person to pick up the receiver or the like to a predetermined place or press a predetermined button. As a result, the target person can easily make a voice call, and can more closely communicate with related persons such as family members and staff. In addition, regardless of the state of the target person, the related person can surely connect a voice call to the room of the target person, and it is easier and more reliable to communicate with the target person and grasp the state of the target person. It can be carried out.

Further, the telephone unit further has a storage unit for storing a callable telephone number in advance. When the telephone unit receives an incoming call, the telephone unit determines whether the incoming callable telephone number stored in the storage unit is used as a sender. If the caller determines a telephone number other than the callable telephone number, the caller does not respond to the call. As a result, it is possible not to respond to incoming calls from other than the preset callable telephone numbers. Therefore, even when the incoming call is automatically answered, the incoming caller does not have to answer the incoming call from the caller who does not want the incoming call, so that the incoming caller can feel secure in the incoming call.

Furthermore, when a telephone call is received, the telephone section automatically responds after a predetermined time set in advance, and makes a voice call possible state. This allows you to set the time from when you receive a call until the voice call starts, so that the target person can prepare to start the call or the staff can interrupt the work in progress. Then, the target person can prepare for the call. In particular, when a videophone call is performed in which images are transmitted and received together with voice, it is effective because the preparation time for the target person to be dressed can be secured.

Furthermore, the telephone unit responds to a voice call or a predetermined instruction by a gesture when a call is received, and makes a voice call ready by responding even if a predetermined time has not elapsed. As a result, when the target person wants to immediately answer the incoming call and start a voice call, the target person can be requested to perform a complicated operation such as picking up the handset or pressing a specific button. You can immediately start a voice call with simple and intuitive operation.

Furthermore, the telephone unit transmits the photographed image photographed by the photographing unit together with the voice data for making the voice call. As a result, the image of the living room of the target person including the target person can be transmitted in real time to the other party of the telephone, and the other party of the telephone can visually check the state of the target person in real time by checking the captured image received While doing so, it is possible to make a voice call with the target person. As a result, the related person and the target person can more easily and surely communicate with each other.

Further, the telephone unit further includes an output unit for outputting an image based on the image data, and the telephone unit receives the image data transmitted from the other party of the voice call together with the voice data for performing the voice call. Send to the output section. Thereby, for example, a captured image captured by a camera or the like provided in the terminal of the other party of the telephone can be received and the captured image can be output via the output unit provided in the detection unit. As a result, the target person can make a voice call while visually confirming the state of the other party of the call in real time. As a result, the related person and the target person can more easily and surely communicate with each other.

Further, the telephone unit makes a call to a predetermined telephone number registered in advance in association with the instruction, based on the instruction by the subject's voice or gesture. As a result, the target person can make a phone call to the desired party by a simple and intuitive operation without requiring the target person to perform a complicated operation such as picking up the handset or pressing a specific button. You can make a voice call.

Further, at least one of a first interface for wirelessly communicating with a predetermined terminal and a second interface for wirelessly communicating with a device that detects information from a target person is further included in the detection unit. Integrate as a component. As a result, the contact book data etc. input from the terminal installed in the subject's living room and the vital data measured by the vital data measuring device are acquired and used by the integrated single monitoring device. it can.

Furthermore, a predetermined event is detected by detecting the behavior of the target person based on the captured image. Thereby, the equipment for detecting the event can be suppressed.

Furthermore, a predetermined event is detected based on the body movement of the subject. Thereby, a plurality of events can be detected based on one piece of vital data.

Further, the integrated unit is provided with an installation unit for installation on the ceiling. As a result, it is possible to reduce obstacles to furniture, electrical appliances, etc. located between the watching device and the outside of the living room, so that when the watching device performs mobile telephone communication, wireless communication with the base station is required. It can be advantageously realized in a state where there are few obstacles. In addition, wireless communication with each device can be advantageously realized between the watching device and each part in the living room or in the facility where the living room is provided with few obstacles. Further, the photographing area of the photographed image can be expanded and the body movement of the subject can be detected more effectively.

The configuration of the watching system described above is the main configuration in describing the features of the above-described embodiment, and is not limited to the above-described configuration, and can be variously modified within the scope of the claims. Further, the configuration included in a general watching system is not excluded.

For example, the server 20, the administrator terminal 30, or the staff terminal 40 may have some of the functions of the detection unit 10.

Further, the detection unit 10, the server 20, the administrator terminal 30, and the staff terminal 40 may each be configured by a plurality of devices, and any of the plurality of devices may be configured as a single device.

Further, in the above-described flowchart, some steps may be omitted and other steps may be added. Further, some of the steps may be executed simultaneously, or one step may be divided into a plurality of steps and executed.

Further, the means and method for performing various processes in the watching system 1 according to the above-described embodiment can be realized by either a dedicated hardware circuit or a programmed computer. The program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versatile Disc)-ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred and stored in a storage unit such as a hard disk. Further, the above program may be provided as independent application software, or may be incorporated as one function into software of the device such as the detection unit.

1 Watching system,
10 Detector,
10a installation section,
11 control unit,
12 memory,
13 cameras,
14 body motion sensor,
15 Mike,
16 speakers,
17 routers,
18 Wi-Fi interface,
19 Bluetooth interface,
100 telephone departments,
110 output section,
20 servers,
30 administrator terminal,
40 staff terminals,
50 networks,
51 access points,
52 Internet,
53 Public telephone line.

Claims (18)

A shooting unit that shoots a predetermined shooting area,
While irradiating the predetermined irradiation region with microwaves, a body movement detection unit that detects the body movement of the subject within the irradiation region by detecting reflected waves,
The target based on at least one of a captured image captured by the capturing unit including the target person in the predetermined capturing region and a body motion of the target person detected by the body motion detection unit. A control unit that detects a predetermined event of the person,
A telephone unit that is integrated with the image capturing unit, the body movement detecting unit, and the control unit, and performs a voice call using a telephone number;
With a watch. The watching apparatus according to claim 1, wherein the telephone unit has a SIM slot, and performs a voice call by mobile telephone communication using a telephone number stored in a SIM card inserted in the SIM slot. The said telephone part has a connection part for connecting a modular cable, and performs a voice call by fixed telephone communication using the telephone number corresponding to the telephone line connected to the said modular cable. Monitoring device. The watching apparatus according to any one of claims 1 to 3, further comprising a sounding unit that outputs a sound based on sound data received by the telephone unit. The watching apparatus according to any one of claims 1 to 4, further comprising a sound collecting unit that collects sound for generating sound data transmitted by the telephone unit. 6. The telephone unit transmits/receives voice data to/from a child device, which is a telephone provided as a separate body, via wireless communication to perform a voice call via the child device. The monitoring device described in paragraph. 7. The watching apparatus according to claim 1, wherein the telephone unit automatically responds to a voice call without requesting an operation by a user when a call is received, and makes the voice call possible. It further has a storage unit that stores in advance a callable telephone number,
When a telephone call is received, the telephone unit determines whether or not the incoming call is the callable telephone number stored in the storage unit, and a telephone number other than the callable telephone number. The monitoring device according to any one of claims 1 to 7, which does not respond to the incoming call when the source is. 9. The telephone unit, when an incoming call is received, notifies the incoming call, and automatically responds after a predetermined time set in advance to enable a voice call state. The watching apparatus according to the item 1. The control unit recognizes a voice or gesture instruction,
The telephone section responds to a voice call even if the predetermined time has not elapsed when a predetermined instruction is recognized by the control section when an incoming call is received. The watching apparatus according to item 9. The watching apparatus according to any one of claims 1 to 10, wherein the telephone unit transmits the photographed image photographed by the photographing unit together with voice data for making a voice call. Further having an output unit for outputting an image based on the image data,
The telephone unit receives image data transmitted from the other party of the voice call together with voice data for making a voice call, and transmits the image data to the output unit. The described monitoring device. The control unit recognizes a voice or gesture instruction of the target person,
13. The telephone unit according to claim 1, wherein, based on an instruction recognized by the control unit, the telephone unit makes a call to a predetermined telephone number registered in advance in association with the instruction. The described monitoring device. At least one of a first interface for wirelessly communicating with a predetermined terminal and a second interface for wirelessly communicating with a device that detects information from the target person is further integrated. The watching apparatus according to any one of claims 1 to 13. The watching apparatus according to any one of claims 1 to 14, wherein the control unit detects the event by detecting an action of the target person based on the captured image. 16. The watching apparatus according to claim 1, wherein the control unit detects the event based on the detected body movement of the target person. The watching apparatus according to any one of claims 1 to 16, further comprising an installation section for installing the watching apparatus on a ceiling. A program executed in a watching device in which a photographing unit, a body movement detecting unit, a control unit, and a telephone unit are integrated,
A step (a) of acquiring a photographed image in which a predetermined photographing region is photographed by the photographing unit;
A step (b) of irradiating a predetermined irradiation region with microwaves by the body motion detection unit and acquiring a body motion of the target person in the irradiation region by detecting a reflected wave,
Based on at least one of the captured image including the target person in the predetermined shooting region acquired in the step (a) and the body motion of the target person detected in the step (b). A step (c) of detecting a predetermined event of the target person by the control unit,
A step (d) of making a voice call using the telephone number by the telephone section;
A program for a watching device for causing a computer to execute a process including the above.