JP7268387B2 - Monitoring device and program for monitoring device - Google Patents

Description

The present invention relates to a watching device and a watching device program.

In Japan, life expectancy has increased remarkably due to improvements in living standards, sanitary environments, and medical standards that have accompanied the post-war period of rapid economic growth. For this reason, combined with the declining birth rate, Japan has become an aging society with a high rate of aging. In such an aging society, it is expected that there will be an increase in the number of subjects who require care such as nursing care and support due to illness, injury, aging, and the like.

Subjects may fall or fall from their beds while walking at home or in facilities such as hospitals and welfare facilities for the elderly, and be injured. Therefore, in order to enable caregivers and nurses to rush to the subject immediately when the subject falls into such a state, the state of the subject is detected and the detection results are accessed by the relevant parties via the network. A system is under development to send to possible servers.

In relation to such a system, Patent Literature 1 below discloses the following technique. The motion sensor data detected by the motion sensor installed in the residence of the resident to be monitored and the accelerometer data detected by the accelerometer worn by the resident are sent to the residence via access points. Send to a server PC inside or outside the room. Then, the server PC determines an event such as a fall of the resident based on the location of the resident estimated from the motion sensor data and the behavior of the resident estimated from the acceleration sensor data, and determines the event of the resident. Save as information. As a result, it is possible for caregivers, etc., to view information on residents' events from a terminal that can be connected to a server PC via the Internet or the like.

JP 2014-89494 A

However, in the above prior art, in order to transmit various sensor data from each sensor to a server PC connected to the Internet, it is necessary to install equipment such as an access point as a communication path from each sensor to the server PC. There is a problem that there is

The present invention has been made to solve such problems. In other words, it is an object of the present invention to provide a monitoring device capable of reducing the equipment required to form communication paths from each sensor to a network.

The above problems of the present invention are solved by the following means.

(1) A photographing unit that photographs a predetermined photographing area, and a body motion detection unit that irradiates a predetermined irradiation area with microwaves and detects the body movement of the subject within the irradiation area by detecting reflected waves. and based on at least one of a photographed image including the subject within the predetermined photographing area photographed by the photographing unit and body movement of the subject detected by the body movement detecting unit, A control unit for detecting a predetermined event of the subject, the imaging unit, the body movement detection unit, and the control unit are integrated, and the captured image captured by the imaging unit and the body movement detection unit a router that transmits data of at least one of the detected body movement of the subject and the predetermined event detected by the control unit to a destination device via a network ; and a second interface for wirelessly receiving the vital data from a measuring instrument that detects the vital data of the subject are further integrated. A monitoring device.

( 2 ) The watching device according to (1) above, wherein the router is a wired router.

( 3 ) The watching device according to (1) or ( 2) above, wherein the control unit detects the event by detecting the behavior of the subject based on the captured image.

( 4 ) The watching device according to any one of (1) to ( 3 ) above, wherein the control unit detects the event based on the detected body movement of the subject.

( 5 ) The watching device according to any one of (1) to ( 4 ) above, further comprising an installation portion for installing the watching device on the ceiling.

( 6 ) The watching device according to any one of (1) to ( 5 ) above, wherein the network is the Internet.

( 7 ) A conversion unit that converts the data into a signal that can be transmitted over the network is further integrated with the router together with the imaging unit, the body movement detection unit, and the event detection unit, and the router converts the data into , the watching device according to the above ( 1 ), wherein the signal converted by the conversion unit is transmitted to the destination device via the network.

( 8 ) A first interface for wireless communication between an imaging unit, a body motion detection unit, a control unit, a router, and a predetermined terminal, and a measurement device that detects the subject's vital data a second interface for wirelessly receiving the vital data between the watching device and the monitoring device integrated with the monitoring device, wherein a photographed image obtained by photographing a predetermined photographing area by the photographing unit is obtained. Step (a), and step (b) of irradiating a predetermined irradiation area with microwaves by the body movement detection unit and detecting a reflected wave to acquire the body movement of the subject within the irradiation area; Based on at least one of the photographed image including the subject within the predetermined photographing area acquired in the procedure (a) and body movement of the subject detected in the procedure (b) , a procedure (c) of detecting a predetermined event of the subject by the control unit; a procedure (c1) of receiving the vital data from the measuring instrument through the second interface; the subject's body motion detected in the procedure (b) ; the predetermined event detected in the procedure (c); and the vital data received in the procedure (c1). a program for a watching device for causing a computer to execute a process having a procedure (d) of transmitting data to a destination device via a network by the router.

A predetermined event is detected based on at least one of an imaging unit, a body motion detection unit, a captured image including the subject captured by the imaging unit, and the subject's body motion detected by the body motion detection unit. and a router that transmits data of at least one of a photographed image, body movement, and a detected predetermined event to a destination device via a network. This reduces the equipment required to form communication paths from each sensor to the network.

It is a figure showing the whole watching system composition. FIG. 4 is a diagram showing an example of detection units installed around a bed in a room of a subject; It is a block diagram which shows the hardware constitutions of a detection part. It is a figure which shows the installation part for installing a detection part in the ceiling etc. of a living room. It is a figure which shows the screen of the contact book displayed on the tablet terminal. It is a figure which shows the screen of the message board displayed on the staff terminal. It is a block diagram which shows the hardware constitutions of a server. FIG. 10 is a diagram showing an example of a screen on which vital data stored in a server is displayed on a staff terminal; FIG. 10 is a diagram showing another example of a screen on which vital data stored in the server is displayed on the staff terminal. FIG. 10 is a diagram showing still another example of a screen on which the vital data stored in the server is displayed on the staff terminal. 3 is a block diagram showing the hardware configuration of an administrator terminal; FIG. 4 is a block diagram showing the hardware configuration of a staff terminal; FIG. It is explanatory drawing which shows the network configuration of a watching system, and the data transmitted/received through a network. 4 is a flow chart showing the operation of a detection unit;

Hereinafter, embodiments of the present invention will be described with reference to the attached drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted. Also, the dimensional ratios in the drawings are exaggerated for convenience of explanation, and may differ from the actual ratios.

(overall structure)
FIG. 1 is a diagram showing the overall configuration of the watching system 1, and FIG. 2 is a diagram showing an example of the detector 10 installed around the bed 60 in the room of the subject 70. As shown in FIG.

As shown in FIG. 1 , the monitoring system 1 includes multiple detectors 10 , a server 20 , an administrator terminal 30 , one or more staff terminals 40 , and one or more tablet terminals 100 . The detection unit 10 constitutes a watching device. The detection unit 10, the server 20, the administrator terminal 30, and the staff terminal 40 are connected to communicate with each other via the network 50 by wire or wirelessly. Network 50 may include repeaters, such as repeaters, bridges, routers, or cross-connects that relay communication signals. In the example shown in FIG. 1, the staff terminal 40 uses the detection unit 10, the server 20, the administrator terminal 30, and the network 50 including the wireless LAN (for example, the LAN according to the IEEE802.11 standard) including the access point 51, They are connected so that they can communicate with each other. As will be described later, the tablet terminal 100 wirelessly communicates with the detection unit 10 by, for example, Wi-Fi (registered trademark).

The target person 70 (person to be watched over) is, for example, a patient who needs nursing care due to illness or injury, a cared person who needs nursing care due to a decline in physical ability due to old age, a solitary person living alone, or a hospital facility. Patients who are hospitalized, etc. In particular, from the viewpoint of enabling early detection and early countermeasures, the subject 70 may be a person who needs to be found when a predetermined inconvenient event, such as an abnormal condition, occurs to him/her.

The detection unit 10 can be placed in each living room of the home, which is the observation area of the subject 70 . In the example shown in FIG. 1, four detection units 10 are arranged in the living rooms of the target persons 70, Mr. A, Mr. B, Mr. C, and Mr. D, respectively. The observation area of the detector 10 includes the bed 60 . A staff member 80 who provides nursing or nursing care (for example, care) for the target person 70 carries a staff terminal 40, which is a portable terminal, with them.

The manager terminal 30 is a terminal for the manager 90 . The manager 90 is, for example, a manager who supervises a plurality of staff members 80 .

The position, number, and the like of each component included in the watching system 1 are not limited to the example shown in FIG. 1 .

(Detector 10)
FIG. 3 is a block diagram showing the hardware configuration of the detection unit 10. As shown in FIG. FIG. 4 is a diagram showing an installation section 10a for installing the detection section 10 on the ceiling of a living room or the like. As shown in FIG. 3, the detection unit 10 includes a control unit 11, a storage unit 12, a camera 13, a body motion sensor 14, a microphone 15, a speaker 16, a router 17, a Wi-Fi (registered trademark) interface 18, and a Bluetooth ( A Bluetooth (registered trademark)) interface 19 is provided, and these are interconnected by a bus. The camera 13 constitutes an imaging unit. The body motion sensor 14 constitutes a body motion detector. The Wi-Fi (registered trademark) interface 18 constitutes a first interface. A Bluetooth interface 19 constitutes the second interface. As shown in FIG. 4, the detection unit 10 has an installation unit 10a that is at least partially flat, and can be fixedly arranged so that the flat surface is in contact with the ceiling of the living room. The installation part 10a may be configured by fixing a stop plate provided with a hole through which a bolt for fixing the detection part 10 to the ceiling of the room is fixed to a part of the side surface of the detection part 10 or the like.

Note that the detection unit 10 may include components other than the components described above, or may not include some of the components described above. For example, the detection unit 10 may further include a temperature sensor.

Each component of the detection unit 10 is physically integrated. Integration includes arranging a plurality of components in a single housing, mounting a plurality of components on a single substrate, and disposing the positions of a plurality of components at relatively constant distances ( (including the case where the distance is 0) is widely included. For example, integration of components includes having a common power source that powers each component. In this case, power is supplied through one path to the housing in which all the components are accommodated, and the power is distributed to each of the components by branching the path within the housing. Integration of components includes wiring between components within the same housing. In addition, integration of components includes local exchange of signals between components. Here, the term "local" refers to a range that is not connected to a communication line that can be connected by an unspecified number of people, such as the Internet or a public line.

The control unit 11 is configured by a CPU (Central Processing Unit), and controls each unit of the detection unit 10 and performs arithmetic processing according to a program. A specific action of the control unit 11 will be described later.

The storage unit 12 includes RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), etc., and stores various programs and various data.

The camera 13 is arranged at a position where the area including the bed 60 of the subject 70 can be overlooked by fixedly arranging the detection unit 10 on the ceiling of the living room, the upper part of a fixed stand, the upper part of the wall, or the like. Thereby, the camera 13 photographs an area including the bed 60 of the subject 70 as a predetermined photographing area (observation area), and outputs a photographed image (image data). Hereinafter, an image captured by the camera 13 is also simply referred to as a "captured image". The captured image includes an image including the target person 70 . The captured images include still images and moving images (video). Although the camera 13 is a near-infrared camera, a visible light camera may be used in place of this, or these may be used in combination.

The body motion sensor 14 transmits microwaves to a predetermined irradiation area and receives reflected waves, thereby detecting a Doppler shift of microwaves caused by body motion (for example, respiratory motion) of the subject 70 as body motion. . The predetermined irradiation area is an area in which the subject 70 can be irradiated with microwaves, and can be an area including part or all of the bed 60, for example. The body motion sensor 14 detects the body motion of the chest (up and down motion of the chest) associated with the breathing motion of the subject 70, and detects the disturbance of the cycle of the body motion of the chest and the body motion of the chest which is less than a preset threshold. By detecting the amplitude at , micromotion anomalies are detected.

The microphone 15 converts voice into an electrical signal and outputs the electrical signal.

The speaker 16 converts the electric signal into sound (sound wave) and outputs it.

The router 17 adds an address (for example, A global IP address) and an address (for example, a global IP address) for specifying the destination server 20 are added, and transmitted to the server 20 via the network 50 .

From the camera 13, an address (local IP address) for specifying the camera 13 may be added to the captured image (image data) and output. Further, the body motion sensor 14 may output the body motion (microwave data) with an address (local IP address) for specifying the body motion sensor 14 added thereto. In these cases, the router 17 uniformly converts the local IP address of the camera 13 and the local IP address of the motion sensor 14 to the global IP address of the router 17 (deletes the local IP address and adds the global IP address, etc.). ) to transmit the detection data to the server 20 .

Detection data output from the camera 13 and the body motion sensor 14 may not have addresses for specifying the camera 13 and the body motion sensor 14 added thereto. In this case, the router 17 simply adds a global IP address or the like to the detected data and transmits the data to the server 20 .

The router 17 includes a wireless router that exchanges data wirelessly using a wireless antenna, a SIM card, and the like, and a wired router that has an outlet for a cable and exchanges data by wire.

If the router 17 is a wireless router, the router 17 sends the SIM card's identification number stored in the SIM card to the base station to obtain a global IP address dynamically assigned to the SIM card from the base station. can be obtained and used as an address to identify the router 17 . The global IP address of the router 17 may be set in advance as a dedicated global IP address.

When the router 17 is a wireless router, the router 17 receives the voice signal of the telephone whose destination is the telephone number associated with the identification number of the SIM card stored in the SIM card, and transmits the voice signal to the speaker 16. output as audio. The router 17 converts the voice uttered by the target person 70 or the like as a response to an incoming call by the microphone 15 into an electric signal as voice data, and transmits the voice data to the network 50 (specifically, the public telephone line 53 (see FIG. 13)). to the terminal that originated the incoming call (for example, the family terminal 92 (see FIG. 13)). Note that the router 17 is set in advance with telephone numbers of terminals that can receive calls, so that the router 17 can reject incoming calls originating from terminals other than the set telephone numbers.

If the router 17 is a wired router, the router 17 transmits detection data and the like via a cable or the like inserted into the receptacle. In this case, an address (for example, a global IP address) for specifying the router 17 can be set in the router 17 in advance. In addition, when the router 17 is a wired router, the router 17 is integrated with a conversion unit that performs at least one of mutual conversion between an optical signal and an electric signal and mutual conversion between a digital signal and an analog signal. It can be further included by being converted.

When the router 17 is a wired router, a telephone number is set in advance in the router 17, and an audio signal of a call whose destination is the telephone number is received and transmitted to the speaker 16 to be output as audio. The router 17 converts the voice uttered by the subject 70 or the like as a response to the incoming call into an electric signal converted by the microphone 15 as voice data from the cable through the network 50 (specifically, the public telephone line 53), It is transmitted to the terminal that originated the incoming call (for example, the family's terminal 92). Note that the router 17 may have an outlet for a 4-core or 2-core modular cable used for fixed telephones. In this case, a telephone exchange or the like, which is a facility of a telecommunications carrier, is used to connect the calling terminal of the call to the home telephone number of the target person 70 where the detection unit 10 is installed to the modular cable. is connected to the telephone line to be connected. As a result, the router 17 and the terminal of the caller are connected to enable communication.

The Wi-Fi interface 18 includes a Wi-Fi module (semiconductor chip), and connects the tablet terminal 100, the staff terminal 40, a PC, etc. and the detection unit 10 so as to be able to communicate wirelessly with each other by Wi-Fi (registered trademark). do.

The Bluetooth interface 19 includes an SoC (System-on-a-Chip) for Bluetooth, and can wirelessly communicate with a measuring device (not shown) that acquires the vital data of the subject 70 via Bluetooth (registered trademark). connect to.

The action of the control unit 11 will be described.

The control unit 11 recognizes the behavior of the subject 70 from the captured image captured by the camera 13 . Actions to be recognized include "getting up" from the bed 60, "getting out of bed" from the bed 60, "falling" from the bed 60, and "falling" to the floor or the like.

The control unit 11 detects image silhouettes (hereinafter referred to as “person silhouettes”) from a plurality of captured images (moving images). A human silhouette can be detected, for example, by extracting a range of pixels with relatively large differences by a time difference method of extracting differences between images captured at different times. A person silhouette may be detected by a background subtraction method that extracts a difference between a captured image and a background image. Getting up, leaving the bed, falling, and falling are detected from the posture of the subject 70 (for example, standing, sitting, lying down, etc.) from the detected human silhouette, and from the position relative to the bed 60 or other installations in the living room. These detections may be performed by a program processed by the CPU of the control unit 11, or may be performed by a built-in processing circuit. Alternatively, all or most of these recognition processes may be performed on the server 20 side, and the controller 11 may only transmit the captured image to the server 20 . When any action is recognized, the control unit 11 transmits a notification that the action has occurred to the server 20 or the like as an event notification (alert) notifying that a predetermined event has been detected. The event notification includes the name of the target person 70, the room number, and the contents of the event. Predetermined events notified by the event notification include falling asleep, abnormal body movement, and the like detected based on body movement detected by the body movement sensor 14 . Based on a nurse call signal output from a nurse call unit (not shown) that is output when a button of the nurse call unit (not shown) is pressed, or an audio signal converted into an electrical signal by a microphone 15, the control unit 11 A nurse call can be detected. A nurse call detected in this way may also be included in the predetermined event.

The control unit 11 uses the router 17 to add an address for identifying itself as a transmission source and an address for identifying the server 20 as a transmission destination to the detection data etc., and transmit the data via the network 50. , and transmits detection data and the like to the server 20 .

The control unit 11 causes a part of the storage unit 12 to function as a ring buffer by causing the storage unit 12 to continuously store the latest captured images for a predetermined period of time. The predetermined time can be, for example, 5 minutes. When an event is detected based on a captured image, the control unit 11 notifies the event of the captured image, for example, one minute before and after the time when the event is detected, among the captured images stored in the ring buffer for a predetermined period of time. It can be sent to the server 20 by being included in the event notification to be performed.

The control unit 11 receives contact book data from the tablet terminal 100 provided for each living room of the subject 70 via the Wi-Fi interface 18 . The control unit 11 transmits the received contact book data to the server 20 via the router 17 . Note that the tablet terminal 100 may be replaced by a PC (personal computer) or the like.

FIG. 5 is a diagram showing a contact book screen displayed on the tablet terminal 100. As shown in FIG. A of FIG. 5 is a contact book screen displayed when the tablet terminal 100 is activated. FIG. 5B is a diagram showing an entry example by the staff member 80 on the screen of the contact book on the tablet terminal 100. As shown in FIG.

As shown in A of FIG. 5, when the tablet terminal 100 is activated, a contact book screen in which only the date and time are entered is displayed as an initial screen.

As shown in FIG. 5B, the staff member 80 selects his/her name (name, surname, etc.) from the pull-down menu in the "recorder" column of the contact book screen, and the record person ( Enter your name as the author). The staff member 80 enters the measured vital data in the "body temperature", "blood pressure", and "SPO2" columns on the contact book screen. The staff member 80 selects the "activate camera" button to activate a camera (not shown) included in the tablet terminal 100, and captures the image of the target person 70 with the camera, thereby inputting the image of the target person 70 into the contact book. can. The staff member 80 freely writes the message in the "free description" column. In the example of B in FIG. 5, it is described as "He seems to be in good physical condition and has talked a lot about his son. Staff A". Writing in the contact book can be done by handwriting input using a touch pen. Entries in the contact book may be entered with a touch pen on the keyboard screen displayed by selecting the "keyboard input" button. The contents of the contact book are scrolled and displayed by selecting the white leftward or rightward arrow. By selecting another person's name or one's own name from the pull-down menu of the column of "entered by", the contents of the entry in the contact book by the staff member 80 with the selected name are displayed on the screen.

The control unit 11 receives the vital data from the measuring equipment that acquires the vital data of the subject 70 via the Bluetooth interface 19 . The control unit 11 transmits the received vital data to the server 20 as detection data or the like.

The control unit 11 sends a message addressed to the target person 70 to the message board related to the detection unit 10 including the control unit 11 among the message boards for each detection unit 10 that can be viewed and posted by members registered in advance by accessing the server 20. When a post is made, the content of the post is received from the server 20 via the network 50 by the router 17 . The control unit 11 projects the content of the received post on a screen or the like provided on the wall of the living room so that the subject 70 can see the content of the post, for example, using a projector (not shown) included in the detection unit 10 .

FIG. 6 is a diagram showing a message board screen displayed on the staff terminal 40. As shown in FIG. A message board screen can be displayed on the staff terminal 40 by accessing the server 20 from the staff terminal 40 of the staff member 80 registered in advance as a member.

FIG. 6A shows a message board screen on which an event is displayed when the server 20 receives an event notification from the detection unit 10 . In the example of FIG. 6, when the server 20 receives the event notification of Mr. A's "wake-up" event, the "wake-up" event is displayed in the thread of the message board for Mr. A. In FIG. The message entry field displays a check box for selecting a destination to which the message posted in the message entry field is to be notified. Any category or group such as the target person 70, medical staff, care staff, or family members can be set in advance as destination candidates. In FIG. 6, one message board thread is created in association with the detection unit 10 corresponding to Mr. A. However, a message board thread is created in association with each event and each post related to Mr. A. You may do so.

FIG. 6B shows the screen of the message board when staff B and staff C post from the staff terminal 40 in response to the "wake up" event in Mr. A's message board thread. Of the check boxes displayed in the message entry field posted by staff member B, check boxes for selection are entered in the check boxes for target person 70, care staff, and family members. Therefore, as described above, the content of the message posted in the message input field is transmitted from the server 20 to the router 17 of the detection unit 10, and is displayed on the screen or the like provided on the wall of the living room by the projector provided in the detection unit 10. projected onto. For example, an e-mail or the like is transmitted to the terminals of the care staff and family members, and the URL for accessing the message board is described in the e-mail, thereby inducing access to the message board.

The control unit 11 transmits the telephone voice signal received by the router 17 to the speaker 16 to output it as voice. The control unit 11 converts the voice uttered by the target person 70 or the like as a response to the telephone call received by the router 17 into an electric signal converted by the microphone 15 as voice data via the network 50 by the router 17. Send to the original terminal.

The control unit 11 adjusts the brightness of the captured image based on the output of the image sensor forming the camera 13 . The control unit 11 measures the brightness around the camera 13 based on the adjustment amount of the brightness of the captured image, thereby detecting whether or not the light has been left off during bedtime. When the controller 11 detects that the lights have been forgotten to be turned off, the controller 11 can transmit a notification that the lights have been forgotten to the staff terminal 40 or the like via the network 50 .

The control unit 11 measures the temperature in the living room of the subject 70 with a temperature sensor (not shown) included in the detection unit 10, and when the measured temperature exceeds a predetermined value, the router 17 detects the temperature of the subject 70. A notification suggesting the possibility of heat stroke can be sent to the staff terminal 40 or the like via the network 50 .

The control unit 11 receives an image of the garden taken by a camera (not shown) whose shooting range is the garden of the subject 70's house via the Wi-Fi interface 18 from the camera, and the detection unit 10 A provided projector (not shown) projects the image on a screen or the like provided on the wall of the living room so that the target person 70 can see the image.

The work performed by the staff 80 may include medical work and nursing care work. Here, when the work of the staff 80 is nursing work for the target person 70, the contents of the correspondence regarding each event will be described. "Wake-up" is determined as an event, and if the determination is within a predetermined time (wake-up time set in the facility (for example, 7:00 to 8:00 am)), morning care is performed. This morning care includes face washing, tooth brushing assistance, denture wearing, dressing assistance, and the like. In addition, if it is an event of "getting out of bed", wheelchair transfer and walking assistance may be required. Regular (regular) events other than the events determined by the detection unit 10 include beverages, meal assistance, excretion assistance, wheelchair transfer, walking assistance, and position change (bedsore prevention). For these regular events, the nurse call section or the like may generate an alert at the scheduled time. In addition, the amount of water intake, the amount of urination, the amount of excretion, and the like of the subject 70 can be grasped by the staff 80 and recorded in the correspondence record and stored in the server 20 in the assistance with drinking, meal, and excretion. The correspondence record is entered at the staff terminal 40 and transmitted from the staff terminal 40 to the server 20 .

(Server 20)
FIG. 7 is a block diagram showing the hardware configuration of the server 20. As shown in FIG.

The server 20 includes a control section 21 , a communication section 22 and a storage section 23 . The server 20 may be a cloud server virtually constructed by a plurality of servers arranged on a network 50 such as the Internet. Server 20 may be a single dedicated server remotely located and connectable via network 50 . Each component is communicatively connected to each other by a bus. Components of the server 20 that correspond to the components of the detection unit 10 have the same basic configuration as the components of the detection unit 10, and redundant description will be omitted.

The communication unit 22 is a network interface for wired communication based on standards such as Ethernet (registered trademark), an interface for wireless communication based on standards such as IEEE 802.11, etc., and communicates with each terminal connected to the network 50 . The storage unit 23 stores various programs and various data. The above components of the server 20 are controlled by the control unit 21 according to the program. The storage unit 23 stores information about the subject 70 and data such as a message board. The information about the subject 70 includes photographed images, vital data, events, room temperature, contact book information, and the like.

When the server 20 receives an event notification from the detection unit 10, the server 20 notifies the staff 80 of the occurrence of the event by transferring the event notification to each staff terminal 40, and instructs the staff 80 to respond to the event.

The server 20 transmits the data stored in the storage unit 23 to the staff terminal 40 or the like and displays it on the screen in response to a request from a user such as the staff member 80 registered in advance. The data includes message boards.

FIG. 8 is a diagram showing an example of a screen on which the vital data stored in the server 20 is displayed on the staff terminal 40. As shown in FIG.

As shown in FIG. 8, the staff terminal 40 displays details of vital signs (measured values) and the date and time of last update for each vital sign. It should be noted that an image taken by the camera 13 is displayed on the screen by selecting the "state of the room" icon. By selecting the "user list" icon, a list of subjects 70 whose vitals are to be measured is displayed in a selectable manner from a pull-down menu or the like, and the vitals of the subject 70 selected from the pull-down menu or the like are displayed. details and the date and time of the last update for each vital is displayed.

FIG. 9 is a diagram showing another example of a screen on which the vital data stored in the server 20 is displayed on the staff terminal 40. As shown in FIG.

As shown in FIG. 9, on the staff terminal 40, any one of sleep, wakefulness, and absence (absence in the living room) time period is visually displayed as a graph. The displayed period is selectable, and can be any one week, for example. As in the example of FIG. 8, a "room state" icon and a "user list" icon are displayed.

FIG. 10 is a diagram showing still another example of a screen on which the vital data stored in the server 20 is displayed on the staff terminal 40. As shown in FIG.

As shown in FIG. 10, the staff terminal 40 visually displays changes in the respiration rate as a graph. The displayed period is selectable, and can be any one week, for example. As in the example of FIG. 8, a "room state" icon and a "user list" icon are displayed.

(Administrator terminal 30)
FIG. 11 is a block diagram showing the hardware configuration of the administrator terminal 30. As shown in FIG. The administrator terminal 30 is a so-called PC (Personal Computer) and includes a control section 31, a communication section 32, a storage section 33, a display section 34, and an input section 35, which are interconnected by a bus. Of the constituent elements of the administrator terminal 30, those corresponding to those of the server 20 have the same basic configuration as those of the server 20, so redundant description will be omitted.

The display unit 34 is, for example, a liquid crystal display, and displays various information.

The input unit 35 includes a keyboard, numeric keypad, mouse, etc., and inputs various information.

The administrator terminal 30 transmits images and the like stored in the storage unit 33 to the detection unit 10 in accordance with instructions input to the input unit 35 by the administrator 90 . The images include a video for explaining how to take medicine and a video for explaining rehabilitation.

The administrator terminal 30 can transmit the voice of the administrator 90 acquired by a microphone (not shown) to the detector 10 via the network 50 . As a result, for example, by transmitting the voice of the administrator 90 to the detection unit 10 together with the video for explaining how to take medicine, a projector (not shown) provided in the detection unit 10 projects the video while the voice is transmitted. Therefore, taking medicine can be explained to the subject 70 in the living room. Note that the above-described image is transmitted from the administrator terminal 30 to the detection unit 10 in advance and stored in advance in the storage unit 12 of the detection unit 10, and a control signal for reproducing the image is sent from the administrator terminal 30. By transmitting the image to the detection unit 10 , the image may be projected by a projector (not shown) included in the detection unit 10 .

(Staff terminal 40)
FIG. 12 is a block diagram showing the hardware configuration of the staff terminal 40. As shown in FIG. The staff terminal 40 includes a control section 41, a wireless communication section 42, a storage section 43, a display section 44, an input section 45, and an audio input/output section 46, which are interconnected by a bus. The components of the staff terminal 40 that correspond to the components of the server 20 have the same basic configuration as the components of the server 20, so redundant description will be omitted.

The wireless communication unit 42 enables wireless communication using standards such as 4G, Wi-Fi, Bluetooth (registered trademark), etc., and wirelessly communicates with each device via the access point 51 or directly. The display unit 44 and the input unit 45 are touch panels, and a touch sensor as the input unit 45 is superimposed on the display surface of the display unit 44 made of liquid crystal or the like. Various instructions are displayed to the staff 80 by the display unit 44 and the input unit 45 . Further, the display unit 44 and the input unit 45 display an operation screen displaying an event notification, and accept various operations such as input of intention to respond to the event and input of care records through the operation screen. In addition, the display unit 44 displays captured images (including live images) received from the server 20 by making a request to the server 20 . The voice input/output unit 46 is, for example, a speaker and a microphone, and enables voice communication with other staff terminals 40 and the detection unit 10 via the wireless communication unit 42 . The staff terminal 40 can be configured by a portable communication terminal device such as a tablet computer, smart phone, or mobile phone, for example.

The server 20, administrator terminal 30, and staff terminal 40 may include components other than the components described above, or may not include some of the components described above.

FIG. 13 is an explanatory diagram showing the network configuration of the watching system 1 and the data transmitted and received through the network 50. As shown in FIG. As shown in FIG. 13, network 50 includes Internet 52 and public telephone line 53 .

Data such as captured images, vital data, and event notifications (alerts) are transmitted from each detector 10 to the server 20 via the Internet 52 . In addition, these data are sent to these terminals via the Internet 52 in response to requests from the staff terminal 40, the administrator terminal 30, the doctor's terminal 91, and the subject's family terminal 92, which are registered in advance. sent. Message board data is transmitted and received between the server 20 and the staff terminal 40 , the administrator terminal 30 , the doctor's terminal 91 and the family's terminal 92 via the Internet 52 . Of the messages posted on the message board, messages addressed to the target person 70 are sent from the server 20 to the detection unit 10 arranged in the room of the target person 70 via the Internet 52 .

Voice signals are transmitted and received between the detector 10 , the staff terminal 40 and the administrator terminal 30 via the public telephone line 53 . Note that when a call is made between the detection unit 10 and the staff terminal 40 or the like by IP phone, voice signals are transmitted and received between the detection unit 10 and the staff terminal 40 via the Internet 50 .

The operation of the detection unit 10 in the watching system will be described.

FIG. 14 is a flow chart showing the operation of the detection unit 10. As shown in FIG. This flowchart can be executed by the control unit 11 according to a program stored in the storage unit 12 of the detection unit 10 .

The control unit 11 acquires a captured image from the camera 13 (S101).

The control unit 11 acquires body motion from the body motion sensor 14 (S102).

The control unit 11 detects a predetermined event of the subject 70 based on at least one of the captured image and body movement (103).

The control unit 11 adds an address for specifying the router 17 to data of at least one of the photographed image, the body movement, and the predetermined event using the router 17, and transmits the data to the server 20 via the Internet 52. (S104).

This embodiment has the following effects.

A predetermined event is detected based on at least one of an imaging unit, a body motion detection unit, a captured image including the subject captured by the imaging unit, and the subject's body motion detected by the body motion detection unit. and a router that transmits data of at least one of a photographed image, body movement, and a detected predetermined event to a destination device via a network. This reduces the equipment required to form communication paths from each sensor to the network. Further, by arranging the integrated device on the ceiling or the like, it is possible to expand the photographing range of the photographing section and the detection range of the body movement detecting section.

Furthermore, at least one of a first interface for wirelessly communicating with a predetermined terminal and a second interface for wirelessly communicating with a device that detects information from the subject is further provided in the detection unit. Integrate as a component. As a result, the contact book data entered from the terminal installed in the subject's living room and the vital data measured by the vital data measuring device are acquired and used by a single integrated monitoring device. can. Further, by arranging the integrated device on the ceiling or the like, wireless communication can be advantageously realized with few obstacles between the first interface and the predetermined terminal. Further, the router is a wired router. As a result, by inserting a cable or the like connected to the Internet or the like into the integrated single watching device, data such as captured images can be used via the Internet or the like.

Furthermore, a predetermined event is detected by detecting the subject's behavior based on the captured image. As a result, equipment for detecting events can be suppressed.

Furthermore, a predetermined event is detected based on the subject's body movement. Thereby, a plurality of events can be detected based on one vital data.

Furthermore, the integrated single device is provided with an installation portion for installation on the ceiling. As a result, the photographing area of the photographed image can be expanded, and the body movement of the subject can be detected more effectively.

Furthermore, let the network be the Internet. This makes it possible to expand the range of users who use data such as captured images.

Furthermore, a conversion unit that converts data into a signal that can be transmitted over a network is further integrated into the router together with the imaging unit, the body movement detection unit, and the event detection unit, and the router converts the data into a signal converted by the conversion unit, Send to the destination device via the network. As a result, even if signal conversion is necessary to transmit data over a network, it is possible to eliminate the need to install equipment for that purpose and to suppress an increase in the length of the communication path.

The configuration of the monitoring system described above is the main configuration for explaining the features of the above-described embodiment, and is not limited to the above-described configuration, and can be variously modified within the scope of the claims. Moreover, the structure with which a general watching system is equipped is not excluded.

For example, the server 20, the administrator terminal 30, or the staff terminal 40 may have some of the functions that the detection unit 10 has.

Moreover, the detection unit 10, the server 20, the administrator terminal 30, and the staff terminal 40 may each be composed of a plurality of devices, and any of the plurality of devices may be configured as a single device.

In addition, some steps may be omitted from the flowchart described above, and other steps may be added. Also, part of each step may be executed simultaneously, or one step may be divided into a plurality of steps and executed.

Moreover, means and methods for performing various processes in the watching system 1 according to the above-described embodiment can be realized by either a dedicated hardware circuit or a programmed computer. The program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versatile Disc)-ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. Further, the above program may be provided as independent application software, or may be incorporated as one function into the software of the device such as the detection unit.

1 monitoring system,
10 detection unit,
10a installation part,
11 control unit,
12 storage unit,
13 camera,
14 motion sensor,
15 Mike,
16 speakers,
17 routers,
18 Wi-Fi interfaces,
19 bluetooth interface,
20 servers,
30 administrator terminal,
40 staff terminals,
50 network,
51 Internet,
52 public telephone lines.

Claims (8)

a photographing unit for photographing a predetermined photographing area;
a body motion detection unit that irradiates a predetermined irradiation area with microwaves and detects a body movement of a subject in the irradiation area by detecting reflected waves;
Based on at least one of a photographed image including the subject within the predetermined photographing area photographed by the photographing unit and body movement of the subject detected by the body movement detecting unit, the subject a control unit that detects a predetermined event of a person;
integrated with the photographing unit, the body movement detection unit, and the control unit, the photographed image photographed by the photographing unit, the subject's body movement detected by the body movement detection unit, and the control a router that transmits data of at least one of the predetermined events detected by the unit to a destination device via a network ;
A first interface for wirelessly communicating with a predetermined terminal and a second interface for wirelessly receiving the vital data from a measuring device that detects the vital data of the subject are further integrated. A monitoring device. The watching device according to claim 1, wherein said router is a wired router. The watching device according to claim 1 or 2 , wherein the control unit detects the event by detecting the subject's behavior based on the captured image. The watching device according to any one of claims 1 to 3 , wherein the control unit detects the event based on the detected body movement of the subject. The watching device according to any one of claims 1 to 4 , further comprising an installation portion for installing the watching device on a ceiling. The watching device according to any one of claims 1 to 5 , wherein the network is the Internet. A conversion unit that converts the data into a signal that can be transmitted over the network is further integrated into the router together with the photographing unit, the body movement detection unit, and the control unit, and the router converts the data into the conversion unit. 2. The watching device according to claim 1 , wherein the converted signal is transmitted to the destination device via the network. Radio communication between the imaging unit, the body motion detection unit, the control unit, the router, the first interface for wirelessly communicating with a predetermined terminal, and the measurement equipment that detects the vital data of the subject A program executed in a monitoring device integrated with a second interface for receiving the vital data by
a step (a) of obtaining a captured image in which a predetermined capturing area is captured by the capturing unit;
A step (b) of irradiating a predetermined irradiation area with microwaves by the body movement detection unit and detecting a reflected wave to acquire the body movement of the subject within the irradiation area;
Based on at least one of the photographed image including the subject within the predetermined photographing area acquired in the procedure (a) and body movement of the subject detected in the procedure (b) , a step (c) of detecting a predetermined event of the subject by the control unit;
a step (c1) of receiving the vital data from the measuring instrument through the second interface;
the captured image captured in the procedure (a), the body movement of the subject detected in the procedure (b) , the predetermined event detected in the procedure (c), and the procedure (c1) a step (d) of transmitting at least one of the received vital data to a destination device via a network by the router;
A watching device program for causing a computer to execute a process having

Images