US20200103286A1 - Notification control device, notification control system, and notification control method - Google Patents
Notification control device, notification control system, and notification control method Download PDFInfo
- Publication number
- US20200103286A1 US20200103286A1 US16/582,366 US201916582366A US2020103286A1 US 20200103286 A1 US20200103286 A1 US 20200103286A1 US 201916582366 A US201916582366 A US 201916582366A US 2020103286 A1 US2020103286 A1 US 2020103286A1
- Authority
- US
- United States
- Prior art keywords
- information
- bed
- notification control
- notification
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 230000008569 process Effects 0.000 claims abstract description 62
- 238000001514 detection method Methods 0.000 claims description 126
- 230000004044 response Effects 0.000 claims description 33
- 230000008859 change Effects 0.000 claims description 29
- 238000012937 correction Methods 0.000 description 44
- 238000010586 diagram Methods 0.000 description 23
- 230000004397 blinking Effects 0.000 description 17
- 238000004891 communication Methods 0.000 description 16
- 238000012545 processing Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 5
- 230000010365 information processing Effects 0.000 description 4
- 230000000474 nursing effect Effects 0.000 description 4
- 230000005855 radiation Effects 0.000 description 4
- 206010041235 Snoring Diseases 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 235000012054 meals Nutrition 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000001931 thermography Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/002—Monitoring the patient using a local or closed circuit, e.g. in a room or building
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
- A61B5/1115—Monitoring leaving of a patient support, e.g. a bed or a wheelchair
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1116—Determining posture transitions
- A61B5/1117—Fall detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
- G01V9/00—Prospecting or detecting by methods not provided for in groups G01V1/00 - G01V8/00
- G01V9/005—Prospecting or detecting by methods not provided for in groups G01V1/00 - G01V8/00 by thermal methods, e.g. after generation of heat by chemical reactions
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/22—Status alarms responsive to presence or absence of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/001—Alarm cancelling procedures or alarm forwarding decisions, e.g. based on absence of alarm confirmation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2576/00—Medical imaging apparatus involving image processing or analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0004—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
- A61B5/0008—Temperature signals
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
-
- G01J2005/0085—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/48—Thermography; Techniques using wholly visual means
- G01J5/485—Temperature profile
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
- G08B21/043—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
- G08B21/0476—Cameras to detect unsafe condition, e.g. video cameras
Definitions
- the present invention is related to a notification control device, a notification control system, and a notification control method.
- a nursing call system is known for a medical practitioner to be called in response to a calling operation of patients, or the like.
- a nurse call system is known to detect whether a bed is empty or not, and to notify an end of a bed making according to a calling operation when the bed is empty and notify the nurse call according to the calling operation when the bed is not empty (see, for example, Patent Document 1).
- Patent Document 1 Japanese Laid-Open Patent Application No. 2013-211607
- FIG. 1 is a diagram illustrating an example of a system configuration of a notification control system according to an embodiment
- FIG. 2A and FIG. 2B are diagrams illustrating an arrangement example of beds and cameras according to the present embodiment
- FIG. 3A and FIG. 3B are diagrams for explaining the sensing region according to the present embodiment.
- FIG. 4A through FIG. 4D are diagrams illustrating examples of detection patterns according to the present embodiment.
- FIG. 5 is a diagram illustrating an example of a hardware configuration of a notification control device according to the present embodiment
- FIG. 6A and FIG. 6B are diagrams illustrating examples of a hardware configuration of an information collection device according to the present embodiment
- FIG. 7 is a diagram illustrating an example of a functional configuration of a notification control system according to the present embodiment.
- FIG. 8A and FIG. 8B are diagrams illustrating examples of information managed by the notification control device according to the present embodiment.
- FIG. 9 is a flowchart illustrating an example of a notification control process according to a first embodiment
- FIG. 10 is a sequence diagram illustrating an example of a display control process according to the first embodiment
- FIG. 11 is a flowchart illustrating an example of a process for providing a response information according to the first embodiment
- FIG. 12 is a flowchart illustrating an example of a sound discrimination process according to a second embodiment
- FIG. 13 is a diagram illustrating an example of a display screen according to the second embodiment
- FIG. 14A through FIG. 14D are diagrams for explaining a correction process of a detection frame according to the third embodiment.
- FIG. 15 is a flowchart illustrating an example of the correction process of the detection frame according to the third embodiment.
- a system may be considered to detect a status of bed users (patients or the like), such as getting out of the bed and returning to bed, by using temperature image data captured by thermo-cameras, or the like installed around the bed, and may inform the nurse call system or the like of a status of the users.
- the temperature image data may be used to sense temperature and a size of an area corresponding to a user, to estimate a user's condition, and to inform the nurse call system of the user's condition based on estimation results.
- a notification control system which facilitates securing a privacy of a bed user and detects a status of the user at night after lights are turned off.
- the method for determining the status of the user over time has a problem in which notification to the nurse call system is delayed in an event of an accident or the like occurring to the bed user.
- One embodiment of the present invention will be presented in view of the above-described problems, and in a notification control device that notifies a predetermined destination of a status of a user based on temperature image data captured within a predetermined capturing range, an error notification is reduced while suppressing a delay of a notification indicating the status of the user.
- FIG. 1 is a diagram illustrating an example of a system configuration of a notification control system according to an embodiment.
- the notification control system 100 includes a plurality of information collection devices 102 a to 102 f installed in an inpatient ward 110 , which is an example of a facility such as a medical facility or a nursing facility, and a notification control device 101 communicatively connected to the plurality of information collection devices 102 a to 102 f via a network 104 .
- the “information collection device 102 ” is referred to. Further, the number of the information collection devices 102 illustrated in FIG. 1 is an example, and one or more information collection devices 102 may be included in the notification control system 100 .
- the information collection device 102 includes a short-range wireless module for receiving identification information transmitted from a thermo-camera for capturing temperature image data indicative of a temperature of a subject and a Bluetooth Low Energy (hereinafter referred to as BLE) tag.
- BLE Bluetooth Low Energy
- the information collector 102 may also be referred to as a watch-over camera, simply a camera, or the like.
- thermo-camera is an imaging device that converts infrared radiation from a measurement object to temperature information by imaging the infrared radiation, and visualizes a temperature distribution by color or the like.
- the thermo-camera is sometimes referred to as a thermographic camera, a thermography, a thermo-vision, a thermo-viewer, or the like.
- the plurality of information collection devices 102 a to 102 f are mounted on walls, ceilings, or the like for a plurality of beds 103 a to 103 f provided in rooms A to F, respectively.
- the information collection device 102 a is mounted on a wall corresponding to the bed 103 a provided in the room A and is positioned so as to be able to capture temperature image data representing a temperature of a subject on the bed 103 a and around the bed 103 a (a predetermined capturing range).
- the information collection device 102 a photographs the temperature image data of the bed 103 a and around the bed 103 a at a predetermined frame rate (for example, 5 fps to 1 fps or the like) using the thermo-camera.
- a predetermined frame rate for example, 5 fps to 1 fps or the like
- a medical practitioner for instance, physician, nurse, caregiver, or the like working at the facility has a BLE tag that transmits identification information identifying the medical practitioner.
- the information collection device 102 a receives identification information (hereinafter, referred to as a wireless ID) transmitted from the BLE tag possessed by the medical practitioner who works in a facility using a short-range radio module (hereinafter, simply referred to as the “medical practitioner”).
- the medical practitioner may include a variety of staff working at the institution.
- the temperature image data acquired by the thermo-camera may be image data captured at predetermined time intervals (for example, 10 seconds to 60 seconds).
- the short-range wireless module may receive the wireless ID transmitted from a wireless tag other than the BLE tag, such as an active tag of a Radio Frequency Identity (RFID) instead of the BLE tag.
- RFID Radio Frequency Identity
- the information collection device 102 a transmits user information including captured temperature image data to the notification control device 101 through the network 104 .
- the user information includes identification information for identifying the collection device 102 a and the bed 103 a (for example, an IP address, a device ID, a bed ID, and the like).
- the information collection device 102 a receives the wireless ID, the user information includes the received wireless ID.
- other information collection devices 102 b to 102 f transmit user information including the temperature image data capturing the bed and the periphery of the bed, the received wireless ID, and the like to the notification control device 101 via the network 104 .
- the notification control device 101 is regarded as an information processing device having a computer configuration or a system including a plurality of information processing devices.
- the notification control device 101 receives the user information transmitted from the information collection device 102 and notifies a predetermined destination, such as a nurse call system 121 , of the notification information indicating the status of the user who uses the bed based on the received user information.
- the notification control device 101 detects a temperature change of a predetermined pattern in one or more sensing regions preset in the capturing range by using the temperature image data included in the user information. Upon detecting the temperature change of a predetermined pattern, the notification control device 101 notifies the nurse call system 121 of the notification information including the notification contents (for example, information indicating the state of the user, the temperature image data, and the like) corresponding to the detected temperature change.
- the notification contents for example, information indicating the state of the user, the temperature image data, and the like
- the notification control device 101 includes a function for stopping a process of notifying the notification information to the nurse call system 121 according to whether or not the user information includes a predetermined wireless ID.
- the notification control device 101 detects that a user of the bed 103 a has left the bed 103 a , by using the temperature image data included in the user information, and sends return information indicating that the user has returned to a predetermined destination when the user returns to the bed 103 a.
- temperature image data it is difficult to determine whether a person returning is the user using the bed 103 a, a medical practitioner, or the like.
- the notification control device 101 determines that the person returning is the medical practitioner, or the like, and stops the process of notifying the notification information to the nurse call system 121 .
- the notification control device 101 determines that the person returning is the medical practitioner, or the like, and stops the process of notifying the notification information to the nurse call system 121 .
- the notification control device 101 may determine that the person returning is not the bed user and may stop the process of notifying the notification information to the nurse call system 121 .
- the user may attach a BLE tag to a tray or a container used for meals or the like, and even if a user is detected in a predetermined area on a bed as described below, when the received user information includes the wireless ID of the BLE tag, the process of notifying information to the nurse call system 121 may be suspended.
- the notification control device 101 stops the process of notifying the notification information to the nurse call system 121 .
- Wireless IDs of a pre-registered medical practitioner, a facility staff, a person from outside of the facility, and wireless IDs of bed users are examples of predetermined identification information.
- the nurse call system 121 is an information processing apparatus including a computer configuration or a system including a plurality of information processing apparatus, and is an example of a predetermined destination to which the notification control apparatus 101 sends the notification information.
- the nurse call system 121 displays the calling information by a user (for example, a patient, a cared person, or the like) using the bed 103 on display devices 122 a to 122 c installed in nurse stations A to C, and an information terminal 123 possessed by a staff such as a nurse and a caregiver.
- the nurse call system 121 is connected to the notification control device 101 through the network 104 , and receives notification information that is sent from the notification control device 101 as depicted in FIG. 1 . Moreover, the nurse call system 121 may display a display screen for notifying a status of a user on the basis of the received notification information on the display devices 122 a to 122 c, the information terminal 123 , or the like.
- a plurality of display devices 122 a to 122 c are regarded as display devices provided in the nurse stations A to C or the like to display a display screen transmitted from the nurse call system 121 .
- the information terminal 123 is an information terminal such as a smartphone, a tablet terminal, a notebook, a Personal Computer (PC), or the like possessed by a nurse, caregiver, or the like.
- the information terminal 123 is able to communicate with the nurse call system 121 , for example, by wireless communication, and is able to display a display screen transmitted from the nurse call system 121 by executing a predetermined application.
- FIG. 2A and FIG. 2B are diagrams illustrating an arrangement example of beds and cameras according to the present embodiment. This embodiment can be applied where a plurality of beds 103 are provided in a room 111 , as illustrated in FIG. 2A and FIG. 2B , for example.
- the information collection device 102 is mounted on a wall or the like in order to acquire image data of the bed 103 and the periphery of the bed 103 corresponding to the information collection device 102 .
- the information collection device 102 may be installed on a ceiling of a room 111 .
- FIG. 2B illustrates the room 111 viewed from above.
- the information collection device 102 is positioned so that a thermo-camera is able to be used to capture the temperature image data of a predetermined capturing range 201 including an area of the bed 103 and the periphery of the bed 103 corresponding to the information collection device 102 .
- the information collection device 102 is adjusted to be capable of receiving radio waves transmitted by the BLE tag located in a communication range 202 including the bed 103 and a periphery of the bed 103 , and of acquiring a wireless ID included in the radio waves by using a short-range radio module.
- Each of medical practitioners possesses a BLE tag that transmits the wireless ID identifying the medical practitioner.
- the BLE tag can control a communication distance by an intensity of the radio wave to be transmitted.
- the intensity of the radio wave to be transmitted is set so that the communication distance is about 3 m to 4 m.
- FIG. 3A and FIG. 3B are diagrams for explaining the sensing region according to the present embodiment.
- the notification control device 101 manages one or more sensing regions preset within the capturing range 201 of the information collection device 102 .
- a detection frame 301 including a plurality of small areas 302 is set in the capturing range 201 of the information collection device 102 as illustrated in FIG. 3A .
- an attention area B is represented by “C3” indicating a position of a small area.
- An attention area C is represented by “B2, C2” and “B4, C4” indicating positions of a plurality of small areas.
- FIG. 4A through FIG. 4D are diagrams illustrating examples of detection patterns according to the present embodiment.
- the notification control device 101 detects a temperature change of a predetermined pattern in one or more sensing regions set in the capturing range 201 by using temperature image data included in user information received from the information collection device 102 .
- the notification control device 101 senses a position of a user 401 using the bed 103 by a temperature of a head 402 of the user 401 .
- the head 402 is less likely to be covered with, for example, clothing or blankets, and the facial portion is less susceptible to an influence of hairs; hence, it is suitable for sensing the position of the user 401 .
- the head 402 of the user 401 is represented by a different temperature (different color from the other portions) than the other portions, as illustrated in FIG. 4A .
- the notification control device 101 can detect a position of the user 401 by detecting an area corresponding to a predetermined temperature (for example, 30° C. to 40° C.) and the size of the head 402 from the temperature image data.
- a detection pattern is shown when the head 402 of the user 401 moves to an attention area A 410 defined in FIG. 3A and FIG. 3B .
- the notification control device 101 determines, for example, that the user 401 is at risk of falling from the bed 103 .
- the notification control device 101 notifies the predetermined destination, such as the nurse call system 121 , of the notification information indicating that the user 401 is at risk of falling from the bed 103 .
- This notification information includes falling warning information indicating that user 401 may fall from bed 103 , a bed ID identifying the bed 103 , temperature image data determined to be dangerous, current temperature image data, and the like.
- FIG. 4B illustrates another example of the detection pattern in which the user 401 falls from the bed 103 .
- the head 402 of the user 401 which is detected in any of the attention areas A to C defined in FIG. 3A and FIG. 3B , moves to the falling detection area 420 and remains in the falling detection area 420 for a predetermined time.
- the notification control device 101 determines that the user 401 has fell from the bed 103 .
- the notification control device 101 sends the notification information including the falling detection information indicating that the user 401 has fell from the bed, to a predetermined destination such as a nurse call system 121 .
- FIG. 4C illustrates another example of a sensing pattern of detection that a user 401 using the bed 103 leaves the bed 103 .
- the notification control device 101 determines that the user has been released from bed. In this case, the notification control device 101 sends the notification information including leaving detection information indicating that the user 401 has left the bed 103 to the predetermined destination such as a nurse call system 121 .
- FIG. 4D illustrates another example of the detection pattern of detecting that the user 401 using the bed 103 returns to the bed 103 (hereinafter referred to as “returning”).
- returning For example, suppose a user 401 that was not detected in the detection frame 301 had returned to the bed 103 or around the bed 103 . In this case, for example, as depicted in FIG. 4D , the head 402 of the user 401 is sensed in the falling detection area 420 . However, with this alone, the notification control device 101 cannot determine whether a person detected in the falling detection area 420 is the user 401 of the bed 103 or a staff of the facility.
- the notification control device 101 determines that the person detected in the fall detection area 420 is the user 401 of the bed 103 in a case in which the wireless ID of the medical practitioner is not included in information received from the information collection device 102 .
- the information collection device 102 notifies the predetermined destination such as the nurse call system 121 of the notification information including returning detection information indicating that the user 401 has returned to the bed 103 .
- the notification control device 101 determines that the person detected in the fall detection area 420 is the medical practitioner, and stops a process of transmitting the notification information to the predetermined destination.
- the notification control device 101 when the user 401 returning to the bed 103 is collapsed in the fall detection area 420 , for example, as depicted in FIG. 4B with hands or feet of the user 401 slipped, the notification control device 101 is able to immediately determine that the user 401 is present in the fall detection area 420 . In addition, when a medical practitioner is working in the falling detection area 420 or the like, the notification control device 101 is able to stop the process of transmitting the notification information to the predetermined destination, and thus, it is possible to reduce an error notification to the notification destination.
- the notification control device 101 that notifies the predetermined destination of a status of a user based on temperature image data captured in the predetermined capturing range 201 , it is possible to reduce the error notification while suppressing a delay of a notification indicating the status of the user.
- FIG. 5 is a diagram illustrating an example of a hardware configuration of the notification control device according to the present embodiment.
- the notification control device 101 includes a typical computer configuration such as a Central Processing Unit (CPU) 501 , Random Access Memory (RAM) 502 , Read Only Memory (ROM) 503 , a storage device 504 , a network I/F (Interface) 505 , an input device 506 , a display device 507 , an external I/F 508 , and a bus 509 .
- CPU Central Processing Unit
- RAM Random Access Memory
- ROM Read Only Memory
- the CPU 501 is an arithmetic unit which realizes functions of the notification control device 101 by reading out a program or data stored in the ROM 503 or the storage device 504 to the RAM 502 and by performing various processes.
- RAM 502 is a volatile memory used as a work area or the like of CPU 501 .
- ROM 503 is a non-volatile memory which maintains programs and data even when power is turned off.
- the storage device 504 may be, for example, a mass storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores, for example, an Operating System (OS), application programs, various data, and the like.
- HDD hard disk drive
- SSD solid state drive
- OS Operating System
- the network I/F 505 is a communication interface for connecting the notification control device 101 to the network 104 .
- the input device 506 is a pointing device such as a mouse or an input device such as a keyboard and is used to operate to input various information items to the notification control device 101 .
- the display device 507 is a device to display process results or the like acquired by the notification control device 101 .
- the external I/F 508 is an interface for connecting external devices.
- Each of the external devices includes, for example, a recording medium or the like.
- the notification control device 101 stores a predetermined program in the recording medium and installs the program stored in the recording medium into the notification control device 101 via the external I/F 508 , thereby making the predetermined program executable.
- the bus 509 is connected to each of the above described components (regarded as circuitries) and transmits address signals, data signals, various control signals, and the like.
- FIG. 6A and FIG. 6B are diagrams illustrating examples of a hardware configuration of the information collection device according to the present embodiment.
- the information collection device 102 includes a CPU 601 , a memory 602 , a network I/F 603 , a short-range wireless module 604 , a thermo-camera 605 , a Complementary Metal Oxide Semiconductor (CMOS) camera 606 , a microphone array 607 , a Light Emitting Diode (LED) 608 , and a bus 609 , as depicted in FIG. 6A .
- CMOS Complementary Metal Oxide Semiconductor
- LED Light Emitting Diode
- the CPU 601 is an arithmetic unit which implements functions of the information collection device 102 by executing a program stored in the memory 602 .
- the memory 602 includes one or more storage devices such as a RAM, a ROM, a flash ROM, and the like.
- the network I/F 603 is a communication interface for connecting the information collection device 102 to the network 104 .
- the short-range wireless module 604 includes an antenna, a wireless circuit, and communication control for communicating with a wireless tag such as a BLE tag, for example, by a short-range wireless communication such as BLE communication.
- the thermo-camera 605 is an imaging device that converts infrared radiation from a measurement subject to temperature information by imaging the infrared radiation, and visualizes a temperature distribution by color or the like as described in the description of FIG. 1 .
- the thermo-camera 605 is provided in a front panel 610 or the like facing the bed 103 , for example, as depicted in FIG. 6B , captures an image within the capturing range 201 including an area of the bed 103 and the periphery of the bed 103 , and outputs temperature image data.
- the CMOS camera 606 is an imaging device that captures typical photographic data.
- the CMOS camera 606 is provided on the front panel 610 or the like facing the bed 103 , as depicted in FIG. 6B , for example, and captures photographic data in the capturing range 201 including the area of the bed 103 and the periphery of the bed 103 , and outputs photographic data taken.
- a microphone array 607 selectively acquires a predetermined range of voices by using multiple microphones.
- the microphone array 607 includes two or more microphones provided on, for example, the front panel 610 opposite the bed 103 , as depicted in FIG. 6B , for selectively acquiring voice data at the bed 103 and around the bed 103 .
- the microphone array 607 acquires audio within the same range as the communication range 202 of the short-range wireless module illustrated in FIG. 2 .
- the LED 608 is a light emitting element that emits light according to control from the CPU 601 .
- the LED 608 is an example of a display device provided by the information collection device 102 and blinks or illuminates, for example, in a color or a light emitting pattern specified by the CPU 601 .
- the bus 609 is connected to each of the above components and transmits address signals, data signals, various control signals, and the like.
- FIG. 7 is a diagram illustrating an example of a functional configuration of a notification control system according to the present embodiment.
- the notification control system 100 includes the notification control device 101 connected to the network 104 and one or more information collection devices 102 a, 102 b, . . . , and the like.
- the notification control device 101 is communicatively connected to the nurse call system 121 , which is an example of the predetermined destination, for example, through the network 104 .
- the information collection device 102 b includes the same functional configuration as the information collection device 102 a.
- the notification control device 101 realizes a communication unit 701 , an information receiving unit 702 , a detection unit 703 , a notification control unit 704 , an ID managing unit 705 , a response information providing unit 706 , a display control unit 707 , a voice discrimination unit 708 , a voice information providing unit 709 , a correction unit 710 , and a storage device 711 by executing a predetermined program in the CPU 501 .
- At least one of the above-described circuitries may be implemented by hardware.
- the communication unit 701 is realized, for example, by a program executed in the CPU 501 of FIG. 5 and the network I/F 505 .
- the communication unit 701 connects the notification control device 101 to the network 104 and communicates with the information collection device 102 , the nurse call system 121 , and the like.
- the information receiving unit 702 is implemented by a program executed by the CPU 501 of FIG. 5 .
- the information receiving unit 702 receives user information (subject information) transmitted from the one or more information collection devices 102 through the network 104 and stores the information in the storage device 711 .
- the user information includes information for identifying the information collection device 102 , the bed 103 , or the like, and temperature image data acquired by capturing the capturing range 201 including an area of the bed 103 and the periphery of the bed 103 .
- the user information further includes the received wireless ID.
- the user information includes voice data acquired by a voice data acquisition unit 725 at the bed 103 and around the bed 103 .
- the detection unit 703 is implemented, for example, by a program executed in the CPU 501 of FIG. 5 .
- the detection unit 703 detects a temperature change of a predetermined detection pattern in one or more sensing regions preset in the capturing range 201 by using the temperature image data stored in the storage device 711 by the information receiving unit 702 .
- the notification control device 101 previously stores detection pattern information 712 as depicted in FIG. 8A in the storage device 711 or the like.
- the detection unit 703 detects the temperature change of the detection pattern set to the detection pattern information 712 in a detection area such as the detection frame 301 , the falling detection area, and the attention areas A to C described with reference to FIG. 3A and FIG. 3B .
- FIG. 8A is a diagram illustrating an example of the detection pattern information 712 according to the present embodiment.
- the detection pattern information 712 includes information such as “detection pattern”, “notification contents”, and “temperature change” as items.
- the item “detection pattern” indicates information such as a name, number, or identification information for identifying a detection pattern indicative of a pattern of temperature changes.
- the item “notification contents” indicates information representing notification contents to be sent to a predetermined destination upon detecting a “temperature change” corresponding to the “detection pattern”.
- the item “temperature change” indicates information representing a change in temperature detected in the detection area such as the detection frame 301 , the falling detection area, and the attention areas A to C corresponding to the “detection pattern”.
- FIG. 8A depicts that the “temperature change” corresponding to the detection pattern “pattern 6” indicates a movement of a sensing target (for example, the head 402 of the user 401 ) from an outside of the detection frame 301 into the detection frame 301 .
- the detection unit 703 senses a temperature change in the detection frame 301 , the falling detection area, and the attention areas A to C.
- the detection unit 703 senses a temperature change of “pattern 6” (an example of the predetermined detection pattern).
- the notification control unit 704 is implemented by, for example, a program executed by the CPU 501 of FIG. 5 .
- the notification control unit 704 notifies a predetermined destination such as the nurse call system 121 of the notification information representing the state of the user 401 of the bed 103 (the state of the subject), based on user information (information of the subject) received by the information receiving unit 702 .
- the notification control unit 704 notifies the predetermined destination of the notification information including “notification contents” corresponding to the “detection pattern” when the detection unit 703 detects a temperature change of the predetermined detection pattern and when the user information (subject information) does not include the predetermined wireless ID.
- the predetermined wireless ID is the wireless ID of the medical personnel working at the facility.
- the notification control unit 704 notifies the predetermined destination of the notification information including the “notification contents” corresponding to the detection pattern “pattern 6” of the detection pattern information 712 (returning information indicating that a user has returned to a bed and the temperature image data of the bed and the periphery of the bed).
- the notification control unit 704 detects the temperature change of the predetermined detection pattern by the sensing unit 703 , and stops the processing of notifying information including “notification contents” corresponding to the “detection pattern” to a predetermined destination when the user information includes a predetermined wireless ID.
- the ID management unit (identification information management unit) 705 is implemented by a program executed by the CPU 501 of FIG. 5 .
- the ID management unit (identification information management unit) 705 stores in the storage device 711 or the like and manages the wireless ID identifying the medical practitioner working in the facility.
- FIG. 8B is a diagram illustrating an example of the ID management information 713 according to the present embodiment.
- the ID management information 713 includes information such as “WIRELESS ID”, “JOB TYPE”, “AFFILIATION”, “NAME”, and the like as items.
- the item “WIRELESS ID” is regarded as identification information included in radio waves transmitted by the BLE tags possessed by a medical personnel working in the facility.
- the item “JOB TYPE” indicates information representing an occupation of a medical personnel corresponding to the “WIRELESS ID”.
- the item “AFFILIATION” refers to a place to which the medical personnel corresponding to the “WIRELESS ID” belongs.
- the item “NAME” indicates information representing a name, or the like of the medical personnel corresponding to the “WIRELESS ID”.
- the notification control device 101 may determine that a facility staff, a medical practitioner, or the like is near the bed 103 when the wireless ID received at the bed 103 or around the bed 103 is registered in the ID management information 713 .
- the notification control device 101 may determine that the staff of the facility, the medical practitioner, or the like is not near the bed 103 .
- a response information providing unit (first information providing unit) 706 is realized, for example, by a program executed in the CPU 501 of FIG. 5 .
- the response information providing unit 706 uses the wireless ID included in the user information (subject information) received by the information receiving unit 702 to provide information for visualizing a response of the staff of the facility and the medical practitioner with respect to the user 401 of the bed 103 .
- the response information providing unit 706 aggregates time at which the wireless ID of each medical practitioner is received in each of the beds 103 , and outputs or displays information visualized in tables, graphs, or the like to determine how much time each medical practitioner has spent to respond to the user 401 of each of the beds 103 .
- the information provided by the response information providing unit 706 may include temperature image data capturing the bed 103 and the periphery of the bed 103 .
- the display control unit 707 is implemented, for example, by a program executed in the CPU 501 of FIG. 5 and controls a display by a display device such as the LED 608 , provided by the information collection device 102 .
- the display control unit 707 determines whether or not there is a medical practitioner at the bed 103 or around the bed 103 based on the wireless ID included in the information received by the information receiving unit 702 .
- the display control unit 707 sends information indicating that there is a medical practitioner the bed 103 or around the bed 103 , as an example to the information collection device 102 , when there is a medical practitioner or the like at the bed 103 or around the bed 103 .
- the display control unit 707 may notify the information collection device 102 of control information indicating that the LED 608 blinks green when a medical practitioner or the like is present at the bed 103 or around the bed 103 .
- the information collection device 102 flashes green on the LED 608 , for example, when there is a medical practitioner at the bed 103 or around the bed 103 .
- the green flashing of the LED 608 is an example of display information indicating that there is a medical practitioner at the bed 103 or around the bed 103 .
- the display control unit 707 notifies the information collection device 102 that there is no medical practitioner at the bed 103 and around the bed 103 as an example.
- the display control unit 707 may notify the information collection device 102 of control information indicating that the LED 608 does not blink green when there is no medical practitioner at the bed 103 and around the bed 103 .
- the information collection device 102 does not cause the LED 608 to blink green when there is no medical practitioner at the bed 103 or around the bed 103 .
- the voice discrimination unit (discrimination unit) 708 is realized, for example, by a program executed by the CPU 501 of FIG. 5 , and determines a type of sound included in the voice data by using the temperature image data and the voice data included in the user information received by the information receiving unit 702 .
- the speech discrimination unit 708 calculates the sound magnitude of the voice data and analyzes the temperature image data when the sound magnitude is greater than or equal to the first threshold value to calculate an amount of a movement of the user 401 using the bed 103 (for example, an amount of a movement of the head 402 of the user 401 ).
- the voice discrimination unit 708 determines that the type of sound is, for example, a user's groaning, when the magnitude of the sound data is more than or equal to a first threshold value and the amount of the movement of the user is more than or equal to a second threshold value.
- the voice discrimination unit 708 determines that the type of sound is, for example, a user's snoring, when the magnitude of the sound data is more than or equal to the first threshold value and the amount of movement of the user is less than the second threshold value.
- the groaning and the snoring are examples of types of sounds determined by the voice discrimination unit 708 .
- the voice discrimination unit 708 may determine whether or not the type of the sound indicated in the voice data indicates a sound to be notified to the predetermined destination.
- the voice information providing unit (second information providing unit) 709 is implemented by a program executed in the CPU 501 of FIG. 5 , for example, and outputs or displays information representing a determination result by the voice discriminating unit 708 .
- the information provided by the voice information providing unit 709 includes temperature image data capturing the bed 103 or the periphery of the bed 103 .
- the voice information providing unit 709 may output sound acquired at the bed 103 or around the bed 103 in accordance with an operation of an operator.
- the correction unit 710 is realized, for example, by a program executed in the CPU 501 of FIG. 5 , and corrects a position of the detection frame 301 , the falling detection area, and the attention regions A to C set in the capturing range 201 in accordance with a change of a location of the bed 103 .
- the information collection device 102 is able to transmit image data (hereinafter, referred to as photographic data) on which the bed 103 is captured by the CMOS camera 606 to the notification control device 101 .
- the correction unit 710 uses the received photographic data to specify the location of the bed 103 (for example, a contour), and corrects positions of the detection frame 301 , the falling sensing area, and the caution regions A to C in accordance with the location of the bed 103 .
- the display control unit 707 blinks the LED 608 of the information collection device 102 , for example, in red.
- the facility staff, the medical practitioner, or the like determines that the bed 103 is not properly positioned, and adjusts the bed 103 to a correct position.
- the correction unit 710 again corrects the positions of the detection frame 301 , the falling sensing area, and the attention areas A to C, and terminates the red blinking of the LED 608 of the information collection device 102 when the positions are corrected.
- the storage device 711 is implemented by, for example, a program executed by the CPU 501 of FIG. 5 and a storage device 504 , a RAM 502 , or the like, and stores the detection pattern information 712 , the ID management information 713 , and the area information 310 described above.
- the information collection device 102 realizes, for example, a communication unit 721 , an image data acquisition unit 722 , an ID receiving unit 723 , an information transmitting unit 724 , voice data acquisition unit 725 , a photographic data acquisition unit 726 , and a display unit 727 by executing a predetermined program in the CPU 601 .
- a communication unit 721 an image data acquisition unit 722 , an ID receiving unit 723 , an information transmitting unit 724 , voice data acquisition unit 725 , a photographic data acquisition unit 726 , and a display unit 727 by executing a predetermined program in the CPU 601 .
- At least one of the above-described circuitries may be implemented by hardware.
- the communication unit 721 is realized, for example, by a program executed in the CPU 601 of FIG. 6A , the network I/F 603 , and the like, and communicates with the notification control device 101 and the like by connecting the information collection device 102 to the network 104 .
- the image data acquisition unit 722 is realized, for example, by a program executed by the CPU 601 , and captures the temperature image data of the bed 103 and around the bed 103 by using the thermo-camera 605 of FIG. 6 .
- the ID receiving unit (identification information receiving unit) 723 is implemented, for example, by a program executed by the CPU 601 , and receives a wireless ID from a BLE tag or the like at the bed 103 and around the bed 103 by using the short-range wireless module 604 of FIG. 6 .
- the information transmitting unit 724 is implemented by a program executed by the CPU 601 , and transmits the user information including the temperature image data captured by the image data acquisition unit 722 to the notification control device 101 .
- the user information includes information that identifies the information collection device 102 , the bed 103 , or the like, as described above.
- the information of the user includes the wireless ID received by the ID receiving unit 723 .
- the information transmitting unit 724 may, if necessary, transmit the voice data acquired by the voice data acquisition unit 725 , the photographic data acquired by the photographic data acquisition unit 726 , or the like to the notification control device 101 included in the user information.
- the voice data acquisition unit 725 is implemented, for example, by a program executed by the CPU 601 , and acquires the voice data at the bed 103 and around the bed 103 by using the microphone array 607 of FIG. 6 .
- the photographic data acquisition unit 726 is implemented, for example, by a program executed in the CPU 601 to capture photographic data of the bed 103 and the periphery of the bed 103 by using the CMOS camera 606 of FIG. 6 .
- the display unit 727 is realized, for example, by a program executed in the CPU 601 .
- the LED 608 of FIG. 6 emits light in a predetermined color, a blinking pattern, or the like to display predetermined information.
- the display unit 727 flashes green on the LED 608 , for example, when there is a staff of the facility, a medical practitioner, or the like at the bed 103 and around the bed 103 .
- the display unit 727 causes the LED 608 to blink in red as an example.
- FIG. 9 is a flowchart illustrating an example of a notification control process according to a first embodiment. This process in FIG. 9 illustrates an example of the notification control process performed when the notification control device 101 receives user information transmitted from the information collection device 102 .
- the information collection device 102 transmits user information including temperature image data capturing the bed 103 and around the bed 103 and the bed ID identifying the bed 103 to the notification control device 101 at a predetermined time interval.
- the ID receiving unit 723 receives the wireless ID
- the information collection device 102 transmits the user information including the received wireless ID to the notification control device 101 .
- step S 901 the information receiving unit 702 of the notification control device 101 receives the user information transmitted from the information collection device 102 .
- step S 902 the information receiving unit 702 stores the temperature image data included in the received user information in the storage device 711 .
- the information receiving unit 702 deletes the temperature image data after a predetermined storage period from the storage device 711 .
- step S 903 the detection unit 703 of the notification control device 101 detects a temperature change of a predetermined detection pattern in one or more sensing regions by using the temperature image data stored in the storage device 711 .
- the detection unit 703 detects the temperature change of the detection pattern set to the detection pattern information 712 in the detection area such as the detection frame 301 , the falling detection area, and the attention areas A to C described in FIG. 3A and FIG. 3B .
- step S 904 the detection unit 703 of the notification control device 101 determines whether or not the temperature change of the predetermined detection pattern is detected in step S 903 .
- the notification control device 101 advances to step S 905 . However, when the temperature change of the predetermined detection pattern is not detected, the notification control device 101 terminates this process.
- the notification control unit 704 of the notification control device 101 determines whether or not the wireless ID of the medical practitioner is included in the user information received by the information receiving unit 702 . For example, when the wireless ID registered in the ID management information 713 is included in the user information received by the information receiving unit 702 , the notification control unit 704 determines that the wireless ID of the medical practitioner is included in the user information.
- the notification control unit 704 advances to step S 906 .
- the notification control unit 704 stops the process of notifying the notification information to the predetermined destination and terminates this process.
- the notification control unit 704 of the notification control device 101 When advancing to step S 906 , notifies a predetermined destination such as the nurse call system 121 of the notification information corresponding to the detected temperature change.
- the notification control unit 704 to immediately notify the predetermined destination of the notification information indicating that the user 401 has returned to the bed 103 .
- the notification control device 101 that notifies the predetermined destination of the status of the user based on the temperature image data captured within the predetermined capturing range, it is possible to reduce the error notification while suppressing the delay of the notification indicating the status of the user.
- FIG. 10 is a sequence diagram illustrating an example of a display control process according to the first embodiment. This process illustrates an example of the display control process in which the notification control device 101 executes in parallel with the notification control process illustrated in FIG. 9 when the user information transmitted from the information collection device 102 is received.
- step S 1001 the information collection device 102 transmits user information including the temperature image data capturing the bed 103 and the periphery of the bed 103 to the notification control device 101 .
- step S 1002 the display control unit 707 of the notification control device 101 checks whether or not the wireless ID (a predetermined ID) of the medical practitioner is included in the user information received from the information collection device 102 .
- step S 1011 and step S 1012 are performed.
- the processes in step S 1021 and step S 1022 are performed.
- step S 1011 the display control unit 707 of the notification control device 101 notifies the information collection device 102 of information indicating that the medical practitioner is present in the bed 103 or around the bed 103 as an example.
- the display control unit 707 may notify the information collection device 102 of control information indicating green blinking of the LED 608 .
- step S 1012 the display unit 727 of the information collection device 102 blinks the LED 608 in green in response to information indicating that the medical practitioner is present or the control information indicating that the LED 608 blinks green received from the notification control device 101 .
- step S 1021 the display control unit 707 of the notification control device 101 notifies the information collection device 102 of information indicating that there is no medical practitioner at the bed 103 or around the bed 103 .
- the display control unit 707 may notify the information collection device 102 of the control information indicating a stop of green blinking of the LED 608 .
- step S 1022 the display unit 727 of the information collection device 102 does not cause the LED 608 to blink green in response to information received from the notification control device 101 indicating an absence of a medical practitioner or control information indicating a stop of blinking of the LED 608 in green. For example, when the LED 608 is blinking in green, the display unit 727 ends flashing in green. When the LED 608 is not blinking in green, the display unit 727 maintains a present state.
- the medical practitioner is able to check the LED 608 of the nearby information collection device 102 and to recognize that the BLE tag is in a fault or out-of-battery state, or that the ID receiving unit 723 of the information collection device 102 is in a fault state in a case in which the LED is not blinking green.
- FIG. 11 is a flowchart illustrating an example of a process for providing a response information according to the first embodiment. This process represents an example of a process for providing the response information in order to visualize a response of a medical practitioner to the user 401 of the bed 103 .
- step S 1101 the information receiving unit 702 of the notification control device 101 receives user information transmitted from the information collection device 102 .
- step S 1102 the response information providing unit 706 of the notification control device 101 determines whether or not a wireless ID (a predetermined ID) of the medical practitioner is included in the received user information.
- the response information providing unit 706 advances to step S 1103 . However, when the wireless ID of the medical practitioner is not included in the user information, the response information providing unit 706 advances to step S 1104 .
- the response information providing unit 706 of the notification control device 101 stores the wireless ID of the medical practitioner included in the user information in the storage device 711 in association with the bed 103 .
- the response information providing unit 706 stores in the storage device 711 the wireless ID included in the user information in association with identification information identifying the bed 103 , the information collection device 102 , or the like.
- the information stored in the storage device 711 by the response information providing unit 706 is automatically erased after a certain period.
- the response information providing unit 706 of the notification control device 101 determines whether or not a display request of response information is received from the input device 506 or the like.
- the notification control device 101 When the display request of the response information is not received, the notification control device 101 returns the process to step S 1101 and executes this process from step S 1101 again. However, when the display request of the response information is received, the response information providing unit 706 of the notification control device 101 advances to step S 1105 .
- the response information providing unit 706 of the notification control device 101 acquires information stored in the storage device 711 and aggregates times each when the wireless ID of the medical practitioner is received at each of beds 103 . By this aggregation, for example, a time length, in which the medical practitioner has stayed at each of the beds 103 and around the bed 103 , is calculated.
- step S 1106 the response information providing unit 706 of the notification control device 101 visually displays the response to the user 401 by a medical practitioner for each of the beds 103 .
- the response information providing unit 706 creates display information indicating how long it took for the medical practitioner to respond to the user 401 for each of the beds 103 based on the wireless ID of the medical practitioner designated in step S 1104 , and displays the created display information on the display device 507 or the like.
- the response information providing unit 706 may create display information including the information of the medical practitioner corresponding to the user 401 and the temperature image data, and may display the created display information on the display device 507 or the like.
- the notification control device 101 in accordance with the first embodiment, it is possible to visualize and provide (output, display, or the like) a response to a user 401 of each bed 103 by a medical practitioner.
- FIG. 12 is a flowchart illustrating an example of a sound discrimination process according to a second embodiment. This process illustrates an example of a process in which a voice discrimination unit 708 of the notification control device 101 determines a type of sound around the bed 103 and the bed 103 .
- step S 1201 the information receiving unit 702 of the notification control device 101 receives user information transmitted from the information collection device 102 , and stores the user information in the storage device 711 .
- step S 1202 the voice discrimination unit 708 calculates a sound magnitude based on the voice data included in the user information.
- step S 1203 the voice discrimination unit 708 determines whether or not the sound magnitude in the voice data is greater than or equal to a first threshold value.
- a first threshold value a value for determining whether or not a sound to be discerned is occurred at the bed 103 and around the bed 103 is set beforehand.
- the voice discrimination unit 708 terminates this process. However, when the sound magnitude in the voice data is greater than or equal to the first threshold value, the voice discrimination unit 708 advances to step S 1205 .
- the voice discrimination unit 708 calculates a movement amount of the user 401 of the bed 103 (for example, a movement amount of the head 402 of the user 401 ) using the temperature image data stored in the storage device 711 .
- the movement amount of the user 401 is represented by a pixel movement amount or the like representing the temperature corresponding to the head 402 of the user 401 in the temperature image data.
- step S 1205 the voice discrimination unit 708 determines whether or not the movement amount of the user 401 calculated in step S 1204 is more than or equal to a second threshold value.
- the second threshold is preset, for example, to determine whether the user 401 of the bed 103 is waking or sleeping.
- the voice discrimination unit 708 determines a type of sound occurring at the bed 103 and around the bed 103 , for example, as a groaning (step S 1206 ). However, when the movement amount of the user 401 is less than the second threshold value, the voice discrimination unit 708 determines the type of sound occurring at the bed 103 and around the bed 103 , for example, as a snoring (step S 1207 ).
- the voice information providing unit 709 of the notification control device 101 may display a display screen 1300 as illustrated in FIG. 13 on the display device 507 .
- the voice information providing unit 709 may notify the display screen 1300 to the nurse call system 121 or the like based on the determination result. For example, the voice information providing unit 709 notifies a predetermined destination such as the nurse call system 121 of the display screen 1300 depicted in FIG. 13 upon determining the type of sound to be a groaning voice in the sound discrimination process depicted in FIG. 12 .
- FIG. 13 is a diagram illustrating an example of a display screen according to the second embodiment.
- a character string 1301 representing a status of a user 401
- a temperature image 1302 captured around the bed 103
- a volume information 1303 a play button 1304 , and the like are displayed on the picture screen 1300 .
- the character string 1301 representing the state of the user 401 displays a bed name identifying the bed 103 , the state of the user 401 of the bed 103 , and the discrimination result by the sound discrimination process depicted in FIG. 12 .
- the temperature image 1302 taken around the bed 103 is displayed by using the temperature image data included in the user information received from the information collection device 102 .
- Volume information 1303 visually indicates the loudness of sound around the bed 103 .
- the voice information providing unit 709 plays back the sound acquired around the bed 103 by using the acquired voice data.
- the notification control device 101 when the head 402 of the user 401 is detected in the falling detection area, the attention areas A to C, or the like, the notification control device 101 performs notification process to notify a predetermined destination of notification information indicating a status of the user 401 . Therefore, for example, if the head 402 of the user 401 does not move from a position depicted in a temperature image 1302 of FIG. 13 , the notification information is not sent.
- the notification control device 101 detects an abnormality of the user 401 and notifies a predetermined destination of an occurrence of the abnormality.
- the notification control device 101 includes a correction unit 710 for correcting the position of the detection frame 301 according to the location of the bed 103 .
- FIG. 14A through FIG. 14D are diagrams for explaining the correction process of the detection frame according to the third embodiment.
- the information collection device 102 according to the third embodiment includes a function of capturing photographic data of the bed 103 by using the CMOS camera 606 and transmitting the photographic data to the notification control device 101 .
- the photographic data acquisition unit 726 of the information collector 102 acquires photographic data of the bed 103 and a periphery of the bed 103 .
- the information transmitting unit 724 transmits user information including the temperature image data acquired by the image data acquisition unit 722 and the photographic data acquired by the photographic data acquisition unit 726 to the notification control unit 101 .
- the information transmitting unit 724 may transmit the photographic data to the notification control unit 101 in addition to the user information.
- the information collection device 102 may transmit the photographic data to the notification control device 101 upon a request from the notification control device 101 or transmit the photographic data to the notification control device 101 at a predetermined time interval.
- FIG. 14A illustrates an image of a photographic image 1401 and a detection frame 301 when the bed 103 is arranged at a predetermined place. From this state, for example, as illustrated in FIG. 14B , when the location of the bed 103 is displaced, the correction unit 710 of the notification control device 101 detects that a location of the bed 103 has been displaced, for example, by detecting a contour of the bed 103 from the photographic image 1401 .
- the correction unit 710 of the notification control device 101 corrects the position of the detection frame 301 according to the contour of the bed 103 , for example, as depicted in FIG. 14C .
- the correction unit 710 of the notification control device 101 does not detect the contour of the bed 103 .
- the location of the bed 103 is largely displaced as described above, even though the contour of the bed 103 is detected, a portion of the detection frame 301 may not be detectable.
- the correction unit 710 of the notification control device 101 notifies that correction of the detection frame 301 cannot be performed, for example, by flashing, in red, the LED 608 of the information collection device 102 .
- the medical practitioner around the bed 103 may determine that the location of the bed 103 is displaced and may adjust the position of bed 103 .
- the medical practitioner around the bed 103 may also recognize that the location of the bed 103 is correct if the LED 608 of the information collection device 102 is not blinking in red.
- FIG. 15 is a flowchart illustrating an example of the correction process of the detection frame according to the third embodiment. This process illustrates the example of the correction process of the detection frame performed when the notification control device 101 corrects the detection frame 301 .
- step S 1501 the correction unit 710 of the notification control device 101 acquires photographic data of the bed 103 transmitted from the information collection device 102 .
- the correction unit 710 acquires the photographic data included in the user information received by the information receiving unit 702 .
- step S 1502 the correction unit 710 of the notification control device 101 detects a location of the bed 103 from the photographic data of the bed 103 .
- the correction unit 710 analyzes the photographic data and extracts a contour of the bed 103 .
- step S 1503 the correction unit 710 of the notification control device 101 determines whether or not the location of the bed 103 is displaced with respect to the detection frame 301 .
- the correction unit 710 determines that the location of the bed 103 is not displaced when the contour of the bed 103 is correctly positioned with respect to the detection frame 301 and the small area 302 within the detection frame 301 .
- the correction unit 710 determines that the location of the bed 103 is displaced with respect to the detection frame 301 and the small area 302 in the detection frame 301 when the contour of the bed 103 is not correctly positioned.
- the correction unit 710 advances to step S 1504 . However, when the location of the bed 103 is displaced, the correction unit 710 advances to step S 1505 .
- the correction unit 710 of the notification control device 101 notifies the information collection device 102 that the correction of the detection frame 301 has been successful, and ends this process. Accordingly, when the LED 608 is blinking in red, the information collection device 102 controls the LED 608 to end blinking in red, and when the LED 608 is not blinking in red, the information collection device 102 maintains a state of the LED 608 not blinking in red.
- the correction unit 710 of the notification control device 101 corrects the position of the detection frame 301 according to the location of the bed 103 , for example, as depicted in FIG. 14C .
- the correction unit 710 adjusts the detection frame 301 by moving, rotating, enlarging, or reducing the detection frame 301 , for the contour of the bed 103 with respect to the detection frame 301 and the small area 302 within the detection frame 301 to be positioned at a correct location.
- step S 1506 the correction unit 710 of the notification control device 101 determines whether or not the correction of the detection frame 301 was successful. For example, the correction unit 710 determines that the correction was successful when the detection frame 301 and the small area 302 in the detection frame 301 are detectable as illustrated in FIG. 14C . However, as depicted in FIG. 14D , when the contour of the bed 103 cannot be detected, or when a portion of the small area 302 in the detection frame 301 and the detection frame 301 cannot be detected, the correction unit 710 determines that the correction failed.
- step S 1504 When the correction of the detection frame 301 is successful, the correction unit 710 advances to step S 1504 . However, when the correction of the detection frame 301 fails, the correction unit 710 advances to step S 1507 .
- the correction unit 710 of the notification control device 101 When advancing to step S 1507 , the correction unit 710 of the notification control device 101 notifies the information collection device 102 that the correction of the detection frame 301 has failed and returns to step S 1501 . Accordingly, when the LED 608 is not blinking in red, the information collection device 102 controls the LED 608 to start blinking in red, and when the LED 608 is blinking in red, the LED 608 continues blinking in red.
- the above process allows the medical practitioner to easily determine that the bed 103 is displaced and to correct the location of the bed 103 .
- a notification control device that notifies a predetermined destination of a status of a user based on temperature image data captured within a predetermined capturing range, it is possible to reduce error notifications while suppressing a delay of a notification indicating the status of the user.
- the present invention can be implemented in any convenient form, for example using dedicated hardware, or a mixture of dedicated hardware and software.
- the present invention may be implemented as computer software implemented by one or more networked processing apparatuses.
- the network can comprise any conventional terrestrial or wireless communications network, such as the Internet.
- the processing apparatuses can comprise any suitably programmed apparatuses such as a general purpose computer, personal digital assistant, mobile telephone (such as a WAP or 3G-compliant phone) and so on. Since the present invention can be implemented as software, each and every aspect of the present invention thus encompasses computer software implementable on a programmable device.
- the computer software can be provided to the programmable device using any storage medium for storing processor readable code such as a floppy disk, a hard disk, a CD ROM, a magnetic tape device or a solid state memory device.
- the hardware platform includes any desired kind of hardware resources including, for example, a processor such as a central processing unit (CPU), a random access memory (RAM), and a hard disk drive (HDD).
- the CPU may be implemented by any desired kind of any desired number of processors.
- the RAM may be implemented by any desired kind of volatile or non-volatile memory.
- the HDD may be implemented by any desired kind of non-volatile memory capable of storing a large amount of data.
- the hardware resources may additionally include an input device, an output device, or a network device, depending on the type of the apparatus. Alternatively, the HDD may be provided outside of the apparatus as long as the HDD is accessible.
- the CPU such as a cache memory of the CPU
- the RAM may function as a physical memory or a primary memory of the apparatus, while the HDD may function as a secondary memory of the apparatus.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Emergency Management (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Surgery (AREA)
- Molecular Biology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Physiology (AREA)
- Dentistry (AREA)
- Geophysics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Chemical Kinetics & Catalysis (AREA)
- General Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Computer Networks & Wireless Communication (AREA)
- Accommodation For Nursing Or Treatment Tables (AREA)
- Alarm Systems (AREA)
Abstract
Description
- The present application claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2018-185999 filed on Sep. 28, 2018 and No. 2019-098711 filed on May 27, 2019, the entire contents of which are incorporated herein by reference.
- The present invention is related to a notification control device, a notification control system, and a notification control method.
- In facilities such as medical facilities and nursing care facilities, a nursing call system is known for a medical practitioner to be called in response to a calling operation of patients, or the like.
- In addition, a nurse call system is known to detect whether a bed is empty or not, and to notify an end of a bed making according to a calling operation when the bed is empty and notify the nurse call according to the calling operation when the bed is not empty (see, for example, Patent Document 1).
- Patent Document 1: Japanese Laid-Open Patent Application No. 2013-211607
- In one aspect of this disclosure, a notification control device for controlling notification based on subject information includes a memory, and a processor coupled to the memory and configured to perform receiving the subject information including temperature image data indicating temperature of a subject captured within a predetermined capturing range; and notifying a predetermined destination of notification information representing a state of the subject based on the subject information, the processor stops a process of notifying the notification information to the predetermined destination depending on whether or not the subject information includes predetermined identification information.
- In the following, embodiments of the present invention will be described with reference to the accompanying drawings.
-
FIG. 1 is a diagram illustrating an example of a system configuration of a notification control system according to an embodiment; -
FIG. 2A andFIG. 2B are diagrams illustrating an arrangement example of beds and cameras according to the present embodiment; -
FIG. 3A andFIG. 3B are diagrams for explaining the sensing region according to the present embodiment; -
FIG. 4A throughFIG. 4D are diagrams illustrating examples of detection patterns according to the present embodiment; -
FIG. 5 is a diagram illustrating an example of a hardware configuration of a notification control device according to the present embodiment; -
FIG. 6A andFIG. 6B are diagrams illustrating examples of a hardware configuration of an information collection device according to the present embodiment; -
FIG. 7 is a diagram illustrating an example of a functional configuration of a notification control system according to the present embodiment; -
FIG. 8A andFIG. 8B are diagrams illustrating examples of information managed by the notification control device according to the present embodiment; -
FIG. 9 is a flowchart illustrating an example of a notification control process according to a first embodiment; -
FIG. 10 is a sequence diagram illustrating an example of a display control process according to the first embodiment; -
FIG. 11 is a flowchart illustrating an example of a process for providing a response information according to the first embodiment; -
FIG. 12 is a flowchart illustrating an example of a sound discrimination process according to a second embodiment; -
FIG. 13 is a diagram illustrating an example of a display screen according to the second embodiment; -
FIG. 14A throughFIG. 14D are diagrams for explaining a correction process of a detection frame according to the third embodiment; and -
FIG. 15 is a flowchart illustrating an example of the correction process of the detection frame according to the third embodiment. - For instance, in such medical facilities, nursing care facilities, and the like, a system may be considered to detect a status of bed users (patients or the like), such as getting out of the bed and returning to bed, by using temperature image data captured by thermo-cameras, or the like installed around the bed, and may inform the nurse call system or the like of a status of the users. For example, the temperature image data may be used to sense temperature and a size of an area corresponding to a user, to estimate a user's condition, and to inform the nurse call system of the user's condition based on estimation results. Thus, for example, it is possible to implement a notification control system, which facilitates securing a privacy of a bed user and detects a status of the user at night after lights are turned off.
- However, in this method, after the user has left bed, for example, when a health care worker comes to the bed or the area around the bed, the user may be misidentified as having returned to the bed and notified to the nurse system.
- In order to prevent such erroneous detection, it is also possible to assume, for example, that the user has returned to the bed after the temperature and the size of the area corresponding to a person has been detected around the bed and after the user has been moved to the bed and a predetermined period of time has elapsed. However, the method for determining the status of the user over time has a problem in which notification to the nurse call system is delayed in an event of an accident or the like occurring to the bed user.
- As described above, in a notification control device that notifies a predetermined destination of the status of the user based on the temperature image data captured within a predetermined capturing range, it has been difficult to reduce an error notification while suppressing a delay of a notification indicating the status of the user.
- One embodiment of the present invention will be presented in view of the above-described problems, and in a notification control device that notifies a predetermined destination of a status of a user based on temperature image data captured within a predetermined capturing range, an error notification is reduced while suppressing a delay of a notification indicating the status of the user.
- In the following, an embodiment according to the present invention will be described with reference to the accompanying drawings.
-
FIG. 1 is a diagram illustrating an example of a system configuration of a notification control system according to an embodiment. Thenotification control system 100 includes a plurality ofinformation collection devices 102 a to 102 f installed in aninpatient ward 110, which is an example of a facility such as a medical facility or a nursing facility, and anotification control device 101 communicatively connected to the plurality ofinformation collection devices 102 a to 102 f via anetwork 104. - Incidentally, in the following description, when any of the plurality of
information collection devices 102 a to 102 f is represented, the “information collection device 102” is referred to. Further, the number of theinformation collection devices 102 illustrated inFIG. 1 is an example, and one or moreinformation collection devices 102 may be included in thenotification control system 100. - The
information collection device 102 includes a short-range wireless module for receiving identification information transmitted from a thermo-camera for capturing temperature image data indicative of a temperature of a subject and a Bluetooth Low Energy (hereinafter referred to as BLE) tag. Theinformation collector 102 may also be referred to as a watch-over camera, simply a camera, or the like. - A thermo-camera is an imaging device that converts infrared radiation from a measurement object to temperature information by imaging the infrared radiation, and visualizes a temperature distribution by color or the like. The thermo-camera is sometimes referred to as a thermographic camera, a thermography, a thermo-vision, a thermo-viewer, or the like.
- In the example of
FIG. 1 , the plurality ofinformation collection devices 102 a to 102 f are mounted on walls, ceilings, or the like for a plurality ofbeds 103 a to 103 f provided in rooms A to F, respectively. For example, theinformation collection device 102 a is mounted on a wall corresponding to thebed 103 a provided in the room A and is positioned so as to be able to capture temperature image data representing a temperature of a subject on thebed 103 a and around thebed 103 a (a predetermined capturing range). - The
information collection device 102 a photographs the temperature image data of thebed 103 a and around thebed 103 a at a predetermined frame rate (for example, 5 fps to 1 fps or the like) using the thermo-camera. - In this embodiment, a medical practitioner (for instance, physician, nurse, caregiver, or the like) working at the facility has a BLE tag that transmits identification information identifying the medical practitioner. The
information collection device 102 a receives identification information (hereinafter, referred to as a wireless ID) transmitted from the BLE tag possessed by the medical practitioner who works in a facility using a short-range radio module (hereinafter, simply referred to as the “medical practitioner”). - The medical practitioner may include a variety of staff working at the institution. The temperature image data acquired by the thermo-camera may be image data captured at predetermined time intervals (for example, 10 seconds to 60 seconds). In addition, the short-range wireless module may receive the wireless ID transmitted from a wireless tag other than the BLE tag, such as an active tag of a Radio Frequency Identity (RFID) instead of the BLE tag.
- In the above-described configuration, the
information collection device 102 a transmits user information including captured temperature image data to thenotification control device 101 through thenetwork 104. The user information includes identification information for identifying thecollection device 102 a and thebed 103 a (for example, an IP address, a device ID, a bed ID, and the like). When theinformation collection device 102 a receives the wireless ID, the user information includes the received wireless ID. - Similarly, other
information collection devices 102 b to 102 f transmit user information including the temperature image data capturing the bed and the periphery of the bed, the received wireless ID, and the like to thenotification control device 101 via thenetwork 104. - The
notification control device 101 is regarded as an information processing device having a computer configuration or a system including a plurality of information processing devices. Thenotification control device 101 receives the user information transmitted from theinformation collection device 102 and notifies a predetermined destination, such as anurse call system 121, of the notification information indicating the status of the user who uses the bed based on the received user information. - For example, the
notification control device 101 detects a temperature change of a predetermined pattern in one or more sensing regions preset in the capturing range by using the temperature image data included in the user information. Upon detecting the temperature change of a predetermined pattern, thenotification control device 101 notifies thenurse call system 121 of the notification information including the notification contents (for example, information indicating the state of the user, the temperature image data, and the like) corresponding to the detected temperature change. - Moreover, the
notification control device 101 according to the present embodiment includes a function for stopping a process of notifying the notification information to thenurse call system 121 according to whether or not the user information includes a predetermined wireless ID. - For example, the
notification control device 101 detects that a user of thebed 103 a has left thebed 103 a, by using the temperature image data included in the user information, and sends return information indicating that the user has returned to a predetermined destination when the user returns to thebed 103 a. However, with temperature image data, it is difficult to determine whether a person returning is the user using thebed 103 a, a medical practitioner, or the like. - Accordingly, as an example, when the received user information includes a pre-registered wireless ID of a medical practitioner or a staff of the facility or a wireless ID of a person from outside of the facility (such as a contracted person allowed to enter such as a cleaner, or the like), the
notification control device 101 determines that the person returning is the medical practitioner, or the like, and stops the process of notifying the notification information to thenurse call system 121. By the above described control, it is possible to reduce a possibility that notification to thenurse call system 121 will be erroneously made in a case in which, for example, a bed user of wheelchair returns to thebed 103 a with a staff of the facility or in a case of a bed making by a medical practitioner or the like. - As another example, if the received user information does not include the wireless ID of the bed user, the
notification control device 101 may determine that the person returning is not the bed user and may stop the process of notifying the notification information to thenurse call system 121. - As another example, the user may attach a BLE tag to a tray or a container used for meals or the like, and even if a user is detected in a predetermined area on a bed as described below, when the received user information includes the wireless ID of the BLE tag, the process of notifying information to the
nurse call system 121 may be suspended. - Next, an example will be described that when the user information includes a wireless ID of such as a medical practitioner, a facility employee, or a person from outside of the facility, the
notification control device 101 stops the process of notifying the notification information to thenurse call system 121. Wireless IDs of a pre-registered medical practitioner, a facility staff, a person from outside of the facility, and wireless IDs of bed users are examples of predetermined identification information. - The
nurse call system 121 is an information processing apparatus including a computer configuration or a system including a plurality of information processing apparatus, and is an example of a predetermined destination to which thenotification control apparatus 101 sends the notification information. Thenurse call system 121 displays the calling information by a user (for example, a patient, a cared person, or the like) using thebed 103 ondisplay devices 122 a to 122 c installed in nurse stations A to C, and aninformation terminal 123 possessed by a staff such as a nurse and a caregiver. - The
nurse call system 121 according to the present embodiment is connected to thenotification control device 101 through thenetwork 104, and receives notification information that is sent from thenotification control device 101 as depicted inFIG. 1 . Moreover, thenurse call system 121 may display a display screen for notifying a status of a user on the basis of the received notification information on thedisplay devices 122 a to 122 c, theinformation terminal 123, or the like. - A plurality of
display devices 122 a to 122 c are regarded as display devices provided in the nurse stations A to C or the like to display a display screen transmitted from thenurse call system 121. - The
information terminal 123 is an information terminal such as a smartphone, a tablet terminal, a notebook, a Personal Computer (PC), or the like possessed by a nurse, caregiver, or the like. Theinformation terminal 123 is able to communicate with thenurse call system 121, for example, by wireless communication, and is able to display a display screen transmitted from thenurse call system 121 by executing a predetermined application. -
FIG. 2A andFIG. 2B are diagrams illustrating an arrangement example of beds and cameras according to the present embodiment. This embodiment can be applied where a plurality ofbeds 103 are provided in aroom 111, as illustrated inFIG. 2A andFIG. 2B , for example. - For example, as illustrated in
FIG. 2A , theinformation collection device 102 is mounted on a wall or the like in order to acquire image data of thebed 103 and the periphery of thebed 103 corresponding to theinformation collection device 102. Theinformation collection device 102 may be installed on a ceiling of aroom 111. -
FIG. 2B illustrates theroom 111 viewed from above. Theinformation collection device 102 is positioned so that a thermo-camera is able to be used to capture the temperature image data of apredetermined capturing range 201 including an area of thebed 103 and the periphery of thebed 103 corresponding to theinformation collection device 102. - In addition, the
information collection device 102 is adjusted to be capable of receiving radio waves transmitted by the BLE tag located in acommunication range 202 including thebed 103 and a periphery of thebed 103, and of acquiring a wireless ID included in the radio waves by using a short-range radio module. - Each of medical practitioners possesses a BLE tag that transmits the wireless ID identifying the medical practitioner. The BLE tag can control a communication distance by an intensity of the radio wave to be transmitted. For example, the intensity of the radio wave to be transmitted is set so that the communication distance is about 3 m to 4 m.
-
FIG. 3A andFIG. 3B are diagrams for explaining the sensing region according to the present embodiment. Thenotification control device 101 manages one or more sensing regions preset within thecapturing range 201 of theinformation collection device 102. - For example, a
detection frame 301 including a plurality ofsmall areas 302 is set in thecapturing range 201 of theinformation collection device 102 as illustrated inFIG. 3A . In the example ofFIG. 3A , there are 25small areas 302 identified in columns A to E androws 1 to 5 within thedetection frame 301. - As illustrated in
FIG. 3B , an attention area B is represented by “C3” indicating a position of a small area. An attention area C is represented by “B2, C2” and “B4, C4” indicating positions of a plurality of small areas. Thereby, thenotification control apparatus 101 is able to easily detect a temperature change in one or more sensing regions. -
FIG. 4A throughFIG. 4D are diagrams illustrating examples of detection patterns according to the present embodiment. Thenotification control device 101 detects a temperature change of a predetermined pattern in one or more sensing regions set in thecapturing range 201 by using temperature image data included in user information received from theinformation collection device 102. - As a preferred example, the
notification control device 101 senses a position of auser 401 using thebed 103 by a temperature of ahead 402 of theuser 401. Of the body of theuser 401, thehead 402 is less likely to be covered with, for example, clothing or blankets, and the facial portion is less susceptible to an influence of hairs; hence, it is suitable for sensing the position of theuser 401. - For example, in the temperature image data included in the user information, the
head 402 of theuser 401 is represented by a different temperature (different color from the other portions) than the other portions, as illustrated inFIG. 4A . Accordingly, thenotification control device 101 can detect a position of theuser 401 by detecting an area corresponding to a predetermined temperature (for example, 30° C. to 40° C.) and the size of thehead 402 from the temperature image data. - In the example of
FIG. 4A , as an example of the detection pattern, a detection pattern is shown when thehead 402 of theuser 401 moves to an attention area A410 defined inFIG. 3A andFIG. 3B . If thehead 402 of theuser 401 moves to the attention area A410, thenotification control device 101 determines, for example, that theuser 401 is at risk of falling from thebed 103. In this case, thenotification control device 101 notifies the predetermined destination, such as thenurse call system 121, of the notification information indicating that theuser 401 is at risk of falling from thebed 103. This notification information includes falling warning information indicating thatuser 401 may fall frombed 103, a bed ID identifying thebed 103, temperature image data determined to be dangerous, current temperature image data, and the like. -
FIG. 4B illustrates another example of the detection pattern in which theuser 401 falls from thebed 103. For example, it is assumed that thehead 402 of theuser 401, which is detected in any of the attention areas A to C defined inFIG. 3A andFIG. 3B , moves to the fallingdetection area 420 and remains in the fallingdetection area 420 for a predetermined time. In this case, thenotification control device 101 determines that theuser 401 has fell from thebed 103. In this case, thenotification control device 101 sends the notification information including the falling detection information indicating that theuser 401 has fell from the bed, to a predetermined destination such as anurse call system 121. -
FIG. 4C illustrates another example of a sensing pattern of detection that auser 401 using thebed 103 leaves thebed 103. For example, if thehead 402 of theuser 401, which was sensed on thebed 103, is detected in the fallingdetection area 420 and is no longer sensed in thedetection frame 301 within a predetermined time, thenotification control device 101 determines that the user has been released from bed. In this case, thenotification control device 101 sends the notification information including leaving detection information indicating that theuser 401 has left thebed 103 to the predetermined destination such as anurse call system 121. -
FIG. 4D illustrates another example of the detection pattern of detecting that theuser 401 using thebed 103 returns to the bed 103 (hereinafter referred to as “returning”). For example, suppose auser 401 that was not detected in thedetection frame 301 had returned to thebed 103 or around thebed 103. In this case, for example, as depicted inFIG. 4D , thehead 402 of theuser 401 is sensed in the fallingdetection area 420. However, with this alone, thenotification control device 101 cannot determine whether a person detected in the fallingdetection area 420 is theuser 401 of thebed 103 or a staff of the facility. - Accordingly, the
notification control device 101 determines that the person detected in thefall detection area 420 is theuser 401 of thebed 103 in a case in which the wireless ID of the medical practitioner is not included in information received from theinformation collection device 102. Theinformation collection device 102 notifies the predetermined destination such as thenurse call system 121 of the notification information including returning detection information indicating that theuser 401 has returned to thebed 103. Meanwhile, when the wireless ID of the medical practitioner is included in the user information received from theinformation collection device 102, thenotification control device 101 determines that the person detected in thefall detection area 420 is the medical practitioner, and stops a process of transmitting the notification information to the predetermined destination. - By the above described control, when the
user 401 returning to thebed 103 is collapsed in thefall detection area 420, for example, as depicted inFIG. 4B with hands or feet of theuser 401 slipped, thenotification control device 101 is able to immediately determine that theuser 401 is present in thefall detection area 420. In addition, when a medical practitioner is working in the fallingdetection area 420 or the like, thenotification control device 101 is able to stop the process of transmitting the notification information to the predetermined destination, and thus, it is possible to reduce an error notification to the notification destination. - As described above, according to the present embodiment, in the
notification control device 101 that notifies the predetermined destination of a status of a user based on temperature image data captured in thepredetermined capturing range 201, it is possible to reduce the error notification while suppressing a delay of a notification indicating the status of the user. - Next, hardware configurations of the
notification control device 101 and theinformation collection device 102 will be described. -
FIG. 5 is a diagram illustrating an example of a hardware configuration of the notification control device according to the present embodiment. Thenotification control device 101 includes a typical computer configuration such as a Central Processing Unit (CPU) 501, Random Access Memory (RAM) 502, Read Only Memory (ROM) 503, astorage device 504, a network I/F (Interface) 505, aninput device 506, adisplay device 507, an external I/F 508, and abus 509. - The
CPU 501 is an arithmetic unit which realizes functions of thenotification control device 101 by reading out a program or data stored in theROM 503 or thestorage device 504 to theRAM 502 and by performing various processes.RAM 502 is a volatile memory used as a work area or the like ofCPU 501.ROM 503 is a non-volatile memory which maintains programs and data even when power is turned off. - The
storage device 504 may be, for example, a mass storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores, for example, an Operating System (OS), application programs, various data, and the like. - The network I/
F 505 is a communication interface for connecting thenotification control device 101 to thenetwork 104. Theinput device 506 is a pointing device such as a mouse or an input device such as a keyboard and is used to operate to input various information items to thenotification control device 101. Thedisplay device 507 is a device to display process results or the like acquired by thenotification control device 101. - The external I/
F 508 is an interface for connecting external devices. Each of the external devices includes, for example, a recording medium or the like. For example, thenotification control device 101 stores a predetermined program in the recording medium and installs the program stored in the recording medium into thenotification control device 101 via the external I/F 508, thereby making the predetermined program executable. Thebus 509 is connected to each of the above described components (regarded as circuitries) and transmits address signals, data signals, various control signals, and the like. -
FIG. 6A andFIG. 6B are diagrams illustrating examples of a hardware configuration of the information collection device according to the present embodiment. Theinformation collection device 102 includes aCPU 601, amemory 602, a network I/F 603, a short-range wireless module 604, a thermo-camera 605, a Complementary Metal Oxide Semiconductor (CMOS)camera 606, amicrophone array 607, a Light Emitting Diode (LED) 608, and abus 609, as depicted inFIG. 6A . - The
CPU 601 is an arithmetic unit which implements functions of theinformation collection device 102 by executing a program stored in thememory 602. Thememory 602 includes one or more storage devices such as a RAM, a ROM, a flash ROM, and the like. The network I/F 603 is a communication interface for connecting theinformation collection device 102 to thenetwork 104. - The short-
range wireless module 604 includes an antenna, a wireless circuit, and communication control for communicating with a wireless tag such as a BLE tag, for example, by a short-range wireless communication such as BLE communication. - The thermo-
camera 605 is an imaging device that converts infrared radiation from a measurement subject to temperature information by imaging the infrared radiation, and visualizes a temperature distribution by color or the like as described in the description ofFIG. 1 . The thermo-camera 605 is provided in afront panel 610 or the like facing thebed 103, for example, as depicted inFIG. 6B , captures an image within thecapturing range 201 including an area of thebed 103 and the periphery of thebed 103, and outputs temperature image data. - The
CMOS camera 606 is an imaging device that captures typical photographic data. TheCMOS camera 606 is provided on thefront panel 610 or the like facing thebed 103, as depicted inFIG. 6B , for example, and captures photographic data in thecapturing range 201 including the area of thebed 103 and the periphery of thebed 103, and outputs photographic data taken. - A
microphone array 607 selectively acquires a predetermined range of voices by using multiple microphones. Themicrophone array 607 includes two or more microphones provided on, for example, thefront panel 610 opposite thebed 103, as depicted inFIG. 6B , for selectively acquiring voice data at thebed 103 and around thebed 103. As an example, themicrophone array 607 acquires audio within the same range as thecommunication range 202 of the short-range wireless module illustrated inFIG. 2 . - The
LED 608 is a light emitting element that emits light according to control from theCPU 601. TheLED 608 is an example of a display device provided by theinformation collection device 102 and blinks or illuminates, for example, in a color or a light emitting pattern specified by theCPU 601. Thebus 609 is connected to each of the above components and transmits address signals, data signals, various control signals, and the like. - Next, a functional configuration of the
notification control system 100 will be described. -
FIG. 7 is a diagram illustrating an example of a functional configuration of a notification control system according to the present embodiment. Thenotification control system 100 includes thenotification control device 101 connected to thenetwork 104 and one or moreinformation collection devices notification control device 101 is communicatively connected to thenurse call system 121, which is an example of the predetermined destination, for example, through thenetwork 104. InFIG. 7 , theinformation collection device 102 b includes the same functional configuration as theinformation collection device 102 a. - For example, the
notification control device 101 realizes acommunication unit 701, aninformation receiving unit 702, adetection unit 703, anotification control unit 704, anID managing unit 705, a responseinformation providing unit 706, adisplay control unit 707, avoice discrimination unit 708, a voiceinformation providing unit 709, acorrection unit 710, and astorage device 711 by executing a predetermined program in theCPU 501. At least one of the above-described circuitries may be implemented by hardware. - The
communication unit 701 is realized, for example, by a program executed in theCPU 501 ofFIG. 5 and the network I/F 505. Thecommunication unit 701 connects thenotification control device 101 to thenetwork 104 and communicates with theinformation collection device 102, thenurse call system 121, and the like. - For example, the
information receiving unit 702 is implemented by a program executed by theCPU 501 ofFIG. 5 . Theinformation receiving unit 702 receives user information (subject information) transmitted from the one or moreinformation collection devices 102 through thenetwork 104 and stores the information in thestorage device 711. - As described above, the user information includes information for identifying the
information collection device 102, thebed 103, or the like, and temperature image data acquired by capturing thecapturing range 201 including an area of thebed 103 and the periphery of thebed 103. When theinformation collection device 102 receives the wireless ID, the user information further includes the received wireless ID. - If necessary, the user information includes voice data acquired by a voice
data acquisition unit 725 at thebed 103 and around thebed 103. - The
detection unit 703 is implemented, for example, by a program executed in theCPU 501 ofFIG. 5 . Thedetection unit 703 detects a temperature change of a predetermined detection pattern in one or more sensing regions preset in thecapturing range 201 by using the temperature image data stored in thestorage device 711 by theinformation receiving unit 702. - For example, the
notification control device 101 previously storesdetection pattern information 712 as depicted inFIG. 8A in thestorage device 711 or the like. Thedetection unit 703 detects the temperature change of the detection pattern set to thedetection pattern information 712 in a detection area such as thedetection frame 301, the falling detection area, and the attention areas A to C described with reference toFIG. 3A andFIG. 3B . -
FIG. 8A is a diagram illustrating an example of thedetection pattern information 712 according to the present embodiment. In the example ofFIG. 8A , thedetection pattern information 712 includes information such as “detection pattern”, “notification contents”, and “temperature change” as items. - The item “detection pattern” indicates information such as a name, number, or identification information for identifying a detection pattern indicative of a pattern of temperature changes. The item “notification contents” indicates information representing notification contents to be sent to a predetermined destination upon detecting a “temperature change” corresponding to the “detection pattern”. The item “temperature change” indicates information representing a change in temperature detected in the detection area such as the
detection frame 301, the falling detection area, and the attention areas A to C corresponding to the “detection pattern”. - For example,
FIG. 8A depicts that the “temperature change” corresponding to the detection pattern “pattern 6” indicates a movement of a sensing target (for example, thehead 402 of the user 401) from an outside of thedetection frame 301 into thedetection frame 301. For example, thedetection unit 703 senses a temperature change in thedetection frame 301, the falling detection area, and the attention areas A to C. When the sensing target moves from the outside of thedetection frame 301 to an inside of thedetection frame 301, thedetection unit 703 senses a temperature change of “pattern 6” (an example of the predetermined detection pattern). - The
notification control unit 704 is implemented by, for example, a program executed by theCPU 501 ofFIG. 5 . Thenotification control unit 704 notifies a predetermined destination such as thenurse call system 121 of the notification information representing the state of theuser 401 of the bed 103 (the state of the subject), based on user information (information of the subject) received by theinformation receiving unit 702. - For example, the
notification control unit 704 notifies the predetermined destination of the notification information including “notification contents” corresponding to the “detection pattern” when thedetection unit 703 detects a temperature change of the predetermined detection pattern and when the user information (subject information) does not include the predetermined wireless ID. Here, the predetermined wireless ID is the wireless ID of the medical personnel working at the facility. - For example, in the
detection pattern information 712 illustrated inFIG. 8A , the temperature change of the detection pattern of the “pattern 6” is detected, and the user information does not include the predetermined wireless ID. In this case, thenotification control unit 704 notifies the predetermined destination of the notification information including the “notification contents” corresponding to the detection pattern “pattern 6” of the detection pattern information 712 (returning information indicating that a user has returned to a bed and the temperature image data of the bed and the periphery of the bed). - Meanwhile, the
notification control unit 704 detects the temperature change of the predetermined detection pattern by thesensing unit 703, and stops the processing of notifying information including “notification contents” corresponding to the “detection pattern” to a predetermined destination when the user information includes a predetermined wireless ID. - For example, the ID management unit (identification information management unit) 705 is implemented by a program executed by the
CPU 501 ofFIG. 5 . The ID management unit (identification information management unit) 705 stores in thestorage device 711 or the like and manages the wireless ID identifying the medical practitioner working in the facility. -
FIG. 8B is a diagram illustrating an example of theID management information 713 according to the present embodiment. In the example ofFIG. 8B , theID management information 713 includes information such as “WIRELESS ID”, “JOB TYPE”, “AFFILIATION”, “NAME”, and the like as items. - The item “WIRELESS ID” is regarded as identification information included in radio waves transmitted by the BLE tags possessed by a medical personnel working in the facility. The item “JOB TYPE” indicates information representing an occupation of a medical personnel corresponding to the “WIRELESS ID”. The item “AFFILIATION” refers to a place to which the medical personnel corresponding to the “WIRELESS ID” belongs. The item “NAME” indicates information representing a name, or the like of the medical personnel corresponding to the “WIRELESS ID”.
- Using the
ID management information 713, thenotification control device 101 may determine that a facility staff, a medical practitioner, or the like is near thebed 103 when the wireless ID received at thebed 103 or around thebed 103 is registered in theID management information 713. When the wireless ID received at thebed 103 and around thebed 103 is not registered in theID management information 713, thenotification control device 101 may determine that the staff of the facility, the medical practitioner, or the like is not near thebed 103. - A response information providing unit (first information providing unit) 706 is realized, for example, by a program executed in the
CPU 501 ofFIG. 5 . The responseinformation providing unit 706 uses the wireless ID included in the user information (subject information) received by theinformation receiving unit 702 to provide information for visualizing a response of the staff of the facility and the medical practitioner with respect to theuser 401 of thebed 103. - For example, the response
information providing unit 706 aggregates time at which the wireless ID of each medical practitioner is received in each of thebeds 103, and outputs or displays information visualized in tables, graphs, or the like to determine how much time each medical practitioner has spent to respond to theuser 401 of each of thebeds 103. - The information provided by the response
information providing unit 706 may include temperature image data capturing thebed 103 and the periphery of thebed 103. As a result, for example, when theuser 401 of thebed 103 is victimized by violence, abuse, or the like, the staff around thebed 103 and their response status are visualized, so that it is possible to expect an effect of preventing violence and abuse by the medical staff. - The
display control unit 707 is implemented, for example, by a program executed in theCPU 501 ofFIG. 5 and controls a display by a display device such as theLED 608, provided by theinformation collection device 102. - For example, the
display control unit 707 determines whether or not there is a medical practitioner at thebed 103 or around thebed 103 based on the wireless ID included in the information received by theinformation receiving unit 702. Thedisplay control unit 707 sends information indicating that there is a medical practitioner thebed 103 or around thebed 103, as an example to theinformation collection device 102, when there is a medical practitioner or the like at thebed 103 or around thebed 103. As another example, thedisplay control unit 707 may notify theinformation collection device 102 of control information indicating that theLED 608 blinks green when a medical practitioner or the like is present at thebed 103 or around thebed 103. - Accordingly, the
information collection device 102 flashes green on theLED 608, for example, when there is a medical practitioner at thebed 103 or around thebed 103. The green flashing of theLED 608 is an example of display information indicating that there is a medical practitioner at thebed 103 or around thebed 103. - Meanwhile, when there is no medical practitioner at the
bed 103 and around thebed 103, thedisplay control unit 707 notifies theinformation collection device 102 that there is no medical practitioner at thebed 103 and around thebed 103 as an example. As another example, thedisplay control unit 707 may notify theinformation collection device 102 of control information indicating that theLED 608 does not blink green when there is no medical practitioner at thebed 103 and around thebed 103. - Accordingly, the
information collection device 102 does not cause theLED 608 to blink green when there is no medical practitioner at thebed 103 or around thebed 103. - The voice discrimination unit (discrimination unit) 708 is realized, for example, by a program executed by the
CPU 501 ofFIG. 5 , and determines a type of sound included in the voice data by using the temperature image data and the voice data included in the user information received by theinformation receiving unit 702. - For example, the
speech discrimination unit 708 calculates the sound magnitude of the voice data and analyzes the temperature image data when the sound magnitude is greater than or equal to the first threshold value to calculate an amount of a movement of theuser 401 using the bed 103 (for example, an amount of a movement of thehead 402 of the user 401). - The
voice discrimination unit 708, for example, determines that the type of sound is, for example, a user's groaning, when the magnitude of the sound data is more than or equal to a first threshold value and the amount of the movement of the user is more than or equal to a second threshold value. - However, the
voice discrimination unit 708 determines that the type of sound is, for example, a user's snoring, when the magnitude of the sound data is more than or equal to the first threshold value and the amount of movement of the user is less than the second threshold value. - The groaning and the snoring are examples of types of sounds determined by the
voice discrimination unit 708. For example, thevoice discrimination unit 708 may determine whether or not the type of the sound indicated in the voice data indicates a sound to be notified to the predetermined destination. - The voice information providing unit (second information providing unit) 709 is implemented by a program executed in the
CPU 501 ofFIG. 5 , for example, and outputs or displays information representing a determination result by thevoice discriminating unit 708. - Preferably, the information provided by the voice
information providing unit 709 includes temperature image data capturing thebed 103 or the periphery of thebed 103. Preferably, the voiceinformation providing unit 709 may output sound acquired at thebed 103 or around thebed 103 in accordance with an operation of an operator. - The
correction unit 710 is realized, for example, by a program executed in theCPU 501 ofFIG. 5 , and corrects a position of thedetection frame 301, the falling detection area, and the attention regions A to C set in thecapturing range 201 in accordance with a change of a location of thebed 103. - For example, if necessary, the
information collection device 102 is able to transmit image data (hereinafter, referred to as photographic data) on which thebed 103 is captured by theCMOS camera 606 to thenotification control device 101. Thecorrection unit 710 uses the received photographic data to specify the location of the bed 103 (for example, a contour), and corrects positions of thedetection frame 301, the falling sensing area, and the caution regions A to C in accordance with the location of thebed 103. - Preferably, when the
correction unit 710 is unable to correct the positions of thedetection frame 301, the falling sensing area, and the attention area A to C, thedisplay control unit 707 blinks theLED 608 of theinformation collection device 102, for example, in red. In this case, the facility staff, the medical practitioner, or the like determines that thebed 103 is not properly positioned, and adjusts thebed 103 to a correct position. - Thereafter, the
correction unit 710 again corrects the positions of thedetection frame 301, the falling sensing area, and the attention areas A to C, and terminates the red blinking of theLED 608 of theinformation collection device 102 when the positions are corrected. - The
storage device 711 is implemented by, for example, a program executed by theCPU 501 ofFIG. 5 and astorage device 504, aRAM 502, or the like, and stores thedetection pattern information 712, theID management information 713, and thearea information 310 described above. - The
information collection device 102 realizes, for example, acommunication unit 721, an imagedata acquisition unit 722, anID receiving unit 723, aninformation transmitting unit 724, voicedata acquisition unit 725, a photographicdata acquisition unit 726, and adisplay unit 727 by executing a predetermined program in theCPU 601. At least one of the above-described circuitries may be implemented by hardware. - The
communication unit 721 is realized, for example, by a program executed in theCPU 601 ofFIG. 6A , the network I/F 603, and the like, and communicates with thenotification control device 101 and the like by connecting theinformation collection device 102 to thenetwork 104. - The image
data acquisition unit 722 is realized, for example, by a program executed by theCPU 601, and captures the temperature image data of thebed 103 and around thebed 103 by using the thermo-camera 605 ofFIG. 6 . - The ID receiving unit (identification information receiving unit) 723 is implemented, for example, by a program executed by the
CPU 601, and receives a wireless ID from a BLE tag or the like at thebed 103 and around thebed 103 by using the short-range wireless module 604 ofFIG. 6 . - For example, the
information transmitting unit 724 is implemented by a program executed by theCPU 601, and transmits the user information including the temperature image data captured by the imagedata acquisition unit 722 to thenotification control device 101. - The user information includes information that identifies the
information collection device 102, thebed 103, or the like, as described above. When theID receiving unit 723 receives the wireless ID, the information of the user includes the wireless ID received by theID receiving unit 723. Theinformation transmitting unit 724 may, if necessary, transmit the voice data acquired by the voicedata acquisition unit 725, the photographic data acquired by the photographicdata acquisition unit 726, or the like to thenotification control device 101 included in the user information. - The voice
data acquisition unit 725 is implemented, for example, by a program executed by theCPU 601, and acquires the voice data at thebed 103 and around thebed 103 by using themicrophone array 607 ofFIG. 6 . - The photographic
data acquisition unit 726 is implemented, for example, by a program executed in theCPU 601 to capture photographic data of thebed 103 and the periphery of thebed 103 by using theCMOS camera 606 ofFIG. 6 . - The
display unit 727 is realized, for example, by a program executed in theCPU 601. TheLED 608 ofFIG. 6 emits light in a predetermined color, a blinking pattern, or the like to display predetermined information. For example, thedisplay unit 727 flashes green on theLED 608, for example, when there is a staff of the facility, a medical practitioner, or the like at thebed 103 and around thebed 103. When thecorrection unit 710 of thenotification control device 101 cannot correct the position of thedetection frame 301, thedisplay unit 727 causes theLED 608 to blink in red as an example. - Next, a process flow of a notification control method according to the present embodiment will be described.
-
FIG. 9 is a flowchart illustrating an example of a notification control process according to a first embodiment. This process inFIG. 9 illustrates an example of the notification control process performed when thenotification control device 101 receives user information transmitted from theinformation collection device 102. - Here, as an example, it is assumed that the
information collection device 102 transmits user information including temperature image data capturing thebed 103 and around thebed 103 and the bed ID identifying thebed 103 to thenotification control device 101 at a predetermined time interval. When theID receiving unit 723 receives the wireless ID, theinformation collection device 102 transmits the user information including the received wireless ID to thenotification control device 101. - In step S901, the
information receiving unit 702 of thenotification control device 101 receives the user information transmitted from theinformation collection device 102. - In step S902, the
information receiving unit 702 stores the temperature image data included in the received user information in thestorage device 711. - Preferably, at this time, the
information receiving unit 702 deletes the temperature image data after a predetermined storage period from thestorage device 711. - In step S903, the
detection unit 703 of thenotification control device 101 detects a temperature change of a predetermined detection pattern in one or more sensing regions by using the temperature image data stored in thestorage device 711. - For example, the
detection unit 703 detects the temperature change of the detection pattern set to thedetection pattern information 712 in the detection area such as thedetection frame 301, the falling detection area, and the attention areas A to C described inFIG. 3A andFIG. 3B . - In step S904, the
detection unit 703 of thenotification control device 101 determines whether or not the temperature change of the predetermined detection pattern is detected in step S903. - When the temperature change of the predetermined detection pattern is detected, the
notification control device 101 advances to step S905. However, when the temperature change of the predetermined detection pattern is not detected, thenotification control device 101 terminates this process. - When advancing to step S905, the
notification control unit 704 of thenotification control device 101 determines whether or not the wireless ID of the medical practitioner is included in the user information received by theinformation receiving unit 702. For example, when the wireless ID registered in theID management information 713 is included in the user information received by theinformation receiving unit 702, thenotification control unit 704 determines that the wireless ID of the medical practitioner is included in the user information. - When the wireless ID of the medical practitioner is not included in the user information, the
notification control unit 704 advances to step S906. However, when the wireless ID of the medical practitioner is included in the user information, thenotification control unit 704 stops the process of notifying the notification information to the predetermined destination and terminates this process. - When advancing to step S906, the
notification control unit 704 of thenotification control device 101 notifies a predetermined destination such as thenurse call system 121 of the notification information corresponding to the detected temperature change. - By the above-described process, for example, as illustrated in
FIG. 4D , when theuser 401 using thebed 103 moves into thedetection frame 301, it is possible for thenotification control unit 704 to immediately notify the predetermined destination of the notification information indicating that theuser 401 has returned to thebed 103. - In
FIG. 4D , when a person who moved within thedetection frame 301 is a medical practitioner, it is possible for thenotification control device 101 to abort the process of notifying the notification information to the predetermined destination. - As described above, according to the present embodiment, in the
notification control device 101 that notifies the predetermined destination of the status of the user based on the temperature image data captured within the predetermined capturing range, it is possible to reduce the error notification while suppressing the delay of the notification indicating the status of the user. -
FIG. 10 is a sequence diagram illustrating an example of a display control process according to the first embodiment. This process illustrates an example of the display control process in which thenotification control device 101 executes in parallel with the notification control process illustrated inFIG. 9 when the user information transmitted from theinformation collection device 102 is received. - In step S1001, the
information collection device 102 transmits user information including the temperature image data capturing thebed 103 and the periphery of thebed 103 to thenotification control device 101. - In step S1002, the
display control unit 707 of thenotification control device 101 checks whether or not the wireless ID (a predetermined ID) of the medical practitioner is included in the user information received from theinformation collection device 102. - Here, when the user information includes the wireless ID of the medical practitioner, processes of step S1011 and step S1012 are performed. However, when the user information does not include the wireless ID of the medical practitioner, the processes in step S1021 and step S1022 are performed.
- In step S1011, the
display control unit 707 of thenotification control device 101 notifies theinformation collection device 102 of information indicating that the medical practitioner is present in thebed 103 or around thebed 103 as an example. As another example, thedisplay control unit 707 may notify theinformation collection device 102 of control information indicating green blinking of theLED 608. - In step S1012, the
display unit 727 of theinformation collection device 102 blinks theLED 608 in green in response to information indicating that the medical practitioner is present or the control information indicating that theLED 608 blinks green received from thenotification control device 101. - However, in step S1021, as an example, the
display control unit 707 of thenotification control device 101 notifies theinformation collection device 102 of information indicating that there is no medical practitioner at thebed 103 or around thebed 103. As another example, thedisplay control unit 707 may notify theinformation collection device 102 of the control information indicating a stop of green blinking of theLED 608. - In step S1022, the
display unit 727 of theinformation collection device 102 does not cause theLED 608 to blink green in response to information received from thenotification control device 101 indicating an absence of a medical practitioner or control information indicating a stop of blinking of theLED 608 in green. For example, when theLED 608 is blinking in green, thedisplay unit 727 ends flashing in green. When theLED 608 is not blinking in green, thedisplay unit 727 maintains a present state. - Through the above process, the medical practitioner is able to check the
LED 608 of the nearbyinformation collection device 102 and to recognize that the BLE tag is in a fault or out-of-battery state, or that theID receiving unit 723 of theinformation collection device 102 is in a fault state in a case in which the LED is not blinking green. -
FIG. 11 is a flowchart illustrating an example of a process for providing a response information according to the first embodiment. This process represents an example of a process for providing the response information in order to visualize a response of a medical practitioner to theuser 401 of thebed 103. - In step S1101, the
information receiving unit 702 of thenotification control device 101 receives user information transmitted from theinformation collection device 102. - In step S1102, the response
information providing unit 706 of thenotification control device 101 determines whether or not a wireless ID (a predetermined ID) of the medical practitioner is included in the received user information. - When the wireless ID of the medical practitioner is included in the user information, the response
information providing unit 706 advances to step S1103. However, when the wireless ID of the medical practitioner is not included in the user information, the responseinformation providing unit 706 advances to step S1104. - When advancing to step S1103, the response
information providing unit 706 of thenotification control device 101 stores the wireless ID of the medical practitioner included in the user information in thestorage device 711 in association with thebed 103. For example, the responseinformation providing unit 706 stores in thestorage device 711 the wireless ID included in the user information in association with identification information identifying thebed 103, theinformation collection device 102, or the like. - Preferably, the information stored in the
storage device 711 by the responseinformation providing unit 706 is automatically erased after a certain period. - When advancing to step S1104, the response
information providing unit 706 of thenotification control device 101 determines whether or not a display request of response information is received from theinput device 506 or the like. - When the display request of the response information is not received, the
notification control device 101 returns the process to step S1101 and executes this process from step S1101 again. However, when the display request of the response information is received, the responseinformation providing unit 706 of thenotification control device 101 advances to step S1105. - When advancing to step S1105, the response
information providing unit 706 of thenotification control device 101 acquires information stored in thestorage device 711 and aggregates times each when the wireless ID of the medical practitioner is received at each ofbeds 103. By this aggregation, for example, a time length, in which the medical practitioner has stayed at each of thebeds 103 and around thebed 103, is calculated. - In step S1106, for example, the response
information providing unit 706 of thenotification control device 101 visually displays the response to theuser 401 by a medical practitioner for each of thebeds 103. - For example, the response
information providing unit 706 creates display information indicating how long it took for the medical practitioner to respond to theuser 401 for each of thebeds 103 based on the wireless ID of the medical practitioner designated in step S1104, and displays the created display information on thedisplay device 507 or the like. - As a preferred example, in the
bed 103 designated in step S1104, the responseinformation providing unit 706 may create display information including the information of the medical practitioner corresponding to theuser 401 and the temperature image data, and may display the created display information on thedisplay device 507 or the like. By this process, for example, it is possible to easily specify which medical practitioner made to theuser 401 in a case in which theuser 401 of thebed 103 was subjected to violence or abuse. - As described above, by the
notification control device 101 in accordance with the first embodiment, it is possible to visualize and provide (output, display, or the like) a response to auser 401 of eachbed 103 by a medical practitioner. - In a second embodiment, an example of a process, which is conducted when voice data at the
bed 103 and around thebed 103 are included in user information transmitted by theinformation collection device 102 to thenotification control device 101, will be described. -
FIG. 12 is a flowchart illustrating an example of a sound discrimination process according to a second embodiment. This process illustrates an example of a process in which avoice discrimination unit 708 of thenotification control device 101 determines a type of sound around thebed 103 and thebed 103. - In step S1201, the
information receiving unit 702 of thenotification control device 101 receives user information transmitted from theinformation collection device 102, and stores the user information in thestorage device 711. - In step S1202, the
voice discrimination unit 708 calculates a sound magnitude based on the voice data included in the user information. - In step S1203, the
voice discrimination unit 708 determines whether or not the sound magnitude in the voice data is greater than or equal to a first threshold value. For example, as the first threshold value, a value for determining whether or not a sound to be discerned is occurred at thebed 103 and around thebed 103 is set beforehand. - When the sound magnitude in the voice data is less than the first threshold value, the
voice discrimination unit 708 terminates this process. However, when the sound magnitude in the voice data is greater than or equal to the first threshold value, thevoice discrimination unit 708 advances to step S1205. - When advancing to step S1204, the
voice discrimination unit 708 calculates a movement amount of theuser 401 of the bed 103 (for example, a movement amount of thehead 402 of the user 401) using the temperature image data stored in thestorage device 711. As an example, the movement amount of theuser 401 is represented by a pixel movement amount or the like representing the temperature corresponding to thehead 402 of theuser 401 in the temperature image data. - In step S1205, the
voice discrimination unit 708 determines whether or not the movement amount of theuser 401 calculated in step S1204 is more than or equal to a second threshold value. The second threshold is preset, for example, to determine whether theuser 401 of thebed 103 is waking or sleeping. - When the movement amount of the
user 401 is equal to or greater than the second threshold, thevoice discrimination unit 708 determines a type of sound occurring at thebed 103 and around thebed 103, for example, as a groaning (step S1206). However, when the movement amount of theuser 401 is less than the second threshold value, thevoice discrimination unit 708 determines the type of sound occurring at thebed 103 and around thebed 103, for example, as a snoring (step S1207). - Based on a determination result, for example, the voice
information providing unit 709 of thenotification control device 101 may display adisplay screen 1300 as illustrated inFIG. 13 on thedisplay device 507. - Alternatively, the voice
information providing unit 709 may notify thedisplay screen 1300 to thenurse call system 121 or the like based on the determination result. For example, the voiceinformation providing unit 709 notifies a predetermined destination such as thenurse call system 121 of thedisplay screen 1300 depicted inFIG. 13 upon determining the type of sound to be a groaning voice in the sound discrimination process depicted inFIG. 12 . -
FIG. 13 is a diagram illustrating an example of a display screen according to the second embodiment. In the example ofFIG. 13 , for example, acharacter string 1301 representing a status of auser 401, atemperature image 1302 captured around thebed 103, avolume information 1303, aplay button 1304, and the like are displayed on thepicture screen 1300. - For example, as illustrated in
FIG. 13 , thecharacter string 1301 representing the state of theuser 401 displays a bed name identifying thebed 103, the state of theuser 401 of thebed 103, and the discrimination result by the sound discrimination process depicted inFIG. 12 . - The
temperature image 1302 taken around thebed 103 is displayed by using the temperature image data included in the user information received from theinformation collection device 102. -
Volume information 1303 visually indicates the loudness of sound around thebed 103. When theplay button 1304 is selected, the voiceinformation providing unit 709 plays back the sound acquired around thebed 103 by using the acquired voice data. - For example, in the first embodiment, when the
head 402 of theuser 401 is detected in the falling detection area, the attention areas A to C, or the like, thenotification control device 101 performs notification process to notify a predetermined destination of notification information indicating a status of theuser 401. Therefore, for example, if thehead 402 of theuser 401 does not move from a position depicted in atemperature image 1302 ofFIG. 13 , the notification information is not sent. - However, by combining the first embodiment and the second embodiment, for example, even in a case in which the
head 402 of theuser 401 does not move, thenotification control device 101 detects an abnormality of theuser 401 and notifies a predetermined destination of an occurrence of the abnormality. - In a third embodiment, a process related to a correction of a
detection frame 301 by thecorrection unit 710 of thenotification control device 101 will be described. - When the
information collection device 102 is installed on a wall or a ceiling of a hospital room, an accuracy of the detection process by thedetection unit 703 may be degraded when the location of thebed 103 is displaced from a predetermined position. Therefore, when a position of abed 103 is misaligned with respect to adetection frame 301 of theinformation collection device 102, thenotification control device 101 includes acorrection unit 710 for correcting the position of thedetection frame 301 according to the location of thebed 103. -
FIG. 14A throughFIG. 14D are diagrams for explaining the correction process of the detection frame according to the third embodiment. Theinformation collection device 102 according to the third embodiment includes a function of capturing photographic data of thebed 103 by using theCMOS camera 606 and transmitting the photographic data to thenotification control device 101. - For example, the photographic
data acquisition unit 726 of theinformation collector 102 acquires photographic data of thebed 103 and a periphery of thebed 103. Theinformation transmitting unit 724 transmits user information including the temperature image data acquired by the imagedata acquisition unit 722 and the photographic data acquired by the photographicdata acquisition unit 726 to thenotification control unit 101. - The
information transmitting unit 724 may transmit the photographic data to thenotification control unit 101 in addition to the user information. For example, theinformation collection device 102 may transmit the photographic data to thenotification control device 101 upon a request from thenotification control device 101 or transmit the photographic data to thenotification control device 101 at a predetermined time interval. -
FIG. 14A illustrates an image of aphotographic image 1401 and adetection frame 301 when thebed 103 is arranged at a predetermined place. From this state, for example, as illustrated inFIG. 14B , when the location of thebed 103 is displaced, thecorrection unit 710 of thenotification control device 101 detects that a location of thebed 103 has been displaced, for example, by detecting a contour of thebed 103 from thephotographic image 1401. - When detecting that the location of the
bed 103 is displaced, thecorrection unit 710 of thenotification control device 101 corrects the position of thedetection frame 301 according to the contour of thebed 103, for example, as depicted inFIG. 14C . - However, as illustrated in
FIG. 14D , if the location of thebed 103 is largely displaced, for example, thecorrection unit 710 of thenotification control device 101 does not detect the contour of thebed 103. Moreover, if the location of thebed 103 is largely displaced as described above, even though the contour of thebed 103 is detected, a portion of thedetection frame 301 may not be detectable. - In this case, the
correction unit 710 of thenotification control device 101 notifies that correction of thedetection frame 301 cannot be performed, for example, by flashing, in red, theLED 608 of theinformation collection device 102. Thus, for example, if theLED 608 of theinformation collection device 102 is flashing red, the medical practitioner around thebed 103 may determine that the location of thebed 103 is displaced and may adjust the position ofbed 103. The medical practitioner around thebed 103 may also recognize that the location of thebed 103 is correct if theLED 608 of theinformation collection device 102 is not blinking in red. -
FIG. 15 is a flowchart illustrating an example of the correction process of the detection frame according to the third embodiment. This process illustrates the example of the correction process of the detection frame performed when thenotification control device 101 corrects thedetection frame 301. - In step S1501, the
correction unit 710 of thenotification control device 101 acquires photographic data of thebed 103 transmitted from theinformation collection device 102. For example, thecorrection unit 710 acquires the photographic data included in the user information received by theinformation receiving unit 702. - In step S1502, the
correction unit 710 of thenotification control device 101 detects a location of thebed 103 from the photographic data of thebed 103. For example, thecorrection unit 710 analyzes the photographic data and extracts a contour of thebed 103. - In step S1503, the
correction unit 710 of thenotification control device 101 determines whether or not the location of thebed 103 is displaced with respect to thedetection frame 301. For example, as depicted inFIG. 14A , thecorrection unit 710 determines that the location of thebed 103 is not displaced when the contour of thebed 103 is correctly positioned with respect to thedetection frame 301 and thesmall area 302 within thedetection frame 301. However, as depicted inFIG. 14B , thecorrection unit 710 determines that the location of thebed 103 is displaced with respect to thedetection frame 301 and thesmall area 302 in thedetection frame 301 when the contour of thebed 103 is not correctly positioned. - When the location of the
bed 103 is not displaced, thecorrection unit 710 advances to step S1504. However, when the location of thebed 103 is displaced, thecorrection unit 710 advances to step S1505. - When advancing to step S1504, the
correction unit 710 of thenotification control device 101 notifies theinformation collection device 102 that the correction of thedetection frame 301 has been successful, and ends this process. Accordingly, when theLED 608 is blinking in red, theinformation collection device 102 controls theLED 608 to end blinking in red, and when theLED 608 is not blinking in red, theinformation collection device 102 maintains a state of theLED 608 not blinking in red. - However, when advancing from step S1503 to step S1505, the
correction unit 710 of thenotification control device 101 corrects the position of thedetection frame 301 according to the location of thebed 103, for example, as depicted inFIG. 14C . For example, thecorrection unit 710 adjusts thedetection frame 301 by moving, rotating, enlarging, or reducing thedetection frame 301, for the contour of thebed 103 with respect to thedetection frame 301 and thesmall area 302 within thedetection frame 301 to be positioned at a correct location. - In step S1506, the
correction unit 710 of thenotification control device 101 determines whether or not the correction of thedetection frame 301 was successful. For example, thecorrection unit 710 determines that the correction was successful when thedetection frame 301 and thesmall area 302 in thedetection frame 301 are detectable as illustrated inFIG. 14C . However, as depicted inFIG. 14D , when the contour of thebed 103 cannot be detected, or when a portion of thesmall area 302 in thedetection frame 301 and thedetection frame 301 cannot be detected, thecorrection unit 710 determines that the correction failed. - When the correction of the
detection frame 301 is successful, thecorrection unit 710 advances to step S1504. However, when the correction of thedetection frame 301 fails, thecorrection unit 710 advances to step S1507. - When advancing to step S1507, the
correction unit 710 of thenotification control device 101 notifies theinformation collection device 102 that the correction of thedetection frame 301 has failed and returns to step S1501. Accordingly, when theLED 608 is not blinking in red, theinformation collection device 102 controls theLED 608 to start blinking in red, and when theLED 608 is blinking in red, theLED 608 continues blinking in red. - The above process allows the medical practitioner to easily determine that the
bed 103 is displaced and to correct the location of thebed 103. - According to the above described embodiments of the present invention, in a notification control device that notifies a predetermined destination of a status of a user based on temperature image data captured within a predetermined capturing range, it is possible to reduce error notifications while suppressing a delay of a notification indicating the status of the user.
- The present invention can be implemented in any convenient form, for example using dedicated hardware, or a mixture of dedicated hardware and software. The present invention may be implemented as computer software implemented by one or more networked processing apparatuses. The network can comprise any conventional terrestrial or wireless communications network, such as the Internet. The processing apparatuses can comprise any suitably programmed apparatuses such as a general purpose computer, personal digital assistant, mobile telephone (such as a WAP or 3G-compliant phone) and so on. Since the present invention can be implemented as software, each and every aspect of the present invention thus encompasses computer software implementable on a programmable device.
- The computer software can be provided to the programmable device using any storage medium for storing processor readable code such as a floppy disk, a hard disk, a CD ROM, a magnetic tape device or a solid state memory device.
- The hardware platform includes any desired kind of hardware resources including, for example, a processor such as a central processing unit (CPU), a random access memory (RAM), and a hard disk drive (HDD). The CPU may be implemented by any desired kind of any desired number of processors. The RAM may be implemented by any desired kind of volatile or non-volatile memory. The HDD may be implemented by any desired kind of non-volatile memory capable of storing a large amount of data. The hardware resources may additionally include an input device, an output device, or a network device, depending on the type of the apparatus. Alternatively, the HDD may be provided outside of the apparatus as long as the HDD is accessible. In this example, the CPU, such as a cache memory of the CPU, and the RAM may function as a physical memory or a primary memory of the apparatus, while the HDD may function as a secondary memory of the apparatus.
Claims (15)
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018185999 | 2018-09-28 | ||
JPJP2018-185999 | 2018-09-28 | ||
JP2018-185999 | 2018-09-28 | ||
JP2019098711A JP7480475B2 (en) | 2018-09-28 | 2019-05-27 | Notification control system, notification control method, and program |
JP2019-098711 | 2019-05-27 | ||
JPJP2019-098711 | 2019-05-27 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200103286A1 true US20200103286A1 (en) | 2020-04-02 |
US11513007B2 US11513007B2 (en) | 2022-11-29 |
Family
ID=69947863
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/582,366 Active 2040-01-28 US11513007B2 (en) | 2018-09-28 | 2019-09-25 | Notification control device, notification control system, and notification control method |
Country Status (1)
Country | Link |
---|---|
US (1) | US11513007B2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11223802B2 (en) | 2019-07-31 | 2022-01-11 | Ricoh Company, Ltd. | Image-based determination apparatus and image-based determination system |
US11346938B2 (en) | 2019-03-15 | 2022-05-31 | Msa Technology, Llc | Safety device for providing output to an individual associated with a hazardous environment |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100286997A1 (en) * | 2009-04-09 | 2010-11-11 | Rajagopal Srinivasan | Handheld Medical Information Management Device |
US20150109442A1 (en) * | 2010-09-23 | 2015-04-23 | Stryker Corporation | Video monitoring system |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6328712B1 (en) * | 1996-02-28 | 2001-12-11 | Smisson-Cartledge Biomedical Corporation | Rapid infusion system |
US20030204909A1 (en) * | 2001-04-06 | 2003-11-06 | Lane Stephen S. | Bed air bag deterrent system |
US8262583B1 (en) * | 2002-05-11 | 2012-09-11 | Terry Keith Bryant | Incentive spirometry devices by the employment of verbal simulated humanlike voices and using a tilt sensing component for ensuring patient actual use of the improved incentive spirometry devices |
CA2695728A1 (en) * | 2007-08-06 | 2009-02-12 | Ohio Medical Corporation | Wound treatment system and suction regulator for use therewith |
US20130046543A1 (en) * | 2011-07-22 | 2013-02-21 | Seton Healthcare Network | Interactive voice response (ivr) system for error reduction and documentation of medical procedures |
JP5850572B2 (en) | 2012-03-30 | 2016-02-03 | 株式会社ケアコム | Nurse call system |
US20180144307A1 (en) * | 2016-11-18 | 2018-05-24 | Alan West | Notification system |
US11894123B2 (en) * | 2017-04-05 | 2024-02-06 | Sensus Healthcare, Inc. | Radiotherapy mobile and wireless device workflow management system |
US10553099B2 (en) | 2017-08-07 | 2020-02-04 | Ricoh Company, Ltd. | Information providing apparatus and information providing system |
WO2019142370A1 (en) * | 2018-01-16 | 2019-07-25 | アイホン株式会社 | Nurse call system |
-
2019
- 2019-09-25 US US16/582,366 patent/US11513007B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100286997A1 (en) * | 2009-04-09 | 2010-11-11 | Rajagopal Srinivasan | Handheld Medical Information Management Device |
US20150109442A1 (en) * | 2010-09-23 | 2015-04-23 | Stryker Corporation | Video monitoring system |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11346938B2 (en) | 2019-03-15 | 2022-05-31 | Msa Technology, Llc | Safety device for providing output to an individual associated with a hazardous environment |
US11223802B2 (en) | 2019-07-31 | 2022-01-11 | Ricoh Company, Ltd. | Image-based determination apparatus and image-based determination system |
Also Published As
Publication number | Publication date |
---|---|
US11513007B2 (en) | 2022-11-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11363966B2 (en) | Detecting unauthorized visitors | |
US11544953B2 (en) | Methods and systems for identifying the crossing of a virtual barrier | |
JP6839205B2 (en) | Automated procedure determination and judgment generation | |
CN112640427B (en) | User interface for configuring a thermal imaging system | |
US9524443B1 (en) | System for determining whether an individual enters a prescribed virtual zone using 3D blob detection | |
US11443602B2 (en) | Methods and systems for detecting prohibited objects | |
EP3170125B1 (en) | Occupancy detection | |
US11513007B2 (en) | Notification control device, notification control system, and notification control method | |
JP6119938B2 (en) | Image processing system, image processing apparatus, image processing method, and image processing program | |
US20200135002A1 (en) | Information providing apparatus, information providing method and information providing system | |
JP7480475B2 (en) | Notification control system, notification control method, and program | |
JPWO2019216045A1 (en) | System and system control method | |
JP2011005171A (en) | Uprising monitoring device | |
JP7327396B2 (en) | Control program, report output method, and report output device | |
WO2020003954A1 (en) | Program executed by computer, information processing device, and method executed by computer | |
JP2020194392A (en) | Program for notifying of information, information notification device, and method executed by computer for notifying of information | |
JP7293895B2 (en) | Method and program for linking two systems, and information processing system | |
JP2023000589A (en) | Information processing system, information processor, control method, and control program | |
WO2019244647A1 (en) | Computer-executable program, information processing device, and computer-executable method | |
WO2018135316A1 (en) | Nurse call system | |
JP2020057222A (en) | Status monitoring device and status monitoring method | |
JP2020184201A (en) | Information reporting program, information processing device, and method to be executed by computer in order to report information | |
JP2021140422A (en) | Monitoring system, monitoring apparatus, and monitoring method | |
JP2020135063A (en) | Surveillance device and program for surveillance device | |
JP2020014738A (en) | Information processing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: RICOH COMPANY, LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:IKEDA, HAJIMU;ATSUMI, TOSHIHIRO;KOMOTO, SHOTARO;REEL/FRAME:050487/0337 Effective date: 20190917 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |