JP2019030628A - Information providing apparatus, information providing system, information providing method, and program - Google Patents

Abstract

To appropriately grasp situations of a user who uses a bed in facilities such as a medical facility and a nursing facility.SOLUTION: An information providing apparatus providing information about a user who uses a bed installed in a facility has: a collection part collecting image data from an acquisition device acquiring image data showing temperatures of the bed and around the bed; a detection part which detects a change of temperatures in the bed and one or more detection areas preset around the bed by using the image data collected by the collection part; and a notification part which notifies a prescribed notification destination of the user information when it is detected by the detection part that a change of temperature shown by the image data in the detection area shows a change of temperature of a preset content.SELECTED DRAWING: Figure 7A

Description

  The present invention relates to an information providing apparatus, an information providing system, an information providing method, and a program.

  A user who indicates the situation of a user who uses a bed installed in a facility such as a medical facility or a nursing facility (for example, that he / she has left the bed, has fallen from the bed, is likely to fall off the bed, etc.) There is an information providing device that provides the information.

  For example, by using a plurality of weight detection elements that are provided in the lower part of the bed for caregiving and detect the weight, it is determined whether or not the caregiver should be cared for, and this should be indicated when the caregiver should be cared for. Nursing care support devices for displaying are known (see, for example, Patent Document 1).

  The technique disclosed in Patent Document 1 requires a special bed equipped with a weight detection element, and causes a false detection due to a malfunction or failure of the sensor. It will not be possible to sufficiently reduce the burden of nighttime patrol work.

  Moreover, in a system using a normal surveillance camera, for example, a nurse or a caregiver needs to monitor the image of the surveillance camera. There is a problem that it is difficult to confirm the situation.

  As described above, in the conventional technique, it has been difficult to accurately grasp the situation of the user who uses the bed installed in the facility, such as a medical facility or a nursing facility.

  The embodiment of the present invention has been made in view of the above problems, and accurately grasps the situation of a user who uses a bed installed in a facility such as a medical facility or a nursing facility. To be able to.

  In order to solve the above-described problem, an information providing apparatus according to an embodiment of the present invention is an information providing apparatus that provides information on a user who uses a bed installed in a facility, the bed and the bed. The acquisition unit that acquires the image data indicating the ambient temperature, the collection unit that collects the image data, and the image data collected by the collection unit are used to set the bed and the periphery of the bed in advance. The detection unit that detects a change in temperature in two or more detection regions, and the detection unit detects that a change in temperature indicated by the image data in the detection region indicates a change in temperature of a preset content. A notification unit that notifies the user's information to a predetermined notification destination.

  According to the embodiment of the present invention, in a facility such as a medical facility or a care facility, it is possible to accurately grasp the situation of a user who uses a bed installed in the facility.

It is a figure which shows an example of the system configuration | structure of the information provision system which concerns on one Embodiment. It is a figure which shows another example of the system configuration | structure of the information provision system which concerns on one Embodiment. It is a figure which shows an example of the arrangement | positioning of the bed which concerns on one Embodiment, and a camera. It is a figure which shows an example of the detection area which concerns on one Embodiment. It is a figure (1) which shows the example of the detection pattern concerning one embodiment. It is a figure (2) showing an example of a detection pattern concerning one embodiment. It is a figure which shows the example of the hardware constitutions of the information provision apparatus which concerns on one Embodiment. It is a figure which shows an example of a function structure of the information provision system which concerns on one Embodiment. It is a figure which shows another example of a function structure of the information provision system which concerns on one Embodiment. It is a figure which shows the example of the information which the information provision apparatus which concerns on one Embodiment manages. It is a flowchart which shows the example of a process of the information provision apparatus which concerns on 1st Embodiment. It is a sequence diagram which shows the example of a process of the information provision system which concerns on 1st Embodiment. It is a figure for demonstrating the example of the detection process which concerns on 2nd Embodiment. It is a flowchart which shows the example of the detection process which concerns on 2nd Embodiment. It is a flowchart which shows the example of the detection process which concerns on 3rd Embodiment. It is a figure for demonstrating the detection process which concerns on 3rd Embodiment. It is FIG. (1) for demonstrating the correction process which concerns on 4th Embodiment. It is FIG. (2) for demonstrating the correction process which concerns on 4th Embodiment. It is a figure which shows the example of the system configuration | structure of the information provision system which concerns on 5th Embodiment. It is a figure which shows the example of a function structure of the information provision system which concerns on 5th Embodiment. It is a figure for demonstrating the detection frame which concerns on 5th Embodiment, and log information. It is a flowchart which shows the example of the transmission process of the log information which concerns on 5th Embodiment. It is a flowchart which shows the example of the process of the external server which concerns on 5th Embodiment. It is a figure (1) for demonstrating the example of the analysis result which concerns on 5th Embodiment. It is FIG. (2) for demonstrating the example of the analysis result which concerns on 5th Embodiment. It is a figure (3) for demonstrating the example of the analysis result which concerns on 5th Embodiment.

  Embodiments of the present invention will be described below with reference to the accompanying drawings.

<System configuration>
FIG. 1A is a diagram illustrating a configuration example of an information providing system according to an embodiment. For example, the information providing system 100 is connected to a plurality of cameras 102a to 102f installed in an inpatient ward 110, which is an example of a facility such as a medical facility or a nursing facility, and a plurality of cameras 102a to 102f via a network 104. Information providing apparatus 101.

  Note that the number of cameras 102 illustrated in FIG. 1A is an example, and the number of cameras 102 may be an arbitrary number of one or more. In the following description, “camera 102” is used to indicate an arbitrary camera among the plurality of cameras 102a to 102f.

  The camera (acquisition apparatus) 102 is an imaging apparatus that acquires image data indicating the temperature of an object. For example, a general infrared thermography camera (hereinafter referred to as a thermo camera) or the like can be applied. A thermo camera is an apparatus that images infrared radiation from a measurement object, converts it into a temperature, and visualizes the temperature distribution by color or the like. The thermo camera may be called a thermography, a thermo vision, a thermo viewer, or the like.

  In the example of FIG. 1A, the plurality of cameras 102a to 102f are installed on the walls or ceilings of the respective patient rooms corresponding to the respective beds 103a to 103f provided in the patient rooms A to F. For example, the camera 102a is installed on a wall surface corresponding to the bed 103a provided in the hospital room A, and is installed so that image data indicating the bed 103a and the temperature around the bed 103a can be acquired.

  Further, the camera 102a acquires image data indicating the bed 103a and the temperature around the bed 103a at a predetermined frame rate (for example, 5 fps to 1 fps, etc.), and provides the acquired image data via the network 104. Send to device 101. The image data acquired by the camera 102a is not limited to moving image data, and may be still image data acquired at a predetermined time interval (for example, an interval of 10 seconds to 60 seconds).

  At this time, the image data transmitted by the camera 102a includes identification information (for example, IP address, camera ID, bed ID, etc.) for identifying the camera 102a, the bed 103a, and the like.

  Similarly, the plurality of cameras 102a to 102f acquires image data indicating the corresponding bed and the temperature around the bed, and transmits the acquired image data to the information providing apparatus 101 via the network 104 together with the identification information. To do.

  The information providing apparatus 101 is, for example, an information processing apparatus such as a PC (Personal Computer) or a system including a plurality of information processing apparatuses. The information providing apparatus 101 collects image data transmitted from the camera 102 and uses the collected image data to detect a change in temperature in the bed and in one or more detection areas predetermined around the bed. In addition, the information providing apparatus 101 uses information indicating the state of a bed user (for example, a patient, a care recipient, etc.) when a change in temperature of a predetermined pattern is detected in one or more detection areas. The information of the person is notified to a predetermined notification destination (for example, nurse call system 121).

  The nurse call system 121 is, for example, an information processing apparatus such as a PC or a system including a plurality of information processing apparatuses, and is an example of a predetermined notification destination set in the information providing apparatus 101. The nurse call system 121 uses the display devices 122a to 122c installed in the nurse stations A to C, nurses, caregivers, and the like for calling information by a user who uses the bed 103 (for example, a patient, a care recipient). The information is displayed on the information terminal 123 or the like owned by the staff.

  Moreover, the nurse call system 121 according to the present embodiment is connected to the information providing apparatus 101 via the network 104 and receives user information notified from the information providing apparatus 101 as illustrated in FIG. 1A. The nurse call system 121 displays a display screen for notifying the user's situation on the display devices 122a to 122c, the information terminal 123, and the like based on the received user information.

  The plurality of display devices 122 a to 122 c are display devices provided in a nurse station or the like, and display a display screen transmitted from the nurse call system 121.

  The information terminal 123 is an information processing apparatus such as a smartphone, a tablet terminal, or a notebook PC possessed by a staff member such as a nurse or a caregiver. For example, the information terminal 123 can communicate with the nurse call system 121 by wireless communication, and displays a display screen transmitted from the nurse call system 121 by executing a predetermined application program (hereinafter referred to as an application). To do.

  The nurse call system 121 may be integrated with the information providing apparatus 101 as shown in FIG. 1B. For example, the function of the information providing apparatus 101 may be realized by a nurse call system or the like corresponding to a facility such as an inpatient ward 110.

(Example of bed and camera arrangement)
FIG. 2 is a diagram illustrating an example of the arrangement of beds and cameras according to an embodiment. As shown in FIG. 2A, the camera 102 is installed on the wall of the hospital room 111 or the like so that image data of the bed 103 corresponding to the camera 102 and the periphery of the bed can be acquired. The camera 102 may be installed on the ceiling of the hospital room 111.

  FIG. 2B shows a state in which the hospital room 111 is viewed from above. The camera 102 is installed so as to be able to acquire image data of a bed 103 corresponding to the camera 102 and a predetermined range including the periphery of the bed 103 (hereinafter referred to as a detection range 201).

(Example of detection area)
FIG. 3 is a diagram illustrating an example of a detection region according to an embodiment. The information providing apparatus 101 manages information indicating one or more detection areas set in advance within the detection range 201 of the camera 102. For example, in the detection range 201 of the camera 102, a plurality of detection areas are set in advance as shown in FIG. In the example of FIG. 3A, a fall detection area 301, a caution area A 302a, a caution area B 302b, a caution area C 302c, and the like are set in the detection range 201.

  The information providing apparatus 101 can manage each detection area using, for example, coordinate information of image data acquired by the camera 102.

  Preferably, the information providing apparatus 101 manages the detection range 201 of the image data acquired by the camera 102 by dividing it into, for example, a mesh-like small region (mesh) 303 as shown in FIG. To do. For example, the information providing apparatus 101 includes information (1, 2, 3,...) Indicating the vertical position of the divided small areas and information (A, B, C,...) Indicating the horizontal position.・), Each detection area can be managed. As an example, in FIG. 3B, the attention area B302b can be represented by information “J7, K7, L7, J8, K8, L8, J9, K9, L9” indicating the positions of a plurality of small areas. As a result, the information providing apparatus 101 can easily manage temperature changes in one or more detection regions.

(Example of detection pattern)
The information providing apparatus 101 uses the image data collected from the camera 102 to detect a change in temperature in one or more detection areas, and uses the change when a change in temperature corresponding to a preset detection pattern is detected. The user information indicating the status of the user is notified to a predetermined notification destination.

  4 and 5 are diagrams illustrating examples of detection patterns according to an embodiment. FIG. 4A shows an example of a bed leaving detection pattern in which a user 401 (patient, cared person, etc.) who uses the bed 103 detects the bed leaving the bed 103. For example, when the temperature corresponding to the user 401 detected on the bed 103 is detected in the fall detection area 301 and is not detected in the detection range 201 within a predetermined time, the information providing apparatus 101 It is determined (detected) that has left the bed.

  In this case, the information providing apparatus 101 notifies the predetermined notification destination (for example, the nurse call system 121) of the bed detection information indicating that the user 401 has left the bed 103. The bed leaving detection information includes identification information for identifying at least one of the bed 103, the camera 102, the place where the bed 103 is installed, and the user 401 using the bed 103.

  Preferably, this bed detection information includes image data collected within a predetermined period (for example, about 5 to 15 minutes) before the user's bed is detected.

  FIG. 4B shows an example of a fall detection pattern for detecting that the user 401 who uses the bed 103 has fallen from the bed 103. For example, when the temperature corresponding to the user 401 detected on the bed 103 is detected in the fall detection area 301 and remains in the fall detection area 301 for a predetermined time, the information providing apparatus 101 uses It is determined (detected) that the person has fallen from the bed 103.

  Preferably, the information providing apparatus 101 detects the temperature corresponding to the user 401, that is, the position of the user 401 based on the temperature of the head 402 of the user 401. The head 402 of the body of the user 401 is less likely to be covered with, for example, clothes or a blanket, and the face portion is not easily affected by hair, which is suitable for detecting the user 401. .

  For example, in the image data acquired by the camera 102, as shown in FIG. 4B, the head 402 of the user 401 has a temperature different from other parts (for example, a color different from the other parts). It is represented by Accordingly, the information providing apparatus 101 detects, from the image data, a region corresponding to the user 401 by detecting a region having a size corresponding to the head 402 indicating a predetermined temperature (for example, 30 ° C. to 40 ° C.). That is, the position of the user 401 can be detected.

  Preferably, as shown in FIG. 3B, the information providing apparatus 101 manages the detection range 201 by dividing the detection range 201 into a plurality of small areas and continuously indicating a predetermined temperature (for example, 30 ° C. to 40 ° C.). When the number of small areas is a predetermined number (for example, 5 or more), it is detected as a temperature corresponding to the user 401.

  As illustrated in FIG. 4B, when it is detected that the user 401 has fallen from the bed 103, the information providing apparatus 101 stores fall detection information indicating that the user 401 has fallen from the bed 103 as predetermined information. Notify the notification destination. The fall detection information includes the identification information described above, image data collected within a predetermined period before the fall of the user is detected, and the like.

  For example, as shown in FIG. 4B, the face and facial expression of the user 401 cannot be discriminated from this image data. However, the head 402 and the body of the user 401 are identified by the color indicating the temperature distribution. Etc. can be estimated. Therefore, a staff member such as a nurse or a caregiver grasps the situation of the user 401 (whether it has fallen from the bed 103 or is standing on the bed 103 side) on the display screen displayed on the display device. Can do.

  Preferably, in the image data acquired by the camera 102 and notified to the predetermined notification destination by the information providing apparatus 101, for example, an image that can confirm the outline of the bed 103 or the user 401 in addition to the color indicating the temperature. Contains information. Thereby, a staff member such as a nurse or a caregiver can grasp the situation of the user 401 more accurately on the display screen displayed on the display device.

  It is desirable that the image data acquired by the camera 102 and notified to the predetermined notification destination by the information providing apparatus 101 does not include information that can identify an individual, such as a face or an expression. As a result, a service provider that operates the information providing apparatus 101 and provides a service, without handling personal information of the user 401, can obtain user information indicating the user's status, such as the nurse call system 121. It can be provided to a predetermined notification destination.

  5A to 5C show examples of detection patterns for detecting that the user 401 who uses the bed 103 is in a state requiring attention (or a dangerous state). For example, as illustrated in FIG. 5A, when a temperature corresponding to the user 401 (for example, the head 402 of the user 401) is detected in the attention area A 302a, the information providing apparatus 101 uses, for example, the usage It is determined (detected) that there is a danger that the person falls from the bed 103.

  As described above, when the temperature corresponding to the user 401 is detected in the caution area A302a, the information providing apparatus 101 notifies the drop caution information indicating that the user 401 has a risk of falling from the bed in a predetermined notification. Notify first. This drop attention information includes the above-described identification information, image data collected within a predetermined period before the fall of the user is detected, and the like.

  Further, as illustrated in FIG. 5B, when the temperature corresponding to the user 401 (for example, the head 402 of the user 401) is detected in the attention area B302b, the information providing apparatus 101 uses, for example, the usage It is determined (detected) that the person has woken up.

  As described above, when the temperature corresponding to the user 401 is detected in the attention area B302b, the information providing apparatus 101 wakes up and indicates that there is a risk that the user 401 wakes up and starts some action. Is notified to a predetermined notification destination. This wake-up attention information includes the identification information described above, image data collected within a predetermined period before the user's fall is detected, and the like.

  Furthermore, as illustrated in FIG. 5C, when the temperature corresponding to the user 401 (for example, the head 402 of the user 401) is detected in the attention area C302c, the information providing apparatus 101 uses, for example, the usage It is determined (detected) that the person 401 may get out of bed.

  As described above, when the temperature corresponding to the user 401 is detected in the caution area C302c, the information providing apparatus 101 sends out the bed caution information indicating that the user 401 has a risk of getting out of the floor to a predetermined notification destination. Notice. This wake-up attention information includes the identification information described above, image data collected within a predetermined period before the user's fall is detected, and the like.

  Note that the detection patterns shown in FIGS. 4 and 5 are examples, and the information providing apparatus 101 uses the status indicating the state of the user 401 when detecting a temperature change of a predetermined pattern in one or more detection areas. What is necessary is just to notify a predetermined information to a predetermined notification destination.

  As described above, according to the present embodiment, the information providing apparatus 101 receives user information indicating the status of the user 401 who uses the bed 103 installed in a facility such as a medical facility or a care facility. The nurse call system 121 and the like can be notified. Therefore, a staff member such as a nurse or a caregiver in the facility can accurately grasp the situation of the user 401 who uses the bed 103 installed in the facility.

<Hardware configuration>
Next, the hardware configuration of the information providing apparatus 101 will be described. FIG. 6 is a diagram illustrating an example of a hardware configuration of the information providing apparatus according to the embodiment. The information providing apparatus 101 has a general computer configuration. For example, a CPU (Central Processing Unit) 601, a RAM (Random Access Memory) 602, a ROM (Read Only Memory) 603, a storage unit 604, a network I / F (Interface) 605, an input unit 606, a display unit 607, an external I / F 608, a bus 609, and the like.

  The CPU 601 is an arithmetic device that implements each function of the information providing apparatus 101 by reading a program or data stored in the ROM 603, the storage unit 604, or the like onto the RAM 602 and executing processing. A RAM 602 is a volatile memory used as a work area for the CPU 601. The ROM 603 is a nonvolatile memory that can retain programs and data even when the power is turned off.

  The storage unit 604 is a large-capacity storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores an OS (Operation System), application programs, various data, and the like.

  A network I / F 605 is a communication interface for connecting the information providing apparatus 101 to the network 104. The input unit 606 is an interface with a pointing device such as a mouse or an input device such as a keyboard, and is used to input each operation signal to the information providing apparatus 101. The display unit 607 is a display device such as a display or an interface for connecting to the display device, and is used for displaying processing results and the like by the information providing device 101.

  The external I / F 608 is an interface with an external device. The external device includes, for example, a recording medium. For example, the information providing apparatus 101 stores a predetermined program in a recording medium, and the predetermined program is executed by installing the program stored in the recording medium in the information providing apparatus 101 via the external I / F 608. It becomes possible. A bus 609 is connected to each of the above components, and transmits an address signal, a data signal, various control signals, and the like.

<Functional configuration>
Next, the functional configuration of the information providing system 100 will be described. FIG. 7A is a diagram illustrating an example of a functional configuration of the information providing system 100 according to an embodiment. The information providing system 100 includes, for example, an information providing apparatus 101 connected to a network 104 such as a LAN (Local Area Network), and a plurality of cameras 102a, 102b,. The information providing apparatus 101 can communicate with a nurse call system 121, which is an example of a predetermined notification destination, via the network 104, for example.

(Functional configuration of information providing device)
The information providing apparatus 101 executes a predetermined program by the CPU 601, whereby the collection unit 701, the detection unit 702, the notification unit 703, the correspondence information management unit 704, the correction unit 705, the image data management unit 706, and the area information management unit 707. And a storage unit 708 and the like.

  The collection unit 701 is realized by, for example, a program executed by the CPU 601, and is sent via the network 104 from the bed 103 and the camera (acquisition apparatus) 102 that acquires image data indicating the temperature around the bed 103. Collect incoming image data. Further, the collection unit 701 notifies the collected image data to the image data management unit 706, the detection unit 702, and the like.

  The detection unit 702 is realized by, for example, a program executed by the CPU 601 and uses the image data collected by the collection unit 701, and the temperature in one or more detection regions set in advance around the bed 103. Detect changes in

  Preferably, for example, in the plurality of small regions divided as illustrated in FIG. 3B, the detection unit 702 includes a number of continuous small regions indicating a predetermined temperature (for example, 30 ° C. to 40 ° C.). When it is a predetermined number (for example, 5 or more), it is detected as a temperature corresponding to the user 401.

  The notification unit 703 is realized by, for example, a program executed by the CPU 601. When a change in temperature of a preset pattern is detected in one or more detection areas, the notification unit 703 indicates the user 401 status. Information is notified to a predetermined notification destination. For example, the notification unit 703 notifies the nurse call system 121 of the user information when a change in temperature corresponding to the detection pattern as shown in FIGS.

  The correspondence information management unit 704 is realized by, for example, a program executed by the CPU 601, and correspondence information 711 that associates a predetermined temperature change with a notification content corresponding to the predetermined temperature change is stored in the storage unit 708 or the like. Remember and manage.

  An example of the correspondence information 711 managed by the correspondence information management unit 704 is shown in FIG. In the example of FIG. 8A, the correspondence information 711 includes information such as “detection pattern”, “notification content”, “temperature change”, and the like.

  The “detection pattern” is information such as a name, a number, or identification information for identifying a detection pattern indicating a temperature change pattern. “Notification content” is information indicating notification content corresponding to a predetermined temperature change. “Temperature change” is information indicating the content of a predetermined temperature change.

  In FIG. 8A, the detection pattern “Pattern 1” includes the bed detection information indicating that the user 401 has left the floor when the temperature (detection target) corresponding to the user 401 moves outside the detection range 201. It is shown that user information including image data is notified to a notification destination.

  Preferably, at this time, the notified image data includes image data collected by the collection unit 701 within a predetermined period before each detection pattern is detected.

  Note that the detection patterns (patterns 1 to 5) shown in FIG. 8A correspond to the detection patterns described in FIGS.

  In addition, the detection pattern may include a pattern for notifying information indicating that the user 401 has returned to the bed, as shown in the detection pattern “pattern 6” in FIG.

  Preferably, the notification unit 703 detects, in one or more detection areas, when “temperature change” corresponding to each detection pattern set in the correspondence information 711 is detected, The user information including “content” is notified to a predetermined notification destination.

  The correction unit 705 is realized by, for example, a program executed by the CPU 601, and when the position of the bed 103 is deviated from the detection range 201 as illustrated in FIG. It is moved according to the position of 103.

  The image data management unit 706 is realized by, for example, a program executed by the CPU 601, and stores the image data collected by the collection unit 701 in the storage unit 708 for each camera 102 and manages the image data. For example, the image data management unit 706 stores the image data collected from the camera 102a in the image data 713a of the storage unit 708, and stores the image data collected from the camera 102b in the image data 713b of the storage unit 708. .

  Preferably, the image data management unit 706 deletes image data that has passed a predetermined storage period (for example, 15 minutes) from the image data stored in the storage unit 708.

  However, image data in which “temperature change” is detected is not deleted but archived. Further, the archived image data is stored with administrator authority so that only the administrator can delete it.

  The area information management unit 707 is realized by, for example, a program executed by the CPU 601, and stores and manages area information 712 that specifies one or more detection areas preset in the detection range 201 in the storage unit 708. .

  FIG. 8B shows an example of the area information 712. In the example of FIG. 8B, the region information 712 includes information such as “region”, “attribute”, “coordinate range”, and the like.

  “Area” is information indicating the name, number, or identification information of the detection area. “Attribute” is information indicating the type and attribute of the detection area. “Coordinate range” is coordinate information indicating the range of each detection area. For example, when each detection area is rectangular, it is represented by coordinates of four vertices.

  In the example of FIG. 8B, the area information 712 includes an area 1 (detection area) indicating the detection range 201, an area 2 (first area) indicating the fall detection area 301, and an area 3 indicating the attention area A302a. (An example of the second area) is set.

  FIG. 8C shows another example of the area information 712. The area information 712 illustrated in FIG. 8C includes “corresponding small area” information instead of the “coordinate range” of the area information 712 illustrated in FIG. For example, as shown in FIG. 3B, the “corresponding small area” indicates the position of the small area corresponding to each detection area when the detection range 201 is divided into a plurality of small areas and managed. Information is stored.

  The storage unit 708 is realized by, for example, a program executed by the CPU 601, the storage unit 604, the RAM 602, and the like, and stores the correspondence information 711, the region information 712, the image data 713a, 713b,.

  In addition, when the information provision apparatus 101 and the nurse call system 121 are integrated like FIG. 1B, the function structure of the information provision apparatus 101 can also be made into FIG. 7B. The difference between FIG. 7B and FIG. 7A is that, in place of the notification unit 703, an output unit 720 is provided as an output interface to a display device (display devices 122a, 122b,..., And information terminal 123). is there. The output unit 720 is realized by, for example, a program executed by the CPU 601 in FIG. 6, a display unit 607, and the like.

  In the present embodiment, the nurse call system 121 is an example of a predetermined notification destination, and the configuration thereof includes at least a configuration for outputting the notified information to a predetermined display device, such as the output unit 720 described above. If so, other configurations may be arbitrary, and thus detailed description thereof is omitted. In the present embodiment, since a general thermo camera can be applied to the camera 102, a detailed description is omitted here.

<Process flow>
Subsequently, a processing flow of the information providing method according to the present embodiment will be described.

[First Embodiment]
(Processing of information providing device)
FIG. 9 is a flowchart illustrating an example of processing of the information providing apparatus according to the first embodiment. The information providing apparatus 101 executes, for example, the processing illustrated in FIG. 9 in response to reception of image data transmitted from each of the one or more cameras 102a, 102b,.

  In step S <b> 901, when the collection unit 701 collects image data transmitted from the camera 102, the information providing apparatus 101 executes processing in step S <b> 902 and subsequent steps. Here, as an example, processing when the collection unit 701 collects image data transmitted from the camera 102a will be described.

  In step S902, the image data management unit 706 stores the image data from the camera 102a collected by the collection unit 701 in the storage unit 708 as image data 713a. For example, the image data management unit 706 stores the image data collected from the camera 102a in a folder corresponding to the camera 102a based on the identification information included in the image data collected by the collection unit 701.

  In step S903, the image data management unit 706 deletes image data that has passed a predetermined storage period (for example, 15 minutes) from the image data 713a stored in the storage unit 708. Here, by deleting unnecessary image data, the storage area of the storage unit 708 can be saved, and the following processing load can be reduced.

  In step S904, the detection unit 702 detects a change in temperature in one or more detection regions using the image data 713a collected by the collection unit 701 and stored in the storage unit 708 by the image data management unit 706. For example, the detection unit 702 detects a trajectory in which a region indicating a predetermined temperature corresponding to the head 402 of the user 401 has moved.

  In step S905, the notification unit 703 determines whether there is a predetermined temperature change in one or more detection regions. For example, the notification unit 703 determines whether there is a temperature change corresponding to the “temperature change” in the correspondence information 711 as illustrated in FIG.

  If there is no change in the predetermined temperature, the notification unit 703 ends the process. On the other hand, when there is a change in the predetermined temperature, the notification unit 703 moves the process to step S906.

  If transfering it to step S906, the notification part 703 will notify the information of the user which shows the condition of the user 401 of the bed 103a corresponding to the camera 102a to a predetermined notification destination (here, nurse call system 121). The user information includes information (identification information) for identifying at least one of the camera 102a, the bed 103a corresponding to the camera 102a, the place where the bed 103a is installed, and the user 401 of the bed 103a. Is included.

  The user information includes, for example, “notification content” corresponding to a predetermined “temperature change” detected in correspondence information 711 as shown in FIG. For example, in the correspondence information 711 shown in FIG. 8A, when “temperature change” of “pattern 1” is detected, the user information includes the bed detection information indicating that the user 401 has been detected to leave. And image data collected within a predetermined period before the temperature change is detected.

  Through the above processing, the information providing apparatus 101, based on the image data collected from each camera 102, when a predetermined temperature change in one or more detection areas is detected, the user information indicating the user status Can be notified to a predetermined notification destination such as the nurse call system 121.

(Information provision system processing)
FIG. 10 is a sequence diagram illustrating an example of processing of the information providing system according to the first embodiment. This process shows an example of the process of the information providing system 100 as a whole.

  In step S <b> 1001, the camera 102 acquires image data indicating the bed 103 corresponding to the camera 102 and the temperature around the bed 103.

  In step S1002, the camera 102 transmits the acquired image data to the information providing apparatus. The image data includes, for example, identification information for specifying the camera 102, the bed 103 corresponding to the camera 102, the place where the bed 103 is installed, the user 401 of the bed 103, and the like. The camera 102 repeatedly executes the processes in steps S1001 and S1002 at a predetermined time interval (for example, an interval of 10 seconds to 60 seconds).

  In steps S1003 and S1004, the collection unit 701 of the information providing apparatus 101 notifies the image data management unit 706 and the detection unit 702 of the image data collected from the camera 102.

  In step S <b> 1005, the image data management unit 706 of the information providing apparatus 101 stores the image data in a folder or the like corresponding to the camera 102 based on the identification information included in the image data notified from the collection unit 701.

  In step S <b> 1006, the image data management unit 706 deletes image data that has passed a predetermined storage period (for example, 5 to 15 minutes) from image data stored in a folder or the like corresponding to the camera 102.

  In step S <b> 1007, the detection unit 702 of the information providing apparatus 101 detects a temperature change in one or more detection regions using the image data collected by the collection unit 701. For example, the detection unit 702 uses the one or more image data collected by the collection unit 701 and stored in the storage unit 708 to change the temperature corresponding to the user 401 detected in one or more detection areas. In addition, the presence or absence of a temperature corresponding to the user 401 in a predetermined detection area is detected.

  In step S1008, the detection unit 702 notifies the notification unit 703 of the detection result of the temperature change in one or more detection regions. This detection result includes, for example, the identification information described above.

  In step S1009, the notification unit 703 of the information providing apparatus 101 determines whether the temperature change detected by the detection unit 702 is a temperature change of a preset pattern. For example, the notification unit 703 determines whether the temperature change corresponds to the “temperature change” in the correspondence information 711 as illustrated in FIG.

  When the change in temperature detected by the detection unit 702 is a change in temperature of a preset pattern, the notification unit 703 executes processing in step S1010.

  In step S1010, the notification unit 703 displays the user information including the notification content corresponding to the “temperature change” in the correspondence information 711 and the identification information included in the detection result as illustrated in FIG. Notify the call system 121. The user information includes, for example, information indicating the user's situation and a change in the temperature of a preset pattern, as shown in the “notification content” of the correspondence information 711 shown in FIG. Image data acquired within a predetermined period before detection is included.

  In step S1011, the nurse call system 121 displays a display screen based on the user information notified from the information providing apparatus 101 on the display apparatuses 122a to 122c, the information terminal 123, and the like.

  Through the above processing, in the bed 103a of the hospital ward 110 in FIG. 1A, for example, when the user 401 of the bed 103a falls from the bed 103a, the user 401 is placed on the display device 122a or the like installed in the nurse station A. A display screen indicating that it has been dropped is displayed. At this time, the nurse call system 121 can display image data in a predetermined period before the fall of the user 401 is detected on the display screen. Therefore, a staff member such as a nurse or a caregiver who looks at the display screen can more accurately grasp the situation of the user 401 who uses the bed 103a.

  As described above, according to the information providing system 100 according to the present embodiment, in a facility such as a medical facility or a nursing care facility, it is possible to accurately grasp the situation of a user who uses a bed installed in the facility. become.

[Second Embodiment]
2nd Embodiment demonstrates the example of the process for reducing the misdetection at the time of detecting a user's condition.

  FIG. 11 is a diagram for describing an example of detection processing according to the second embodiment. In FIG. 11, it is assumed that a small object 1101 having a temperature close to that of the human body, such as a mobile phone, a smartphone, a disposable body warmer, and a charger, is present in the detection range 201. In such a case, it is desirable that the detection unit 702 of the information providing apparatus 101 excludes the object 1101 from the temperature change detection target.

  For example, the detection unit 702 is a region having a predetermined temperature range (for example, 30 ° C. to 40 ° C.) that is less than the size of the human head (for example, a region having four or less small regions). Etc.) are excluded from the temperature change detection targets. Accordingly, the detection unit 702 can exclude the object 1101 from the temperature change detection target.

  In FIG. 11, it is assumed that an object 1102 larger than the object 1101 having a temperature close to a human body, such as a television, a refrigerator, or a PC, is installed in the detection range 201. In such a case, it is desirable that the detection unit 702 of the information providing apparatus 101 excludes the object 1102 from the temperature change detection target.

  For example, the detection unit 702 excludes a region that does not move over a predetermined time from a region that is in a predetermined temperature range, from a temperature change detection target. Accordingly, the detection unit 702 can exclude the object 1102 from the temperature change detection target.

  Further, in FIG. 11, a person 1103 different from the user 401 of the bed 103, such as a health care worker such as a nurse or a doctor, a family member visiting a visitor, a caregiver, or the like, is present in the detection range 201. Shall. In such a case, it is desirable that the information providing apparatus 101 does not notify the detection result in order to prevent erroneous detection by the head 1104 of the person 1103.

  For example, when there are two or more regions different from the objects 1101 and 1102 among the regions that are in the predetermined temperature range, the detection unit 702 stops the notification of the detection result. Even in this case, since there is another person 1103 near the user 401 of the bed 103, even if the user 401 falls into a dangerous state, it can be considered that appropriate measures can be taken immediately.

<Process flow>
FIG. 12 is a flowchart illustrating an example of detection processing according to the second embodiment. This process is an example of the detection process executed by the detection unit 702 of the information providing apparatus 101 in step S904 in FIG.

  In step S <b> 1201, the detection unit 702 extracts a region within a predetermined temperature range within the detection range 201. Accordingly, in the example of FIG. 11, the head 402 of the user 401 of the bed 103, the head 1104 of the person 1103, the objects 1101, 1102, and the like are detected.

  In step S <b> 1202, the detection unit 702 detects a region that is less than a predetermined size (for example, a region having four or less small regions) among the detected regions within the predetermined temperature range. Exclude from detection. Thereby, in the example of FIG. 11, the object 1101 is excluded from the detection target of the temperature change.

  In step S1203, the detection unit 702 excludes, from among the detected regions within the predetermined temperature range, regions that have not moved for a predetermined time from temperature change detection targets. Thereby, in the example of FIG. 11, the object 1102 is excluded from the temperature change detection target.

  In step S1204, the detection unit 702 determines whether or not there is a region within a predetermined temperature range to be detected in the detection range 201.

  If there is no region within the predetermined temperature range to be detected in the detection range 201, the detection unit 702 ends the detection process. On the other hand, when there is no region within the predetermined temperature range to be detected in the detection range 201, the detection unit 702 shifts the processing to step S1205.

  In step S1205, the detection unit 702 determines whether there are two or more regions within a predetermined temperature range to be detected.

  When there are two or more regions within a predetermined temperature range to be detected, the detection unit 702 ends the process without notifying the detection result. On the other hand, when there are two or more regions within the predetermined temperature range to be detected, that is, when there is one region within the predetermined temperature range to be detected, the detection unit 702 proceeds to step S1206. Transition.

  In step S1206, the detection unit 702 notifies the notification unit 703 and the like of the temperature change detection result.

  With the above processing, for example, in steps S1007 and S1008 in FIG. 10, the notification unit 703 is notified of objects different from the user 401, such as the object 1101, the object 1102, and the person 1103 illustrated in FIG. Is suppressed. Therefore, according to the present embodiment, the information providing apparatus 101 can reduce false detection when detecting a user's situation.

[Third Embodiment]
In the third embodiment, an example of a suitable process when the user's 401 getting out of bed is detected based on the detection pattern of pattern 1 in FIG.

  For example, if it is determined by the detection pattern shown in pattern 1 in FIG. 8A that the user 401 has left the bed, it is expected that the user 401 will return to the bed 103 again after a while. However, just by detecting a temperature change within the detection range 201, it is not possible to determine whether the user 401 has returned, or whether a person different from the user 401 such as a visitor or a medical staff has visited. Can not.

  Therefore, in this embodiment, after the user's 104 getting out of bed is detected, notification is not made only when a temperature change is detected in the detection range 201, and the detection target is detected on the bed 103 for a predetermined time or more. If detected, the notification process is resumed. This is because, for example, it is considered that a person who is different from the user 401 such as a visitor or a medical staff stays on the bed 103 for a predetermined time or more. It is because it can be judged that it has returned.

<Process flow>
FIG. 13 is a flowchart illustrating an example of detection processing according to the third embodiment. This processing is executed by the information providing apparatus 101 when, for example, the user's 104 getting out of bed is detected by the detection pattern of pattern 1 in FIG.

  In step S1301, when the detection target moves out of the detection range 201, the information providing apparatus 101 executes processing subsequent to step S1302.

  In step S1302, the notification unit 703 of the information providing apparatus 101 interrupts the notification process.

  In step S303, the detection unit 702 of the information providing apparatus 101 determines whether a detection target is detected in the detection range 201. If the detection target is detected in the detection range 201, the process proceeds to step S1304. . Thereby, for example, as shown in FIG. 14A, when the user of the bed 103 returns from outside the detection range 201 to within the detection range, the processing from step S1304 is executed.

  In step S1304, the detection unit 702 determines whether or not a detection target is detected in the bed 103. If the detection target is detected in the bed 103, the process proceeds to step S1305. Thereby, for example, as illustrated in FIG. 14B, when the user 401 of the bed 103 returns to the bed 103, the processing from step S <b> 1305 is executed.

  In step S1305, the detection unit 702 waits for a predetermined time (for example, about several tens of seconds to several minutes), and then shifts the processing to step S1306.

  In step S1306, the detection unit 702 determines again whether or not the detection target is detected in the bed 103.

  When the detection target is not detected in the bed 103, the detection unit 702 returns the process to step S1303, and the information providing apparatus 101 executes the same process again. On the other hand, when the detection target is detected in the bed 103, the detection unit 702 shifts the processing to step S1307.

  In step S1307, the notification unit 703 of the information providing apparatus 101 resumes the notification process. Thus, for example, when the information providing apparatus 101 detects a predetermined temperature change in one or more detection areas as illustrated in FIG. 9, the information providing apparatus 101 displays information on the user 401 indicating the user's situation as a nurse call system. The process of notifying a predetermined notification destination such as 121 is resumed.

  Through the above processing, the information providing apparatus 101 can appropriately determine that the user 401 has used it and then returned to the bed 103 again, and for example, can restart the information providing processing as illustrated in FIGS. it can. In addition, by this process, for example, when a person who is different from the user 401 such as a visitor or a medical staff visits, a notification indicating that the user 401 has returned is erroneously sent to the notification destination of the nurse call system 121 or the like. Can be effectively suppressed.

[Fourth Embodiment]
In the fourth embodiment, an example of correction processing executed by the information providing apparatus 101 when the position of the bed 103 moves from a predetermined position will be described.

  When the camera 102 is installed on a wall, ceiling, or the like of a hospital room, if the position of the bed 103 moves from a predetermined position, the accuracy of detection processing by the detection unit 702 may be reduced. Therefore, the information providing apparatus 101 includes a correction unit 705 that corrects the position of the detection range 201 in accordance with the position of the bed 103 when the position of the bed 103 is shifted from the detection range 201.

  FIG. 15 is a diagram for explaining the correction processing according to the fourth embodiment. As an example, the image data acquired by the camera 102 includes image information representing the contour of the bed 103 and the user 401 in addition to the bed 103 and color information representing the temperature around the bed 103. Shall. In this case, the correction unit 705 stores an area 1501 corresponding to the position of the bed 103 within the detection range 201 in advance.

  Further, when the correction unit 705 determines from the image data acquired by the camera 102 that the position of the bed 103 is shifted as illustrated in FIG. 16A, for example, as illustrated in FIG. The detection range 201 is moved according to the bed 103. For example, the correction unit 705 performs, for example, an image such as movement, rotation, enlargement, or reduction with respect to the detection range 201 so that the area 1501 corresponding to the position of the bed 103 stored in advance matches the contour of the bed 103. Execute the process.

  As another example, the correction unit 705 stores in advance small areas 1502a and 1502b corresponding to two corners of the bed 103, for example, as illustrated in FIG. An object that generates a predetermined temperature is attached to the two corners of the bed 103.

  Further, when the correction unit 705 determines from the image data acquired by the camera 102 that the position of the bed 103 is shifted as shown in FIG. 15A, for example, the temperature of the small regions 1502a and 1502b stored in advance is determined. For example, image processing such as movement, rotation, enlargement, and reduction is performed on the detection range 201 so that the temperature becomes a predetermined temperature.

  By the above processing, the processing according to the first and second embodiments can be executed without changing the information of the small region indicating one or more detection regions. In addition, the above-described processing can suppress a decrease in accuracy of detection processing by the detection unit 702.

  Note that the above processing is not limited to when the position of the bed changes, and for example, by performing image processing such as enlargement or reduction on the detection range 201 even when the height of the bed changes. Can respond.

[Fifth Embodiment]
In the first to fourth embodiments, the information providing apparatus 101 is the user's “current situation” of the user 401 who uses the bed 103 installed in a facility such as a medical facility or a care facility. An example in which information is notified to the nurse call system 121 has been described.

  In the fifth embodiment, the information providing apparatus 101 quantifies and accumulates the situation of the user 401 who uses the bed 103 and provides an analysis result that visualizes the “past situation” of the bed user 401. An example will be described.

<System configuration>
FIG. 17 is a diagram illustrating an example of a system configuration of an information providing system according to the fifth embodiment. As illustrated in FIG. 17, the information providing system 100 according to the fifth embodiment includes an external server 1701 in addition to the system configuration of the information providing system 100 according to the embodiment illustrated in FIG. 1, for example. .

  The external server 1701 is, for example, a system including an information processing apparatus capable of communicating with the information providing apparatus 101, the information terminal 123, or the like via a network such as the Internet 1702, or a plurality of information processing apparatuses. Here, the following description is given assuming that the external server 1701 is an information processing apparatus having a hardware configuration as shown in FIG. 6, for example.

<Functional configuration>
(Functional configuration of information providing device)
FIG. 18 is a diagram illustrating an example of a functional configuration of an information providing system according to the fifth embodiment.

  For example, in addition to the functional configuration of the information providing apparatus 101 according to the embodiment illustrated in FIG. 7A, the information providing apparatus 101 according to the fifth embodiment includes a detection range management unit 1811 and a detection as illustrated in FIG. 18. A range specifying unit 1812 and a log information transmitting unit 1813 are included.

  The detection range management unit 1811 is realized by, for example, a program executed by the CPU 601. The detection range management unit 1811 manages the detection range of the image acquired by the camera 102 by dividing it into a plurality of detection frames 1901 as shown in FIG. 19A, for example. In the example of FIG. 19A, a plurality of detection frames 1901 that are divided into five columns A to E in the vertical direction and divided into five rows 1 to 5 in the horizontal direction are shown. Note that the plurality of detection frames 1901 illustrated in FIG. 19A is an example, and the number, size, and the like of the detection frames 1901 can be arbitrarily set or changed by, for example, an administrator.

  The detection range specifying unit 1812 is realized by, for example, a program executed by the CPU 601 and specifies a detection frame 1901 indicating a predetermined temperature corresponding to the head 402 of the user 401 who uses the bed 103 and digitizes the detection frame 1901. For example, in the example of FIG. 19A, the temperature corresponding to the head 402 of the user 401 is included in the detection frame of E column and 3 rows, so that the detection range specifying unit 1812 detects the predetermined temperature. The detected frame is represented by “E3”, for example.

  The log information transmission unit (history information transmission unit) 1813 is realized by a program executed by the CPU 601, for example. When the detection unit 702 detects that the detection frame in which the predetermined temperature has been detected has changed, the log information transmission unit 1813 identifies the camera ID that identifies the camera 102 that acquired the image, the time when the image was acquired, and the detection frame ( For example, log information including “E3”) is transmitted to the external server 1701. The log information is an example of history information.

  On the other hand, the log information transmission unit 1813 does not transmit the log information to the external server 1701 when the detection unit 702 detects that the detection frame indicating the predetermined temperature does not change. Also, the detection frame information included in the log information is represented by a short character string such as “E3”, for example. Therefore, in this embodiment, the communication data amount of log information transmitted by the log information transmission unit 1813 and the storage capacity of log information in the external server 1701 can be effectively reduced.

  However, this is a preferred example, and the log information transmission unit 1813 may transmit log information to the external server 1701 at a predetermined time interval or at a predetermined time, for example, or a detection state described later. May be further transmitted.

  The functional configuration of the information providing apparatus 101 other than the above may be the same as the functional configuration of the information providing apparatus 101 according to the embodiment illustrated in FIG. 7A, for example.

(Functional configuration of external server)
The external server 1701 implements a log information storage unit 1821, an information provision unit 1822, a storage unit 1823, and the like, for example, by executing a predetermined program with the CPU 601.

  A log information storage unit (history information storage unit) 1821 receives log information transmitted from the information providing apparatus 101 and stores the received log information in the storage unit 1823 for management. Note that the log information storage unit 1821 is not limited to the storage unit 1823, and may store and manage log information in an external server other than the external server 1701.

  FIG. 19B shows an example of log information 1824 stored in the storage unit 1823. As illustrated in FIG. 19B, the log information 1824 stores information such as “camera ID”, “time”, and “detection frame” included in the log information received from the information providing apparatus 101.

  “Camera ID” is identification information for identifying the camera 102. The camera ID may be a bed ID for identifying the bed 103 or the like.

  “Time” is information indicating the time (date or time or the like) when the camera 102 acquires an image. In the example of FIG. 19B, information indicating hours, minutes, and seconds is stored.

  The “detection frame” is information indicating the position of the detection frame where a predetermined temperature corresponding to the head 402 of the user 401 of the bed 103 is detected. In the example of FIG. 19B, FIG. The columns and rows in a plurality of detection frames 1901 shown in FIG.

  For example, in FIG. 19B, the predetermined temperature corresponding to the head 402 of the user 401 of the bed 103 corresponding to the camera ID “10001” is changed from the time “00:00:00” to the time “02:05: It is shown that the detection frame “E3” is detected until “43”.

  In addition, at time “02:05:43”, the detection frame in which the predetermined temperature was detected changed from “E3” to “E1”, and the state continued until time “02:07:11”. It is shown.

  Thus, the log information 1824 stored in the storage unit 1823 includes a detection frame in which a predetermined temperature corresponding to the head 402 of the user 401 is detected, a detected time and duration, a detected order, and the like. Information is included. However, the log information 1824 does not include information that conflicts with the personal information of the user 401.

  Here, returning to FIG. 18, the description of the functional configuration of the external server 1701 is continued.

  For example, the information providing unit 1822 analyzes the log information 1824 in response to a request from the information terminal 123 or the like used by a staff member such as a nurse or a caregiver in the facility, and provides the analysis result to the information terminal 123. The analysis result may include various information such as the state transition of the user 401 who uses the bed 103, the occupancy rate, the heat map, the man-time chart, and the like.

  The storage unit 1823 is realized by, for example, a program executed by the CPU 601, the storage unit 604, the RAM 602, and the like, and stores various information such as log information 1824.

<Process flow>
Subsequently, a processing flow of the information providing method according to the fifth embodiment will be described.

(Log information transmission process)
FIG. 20 is a flowchart illustrating an example of a log information transmission process according to the fifth embodiment. This process is repeatedly executed by the log information transmitting unit 1813 of the information providing apparatus 101 for each camera 102 and for each frame every time image data is acquired.

  In step S2001, the log information transmission unit 1813 of the information providing apparatus 101 acquires image data acquired by the camera 102 from the collection unit 701.

  In step S2002, the detection range specifying unit 1812 specifies a detection frame within a predetermined temperature range corresponding to the head 402 of the user 401 who uses the bed 103. For example, in the example of FIG. 19A, the detection frame “E3” indicating a predetermined temperature corresponding to the head 402 of the user 401 is specified.

  In step S2003, the detection unit 702 determines whether or not the position of the detection frame specified by the detection range specification unit 1812 has changed to a position different from the position of the detection frame specified last time.

  When the detection unit 702 detects that the position of the detection frame has changed from the position of the detection frame detected last time, the log information transmission unit 1813 shifts the processing to step S2004. On the other hand, when it is detected that the position of the detected detection frame has not changed from the position of the detection frame detected last time, the log information transmission unit 1813 ends the process.

  In step S2004, the log information transmission unit 1813 sends log information including the camera ID of the camera that acquired the image data, the time when the image data was acquired, and the detection frame information detected in step S2002 to the external server 1701. Send.

  Note that the log information transmission process illustrated in FIG. 20 is an example. As described above, the log information transmission unit 1813 may transmit the log information to the external server 1701 in accordance with a predetermined time interval, a predetermined time, or the like regardless of whether or not the detection frame has changed. .

(External server processing)
FIG. 21 is a flowchart illustrating an example of processing of the external server according to the fifth embodiment. For example, the external server 1701 repeatedly executes the process shown in FIG.

  In step S2101, when the external server 1701 receives request information for requesting provision of information from the information terminal 123 or the like, the external server 1701 executes processing in step S2102 and subsequent steps.

  This request information is transmitted from the information terminal 123 in accordance with, for example, an operation of a staff member such as a nurse or a caregiver in the facility. For example, the state of the user 401 using the bed 103, the occupancy rate, This is information requesting provision of various information such as a heat map and a man-time chart. This request information includes, for example, information such as the camera ID (or bed ID of the bed) of the target camera 102, the target period, and the analysis content.

  In step S2102, the information providing unit 1822 of the external server 1701 reads the log information corresponding to the camera ID and the target period included in the request information from the log information 1824 stored in the storage unit 1823.

  In step S2105, the information providing unit 1822 analyzes the read log information and creates an analysis result of the requested analysis content. In step S2106, the information providing unit 1822 provides (sends or transmits) to the requesting information terminal 123 or the like. Display).

  22-24 is a figure for demonstrating the example of the analysis result which concerns on 5th Embodiment.

(Changes in detection status)
FIG. 22A is a diagram illustrating an example of a detection state of the user 401 who uses the bed 103. This figure shows the correspondence between the detection frame in which the temperature corresponding to the head 402 of the user 401 using the bed 103 (hereinafter referred to as “user's head”) is detected and the detection state. Yes.

  In the example of FIG. 22A, it is indicated that the detection state of the “user's head” detected in the detection frame “E3” is “sleeping state”.

  In FIG. 22A, the detection frames corresponding to the detection state “rising state” are “B3, C3”. This indicates that the detection state in which the “user's head” is detected in at least one detection frame among the detection frames “B3” and “C3” is set to the “wake-up state”.

  On the other hand, in FIG. 22A, the detection frame corresponding to the detection state “sitting state” and the detection frame corresponding to the detection state “landing state” are both detection frames “B2, C2.” In the example of FIG. 22A, the information providing unit 1822 detects, for example, detection state transition (or detection frame transition) when “user's head” is detected in the detection frame “B2”. The detection state is judged by comparing the sequences. For example, when the “user's head” is detected in the detection frame “B2” after the “absence state” or “leaving state”, the information providing unit 1822 determines that the detection state is “landing state”. . On the other hand, when the “user face” is detected in the detection frame “B2” after “sleeping state”, “falling danger state”, or “wake-up state”, the information providing unit 1822 sets the detection state to “ Judgment is “sitting state”.

  Further, in FIG. 22A, the detection frame corresponding to the detection state “leaving state” and the detection frame corresponding to the detection state “falling state” are both detection frames “B1, C1”. In the example of FIG. 22A, for example, when the “user's head” is detected in the detection frame “C1”, the information providing unit 1822 determines the detection state based on the duration of the state. For example, when the “user's face” stays in the detection frame “C1” for less than a predetermined time (for example, about 1 to 5 minutes), the information providing unit 1822 sets the detection state to “out of bed”. Judge. On the other hand, when the “user face” stays in the detection frame “C1” for a predetermined time or more, the information providing unit 1822 determines that the detection state is “falling state”.

  Further, in the example of FIG. 22A, the state where the “user's head” is not detected in any of the detection frames is indicated as “absent state”. Note that the relationship between the detection frame and the detection state and the size and number of detection frames shown in FIG. 22 are examples, and can be arbitrarily set and changed by, for example, an administrator.

  The information providing unit 1822 uses, for example, information indicating the correspondence between detection frames and detection states as illustrated in FIG. 22A and log information 1824 as illustrated in FIG. ) Can be created and provided to the requesting information terminal 123 or the like.

  FIG. 22B shows an example of the analysis result indicating the transition of the detection state. In the example of FIG. 22B, at the time “00:00:00 (0: 0: 0)”, the “user's head” is detected in the detection frame “E3”, and the detection state is “sleeping state”. It is shown that.

  In addition, at the time “02:05:43 (2:05:43)”, the “user's head” is detected by the detection frame “E1”, which indicates that the detection state is “falling danger state”. Yes. In the log information transmission process shown in FIG. 20, the information of “time” and “detection frame” is updated when the detection frame is changed, so that the time “00:00:00” to “02:05” is updated. : 43 ”indicates that the“ sleeping state ”continued.

  At time “05:35:40”, when “user's head” is detected in the detection frames “B2” and “C2”, the previous detection state is “rise state”, so the information providing unit 1822 Thus, it is analyzed that the detection state is the “sitting state”. On the other hand, when the “user's head” is detected in the detection frame “C1” at the time “05:35:49”, the previous detection state is “absent state”. Has been analyzed to be "landing state".

  As described above, the information providing unit 1822 can create and provide information indicating the transition of the detection state of the user 401 who uses the bed 103. Note that the information indicating the transition of the detection state is an example of an analysis result created and provided by the information providing unit 1822.

(Occupancy rate)
FIG. 23A shows an image of an analysis result of “occupancy rate” created and provided by the information providing unit 1822. In the example of FIG. 23A, an example of the analysis result of the occupancy rate indicating the ratio between the absence 2311 of the user 401 who uses the bed 103 and the occupancy 2312 is shown. Among these, the ratio of absent 2311 is obtained by analyzing the ratio of time indicated by the detection state “absent state” in the log information 1824 within the target period included in the request information received from the information terminal 123 or the like, for example. be able to.

  As described above, the information providing unit 1822 can create and provide information indicating the occupancy rate of the user 401 who uses the bed 103. Note that the information indicating the occupancy rate of the user 401 is an example of an analysis result created and provided by the information providing unit 1822.

(Heat map)
FIG. 23B shows an image of an analysis result of the “residence time heat map” created and provided by the information providing unit 1822. FIG. 23B shows a heat map of the residence time visualized by color-coding the length of time when the “user's head” is detected in each detection frame by, for example, seven colors 2321a to 2321g. The image is shown. In FIG. 23B, it is shown that the time when the “user's face” is detected is long in the order of color 2321a, color 2321b,..., Color 2321g.

  According to the heat map of the residence time shown in FIG. 23B, the time when the “user's face” is detected at “E3” of the detection frame shown in FIG. 19A, for example, is the longest, and the detection frame “A4” It can be seen that the time detected at “A5” to “E5” is the shortest.

  FIG. 23C illustrates an image of the analysis result of the “movement frequency heat map” created and provided by the information providing unit 1822. The movement frequency heat map is information that visualizes the frequency and frequency of detection of the “user's head” in each detection frame 2331, and is another example of the heat map created and provided by the information providing unit 1822. It is.

  As an example, the movement frequency heat map is visualized by color-coding the frequency at which the “user's head” has moved to each detection frame 2331, for example, as in FIG.

  As another example, the movement frequency heat map may visualize the number of times the “user's head” has moved to each detection frame 2331 using numerical values.

  Furthermore, as shown in FIG. 23B, for example, the movement frequency heat map visualizes the frequency of movement of the “user's head” in each detection frame 2331 by color coding, and “uses” in each detection frame 2331. The number of times the “person's head” has moved may be visualized by a numerical value in the frame.

  Note that the frequency and number of times the “user's head” is detected are, for example, from the time included in the analysis result indicating the transition of the detection state as shown in FIG. It can be obtained from the ratio of the detection frames moved within a predetermined time, the number of times, or the like.

  As described above, the information providing unit 1822 can create and provide a heat map that allows the user 401 using the bed 103 to visualize and display the time, frequency, number of times, and the like detected in each detection frame. . The heat map is an example of an analysis result created and provided by the information providing unit 1822.

  From such a heat map, the tendency for each user of the detection frame in which the “user's head” is detected can be visualized. Thus, for example, staff such as nurses and caregivers in the facility can predict possible problems (eg, fall, injury, wrinkles, etc.) from the heat map, and prevent or reduce problems in advance. Will be able to.

  In addition, for example, the following service may be provided using such a heat map. For example, a service provider who provides the external server 1701 analyzes a correspondence between a problem that occurred in the past and the heat map immediately before it from a plurality of log information 1824 stored in the external server 1701. Create

  Also, a staff member such as a nurse or a caregiver in the facility shoots a heat map as shown in FIG. 23B with a smartphone or the like in which an application corresponding to the information providing system 100 is installed. Correspondingly, if the above-mentioned dictionary is searched by an application installed on a smartphone or the like, and a heat map corresponding to a problem that occurred in the past is searched, problems that may occur in the future, information on countermeasures, etc. And display on a display screen of a smartphone or the like.

  For example, such services enable nurses, caregivers, and the like in the facility to more accurately grasp the situation of the user 401 who uses the bed 103 installed in the facility. Become.

(Man time chart)
FIG. 23C shows an image of the analysis result of the “man time chart” created and provided by the information providing unit 1822. FIG. 23C shows an image of a man-time chart that visualizes and displays the detection state of each time of the user 401 who uses the bed 103. In FIG. 23C, the horizontal axis indicates time, and the time when each detection state indicated on the vertical axis is detected is displayed by a rectangle (or line). Such a man-time chart allows a staff member such as a nurse or a caregiver in the facility to easily grasp the detection state of the user 401 using the bed 103 at each time.

  In this way, the information providing unit 1822 can create and provide a man-time chart that visualizes and displays the detection state of the user 401 who uses the bed 103 at each time. The man time chart is an example of an analysis result created and provided by the information providing unit 1822.

  The analysis results shown in FIGS. 22 and 23 are merely examples, and the information providing unit 1822 can create and provide various analysis results other than the above using the log information 1824.

  As described above, according to the information providing system 100 according to the present embodiment, the situation of the user 401 who uses the bed 103 installed in the facility is grasped, the situation is quantified and accumulated, and the bed user 401 An analysis result that visualizes the “past situation” can be provided. As a result, if the “past situation” of the user 401 who uses the bed 103 shows a sign of a past accident or danger, a staff member such as a nurse or a caregiver in the facility You will be able to take action to prevent danger.

  Note that the system configuration of the information providing system 100 illustrated in FIG. 17 and the functional configuration of the information providing system illustrated in FIG. 18 are examples, and the information providing system 100 according to the present embodiment has various system configurations and functional configurations. Can be adopted.

  For example, each functional configuration of the external server 1701 may be realized by an information processing apparatus connected to the network 104. Further, the information providing apparatus 101 and the nurse call system 121 may be the same information processing apparatus. Furthermore, at least a part of each functional configuration of the external server 1701 may be included in the information providing apparatus 101 or the nurse call system 121.

  Further, the information providing unit 1822 of the external server 1701 may provide a part or all of the log information 1824 stored in the storage unit 1823 according to the request information from the information terminal 123 or the like. In this case, the log information is analyzed by an application of the information terminal 123, and various analysis results as shown in FIGS. 22 and 23, for example, may be generated and displayed.

  Further, the information providing unit 1822 of the external server 1701 may be provided on the information terminal 123 side. In this case, request information is transmitted from the information terminal 123 to the external server 1701, and log information is acquired from the log information storage unit 1821 of the external server 1701. The information terminal 123 can analyze the acquired log information and display the result on the display screen of the information terminal 123 by the function of the information providing unit 1822.

DESCRIPTION OF SYMBOLS 100 Information provision system 101 Information provision apparatus 102 Camera (acquisition apparatus)
103 beds 110 hospital wards (example of facilities)
121 Nurse Call System (an example of a predetermined notification destination)
201 Detection range (detection area)
301 Fall detection area (first area)
302a to 302c Caution areas A to C (second area)
401 User 701 Collection unit 702 Detection unit 703 Notification unit 704 Corresponding information management unit (management unit)
705 Correction unit 720 Output unit 1701 External server (external server)
1813 Log information transmission unit (history information transmission unit)
1821 Log information storage unit (history information storage unit)
1822 Information provision department

JP 2000-316915 A

Claims (20)

An information providing device for providing information on a user who uses a bed installed in a facility,
A collecting unit that collects the image data from an acquisition device that acquires image data indicating the bed and the temperature around the bed;
Using the image data collected by the collection unit, a detection unit that detects a change in temperature in the bed and at least one detection region preset around the bed;
Notification that notifies the user information to a predetermined notification destination when the detection unit detects that a change in temperature indicated by the image data in the detection region indicates a change in temperature of a preset content. And
An information providing apparatus. The detection area further includes a first area that is an area for the user to detect a fall from the bed accompanying a change in temperature of the preset content,
If the change in temperature indicated by the image data does not occur even after a predetermined time after the change in temperature of the preset content in the first area is detected, the notification unit uses the use The information providing apparatus according to claim 1, wherein information of a person is notified to the notification destination.   The notification unit is a case where a change in the temperature in the detection area is detected again after the temperature corresponding to the user is no longer detected from the detection area, and the preset in the first area The information providing apparatus according to claim 2, wherein if the temperature change of the content that has been performed does not occur within a predetermined time, the user information is not notified to the notification destination. The detection area further includes a second area for detecting that the user is at risk of falling from the bed,
The said detection part notifies the said user's information to the said notification destination, when the temperature corresponding to the said user is detected in the said 2nd area | region, The said notification destination WHEREIN: Information providing device.   The notification unit is a case where a change in the temperature in the detection region is detected again after the temperature corresponding to the user is no longer detected from the detection region, and the change in the temperature is the first change. If it is detected that the user stays in the first area or the second area again after the predetermined time after moving from the area to the bed, the user information is notified. The information providing apparatus according to claim 4, which is notified in advance. The detection area has a small area obtained by dividing the detection area into a plurality of areas,
The said detection part detects the change of the temperature corresponding to the said user by the change of the temperature in the said continuous small area | region which shows the temperature and magnitude | size of a human body. Information providing device.   The information of the user includes information for specifying at least one of the bed, a place where the bed is installed, the acquisition device, and the user. The information providing apparatus according to the description.   The user information includes one or more of the image data collected by the collection unit within a predetermined period before a change in temperature of the preset content is detected. The information providing device according to claim 1. A management unit that manages correspondence information associating a change in temperature of the preset content with a notification content corresponding to the change in temperature;
The information providing apparatus according to any one of claims 1 to 8, wherein the user information includes the notification content corresponding to a change in temperature of the preset content detected by the detection unit. The facility is a medical facility or a nursing facility,
The information providing device according to claim 1, wherein the notification destination is a nurse call system corresponding to the facility.   The information providing apparatus according to claim 1, further comprising: a correction unit that corrects a position of the detection area in accordance with a change in the position of the bed.   The information providing apparatus according to claim 2, wherein the predetermined time is a time that can be set for each of the first region and the second region.   When a change in temperature in the one or more detection areas is detected by the detection unit, history information including information on a detection area where a predetermined temperature corresponding to the user is detected is stored in a predetermined external device. The information provision apparatus according to claim 1, further comprising a history information transmission unit for transmission. An information providing method executed by an information providing apparatus for providing information on a user who uses a bed installed in a facility,
The information providing device is
Collecting the image data from an acquisition device that acquires image data indicating the bed and the temperature around the bed;
Using the collected image data to detect a change in temperature in the bed and one or more detection areas preset around the bed;
When a change in temperature indicated by the image data in the detection region is detected to indicate a change in temperature of a preset content, notifying the user information to a predetermined notification destination; and
Information providing method to execute. In the information provision device that provides information on users who use the beds installed in the facility,
Collecting the image data from an acquisition device that acquires image data indicating the bed and the temperature around the bed;
Using the collected image data to detect a change in temperature in the bed and one or more detection areas preset around the bed;
When a change in temperature indicated by the image data in the detection region is detected to indicate a change in temperature of a preset content, notifying the user information to a predetermined notification destination; and
A program for running An information providing device for providing information on a user who uses a bed installed in a facility,
A collecting unit that collects the image data from an acquisition device that acquires image data indicating the bed and the temperature around the bed;
Using the image data collected by the collection unit, a detection unit that detects a change in temperature in the bed and at least one detection region preset around the bed;
An output unit that displays the user information on a predetermined display device when a change in temperature indicated by the image data in the detection area is detected to indicate a change in temperature of a preset content;
An information providing apparatus. An information providing method executed by an information providing apparatus for providing information on a user who uses a bed installed in a facility,
The information providing device is
Collecting the image data from an acquisition device that acquires image data indicating the bed and the temperature around the bed;
Using the collected image data to detect a change in temperature in the bed and one or more detection areas preset around the bed;
When it is detected that a change in temperature indicated by the image data in the detection area indicates a change in temperature of a preset content, displaying the user information on a predetermined display device; and
Information providing method to execute. In the information provision device that provides information on users who use the beds installed in the facility,
Collecting the image data from an acquisition device that acquires image data indicating the bed and the temperature around the bed;
Using the collected image data to detect a change in temperature in the bed and one or more detection areas preset around the bed;
When it is detected that a change in temperature indicated by the image data in the detection area indicates a change in temperature of a preset content, displaying the user information on a predetermined display device; and
A program for running An information providing system for providing information of a user who uses a bed installed in a facility by a plurality of information providing devices,
A collecting unit that collects the image data from an acquisition device that acquires image data indicating the bed and the temperature around the bed;
Using the image data collected by the collection unit, a detection unit that detects a change in temperature in the bed and at least one detection region preset around the bed;
A notification unit for notifying a predetermined notification destination of the user information when it is detected that a change in temperature indicated by the image data in the detection region indicates a change in temperature of a preset content;
An output unit for displaying the notified user information on a predetermined display device;
An information providing system. A history information transmission unit that transmits history information including information on a detection region where a predetermined temperature corresponding to the user is detected when a change in temperature in the one or more detection regions is detected by the detection unit. When,
A history information storage unit for storing the history information transmitted by the history information transmission unit;
Using the history information stored in the history information storage unit, an information providing unit that provides an analysis result indicating the state of the user;
The information providing system according to claim 19, comprising:

Images