JP2023183537A - Information processing apparatus, program, computer-readable recording medium, information processing system, and information processing method - Google Patents

Abstract

To provide an information processing apparatus configured to display data for supporting appropriate review of a rehabilitation plan, a program, a computer-readable recording medium, an information processing system, and an information processing method.SOLUTION: An information processing apparatus includes: an acquisition unit which acquires first data obtained by recording daily activity of a cared person, and second data obtained by recording rehabilitation activity of the cared person, for each predetermined rehabilitation item; and a display unit which displays the first data and a designated rehabilitation item of the second data so as to be compared to each other.SELECTED DRAWING: Figure 9

Description

The present technology relates to an information processing device, a program, a computer-readable recording medium, an information processing system, and an information processing method.

In nursing care facilities, a rehabilitation plan is drawn up for each person being cared for, and rehabilitation is implemented. In order to update the rehabilitation plan as needed, the content of rehabilitation implementation is recorded for each cared person (for example, Patent Document 1).

Japanese Patent Application Publication No. 2020-135734

When recording the content of rehabilitation implementation, even when the same content of rehabilitation is performed, it may be recorded using different description methods depending on the recorder. Furthermore, there are not necessarily sufficient means for accurately and easily reviewing the rehabilitation plan while referring to the rehabilitation implementation details. As a result, the rehabilitation plan may not be appropriately reviewed.

An object of the present technology is to provide an information processing device, a program, a computer-readable recording medium, an information processing system, and an information processing method that enable display of data that supports appropriate review of a rehabilitation plan.

According to an aspect of the present technology, the information processing device records first data obtained by recording the daily activities of the cared person and rehabilitation activities of the cared person for each predetermined rehabilitation item. and a display unit that displays the first data and a designated rehabilitation item of the second data so as to be comparable.

Preferably, outputting the data in a comparable manner includes displaying the first data and the second data in an overlapping manner.

Preferably, the first data includes information on changes over time regarding the predetermined index. The second data includes information on changes over time regarding predetermined rehabilitation items.

Preferably, the first data includes at least one index of the cared person's sleeping time, sleep state, number of times he or she wakes up, number of times he leaves the bed, heart rate, and breathing rate.

Preferably, recording the care recipient's daily activities includes acquiring the care recipient's biological information, body position information, or location information.

Preferably, the second data includes any one of the number of times and amount of rehabilitation items performed.

Preferably, recording the care receiver's rehabilitation activities includes inputting the care receiver's rehabilitation activities into the information processing device for each predetermined item.

Preferably, the information processing device is a terminal device, and the acquisition unit acquires the first data and the second data from a server device communicably connected to the terminal device.

According to another aspect of the present disclosure, the program records the first data obtained by recording the daily activities of the cared person and the rehabilitation activities of the cared person for each predetermined rehabilitation item. and a step of displaying the first data and the specified rehabilitation item of the second data in a comparative manner. .

According to yet another aspect of the present disclosure, the recording medium is computer readable and stores the above program.

According to still another aspect of the present disclosure, an information processing system includes a recording device that records the activities of a cared person, a server device that acquires recording results of the recording device, and a terminal device that can communicate with the server device. . The terminal device stores first data obtained by recording the care receiver's daily activities, and second data obtained by recording the care receiver's rehabilitation activities for each predetermined rehabilitation item. is obtained from the server device, and the first data and the specified rehabilitation item of the second data are displayed so as to be comparable.

According to still another aspect of the present disclosure, the information processing method includes first data obtained by recording the daily activities of the cared person and rehabilitation activities of the cared person for each predetermined rehabilitation item. The method includes a step of acquiring second data obtained by recording, and a step of displaying the first data and a designated rehabilitation item of the second data so as to be comparable.

According to the present technology, the first data obtained by recording the daily activities of the cared person and the second data obtained by recording the rehabilitation activities of the cared person are displayed in a way that allows them to be compared. By doing so, it is possible to support appropriate review of rehabilitation plans. Here, by recording the rehabilitation activities for each predetermined item, it is possible to suppress variations in the filling format between recorders and obtain highly reliable second data.

FIG. 1 is a diagram showing an example of the configuration of a rehabilitation support system. 9 is a diagram illustrating an example of an outline of a behavior record or an activity record of a user 800 in a living room 900. FIG. It is a diagram showing an example of the hardware configuration of a sensor box 100 and a mobile terminal 300A. 2 is a diagram illustrating an example of the hardware configuration of a server device 200. FIG. 9 is a diagram showing an example of a record of actions of a user 800 in a living room 900. FIG. 9 is a diagram illustrating an example of a motion record of a user 800 in a rehabilitation room 950. FIG. It is a figure which shows an example of the posture estimation (motion type estimation) method of the user 800 in a rehabilitation support system. It is a functional block diagram for explaining the functional configuration of a sensor box 100, a server device 200, and a terminal device 300 that constitute the rehabilitation support system. FIG. 3 is a diagram for explaining the operation of the terminal device 300 when performing rehabilitation in a certain situation. FIG. 3 is a diagram (part 1) showing a screen displayed on the display 305 of the terminal device 300 in a certain situation. FIG. 3 is a diagram (Part 2) showing a screen displayed on the display 305 of the terminal device 300 in a certain situation. FIG. 2 is a sequence diagram showing a processing flow executed in the rehabilitation support system.

Embodiments of the present technology will be described below. Note that the same reference numerals may be given to the same or corresponding parts, and the description thereof may not be repeated.

Note that in the embodiments described below, when referring to the number of objects, etc., the scope of the present technology is not necessarily limited to the number of objects, unless otherwise specified. Furthermore, in the embodiments below, each component is not necessarily essential to the present technology unless otherwise specified.

<System configuration>
The overall picture of the rehabilitation support system (information processing system) will be described with reference to FIGS. 1 and 2. The rehabilitation support system according to this embodiment is assumed to be used mainly in residences for elderly people, special nursing homes, nursing care facilities, etc. (hereinafter collectively referred to as "facilities"). . In the following explanation, the cared person who receives care within the facility will be referred to as a "user," and the caregiver who performs care work within the facility will be referred to as "staff."

FIG. 1 is a diagram showing an example of the configuration of a rehabilitation support system according to the present embodiment. Referring to FIG. 1, the rehabilitation support system includes a sensor box 100, a server device 200, and a terminal device 300.

The facility 10 includes at least a living room 900 and a rehabilitation room 950. The living room 900 is a room where the user 800 lives his daily life. The rehabilitation room 950 is a room where the user 800 performs rehabilitation (including physical fitness measurement) for the purpose of improving athletic ability. In the example shown in FIG. 1, a user 800A is living his daily life in a living room 900, and a user 800B is undergoing rehabilitation in a rehabilitation room 950.

The sensor box 100 uses the camera and sensor built into the sensor box 100, and various other sensors to monitor the movements (herein referred to as "daily movements") or activities (in this specification) of the user 800 in the living room 900. (herein referred to as "daily activities") may be obtained. The sensor box 100 transmits the acquired record of the daily activities of the user 800 to the server device 200 via the internal network. Furthermore, the sensor box 100 may also be installed in the rehabilitation room 950. The sensor box 100 in the rehabilitation room 950 can acquire records of the user's 800 movements (herein referred to as "rehabilitation movements") or activities (herein referred to as "rehabilitation activities") in the rehabilitation room 950. .

Note that in this specification, "action" of the user 800 means an action that involves movement of the user's 800 body. Further, the "activity" of the user 800 refers to the overall actions of the user 800, regardless of the presence or absence of body movements. For example, "sleeping", "reading", etc. are included in "activities" even if they do not necessarily involve physical movements of the user 800. In this specification, "daily activities" and "rehabilitation activities" are collectively referred to as "operations," and "daily activities" and "rehabilitation activities" are collectively referred to as "activities." Furthermore, records of actions or activities obtained by cameras, sensors, etc. are referred to as "action records" or "activity records."

The action record of the user 800 includes, for example, moving image data captured by a camera. The activity record of the user 800 includes information such as sleep time and heart rate of the user 800 acquired by a sensor, for example.

The user 800's actions include, for example, "walking" in which the user's 800's position changes while standing, "getting up" in which the user's 800's position changes from a lying position to a sitting position, and This includes ``standing up,'' where one's posture changes from a sitting position to a standing position. The action record of the user 800 may include any action other than the above actions.

The rehabilitation support system may further include a gateway server 11, a switching device 12, and an access point 13.

The gateway server 11 interconnects the internal network of the facility 10 and the external network of the facility 10 . The internal network may be a wired and wireless local network. The external network is, for example, the Internet or a public telephone network. Devices connected to internal or external networks transmit data using communication protocols such as TCP (Transmission Control Protocol)/IP (Internet Protocol), UDP (User Datagram Protocol), and ICMP (Internet Control Message Protocol). Send and receive.

The gateway server 11 may include security-related functions. For example, the gateway server 11 may use a firewall or filtering function to prevent devices connected to the external network from accessing devices on the internal network. Conversely, the gateway server 11 may impose restrictions on each device connected to the internal network, such as making it impossible to refer to a specific web page on the external network.

The switching device 12 interconnects each device on the internal network of the facility 10. In some aspects, a router or switch may be used as switching device 12. The switching device 12 includes a plurality of Ethernet (registered trademark) communication ports and can be connected to each device via an Ethernet cable. Furthermore, the switching device 12 may include a wireless antenna compatible with Wi-Fi (registered trademark) (Wireless Fidelity) or the like. In that case, switching device 12 may communicate with each device by both wired and wireless means. In the example shown in FIG. 1, the number of exchange devices 12 is one, but the number of exchange devices 12 is not limited to this. The internal network of facility 10 may be configured by a combination of multiple switching devices 12.

The access point 13 is equipped with a wireless antenna and connects each device to the internal network via wireless communication. In some aspects, a Wi-Fi router may be used as the access point 13. In some aspects, switching device 12 and access point 13 may be integrated.

The sensor box 100 transmits the acquired operation record or activity record of the user 800 to the server device 200 via the internal network.

The server device 200 manages programs and various data of the rehabilitation support system. Furthermore, the server device 200 saves the operation record or activity record of the user 800 in the living room 900 and the operation record or activity record of the user 800 in the rehabilitation room 950.

Server device 200 may be a cloud server on an external network. In that case, the server device 200 will communicate with each device on the internal network via the gateway server 11.

The terminal device 300 may include a mobile terminal 300A used by individual staff and an administrator terminal 300B used by the administrator of the facility 10. Administrator terminal 300B may be used as a terminal for the administrator of facility 10 to log into server device 200. In the example shown in FIG. 1, two mobile terminals 300A1, 300A2 and one administrator terminal 300B are illustrated, but the number of mobile terminals 300A and administrator terminal 300B is not particularly limited.

The sensor box 100 can analyze the operation record or activity record of the user 800 in the living room 900 or the rehabilitation room 950, and can transmit the analysis result to the server device 200. The analysis results may include, for example, information such as an estimation result of the motion type of each motion included in the motion record of the user 800, and the motion time or motion speed of each motion. Furthermore, the sensor box 100 can estimate whether the user 800 is in a sleeping state or in an awake state.

The sensor box 100 may further transmit position information to the server device 200. The position information here may include information regarding the living room 900, the rehabilitation room 950, the dining room, other shared spaces, and the like. In other aspects, the sensor box 100 may transmit all or part of the acquired information to the mobile terminal 300A. In that case, the mobile terminal 300A can transmit various information acquired from the sensor box 100 to the server device 200.

The sensor box 100 has a built-in sensor for detecting the movement of the user 800 in the living room 900. An example of a sensor is a Doppler sensor for detecting motion of an object.

The mobile terminal 300A is used by staff who are engaged in nursing care at the facility 10. The staff member may use the mobile terminal 300A to transmit a record of the rehabilitation operation of the user 800 to the server device 200. The staff performs rehabilitation of the user 800 using the mobile terminal 300A. For example, the staff member may use the mobile terminal 300A as a stopwatch to measure the time of actions such as walking, getting up, and standing. In that case, the mobile terminal 300A may transmit a timestamp (start time and end time) of each operation to the server device 200.

In the example of FIG. 1, the number of living rooms 900 and rehabilitation rooms 950 included in the facility 10 is one each, but the rehabilitation support system according to this embodiment can include any number of living rooms 900 and any number of rehabilitation rooms. It can be used in a facility 10 having a room 950. Similarly, the number of other devices such as the mobile terminal 300A, the access point 13, and the exchange device 12 is not limited to the example shown in FIG.

Living room 900 includes, for example, a bed 901 as equipment. The user 800 wears a vital sensor 400 that detects vital information of the user 800. An example of the detected vital information is the user's body temperature. Another example is the user's breathing. Yet another example is the user's heart rate. Yet another example is two or more types of information among these pieces of information.

FIG. 2 is a diagram illustrating an example of an outline of the operation record or activity record of the user 800 in the living room 900. Sensor box 100, server device 200, and mobile terminal 300A may be connected to each other via a wired network or a wireless network. Although the example shown in FIG. 2 is the living room 900, the rehabilitation support system can also acquire operation records or activity records of the user 800 in the rehabilitation room 950 using the same procedure.

Sensor box 100 includes a camera 105 (imaging device) and an optional sensor 110 (such as a microphone, an infrared sensor, a Doppler sensor, or a combination thereof). For example, the sensor box 100 may photograph the movement of the user 800 with the camera 105 only when the sensor 110 detects the movement of the user 800, and send the moving image data to the server device 200 as a record of the movement. good. As another example, the sensor box 100 may continue to photograph the actions of the user 800 and may send moving image data to the server device 200 to which detection values obtained from the sensor 110 are added at regular intervals.

The server device 200 can analyze the received operation record and store the analysis results together with the identification information of the user 800. Terminal device 300 can display information acquired from server device 200 on a display.

The camera 105 photographs the inside of the living room 900. The camera 105 may be a movable camera having two or more movable axes. Camera 105 may be an infrared camera. Furthermore, camera 105 may be a movable infrared camera. In that case, the sensor box 100 can photograph the inside of the living room 900 without disturbing the sleep of the user 800 even when the lights are off at night. Furthermore, in other aspects, camera 105 may include both a regular camera and an outside line camera. In that case, the sensor box 100 can take pictures of the inside of the living room 900 during the daytime with a normal camera, and can take pictures of the inside of the living room 900 at night with an infrared camera.

The sensor 110 can detect the user's 800 behavior or acquire data for analysis. The sensor 110 can obtain, for example, the start time of the user's 800 action, the end time of the action, and location information. The sensor box 100 or the server device 200 can analyze the motion of the user 800 with high accuracy based on the moving image data and the information acquired from the sensor 110.

Video data of the user's 800 movement (rehabilitation movement) in the rehabilitation room 950 can be acquired by the mobile terminal 300A. The video data of the rehabilitation operation may be acquired by the camera 105 of the sensor box 100, similarly to the operation (daily operation) in the living room 900.

<Hardware configuration>
Next, the hardware configurations of the sensor box 100, the server device 200, and the mobile terminal 300A will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram showing an example of the hardware configuration of the sensor box 100 and the mobile terminal 300A.

Referring to FIG. 3, sensor box 100 records the motion or activity of user 800 in living room 900 or rehabilitation room 950, and transmits the acquired information to server device 200 as a motion record or activity record. The sensor box 100 includes a control device 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a communication interface 104, a camera 105, a Doppler sensor 106, a wireless communication device 107, and a storage device. 108.

Control device 101 controls sensor box 100. Control device 101 is configured, for example, by at least one integrated circuit. The integrated circuit includes, for example, at least one CPU (Central Processing Unit), at least one ASIC (Application Specific Integrated Circuit), at least one FPGA (Field Programmable Gate Array), or a combination thereof.

ROM 102 can store various programs and settings executed by control device 101. The RAM 103 temporarily stores programs loaded from the ROM 102 or the storage device 108. The control device 101 executes the program read into the RAM 103.

Communication interface 104 is connected to an antenna (not shown) or the like. The sensor box 100 exchanges data with other communication devices via the antenna. Other communication devices include, for example, server device 200, mobile terminal 300A, access point 13, and other communication terminals. In some aspects, communication interface 104 may be connected to other communication devices via a wired connection.

Camera 105, in one implementation, is a near-infrared camera. The near-infrared camera includes an IR (Infrared) projector that projects near-infrared light, and can take images and/or photographs showing the inside of the living room 900 even at night. In other implementations, camera 105 is a surveillance camera that receives only visible light. In still other implementations, the camera 105 may be a 3D sensor or a thermography camera. Sensor box 100 and camera 105 may be configured integrally or may be configured separately.

Doppler sensor 106 is, for example, a microwave Doppler sensor, and detects the behavior (movement) of objects in living room 900 by emitting and receiving radio waves. Thereby, the biometric information of the user 800 in the living room 900 can be detected. In one example, the Doppler sensor 106 emits microwaves in the 24 GHz band toward the bed 901 of each room 900, and receives the microwaves reflected by the user 800 (hereinafter referred to as "reflected waves"). The reflected waves undergo a Doppler shift due to the actions of the user 800. The Doppler sensor 106 can detect the breathing state and heart rate of the user 800 from the reflected waves. The Doppler sensor 106 corresponds to the sensor 110 that detects the motion of the user 800 shown in FIG. 2. In one aspect, the sensor box 100 may include any sensor other than the Doppler sensor 106 that detects the motion of the user 800.

Wireless communication device 107 receives each signal from vital sensor 400 and transmits the signal to control device 101. Vital sensor 400 transmits each detection output to wireless communication device 107.

The storage device 108 is, for example, a storage medium such as a hard disk or an external storage device. The storage device 108 can store the moving image data acquired by the camera 105 and the detection information of the Doppler sensor 106. In some aspects, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) may be used as the storage device 108.

The mobile terminal 300A displays operation records or activity records of the user 800. Furthermore, the mobile terminal 300A receives input of a record of rehabilitation motion from the user 800, and transmits the received record of the rehabilitation motion to the server device 200. The mobile terminal 300A includes a control device 301, a RAM 303, a communication interface 304, a display 305, an input device 306, a camera 307, and an internal memory 308.

Control device 301 controls mobile terminal 300A. Control device 301 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof. The RAM 303 temporarily stores programs and the like loaded from the internal memory 308. Control device 301 executes a program read into RAM 303.

Communication interface 304 is connected to an antenna (not shown) or the like. The mobile terminal 300A exchanges data with an external communication device via the antenna and the access point 13. External communication devices include, for example, the sensor box 100, the server device 200, and the like.

The display 305 is realized by, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. Input device 306 is realized, for example, by a touch sensor overlaid on display 305. The touch sensor accepts various operations on the mobile terminal 300A through touch operations, and outputs the contents of the operations to the control device 301. The display 305 may display a screen for inputting nursing care records, and may accept input of nursing care records from staff. The camera 307 (imaging device) can acquire moving image data as motion information of the user 800.

Internal memory 308 is, for example, a storage medium such as an eMMC (Embedded Multimedia Card). As an example, the internal memory 308 stores a program executed by the control device 301, but the program may be stored in a storage device other than the internal memory 308 as long as it is a storage device that can be accessed by the control device 301. Good too. For example, the program may be stored in a recording medium readable by the terminal device 300 (computer).

FIG. 4 is a diagram showing an example of the hardware configuration of the server device 200. With reference to FIG. 4, the hardware configuration of the server device 200 and the functions of each configuration will be described. The server device 200 may be a PC (Personal Computer) or a workstation, for example.

Server device 200 includes a control device 201, ROM 202, RAM 203, communication interface 204, display interface 205, operation interface 206, and storage device 207.

Control device 201 controls server device 200 . Control device 201 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

ROM 202 can store various programs and settings executed by control device 201. The RAM 203 temporarily stores programs loaded from the ROM 202 or the storage device 207. The control device 201 executes the program read into the RAM 203.

An antenna (not shown) or the like is connected to the communication interface 204. The server device 200 exchanges data with an external communication device via the antenna. External communication equipment includes, for example, sensor box 100 and mobile terminal 300A.

The display interface 205 is connected to the display 208 and sends an image signal for displaying an image to the display 208 according to a command from the control device 201 or the like. In one aspect, the display 208 may display the expected improvement value of each movement of the user 800, the rehabilitation plan, the rehabilitation record, and the like.

The operation interface 206 is, for example, a USB (Universal Serial Bus) terminal, and is connected to the input device 209. Operation interface 206 receives signals indicating user operations from input device 209 . The input device 209 is, for example, a mouse, a keyboard, a touch panel, or other device capable of accepting user input operations.

The storage device 207 is, for example, a storage medium such as a hard disk or an external storage device. The storage device 207 stores, for example, records of daily movements, records of rehabilitation movements, analysis results of movement records, expected improvement values of each movement of each user 800, records of rehabilitation of each user 800, and the like. In some aspects, an HDD or SSD may be used as storage device 207.

<Obtaining operation records or activity records>
Next, with reference to FIGS. 5 and 6, a process for acquiring operation records or activity records of the user 800 in the rehabilitation support system will be described.

FIG. 5 is a diagram showing an example of a record of daily activities. The example shown in FIG. 5 is the living room 900 viewed from the camera 105 of the sensor box 100 installed on the ceiling of the living room 900. The action line 500 represents a trajectory along which the user 800 has moved.

The sensor box 100 captures an image of the living room 900 using the camera 105. The sensor box 100 adds a time stamp, detection data of the sensor 110, etc. to the moving image data to generate a record of daily operations or daily activities. The sensor box 100 periodically transmits records of daily operations or daily activities to the server device 200.

The server device 200 analyzes the moving image data and the detection data of the sensor 110 included in the records of daily actions or daily activities, and extracts the behavioral guide line 500. Next, the server device 200 determines the walking speed of the user 800 in daily life based on the amount of change in the position of the user 800 based on the action line 500 and the time stamp when the position of the user 800 changes. Calculate. In one aspect, the sensor box 100 may calculate the walking speed of the user 800 in daily life, and transmit the calculation result to the server device 200.

FIG. 6 is a diagram illustrating an example of a record of rehabilitation motion. In the example shown in FIG. 6, a user 800 is undergoing walking rehabilitation while receiving guidance from a staff member. The sensor box 100 is provided on the ceiling of the rehabilitation room 950 similarly to the living room 900.

A user 800 walks from a start point 601 to a goal point 602 according to the staff's instructions. In one example, the rehabilitation motion of the user 800 is captured by the camera 307 of the mobile terminal 300A. In another example, the rehabilitation movement of the user 800 is captured by the camera 105 of the sensor box 100. A time stamp, detection data of the sensor 110, and the like are added to these moving image data to generate a record of the rehabilitation operation. The generated record of the rehabilitation motion is stored in the server device 200.

<Estimation of motion type>
FIG. 7 is a diagram illustrating an example of a method for estimating the posture of the user 800 (estimating the type of motion) in the rehabilitation support system according to the present embodiment. The server device 200 can estimate the type of movement of the user 800 by estimating the posture of the user 800 based on the movement record and detecting changes in the posture of the user 800. The user 800 posture estimation method includes the following four steps.

In step 810, the server device 200 extracts a plurality of images that are continuous in time series from the operation record. In a certain aspect, server device 200 may extract video for a certain period of time.

In step 820, the server device 200 identifies the user 800 included in each image extracted in step 810. In one aspect, server device 200 may identify user 800 included in the image using existing image recognition technology. In step 830, the server device 200 specifies the size of the head of the user 800 and the positions of the joints of the head and the whole body included in each image extracted in step 810.

In step 840, the server device 200 compares adjacent images in chronological order, and determines which images to use based on changes in the size of the user's 800 head and changes in the positional relationship between the head and the joints of the whole body. The motion of the person 800 is estimated. Each image is associated with a time stamp, and the server device 200 can also calculate the speed of the user's 800 movement based on the time stamp.

In one aspect, the server device 200 associates, in the storage device 207, pattern information of changes in the size of the user's 800 head, positional relationships between the head and the joints of the whole body, and the posture of the user 800. The first related information may be stored. In that case, the server device 200 can estimate the posture of the user 800 in each image based on the first related information. Furthermore, the server device 200 can estimate the type of motion of the user 800 based on the change in the posture of the user 800 in each image. As an example, if the posture of the user 800 changes from a sitting position to a standing position, the server device 200 estimates that the user 800 has performed the action "stand up".

<Functional configuration>
FIG. 8 is a functional block diagram for explaining the functional configurations of the sensor box 100, the server device 200, and the terminal device 300 that constitute the rehabilitation support system 1. As shown in FIG. 8, server device 200 includes an acquisition section 210 and an output section 220. Terminal device 300 (information processing device) includes an acquisition section 310, a display section 320, and an input section 330.

The acquisition unit 210 of the server device 200 acquires “activity data” from the sensor box 100 and also acquires “rehabilitation data” from the terminal device 300. In this specification, "activity data" is data obtained by recording the daily activities of the user 800 in the living room 900 using the sensor box 100. “Rehabilitation data” is data obtained by recording the rehabilitation activities of the user 800 in the rehabilitation room 950 for each predetermined rehabilitation item using the terminal device 300. Although not shown in FIG. 8, the "activity data" can also be acquired by the vital sensor 400. Further, "rehabilitation data" can also be acquired from the sensor box 100 provided in the rehabilitation room 950.

The output unit 220 of the server device 200 outputs the activity data and rehabilitation data acquired by the acquisition unit 210 to the terminal device 300 in response to a request from the terminal device 300. The acquisition unit 210 and output unit 220 of the server device 200 are included in the control device 201.

The activity data (first data) and rehabilitation data (second data) acquired by the acquisition unit 210 of the server device 200 are stored in the storage device 207.

The acquisition unit 310 of the terminal device 300 acquires the activity data (first data) and rehabilitation data (second data) output by the output unit 220 of the server device 200. The activity data and rehabilitation data acquired by the acquisition unit 310 are sent to the display unit 320.

The display unit 320 includes a display control unit 320A and a display 305. The display control unit 320A controls the display content on the display 305. Display 305 displays activity data and rehabilitation data in a way that allows them to be compared. The meaning of "comparable" here will be discussed later.

The input unit 330 includes an input receiving unit 330A and an input device 306. The input accepting unit 330A accepts information input via the input device 306. The input reception unit 330A transmits a request signal to the acquisition unit 210 of the server device 200 based on the information input to the input device 306. Activity data and rehabilitation data are transmitted from the output unit 220 of the server device 200 to the acquisition unit 310 of the terminal device 300 as a response signal to this request signal. The input reception unit 330A transmits a display selection signal to the display control unit 320A based on the information input to the input device 306. The display control unit 320A, based on the activity data (first data) and rehabilitation data (second data) received from the output unit 220 of the server device 200, and the display selection signal received from the input reception unit 330A, The content displayed on the display 305 is controlled.

The acquisition unit 310, display control unit 320A, and input reception unit 330A of the terminal device 300 are included in the control device 301.

<User interface (during rehabilitation)>
FIG. 9 is a diagram for explaining the operation of the terminal device when performing rehabilitation in a certain situation. In the example of FIG. 9, measurement of "walking speed" (walking training) is performed as the first rehabilitation item, and then "power rehabilitation" is performed as the second rehabilitation item. Here, "power rehabilitation" means rehabilitation using dumbbells.

As shown in FIG. 9, when measuring "walking speed" (first rehabilitation item), on the menu screen of the mobile terminal 300A shown in "1. (1)", select the main category "walking speed". Select. Next, when the user 800 passes the starting point 601 (FIG. 6), by selecting "START" as shown in "1. (2)", the "Time" in "1. (3)" "Measurement" is started. When the user 800 reaches the goal point 602 (FIG. 6), he selects "STOP" as shown in "1.(4)", thereby completing the "time measurement". When transmitting this record from the mobile terminal 300A to the server device 200, "Register" is selected, and when the "time measurement" is to be performed again, "Re-" is selected.

When implementing "power rehabilitation" (second rehabilitation item) following the measurement of "walking speed", select the major category "power rehabilitation" on the menu screen of the mobile terminal 300A shown in "2. (1)". do. After the screen "2. (2)" is displayed, enter the number of dumbbell lifting exercises (1 set, 2 sets) in "1. (3)". Thereafter, by selecting "Register" as shown in "2.(4)", the record of the number of dumbbell lifting exercises can be transmitted from the mobile terminal 300A to the server device 200.

By entering rehabilitation data for each predetermined item, such as the above-mentioned measurement of "walking speed" and "power rehabilitation," it is possible to suppress variations in entry style among recorders. As a result, highly reliable rehabilitation data can be obtained.

<User interface (displayed in "Comparable")>
10 and 11 are diagrams showing examples of screens displayed on the display 305. As shown in FIGS. 10 and 11, on the display 305, activity data 1000 (first data) obtained by recording the daily activities of the user 800 in the living room 900 and the rehabilitation room 950 of the user 800 are displayed. Rehabilitation data 2000 (second data) obtained by recording rehabilitation activities for each predetermined rehabilitation item (such as "walking speed" and "power rehabilitation") is displayed in an overlapping manner. This allows the activity data 1000 and the rehabilitation data 2000 to be visually compared.

However, "display in a comparable manner" is not limited to this, and for example, a plurality of activity data 1000 and a plurality of rehabilitation data 2000 may be displayed in an overlapping manner on the display 305.

In the example of FIG. 10, activity data 1000 indicating the "activity amount" (distance of the behavioral line 500 in one month) of the user 800 in the living room 900 is displayed as the "daily activity index" information, and the "rehabilitation item" As the information, rehabilitation data 2000 indicating the number of units (one month) of joint range of motion exercises is displayed. Activity data 1000 and rehabilitation data 2000 are displayed overlappingly.

According to the results shown in FIG. 10, 1 to 2 months after the months in which "joint range of motion exercises" were performed relatively frequently as rehabilitation activities (January, May to July, November), the number of users 800 in living room 900 It can be confirmed that the "activity level" of

In the example of FIG. 11, the sleep status of the user 800 in the room 900 recorded by the sensor box 100 (nighttime sleep, nighttime awakening, daytime sleep, daytime sleep, The activity data 1000 indicating each time of awakening is displayed, and the item selected from the menu items (rehabilitation frequency, walking training, muscle strengthening, etc.) (in the example of FIG. 11, the rehabilitation frequency) is displayed as the "rehabilitation item" information. ) is displayed. Activity data 1000 and rehabilitation data 2000 are displayed overlappingly.

According to the results shown in Figure 11, in the weeks in which rehabilitation was performed relatively frequently (April 1st week, April 4th week), nighttime sleep time was relatively long and daytime sleep time was relatively short. This can be confirmed.

Regarding the above-mentioned contents, each user 800 may show a different tendency. Based on the results shown in FIGS. 10 and 11, the rehabilitation plan for each user 800 can be appropriately reviewed.

<Processing flow>
FIG. 12 is a sequence diagram showing the flow of the information processing method executed in the rehabilitation support system. As shown in FIG. 12, activity data and rehabilitation data are transmitted from the sensor box 100 and the terminal device 300 to the server device 200. In sequence SQ1, the terminal device 300 receives an input specifying a display target (user ID, date and time, daily activity index, rehabilitation item, etc.).

In sequence SQ2, terminal device 300 transmits a request signal to server device 200 based on an input specifying a display target. In sequence SQ3, server device 200 extracts activity data and rehabilitation data to be displayed based on the request signal. In sequence SQ4, server device 200 transmits a response signal (a signal including activity data and rehabilitation data) to terminal device 300. In sequence SQ5, terminal device 300 displays activity data and rehabilitation data according to the input.

<Program>
The internal memory 308 of the terminal device 300 stores a program for executing the above-described information processing in the control device 301. The program stored in the internal memory 308 is obtained by recording the activity data 1000 obtained by recording the daily activities of the user 800 and the rehabilitation activities of the user 800 for each predetermined rehabilitation item. The control device 301 (processor) of the terminal device 300 is caused to execute the steps of acquiring the rehabilitation data 2000 and displaying the activity data 1000 and rehabilitation items specified in the rehabilitation data 2000 in a comparative manner.

<Summary>
The above-mentioned exemplary content can be summarized as follows. The rehabilitation support system 1 (information processing system) includes a sensor box 100 and a vital sensor (recording device) that record the daily activities of a user 800 (care recipient), and a server device 200 that acquires the recording results of the sensor box 100. , a terminal device 300 (information processing device) capable of communicating with a server device 200. Note that the terminal device 300 also functions as a device (recording device) that records the rehabilitation activities of the user 800.

The terminal device 300 stores activity data 1000 (first data) obtained by recording the daily activities of the user 800 in the living room 900 and predetermined rehabilitation items for the rehabilitation activities in the rehabilitation room 950 of the user 800. an acquisition unit 310 that acquires rehabilitation data 2000 (second data) obtained by recording each activity; and a display that allows comparison between the activity data 1000 and specified rehabilitation items of the rehabilitation data 2000. 320.

In the examples shown in FIGS. 10 and 11, the activity data 1000 and the rehabilitation data 2000 are displayed in an overlapping manner, so that the activity data 1000 and the rehabilitation data 2000 are outputted so that they can be compared with each other.

In one example, the activity data 1000 includes information on changes over time regarding predetermined indicators (eg, activity level, sleep time, etc.). More specifically, the activity data 1000 may include at least one index of the user's 800 sleeping time, sleep state, number of times of getting up, number of times of getting out of bed, heart rate, and breathing rate.

Rehabilitation data 2000 may include information on changes over time (for example, changes over time in the number of times rehabilitation is performed) regarding predetermined rehabilitation items. Rehabilitation data 2000 may include any one of the number of times and amount of rehabilitation items performed.

In one example, recording the daily activities of the user 800 includes obtaining biometric information, body position information, or location information of the user 800.

In one example, the rehabilitation activities of the user 800 are recorded by inputting the rehabilitation activities of the user 800 into the terminal device 300 for each predetermined item.

According to the present embodiment, activity data 1000 obtained by recording the daily activities of the user 800 in the room 900 and rehabilitation data obtained by recording the rehabilitation activities of the user 800 in the rehabilitation room 950. By displaying 2000 in a visually comparable manner, it becomes easier to check and compare the trends in the activities of the user 800 in the living room 900 and the trends in the rehabilitation records of the user 800 in the rehabilitation room 950. It becomes easier to appropriately review plans. In addition, by recording rehabilitation activities for each predetermined rehabilitation item, it is possible to suppress variations in filling formats among recorders, and therefore highly reliable rehabilitation data 2000 can be obtained.

Although the embodiments of the present technology have been described above, the embodiments disclosed this time should be considered to be illustrative in all respects and not restrictive. The scope of the present technology is indicated by the claims, and it is intended that all changes within the meaning and range equivalent to the claims are included.

1 rehabilitation support system, 10 facility, 11 gateway server, 12 exchange device, 13 access point, 100 sensor box, 101 control device, 102 ROM, 103 RAM, 104 communication interface, 105 camera, 106 Doppler sensor, 107 wireless communication device, 108 storage device, 110 sensor, 200 server device, 201 control device, 202 ROM, 203 RAM, 204 communication interface, 205 display interface, 206 operation interface, 207 storage device, 208 display, 209 input device, 210 acquisition unit, 220 output Department, 300 Terminal device, 300A, 300A1, 300A2 Mobile terminal, 300B Administrator terminal, 301 Control device, 303 RAM, 304 Communication interface, 305 Display, 305A First display area, 305B Second display area, 306 Input device, 307 Camera, 308 Internal memory, 310 Acquisition unit, 320 Display unit, 320A Display control unit, 330 Input unit, 330A Input reception unit, 400 Vital sensor, 500 Action guide, 601 Start point, 602 Goal point, 800, 800A, 800B Use person, 900 living room, 901 bed, 950 rehabilitation room, 1000 activity data, 2000 rehabilitation data.

Claims (12)

Obtaining first data obtained by recording the daily activities of the cared person and second data obtained by recording the rehabilitation activities of the cared person for each predetermined rehabilitation item. an acquisition unit to
An information processing apparatus, comprising: a display unit that displays the first data and the rehabilitation item specified in the second data in a comparative manner. The above-mentioned output that can be compared is
The information processing apparatus according to claim 1, further comprising displaying the first data and the second data in an overlapping manner. The first data includes information on changes over time regarding a predetermined index,
The information processing apparatus according to claim 1 or 2, wherein the second data includes information on changes over time regarding the predetermined rehabilitation items. The information according to claim 1 or 2, wherein the first data includes at least one index of sleep time, sleep state, number of times of getting up, number of times of getting out of bed, heart rate, and breathing rate of the cared person. Processing equipment. 3. The information processing apparatus according to claim 1, wherein recording the daily activities of the cared person includes acquiring biological information, body position information, or position information of the cared person. The information processing apparatus according to claim 1 or 2, wherein the second data includes any one of the number of times and the amount of the rehabilitation item. The information according to claim 1 or 2, wherein recording the rehabilitation activities of the cared person includes inputting the rehabilitation activities of the cared person for each predetermined item into the information processing device. Processing equipment. The information processing device is a terminal device,
The information processing apparatus according to claim 1 or 2, wherein the acquisition unit acquires the first data and the second data from a server device communicatively connected to the terminal device. Obtaining first data obtained by recording the daily activities of the cared person and second data obtained by recording the rehabilitation activities of the cared person for each predetermined rehabilitation item. the step of
A program for causing a processor of an information processing device to execute a step of displaying the first data and the rehabilitation item specified in the second data in a comparative manner. A computer-readable recording medium storing the program according to claim 9. a recording device that records the activities of the care recipient;
a server device that acquires recording results of the recording device;
comprising a terminal device capable of communicating with the server device,
The terminal device is
The first data obtained by recording the daily activities of the cared person and the second data obtained by recording the rehabilitation activities of the cared person for each predetermined rehabilitation item. obtained from the server device,
An information processing system that displays the first data and the rehabilitation item specified in the second data so as to be comparable. Obtaining first data obtained by recording the daily activities of the cared person and second data obtained by recording the rehabilitation activities of the cared person for each predetermined rehabilitation item. the step of
An information processing method, comprising the step of displaying the first data and the rehabilitation item specified in the second data so that they can be compared.

Images