WO2023281800A1 - Système de traitement d'informations, procédé de traitement d'informations et programme - Google Patents

Système de traitement d'informations, procédé de traitement d'informations et programme Download PDF

Info

Publication number
WO2023281800A1
WO2023281800A1 PCT/JP2022/006924 JP2022006924W WO2023281800A1 WO 2023281800 A1 WO2023281800 A1 WO 2023281800A1 JP 2022006924 W JP2022006924 W JP 2022006924W WO 2023281800 A1 WO2023281800 A1 WO 2023281800A1
Authority
WO
WIPO (PCT)
Prior art keywords
patient
information
monitoring
real
unit
Prior art date
Application number
PCT/JP2022/006924
Other languages
English (en)
Japanese (ja)
Inventor
宇紀 深澤
弘泰 馬場
穂 高橋
Original Assignee
ソニーグループ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーグループ株式会社 filed Critical ソニーグループ株式会社
Publication of WO2023281800A1 publication Critical patent/WO2023281800A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Definitions

  • the present disclosure relates to an information processing system, an information processing method, and a program, and more particularly to an information processing system, an information processing method, and a program that can improve the efficiency of monitoring work.
  • ICU Intensive Care Unit
  • nurses monitor the condition of patients in the ICU (hereinafter referred to as ICU patients), and the monitored contents are recorded in electronic or paper media.
  • ICU patients Intensive Care Unit
  • a confirmation screen can be displayed that the caregiver uses to confirm that the patient's vital signs data should be charted in the patient's EMR.
  • a hospital bed with a graphical user interface is disclosed.
  • ICU patients have a higher risk of sudden changes in their condition than those in general wards, and more monitoring is required for condition management, so there is a need to improve the efficiency of the monitoring work performed by nurses of ICU patients.
  • ICU patients have a high risk of sudden changes in their condition, and it is important to monitor them at the appropriate time and record the results. Business efficiency is required.
  • This disclosure has been made in view of this situation, and is intended to make it possible to improve the efficiency of monitoring operations.
  • An information processing system provides real-time information obtained by monitoring a patient in real time with a relatively short measurement cycle, and monitoring the patient at intervals with a relatively long measurement cycle.
  • a data processing unit that acquires the interval information obtained by analyzing the signal obtained by sensing the patient; and a display that causes the display unit to display the real-time information and the interval information in a display layout in which the real-time information and the interval information are displayed in different display areas.
  • a display control unit that performs control, and when there is a specific update in the real-time information and the interval information, the display control unit is controlled to notify that the update has occurred, and the notification is confirmed. and a control unit for performing control to record the confirmation content in the recording unit in response to the confirmation.
  • An information processing method or program includes real-time information obtained by monitoring a patient in real time with a relatively short measurement cycle, and monitoring the patient at intervals with a relatively long measurement cycle. acquiring the interval information obtained by performing data processing for analyzing the signal obtained by sensing the patient; and displaying the real-time information and the interval information on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas. and, when there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and when the notification is confirmed, the confirmation content is confirmed. This includes controlling recording in the recording unit.
  • real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle.
  • real-time information and interval information acquired by data processing that analyzes a signal obtained by sensing a patient, and are displayed on the display unit in a display layout in which the real-time information and the interval information are displayed in different display areas. Then, when there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control is performed to record the confirmation content in the recording unit in response to the confirmation of the notification. is done.
  • FIG. 10 is a diagram showing a first display example of a monitoring screen; It is a block diagram which shows the structural example of an information processing apparatus. 4 is a flowchart for explaining monitoring processing; FIG. 11 is a flowchart for explaining work confirmation processing when there is a change in posture; FIG. It is a figure which shows the example of a display of a work content confirmation screen.
  • FIG. 10 is a diagram showing a second display example of the monitoring screen; It is a figure which shows the display content of each icon. It is a figure explaining the remote evaluation using a monitoring system. It is a figure which shows an example of an evaluation index.
  • 1 is a block diagram showing a configuration example of an embodiment of a computer to which the present technology is applied; FIG.
  • FIG. 1 is a diagram showing a configuration example of an embodiment of a monitoring system to which the present technology is applied.
  • the monitoring system 11 shown in FIG. 1 includes a vital sensor 12, an imaging system 13, a millimeter wave radar 14, a display device 15, and an information processing device 16.
  • the vital sensor 12 measures the ICU patient's vital signs (for example, pulse, blood pressure, body temperature, etc.) and supplies the information processing device 16 with a vital sign measurement signal obtained as a result of the measurement.
  • vital signs for example, pulse, blood pressure, body temperature, etc.
  • the imaging system 13 is composed of multiple RGB cameras. For example, each RGB camera captures video for monitoring ICU patients, video for monitoring infusion and drainage, and so on. Then, the imaging system 13 supplies video signals obtained by imaging them to the information processing device 16 .
  • the millimeter-wave radar 14 transmits and receives electromagnetic waves in the millimeter-wave frequency band that are capable of detecting the movement of the body surface of the ICU patient, for example, through blankets and clothing, in order to measure the thoracic fluctuation pattern of the ICU patient. do. Then, the millimeter wave radar 14 supplies the information processing device 16 with a millimeter wave measurement signal obtained as a result of receiving the electromagnetic waves reflected by the body surface of the ICU patient.
  • the display device 15 displays a monitoring screen (see FIG. 2 described later) for monitoring ICU patients in the monitoring system 11 according to display control by the information processing device 16 .
  • the information processing device 16 uses the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave measurement signal supplied from the millimeter wave radar 14 to monitor the ICU patients. Executes information processing that performs various types of analysis. Then, the information processing device 16 displays the analysis result obtained by executing the information processing on the monitoring screen of the display device 15 .
  • FIG. 2 is a diagram showing a first display example of the monitoring screen displayed on the display device 15. As shown in FIG.
  • the monitoring screen 21 includes an attribute data display image 31, a vital signs monitoring image 32, a monitoring video 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, and a sedation level.
  • a monitoring image 37 and a postural change monitoring image 38 are displayed.
  • the attribute data display image 31 displays data indicating the attributes of the ICU patient being monitored, such as the current date and time, patient name, age, gender, and weight.
  • the vital sign monitoring image 32 displays the ICU patient's vital signs measured by the vital sensor 12, for example, ECG (Electrocardiogram), SpO2 (Saturation of Percutaneous Oxygen), and RESP (Respiratory) are displayed.
  • ECG Electrocardiogram
  • SpO2 SpO2
  • RESP Respiratory
  • the monitoring image 33 an image for monitoring the ICU patient imaged by the RGB camera of the imaging system 13 is displayed.
  • the respiration monitoring image 34 includes the image of the ICU patient captured by the RGB camera of the imaging system 13 and the chest fluctuation pattern of the ICU patient measured by the millimeter wave radar 14, and analyzed by the information processing device 16.
  • the ICU patient's breathing rate and breathing pattern are displayed.
  • the water balance monitoring image 35 displays changes in the water balance of the ICU patient analyzed by the information processing device 16 based on the video for monitoring the infusion and drainage captured by the RGB camera of the imaging system 13. be.
  • a bar graph showing the amount of water taken in by the ICU patient due to medication and the amount of water discharged from the ICU patient due to urination etc.
  • a line graph is displayed showing the water balance determined based on the difference in the intake and output of .
  • the urine/drainage monitoring image 36 shows changes in urine color and drainage of the ICU patient analyzed by the information processing device 16 based on the images for monitoring the infusion and drainage captured by the RGB camera of the imaging system 13 . Discharge color change is displayed. For example, in the illustrated display example, a bar graph indicating the amount of urine and drain fluid is displayed in a color (hatched in the figure) corresponding to the color of the measured urine and drain fluid at each hourly measurement cycle. It is
  • the sedation monitoring image 37 displays the change in the sedation level of the ICU patient analyzed by the information processing device 16 based on the image of the ICU patient captured by the RGB camera of the imaging system 13 .
  • a line graph is displayed showing the degree of sedation obtained by setting the score to 0 when the ICU patient is at rest at an hourly measurement cycle.
  • the posture change monitoring image 38 displays the progress of the ICU patient's posture change analyzed by the information processing device 16 based on the ICU patient's image captured by the RGB camera of the imaging system 13 .
  • the progress of the ICU patient's position change is displayed at an hourly measurement cycle, along with the time and position of the previous position change, and the time of the next scheduled position change. and posture are displayed.
  • real-time information the vital signs, monitoring images, respiration rate and respiration pattern that are monitored in real time with a relatively short measurement period such as less than several seconds.
  • water balance, drainage change, sedation level, and postural change monitored at relatively long measurement intervals such as one-hour intervals are referred to as interval information.
  • a vital signs monitoring image 32, a monitoring video 33, and a respiration monitoring image 34 corresponding to real-time information are collectively displayed in a real-time information display area 41.
  • a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation monitoring image 37, and a postural change monitoring image 38 corresponding to the interval information are collectively displayed in the interval information display area 42.
  • an unread mark 43 is displayed to notify that there is unconfirmed update information.
  • the unread mark 43 is displayed when there is a specific update (an update in which a large change equal to or greater than a predetermined threshold is detected) in real-time information and interval information.
  • an unread mark 43 is displayed on the urine/effluent monitoring image 36 to notify that a change in the color or amount of urine or effluent requiring notification to the nurse has occurred. be.
  • the confirmation information indicating that the nurse has confirmed the contents of the update information (the time the nurse confirmed the update contents, the name of the nurse, the contents of the update information) is It is automatically recorded in the EMR (Electronic Medical Record) of the recording unit 53 in FIG.
  • nurses can collectively check real-time information and interval information in addition to ICU patient attribute information.
  • the unread mark 43 it is possible to clarify that there is unconfirmed update information, thereby avoiding the risk of the nurse overlooking the update information.
  • a vital signs monitoring image 32, a monitoring image 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation The display of the degree monitoring image 37 and the postural change monitoring image 38 is automatically adjusted. For example, important monitoring items can be displayed in a large size, and unnecessary monitoring items can be hidden. For example, these items may be flexibly replaced depending on sensing devices (cameras, sensors, etc.) configuring the monitoring system 11 .
  • each notification includes a vital signs monitoring image 32, a monitoring image 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation monitoring image 37, and a postural change monitoring image 38, respectively. is performed on This allows the nurse to easily recognize which items should be checked.
  • notifications are made through visual changes, such as the frame of each image shining or a red circle being displayed within the frame.
  • the number of unread notices numerically like the unread mark 43A in FIG. 8, which will be described later, the nurse can easily grasp the types and total number of unconfirmed items.
  • notifications may also be made, for example, by a mobile terminal (for example, a smartphone application) carried by the nurse.
  • a mobile terminal for example, a smartphone application
  • FIG. 3 is a block diagram showing a configuration example of the information processing device 16. As shown in FIG.
  • the information processing device 16 includes a signal acquisition unit 51, a memory 52, a recording unit 53, a central control unit 54, a display control unit 55, and a data processing unit 56.
  • the signal acquisition unit 51 acquires the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave measurement signal supplied from the millimeter wave radar 14, and sends them to the central control unit 54. supply. Further, for example, when an operation input unit (not shown) such as a touch panel or a button is operated by a nurse, the signal acquisition unit 51 acquires an operation signal corresponding to the operation, and the central control unit 54 supply to
  • the memory 52 is composed of ROM (Read Only Memory), RAM (Random Access Memory), etc., and stores various data that need to be temporarily stored when the central control unit 54 performs control.
  • the recording unit 53 is composed of, for example, an HDD (Hard Disk Drive) or the like, and records information that needs to be retained in the monitoring system 11 in the EMR under the control of the central control unit 54.
  • HDD Hard Disk Drive
  • the central control unit 54 is composed of a CPU (Central Processing Unit) and controls each block of the information processing device 16 .
  • the central control unit 54 causes the recording unit 53 to record the vital signs measurement signal supplied from the signal acquiring unit 51 and supplies the display control unit 55 with the vital signs monitoring image 32 to display the vital signs.
  • the central control unit 54 also supplies the video signal supplied from the signal acquisition unit 51 to the display control unit 55 to display the image of the ICU patient on the monitoring image 33 .
  • the central control unit 54 supplies the video signal and the millimeter wave measurement signal supplied from the signal acquisition unit 51 to the data processing unit 56 to perform various analyzes necessary for monitoring the ICU patient. The result is supplied to the display control section 55 .
  • the display control unit 55 controls the display on the display device 15 and displays the monitoring screen 21 according to the control by the central control unit 54 .
  • the data processing unit 56 is composed of a respiration analysis unit 61, a liquid state analysis unit 62, a sedation analysis unit 63, and a postural transformation analysis unit 64.
  • the respiration analysis unit 61 uses video signals and millimeter wave measurement signals to non-contactly analyze the respiration rate and respiration pattern of ICU patients.
  • ICU patients often receive respiratory management using artificial respirators and oxygen masks, and it is assumed that there are many cases in which the respiratory rate is already being monitored.
  • breathing patterns manifested in the ribcage and neck muscles are currently visually confirmed.
  • constant non-contact monitoring makes it easier to manage the condition of ICU patients.
  • the respiratory analysis unit 61 performs image recognition processing on the video signal, recognizes a predetermined part of the ICU patient (for example, the chest and neck), extracts the measurement target, and measures the amount of movement of the measurement target in millimeters. wave measurement signal. For example, when the body of the ICU patient moves, artifact correction of the millimeter wave measurement signal can be performed by re-extracting the measurement target based on the video signal of the respiratory analysis unit 61 . Then, the respiration analysis unit 61 can analyze the respiration rate and respiration pattern of the ICU patient based on the variation of the millimeter wave measurement signal, that is, based on the variation of the ICU patient's chest and neck associated with respiration. .
  • the imaging system 13 and the millimeter wave radar 14 are used so that the respiratory analysis unit 61 can extract the measurement target based on the video signal, thereby avoiding such erroneous detection. can do. Therefore, in the monitoring system 11, it is possible to improve the detection accuracy of the thorax variation pattern.
  • a method for non-contact analysis of respiration of an ICU patient using the imaging system 13 and the millimeter wave radar 14 has been described, but other methods may be used.
  • an RGB-D camera capable of acquiring depth information as well as color images may be used to measure neck muscle movement that appears during forced breathing, and the measurement signal may be analyzed to evaluate respiration.
  • the wavelength range of the RGB-D camera cannot penetrate the futon, the measurement is performed with the neck muscles as the measurement target.
  • the analysis results of the respiratory rate and respiratory pattern of the ICU patient analyzed by the respiratory analysis unit 61 are supplied to the display control unit 55 via the central control unit 54 and displayed on the respiratory monitoring image 34 of the monitoring screen 21. .
  • the situations in which the ICU patient's breathing is sensed without contact are assumed to be cases in which the ICU patient can breathe spontaneously, and cases in which the ICU patient is fitted with a ventilator.
  • image recognition processing is performed based on the video signal to recognize the predetermined parts related to breathing of the ICU patient (for example, the chest and neck) and ROI (Region of Interest). Then, the amount of motion in the ROI is acquired using the millimeter wave radar 14 and the RGB-D camera, and if there is body motion of the ICU patient, artifact correction is performed by image recognition processing based on the video signal, Respiratory rates and patterns of ICU patients can be analyzed.
  • the ROI for the object to be measured it is possible to reduce the amount of output data, increase the speed, and reduce power consumption.
  • the influence of disturbance can be reduced and the measurement target can be reliably measured.
  • the setting of the ventilator is acquired from the video signal or external input, and the respiratory rate of the ICU patient is calculated as in the case where the ICU patient can breathe spontaneously. and analyze breathing patterns. Then, based on this analysis result, FFT (Fast Fourier Transform), machine learning, etc. can be used to separate spontaneous respiration and artificial respiration. For example, when spontaneous respiration remains or spontaneous respiration returns, weaning from artificial respiration can be performed more safely by distinguishing between spontaneous respiration and artificial respiration.
  • FFT Fast Fourier Transform
  • the liquid state analysis unit 62 uses video signals to analyze the ICU patient's water balance, urine color, and drain discharge color.
  • the RGB camera of the imaging system 13 captures images for monitoring the infusion and drainage.
  • the first RGB camera captures an image of the periphery of an infusion pump, a syringe, and the like
  • the second RGB camera captures the periphery of a drainage chamber.
  • the liquid state analysis unit 62 analyzes the video signal for monitoring the infusion ingested by the ICU patient to obtain the infusion volume, and analyzes the video signal for monitoring the drainage (urine and drain) discharged from the ICU patient. to determine the drainage volume, and the patient's fluid balance can be obtained based on the difference between the infusion volume and the drainage volume.
  • the liquid state analysis unit 62 can perform image recognition (for example, optical character recognition) on the video signal for monitoring the infusion to recognize the name and flow rate of the medicine printed on the infusion pack.
  • image recognition for example, optical character recognition
  • the liquid state analysis unit 62 can record the name and flow rate of the recognized medicine in the EMR of the recording unit 53 .
  • the analysis results of the ICU patient's water balance, urine color, and drain discharge color analyzed by the liquid state analysis unit 62 are supplied to the display control unit 55 via the central control unit 54, and the water content of the monitoring screen 21 is displayed. It is displayed on the balance monitoring image 35 and the urine/discharge monitoring image 36 .
  • the liquid state analysis unit 62 analyzes the symptoms that the ICU patient may be developing based on the color of the drainage, and presents the analysis result to the nurse by displaying it on the monitoring screen 21. You may
  • the sedation analysis unit 63 uses video signals to analyze the sedation of ICU patients.
  • the sedation analysis unit 63 uses RASS (Richmond Agitation-Sedation Scale), which is an index of sedation evaluation, to analyze the appearance of ICU patients such as facial expressions, behaviors, and gazes. By analyzing the voice that is the content of the answer given by the user, it is possible to automatically calculate it.
  • RASS Random Agitation-Sedation Scale
  • the analysis result of the sedation level of the ICU patient analyzed by the sedation level analysis unit 63 is supplied to the display control unit 55 via the central control unit 54 and displayed on the sedation monitoring image 37 of the monitoring screen 21.
  • the postural change analysis unit 64 uses the video signal to analyze the postural change of the ICU patient. For example, the postural change analysis unit 64 analyzes the video signal using an analysis method based on machine learning (Open Pose, etc.), which is a known technology, and estimates the posture of the ICU patient or nurse, so that the postural change is performed. It is possible to determine whether
  • the analysis result of the ICU patient's postural change analyzed by the postural change analysis unit 64 is supplied to the display control unit 55 via the central control unit 54 and displayed on the postural change monitoring image 38 of the monitoring screen 21.
  • the information processing device 16 is configured as described above, and the monitoring screen 21 shown in FIG. Can be recorded in EMR. As a result, nurses can effectively monitor ICU patients, and by improving the efficiency of monitoring work, it is possible to reduce the workload of nurses.
  • the process is started, and in step S11, the signal acquisition unit 51 acquires the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave radar 14.
  • the supplied millimeter wave measurement signal is acquired and supplied to the central control unit 54 .
  • the central control unit 54 supplies the video signal and the millimeter wave measurement signal to the data processing unit 56 .
  • step S ⁇ b>12 the central control unit 54 causes the recording unit 53 to record the vital sign measurement signal supplied from the signal acquisition unit 51 in step S ⁇ b>11 , and supplies the signal to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the display of vital signs in the vital signs monitoring image 32 displayed on the monitoring screen 21 .
  • step S13 the central control unit 54 supplies the video signal supplied from the signal acquisition unit 51 in step S11 to the display control unit 55.
  • the display control unit 55 controls the display on the display device 15 and updates the display of the ICU patient image in the monitoring image 33 displayed on the monitoring screen 21 .
  • step S14 in the data processing unit 56, the respiration analysis unit 61 uses the video signal and millimeter-wave measurement signal supplied from the central control unit 54 in step S11 to calculate the respiration rate and respiration pattern of the ICU patient as described above. is analyzed, and the analysis result is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis result of the respiratory rate and breathing pattern of the ICU patient, and supplies the result to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the display of the respiratory rate and respiratory pattern in the respiratory monitoring image 34 displayed on the monitoring screen 21 .
  • step S15 in the data processing unit 56, the liquid state analysis unit 62 uses the video signal supplied from the central control unit 54 in step S11 to determine the water balance, urine color, and drain discharge of the ICU patient as described above.
  • the liquid color is analyzed and the analysis result is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis results of the ICU patient's water balance, urine color, and drain discharge color, and supplies them to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15, updates the display of the water balance in the water balance monitoring image 35 displayed on the monitoring screen 21, and adjusts the urine color and drain discharge in the urine/discharge monitoring image 36. Update liquid color display.
  • step S16 in the data processing unit 56, the sedation analysis unit 63 uses the video signal supplied from the central control unit 54 in step S11 to analyze the sedation of the ICU patient as described above. is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis result of the sedation level of the ICU patient, and supplies the result to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the sedation level display in the sedation level monitoring image 37 displayed on the monitoring screen 21 .
  • step S17 in the data processing unit 56, the postural change analysis unit 64 uses the video signal supplied from the central control unit 54 in step S11 to analyze the postural change of the ICU patient as described above. is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis result of the postural change of the ICU patient, and supplies the result to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the display of the postural change in the postural change monitoring image 38 displayed on the monitoring screen 21 .
  • step S18 the central control unit 54 needs to notify the nurse of vital signs, monitoring images, respiration rate and respiration pattern, water balance, urine color, drain color, sedation level, and postural change. It is determined whether or not there has been an information update with a change.
  • step S18 if the central control unit 54 determines that there is no information update with a change requiring notification to the nurse, the process returns to step S11, and the same process is repeated thereafter. On the other hand, if the central control unit 54 determines in step S18 that there is an information update that causes a change requiring notification to the nurse, the process proceeds to step S19.
  • step S19 the central control unit 54 determines that there is information update among vital signs, monitoring images, respiration rate and respiration pattern, water balance, urine color, drain color, sedation level, and postural change.
  • the target to be displayed is notified to the display control unit 55 .
  • the display control unit 55 displays the vital signs monitoring image 32, the monitoring video 33, the respiration monitoring image 34, the water balance monitoring image 35, the urine/discharge monitoring image 36, the sedation monitoring image 37, and the postural change monitoring image 38, an unread mark 43 notifying that there is unconfirmed update information is displayed.
  • the signal acquisition unit 51 acquires the operation signal and supplies it to the central control unit 54.
  • the central control unit 54 controls the display control unit 55 to display the contents of the update information on the monitoring screen 21 .
  • step S20 the central control unit 54 causes the recording unit 53 to record confirmation information indicating that the nurse has confirmed the content of the update information displayed on the monitoring screen 21 in step S19. After that, the process returns to step S11, and the same process is repeated thereafter. Note that the processing of steps S12 to 14 is performed at relatively short measurement intervals corresponding to the timing at which the signal acquisition unit 51 acquires signals, and the processing of steps S15 to 17 is performed at relatively long intervals such as one hour intervals. This is done at the measurement cycle.
  • the monitoring system 11 when the information processing device 16 executes the monitoring process, the monitoring system 11 notifies the nurse with the unread mark 43 when there is an information update that causes a change requiring notification to the nurse. Only by confirming the contents of the update information by the teacher, the confirmation information can be automatically recorded. Thereby, the monitoring system 11 can improve the efficiency of the monitoring work.
  • FIG. 5 is a flow chart explaining the work confirmation process when there is a position change.
  • step S31 the postural transformation analysis unit 64 analyzes the video signal using an analysis technique based on machine learning (Open Pose, etc.), which is a known technique, and estimates the posture of the ICU patient or nurse.
  • machine learning Open Pose, etc.
  • step S32 the postural change analysis unit 64 determines whether or not the ICU patient's postural change has occurred based on the posture estimated in step S31.
  • step S32 if the postural change analysis unit 64 determines that the ICU patient's postural change has not occurred, the process returns to step S31, and the same process is repeated thereafter. On the other hand, in step S32, when the postural change analysis unit 64 determines that the ICU patient's postural change has occurred, the process proceeds to step S33.
  • step S33 the postural change analysis unit 64 notifies the central control unit 54 that it has determined that the ICU patient's postural change has occurred.
  • the central control unit 54 controls the display control unit 55 so that the work content confirmation screen 22 as shown in FIG. 6 is superimposed on the monitoring screen 21 and displayed.
  • the work content confirmation screen 22 displays the time when it was determined that the ICU patient's position was changed, and a user interface (Yes/No) for confirming the presence or absence of the position change.
  • the signal acquisition unit 51 acquires the operation signal and the central control unit 54, and the central control unit 54 recognizes the contents of the operation by the nurse.
  • step S34 the central control unit 54 causes the EMR of the recording unit 53 to record the operation details of the work content confirmation screen 22 by the nurse and the work details of the postural change of the ICU patient (postural change implementation time, postural position, etc.). .
  • step S ⁇ b>35 the central control unit 54 controls the display control unit 55 to update the posture change display in the posture change monitoring image 38 displayed on the monitoring screen 21 of the display device 15 . After that, the process returns to step S31, and the same process is repeated thereafter.
  • FIG. 7 is a diagram showing a second display example of the monitoring screen displayed on the display device 15. As shown in FIG.
  • the monitoring system 11 is assumed to be used by a nurse to monitor multiple ICU patients with one display device 15, and the display device 15 displays a monitoring screen 23 as shown in FIG. be.
  • the monitoring screen 23 basically, vital sign monitoring images 32, which are highly important information, are displayed side by side along with a plurality of patient names.
  • the nurse can switch the images corresponding to the icons 71 to 76 from the vital sign monitoring image 32 and display them.
  • FIG. 7 shows a display example of the monitoring screen 23 when monitoring three ICU patients (Patient A, Patient B, and Patient C) with one display device 15 . That is, basically, on the monitoring screen 23, a vital signs monitoring image 32A of patient A, a vital signs monitoring image 32B of patient B, and a vital signs monitoring image 32C of patient C are displayed side by side.
  • an icon 71A for displaying the monitoring image 33 of the patient A an icon 72A for displaying the water balance monitoring image 35 of the patient A, urine and drainage monitoring of the patient A
  • An icon 73A for displaying the image 36 an icon 74A for displaying the respiratory monitoring image 34 of the patient A, an icon 75A for displaying the sedation monitoring image 37 of the patient A, and a postural change monitoring image of the patient A.
  • An icon 76A for displaying 38 is displayed.
  • icons 71B to 76B are displayed below the vital signs monitoring image 32B
  • icons 71C to 76C are displayed below the vital signs monitoring image 32C.
  • the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the same image tab as the monitoring image 33 (FIG. 8).
  • the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the moisture balance tab (FIG. 8) similar to the moisture balance monitoring image 35.
  • the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the drainage tab (FIG. 8) similar to the urine/drainage monitoring image 36.
  • the icon 73A displays an unread mark 43A notifying that there is one unconfirmed update information, and the same unread mark 43A is displayed on the drainage tab shown in FIG. is displayed.
  • the monitoring system 11 can monitor multiple ICU patients with a single display device 15, and can clearly notify which items are unconfirmed by the unread marks 43A. As a result, the nurse can appropriately confirm the contents of the update information, and the efficiency of the monitoring work can be improved.
  • the display device 15 is configured with a patient camera 81 , line-of-sight detection sensor 82 , and microphone 83 . Then, the monitoring system 11 can connect the information processing device 16 to the remote monitoring terminal 91 via a network and allow communication to be performed.
  • the monitoring terminal 91 has the same function as the sedation analysis unit 63, and analyzes the video and audio signals when the nurse evaluates the sedation of the ICU patient via the network, automatically sedation may be calculated.
  • the score of the RASS evaluation method is used as an example of an evaluation index used to evaluate the degree of sedation.
  • the score of the RASS evaluation method is evaluated in 10 stages (+4 to -5) centering on 0, and the terms and explanations corresponding to each score are as shown. is.
  • the RASS evaluation method has the contents shown in steps 1 and 2, and the degree of sedation is evaluated based on the ICU patient's behavior and responses to calls.
  • the monitoring system 11 it is preferable to apply the monitoring system 11 to remote monitoring when human resources are scarce or when the risk of infectious diseases is high.
  • FIG. 11 is a block diagram showing a configuration example of one embodiment of a computer in which a program for executing the series of processes described above is installed.
  • the program can be recorded in advance in the hard disk 105 or ROM 103 as a recording medium built into the computer.
  • the program can be stored (recorded) in a removable recording medium 111 driven by the drive 109.
  • a removable recording medium 111 can be provided as so-called package software.
  • the removable recording medium 111 includes, for example, a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), magnetic disk, semiconductor memory, and the like.
  • the program can be installed in the computer from the removable recording medium 111 as described above, or can be downloaded to the computer via a communication network or broadcasting network and installed in the hard disk 105 incorporated therein. That is, for example, the program is transferred from the download site to the computer wirelessly via an artificial satellite for digital satellite broadcasting, or transferred to the computer by wire via a network such as a LAN (Local Area Network) or the Internet. be able to.
  • LAN Local Area Network
  • the computer incorporates a CPU (Central Processing Unit) 102 , and an input/output interface 110 is connected to the CPU 102 via a bus 101 .
  • a CPU Central Processing Unit
  • an input/output interface 110 is connected to the CPU 102 via a bus 101 .
  • the CPU 102 executes a program stored in a ROM (Read Only Memory) 103 according to a command input by the user through the input/output interface 110 by operating the input unit 107 or the like. Alternatively, the CPU 102 loads a program stored in the hard disk 105 into a RAM (Random Access Memory) 104 and executes it.
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the CPU 102 performs the processing according to the above-described flowchart or the processing performed by the configuration of the above-described block diagram. Then, the CPU 102 outputs the processing result from the output unit 106 via the input/output interface 110, transmits it from the communication unit 108, or records it in the hard disk 105 as necessary.
  • the input unit 107 is composed of a keyboard, mouse, microphone, and the like. Also, the output unit 106 is configured by an LCD (Liquid Crystal Display), a speaker, and the like.
  • LCD Liquid Crystal Display
  • processing performed by the computer according to the program does not necessarily have to be performed in chronological order according to the order described as the flowchart.
  • processing performed by a computer according to a program includes processing that is executed in parallel or individually (for example, parallel processing or processing by objects).
  • the program may be processed by one computer (processor), or may be processed by a plurality of computers in a distributed manner. Furthermore, the program may be transferred to a remote computer and executed.
  • a system means a set of multiple components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device housing a plurality of modules in one housing, are both systems. .
  • the configuration described as one device (or processing unit) may be divided and configured as a plurality of devices (or processing units).
  • the configuration described above as a plurality of devices (or processing units) may be collectively configured as one device (or processing unit).
  • part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit) as long as the configuration and operation of the system as a whole are substantially the same. .
  • this technology can take a configuration of cloud computing in which a single function is shared and processed jointly by multiple devices via a network.
  • the above-described program can be executed on any device.
  • the device should have the necessary functions (functional blocks, etc.) and be able to obtain the necessary information.
  • each step described in the flowchart above can be executed by a single device, or can be shared and executed by a plurality of devices.
  • the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.
  • a plurality of processes included in one step can also be executed as processes of a plurality of steps.
  • the processing described as multiple steps can also be collectively executed as one step.
  • the program executed by the computer may be such that the processing of the steps described in the program is executed in chronological order according to the order described herein, or in parallel, or when the call is made. They may be executed individually at necessary timings such as occasions. That is, as long as there is no contradiction, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps describing this program may be executed in parallel with the processing of other programs, or may be executed in combination with the processing of other programs.
  • Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient.
  • a data processing unit that acquires by data processing that analyzes the a display control unit that performs display control to display the real-time information and the interval information on a display unit in display layouts that are displayed in different display areas;
  • control is performed on the display control unit to notify that the update has occurred, and confirmation content is performed in response to the confirmation of the notification.
  • an information processing system comprising: a control unit that controls recording in a recording unit.
  • the real-time information includes the patient's vital information, the patient's monitoring video, and the patient's breathing rate and breathing pattern;
  • the information processing system according to (1) above wherein the interval information includes the patient's water balance, the patient's urine color and drainage color, the patient's sedation level, and the patient's postural change.
  • the data processing unit analyzes a video signal obtained by imaging the patient and a measurement signal obtained by measuring a predetermined part related to the patient's breathing, and the patient's breathing rate and breathing pattern as analysis results.
  • the measurement signal is a measurement signal obtained by measuring the patient's thorax fluctuation pattern with a millimeter wave radar, or a measurement signal obtained by measuring the neck muscle movement of the patient with an RGB-D camera capable of acquiring depth information together with a color image.
  • the data processing unit has a liquid state analysis unit that analyzes a video signal obtained by photographing the patient and acquires the patient's water balance, urine color and drainage color as analysis results.
  • the information processing system according to any one of (2) to (4).
  • the liquid state analysis unit analyzes a video signal for monitoring the infusion ingested by the patient to obtain an infusion volume, and analyzes a video signal for monitoring the drainage discharged from the patient to obtain a drainage volume.
  • the information processing system according to (5) above, wherein the water balance of the patient is obtained based on the difference between the infusion amount and the drainage amount.
  • the liquid state analysis unit performs image recognition on a video signal for monitoring the infusion ingested by the patient, recognizes the name and flow rate of the medicine used as the infusion, and causes the recording unit to record the above (5). Or the information processing system according to (6).
  • the liquid state analysis unit presents the symptoms of the patient estimated from the color of the patient's drainage obtained by analyzing a video signal for monitoring the drainage discharged from the patient. ) to any information processing system.
  • the data processing unit has a sedation level analysis unit that analyzes a video signal obtained by imaging the patient and obtains the sedation level of the patient as an analysis result.
  • Information processing system as described.
  • the sedation analysis unit analyzes the patient's appearance such as facial expression, behavior, and line of sight, and analyzes the voice that is the content of the response given by the nurse to the patient, thereby determining the patient's sedation level.
  • (11) The information processing system according to (9) or (10) above, wherein the sedation level of the patient is remotely evaluated using a monitoring terminal connected via a network.
  • the information processing system according to (2) wherein the data processing unit includes a postural change analyzing unit that analyzes a video signal obtained by imaging the patient and obtains the postural change of the patient as an analysis result.
  • the postural change analysis unit estimates a posture of the patient or the nurse from the video signal, and determines whether or not there is a postural change of the patient.
  • the display control unit causes the display unit to display a plurality of the patient's vital information side by side, and displays an icon for displaying the real-time information and the interval information other than the vital information. information processing system.
  • Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient.
  • obtained by data processing that analyzes the performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas;
  • control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification.
  • a method of processing information including performing (16) In the computer of the information processing system, Real-time information obtained by monitoring the patient in real time with a relatively short measurement period and interval information obtained by monitoring the patient with a relatively long measurement period at intervals are signals obtained by sensing the patient. obtained by data processing that analyzes the performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas; When there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification.
  • a program for executing information processing including performing
  • Monitoring system 12 Vital sensor, 13 Imaging system, 14 Millimeter wave radar, 15 Display device, 16 Information processing device, 21 Monitoring screen, 22 Work content confirmation screen, 23 Monitoring screen, 31 Attribute data display image, 32 Vital sign monitoring Images, 33 Monitoring images, 34 Respiration monitoring images, 35 Water balance monitoring images, 36 Urine/drainage monitoring images, 37 Sedation monitoring images, 38 Position change monitoring images, 41 Real-time information display area, 42 Interval information display area, 43 Unread mark, 51 signal acquisition unit, 52 memory, 53 recording unit, 54 central control unit, 55 display control unit, 56 data processing unit, 61 respiration analysis unit, 62 liquid state analysis unit, 63 sedation analysis unit, 64 posture conversion Analysis unit, 71 to 76 icons, 81 patient camera, 82 line-of-sight detection sensor, 83 microphone, 91 monitoring terminal

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

La présente divulgation concerne un système de traitement d'informations, un procédé de traitement d'informations et un programme au moyen desquels il est possible d'améliorer l'efficacité du travail de surveillance. Des informations en temps réel obtenues par surveillance d'un patient en temps réel à des périodes de mesure relativement courtes et des informations d'intervalle obtenues par surveillance d'un patient à des périodes de mesure relativement longues, de telle sorte que des intervalles sont obtenus, sont acquises par traitement de données d'analyse d'un signal obtenu par détection d'un patient et affichées sur une unité d'affichage dans une configuration d'affichage dans laquelle les informations en temps réel et les informations d'intervalle sont affichées dans des régions d'affichage mutuellement différentes. Lorsqu'il existe une mise à jour spécifique aux informations en temps réel et aux informations d'intervalle, une commande pour communiquer le fait que la mise à jour a eu lieu est effectuée, et en réponse à la vérification de la communication, les spécificités qui ont été vérifiées sont enregistrées dans une unité d'enregistrement. La présente technologie peut être appliquée, par exemple, à un système de surveillance pour surveiller un patient.
PCT/JP2022/006924 2021-07-09 2022-02-21 Système de traitement d'informations, procédé de traitement d'informations et programme WO2023281800A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021114039 2021-07-09
JP2021-114039 2021-07-09

Publications (1)

Publication Number Publication Date
WO2023281800A1 true WO2023281800A1 (fr) 2023-01-12

Family

ID=84801649

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/006924 WO2023281800A1 (fr) 2021-07-09 2022-02-21 Système de traitement d'informations, procédé de traitement d'informations et programme

Country Status (1)

Country Link
WO (1) WO2023281800A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016507256A (ja) * 2012-12-14 2016-03-10 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 活動状態及び姿勢に基づく亜急性患者の患者モニタリング
JP2019150545A (ja) * 2018-03-06 2019-09-12 株式会社 Ｍｔｇ 運動ブースの設置構造および方法
US20190313966A1 (en) * 2018-04-11 2019-10-17 Somniferum Labs LLC Pain level determination method, apparatus, and system
JP2020515948A (ja) * 2017-07-11 2020-05-28 ドレーゲルヴェルク アクチェンゲゼルシャフト ウント コンパニー コマンディートゲゼルシャフト アウフ アクチェンＤｒａｅｇｅｒｗｅｒｋ ＡＧ ＆ Ｃｏ．ＫＧａＡ 患者周辺の光学画像データを検出し、患者のチェックを識別する方法、装置およびコンピュータプログラム
US20200367762A1 (en) * 2018-02-07 2020-11-26 Arthur Wallace Methods and Systems for Patient Monitoring
US20210093243A1 (en) * 2018-04-02 2021-04-01 Potrero Medical, Inc. Systems, devices and methods for draining and analyzing bodily fluids and assessing health

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016507256A (ja) * 2012-12-14 2016-03-10 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 活動状態及び姿勢に基づく亜急性患者の患者モニタリング
JP2020515948A (ja) * 2017-07-11 2020-05-28 ドレーゲルヴェルク アクチェンゲゼルシャフト ウント コンパニー コマンディートゲゼルシャフト アウフ アクチェンＤｒａｅｇｅｒｗｅｒｋ ＡＧ ＆ Ｃｏ．ＫＧａＡ 患者周辺の光学画像データを検出し、患者のチェックを識別する方法、装置およびコンピュータプログラム
US20200367762A1 (en) * 2018-02-07 2020-11-26 Arthur Wallace Methods and Systems for Patient Monitoring
JP2019150545A (ja) * 2018-03-06 2019-09-12 株式会社 Ｍｔｇ 運動ブースの設置構造および方法
US20210093243A1 (en) * 2018-04-02 2021-04-01 Potrero Medical, Inc. Systems, devices and methods for draining and analyzing bodily fluids and assessing health
US20190313966A1 (en) * 2018-04-11 2019-10-17 Somniferum Labs LLC Pain level determination method, apparatus, and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
20 March 1998 (1998-03-20), OMATSU, MASAHIRO ET AL: "Using computer networks to manage biometric information. ", XP009542489 *

Similar Documents

Publication Publication Date Title
JP7355826B2 (ja) プラットフォーム非依存のリアルタイム医療データ表示システム
CN106102571B (zh) 患者监控器和介入/事件时间线
JP2022185032A (ja) 患者転倒検出のためのシステムおよび方法
JP7108267B2 (ja) 生体情報処理システム、生体情報処理方法、及びコンピュータプログラム
US20170245793A1 (en) Systems and Methods for Collecting and Displaying User Orientation Information on a User-Worn Sensor Device
EP3295871A1 (fr) Procédés, dispositifs et techniques de détection d'escarres
JP2014176696A (ja) 患者の医学的パラメータをモニタリング及び表示するための方法、システム及び装置
WO2019162054A1 (fr) Système et procédé d'estimations d'état physiologique côté client sur la base d'une vidéo d'un individu
US11179095B2 (en) Method, system, and apparatus for remote patient monitoring or tracking of sepsis-related indicators
US20230079951A1 (en) System for configuring patient monitoring
Keim-Malpass et al. Nursing and precision predictive analytics monitoring in the acute and intensive care setting: An emerging role for responding to COVID-19 and beyond
CN109044656B (zh) 医用护理设备
WO2023281800A1 (fr) Système de traitement d'informations, procédé de traitement d'informations et programme
US8181862B1 (en) System for providing identification and information, method of use thereof
WO2018219809A1 (fr) Système et procédé permettant de fournir une présentation à base de couches d'une prédiction relative à un patient et générée par un modèle
CN105520723B (zh) 生命体征测量装置、生命体征显示方法和程序
US20230114135A1 (en) Systems and methods for monitoring caregiver burnout risk
JP7325576B2 (ja) 端末装置、出力方法及びコンピュータプログラム
US20190244711A1 (en) System and method for timing delivery of queries to telehealth patients
JP7342863B2 (ja) コンピュータで実行されるプログラム、情報処理システム、および、コンピュータで実行される方法
CN108471957B (zh) 患者监护仪
WO2020133429A1 (fr) Procédé de surveillance, moniteur et support de stockage informatique
JP7419904B2 (ja) 生体モニタ装置、生体モニタ方法及びプログラム
WO2022244213A1 (fr) Procédé de génération de données textuelles
Rammo et al. Comatose patient monitoring system based on (IoT)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22837222

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE