JP2021005221A - Vital sign data input assist system - Google Patents

Abstract

To provide a vital sign data input assist system for automatically inputting vital sign data.SOLUTION: A vital sign data input assist system assists the input of vital sign data displayed on a vital sign monitor. This vital sign data input assist system includes: a vital sign data identifying process unit that performs a character recognition process on monitor image information obtained by imaging a vital sign monitor to identify the vital sign data; and an outputting process unit that outputs the identified vital sign data to a predetermined computer system.SELECTED DRAWING: Figure 1

Description

The present invention relates to a vital sign data input support system for supporting the input of vital sign data.

When a patient is being transported by an ambulance or hospitalized at a medical institution, various sensors are attached to the patient in order to grasp the patient's condition, and these are used as vital signs by doctors, nurses, etc. It is managed by medical personnel such as emergency personnel. Typical examples of vital signs are the patient's pulse, blood pressure, and percutaneous arterial oxygen saturation (SpO ₂ ), as well as the necessary range of monitoring the patient's condition, such as respiratory rate, body temperature, and electrocardiogram. Is being measured in.

Vital signs are generally displayed on a display device (monitor). Although this display device is referred to as a vital sign monitor in the present specification, it may be referred to by other names such as a bedside monitor, a biological information monitor, and a clinical monitor in medical institutions. An example of a vital sign monitor is shown in Non-Patent Document 1 below.

Vital signs The vital signs displayed on the monitor are important data for managing changes over time in patients, so it is required to record them one by one. Therefore, when recording vital sign data displayed on the vital sign monitor, doctors and nurses in the ward and emergency personnel in the ambulance visually observe the vital sign monitor and use it as the vital sign data called a temperature plate. I used to fill out the documents to be recorded by hand or enter them in electronic medical records.

In addition, in order to reduce the burden of recording vital sign data, there is also a method of automatically outputting the vital sign data to be displayed on the vital sign monitor to a predetermined computer system such as an electronic medical record by using an output program.

Nihon Kohden Co., Ltd., "Vital Sign Telemeter GZ-140P", [online], Internet <URL: https://www.nihonkohden.co.jp/iryo/products/monitor/01_bedside/gz140p.html>

When visually checking the vital sign monitor and transcribing it to a temperature plate or electronic medical record, the burden on doctors, nurses, and emergency personnel is extremely heavy because it must be done manually. Therefore, there is an automatic output using an output program, but this output program may be expensive for several million yen, and it may be hesitant to introduce it. As a result, the current situation is that it is done manually.

In view of the above problems, the present inventor is a vital sign data input support system that reduces the burden of manual recording of vital sign data displayed on the vital sign monitor without using the output program built into the vital sign monitor. Invented.

The first invention is a vital sign data input support system that supports the input of vital sign data to be displayed on the vital sign monitor, and the vital sign data input support system is for monitor image information captured by the vital sign monitor. Vital sign data input support having a vital sign data specifying processing unit that specifies vital sign data by performing character recognition processing and an output processing unit that outputs the specified vital sign data to a predetermined computer system. It is a system.

As in the present invention, the vital sign data can be automatically input by specifying the vital sign data by performing character recognition processing on the monitor image information obtained by capturing the screen of the vital sign monitor. The burden on doctors, nurses, and emergency personnel can be reduced. Moreover, it can be realized without using a conventional expensive output program.

In the above-described invention, the vital sign data specifying processing unit performs character recognition processing on the monitor image information, specifies tag information indicating an item of the vital sign data, and specifies a numerical value corresponding to the tag information. By doing so, it can be configured like a vital sign data input support system that specifies the vital sign data of the item.

Vital sign monitors are often accompanied by tag information indicating which item the vital sign data is. Therefore, the vital sign data can be specified from the monitor image information by specifying the tag information and the corresponding numerical value.

In the above-described invention, the vital sign data specifying processing unit specifies a numerical value corresponding to the tag information that satisfies the condition for each item of the vital sign data corresponding to the tag information, thereby specifying the item. It can be configured like a vital sign data input support system that identifies the vital sign data of.

For vital sign data, conditions are set for each item. Therefore, by specifying the numerical value that satisfies the conditions for each item, the vital sign data can be specified accurately.

In the above-described invention, the vital sign data specifying processing unit uses the vital sign data item of the text information recognized by the character recognition processing for the vital sign data of the item not specified in the vital sign data based on the tag information. It can be configured like a vital sign data input support system that specifies a numerical value that satisfies each condition as its vital sign data.

The specific processing based on the tag information is highly accurate. Therefore, it is preferable to prioritize the processing based on the satisfiability of the conditions for each item.

In the above-described invention, the vital sign data specifying processing unit performs character recognition processing on the monitor image information, and among the recognized text information, a numerical value that satisfies the conditions for each item of the vital sign data is selected as the vital. It can be configured like a vital sign data input support system that is specified as sign data.

Character recognition processing may be performed from the monitor image information captured by the vital sign monitor, and the recognition result may be used to specify the vital sign data based on the satisfaction of the conditions for the numerical values for each item.

In the above-described invention, the vital sign data specifying processing unit identifies numerical values on the left and right of a predetermined symbol among the text information recognized by the character recognition processing as a condition for each item of the vital sign data, and these It can be specified like a vital sign data input support system that specifies the numerical value of as vital sign data of blood pressure.

As for blood pressure, systolic blood pressure and diastolic blood pressure are often displayed on the left and right of a predetermined symbol such as a slash “/”. Therefore, the vital sign data of blood pressure can be specified by executing the process as in the present invention.

In the above-described invention, the vital sign data specifying processing unit specifies the numerical values on the left and right of the predetermined symbol among the text information recognized by the character recognition processing as a condition for each item of the vital sign data, and the identification is performed. Vital sign data input support system that specifies the specified value as vital sign data of blood pressure when the condition of the numerical range related to blood pressure specified in advance is satisfied for either one or both of the numerical values. It can be configured as follows.

As described above, the accuracy can be further improved by specifying the vital sign data of blood pressure not only based on the positional relationship between a predetermined symbol and the numerical value but also using the condition of the numerical range that the blood pressure can take.

In the above-described invention, the vital sign data identification processing unit of the vital sign data input support system specifies a numerical value including a decimal point as a condition for each item of the vital sign data, and specifies the numerical value as a numerical value of body temperature. It can be configured as follows.

Body temperature is often displayed as a number including a decimal point. Therefore, the vital sign data of body temperature can be specified by executing the process as in the present invention.

In the above-described invention, when the vital sign data specifying processing unit cannot specify a numerical value including a decimal point as a condition for each item of the vital sign data, the vital sign data specifying processing unit specifies a three-digit numerical value equal to or higher than a predetermined threshold value. It can be configured like a vital sign data input support system that specifies a numerical value that is 1/10 of the numerical value as a numerical value of body temperature.

Since the decimal point is small, it may not be recognized. Therefore, by performing the treatment as in the present invention, the vital sign data of the body temperature can be specified more accurately.

In the above-described invention, in the vital sign data specifying processing unit, a numerical value including the specified decimal point or a numerical value obtained by reducing a three-digit numerical value equal to or higher than the predetermined threshold value to 1/10 is a condition of a numerical range relating to a predetermined body temperature. In the case of satisfying, it can be configured like a vital sign data input support system that specifies the above-mentioned numerical value as vital sign data of body temperature.

As described above, the accuracy can be further improved by specifying the vital sign data of the body temperature not only based on the numerical expression but also using the conditions of the numerical range in which the body temperature can be taken.

In the above-described invention, the vital sign data specifying processing unit determines, as a condition for each item of the vital sign data, a predetermined breath among unspecified numerical values after specifying the vital sign data of the blood pressure and / or body temperature. It can be configured like a vital sign data input support system that specifies a numerical value that satisfies the condition of the numerical range regarding the number as vital sign data of the respiratory rate.

The numerical range of respiratory rate may overlap with blood pressure and body temperature. Therefore, vital sign data of respiratory rate can be specified by specifying by correlation based on clinical significance such as specifying respiratory rate after specifying blood pressure and body temperature.

In the above-described invention, as a condition for each item of the vital sign data, after specifying the vital sign data of the blood pressure, body temperature and / or respiratory rate, 101 or more of the unspecified values are used as the vital sign data of the pulse. It can be configured like a vital sign data input support system.

After specifying the blood pressure, body temperature, and respiratory rate, it is the pulse that has a value of 101 or more. In this way, the vital sign data of the pulse can be specified by specifying the pulse based on the correlation based on the clinical significance.

In the above-described invention, the vital sign data identification processing unit performs color-specific character recognition processing on the monitor image information, and displays a numerical value displayed in a color indicating the percutaneous arterial oxygen saturation. It can be configured like a vital sign data input support system that identifies as vital sign data of arterial oxygen saturation.

Percutaneous arterial oxygen saturation is displayed in a predetermined color such as blue on most vital sign monitors. Therefore, vital sign data of percutaneous arterial oxygen saturation can be identified by performing color-coded character recognition processing.

In the above-described invention, the vital sign data identification processing unit performs color-specific character recognition processing on the monitor image information, and is a numerical value displayed in a color other than the color for displaying the percutaneous arterial oxygen saturation. Therefore, among unspecified numerical values, a numerical value that satisfies the condition of a predetermined numerical range related to the pulse can be configured as a vital sign data input support system that specifies the vital sign data of the pulse.

As in the present invention, the vital sign data of the pulse is specified by executing the judgment processing based on the correlation based on the clinical significance for the numerical value displayed in a color different from the display color of the percutaneous arterial oxygen saturation. be able to.

In the above-described invention, the vital sign data specifying processing unit performs color-specific character recognition processing used for displaying each item of vital sign data set in advance on the monitor image information, and character recognition for each color. It can be configured like a vital sign data input support system that identifies the numerical value recognized in the process as the vital sign data of the item.

Vital signs monitors often display vital sign data items in different colors. Therefore, by setting the correspondence between the item and the display color in advance, the vital sign data of the item can be specified by executing the character recognition process for each color.

In the above-described invention, the vital sign data specifying processing unit uses, among the numerical values recognized by the character recognition processing for each color, a numerical value that satisfies the conditions for each item of the vital sign data as vital sign data of the item. It can be configured like a vital sign data input support system that recognizes.

Depending on the vital sign monitor, the vital sign data of different items may be displayed in the same color. Therefore, it is possible to specify the vital signs data with high accuracy by specifying the vital signs data in consideration of the conditions for the numerical values of the items of the vital signs data.

In the above-described invention, the vital sign data identification processing unit reads the monitor identification information or the code information thereof in the monitor image information, identifies the patient identification information corresponding to the monitor identification information, and the output processing unit is the output processing unit. It can be configured like a vital sign data input support system that outputs the specified vital sign data and the patient identification information to a predetermined computer system.

In the above-described invention, the vital sign data identification processing unit reads the monitor identification information or the code information thereof in the monitor image information, and the output processing unit determines the specified vital sign data and the monitor identification information. By outputting to a computer system, the patient identification information corresponding to the monitor identification information is specified, and the vital sign data and the patient identification information are associated and stored, and is configured like a vital sign data input support system. be able to.

In the above-described invention, the vital sign data identification processing unit reads the patient identification information or the code information thereof in the monitor image information, and the output processing unit determines the specified vital sign data and the patient identification information. It can be configured like a vital sign data input support system that outputs to a computer system.

Vital signs data is generally recorded as information about a specific patient. Therefore, the vital sign monitor is attached with monitor identification information, patient identification information, or code information that encodes them, and the patient information is specified from the information shown in the monitor image information to respond to the patient. Vital sign data can also be recorded.

The first invention can be realized by loading the program of the present invention into a computer and executing it. That is, the vital sign data identification processing unit that specifies the vital sign data by performing character recognition processing on the monitor image information captured by the vital sign monitor, and the specified vital sign data in a predetermined computer system. It can be configured like a vital sign data input support program that functions as an output processing unit that outputs to.

By the vital sign data input support system of the present invention, it is possible to reduce the burden of manually recording the vital sign data displayed on the vital sign monitor without using the output program built in the vital sign monitor.

It is a block diagram which shows typically an example of the whole processing function of the vital sign data input support system of this invention. It is a block diagram which shows typically an example of the hardware composition of the computer in which the vital sign data input support system of this invention functions. It is a flowchart which shows an example of the whole processing of the vital sign data input support system of this invention. It is a flowchart which shows an example of the vital sign data identification processing in the vital sign data input support system of this invention. It is a flowchart which shows an example of the specific processing of the vital sign data based on the tag information in the vital sign data input support system of this invention. It is a flowchart which shows an example of the specific processing of the vital sign data based on the numerical value and the color in the vital sign data input support system of this invention. It is a flowchart which shows an example of the specific processing of blood pressure and body temperature in the vital sign data input support system of this invention. It is a flowchart which shows an example of the specific process of the respiratory rate in the vital sign data input support system of this invention. It is a flowchart which shows an example of the specific processing of the pulse / oxygen saturation degree in the vital sign data input support system of this invention. It is a figure which shows an example of the screen of the vital sign monitor. It is a figure which shows an example of the screen of the vital sign monitor which attached the monitor identification information.

An example of the overall processing function of the vital sign data input support system 1 of the present invention is shown in the block diagram of FIG. Further, FIG. 2 shows an example of the hardware configuration of the computer that realizes the vital sign data input support system 1 of the present invention.

The vital sign data input support system 1 is a computer that executes the processing of the present invention. The computer used in the vital sign data input support system 1 includes an arithmetic unit 70 such as a CPU that executes arithmetic processing of a program, a storage device 71 such as a RAM or a hard disk that stores information, and a display device 72 such as a display (screen). And an input device 73 such as a keyboard or a pointing device (mouse, ten keys, etc.) and a communication device 74 that transmits / receives the processing result of the arithmetic unit 70 and the information stored in the storage device 71 via a network such as the Internet or LAN. Have. Each function (each means) realized on the computer is executed when the means (program, module, etc.) for executing the process is read into the arithmetic unit 70. When the information stored in the storage device 71 is used in the processing, each function reads the corresponding information from the storage device 71 and appropriately uses the read information for the processing in the arithmetic unit 70. Further, although the vital sign data input support system 1 of FIG. 1 is realized by one computer, its functions may be distributed and arranged on a plurality of computers. Computers include various information processing devices such as servers, personal computers, and workstations. It may also be in the so-called cloud format. For example, a computer used by a medical worker such as a doctor, a nurse, or an emergency worker for input may be separated from a computer that receives the input information and executes each process in the present invention.

When the computer includes a touch panel display, the display device 72 and the input device 73 may be integrally configured. Touch panel displays are often used, for example, in portable communication terminals such as tablet computers and smartphones, but are not limited thereto. The touch panel display is a device in which the functions of the display device 72 and the input device 73 are integrated in that input can be performed directly on the display with a predetermined input device (such as a pen for a touch panel) or a finger.

Each means in the present invention has only a logical distinction in its function, and may form the same area physically or substantially. Further, the process described in the present invention is only an example, and the process can be appropriately changed.

The vital sign data input support system 1 uses the processing terminal 3 and the photographing device 4. The processing terminal 3 may be a portable communication terminal such as a smartphone or a tablet computer, and in that case, the photographing device 4 and the processing terminal 3 may be configured as one unit. Of course, the photographing device 4 and the processing terminal 3 may be different.

The photographing device 4 photographs the screen of the vital sign monitor 2 and acquires the image information (monitor image information) thereof. The photographing device 4 may photograph the screen of the vital sign monitor 2 as either a still image or a moving image. Further, the monitor image information may be acquired only by pointing the lens of the photographing device 4 toward the screen of the vital sign monitor 2 without pressing the shutter of the photographing device 4.

FIG. 10 shows an example of the screen of the vital sign monitor 2 taken by the photographing device 4. As shown in FIG. 10, the vital sign monitor 2 displays blood pressure BP, body temperature BT, respiratory rate RR, pulse PR, percutaneous arterial oxygen saturation SpO _{2, and the} like, as well as time T and the like. ， The waveform of the electrocardiogram may be displayed. The vital sign data displayed on the vital sign monitor 2 is appropriately changed according to the place and purpose of use, but blood pressure BP, body temperature BT, respiratory rate RR, pulse PR, and percutaneous arterial blood. Although the oxygen saturation SpO ₂ is generally displayed, some of them may not be displayed depending on the model of the vital sign monitor 2. At least blood pressure BP, pulse PR, and percutaneous arterial oxygen saturation SpO ₂ are displayed in most cases, but body temperature BT and respiratory rate RR are not always displayed. Conversely, other vital sign data and dates may be displayed. Therefore, in the vital sign data input support system 1 of the present invention, regarding vital sign data of blood pressure BP, body temperature BT, respiratory rate RR, pulse PR, and percutaneous arterial oxygen saturation SpO ₂ , which are often displayed. Explains the case of automatic input. Further, for example, when some vital sign data such as body temperature BT and respiratory rate RR are not displayed, the process of automatically inputting the vital sign data can be omitted.

The processing terminal 3 has a monitor image information input reception processing unit 20, a monitor image information storage unit 21, a vital sign data identification processing unit 22, a vital sign data storage unit 23, and an output processing unit 24.

The monitor image information input reception processing unit 20 receives the input of the monitor image information acquired by the photographing device 4 and stores it in the monitor image information storage unit 21 described later. At this time, the input date and time information of the monitor image information may be stored in association with the received date and time information.

The monitor image information storage unit 21 stores the monitor image information received by the monitor image information input reception processing unit 20. In this case, it may be stored in association with the date and time information when the input is received.

The vital sign data identification processing unit 22 performs image analysis processing on the monitor image information received by the monitor image information input reception processing unit 20 or the monitor image information stored in the monitor image information storage unit 21 to perform vitality. The sign data is specified and stored in the vital sign data storage unit 23 described later. At this time, the specified vital sign data may preferably be stored in association with the time information and the date information.

Vital signs data The vital signs data specified by the specific processing unit 22 include blood pressure BP, body temperature BT, respiratory rate RR, pulse PR, and percutaneous arterial oxygen saturation, which are often displayed on the vital sign monitor 2. It is preferable to specify SpO _{2 and the} like, but it is not necessary to perform the specific processing for the data that is not displayed.

When the vital sign data identification processing unit specifies the vital sign data from the monitor image information, character recognition processing (OCR processing, etc.) is performed on the monitor image information, and the text information included in the monitor image information is determined in advance. Identify whether there is tag information indicating the item of the obtained vital sign data.

If there is text information that matches the tag information, specify the numerical text information in the vicinity of the tag information (within a predetermined range from the tag information). Then, when the text information of the specified numerical value satisfies the correlation condition (for example, the condition related to the numerical range) based on the clinical significance of the vital sign data indicated by the tag information, the vital sign data indicated by the tag information is satisfied. Identifies that it is a numerical value of. On the other hand, if the condition regarding the numerical range is not satisfied, the text information of the numerical value is excluded as it is not the vital sign data indicated by the tag information.

On the other hand, for text information of numerical values that do not match the tag information, the numerical values of vital sign data are specified by determining whether the conditions corresponding to the items of vital sign data are satisfied. At this time, whether the numerical text information satisfies the condition related to the numerical range or the numerical text information satisfies the condition related to the corresponding character color is set for each item of the vital sign data. Based on this, the text information of the numerical value that satisfies the condition is specified as the numerical value of the vital sign data.

Detailed specific processing will be described later.

In addition to the above-mentioned vital sign data, the vital sign data specifying processing unit 22 may specify time information and date information among the text information converted into text from the monitor image information by the character recognition process.

Further, the vital sign data identification processing unit 22 may perform the character recognition process after executing the correction process for the monitor image information such as the trapezoidal correction process before performing the character recognition process from the monitor image information. ..

The vital sign data storage unit 23 stores the vital sign data specified by the vital sign data identification processing unit 22. At this time, the specified vital sign data may be stored in association with the time information and date information associated with the monitor image information, or the time information and date information specified from the monitor image information.

The output processing unit 24 outputs the vital sign data stored in the vital sign data storage unit 23, and in some cases, time information and date information to a predetermined electronic medical record system or other computer system. In addition to outputting to a computer, it may be output to a printing device so that it can be output on a paper medium.

Next, an example of the processing process of the vital sign data input support system 1 of the present invention will be described with reference to the flowcharts of FIGS. 3 to 9.

When the vital sign data displayed on the vital sign monitor 2 is output to an electronic medical record system or other computer system by using the vital sign data input support system 1 of the present invention, a doctor, a nurse, or an emergency worker A medical worker such as a medical worker photographs the screen of the vital sign monitor 2 with the imaging device 4 (S100). FIG. 10 shows an example of the monitor image information taken at this time.

Then, when the photographing device 4 captures the image information of the vital sign monitor 2, it sends the captured monitor image information to the processing terminal 3. The photographing device 4 may automatically send the photographed monitor image information to the processing terminal 3 when the monitor image information is photographed, or when the operator of the photographing device 4 performs a predetermined operation, the processing terminal 3 The monitor image information taken may be sent to.

The monitor image information sent from the photographing device 4 is received by the monitor image information input reception processing unit 20 of the processing terminal 3, and is stored in the monitor image information storage unit 21 in association with the time information, date information, and the like. (S110). When the photographing device 4 and the processing terminal 3 are integrated, the monitor image information photographed by the photographing device 4 is directly received by the monitor image information input reception processing unit 20 and stored in the monitor image information storage unit 21. ， The time information, date information, etc. are associated and stored.

Then, the vital sign data identification processing unit 22 executes the vital sign data identification process based on the vital sign data received by the monitor image information input reception processing unit 20 or the vital sign data stored in the monitor image information storage unit 21. (S120).

The vital sign data identification processing unit 22 executes the following processing, for example.

First, the vital sign data identification processing unit 22 performs character recognition processing on the monitor image information (S200). As the character recognition process at this time, in addition to the OCR process or the like, the character recognition process may be performed by using deep learning. For example, using natural language analysis processing by deep learning that executes machine learning by referring to a learning model in which the weighting coefficient between neurons in each layer of a neural network consisting of many layers is optimized. May be good. In addition, natural language analysis processing may be executed by AI (artificial intelligence) using deep learning or machine learning, or AI without them. As these learning models, various monitor image information and text information contained therein can be used as correct answer data.

In the character recognition process of S200, the "numerical value" has a size larger than a certain value, for example, a size that can recognize the size of the vital sign data displayed as the smallest among the items of vital sign data to be recorded. It is also possible to extract only the numerical value displayed in (the size that does not exclude the vital sign data displayed as the smallest among the items of vital sign data to be recorded from the recognition target). Numerical values other than vital sign data are also displayed in the monitor image information, but the display is generally small. Therefore, these small indications are excluded.

Among the text information extracted by the character recognition process in S200, it is specified whether or not there is tag information indicating a predetermined item of vital sign data (S210). The tag information may be any information indicating the vital sign data that is automatically specified and output among the vital sign data displayed on the vital sign monitor 2. For example, "BP" for "blood pressure", "BT" for "body temperature", "RR" for "respiratory rate", "PR" for "pulse", and "percutaneous arterial oxygen saturation". If it is "degree", tag information is set like "SpO ₂ ".

Then, when the vital sign data identification processing unit 22 can identify the tag information that matches the text information extracted by the character recognition process (S220), the vital sign data identification processing unit 22 executes the vital sign data identification process based on the tag information (S230). ..

For example, in the case of FIG. 10, it is assumed that "PR", "SpO ₂ ", "RR" and the like can be specified. Then, if there is text information that matches the tag information, the vital sign data identification processing unit 22 will use numerical text information in the vicinity of the tag information (within a predetermined range from the tag information), for example, in the case of "PR". Is specified as "62", "94" in the case of "SpO ₂ ", and "22" in the case of "RR" (S300). Then, it is determined whether or not the condition regarding the numerical range of the vital sign data indicated by each of the tag information is satisfied (S310).

Since "PR" is "pulse", for example, the condition of the numerical range of "45 ≤ PR ≤ 180" is set, and the numerical value "62" corresponding to "PR" specified in S300 is in this numerical range. Since the condition is satisfied, it is specified that the numerical value of "PR" specified in S300 is "62" (S320).

Further, since "SpO ₂ " is "percutaneous arterial oxygen saturation", for example, a condition in the numerical range of "85 ≤ SpO ₂ ≤ 100" is set, and corresponds to "SpO ₂ " specified in S300. Since the numerical value "94" to be used satisfies the condition of this numerical range, it is specified that the numerical value of "SpO ₂ " specified in S300 is "94" (S330).

Further, since "RR" is "respiratory rate", for example, a condition of a numerical range of "8 ≤ RR ≤ 40" is set, and the numerical value "22" corresponding to "RR" specified in S300 is this numerical range. Since the condition of is satisfied, it is specified that the numerical value of “RR” specified in S300 is “22” (S330).

On the other hand, for example, when "131" is specified as a numerical value corresponding to "SpO ₂ " in S300, the condition "85 ≤ SpO ₂ ≤ 100" in the above numerical range is not satisfied, so that the specified "131" is "131". Exclude as it does not correspond to "SpO ₂ ".

As described above, when the vital sign data identification processing unit 22 can specify the vital sign data based on the tag information, the item indicating the vital sign data (which may be the same as or different from the tag information) and its numerical value. Is stored in the vital sign data storage unit 23 in association with.

In the above case, when the numerical value corresponding to the tag information is specified in S300, it is determined whether the numerical value satisfies the condition of the numerical range, but the condition of this numerical range does not have to be satisfied. In addition, when specifying the numerical values corresponding to the tag information, if there are multiple numerical values in a predetermined range from the text information matching the tag information, all of them are specified and the condition of the numerical range is determined for them. By performing the processing, the numerical values that satisfy the conditions in the numerical range (either one or all the numerical values that satisfy the conditions) may be specified as the vital sign data.

By executing the above processing, it is possible to execute the specific processing of vital sign data based on the tag information.

When the vital sign data specifying processing unit 22 finishes the specification processing of the vital sign data based on the tag information in S230 and there is an item of vital sign data whose numerical value is not specified (S240), the vital sign data specifying processing unit 22 is based on the numerical value and / or the color. Data identification processing is executed (S250).

Specifically, the vital sign data identification processing unit 22 first executes the identification processing of blood pressure BP and body temperature BT (S400).

In blood pressure BP, systolic blood pressure (so-called upper blood pressure) and diastolic blood pressure (so-called lower blood pressure) are generally expressed via "/" (slash). Therefore, in the character recognition process for the monitor image information performed in S200, the numerical values on the left and right of the character recognition process are specified via "/" (S500). Then, it is determined whether these values satisfy the condition of the numerical range of the blood pressure BP (S510). For example, when the systolic blood pressure is set to "50 ≤ systolic blood pressure ≤ 250", it is determined whether the numerical value on the left side of "/" is in the numerical range, and if the condition is satisfied, S500. The value specified in (S520) is specified as the value of blood pressure BP.

For example, in S500, if the value on the left side is specified as "131" and the value on the right side is "48" via "/", if they are blood pressure BP values, the value on the left side of "/" is Since it means systolic blood pressure, it is determined whether the numerical value "131" on the left side of "/" satisfies the condition "50 ≤ systolic blood pressure ≤ 250" in the numerical range of systolic blood pressure. Here, since the conditions in the numerical range are satisfied, the numerical value "131" specified in S500 is specified as the systolic blood pressure, and "48" is specified as the diastolic blood pressure.

Here, only systolic blood pressure is judged as a condition of the numerical range, but only diastolic blood pressure or both systolic blood pressure and diastolic blood pressure may be judged.

Next, in the character recognition process for the monitor image information performed in S200, it is specified whether or not there is a "numerical value including a decimal point", more preferably a "numerical value including a decimal point, which is two digits and one digit after the decimal point". (S530). Then, if there is such a numerical value, it is determined whether or not the numerical value satisfies the condition of the numerical range of the body temperature BT (S540). For example, when "34.0 ≤ BT ≤ 41.0" is set as the condition of the numerical range of the body temperature BT, if the numerical value specified in S530 satisfies the condition of the numerical range, the body temperature BT It is specified as a numerical value (S550).

Further, in S530, when the "numerical value including the decimal point" cannot be specified (S530), it is specified whether or not there is a "predetermined threshold value, for example, a three-digit numerical value of 300 or more" (S560). Then, if there is such a numerical value, the numerical value is reduced to 1/10 (S570), and it is determined whether the processing after S540, that is, whether the numerical value satisfies the condition of the numerical range of the body temperature BT. Then, if the value set to 1/10 satisfies the condition of the value range of the body temperature BT, the value is specified as the body temperature BT (S550).

For example, if "38.0" is specified in S530, it is determined whether or not the numerical value satisfies the condition "34.0 ≤ BT ≤ 41.0" in the numerical range of the body temperature BT. Here, since the condition of the numerical value range is satisfied, the numerical value "38.0" specified in S530 is specified as the numerical value of the body temperature BT.

Further, for example, if "380" is specified in S530, the value is reduced to 1/10 and set to "38.0". Then, in the same manner as described above, it is determined whether or not the numerical value satisfies the condition "34.0 ≤ BT ≤ 41.0" in the numerical range of the body temperature BT, and the numerical value specified in S530 is reduced to 1/10. 38.0 ”is specified as the numerical value of body temperature BT.

The vital sign data identification processing unit 22 specifies vital sign data of blood pressure BP and body temperature BT as described above.

Next, the vital sign data identification processing unit 22 executes the identification process of the respiratory rate RR (S410).

In the character recognition process for the monitor image information performed in S200, a "predetermined reference value, for example, a numerical value less than 40", more preferably a "predetermined numerical range, for example, a numerical value of 8 or more and less than 40" is specified (S600). Then, if there is such a value, the value is specified as the respiratory rate RR (S620).

For example, in the case of FIG. 10, the "value of 8 or more and less than 40" is only "22" (38.0 indicating the body temperature BT has already been specified, so it is excluded from the specific target), so that value is breathed. It is specified as a numerical value of the number RR.

Next, the vital sign data identification processing unit 22 executes identification processing of pulse PR and percutaneous arterial oxygen saturation SpO ₂ (S420).

In the character recognition process for the monitor image information performed in S200, it is specified whether or not there is a "numerical value of 101 or more" (S700). If there is such a value, the percutaneous arterial oxygen saturation SpO ₂ does not exceed 100, so it is specified as a value of pulse PR (S710).

Next, the character recognition process for each color is executed on the monitor image information received in S110 (S720), and the blue numerical value is extracted (S730). Then, it is determined whether the extracted blue numerical value satisfies the condition "85 ≤ SpO ₂ ≤ 100" in the numerical range of the percutaneous arterial oxygen saturation SpO ₂ (S740), and the condition in the numerical range is satisfied. If so, it is specified as a numerical value of percutaneous arterial oxygen saturation SpO ₂ (S750).

In addition, the text information of the numerical value extracted by the character recognition processing performed in S200 is compared with the text information of the blue numerical value extracted in S730, and among the numerical values excluding the blue numerical value, it is still specified as vital sign data. Specify a numerical value that has not been set (S760). Then, among the numerical values specified in S760, the numerical values satisfying the condition “45 ≦ PR ≦ 180” in the numerical range of the pulse PR are specified as the pulse PR (S770, S780).

The vital sign monitor 2 may display pulse PR and heart rate HR. In that case, since the values of both the pulse PR and the heart rate HR displayed on the vital sign monitor 2 are usually the same, both of them may satisfy the condition of the numerical range. As described above, when there are numerical values of a plurality of different vital sign data items, both of the numerical values satisfying the conditions may be specified as the numerical values of the vital sign data. In the above case, two 63 (value of pulse PR and value of heart rate HR) may be stored as the numerical value of "pulse PR".

As described above, "blood pressure BP", "body temperature BT", "respiratory rate RR", "pulse PR", and "percutaneous arterial oxygen saturation SpO ₂ " can be identified from the vital sign data. ..

In the character recognition process performed in S200, the vital sign data identification processing unit 22 includes text information indicating the time T, for example, text information including "hour" and "minute" and text information including ":" (colon). , Text information indicating the date, for example, text information including "month" and "day" may be specified.

Each vital sign data specified by the vital sign data specifying processing unit 22 is stored in the vital sign data storage unit 23 in association with the time information T for each item. The time information T in this case may be the time information T specified by the vital sign data identification processing unit 22 from the monitor image information, or is stored in the monitor image information storage unit 21 in association with the monitor image information. It may be time information. In addition, date information may be further associated. Similarly, the date information may be time information specified by the vital sign data identification processing unit 22 from the monitor image information, or the date information stored in the monitor image information storage unit 21 in association with the monitor image information. It may be.

When the vital sign data is specified from the monitor image information by the vital sign data identification processing unit 22 as described above, the vital sign data and the time information T (and the date information in some cases) are stored in the computer system for recording the vital sign data. Output (S130). That is, the vital sign data stored in the vital sign data storage unit 23 is transmitted to a predetermined electronic medical record system or a computer system used in a medical institution and recorded.

Depending on the special condition such as the cardiopulmonary arrest state or the state immediately before it and the accuracy of the device for measuring the vital sign data, some or all items of the vital sign data may be in each numerical range shown in the above-mentioned Example 1. It may happen that the condition of is not satisfied.

For example, "percutaneous arterial oxygen saturation SpO ₂ " is less than 80, "pulse PR" is less than 40, "blood pressure BP" is less than 60, "respiratory rate RR" is 41 or more, and "body temperature BT" is less than 30. Numerical value may be displayed.

In this case, in addition to the first embodiment, the following processing may be performed.

First, in the case of "blood pressure BP" and "body temperature BT", only the conditions in the numerical range are excluded. That is, in the case of "blood pressure BP", the values before, after, left and right of "/" are specified as the values of blood pressure. Further, in the case of "body temperature BT", a "numerical value including a decimal point", more preferably a "numerical value including a decimal point, two digits and one digit after the decimal point" is specified.

Next, if there is a numerical value of "101" or more, it is specified as "pulse PR". Then, color-coded character recognition processing is executed on the monitor image information, and the blue value is specified as the percutaneous arterial oxygen saturation SpO ₂ . Then, the numerical text information displayed at the bottom of the monitor image information is specified as "respiratory rate RR".

On the other hand, if there is no value of "101" or more, color-specific character recognition processing is executed for the monitor image information, and the blue value is specified as the value of percutaneous arterial oxygen saturation SpO ₂ . Then, the numerical text information displayed at the upper part of the monitor image information is specified as "pulse PR", and the numerical text information displayed at the lower part is specified as "respiratory rate RR". Alternatively, the text information of the two numerical values is compared, and the upper numerical value is specified as "pulse PR" and the lower numerical value is specified as "respiratory rate RR".

By performing such processing, even if the vital sign data does not satisfy the conditions of the numerical range, it can be automatically input.

In the vital sign data displayed on the vital sign monitor 2, the color used for display is generally determined for each item. Therefore, the vital sign data identification processing unit 22 may perform color-specific character recognition processing and specify the numerical value of the vital sign data from the monitor image information based on the character recognition process and the conditions for each item of the vital sign data.

Specifically, the color used for displaying the vital sign data to be recorded is set in advance on the vital sign monitor 2. For example, "blood pressure BP" is "blue", "body temperature BT" is "orange", "respiratory rate RR" is "white", "pulse PR" is "green", and "percutaneous arterial oxygen saturation SpO _2" "" Is set like "blue".

Then, when the vital sign data identification processing unit 22 performs character recognition processing on the monitor image information received by the monitor image information input reception processing unit 20 or the monitor image information stored in the monitor image information storage unit 21. ， Performs character recognition processing for each color. The character recognition process for each color is a process for performing character recognition processing for each color in the monitor image information.

Here, character recognition processing for each color is executed for each color used for displaying the preset vital sign data.

Then, with respect to the numerical text information extracted for each color, the items of vital sign data are associated with each corresponding color.

Specifically, the numerical text information extracted in "blue" is associated with "blood pressure BP" and "percutaneous arterial oxygen saturation SpO ₂ ", and the numerical text information extracted in "orange" is "body temperature". The numerical text information extracted in "BT" is associated with "respiratory rate RR", and the numerical text information extracted in "green" is associated with "pulse PR".

Then, for the text information of the associated numerical value, a numerical value that satisfies the conditions of the vital sign data is specified, and that is used as the numerical value of the item of the vital sign data.

For example, in the text information of the numerical value extracted in "blue", if the numerical value including "/" and the numerical range on the left side of "/" is 50 or more and 250 or less, the numerical value before, after, left and right of "/" Is specified as "blood pressure BP". Further, among the text information of the numerical values extracted in "blue", the numerical value of 85 or more and 100 or less is specified as "percutaneous arterial oxygen saturation SpO ₂ ".

Of the text information of the numerical values extracted in "orange", the numerical value of "numerical value including a decimal point", more preferably "numerical value including a decimal point, 2 digits and 1 digit after the decimal point" is specified as "body temperature BT". To do.

Of the numerical text information extracted in "white", "numerical value less than 40", more preferably "numerical value 8 or more and less than 40" is specified as "respiratory rate RR".

Of the numerical text information extracted in "green", "a numerical value of 45 or more and 180 or less" is specified as "pulse PR".

By executing the above processing, vital sign data can be specified from the monitor image information. In addition to this embodiment, the conditions related to the numerical values may be further added to the conditions such as Example 1.

Identification information for identifying the vital sign monitor 2 or code information 100 in which the identification information is coded is attached to a predetermined location such as the bezel portion (frame portion) of the vital sign monitor 2, and the photographing device 4 When the vital sign monitor 2 is photographed, the identification information or the code information 100 may also be photographed so that the photographed vital sign monitor 2 can be automatically identified. FIG. 11 schematically shows an example of such a vital sign monitor 2. In FIG. 11, code information 100, which is a two-dimensional code of the identification information that identifies the vital sign monitor 2, is attached.

In this case, the identification information of the vital sign monitor 2 and the vital sign data displayed by the vital sign monitor 2 are provided in advance in a computer system such as the vital sign data input support system 1 or the electronic medical record system to which the vital sign data is output. The patient's identification information is stored in association with the patient's identification information.

Then, when a doctor, a nurse, an emergency worker, or the like takes a picture of the vital sign monitor 2, the identification information and the code information 100 are taken so as to be reflected. Then, the monitor image information input reception processing unit 20 receives the input of the monitor image information, and the vital sign data identification processing unit 22 executes the above-described processes of the first to third embodiments to obtain the vital sign data. To identify. Further, the vital sign data identification processing unit 22 identifies the vital sign monitor 2 identification information based on the identification information and the code information 100 reflected in the monitor image information.

When the vital sign data input support system 1 associates the vital sign monitor 2 identification information with the patient identification information, the corresponding patient identification information is based on the identified vital sign monitor 2 identification information. Is specified, and is stored in the vital sign data storage unit 23 in association with the specified vital sign data. When the output processing unit 24 outputs the vital sign data, it also transmits the identification information of the corresponding patient, and when the computer system such as the electronic medical record system accepts them, the electronic medical record of the patient and the vital sign of the patient are received. A computer system that stores data stores each patient.

Further, when the identification information of the vital sign monitor 2 and the identification information of the patient are associated with each other in a computer system such as an electronic medical record system, the identified vital sign data is associated with the identification information of the vital sign monitor 2. Is stored in the vital sign data storage unit 23. Further, when the output processing unit 24 outputs the vital sign data, the identification information of the corresponding vital sign monitor 2 is also transmitted, and the computer system such as the electronic medical record system accepts them. In a computer system such as an electronic medical record system, a computer that identifies the corresponding patient's identification information based on the identified vital sign monitor 2 identification information and stores the patient's electronic medical record and the patient's vital sign data. Have the system store vital sign data for each patient.

By performing such processing, vital sign data can be stored for each patient.

In addition to the vital sign monitor 2 identification information and its code information, the vital sign monitor 2 may be accompanied by patient identification information and its code information 100. In that case, as described above, the conversion process to the patient identification information based on the vital sign monitor 2 identification information is unnecessary, and the patient identification information can be directly specified.

The vital sign data input support system 1 of the present invention reduces the burden of manually recording the vital sign data displayed on the vital sign monitor 2 without using the output program built in the vital sign monitor 2. Can be done.

1: Vital sign data input support system 2: Vital sign monitor 3: Processing terminal 4: Imaging device 20: Monitor image information input reception processing unit 21: Monitor image information storage unit 22: Vital sign data identification processing unit 23: Vital sign data Storage unit 24: Output processing unit 70: Calculation device 71: Storage device 72: Display device 73: Input device 74: Communication device 100: Code information

Claims (20)

It is a vital sign data input support system that supports the input of vital sign data to be displayed on the vital sign monitor.
The vital sign data input support system is
A vital sign data identification processing unit that identifies vital sign data by performing character recognition processing on monitor image information captured by the vital sign monitor.
An output processing unit that outputs the specified vital sign data to a predetermined computer system, and
Vital signs data input support system characterized by having. The vital sign data identification processing unit
Character recognition processing is performed on the monitor image information, tag information indicating the item of the vital sign data is specified, and the vital sign data of the item is specified by specifying the numerical value corresponding to the tag information.
The vital sign data input support system according to claim 1, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
Among the numerical values corresponding to the tag information, the vital sign data of the item is specified by specifying the numerical value that satisfies the condition for each item of the vital sign data corresponding to the tag information.
The vital sign data input support system according to claim 2, characterized in that. The vital sign data identification processing unit
Regarding the vital sign data of an item unspecified in the vital sign data based on the tag information, among the text information recognized by the character recognition process, a numerical value that satisfies the conditions for each item of the vital sign data is used as the vital sign data. Identify,
The vital sign data input support system according to claim 2 or 3, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
Character recognition processing is performed on the monitor image information, and among the recognized text information, a numerical value that satisfies the conditions for each item of vital sign data is specified as the vital sign data.
The vital sign data input support system according to claim 1, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
As a condition for each item of the vital sign data, among the text information recognized by the character recognition process, the numerical values on the left and right of the predetermined symbol are specified, and those numerical values are specified as the vital sign data of blood pressure.
The vital sign data input support system according to claim 4 or 5, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
As a condition for each item of the vital sign data, among the text information recognized by the character recognition process, the numerical values on the left and right of the predetermined symbol are specified.
When one or both of the specified numerical values satisfy the conditions of the predetermined numerical range regarding blood pressure, the specified numerical values are specified as blood pressure vital sign data.
The vital sign data input support system according to claim 4 or 5, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
As a condition for each item of the vital sign data, a numerical value including a decimal point is specified, and the numerical value is specified as a numerical value of body temperature.
The vital sign data input support system according to claim 4 or 5, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
As a condition for each item of the vital sign data, if a numerical value including a decimal point cannot be specified, a three-digit numerical value equal to or higher than a predetermined threshold value is specified, and the value obtained by reducing the value to 1/10 is specified as the body temperature value. To do,
The vital sign data input support system according to claim 4 or 5, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
If the numerical value including the specified decimal point or the numerical value obtained by reducing the three-digit numerical value above the threshold value to 1/10 satisfies the condition of the numerical range relating to the body temperature, the numerical value is used as the vital sign data of the body temperature. Identify as,
The vital sign data input support system according to claim 8 or 9, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
As a condition for each item of the vital sign data, after specifying the vital sign data of the blood pressure and / or body temperature, among the unspecified numerical values, a numerical value that satisfies the condition of the numerical range relating to the predetermined respiratory rate is the respiratory rate. Specified as vital sign data of
The vital sign data input support system according to any one of claims 4 to 10. As a condition for each item of the vital sign data, after specifying the vital sign data of the blood pressure, body temperature and / or respiratory rate, 101 or more of the unspecified values are specified as the vital sign data of the pulse.
The vital sign data input support system according to any one of claims 4 to 11. The vital sign data identification processing unit
Character recognition processing for each color is performed on the monitor image information, and a numerical value displayed in a color indicating the percutaneous arterial oxygen saturation is specified as vital sign data of the percutaneous arterial oxygen saturation.
The vital sign data input support system according to any one of claims 4 to 12, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
Character recognition processing for each color is performed on the monitor image information, and it is a numerical value displayed in a color other than the color for displaying the percutaneous arterial oxygen saturation, and is related to a predetermined pulse among unspecified numerical values. Specify the numerical value that satisfies the condition of the numerical range as the vital sign data of the pulse.
The vital sign data input support system according to any one of claims 4 to 12, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
Character recognition processing for each color used for displaying each item of preset vital sign data is performed on the monitor image information.
The numerical value recognized by the character recognition process for each color is specified as vital sign data of the item.
The vital sign data input support system according to any one of claims 1 to 14, characterized in that. The vital sign data identification processing unit
Among the numerical values recognized by the character recognition process for each color, the numerical values that satisfy the conditions for each item of the vital sign data are recognized as the vital sign data of the item.
The vital sign data input support system according to claim 15, characterized in that. The vital sign data identification processing unit
The monitor identification information or its code information in the monitor image information is read, and the patient identification information corresponding to the monitor identification information is specified.
The output processing unit
The specified vital sign data and the patient identification information are output to a predetermined computer system.
The vital sign data input support system according to any one of claims 1 to 16, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
Read the monitor identification information or its code information in the monitor image information,
The output processing unit
By outputting the specified vital sign data and the monitor identification information to a predetermined computer system, the patient identification information corresponding to the monitor identification information is specified, and the vital sign data and the patient identification information are associated with each other. To memorize
The vital sign data input support system according to any one of claims 1 to 16, wherein the vital sign data input support system is characterized. The vital sign data identification processing unit
Read the patient identification information or its code information in the monitor image information,
The output processing unit
The specified vital sign data and the patient identification information are output to a predetermined computer system.
The vital sign data input support system according to any one of claims 1 to 16, wherein the vital sign data input support system is characterized. Computer,
Vital sign data identification processing unit that identifies vital sign data by performing character recognition processing on the monitor image information taken by the vital sign monitor,
Output processing unit that outputs the specified vital sign data to a predetermined computer system,
Vital signs data input support program characterized by functioning as.

Images