KR102531993B1 - Method for analyzing biometric image through image analysis model and method for predicting shock occurrence using the same - Google Patents

Abstract

Disclosed are a biometric information image analysis method through an image analysis model, a shock occurrence prediction method using the same, an apparatus, and a computer program. A biometric information image analysis method through an image analysis model and a shock occurrence prediction method using the same according to various embodiments of the present invention include the steps of collecting visualized biometric information data, the visualized biometric information data Generating a biometric information image using biometric information data, analyzing the biometric information image, and detecting an event for the user according to an analysis result of the biometric information image.

Description

Biometric information image analysis method through image analysis model and shock occurrence prediction method using the same

Various embodiments of the present invention relate to a biometric information image analysis method through an image analysis model, and a shock occurrence prediction method, apparatus, and computer program using the same.

The ICU has a great impact on the survival and death of patients, and even in important health care organizations that account for 25% of domestic medical expenses, the quality and efficiency of care such as the lack of dedicated medical personnel for critical patients, differences between hospitals/regions, high mortality during patient transfer, etc. is in a very poor condition.

According to an article in the Hankook Ilbo on May 22, 2018, according to the '2014 (1st) intensive care unit adequacy evaluation result' announced by the Health Insurance Review and Assessment Service in 2016, the average number of ICU beds per ICU specialist in Korea The number reaches a whopping 44.7 beds, with 40.4 beds for tertiary general hospitals and 48.9 beds for general hospitals. As such, the average number of beds per specialist in charge is so high that it is difficult for patients admitted to the intensive care unit to even see the specialist's face.

As a result, death due to early detection of sepsis is a reality. According to the HIRA, the average mortality rate of adult patients admitted to intensive care units in Korea is 16.9%, 14.3% in tertiary hospitals and 17.4% in general hospitals.

The intensive care unit is a place for patients with very serious problems such as breathing and heartbeat, which are essential functions for maintaining life, and is a place where intensive care is received 24 hours a day, 7 days a week, 365 days a week, and the condition of patients in intensive care can change at any time. In order not to miss the data, it is necessary to measure and analyze patients' biometric data in real time.

However, there is a problem in that it is difficult to extract valuable information from large-scale and complex data because data generated by each medical device has many types and formats, and the amount of generated data is enormous.

Korean Patent Registration No. 10-1070389 (2011.09.28)

The problem to be solved by the present invention is through an image analysis model that provides real-time information on changes in the patient's condition by analyzing the vast amount of data measuring the patient's biometric information and detecting various events occurring to the patient and the possibility of event occurrence. It is to provide a biometric information image analysis method, a method for predicting shock occurrence using the same, a device, and a computer program.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

A biometric information image analysis method through an image analysis model and a shock occurrence prediction method using the same according to an embodiment of the present invention for solving the above problems are performed by a computing device, in which visualized biometric information data Collecting, generating a biometric information image using the visualized biometric information data, analyzing the biometric information image, and detecting the occurrence of an event for the user according to the analysis result of the biometric information image. can include

A biometric information image analysis method through an image analysis model according to another embodiment of the present invention for solving the above problems and a shock occurrence prediction device using the same according to another embodiment of the present invention include a memory for storing one or more instructions and the one or more instructions stored in the memory and a processor that executes the one or more instructions, thereby collecting visualized biometric information data, generating a biometric information image using the visualized biometric data, and performing the biometric information image using the visualized biometric information data. Analyzing an information image and detecting an occurrence of an event for the user according to the analysis result of the biometric information image, and a biometric information image analysis method using the image analysis model and a shock prediction method using the same can be performed. there is.

A biometric information image analysis method through an image analysis model according to another embodiment of the present invention for solving the above problems and a computer program for predicting shock occurrence using the same are combined with a computer, which is hardware, to collect visualized biometric information data. generating a biometric information image using the visualized biometric information data, analyzing the biometric information image, and detecting an event for the user according to an analysis result of the biometric information image. It can be stored in a computer-readable recording medium to perform a biometric information image analysis method through an image analysis model and a shock occurrence prediction method using the same.

Other specific details of the invention are included in the detailed description and drawings.

The problem to be solved by the present invention has the advantage of providing real-time information about changes in the patient's condition by analyzing the vast amount of data measuring the patient's biometric information and detecting various events occurring to the patient and the possibility of event occurrence.

In addition, in order to accurately predict the patient's risk signs, the patient's condition is monitored in real time 24 hours a day, 365 days a year, AI-based prediction is performed, and when abnormal signs appear, an alarm is immediately sent to the nurse in charge so that they can respond in advance. It is equipped with a visualization function so that the progress can be grasped at a glance.

In addition, it is possible to contribute to improving the quality of care for elderly critically ill patients who are relatively vulnerable by eliminating manual input of patient vitality information by nursing personnel and ensuring real-time processing of patient data.

In addition, as it is possible to achieve the effect of shortening the hospitalization period of severely ill patients, there is an advantage that it is possible to reduce the national medical cost for severely ill patients.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 is a block diagram of a biometric information image analysis method through an image analysis model and a shock occurrence prediction system using the same according to an embodiment of the present invention.
2 is a hardware configuration diagram of a biometric information image analysis method using an image analysis model and a shock occurrence prediction device using the same according to another embodiment of the present invention.
3 is a flow chart of a biometric information image analysis method through an image analysis model and a shock occurrence prediction method using the same according to another embodiment of the present invention.
4 is a diagram illustrating a configuration in which an event detection device images biometric information data according to various embodiments.
5 is a diagram illustrating a process in which an event detection device learns a first artificial intelligence model and a second artificial intelligence model in various embodiments.
6 is a flowchart of a method for detecting event occurrence using an artificial intelligence model, in various embodiments.

Advantages and features of the present invention, and methods of achieving them, will become clear with reference to the detailed description of the following embodiments taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, only these embodiments are intended to complete the disclosure of the present invention, and are common in the art to which the present invention belongs. It is provided to fully inform the person skilled in the art of the scope of the invention, and the invention is only defined by the scope of the claims.

Terminology used herein is for describing the embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms unless specifically stated otherwise in a phrase. As used herein, "comprises" and/or "comprising" does not exclude the presence or addition of one or more other elements other than the recited elements. Like reference numerals throughout the specification refer to like elements, and “and/or” includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various components, these components are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first element mentioned below may also be the second element within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which the present invention belongs. In addition, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless explicitly specifically defined.

The term "unit" or "module" used in the specification means a hardware component such as software, FPGA or ASIC, and "unit" or "module" performs certain roles. However, "unit" or "module" is not meant to be limited to software or hardware. A “unit” or “module” may be configured to reside in an addressable storage medium and may be configured to reproduce one or more processors. Thus, as an example, a “unit” or “module” may refer to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. Functions provided within components and "units" or "modules" may be combined into smaller numbers of components and "units" or "modules" or may be combined into additional components and "units" or "modules". can be further separated.

The spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe a component's correlation with other components. Spatially relative terms should be understood as including different orientations of elements in use or operation in addition to the orientations shown in the drawings. For example, if you flip a component that is shown in a drawing, a component described as "below" or "beneath" another component will be placed "above" the other component. can Thus, the exemplary term “below” may include directions of both below and above. Components may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

In this specification, a computer means any kind of hardware device including at least one processor, and may be understood as encompassing a software configuration operating in a corresponding hardware device according to an embodiment. For example, a computer may be understood as including a smartphone, a tablet PC, a desktop computer, a laptop computer, and user clients and applications running on each device, but is not limited thereto.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Although each step described in this specification is described as being performed by a computer, the subject of each step is not limited thereto, and at least a part of each step may be performed in different devices according to embodiments.

1 is a block diagram of a biometric information image analysis method through an image analysis model and a shock occurrence prediction system using the same according to an embodiment of the present invention.

Referring to FIG. 1 , a biometric information image analysis method through an image analysis model and a shock occurrence prediction system using the same according to an embodiment of the present invention include an event detection device 100, a user terminal 200, and an external server 300 ) may be included.

Here, the event occurrence detection system through artificial intelligence-based image analysis shown in FIG. 1 is according to an embodiment, and its components are not limited to the embodiment shown in FIG. may be deleted.

In one embodiment, the event detection device 100 may collect biometric information data sensed from the user. For example, the event detection device 100 is installed on at least a part of the user's body and detects the user's biometric information from a plurality of sensors (eg, a blood pressure sensor, a body temperature sensor, a pulse rate sensor, and a respiratory rate sensor). Vital sign data including at least one of data, body temperature data, pulse data, and respiratory rate data may be collected.

In various embodiments, the event occurrence detection device 100 may collect biometric information data from the outside and collect biometric information data visualized like a graph.

In various embodiments, the event detection device 100 may collect scalar biometric information data from the outside. However, it is not limited thereto, and various types of data representing the user's biometric information may be collected.

In one embodiment, the event occurrence detection device 100 may generate a biometric information image using visualized biometric information data. For example, the event detection device 100 may generate a biometric information image by capturing graph-type biometric information data collected in real time at predetermined intervals.

In various embodiments, when externally collected biometric information data is in scalar form, the scalar form of biometric information data may be visualized in a graph form, and a biometric information image may be generated by capturing the visualized biometric information data. However, it is not limited thereto.

In one embodiment, the event detection device 100 may analyze the biometric information image to determine whether an event has been detected for the user. For example, the event occurrence detection device 100 may determine detection of an event occurrence for a user by analyzing a biometric information image using an image analysis model.

Here, the image analysis model may be an artificial intelligence model (eg, a first artificial intelligence model and a second artificial intelligence model) pre-trained using a specific image and information indicated by the specific image as learning data. However, it is not limited thereto.

Also, here, an event means an abnormal state generated by a user. For example, the event may include any one or more of hypovolemic shock, cardiogenic shock, obstructive shock, and distributive shock.

In one embodiment, the event detection device 100 may provide a user interface (UI) for outputting information related to an event, such as a user's biometric information data, a biometric information image, whether or not an event has occurred, and the like.

In one embodiment, the user terminal 200 may include a display on at least a portion of the user terminal 200, and various information (eg, event occurrence) provided from the event detection device 100 through the network 400 information on whether or not and information on the possibility of event occurrence) can be output. For example, the user terminal 200 may output a UI provided from the event detection device 100 (eg, a UI for outputting user biometric information and information related to event occurrence), and an event occurs through the UI. Various types of information provided from the sensing device 100 may be output.

In various embodiments, the user terminal 200 may include at least one of a smart phone, a tablet PC, a laptop desktop, and a kiosk. However, it is not limited thereto.

In one embodiment, the external server 300 may be wired or wirelessly connected to the event detection device 100 through the network 400, and various information (eg, information on whether an event has occurred and Information on the possibility of event occurrence) may be provided and stored.

Here, the biometric information image analysis method through the image analysis model shown in FIG. 1 and the shock occurrence prediction system using the same are described in a form in which various data generated by the event detection device 100 are stored in an external server 300 However, it is not limited thereto, and the event detection device 100 may include a separate storage device to store various data in the separately provided storage device.

In various embodiments, the external server 300 may store a variety of patient-related information (eg, patient personal information, patient disease information, etc.), and may store any one or more of the stored patient-related data as an event detection device. (100) can be provided. For example, the external server 300 may be a hospital server, and when receiving a request for information on a specific patient from the event detection device 100, the event occurrence detection device 100 selects various information related to the specific patient. ) can be provided. Hereinafter, with reference to FIG. 2, the hardware configuration of the event detection device 100 will be described.

2 is a hardware configuration diagram of a biometric information image analysis method using an image analysis model and a shock occurrence prediction device using the same according to another embodiment of the present invention.

Referring to FIG. 2 , an event detection device 100 (hereinafter referred to as “computing device 100”) according to another embodiment of the present invention may include a processor 110 and a memory 120. In various embodiments, the computing device 100 may further include a network interface (or communication interface) (not shown), a storage (not shown), and a bus (not shown).

In one embodiment, the processor 110 may control the overall operation of each component of the computing device 100 . The processor 110 may include a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), or any type of processor well known in the art.

In various embodiments, the processor 110 may perform an operation for at least one application or program for executing a method according to embodiments of the present invention. In various embodiments, the processor 110 includes one or more cores (not shown) and a graphics processor (not shown) and/or a connection path (eg, a bus) for transmitting and receiving signals to and from other components. can do.

In various embodiments, the processor 110 may temporarily and/or permanently store signals (or data) processed in the processor 110 (RAM: Random Access Memory, not shown) and ROM (ROM: Read -Only Memory, not shown) may be further included. In addition, the processor 110 may be implemented in the form of a system on chip (SoC) including at least one of a graphics processing unit, RAM, and ROM.

In one embodiment, the processor 110 executes one or more instructions stored in the memory 120, thereby performing a method to be described with reference to FIGS. 3 to 8 (a biometric information image analysis method through an image analysis model and using the same). Shock occurrence prediction method) can be performed. For example, the processor 110 executes one or more instructions stored in the memory 120 to collect visualized biometric information data, generate a biometric information image using the visualized biometric data, and biometric information. An operation of analyzing an image and an operation of detecting occurrence of an event for a user according to an analysis result of the biometric information image may be performed.

In one embodiment, memory 120 may store various data, commands and/or information. The memory 120 may store programs (one or more instructions) for processing and control of the processor 110 . Programs stored in the memory 120 may be divided into a plurality of modules according to functions.

In various embodiments, steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, implemented in a software module executed by hardware, or a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any form of computer readable recording medium well known in the art to which the present invention pertains.

Components of the present invention may be implemented as a program (or application) to be executed in combination with a computer, which is hardware, and stored in a medium. Components of the present invention may be implemented as software programming or software elements, and similarly, embodiments may include various algorithms implemented as data structures, processes, routines, or combinations of other programming constructs, such as C, C++ , Java (Java), can be implemented in a programming or scripting language such as assembler (assembler). Functional aspects may be implemented in an algorithm running on one or more processors. Hereinafter, with reference to FIGS. 3 to 8 , a biometric information image analysis method through an image analysis model performed by the computing device 100 and a shock occurrence prediction method using the same will be described.

3 is a flow chart of a biometric information image analysis method through an image analysis model and a shock occurrence prediction method using the same according to another embodiment of the present invention.

Referring to FIG. 3 , in step S110 , the computing device 100 may collect biometric information data from the outside. For example, the computing device 100 may include blood pressure data, body temperature data, and pulse data generated from a plurality of sensors (eg, a blood pressure sensor, a body temperature sensor, a pulse sensor, and a respiration sensor) that detect biometric information of a patient. And vital sign data including at least one of respiratory rate data may be collected.

In various embodiments, the computing device 100 may include blood pressure data, body temperature data, pulse data, and respiration rate generated from a plurality of sensors (eg, a blood pressure sensor, a body temperature sensor, a pulse rate sensor, and a respiration sensor) for detecting biometric information of a patient. Visualized vital sign data may be collected from a biometric information output device (eg, a bedside monitoring device in an intensive care unit) that visualizes and outputs vital sign data including at least one of the data.

In various embodiments, the computing device 100 directly collects vital sign data including at least one of blood pressure data, body temperature data, pulse data, and respiratory rate data from a plurality of sensors that sense patient's biometric information; Vital sign data collected directly can be visualized in graph form.

In various embodiments, the computing device 100 performs outlier analysis (eg, when there is a standardized outlier pattern, removing the outlier, using a standard deviation such as the Mahalanobis distance) for biometric data collected from the outside. Noise removal using a filter) may be performed, and a biometric information image may be generated using only the biometric information data from which noise is removed through outlier analysis in step S120 described below.

In step S120, the computing device 100 may generate a biometric information image using the visualized biometric information data collected in step S110.

In various embodiments, the computing device 100 generates a biometric information image using the visualized biometric information data, divides the biometric information image into a predetermined time unit, and divides the biometric information image into a plurality of unit bioinformation images for learning an image analysis model. can create Hereinafter, referring to FIG. 4 , a biometric information image generation method performed by the computing device 100 will be described.

4 is a diagram illustrating a configuration in which an event detection device images biometric information data according to various embodiments.

Referring to FIG. 4 , in various embodiments, the computing device 100 may generate a biometric information image using biometric information data collected from the outside, and generate a plurality of unit biometric information images by dividing the biometric information image. can do.

First, the computing device 100 collects biometric information data (eg, vital sign data) visualized in a graph form from the outside, or collects scalar-type biometric information data from the outside and graphs the collected scalar-type biometric information data. Visualized biometric information data can be created by visualizing it in a form.

In various embodiments, the computing device 100 may collect the user's biometric information data for each predetermined first period (T).

In various embodiments, the computing device 100, when the cycles in which biometric data is detected from each of the plurality of sensors are different from each other, determines the sensor having the shortest cycle among the cycles of detecting biometric information data set in each of the plurality of sensors as the basis. Information data can be collected. However, it is not limited thereto.

Thereafter, the computing device 100 may generate a biometric information image using the biometric information data visualized in a graph form. For example, the computing device 100 may generate a biometric information image by capturing biometric information data in the form of a graph collected in real time at every predetermined second period.

Here, the computing device 100 may set the second period equal to or shorter than the first period, but is not limited thereto.

Thereafter, the computing device 100 may generate a plurality of unit biometric information images by segmenting the captured biometric information image.

In various embodiments, the computing device 100 may generate a plurality of unit biometric information images by dividing the biometric information image based on a predetermined unit of time.

In various embodiments, the computing device 100 may generate a plurality of unit biometric information images by dividing the biometric information image into a predetermined number.

In various embodiments, the computing device 100 may adjust a time unit of each of a plurality of unit biometric information images or combine two or more unit biometric information images into one based on whether an event has occurred and whether the event has occurred.

Here, the computing device 100 may use a plurality of unit biometric information images as input values for image analysis performed in the image analysis model, and may use the image analysis model as learning data for learning the image analysis model. However, it is not limited thereto.

In various embodiments, the computing device 100 generates a biometric information image using a plurality of biometric information data (eg, vital sign data in the form of a graph), and visualizes the biometric information image in different shapes and patterns according to the type of biometric data. Alternatively, biometric information images can be created by visualizing them in different colors. For example, if the biometric information data is blood pressure data, the computing device 100 may visualize it in the form of a bar graph representing a diastolic blood pressure value and a maximal blood pressure value, and if the biometric data is body temperature data, the body temperature at the time of detection. Values can be visualized in the form of a line graph.

In addition, the computing device 100 visualizes a plurality of biometric information in the form of a line graph, but sets the blood pressure value to blue color, the body temperature value to red color, and the pulse rate value to orange color. That is, the computing device In (100), it is possible to check the numerical change and pattern change for each type of biometric information data by different visualization or color difference for each type of biometric data, as well as the correlation between each biometric data. , it can be used to determine whether an event has occurred and the possibility of an event occurring.

In various embodiments, the computing device 100 generates a biometric information image using a plurality of biometric information data (eg, vital sign data in the form of a graph), and individually uses each biometric information data to generate each biometric information. A plurality of biometric information images corresponding to the data may be generated.

Referring back to FIG. 3 , in step S130 , the computing device 100 may perform image analysis on the biometric information image generated in step S120 .

In various embodiments, the computing device 100 may perform image analysis on the biometric information image itself or image analysis on each of a plurality of unit biometric information images generated by segmenting the biometric information image.

In various embodiments, the computing device 100 analyzes a biometric information image using a pre-learned artificial intelligence model, but may selectively use the artificial intelligence model according to the type of analysis result to be derived by analyzing the biometric information image. there is.

For example, when the type of analysis result to be derived by analyzing the biometric information image is whether an event has occurred, the computing device 100 uses the pre-learned first artificial intelligence model to obtain a biosignal image and a plurality of units of biometric information. Images can be image analyzed. Here, the pre-learned first artificial intelligence model may refer to a model obtained by learning a plurality of biosignal images labeled with whether an event has occurred as training data.

In various embodiments, when the type of analysis result to be derived by analyzing the biometric information image is the possibility of event occurrence, the computing device 100 uses the pre-learned second artificial intelligence model to obtain the biosignal image and a plurality of unit biometrics. Information images can be image analyzed. Here, it may refer to a model obtained by learning a biometric information image at a second point in time a predetermined time before the first point in time based on the first point in time when the event occurred as training data.

Here, the first artificial intelligence model and the second artificial intelligence model are assumed to be models learned using different learning data (e.g., a plurality of biosignal images labeled with the occurrence of an event, a biometric information image before an event occurs). Although described, but not limited thereto, one artificial intelligence model (e.g., CNN model, NN model, RNN model) learns a plurality of biosignal images labeled with the occurrence of events and biometric information images prior to event occurrence Thus, one artificial intelligence model can perform both the functions of the first artificial intelligence model and the second artificial intelligence model.

Here, the first artificial intelligence model and the second artificial intelligence model are assumed to be models learned using different learning data (e.g., a plurality of biosignal images labeled with the occurrence of an event, a biometric information image before an event occurs). Although described, but not limited thereto, one artificial intelligence model (e.g., CNN model, NN model, RNN model) learns a plurality of biosignal images labeled with the occurrence of events and biometric information images prior to event occurrence Thus, one artificial intelligence model can perform both the functions of the first artificial intelligence model and the second artificial intelligence model. Hereinafter, with reference to FIG. 5, a process for the computing device 100 to learn a first artificial intelligence model and a second artificial intelligence model will be described.

In various embodiments, when biometric information data is collected from the outside in scalar form, the computing device 100 analyzes the biometric information data by using the scalar form of biometric information data as learning data using a pre-learned third artificial intelligence model. can do.

In various embodiments, the computing device 100 analyzes the biometric information image generated in step S120, determines the type of corresponding biometric data based on the visualization form and color of the biometric data included in the biometric information image, Depending on the type of determined biometric information data, different AI models may be applied to analyze images.

5 is a diagram illustrating a process in which an event detection device learns a first artificial intelligence model and a second artificial intelligence model in various embodiments.

In various embodiments, the computing device 100 may train the first artificial intelligence model and the second artificial intelligence model by using the biometric information image and the plurality of unit biometric information images.

First, the computing device 100 may generate a plurality of unit biometric information images by dividing the biometric information image by a predetermined time unit or by dividing the biometric information image by a predetermined number.

Thereafter, the computing device 100 may select a unit bio information image to be used as training data from among a plurality of unit bio information images. For example, the computing device 100 includes a unit biometric information image including a time point at which an event is determined to have occurred through image analysis among a plurality of unit biometric information images, and a time point at which an event bar is generated based on a time point at which an event occurs. A previous unit biometric information image may be selected as training data.

In various embodiments, the computing device 100 may provide the user terminal 200 with a UI for selecting a biometric information image related to an event from among a plurality of unit biometric information images, and may select one of the plurality of unit biometric information images through the UI. A biometric information image related to an event may be selected.

Thereafter, the computing device 100 may perform labeling on the unit biometric information image selected as training data. For example, the computing device 100 labels the correct answer of each unit biometric information image selected as training data (e.g., labels a unit biometric information image including a time point at which an event occurs as class 1, and is not related to the occurrence of an event). unit biometric information image may be labeled as class 0).

In various embodiments, the computing device 100 may directly receive a label for a biometric information image related to an event from a user through a UI for selecting a biometric information image related to the event. For example, the computing device 100 may provide a UI for selecting a biometric information image related to an event to a medical doctor's terminal, select a biometric information image related to an event from among a plurality of unit biometric information images, and receive the selection at the same time. Labeling information of the biometric information image may be input together.

In various embodiments, the computing device 100 may label a unit biometric information image including a time point at which an event occurs differently depending on the cause of the event and the type of the event. However, it is not limited thereto.

In various embodiments, when it is determined that an event occurs based on the user's biometric information image, the computing device 100 automatically labels biometric information images prior to a predetermined time from when the event occurred. can do. In this case, the computing device 100 may also label information indicating how many hours ago the biometric information is from the event occurrence time. For example, the computing device 100 may label biometric information images from 6 hours ago, 12 hours ago, and 24 hours before the event occurred as different classes.

Thereafter, the computing device 100 may perform supervised learning on the first artificial intelligence model and the second artificial intelligence model using the labeled unit biometric information image. For example, the first artificial intelligence model and the second artificial intelligence model may be trained by supervising the computing device 100 using learning data (a biometric information image related to an event) obtained according to a labeling result. However, it is not limited thereto, and various methods of learning an artificial intelligence model using a biometric information image may be applied.

Referring back to FIG. 3 , in step S140 , the computing device 100 may detect the occurrence of an event using an analysis result obtained through image analysis performed in step S130 . Hereinafter, with reference to FIG. 6 , a method of detecting an event performed by the computing device 100 will be described.

6 is a flowchart of a method for detecting event occurrence using an artificial intelligence model, in various embodiments.

Referring to FIG. 6 , in step S210 , the computing device 100 may determine whether an event has occurred by using an analysis result obtained through image analysis performed in step S130 .

In various embodiments, the computing device 100 inputs a biometric information image to determine whether an event has occurred, a plurality of biosignal images labeled with whether an event has occurred, as training data to the pre-learned first artificial intelligence model, It is possible to determine whether an event has occurred based on the analysis result derived using the first artificial intelligence model.

In various embodiments, the computing device 100 may determine whether an event has occurred by comparing a biometric information image to be determined whether an event has occurred and a biometric information image detected when an event has occurred.

In step S220, the computing device 100 may determine the cause of the event when it is determined that the event has occurred through step S210.

In various embodiments, the computing device 100 may determine the cause of the event using the first artificial intelligence model.

For example, in response to determining that an event has occurred according to the analysis result derived through the first artificial intelligence model, the computing device 100 analyzes each of a plurality of unit biometric information images and obtains the biometric information image from the analysis result. The image pattern of can be detected.

Then, the computing device 100 may determine the type and cause of the event by using the detected image pattern. For example, if the detected image pattern has a first pattern, the computing device 100 may determine that the event occurred is hypovolemic shock, and if it has a second pattern, the event occurred may indicate cardiogenic shock. can be judged to be However, it is not limited thereto.

In step S230, the computing device 100 may determine the possibility of an event when it is determined that the event has not occurred through step S210.

In various embodiments, the computing device 100 converts the biometric information image at a second point in time, a predetermined time prior to the first point in time, based on the first point in time at which the event occurred, to determine the possibility of event occurrence. As learning data, the pre-learned second artificial intelligence model may be input, and the possibility of an event occurring may be determined based on an analysis result analyzed using the second artificial intelligence model. Here, steps S210 to S230 may correspond to step S140 of FIG. 3 .

In various embodiments, the computing device 100 determines the likelihood of an event by analyzing the user's biometric information image, and classifies the event occurrence risk group when the determined event likelihood is greater than or equal to a reference value. Thereafter, the computing device 100 may monitor the user's condition more frequently by setting a shorter cycle for collecting biometric data and generating biometric information images for users classified as an event risk group.

In various embodiments, the computing device 100 may train the first artificial intelligence model and the second artificial intelligence model by using a biometric information image of a user classified as a risk group and whether an actual event of the corresponding user has occurred as training data. there is. Through this, the computing device 100 may use an artificial intelligence model to determine whether an event actually occurs according to an event possibility.

In various embodiments, the computing device 100 may provide a user interface (UI) that visualizes information related to the user, the user's biometric data, and whether or not an event has occurred for the user, and configures and outputs the information on a single screen. can Through this, the computing device 100 provides a dashboard where information on the patient and status information can be viewed at a glance, so that a user who monitors the patient's condition can more easily monitor the patient's condition and follow the occurrence of an event. It can motivate you to react quickly.

In various embodiments, when an event occurs, the computing device 100 may output a guide message and a warning signal for guiding whether or not the event has occurred and information related to the occurred event through the UI. For example, when it is determined that an event has occurred through image analysis of a biometric information image, the computing device 100 outputs a guide message guiding information related to the event and a warning signal in the form of a voice through the UI. , the user who monitors the patient's condition in real time can quickly recognize whether an event has occurred.

In various embodiments, the computing device 100 may set the output form of the warning signal based on the type of event determined through the biometric information image. For example, the computing device 100 sets the type of output audio data according to the type of event (e.g., if the event is hypovolemic shock, outputs first audio data, and if the event is cardiogenic shock, outputs second audio data). output) or set the output time of voice data. However, it is not limited thereto.

In various embodiments, the computing device 100 may provide a UI that outputs information about a plurality of users, biometric information about each of the plurality of users, and information related to an event, and requests information about a specific user through the UI. When this is input, only information about a specific user, biometric information about the specific user, and information related to an event can be configured as one screen and output through the UI. For example, the computing device 100 may compose only information about a specific user, biometric information about the specific user, and information related to an event on one screen and output the information in the form of a pop-up window. However, it is not limited thereto.

The biometric information image analysis method through the above-described image analysis model and the shock generation prediction method using the same have been described with reference to the flow chart shown in the drawings. For a brief explanation, the biometric information image analysis method through the image analysis model and the shock occurrence prediction method using the same have been illustrated and described as a series of blocks, but the present invention is not limited to the order of the blocks, and some blocks are described herein. It may be performed in a different order than shown and performed concurrently or in a different order. In addition, new blocks not described in the present specification and drawings may be added, or some blocks may be deleted or changed.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: event detection device (computing device)
200: user terminal
300: external server
400: network

Claims (3)

In a method performed by a computing device,
collecting biometric information data visualized in a graph form from a biometric information output device that visualizes and outputs the user's biometric information in a graph form;
generating a biometric information image by capturing the biometric information data visualized in the form of a graph at predetermined intervals;
analyzing the biometric information image; and
detecting an occurrence of an event for the user according to an analysis result of the biometric information image;
Detecting the occurrence of the event,
Based on the first time point at which the event occurred, the biometric information image at a second point in time a predetermined time before the first point in time is analyzed using the pre-learned second artificial intelligence model as learning data. Determining a possibility of an event occurring for the user based on the basis; and
When the determined event occurrence probability is greater than or equal to a reference value, the user is classified as an event occurrence risk group, and the biometric information image of the user classified as the event occurrence risk group and whether or not an event actually occurs of the user are used as learning data, and the second Learning an artificial intelligence model and determining whether an actual event occurs according to the possibility of event occurrence of each of a plurality of users using the learned second artificial intelligence model,
Biometric information image analysis method through image analysis model and shock occurrence prediction method using the same. a memory that stores one or more instructions; and
a processor to execute the one or more instructions stored in the memory;
By executing the one or more instructions, the processor:
An apparatus that performs the method of claim 1 . A computer program stored in a computer-readable recording medium to be combined with a computer, which is hardware, to perform the method of claim 1.

Images