WO2022092703A1

WO2022092703A1 - Ultrasound simulation system

Info

Publication number: WO2022092703A1
Application number: PCT/KR2021/014807
Authority: WO
Inventors: 최관용; 이준호; 이정민
Original assignee: 최관용; 이준호; 이정민
Priority date: 2020-10-27
Filing date: 2021-10-21
Publication date: 2022-05-05
Also published as: KR102274004B1

Abstract

The present invention relates to an ultrasound simulation system for simulating ultrasound diagnosis through an ultrasound phantom by a user manipulating a probe. The ultrasound simulation system according to the present invention comprises: a body-shaped body phantom; an organ phantom provided inside the body phantom and having sensors attached each to a preset position; a probe that reacts with one of the sensors of the organ phantom outside of the body phantom; an output unit that outputs an ultrasound image of an organ according to probe manipulation; and a control unit that, when the probe and one of the sensors of the organ phantom match in preset conditions, outputs an ultrasound image of an organ set to the corresponding sensor, wherein different images are output according to diseases.

Description

Ultrasonic Simulation System

The present invention relates to an ultrasound simulation system, and more particularly, to an ultrasound simulation system for simulating ultrasound diagnosis through an ultrasound phantom by a user by manipulating a probe.

Ultrasonic diagnostic equipment is a device that injects ultrasonic waves generated from a probe into a diagnostic object, converts information contained in the returned ultrasonic waves into electrical signals, and displays them on a monitor, and is currently widely used in the medical industry. It is a medical diagnostic device.

Since the results of such ultrasound diagnosis vary greatly depending on the experience and knowledge of the examiner, the examination must be performed with sufficient theoretical knowledge and practical experience. However, due to the nature of ultrasound diagnosis, it is not possible to gain practical experience without actually having a patient, and even if there is experience, there is a problem in that it is impossible to diagnose patients according to various diseases.

In order to solve this problem, Korean Patent Laid-Open No. 10-2009-0078487 discloses "a simulator for acquiring 3/4-dimensional ultrasound diagnosis technology and a simulation method thereof".

The disclosed simulator for acquiring ultrasound diagnosis technology is based on real data such as the human body, internal organs, and fetuses, and uses commercial software to model a 3D image. Virtual human body, internal organs, fetal data composed of information and color information, 3D probe data configured in a polygonal shape using the above commercial software, 3/4-dimensional modeling data of the virtual patient, and 3D probe modeling data are stored in a database and loading it from a computer equipment having a display means that can be realized on a screen, etc. to display the virtual human body in opaque/translucent mode, display the 3D probe on the screen, and enlarge/move/rotate the virtual human body and the 3D probe Thus, the two-dimensional ultrasound image is displayed on the screen at the same time according to the mutual location information, the region of interest of the two-dimensional ultrasound image and the driving information of the 3D probe are set, and the 3/4-dimensional image data is configured and visualized and displayed on the screen. , a computer device having a display means that can be realized on a screen or the like.

That is, the simulator for acquiring ultrasound diagnosis technology discloses the contents of realizing a 3/4D ultrasound image by manipulating a probe implemented on a virtual patient on the simulator to reproduce various clinical situations.

However, although the disclosed simulator for acquiring ultrasound diagnosis technology can perform ultrasound diagnosis virtually through simulation, it is difficult to obtain practical experience because it does not operate an actual probe, and it is difficult to obtain ultrasound diagnosis experience according to various diseases. there was

Accordingly, it is an object of the present invention to provide an ultrasound simulation system for simulating ultrasound diagnosis through an ultrasound phantom by a user by manipulating a probe.

Another object of the present invention is to provide an ultrasound simulation system capable of obtaining ultrasound diagnosis experience according to various diseases.

The ultrasonic simulation system according to the present invention includes a body-shaped body phantom, an organ phantom provided inside the body phantom, to which a sensor is attached for each preset position, and a probe that reacts with one of the sensors of the organ phantom from the outside of the body phantom , an output unit for outputting an ultrasound image of an organ according to the manipulation of the probe, and outputting an ultrasound image of an organ set in the corresponding sensor when one of the probe and the sensor of the organ phantom matches a preset condition through the output unit However, it is characterized in that it includes a control unit for outputting a different image according to the disease.

In the ultrasound simulation system according to the present invention, the control unit outputs an ultrasound image of an organ set in the corresponding sensor through the output unit when the position and the incident angle of the probe match values set for each sensor of the organ phantom characterized in that

In the ultrasound simulation system according to the present invention, the control unit determines the proficiency level of the user who operates the probe through user-specific information including the position of the probe, the angle of incidence, and the required time as the control unit operates the probe. do it with

In the ultrasound simulation system according to the present invention, the control unit learns the user's skill level according to the user-specific information of the probe through an artificial intelligence engine.

In the ultrasound simulation system according to the present invention, the control unit provides a mission of a difficulty corresponding to the skill level according to the determined skill level of the user.

In the ultrasound simulation system according to the present invention, the control unit provides a video in which a disease is changed according to the determined skill level of the user, or provides a mission in which a guide voice is changed according to the skill level of the user.

The ultrasound simulation system according to the present invention outputs an ultrasound image of an organ set in the corresponding sensor through the output unit when a preset condition is matched between the probe and one of the sensor of the organ phantom by the user operating the probe, thereby providing sufficient learning for the user. Give yourself time to gain experience with ultrasound diagnosis.

In addition, the ultrasound simulation system according to the present invention provides different images according to diseases, so that the user can learn cases that are difficult to observe normally, thereby improving work ability.

1 is a block diagram showing the configuration of an ultrasound simulation system according to an embodiment of the present invention.

2 is an exemplary diagram for explaining a body phantom according to an embodiment of the present invention.

3 is an exemplary diagram for explaining a long-term phantom according to an embodiment of the present invention.

4 to 7 are views illustrating ultrasound simulation results for each location according to an embodiment of the present invention.

8 is a diagram for explaining the configuration of a deep neural network (DNN) according to an embodiment of the present invention.

Prior to the detailed description of the present invention, the terms or words used in the present specification and claims described below should not be construed as being limited to their ordinary or dictionary meanings, and the inventors should develop their own inventions in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention based on the principle that it can be appropriately defined as a concept of a term for explanation. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all the technical spirit of the present invention, so various equivalents that can be substituted for them at the time of the present application It should be understood that there may be water and variations.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this case, it should be noted that in the accompanying drawings, the same components are denoted by the same reference numerals as much as possible. In addition, detailed descriptions of well-known functions and configurations that may obscure the gist of the present invention will be omitted. For the same reason, some components are exaggerated, omitted, or schematically illustrated in the accompanying drawings, and the size of each component does not fully reflect the actual size.

1 is a block diagram showing the configuration of an ultrasound simulation system according to an embodiment of the present invention, FIG. 2 is an exemplary diagram for explaining a body phantom according to an embodiment of the present invention, and FIG. 3 is an embodiment of the present invention It is an exemplary view for explaining a long-term phantom according to the present invention, and FIGS. 4 to 7 are views showing ultrasound simulation results for each location according to an embodiment of the present invention.

1 to 3 , an ultrasound simulation system 100 according to an embodiment of the present invention includes a phantom 10 , a probe 20 , an input unit 30 , an output unit 40 , a storage unit 50 and a control unit 60 .

The phantom 10 is a model used instead of a human body undergoing an ultrasound examination, and is used to measure the distribution of ultrasound in a material, such as diffusion, attenuation, and scattering of ultrasound in an object. The phantom 10 may include a body phantom 11 and an organ phantom 12 .

The body phantom 11 may have a body shape as shown in FIG. 2 , and the probe 20 comes into contact with the outer surface. The body phantom 11 may be made of a material capable of forming a touch and shape similar to that of an actual body so that the user can obtain an experience similar to that of actually contacting the probe 20 with the body.

In addition, the body phantom 11 is provided with a space capable of accommodating the organ phantom 12 therein, so that the organ phantom 12 can be accommodated therein.

The organ phantom 12 is provided inside the body phantom 11, and a sensor 21a may be attached to each preset position. At this time, the organ phantom 12 is composed of a plurality of sensors 12a and may be disposed at a preset position, but is preferably formed in a shape similar to an actual organ as shown in FIG. (12a) may be attached.

The long-term phantom 12 reacts with the probe 20, and when the position and the incident angle of the probe 20 match the values set in each sensor 12a, the controller 60 provides the control unit 60 for the corresponding position and incident angle. Information may be transmitted to the controller 60 to output an ultrasound image corresponding to a corresponding position and an incident angle through the output unit 40 .

For example, the organ phantom 12 may be used in various applications such as echocardiography, epigastric ultrasound examination, liver ultrasound examination, varicose vein ultrasound examination, gynecological ultrasound examination, prostate ultrasound examination, testicular ultrasound examination, musculoskeletal ultrasound examination, thyroid ultrasound examination, breast ultrasound examination, etc. A sensor 12a may be arranged to simulate a type of ultrasound examination. Meanwhile, in the following description, echocardiography will be described as an example.

The probe 20 has the same shape as an actual ultrasound probe, and may react with a sensor provided in the organ phantom 12 . For example, the probe 20 may include an ultrasonic sensor, an infrared sensor, a gyro sensor, and the like, and various sensors capable of reacting with a sensor provided in the organ phantom 12 may be applied. On the other hand, when one of the sensors of the probe 20 and the long-term phantom 12 reacts, the probe 20 transmits information on the position and incident angle of the corresponding sensor to the controller 60 or the corresponding sensor of the long-term phantom 12 responds. It may be transmitted to the control unit 60 , but it is preferable to transmit information on the position and incident angle of the sensor to which the probe 20 responds to the control unit 60 . In addition, the probe 20 may continuously transmit the current location, current incident angle information, and the like to the real-time controller 60 .

The input unit 30 receives various information such as number and character information, and transmits input signals related to setting various functions and controlling functions of the ultrasound simulation system 100 to the control unit 60 . The input unit 30 may include at least one of a keypad and a touchpad that generate an input signal according to a touch or manipulation. In this case, the input unit 50 may be configured in the form of a single touch panel (or touch screen) together with the display unit 41 to perform input and display functions at the same time. In particular, the input unit 30 may input information about a user who operates the probe 20 and the type of disease to be simulated.

The output unit 40 may include a display unit 41 and a speaker 42 .

The display unit 41 displays information about a series of operation states and operation results that occur while the function of the ultrasound simulation system 100 is performed. In particular, the display unit 41 may output an ultrasound image, information for each user, a skill level for each user, and the like. Here, the display unit 41 includes a liquid crystal display (LCD), an ultra-thin liquid crystal display (TFT-LCD, Thin Film Transistor LCD), a light emitting diode (LED, Light Emitting Diode), and an organic light emitting diode (OLED, Organic LED). ), an active organic light emitting diode (AMOLED, Active Matrix OLED), a retina display, a flexible display, and a three-dimensional display. In this case, when the display unit 41 is configured in the form of a touch screen, some or all of the functions of the input unit 30 may be performed.

The speaker 42 may output a guide voice for a guide related to the operating state of the probe 20 under the control of the controller 60 . For example, the speaker 42 is "adjust the angle of incidence within 60°." As such, a guide voice for a guide may be output as the user manipulates the probe 20 . At this time, the speaker 42 may output a different guide voice according to the skill level of the user under the control of the controller 60 .

The storage unit 50 is a device for storing data, and stores an application program required for a functional operation of the ultrasound simulation system 100 . When each function is activated in response to a user's request, the storage unit 50 executes corresponding application programs under the control of the control unit 60 to provide each function. In particular, the storage unit 50 includes a program for outputting an ultrasound image according to the position and angle of incidence of the probe 20 , a program for outputting an ultrasound image according to a disease, and an ultrasound image according to the position, angle of incidence, and disease of the probe 20 . can be saved. The storage unit 50 includes a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory). , Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory, ROM, Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory , a magnetic disk, and an optical disk may include at least one storage medium.

When one of the sensors of the probe 20 and the organ phantom 12 matches a preset condition, the controller 60 may output an ultrasound image of the organ set in the corresponding sensor through the display unit 41 . At this time, when the position and the incident angle of the probe 20 match the values set for each sensor of the organ phantom 41 , the controller 60 may output the ultrasound image of the organ set in the corresponding sensor through the display unit 41 . there is.

For example, when the first sensor 1 and the probe 20 match among the plurality of sensors 12a of FIG. 2 , the controller 60 may determine an incident angle of a Parasternal long axis ( FIG. 4 ) or a Parasternal short axis ultrasound image. can be printed out. In addition, when the second sensor 2 and the probe 20 match, the controller 60 may output apical 4 chamber ( FIG. 5 ), apical 2 chamber, and apical 3 chamber ultrasound images. In addition, when the third sensor 3 and the probe 20 match, the controller 60 may output an ultrasound image corresponding to a subcostal ( FIG. 6 ), and the fourth sensor 4 and the probe 20 are If they match, an ultrasound image corresponding to the suprasternal notch ( FIG. 7 ) may be output.

Here, the control unit 60 receives disease information selected through the input unit 30 , and when the position and incidence angle of the probe 20 match values set for each sensor of the organ phantom 41 , the ultrasound according to the disease information You can output an image. That is, the controller 60 may output an ultrasound image of an organ to which each disease is applied.

In addition, as the user operates the probe 20 , the controller 60 may determine the skill level of the user who operates the probe 20 through user-specific information including the position of the probe 20 , the angle of incidence, and the required time. . That is, the controller 60 may receive user-specific information from the probe 20 and determine the user's proficiency in consideration of ultrasound diagnosis accuracy and required time.

Also, the control unit 60 may learn the user's skill level according to the user-specific information of the probe 20 through the artificial intelligence engine. Accordingly, the control unit 60 may increase the accuracy according to the user's skill level determination.

Here, the controller 60 may provide a mission of a difficulty corresponding to the determined skill level of the user. For example, the controller 60 may provide a video with different diseases according to the determined skill level of the user, or provide a mission with a different guide voice according to the skill level of the user. That is, the controller 60 outputs a detailed guidance voice according to the state of the probe 20 to a user whose proficiency is lower than a preset value, and a basic guidance voice according to the state of the probe 20 to a user whose proficiency is higher than a preset value. It can be configured to output only

Meanwhile, FIG. 8 is a diagram for explaining the configuration of a deep neural network (DNN) according to an embodiment of the present invention. Here, the learning of the following proficiency is described as using a deep neural network, but various artificial intelligence engines are applicable.

Referring to FIG. 8 , a deep neural network (DNN) may be a multilayer perceptron (MLP). A deep neural network (DNN) includes multiple layers (IL, HL, OL). The plurality of layers includes an input layer (IL), a plurality of hidden layers (HL: HL1 to HLk), and an output layer (OL).

In addition, each of the plurality of layers IL, HL, and OL includes a plurality of nodes. For example, as illustrated, the input layer IL may include m input nodes i1 to im, and the output layer OL may include n output nodes o1 to on. In addition, among the hidden layers HL, the first hidden layer HL1 includes a nodes h11 to h1a, the second hidden layer HL2 includes b nodes h21 to h2b, and the kth hidden layer HL2 includes a number of nodes h21 to h2b. The layer HLk may include l nodes hk1 to hkl.

Each of the plurality of nodes of the plurality of layers performs an operation. In particular, a plurality of nodes of different layers are connected by a channel (indicated by a dotted line) having a weight (W). In other words, the calculation result of one node is weighted and becomes the input of the next layer node. That is, any one node of any one layer of the deep neural network (DNN) receives a value obtained by applying a weight to the input from the node of the previous layer, sums them up to take an activation function, and transmits the result to the input of the next layer do.

Accordingly, when user-specific information, i.e., probe position, angle of incidence, time required, etc. is input to the input layer (IL) of the deep neural network (DNN), the deep neural network (DNN) performs a plurality of measurements (IL) on the input data. , HL, and OL) are performed to calculate an output value indicating the proficiency of each inputted user information.

More specifically, when at least one of the probe position, the angle of incidence, and the required time, which are user-specific information, is input to the plurality of input nodes i1 to im of the input layer IL of the deep neural network (DNN), the first Each of the plurality of first hidden nodes h11 to h1a of the hidden layer HL1 receives a value in which a weight is applied to each process analysis result value of the plurality of input nodes i1 to im (indicated by a dotted line), and the input value After summing all the values, an operation according to the activation function is performed on the summed values to calculate a plurality of first hidden node values. Then, each of the plurality of second hidden nodes h21 to h2b of the second hidden layer HL2 receives a value in which a weight is applied to each of the plurality of first hidden node values of the plurality of first hidden nodes h11 to h1a. (indicated by a dotted line), all input values are summed, and an operation according to the activation function is performed on the summed values to calculate a plurality of second hidden node values. In this way, a weight is applied to a previous node value in the hidden layer HL and transmitted, and a current node value is calculated through calculation. By repeating this process, a plurality of k-th hidden node values of the plurality of k-th hidden nodes hk1 to hkl of the k-th hidden layer HLk may be calculated.

Each of the plurality of output nodes (o1 to on) has a weight w=[w1, w2 , … .

As such, in the ultrasound simulation system 100 according to an embodiment of the present invention, the user manipulates the probe 20 so that one of the probe 20 and the sensor 12a of the organ phantom 12 matches a preset condition. In this case, by outputting an ultrasound image of an organ set in a corresponding sensor through the output unit 40, sufficient learning time is provided to the user to obtain an ultrasound diagnosis experience.

In addition, the ultrasound simulation system 100 according to an embodiment of the present invention provides different images according to diseases, so that the user learns a case that is difficult to observe normally, thereby improving work ability.

Although the present invention has been described above using several preferred embodiments, these examples are illustrative and not restrictive. As such, those of ordinary skill in the art to which the present invention pertains will understand that various changes and modifications can be made in accordance with the doctrine of equivalents without departing from the spirit of the present invention and the scope of rights set forth in the appended claims.

Claims

body shape body phantom;

a long-term phantom provided inside the body phantom, to which a sensor is attached for each preset position;

a probe that reacts with one of the sensors of the organ phantom outside the body phantom;

an output unit for outputting an ultrasound image of an organ according to the manipulation of the probe;

a control unit configured to output, through the output unit, an ultrasound image of an organ set in the corresponding sensor when one of the probe and one of the sensors of the organ phantom matches a preset condition, but outputting a different image according to a disease; including,

The control unit is

As the probe is manipulated, the user's proficiency in manipulating the probe is determined through user-specific information including the position of the probe, the incident angle, and the required time, and the user's proficiency is artificially calculated according to the user-specific information of the probe. It learns through an intelligence engine, and provides a mission with a difficulty corresponding to the skill level according to the determined skill level of the user. Ultrasound simulation system, characterized in that it provides a mission.
According to claim 1,

The control unit is

When the position and the incident angle of the probe match the values set in each sensor of the organ phantom, the ultrasound image of the organ set in the corresponding sensor is output through the output unit.