KR102345827B1 - The method of simulation for taking medical imaging - Google Patents

Abstract

The present invention relates to a method of simulating medical imaging by acquiring posture information using an inertial sensor and displaying medical image data matching the obtained posture information. The method includes: wirelessly receiving, by a computing device, acceleration information, magnetic field information, or rotation speed information measured by an inertial sensor; detecting, by the computing device, information on a tilted direction and an angle of the inertial sensor based on the received acceleration information, magnetic field information, or rotation speed information; determining, by the computing device, a posture of the subject based on the tilted direction and angle information; matching, by the computing device, the determined posture of the subject to pre-classified medical image data; and displaying, by the computing device, medical image data matched to the determined posture of the subject on a display unit.

Description

The method of simulation for taking medical imaging

The present invention relates to a method for simulating medical imaging, and more particularly, by acquiring attitude information using an inertial sensor and displaying medical image data matching the acquired attitude information, medical imaging is performed for the purpose of practice education. How to simulate.

Since the discovery of X-rays by Wilhelm Conrad Roentgen in 1895, radiation has been used in medicine in the medical field up to the present day and has greatly contributed to the diagnosis and treatment of patients. Recently, with the development of advanced technology, digital radiographic imaging equipment has been developed to perform more accurate diagnosis and treatment. In order to perform radiographic examinations using these advanced radiographic imaging equipment, it is important to train manpower with specialized knowledge.

Therefore, in order to nurture professional manpower, it is important to conduct medical simulations through practical education. Medical simulation can be said to be an educational method that integrates knowledge and performance by allowing students to experience clinical treatment and crisis situations by taking a step further from the lecture-oriented education in the past and allowing students to experience a situation close to clinical practice. Simulation refers to practice that can be evaluated and improved decision-making and reasoning skills of learners by using a simulator.

Medical radiology education combines theoretical education to acquire theoretical knowledge and practical education to improve practical skills. Recently, with the improvement of the practice environment according to digitalization, it has become possible to possess digital radiographic imaging equipment. However, since most of the X-ray equipment for practice used for education in most universities generates actual X-rays, it is necessary to practice using a phantom phantom. The use of the phantom phantom has the advantage of no radiation exposure because it does not target humans, but high practical effects cannot be expected due to limitations in patient posture in X-ray examinations that require various patient postures depending on the examination method.

For example, when conducting radiographic imaging practice using a phantom phantom, in the case of shooting with an angle in the phantom according to the imaging technique, the trainee should practice by giving an angle to the body part such as the arm or leg of the phantom. . In this case, it is necessary to take a practice course to adjust the angle of the body part corresponding to the type of photographing. In order to adjust the angle of the phantom manikin, an additional practice process is required to adjust the angle using several different tools.

Therefore, there is a limitation in that it takes a lot of practice time because an additional process of adjusting the angle of the human body phantom according to the shooting type is required.

In addition, since actual radiographic images are taken with the human body model phantom, there is no direct exposure, but there is a risk of being exposed to a trace amount of radiation. I am registered as a visitor and wear a Thermoluminescence Dosimeter (TLD), but it is quite inconvenient to wear a thermoluminescence dosimeter every time I practice.

(KR) Registered Patent No. 10-1849773 (KR) Registered Patent No. 10-2004642

The present invention has been devised to solve the above problem, and a method for performing a radiographic simulation without using a human body phantom so that there is no need to go through the process of adjusting the angles for each part of the human body phantom according to the type of radiographic imaging would like to present

The present invention further intends to propose a method for performing radiographic simulation without actually performing radiographic imaging in order to prevent radiation exposure.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

A medical imaging simulation method according to an embodiment of the present invention includes: wirelessly receiving, by a computing device, acceleration information, magnetic field information, or rotational speed information measured by an inertial sensor; detecting, by the computing device, quaternion data information of the inertial sensor based on the received acceleration information, magnetic field information, or rotation speed information; rotating, by the computing device, 3D matrix information of pre-stored first medical image data based on the quaternion data information; generating, by the computing device, second medical image data by transforming the medical image data by projection mapping the rotated 3D matrix information; and displaying, by the computing device, the generated second medical image data on a display unit.

A medical imaging simulation method according to an embodiment of the present invention includes: determining, by a computing device, a posture of a subject based on the quaternion data information; matching, by the computing device, the determined posture of the subject to pre-classified medical image data; and displaying, by the computing device, medical image data matched to the determined posture of the subject on a display unit.

The quaternion data information according to an embodiment of the present invention may include information on a tilted direction and rotation angle of an inertial sensor.

A medical imaging simulation system according to an embodiment of the present invention includes an inertial sensor for measuring acceleration information, magnetic field information, or rotational speed information; a quaternion data calculator configured to calculate quaternion data information of the inertial sensor based on acceleration information, magnetic field information, or rotational speed information received from the inertial sensor;

Based on the inclination direction information and rotation angle information of the inertial sensor among the calculated quaternion data information, the 3D matrix information of the first medical image data stored in advance is rotated, and the rotated 3D matrix information is projection mapped to a medical image. a medical image data generator configured to convert data to generate second medical image data; and

The display unit may further include a display unit for displaying the second medical image data generated by the medical image data generating unit.

A medical imaging simulation system according to an embodiment of the present invention includes: a posture determining unit for determining a subject's posture based on tilted direction information and rotational angle information of an inertial sensor among the quaternion data information calculated by the quaternion data calculating unit; a medical image database unit in which medical image data is classified according to the subject's posture in advance; a medical image data matching unit matching the posture of the subject determined by the posture determining unit to the medical image data stored in the medical image database; and a display unit displaying the matched medical image data.

The medical imaging simulation system according to an embodiment of the present invention may further include a wireless communication module for wirelessly transmitting acceleration information, magnetic field information, or rotational speed information obtained from the inertial sensor to the posture information detecting unit and the posture determining unit. .

Since the method for simulating medical imaging according to an embodiment of the present invention does not require the use of the human body phantom during radiographic training, an incidental process of adjusting the angle of the human body phantom according to the posture can be omitted, resulting in more efficient medical imaging Shooting simulation can be performed.

Since the medical imaging simulation method according to an embodiment of the present invention acquires the position taken by the trainee through a sensor and displays the medical image data matching the posture, the trainee can practice similarly to the actual medical imaging environment. Therefore, the present invention can increase the learning effect compared to the case of performing a medical imaging simulation using a conventional human body phantom.

In addition, since the medical imaging simulation method according to an embodiment of the present invention does not actually irradiate radiation, it is possible to prevent radiation exposure to the human body when conducting radiographic education, and furthermore, there is no need to install radiation equipment. Installation and maintenance costs for radiation equipment can be reduced.

Effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 shows an inertial sensor attached to a human body according to an embodiment of the present invention.
2 is a schematic diagram illustrating a medical imaging simulation system and method according to an embodiment of the present invention.
3A is a flowchart of a method for simulating medical imaging according to an embodiment of the present invention.
3B illustrates a process of generating new medical image data according to an embodiment of the present invention.
4 illustrates a process of generating new medical image data according to another embodiment of the present invention.
5 illustrates data stored in a medical image database unit according to an embodiment of the present invention.
6A and 6B show radiographic images taken according to an embodiment of the present invention.

Since the present invention can have various changes and can have various embodiments, specific embodiments will be described in detail with reference to the drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. and/or includes a combination of a plurality of related description items or any of a plurality of related description items.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it should be understood that other components may exist in between. something to do. On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

It should also be understood that the terms "first" and "second" are used herein for distinguishing purposes only, and are not meant to indicate or anticipate sequence or priority in any way.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Throughout the specification and claims, when a part includes a certain element, it means that other elements may be further included, rather than excluding other elements, unless specifically stated to the contrary.

Throughout the specification, medical images include X-ray images using radiation, computed tomography (CT) images, positron emission tomography-computed tomography (PET images), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), etc. may include, but is not limited thereto. However, in the present specification, an embodiment will be described based on CT image data.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

In brief, the medical imaging simulation method according to an embodiment of the present invention acquires posture information about a user from an inertial measurement unit (IMU) attached to the user, and CT matched to the obtained posture information Image data can be displayed.

Therefore, the method for simulating medical imaging according to an embodiment of the present invention has the advantage of being able to immediately check a medical image of a posture taken by a user, regardless of the human body phantom, and immediately check it during a class.

1 shows an inertial sensor attached to a human body according to an embodiment of the present invention.

Referring to FIG. 1 , an inertial sensor 10 according to an embodiment of the present invention is attached to each body part. In particular, the inertial sensor is attached mainly to the joint part with a lot of movement, and the inertial sensor may be attached to the elbow 12 , the wrist 13 , and the fingertip 14 position.

The inertial sensor 10 according to an embodiment of the present invention may include a 3-axis acceleration, angular velocity, and magnetic field sensor based on MEMS (Micro Electro Mechanical Systems), and may include acceleration information, magnetic field information or rotation speed information of the sensor. can be measured

According to an embodiment of the present invention, the changing angle may be calculated in real time by substituting the quaternion value into the vector dot product expression using the acceleration information, the magnetic field information, or the rotation speed information measured by the inertial sensor 10 .

The quaternion values (x, y, z, w) according to an embodiment of the present invention may include a vector value that is an inclined direction of the inertial sensor and a rotation angle value of the inertial sensor. Calculating the rotation angle using the quaternion value will be described later with reference to FIG. 3B .

In the medical imaging simulation method according to an embodiment of the present invention, acceleration information, magnetic field information, or rotational speed information measured from the inertial sensor 10 may be wirelessly transmitted to a computing device using the wireless communication module 20 . .

Bluetooth communication or infrared communication may be applied to the wireless communication module 20 according to an embodiment of the present invention.

2 is a schematic diagram illustrating a medical imaging simulation system and method according to an embodiment of the present invention.

Referring to FIG. 2 , acceleration information, magnetic field information, or rotation speed information measured from the inertial sensor 10 may be received by the computing device 200 through the wireless communication module 100 .

A medical imaging simulation system according to an embodiment of the present invention may include an inertial sensor 10 , wireless communication modules 20 and 100 , a computing device 200 , and a display unit 300 .

The computing device 200 according to an embodiment of the present invention may include a quaternion data calculator, a medical image data generator, and a medical image database, and the computing device 200 according to another embodiment of the present invention has a posture It may include a determining unit, a medical image database unit, and a medical image data matching unit.

The quaternion data calculator according to an embodiment of the present invention may calculate quaternion data information of the inertial sensor based on acceleration information, magnetic field information, or rotational speed information received from the inertial sensor.

The medical image data generator according to an embodiment of the present invention rotates the 3D matrix information of the first medical image data stored in advance based on the inclination direction information and the rotation angle information of the inertial sensor among the calculated quaternion data information, New second medical image data may be generated by transforming medical image data by projection mapping the rotated 3D matrix information.

A method of generating new second medical image data by converting pre-stored medical image data by projection mapping according to an embodiment of the present invention will be described below with reference to FIG. 3B .

The computing device 200 according to another embodiment of the present invention further includes a posture determining unit and a medical image data matching unit. The posture of the subject may be determined based on the rotation angle information.

Accordingly, when the practitioner with the inertial sensor 10 takes a posture according to the medical image capturing manual, the angle of each joint in the posture and position and direction information of the arm or leg can be detected through the posture information detector. Meanwhile, throughout the specification, the practitioner may be used as the same meaning as the subject.

For example, the posture determining unit according to an embodiment of the present invention may determine a body part using the head, chest, or leg according to the measured position, and shooting angles such as front, right, left, rear, etc. can be determined, and the type of posture can be determined by sitting posture, standing posture, prone posture, etc.

The medical image database unit according to an embodiment of the present invention may be a DB in which medical image data is classified according to postures of practitioners in advance. Medical image data pre-stored in the DB will be described later with reference to FIG. 4 .

The medical image data matching unit according to an embodiment of the present invention may match the posture of the subject determined by the posture determining unit to the medical image data stored in the medical image database unit.

The medical image data matching unit according to an embodiment of the present invention may be implemented through an artificial intelligence algorithm such as a deep learning algorithm, a supervised learning algorithm, and a reinforcement learning algorithm.

The display unit 300 according to an embodiment of the present invention may display the second medical image data generated by the medical image data generator or may display medical image data matching the posture of the practitioner. More specifically, the display unit 300 according to an embodiment of the present invention may display CT image data matching the body part and posture determined based on information obtained from the inertial sensor (IMU) on the monitor.

Accordingly, the display unit 300 according to an embodiment of the present invention may be implemented as a monitor, and information related to CT image data (eg, kVp, mAs, etc.) may also be displayed together with the CT image data.

3A is a flowchart of a method for simulating medical imaging according to an embodiment of the present invention, and FIG. 3B illustrates a process of generating new medical image data according to an embodiment of the present invention.

Referring to FIG. 3A , the computing device may wirelessly receive acceleration information, magnetic field information, or rotation speed information measured by the inertial sensor ( S100 ).

The computing device according to an embodiment of the present invention may detect quaternion data information of the inertial sensor based on the received acceleration information, magnetic field information, or rotation speed information (S110).

The quaternion data information (x, y, z, w) according to an embodiment of the present invention may include a vector value (x, y, z) that is an inclined direction of the inertial sensor and a rotation angle value (w) of the inertial sensor. can

Then, the computing device rotates the 3D matrix information of the pre-stored first medical image data based on the quaternion data information ( S120 ), and performs projection mapping on the rotated 3D matrix information to the medical image data may be converted to generate second medical image data (S130).

Referring to FIG. 3B , the 3D matrix data 41 of the first medical image data pre-stored in the database unit is rotated using the rotation angle w among the calculated quaternion data information.

The first medical image data according to an embodiment of the present invention may include a CT image taken with respect to the phantom, but is not limited thereto.

The rotated 3D matrix data 43 may be converted by projection mapping to generate second medical image data 45 .

Projection mapping is to project an image made of light onto the surface of an object to change it, and the state in which the 3D matrix data value is changed according to the inclination direction and rotation angle of the inertial sensor can be reflected in the medical image data. have.

As described above, by rotating the 3D matrix information of the first medical image data based on the quaternion data value for the inertial sensor and performing projection mapping, information on the posture taken by the subject is transferred to the medical image data. It is reflected and may generate medical image data corresponding to the posture taken by the subject.

Accordingly, the newly generated medical image data is displayed on the display unit ( S140 ), and the practitioner or the subject can check the radiographic image of the posture taken for the radiographic image in real time.

4 illustrates a process of generating new medical image data according to another embodiment of the present invention.

Referring to FIG. 4 , as described above, the computing device wirelessly receives acceleration information, magnetic field information, or rotation speed information measured by the inertial sensor ( S200 ) to detect quaternion data information of the inertial sensor ( S210).

The computing device may determine the subject's posture based on the quaternion data information ( S220 ). For example, depending on the measured position, the part can be determined with the head, chest, or leg, etc., and the shooting angle can be determined with the front, right side, left side, rear, etc. The type of posture can be determined by the prone position, etc.

The computing device may match the determined posture of the subject with pre-classified medical image data (S230). Pre-classified medical image data according to an embodiment of the present invention will be described later with reference to FIG. 5 .

The computing device may display medical image data matching the determined posture of the subject ( S240 ).

5 illustrates data stored in a medical image database unit according to an embodiment of the present invention.

Referring to FIG. 5 , medical image data 30 is previously stored in the medical image database, and the medical image data is pre-classified by region and photographing angle and stored in the database.

For example, the CT image data may be classified and tagged according to parts such as a head, chest, or legs according to a measured position.

In addition, the CT image data that is tagged and stored for each part may be classified and tagged into front, right, left, or rear according to the imaging angle.

In addition, the CT image data may be classified and tagged according to the type of posture, such as a sitting posture, a standing posture, and a prone posture, with respect to the subject's posture using acceleration information, magnetic field information, or rotational speed information measured by the inertial sensor. have.

Meanwhile, the CT image data may include CT phantom data, and the CT phantom data may be reconstructed into image data through an arithmetic processing program such as Matlab.

In the medical imaging simulation method according to an embodiment of the present invention, the CT image data stored in the medical image database unit by determining the position to be photographed and the subject's posture using position information, angular velocity information, and acceleration information obtained from an inertial sensor. CT image data matching the photographing part and posture of the subject may be retrieved from among them, and then displayed on the display unit.

6A and 6B show radiographic images taken according to an embodiment of the present invention. Fig. 6A shows a front view, and Fig. 6B shows a rear view.

) 또는 다리의 각도(

)에 변화를 주었을 때, 변화된 팔의 각도(

) 또는 다리의 각도(

)를 실시간으로 측정하고, 이에 대한 매칭하는 방사선 영상 데이터를 실시간으로 도시할 수 있다. 6a and 6b show the angle of the arm by the practitioner according to the shooting manual (

) or the angle of the leg (

), the changed arm angle (

) or the angle of the leg (

) may be measured in real time, and matching radiographic image data may be displayed in real time.

The above description is merely illustrative of the technical spirit of the present invention, and various modifications and variations will be possible without departing from the essential characteristics of the present invention by those of ordinary skill in the art to which the present invention pertains. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

10: inertial sensor
20: wireless communication module
30: medical image data
100: wireless communication module
200: computing device
300: display unit

Claims (2)

A computing device comprising: wirelessly receiving acceleration information, magnetic field information, or rotational speed information measured by an inertial sensor;
detecting, by the computing device, quaternion data information of the inertial sensor based on the received acceleration information, magnetic field information, or rotation speed information;
rotating, by the computing device, 3D matrix information of pre-stored first medical image data based on the quaternion data information;
generating, by the computing device, second medical image data by converting the medical image data by projection mapping the rotated 3D matrix information; and
and displaying, by the computing device, the generated second medical image data on a display unit. an inertial sensor that measures acceleration information, magnetic field information, or rotational speed information;
a quaternion data calculator configured to calculate quaternion data information of the inertial sensor based on acceleration information, magnetic field information, or rotational speed information received from the inertial sensor;
Rotating the 3D matrix information of the first medical image data stored in advance based on the inclination direction information and the rotation angle information of the inertial sensor among the quaternion data information calculated by the quaternion data calculation unit, and the rotated 3D matrix information a medical image data generator configured to convert medical image data through projection mapping to generate second medical image data; and
and a display unit configured to display the second medical image data generated by the medical image data generating unit;
Medical imaging simulation system.

Images