WO2022010091A1 - Système d'édition de dessin de traitement et procédé d'édition de dessin de traitement l'utilisant - Google Patents

Système d'édition de dessin de traitement et procédé d'édition de dessin de traitement l'utilisant Download PDF

Info

Publication number
WO2022010091A1
WO2022010091A1 PCT/KR2021/006173 KR2021006173W WO2022010091A1 WO 2022010091 A1 WO2022010091 A1 WO 2022010091A1 KR 2021006173 W KR2021006173 W KR 2021006173W WO 2022010091 A1 WO2022010091 A1 WO 2022010091A1
Authority
WO
WIPO (PCT)
Prior art keywords
model
medical
disease
picture
editing
Prior art date
Application number
PCT/KR2021/006173
Other languages
English (en)
Korean (ko)
Inventor
최병관
Original Assignee
부산대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 부산대학교 산학협력단 filed Critical 부산대학교 산학협력단
Publication of WO2022010091A1 publication Critical patent/WO2022010091A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/20—Drawing from basic elements, e.g. lines or circles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Definitions

  • the present invention relates to a medical picture editing system and a medical picture editing method using the same. It is driven in a way that the picture 230 is called, and it is provided so that the user can modify the size and position of the disease model 220 in the picture. Because the affected part or symptom can be edited in detail in the picture, it is possible to identify the patient's problems in more detail and concretely than simple medical records such as existing texts or abstract medical pictures. In addition, since the medical figure 230 is provided not only in two dimensions but also in three dimensions, the patient can understand more easily and deeply about diseases that are difficult to observe with the naked eye. Medical information may be extracted from the completed medical picture 230 .
  • Medical drawings are a means for doctors to leave brief notes for medical activities or to explain the location of symptoms and lesions to the patient when diagnosing them.
  • an image is more helpful in understanding their symptoms than a thousand words. Therefore, it is possible to seek the smooth cooperation and understanding of the patient in the treatment.
  • the system In order to create a medical picture, some medical information must be input first.
  • the system displays rough information about the disease on the electronic medical picture. Based on the displayed picture, the user modifies the picture so that a more accurate meaning is displayed.
  • the system calls out standardized disease information based on the corrected picture, and the completed medical picture and medical information are stored.
  • the stored medical information and medical pictures can be reused for the next treatment, and can be shared with other medical institutions or medical staff.
  • the present invention provides a technique for producing medical pictures that can express symptoms and lesions in a specific and quantified way, and also proposes a method for automatically producing medical information when editing pictures.
  • the present invention has been devised to solve the above problems, and an object of the present invention is to convert pictorial medical information, which was previously expressed in text or inaccurately, into a quantified and detailed image (IMAGE) or drawing (DRAWING). It is to provide a picture editing system for medical treatment.
  • IMAGE quantified and detailed image
  • DRAWING drawing
  • Another object of the present invention is to provide a medical picture editing system for simplifying the work when a medical staff creates a 2D or 3D picture for treatment and efficiently generating medical information within a short time.
  • Another object of the present invention is to provide a medical picture editing system capable of delivering detailed and accurate information while avoiding the disadvantages of existing medical record texts or simple medical pictures.
  • the editing system of the present invention extracts medical information from the completed medical picture, thereby providing not only pictures but also various information to be stored and shared.
  • the user selects a model from one or more of the saved picture lists by inputting text that means sentences, words, and medical terms for symptoms or disease names, or calls a model corresponding to the text entered from a model database, etc. a model calling step of calling or generating (S10);
  • Medical information such as medical code or disease information is extracted from the modified medical figure 230 through a function using the change of an element as a factor, or the size, position and direction of the modified model, etc. a medical information extraction step (S40) in which the system recognizes the same information and extracts medical information;
  • a model calling unit 100 for calling up a model suitable for a user's input of text including sentences, words, and medical terms for symptoms or disease names;
  • a model display unit 200 for generating a basic model 210 representing a body part and a disease model 220 representing a disease according to the extracted medical code;
  • the system recognizes information such as the size, position and direction of the corrected model or extracts the medical code or medical information from the modified medical figure 230 by a function using element data as a factor, etc. a medical information extraction unit 400 from which may be extracted;
  • the medical information is characterized in that one or more information selected from the name of the symptom or disease name, category, cause, location, left and right hemilateralism, or additional information is expressed in letters and numbers.
  • the basic model 210 is a model representing a part or the whole of the body
  • the disease model 220 is an organ capable of confirming a disease, a surgical or surgical site, a nursing site and a location where the patient is sick, a nursing observation site, a nursing intervention site, a site undergoing rehabilitation treatment, a site subjected to a biopsy, an image examination It is a model showing the organ and the area where the patient has symptoms.
  • the editing of the basic model 210 and the disease model 220 is performed by manipulating points, lines, planes, and a set of elements constituting the basic model 210 and the disease model 220 to move one or more or to move one or more of the elements. It is characterized by adjusting the size, shape, position, etc. of
  • the modification of the element is characterized in that the size or direction of the basic model 210 and the disease model 220 is switched by manipulation of the GUI control.
  • the disease model 220 when the disease model 220 is inserted into the basic model 210 , only the disease model 220 corresponding to the disease model 220 inserted is not modified, but other disease models not manipulated by the user. It is characterized in that it can automatically change up to the elements of (220).
  • the system of the present invention is characterized in that medical information can be extracted by recognizing elements whose position, shape, direction, etc. have changed from the modified medical picture 230 or the shape of the completed medical picture 230 .
  • the medical model is characterized in that it can be displayed in both a 2D format and a 3D format.
  • the present invention can automatically generate a picture for medical treatment, thereby saving time for medical staff to draw a picture, and it is possible to express a disease state within a short time.
  • the system recognizes the use of the GUI interface, so that the medical picture can be automatically modified.
  • medical staff including doctors can more quickly and conveniently recognize the condition of the patient.
  • the medical pictures made by the present invention can be shared with other users to help share information more smoothly.
  • the medical picture generated by the present invention allows the patient to have a greater understanding of the disease and to actively cooperate with the treatment.
  • the present invention can input standardized data such as codes in a short time, which helps to increase work efficiency of medical staff and to increase data accuracy.
  • the present invention makes it possible to draw not only two-dimensional but also three-dimensional medical pictures, so that various types of medical pictures can be created.
  • a single GUI interface is provided so that several models can be moved at the same time, so that it is possible to express a disease state very precisely according to a user's input.
  • FIG. 1 is a flowchart illustrating a method of editing a picture for medical treatment according to the present invention.
  • FIG. 2 is a block diagram showing the configuration of a picture editing system for medical treatment according to the present invention.
  • FIG 3 is a diagram showing an embodiment in which the basic model 210 and the disease model 220 are called by text input according to the present invention.
  • FIG. 4 is a diagram showing an embodiment of calling the basic model 210 and the disease model 220 stored in the database according to the present invention.
  • FIG. 5 is a diagram illustrating an embodiment in which the basic model 210 and the disease model 220 are called by the user's voice according to the present invention.
  • FIG. 6 is a diagram showing that text input in one device can call a model in another device.
  • FIG. 7 is a view showing an embodiment of editing the elements of the basic model 210 and the disease model 220 according to the present invention.
  • FIG. 8 is a view showing an embodiment in which a part of a blood vessel is expanded due to a pressure inside a cerebral blood vessel by a user moving an element according to the present invention.
  • FIG. 9 is a view showing an embodiment in which the elements of the basic model 210 are automatically changed by the disease model 220 when the disease model 220 is inserted into the basic model 210 according to the present invention.
  • This is an example reflecting the shape of the ventricle that is compressed and reduced by the pressure generated by the cerebral hematoma.
  • FIG. 10 is a view showing an embodiment in which the elements of the basic model 210 are automatically changed by the disease model 220 when the disease model 220 is inserted into the basic model 210 according to the present invention.
  • This is an embodiment reflecting the shape or position of the ventricle model in the basic model 210 changes while greatly modifying the size of the disease model 220 that was initially small.
  • FIG. 11 is a diagram illustrating the movement of elements of the basic spine model 210 according to the movement of the GUI interface as an embodiment of creating a scoliosis disease model through the GUI interface according to the present invention.
  • FIG. 12 is a diagram illustrating an embodiment in which elements of the disease model 220 are changed by manipulation of a GUI control or a keyboard in the disease model 220 .
  • FIG. 13 is a diagram illustrating an embodiment in which the color of the disease model 220 is edited by a user.
  • FIG. 14 is a diagram illustrating an embodiment in which the size of the disease model 220 is manipulated by a user.
  • 15 is a view showing that several long-term basic models 210 can be collected and observed in one whole-body basic model 210. As shown in FIG.
  • FIG 16 is a view showing that the position of the disease model 220 can be changed according to the user's needs.
  • a tumor occurring in the lower lobe of the lung This is an example in which C34.3, which means , is extracted.
  • C22.0 means a malignant tumor of the liver when the user moves the location of the disease model 220 to the liver. This is an example to be extracted.
  • FIG. 18 is a diagram illustrating that the degree of scoliosis can be adjusted through a GUI interface (such as a scroll bar), and is an example of adjusting the degree of scoliosis by using a vertical scroll bar.
  • a GUI interface such as a scroll bar
  • 19 is a diagram showing that the degree of scoliosis can be adjusted through a GUI interface (such as a scroll bar), and is an embodiment of adjusting the degree of scoliosis by using a horizontal scroll bar.
  • a GUI interface such as a scroll bar
  • 20 is a diagram showing that medical information can be extracted from the modified medical figure 230 .
  • FIG. 1 is a flowchart showing the method of editing a medical picture for the present inventor, which is carried out by the following steps.
  • the user selects a model from one or more of the stored picture lists by inputting texts meaning sentences, words, and medical terms for symptoms or disease names, or a model corresponding to the text input in a model database, etc. , or call or create the model through voice.
  • the input text may be a text including a disease name and a location of a lesion, or may be a name of a symptom input in each language.
  • the user may select a desired text from the medical text category stored in the network, etc., and may be the text extracted by recognizing the user's voice in the system.
  • the model stored in the database can be called according to the text input by the user in various ways.
  • the server and the device are organically connected through a network, so if you input text from one device, the model may be called from another device that is far away.
  • FIG. 3 is a diagram showing an embodiment in which a user's desired medical code or medical picture 230 is called in various ways.
  • the user can call the basic model 210 and the disease model 220 by inputting textual data, and as can be seen in [Fig. Anatomical organs such as organs, disease models such as tumors, abscesses, and malformations can be selected.
  • the system may call the model by recognizing the user's voice.
  • FIG. 6 is a diagram showing a server and a device connected through a network. It shows that the text input on device A can call the model on device B. Even if different devices are connected to the server, the system can be operated even if the devices are separated from each other.
  • the model display step ( S20 ) is a step of displaying the basic model 210 representing body parts and the disease model 220 representing diseases that are called or generated by the model calling step ( S10 ).
  • the system shows the basic model 210 and the disease model 220 to the user by the user entering the text, selecting a picture from a presented list, or calling or generating the model through voice.
  • the medical code requested in the model calling step ( S10 ), an organ shape corresponding to the text, or an icon indicating a disease, an image, a disease model 220 , etc. are generated or found in the database of the system.
  • the basic model 210 representing a diseased body part and the disease model 220 representing a disease such as a tumor or hematoma are presented together.
  • the user not only calls the model in the medical picture 230 database, but also the artificial intelligence may generate the picture according to the text input by the user.
  • a single picture can be created automatically, or multiple pictures can be called up and the user can select one or more of them.
  • both the basic model 210 and the disease model 220 may be automatically generated.
  • the picture correction step (S30) is a step of confirming the generated basic model 210 and the disease model 220, and correcting the basic model 210, the disease model 220 and the medical picture 230 to be.
  • the picture correction step (S30) is a step in which the user confirms and corrects the basic model 210 and the disease model 220 displayed in the model display step (S20). If the basic model 210 and the disease model 220 are accurately generated or found by the system, the user can use them as they are. On the other hand, if the proper basic model 210 and the disease model 220 are not displayed when the user confirms, they can be corrected. In addition, if various basic models 210 and disease models 220 are called by the same text, the user can select and use the desired basic models 210 and disease models 220 among them.
  • the basic model 210 and the disease model 220 called in the picture correction step (S30) can be modified or supplemented in a desired form by the user.
  • the location and size of the disease can be changed, the severity of the fracture can be adjusted, and the scale of the blood vessels can be changed. What can be modified is not limited to this range and can be changed to suit the characteristics of body parts.
  • This correction is made according to the change of the drawing points, lines, and planes of the basic model 210 and the disease model 220 , and elements that are a set of them.
  • the user can modify or supplement the extracted model and extract appropriate medical information accordingly.
  • points, lines, and planes constituting the medical figure 230 and a set thereof as shown in FIGS. 7 and 8 are referred to as “element”.
  • the elements can be manipulated with a GUI control that can move one or more of the elements of the medical figure 230 such as a mouse, a touch, and a hand gesture.
  • the GUI control allows the system or the user to adjust one or more of the length, volume, and position of points, lines, and faces of elements. Through this, the size or location of a disease or lesion can be expressed.
  • Fig. 7 and Fig. 8 are also examples showing the basic principle of image editing for medical use.
  • the medical picture 230 can be manipulated through a GUI interface capable of manipulating one or more of the elements of the medical picture 230 using a mouse, etc. .
  • FIG. 7 it can be transformed into a curved shape by adjusting the GUI interface displayed on the line, and as shown in [Fig. An aneurysm of a blood vessel can be represented.
  • the modification of the medical model is not limited to only a 2D plane picture, but can also be modified for a 3D stereoscopic picture.
  • FIG. 8 shows an embodiment of changing the shape of the disease model 220, and is an embodiment showing a process of correcting a picture of a cerebral blood vessel using the system of the present invention. This indicates that a part of the blood vessel is dilated due to the pressure inside the blood vessel, and the elements of the basic blood vessel model on the left are displayed by moving or deforming through the “GUI control”.
  • the medical picture 230 for abnormal state of the blood vessel that has been corrected by moving the elements is stored in the system.
  • the concept of “cerebrovascular aneurysm” (CONCEPT), or “cerebrovascular Medical information such as sentences such as “Yes” or the standard code “I67.1” of the international classification of disease (ICD) 10 can be extracted.
  • the treatment picture 230 may be modified through one or more “GUI controls”, and the treatment picture 230 is automatically modified by inserting another disease model 220, or the basic model 210 itself is changed. It can also indicate a disease.
  • FIG. 9 shows an embodiment of information modification that affects the size change of another model, the ventricle model, by recognizing the disease model 220 edited by the user in the system of the present invention.
  • a series of changes in the figure according to the model are shown.
  • the user inserts the disease model 220 into the basic model 210, it is actually compressed by the pressure generated by a brain tumor or cerebral hematoma and reflects the reduced shape of the ventricle. That is, as shown in the edited disease model 220, the image is automatically corrected in a form in which the size of the ipsilateral ventricle is reduced.
  • These changes occurring in the ventricle may be performed automatically by the system of the present invention.
  • the user can provide a function of changing the shape or position of the ventricle model in the basic model 210 while greatly editing the size of the disease model 220. Therefore, by recognizing the edited disease model 220, the medical picture 230 for medical treatment can also be automatically extracted medical information called "compressed ventricle (compressed ventricle)".
  • FIG. 11 is an embodiment showing a chain model change according to the disease model 220 modified by the user.
  • Existing texts or simple medical pictures were difficult to indicate fractures or scoliosis, and it was not easy to explain them to patients. For example, it was inconvenient to indicate the location of the curvature of the spine or the severity of the curvature from various angles. However, if the present inventor's medical picture editing system is used, it is possible to input and display the model more specifically and accurately.
  • an embodiment shown in [FIG. 11] is a case in which a model for scoliosis is used.
  • the model calling step when text such as “scoliosis”, “scoliosis”, “M41”, etc. is input into the system, the basic model 210 on the left is called by the system of the present invention.
  • the GUI interface such as a mouse pointer left and right on the screen or moves the GUI control present in the model of the fourth lumbar vertebra through appropriate use such as clicking, various curvatures of the medical figure are made so that the spine is bent. It can be expressed as a curvature.
  • FIG. 12 is an embodiment provided to generate information based on the identified basic model 210 and disease model 220, and to modify one or more of the shape, size, and position of the disease model 220 Yes. For example, if you want to display the location of a tumor, you can change the location or direction of the tumor by using a mouse or arrow keys on a computer keyboard on the basic model 210 of the body part where the tumor is located.
  • the color of the disease model 220 may be different depending on the severity or frequency of occurrence of the disease.
  • the user can modify the display so that it is displayed in yellow when the frequency of occurrence is low or the severity of symptoms is mild, blue when the level of treatment is required, and red when the frequency of occurrence is frequent or severe.
  • the colors that can be displayed are not limited to the three colors presented above, and various colors other than the above can be displayed, and the lightness and depth of the colors can also be set.
  • the user may extract medical information such as “mild” and “severe” by correcting the color of the disease model 220 .
  • the user may lighten the color of the disease model 220 so that medical information such as “treatment completed” or “sequelae” can be extracted or the disease model 220 can be removed.
  • the color of the disease model 220 can be expressed, but also the size of the disease model 220 can be modified by the user.
  • the user adjusts the size of the model by manipulating elements, and medical information can be extracted accordingly.
  • the size of the medical picture editing system according to the present invention is recognized and the surrounding model can be changed automatically.
  • the size of the tumor increases, it can indicate that a change occurs in the ventricle, and when a large tumor occurs in the intestine, it can display the appearance of other nearby organs being pressed by the tumor.
  • the change of the element may change the size or direction of the basic model 210 and the disease model 220 by manipulating the GUI control.
  • it may be configured to be operated by inputting a combination of one or more of a mouse, gravity, vibration, a touch sensor, a microphone, and a camera.
  • the step of editing the basic model 210 and the disease model 220 is to express the flow of time or time point indicated by the GUI control in the form of a graph on the screen using length, angle, volume, number, or text to express the user can inform Accordingly, it may be possible to modify [ FIGS. 7 to 14 ] according to the manipulation of the GUI control.
  • the medical information extraction step (S40) is a step of extracting medical information from the corrected picture.
  • the disease is text information such as “severe”, “scoliosis”, “50 degrees” and “there is a tumor in the lung” or medical information such as a medical code. It may be a calling step.
  • the medical information may be a standardized medical term code, which refers to data that presents medical concepts such as SNOMED-CT, ICD-9, ICD-10, ICD-11, LOINC, CPT, ATC, RxNorm, ICNP, NMDS, etc. .
  • it may be data expressed in numbers, such as a test result such as a hemoglobin level gram/deciliter. For example, if the correction of the medical figure 230 for spinal stenosis, etc. is completed, medical information such as M48.0 (spine stenosis) can be extracted from the system.
  • the medical information is preferably expressed in letters and numbers that can express any one or more information selected from category, cause, location, left-right unilaterality, or additional information of a symptom or disease name.
  • FIG. 16 tumors generated in the right middle lobe are indicated.
  • the system of the present invention recognizes the coordinates of the disease model and C34.3, which means a tumor occurring in the lower lobe of the lung, can be extracted. .
  • medical information may be extracted by referring to the shape and location coordinates of the disease model or by detecting a change in the coordinates.
  • medical information can be extracted by a function that takes as a factor one or more information among points, lines, planes, and shapes modified by the user.
  • the system recognizes information such as the size, location, and direction of the models in the modified medical picture 230 and medical information may be extracted.
  • the code of ICD10 can be extracted according to the completed medical figure 230.
  • a disease category, a location and cause of a symptom, etc. may be expressed.
  • the picture storing step (S50) is a step of storing one or more of the user's request input in the model calling step (S10), the medical picture 230, or the extracted medical information.
  • the basic model 210 and the disease model 220 may store one or more of the first inputted text and extracted medical information together with a picture in the present inventor's picture editing system for treatment.
  • the stored data is converted into a database and can be re-extracted when the same text is input later.
  • accurate medical information is extracted with pictures, it can be very helpful in sharing medical information, such as sharing information even if the language between countries and medical staff is different.
  • the following is a diagram showing the configuration of the present inventor's medical treatment picture editing system 1 It is composed of a unit 400 and a storage unit 500 .
  • the present inventor's medical picture editing system receives data from the electronic medical record (EMR, 2) and the medical institution server 3 as shown in FIG.
  • the model calling unit 100 inputs texts meaning sentences, words, and medical terms for symptoms or disease names, and the user selects a model from one or more of the stored picture lists or corresponding to the text input in the model database, etc.
  • the model can be called up or the model can be called or created by voice.
  • the artificial intelligence may generate the picture according to the text input by the user. Both the basic model 210 and the disease model 220 may be generated.
  • the model display unit 200 displays a basic model 210 representing a body part and a disease model 220 representing a disease according to the extracted medical code.
  • the model display unit 200 provides the present invention system to visualize the basic model 210 and the disease model 220 by the user inputting the text.
  • a basic model 210 , a disease model 220 , etc. suitable for the input text may be created or called.
  • the basic model 210 representing a diseased body part and the disease model 220 representing a disease such as a tumor or hematoma may be presented together.
  • the basic model 210 and the disease model 220 presented above are preset in the present inventor's picture editing system for medical treatment and are provided so that they can be called from the database.
  • the picture correction unit 300 checks the generated basic model 210 and the disease model 220 and edits the basic model 210 and the disease model 220 to create a medical picture 230 . create
  • the user confirms the basic model 210 and the disease model 220 extracted from the model display unit 200 . If the model is correctly created or found by the system, the user can use it as it is.
  • the user may modify or supplement the extracted basic model 210 and disease model 220 .
  • the location and size of the disease can be changed, and the degree of fracture or vascular dilatation can also be changed. What can be modified is not limited to this range and can be changed to suit the characteristics of body parts.
  • This correction is made according to changes in the elements of the basic model 210, and medical information is called by a function that recognizes the information of the elements of the medical picture editing system.
  • the modification of the basic model 210 and the disease model 220 is not limited to only a 2D flat picture, but can also be expressed as a 3D stereoscopic picture, which is effective when displaying internal organs or diseases invisible to the naked eye.
  • the user may change the color of the disease model 220 according to the severity or frequency of the disease. For example, if the frequency of occurrence is low or the level of symptoms is not severe, yellow is displayed, if the level requires treatment, blue is displayed, and if the frequency of occurrence is frequent or severe, it is displayed in red.
  • the color of the disease model 220 can be expressed, but also the size of the disease model 220 can be changed. In situations such as when the size of a tumor increases or the size of a blood vessel expands, the user adjusts the size by manipulating the element.
  • the change of the element may change the size or direction of the basic model 210 and the disease model 220 by manipulating the GUI control.
  • it may be configured to be operated by inputting a combination of one or more of a mouse, gravity, vibration, a touch sensor, a microphone, and a camera.
  • the step of editing the basic model 210 and the disease model 220 is to express the flow of time or time point indicated by the GUI control in the form of a graph on the screen using length, angle, volume, number, or text to express the user can inform Accordingly, it may be possible to modify [ FIGS. 7 to 14 ] according to the manipulation of the GUI control.
  • the Medical information may be extracted by a function using the change of an element as a factor in the corrected medical figure 230 .
  • the system recognizes information such as size, location, and direction, and medical information may be extracted.
  • the system calls the basic femur model 210 and the user can insert the disease model 220 at the position of the basic model 210 requiring internal fixation.
  • the disease model 220 is inserted or adjusted on the basic model 210 in this way, the correction of the medical figure 230 is completed, and the medical code of “the femur with internal fixation completed” is applied to the completed medical figure 230.
  • Medical information including medical information can be extracted.
  • the accuracy of information can be added, and the basis for sharing information with other medical institutions and other medical staff can be laid.
  • the medical information may be expressed in letters and numbers capable of expressing not only symptoms or disease names, but also any one or more information selected from category, cause, location, left-right hemisphere, or additional information of the corresponding disease.
  • the storage unit 500 stores one or more of the user's request input from the model call unit 100 , the medical picture 230 , or the extracted medical information.
  • Medical information such as the medical code extracted from the modified medical picture 230 and the medical information extraction unit 400 is converted into data and stored in the present invention system, and the stored medical picture 230 is the same text as the next It can be re-extracted when .
  • various basic models 210 and disease models 220 are stored in the same text, a user can select and use a desired medical model from among the various medical models.
  • Such information can be shared with other users, and even if the language is different, it can be shared information.
  • the present invention can automatically generate a medical picture, thereby saving time for medical staff to draw a picture and expressing the state of the disease within a short time.
  • the system recognizes the use of the GUI interface, so that the medical picture can be automatically modified.
  • medical staff including doctors can more quickly and conveniently recognize the condition of the patient.
  • the medical picture generated by the present invention allows the patient to have a greater understanding of the disease and to actively cooperate with the treatment.
  • the present invention helps to increase the work efficiency of the medical staff and increase the accuracy of the data because it can make a medical picture in a short time.
  • the present invention makes it possible to draw not only two-dimensional but also three-dimensional medical pictures, so that even diseases of internal organs of the body can be easily displayed.
  • a single GUI interface is provided so that several models and elements can be moved at the same time, so that it is possible to express the disease state very precisely according to a user's input.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Primary Health Care (AREA)
  • General Health & Medical Sciences (AREA)
  • Epidemiology (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

La présente invention concerne un système d'édition de dessin de traitement et un procédé d'édition de dessin de traitement l'utilisant, et fonctionne de manière à appeler automatiquement un dessin de traitement (230) correspondant à un texte si le personnel médical entre un symptôme, une partie affectée, un nom de maladie, ou similaire d'un patient par texte ou voix, et est prévue de telle sorte qu'un utilisateur peut corriger la taille, l'emplacement et similaires d'un modèle de maladie (220) dans le dessin. Un procédé d'édition du dessin de traitement (230), selon la présente invention, comprend : une étape d'appel de modèle (S10) consistant à appeler un modèle de base et un ou plusieurs modèles de maladie si un utilisateur entre un texte comprenant une phrase, un mot, et un terme médical pour un symptôme ou un nom de maladie ; une étape d'affichage de modèle (S20) consistant à générer, selon un code médical extrait, un modèle de base (210) indiquant une partie du corps et le modèle de maladie (220) indiquant une maladie ; une étape de correction de dessin (S30) consistant à vérifier le modèle de base (210) et le modèle de maladie (220) générés et à éditer le modèle de base (210) et le modèle de maladie (220) pour corriger le dessin de traitement (230) ; une étape d'extraction d'informations médicales (S40) consistant à extraire des informations médicales à partir du dessin de traitement (230) pour lequel la correction a été achevée ; et une étape de stockage de dessin (S50) consistant à stocker le dessin de traitement (230) achevé et les informations médicales. En outre, un système d'édition du dessin de traitement (230), selon la présente invention, comprend : une unité d'appel de modèle (100) pour appeler un modèle de base et un ou plusieurs modèles de maladie si un utilisateur entre un texte comprenant une phrase, un mot, et un terme médical pour un symptôme ou un nom de maladie ; une unité d'affichage de modèle (200) pour générer, selon un code médical extrait, le modèle de base (210) indiquant une partie du corps et le modèle de maladie (220) indiquant une maladie ; une unité de correction de dessin (300) pour vérifier le modèle de base (210) et le modèle de maladie (220) générés, et corriger le dessin de traitement (230) en éditant des éléments dans le modèle de base (210) et le modèle de maladie (220) ; une unité d'extraction d'informations médicales (400) pour extraire des informations médicales à partir du dessin de traitement (230) corrigé ; et une unité de stockage (500) pour stocker le dessin de traitement (230) pour lequel l'édition a été achevée.
PCT/KR2021/006173 2020-07-06 2021-05-18 Système d'édition de dessin de traitement et procédé d'édition de dessin de traitement l'utilisant WO2022010091A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2020-0082548 2020-07-06
KR1020200082548A KR102481236B1 (ko) 2020-07-06 2020-07-06 진료용 그림 편집 시스템 및 이를 이용한 진료용 그림 편집 방법

Publications (1)

Publication Number Publication Date
WO2022010091A1 true WO2022010091A1 (fr) 2022-01-13

Family

ID=79341968

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/006173 WO2022010091A1 (fr) 2020-07-06 2021-05-18 Système d'édition de dessin de traitement et procédé d'édition de dessin de traitement l'utilisant

Country Status (2)

Country Link
KR (1) KR102481236B1 (fr)
WO (1) WO2022010091A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140031486A (ko) * 2012-09-03 2014-03-13 삼성전자주식회사 의료 영상 시뮬레이션 방법 및 그 방법을 이용한 장치
JP2015530657A (ja) * 2012-08-31 2015-10-15 釜山大学校産学協力団Ｐｕｓａｎ Ｎａｔｉｏｎａｌ Ｕｎｉｖｅｒｓｉｔｙ Ｉｎｄｕｓｔｒｙ−Ｕｎｉｖｅｒｓｉｔｙ Ｃｏｏｐｅｒａｔｉｏｎ Ｆｏｕｎｄａｔｉｏｎ 医療情報処理システム
KR20160115269A (ko) * 2015-03-26 2016-10-06 주식회사 한화 건강검진 정보 제공 애플리케이션 및 시스템
KR101837952B1 (ko) * 2016-12-16 2018-03-13 (주)칼리스토 환자 맞춤형 수술치료 애니메이션 디스플레이 방법 및 시스템
KR20190131281A (ko) * 2018-05-16 2019-11-26 부산대학교 산학협력단 환자 상태 조회 화면 제공 방법 및 환자 상태 조회 화면 제공 시스템

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101810289B1 (ko) * 2015-05-12 2017-12-18 부산대학교 산학협력단 의료 영상 판독 장치 및 의료 영상 판독 장치 동작 방법
KR101981583B1 (ko) 2017-02-27 2019-05-23 재단법인 아산사회복지재단 의료영상 내 정보처리방법
KR20200057426A (ko) * 2018-11-16 2020-05-26 삼성전자주식회사 음성 인식 기반 이미지를 표시하는 전자 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015530657A (ja) * 2012-08-31 2015-10-15 釜山大学校産学協力団Ｐｕｓａｎ Ｎａｔｉｏｎａｌ Ｕｎｉｖｅｒｓｉｔｙ Ｉｎｄｕｓｔｒｙ−Ｕｎｉｖｅｒｓｉｔｙ Ｃｏｏｐｅｒａｔｉｏｎ Ｆｏｕｎｄａｔｉｏｎ 医療情報処理システム
KR20140031486A (ko) * 2012-09-03 2014-03-13 삼성전자주식회사 의료 영상 시뮬레이션 방법 및 그 방법을 이용한 장치
KR20160115269A (ko) * 2015-03-26 2016-10-06 주식회사 한화 건강검진 정보 제공 애플리케이션 및 시스템
KR101837952B1 (ko) * 2016-12-16 2018-03-13 (주)칼리스토 환자 맞춤형 수술치료 애니메이션 디스플레이 방법 및 시스템
KR20190131281A (ko) * 2018-05-16 2019-11-26 부산대학교 산학협력단 환자 상태 조회 화면 제공 방법 및 환자 상태 조회 화면 제공 시스템

Also Published As

Publication number Publication date
KR20220005123A (ko) 2022-01-13
KR102481236B1 (ko) 2022-12-23

Similar Documents

Publication Publication Date Title
KR102014359B1 (ko) 수술영상 기반 카메라 위치 제공 방법 및 장치
Gsaxner et al. The HoloLens in medicine: A systematic review and taxonomy
WO2016126056A1 (fr) Appareil et procédé de fourniture d'informations médicales
Linke et al. Assessment of skills using a virtual reality temporal bone surgery simulator
JP2010075403A (ja) 情報処理装置およびその制御方法、データ処理システム
WO2021206517A1 (fr) Procédé et système de navigation vasculaire peropératoire
WO2019132244A1 (fr) Procédé de génération d'informations de simulation chirurgicale et programme
US20220180519A1 (en) Systems and Methods for Displaying Augmented Anatomical Features
WO2021006472A1 (fr) Procédé d'affichage de densité osseuse multiple pour établir un plan de procédure d'implant et dispositif de traitement d'image associé
JP4900551B2 (ja) 標準的治療プログラムに同期した医療情報処理装置
WO2020231007A2 (fr) Système d'apprentissage d'un équipement médical
US11455900B2 (en) System and method for teaching a surgical procedure
WO2019172563A1 (fr) Système pour procurer une expérience de traitement à l'hôpital fondée sur la vr ou l'ar
CN110706825A (zh) 一种基于三维建模和3d打印的骨科医疗平台系统和方法
JP6258084B2 (ja) 医用画像表示装置、医用画像表示システムおよび医用画像表示プログラム
WO2022010091A1 (fr) Système d'édition de dessin de traitement et procédé d'édition de dessin de traitement l'utilisant
WO2021096054A1 (fr) Système de génération de dessin médical automatique, procédé de génération de dessin médical automatique l'utilisant, et système de génération de dessin médical automatique basé sur l'apprentissage automatique
WO2023061402A1 (fr) Procédé de collecte et de présentation de données de signal physiologique et d'informations de position, et serveur et système pour sa mise en oeuvre
JP2018047067A (ja) 画像処理プログラム、画像処理方法および画像処理装置
WO2020145455A1 (fr) Système de simulateur d'apprentissage virtuel basé sur la réalité augmentée pour intervention chirurgicale sur le système cardiovasculaire, et procédé associé
WO2019164273A1 (fr) Méthode et dispositif de prédiction de temps de chirurgie sur la base d'une image chirurgicale
WO2019132166A1 (fr) Procédé et programme d'affichage d'image d'assistant chirurgical
WO2020159276A1 (fr) Appareil d'analyse chirurgicale et système, procédé et programme pour analyser et reconnaître une image chirurgicale
WO2022114758A1 (fr) Procédé de fabrication de prothèse chirurgicale
WO2021149918A1 (fr) Procédé et appareil d'estimation de l'âge d'un os

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21838020

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21838020

Country of ref document: EP

Kind code of ref document: A1