WO2010120061A2 - Apparatus for processing medical data of a client terminal, and method for processing medical image data - Google Patents

Abstract

The present invention relates to an apparatus for processing medical data of a client terminal, comprising: an image receiving unit configured to receive medical images photographed by a capsule endoscope; a medical record receiving unit configured to receive, from a patient management system server, a medical record including the previous diagnosis record of the patient photographed by the capsule endoscope; a viewer configured to simultaneously display the medical images from the image receiving unit and the medical record from the medical record receiving unit; an annotation unit configured to annotate medical images being displayed on the viewer by means of text and/or audio; and a medical data generating unit configured to generate medical data containing the medical images displayed on the viewer, notations input by the notation unit, and the medical record. The apparatus receives a medical record including physical data, medical history, family medical history, previous diagnosis record, etc. of the patient from the patient management system server, displays the received medical record on the viewer together with the medical images photographed by the capsule endoscope or the like, and generates medical data containing said medical record and said medical images, to thereby enable a doctor to examine and consider the medical record including the medical history of the patient during diagnosis using the medical image photographed by the capsule endoscope, so as to assist in diagnosing hereditary diseases having unobvious manifestations. Particularly, the apparatus of the present invention enables the doctor to accurately find and diagnose specific diseases which can be found by synthesizing symptoms at various parts of body, referring to the family medical history or medical history of the patient, and enables symptoms of diseases and the opinions of doctors to be easily shared with other client terminals or servers. The present invention also provides a method for processing medical image data.

Description

Medical data processing device and medical image data processing method of client terminal

The present invention relates to an apparatus and a method for processing a medical image taken by a capsule endoscope, the present invention relates to an image file of a medical image taken by a capsule endoscope and medical data in an exchangeable format including basic medical records and diagnostic findings Medical data processing apparatus and medical equipment for generating and processing the medical image data in the client-server environment and the communication environment between the clients, and further exchanging mutual medical data or enabling remote diagnosis in the client-server environment and the communication environment between the clients. An image data processing method.

The digestive system of the human body consists of the esophagus, stomach, small intestine (ie, duodenum, jejunum, ileum) and several other organs, including the colon.

One limited approach to addressing this problem has been to use a Wireless Capsule Endoscope (WCE) that incorporates video and video technology into wireless transmission. In particular, the wireless capsule endoscope method uses, for example, a small capsule having a diameter of 11 mm and a length of 25 mm. As shown in Fig. 1, the capsule endoscope 301 is equipped with a light emitting diode (LED) and a micro camera to brighten the inner wall of the organ 41 by the light emitting diode and to capture an image of the digestive organ by the micro camera. The radio is transmitted to the receiver 302 worn by the examinee 40. The transmitted image data is sent to the processing system 1, where the expert interprets the captured image to diagnose whether there is a condition.

However, some diseases can be diagnosed based on the finding of any local position in diagnosing the disease, while others can be diagnosed only when the symptoms are spread evenly. Thus, diagnosing a particular disease based on symptoms at multiple locations is more difficult and more likely to be overlooked than diagnosing based on a symptom at a local location.

On the other hand, in recent years, there is a demand for a technology for integrated management by exchanging image data including an image captured by the capsule endoscope via a network. That is, an operating system of a client-server environment in which a workstation accesses a server through a network such as the Internet and uploads image data or downloads necessary image data from a server is required.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and generates a medical image data including an image file and basic medical information of an image taken by an implantable capsule endoscope to create a client-server environment or a communication environment between clients. In the case of construction, it is an object of the present invention to provide a method and system for processing medical image data that can flexibly cope with various requirements of a user.

Still another object of the present invention is to include medical information in the image data itself without an annotation, and to apply the encryption technology to secure the medical image when establishing a client-server environment or a communication environment between clients. It is to provide a data processing method and system.

In order to solve the above problems, the present invention generates medical data in an exchangeable format including image data of a medical image taken by a capsule endoscope and basic medical records and diagnostic findings, and integrated management in a single file form. Accordingly, an object of the present invention is to provide a medical data processing apparatus and a method for exchanging medical data or enabling remote diagnosis in a client-server environment and a communication environment between clients.

In addition, the present invention enables to diagnose by systematically classifying a number of images taken by the capsule endoscope in the diagnosis process so as to synthesize the symptoms at various locations without missing a specific disease, and diagnose the classified images It is another object to improve the accuracy of diagnosis by making it easier to generate, store, export, and call as medical data and share with each other.

Another object of the present invention is not to diagnose only by the image taken by the capsule endoscope, but to receive and decode the received information from the patient information server to display the medical history and family history of the subject together with the image taken by the capsule endoscope, It is possible to make a diagnosis in consideration of the medical history so as to improve the accuracy of diagnosis without overlooking the diagnosis of a specific disease that should be diagnosed by synthesizing the symptoms at various locations.

First of all, the present invention generates a diagnosis file with one medical data including the diagnosis findings and the medical history of a plurality of medical images classified into the main medical images for the diagnosis in consideration of family history and medical history. Therefore, it is very easy to share the diagnosis findings remotely with each other, and it is easier to build a diagnosis database by using it as a single piece of medical data. The purpose.

In addition, the present invention, when the doctors record the diagnostic findings based on the image taken through the capsule endoscope as an annotation or the final diagnosis, it is to automatically generate a medical certificate to minimize the wasteful work of the doctor Another purpose.

A feature of the medical image data processing method according to the present invention for achieving the above object is a method of processing the encoded medical image data by the client terminal, receiving the encoded medical image data from a server, and Decoding the decoded medical image data, extracting medical information from the decoded medical image data, and reproducing the image file of the decoded medical image data and the extracted medical information on a screen.

A feature of the medical image data processing system according to the present invention for achieving the above objects is a server holding encoded medical image data, a receiver for receiving the encoded medical image data from the server, and received at the receiver. A decoder for decoding a medical image data, an extractor for extracting medical information from the medical image data decoded by the decoder, and an image file of the decoded medical image data while reproducing the medical information extracted from the extractor on the screen. It is configured to include a client terminal having a video data viewer (Viewer) to play on the screen.

Preferably, the image data viewer reproduces the medical information and the image file on the screen through a graphical user interface (GUI), wherein the graphical user interface is configured to display at least one image frame according to the reproduction of the image file. 1. A display window, a second display window displaying text of corresponding medical information according to the reproduction of the extracted medical information, and an image frame displayed on the first display window are selected to group at least one image frame. A third display window and a fourth display window for displaying a server list including a plurality of servers together with the server may be configured. The graphic user interface may include an audio player as a map indicating a position of an image frame displayed on the first display window among all image frames, and an operation tool for voice outputting an audio file included in the extracted medical information. It may be configured to include more.

Preferably, medical image data including watermarking information for digital rights management and information security is received from the client terminal as a peer-to-peer and included in the received medical image data. Another client terminal for simultaneously playing the medical information and the image file on the screen may be further provided.

Preferably, the client terminal or the other client terminal may include a generator for inputting an annotation of an image file reproduced on the screen.

Preferably, the extractor is configured to reconfirm the first field indicating the start of the image file, the second field indicating the start of the user field including the medical information, the third field indicating the length of the user field, and the user field. The header field, the user field including the medical information which is at least one of a text and an audio file, and a fourth field comprising the image file comprising a plurality of image frames. The medical information of the user field may be extracted. The graphic user interface may display the plurality of image frames by dividing the plurality of image frames on the first display window, and enlarge the image frames on the first display window as one of the displayed image frames is selected. have. The user field may further include a region into which an annotation of an image file reproduced on the screen is inserted.

Preferably, the client terminal is a generator for inserting the medical information into the medical image data including the image file taken by the human body capsule endoscope, and the medical image data is inserted into the medical information encoded by the generator The encoder may further include a transmitter for uploading the encoded medical image data to the server.

Preferably, the human body-type capsule endoscope for generating and transmitting an image signal in the human body, and a receiver for receiving and storing the image signal transmitted from the capsule endoscope as an image file, the image signal is the capsule endoscope is a human body It is generated by photographing the inside of the digestive tract moving along the internal digestive organ, the capsule endoscope continuously transmits the generated video signal using the human body as a conductor, the client terminal is connected to the receiver and stored Can read image files.

The present invention has been made to achieve the above object, the medical data processing apparatus of the client terminal, comprising: an image receiving unit for receiving a medical image taken from the capsule endoscope; A medical record receiving unit configured to receive a medical record including a previous diagnosis record of the examinee of the medical image from a patient management system server; A viewer for simultaneously displaying the medical image extracted from the image receiving unit and the medical record from the medical record receiving unit; An annotation generating unit for generating an annotation by any one or more of the text, the voice for the medical image displayed on the viewer; It provides a medical data processing apparatus of the client terminal, characterized in that configured to include.

It receives medical records such as the physical condition, medical history, family history, and previous diagnosis records of the examinee from the patient management system server, and displays them on the viewer along with the medical images taken from the capsule endoscope. During the diagnosis process, the medical records such as the medical history of the examinee can be taken into consideration so that the diagnosis can not be missed due to the lack of genetic disease, and the specific symptoms diagnosed by synthesizing the symptoms at various locations are particularly important. This is to make it possible to accurately find and diagnose the disease in consideration of family history or previous history.

Here, the medical record may be received from the patient management system server by extracting the medical history, family history, previous diagnosis results, physical condition, age, gender, etc. of the examinee required to be displayed on the viewer, but need not be displayed on the viewer. It is also possible to extract only medical records necessary for receiving data from the patient management system server and including the information (eg, address, contact information) for display in the viewer. In addition, for security purposes, the encoded data may be received from the patient management system server, decoded, and only the necessary medical records may be extracted and displayed on the viewer.

The medical image displayed on the viewer may be all images taken by the capsule endoscope, but may be extracted as part of the captured image, or may overlap or blur the image taken by the capsule endoscope, or may include a lens. It includes all the images which are modified or the image received by the image processing such as color correction. In other words, the term 'extraction' is used here to include not only the image separated from the photographed image but also all images processed by various methods.

The medical data processing apparatus of the present invention may further include a medical data generation unit configured to generate medical data including the medical image displayed on the viewer, a comment input by the annotation generating unit, and a data field including the medical record. In addition, the medical data generated according to the present invention includes medical images to be stored in a user field with respect to the medical images and comments reflecting the doctor's diagnosis on each of the medical images, and the medical examination of the examinee. In the case of establishing a client-server environment or a client-to-client communication environment, the medical records of the doctors and the medical records of the examinee can be secured, thereby making secondary diagnosis more efficient.

For example, annotations entered by doctors about the medical image are also included in the medical data, so that the medical data can be generated and later used to reconfirm the diagnosis, or exported to other doctors to reflect the opinions of other doctors. On the contrary, diagnostic findings of medical images of other doctors may be called as medical data, and the medical findings may be modified or further reflected and shared. In other words, it is easier for many doctors to share the endoscopy results of the examinee, so that the diagnosis results can be exchanged remotely by using the generated medical data. Effect is obtained.

In addition, since the medical data generated as described above is based on the main medical images necessary for diagnosing a disease, a plurality of medical images and diagnostic findings received from the capsule endoscope can be generated as one undivided medical data. In addition, an advantageous effect of more efficiently constructing a diagnosis database of an examinee using the generated medical data is also obtained.

To this end, the medical data may include a first field indicating the start of the image file, a second field indicating the end of the image file, annotations generated for each of the image files and the medical images of the medical images, and the examinee of the medical image. A data structure is created that includes a user field containing a medical record. The medical data may be formed in a general file format such as jpg, tif, png, wmf, which may include an image data field and a text data field.

At this time, the medical data generation unit is configured to be able to re-create or update again by modifying the already generated medical data. This is intended to facilitate updating of medical data with higher diagnostic accuracy by allowing secondary diagnosers who share the medical data generated by the primary diagnostician to add or modify new opinions to the medical data.

To this end, a medical data storage unit for storing the medical data generated by the medical data generation unit, a medical data export unit for exporting the medical data generated in the medical data storage unit to an external device, and the medical data storage And a medical data calling section for calling and receiving medical data (including those generated by other client terminals) stored in the section.

Meanwhile, the viewer additionally displays one or more image memory bags for selecting and storing the displayed medical images for each group, so that a medical doctor for diagnosing a medical image thought to be associated with a disease may be displayed. It is systematically classified by findings and stored in one or more image memories. Therefore, since the medical image stored in the image storage bag is an image highly related to a disease, the medical data generated by the medical data generation unit may be effectively generated to include the medical images stored in the image bag.

In addition, by moving the captured images suspected of a particular disease or condition to one or more image storage bag to be remembered, the final diagnosis can be diagnosed by examining the medical images classified by disease or disease in the image storage bag In addition, it is easier to find a specific disease to be diagnosed by combining symptoms from different locations.

The image memory bag may be formed in one according to the suspected disease or condition of the examinee, but may be formed in plural. Therefore, the medical data is generated for each group stored in the image storage bag. The medical data is generally generated for a plurality of medical images unless there are few images suspected of disease.

After completing the process of generating and inputting an annotation while looking at the medical image photographed and transmitted from the capsule endoscope, the viewer includes medical images included in the generated medical data, annotations generated for each of the medical images, The medical records of the examinee of the medical image are displayed by listing the image memory bags. Through this, the doctor can visually check the diagnosis result and the main medical image of the subject at a glance. In this case, the medical images to be listed may be displayed together with the diseases classified by the image storage bags, or the imaging time, the video time, and the organ position indicating the anatomical organ position of the medical image may be displayed together.

On the other hand, the present invention provides a recording medium storing medical data generated from the medical data processing apparatus of the client terminal.

The present invention provides a medical data processing method of a client terminal, comprising: a medical image receiving step of receiving a medical image photographed from a capsule endoscope; A medical record receiving step of receiving a medical record of the examinee of the medical image from a patient management system server; Simultaneously displaying the extracted medical record and the medical image while playing the medical image on a viewer; An annotation generation step of generating and inputting an annotation while the medical image is reproduced; A medical data generation step of generating medical data having fields including a medical record and an annotation corresponding to the selected medical image and the medical image, respectively; It provides a medical data processing method of a client terminal comprising a.

The method may further include storing the selected medical image selected from the medical images in one or more image storage bags, and the generating of the medical data may generate medical data for the medical images stored in the image storage bags. It is effective.

At this time, in order to facilitate the exchange and sharing of the generated medical data between the client-server or client-client, the medical data generated in the medical data generating step may be exported, stored, or called and read to an external device. Can be heard.

In addition, the medical image stored in the image storage bag, the annotation generated for the medical image, and the medical record by listing the medical certificate further comprises the step of generating a diagnostic certificate that can automatically generate and output the convenience of diagnosis do.

According to the present invention, when establishing a client-server environment or a communication environment between clients by defining a user field that can include medical information in the image data itself without an annotation, information about a doctor or a patient can be obtained. This enables efficient operation of medical practice. For example, a second client that receives image data without an annotation added from any first client may obtain basic medical information necessary for diagnosis from a user field of the corresponding image data.

In addition, since the medical image data of various patients can be stored in a database on the server, it is easy to access the authenticated users to provide convenience when diagnosing a patient, and to facilitate the sharing or exchange of medical information for a specific patient.

In addition, the present invention enables data organization and standardization by flexibly defining a user field (EXMIF) of image data including not only basic medical information but also an annotation corresponding to a result of a later diagnosis of a doctor without major change of an existing image file format.

In addition, it satisfies the security requirements of encryption of medical image data, thereby ensuring stability in establishing a client-server environment or a communication environment between clients.

In addition, as described above, the present invention, by receiving the medical record from the patient management system server, extract and display the medical image taken from the capsule endoscope, etc. in the viewer, the medical history and family history of the subject by the capsule endoscope It can be displayed along with the captured images, so that not only can you detect a disease with a weak progression, but also overlook the family history or previous history of the specific disease diagnosed by combining the symptoms at various locations. There is an advantageous effect that it can find and increase the diagnostic accuracy.

In addition, according to the present invention, the photographed images suspected of a particular disease or condition are systematically classified and moved according to the condition or the disease into one or more image storage bags, and when the diagnosis is finally made, the images classified by the condition or disease are stored. The medical images contained in the memory bag can be classified and examined for diagnosis, thereby making it easier to find a specific disease to be diagnosed by synthesizing the symptoms at various locations.

First of all, according to the present invention, the medical image data is defined by defining a user field including medical records of the examinee, diagnostic findings input from a diagnostic doctor, and important medical images necessary for the diagnosis of a condition or disease. In the case of establishing a communication environment, information input by a doctor or patient information can be obtained together with medical image data, thereby enabling efficient operation of a diagnostic operation of a medical image captured by a capsule endoscope. That is, the second client that has received image data without an annotation added from any first client has an advantageous effect of obtaining a basic medical record for diagnosis in the user field of the corresponding image data.

At this time, the medical data is one file, but as a plurality of medical images and annotations reflecting the diagnosis findings of each of the medical images are generated together, it is easier to handle and share with other doctors or establish a database. It becomes easier.

In addition, the present invention generates medical data in an exchangeable format having an image file of a medical image taken by a capsule endoscope and a user field including basic medical records and diagnostic findings, thereby mutually communicating in a client-server environment and a communication environment between clients. The exchange of medical data has the beneficial effect of supplementing the diagnosis or facilitating the sharing of diagnostic findings remotely.

In addition, the present invention does not rely on only the image taken by the capsule endoscope to diagnose, but received and decoded from the patient information server to display a medical record, such as the medical history and family history of the subject with the image taken by the capsule endoscope, It is possible to improve the accuracy of diagnosis without overlooking the diagnosis of a specific disease that should be diagnosed by synthesizing the symptoms at various locations by combining the medical history.

In addition, the present invention, if the doctor records the diagnostic findings based on the image taken through the capsule endoscope as an annotation or final diagnosis as described above, even if you do not execute a separate diagnostic software to create a diagnostic as in the prior art automatically A medical certificate can be generated and printed out, minimizing the doctor's waste of work, so as to facilitate the diagnosis.

1 is a schematic diagram showing the configuration of obtaining a medical image of the digestive organs using a capsule endoscope

Figure 2 is a block diagram showing the configuration of a medical data processing apparatus of a client terminal according to an embodiment of the present invention

3 is a flow chart illustrating the operation of the medical data processing apparatus of FIG.

FIG. 4 is a diagram showing a data structure of medical data generated by the medical data generating unit of FIG.

FIG. 5 is a diagram illustrating a viewer configuration for storing a medical image in an image storage bag displayed on the viewer of the medical data processing apparatus of FIG.

FIG. 6 is a view showing a viewer configuration in which thumbnails of medical images stored in the image storage bag are displayed by FIG. 5; FIG.

FIG. 7 is a view showing another configuration of a viewer for storing a medical image in an image storage bag displayed on the viewer of the medical data processing apparatus of FIG.

FIG. 8 is a view showing a viewer configuration in which thumbnails of medical images stored in the image storage bag are displayed by FIG.

FIG. 9 is a view showing a viewer configuration in which an execution button for executing a function relating to a medical image stored in an image storage bag is displayed by FIG.

FIG. 10 is a view illustrating a viewer configuration in which a list of medical images in which annotations are completed and a list of images in which annotations are not generated are shown through FIGS. 5 through 9;

FIG. 11 is a diagram illustrating a viewer configuration in a state where a list of medical images in which annotations are completed is selected from the diagnosis list of FIG. 10; FIG.

FIG. 12 is a diagram illustrating a state in which a medical certificate automatically generated using the medical data processing apparatus of FIG. 2 is displayed in a viewer.

Fig. 13 is a block diagram showing the construction of a medical image data processing system according to the present invention.

14 illustrates a format of medical image data according to the present invention.

15 is a view showing an example of the screen configuration of the medical information generator in the client terminal according to the present invention.

16 and 17 illustrate a configuration example of a graphical user interface (GUI) according to an operation of an image data viewer in a client terminal according to the present invention.

18 is a flowchart of a processing procedure of medical image data according to the present invention.

19 is a view showing an example of the configuration of the capsule endoscope, the receiver and the client terminal in the present invention.

Hereinafter, a medical data processing apparatus of a client terminal according to an embodiment of the present invention will be described with reference to the accompanying drawings.

However, in describing the present invention, the same or similar reference numerals are given to known functions or configurations, and detailed description thereof will be omitted for clarity.

As shown in the figure, the medical data processing apparatus 100 of the client terminal according to an embodiment of the present invention, the medical record for receiving a medical record including the previous diagnosis record of the examinee from the patient management system server 200 A medical image and a medical image of the medical image and the medical image from the image data received by the image receiving unit 120 and the medical image receiving unit 120 and the medical image receiving unit 120 receives the medical image captured by the receiver 110, the capsule endoscope 301 To a viewer 130 that simultaneously displays the medical records of the examinee, an image storage control unit 140 that controls the image storage bag 135 displayed on the viewer 130, and a medical image being reproduced by the viewer 130. Annotation generator 150 for inputting an annotation by voice or text by a doctor, and a medical image displayed on the viewer 130 and an annotation input by the annotation generator 150 and the viewer 130 are displayed. Being A medical data generation unit 160 for generating medical data in a data structure having fields including medical records, and a medical data storage unit for storing medical data generated by the medical data generation unit 160 in a recording medium ( 170, a medical data export unit 180 for transmitting the medical data generated by the medical data generating unit 160 to a server or another client terminal, and the medical data stored in the medical data storage unit 170 or an external device. The medical data call unit 190 calls and reads medical data received from another client terminal, and a medical certificate generator 199 automatically generating a medical certificate based on the data generated from the medical data.

The medical record receiving unit 110 may include personal information such as address, height, weight, and gender of the examinee recorded in the patient management system server 200, previous medical treatment date, self-examination, family history research information, medical history, and previous diagnosis results. Receive medical information in encoded form. Then, the information received from the patient management system server 200 is decoded as necessary to extract medical information such as weight, gender, previous diagnosis results, medical history, family history, etc. necessary for endoscopy.

The image receiving unit 120 receives image data of the organ of the examinee taken by the capsule endoscope 301 shown in FIG. 1 from the receiver 302 by a wired or wireless method and displays the medical image displayed on the viewer 130. To be used. If necessary, the captured image data may be used as a medical image by only extracting an image that overlaps or approaches a desired condition by a predetermined calculation process. At this time, the image captured by the capsule endoscope 301 may be directly received from the receiver 302, but may be received from the image database server 300 that stores it.

As shown in FIG. 5, the viewer 130 is extracted from the image data obtained by the capsule endoscope 301 together with the medical record 136 of the examinee necessary for diagnosis among the information received by the medical record receiving unit 110. The medical image 131 is simultaneously displayed. Through this, the doctor diagnoses by examining the medical image 131 reproduced through the viewer 130 with prior knowledge of a specific disease in consideration of the previous diagnosis result, medical history, and family history of the examinee, so that even a weak condition is missed. To assist in a more complete diagnosis.

The image storage bag control unit 140 controls the operation of the image storage bag 135 displayed on the viewer 130. The image memory bag 135 allows the diagnosis doctor to look into the medical image 131 of the examinee and store the medical image suspected of having the disease in one or more image memory bags 135 and 235 classified by disease or disease. It is marked at 130.

That is, when one image storage bag 135 is used as shown in FIG. 5, the currently observed medical image 131 is displayed in a large upper portion and a thumbnail image of a small size of the medical image 131 is present. 131a and its front and rear medical images 131a 'and 131a " are displayed as thumbnail images at the bottom thereof. When the diagnoser finds a medical image suspected of having a disease, the control button 132 is used. While the reproduction of the medical image 131 is stopped, the corresponding medical image may be stored in the image storage bag 135 by pressing the insert button 134a. Through this, the image storage bag 135 in a state where all the medical images are examined. By recalling the medical images stored in Fig. 11 so that they can be examined again as shown in FIG. 11, it is possible to more efficiently diagnose disease and disease diagnosis of the examinee.

At this time, the image storage bag 135 displays the number 135a of medical images stored so far, and clicks the button 135b at the upper portion of the image storage bag 135 to store the image as shown in FIG. The medical images stored in the bag 135 may be confirmed as thumbnail images.

The annotation generator 150 may record the annotation by text or voice on the medical image suspected of having a disease while the medical images are reproduced through the viewer 130 illustrated in FIG. 5. That is, when the diagnosis finds a medical image suspected of having a disease, an annotation may be entered by typing in the annotation field 137 while the reproduction of the medical image 131 is stopped using the control button 132. An annotation may be input by voice by clicking the icon 137a. For the medical image stored in the image storage bag 135, the comment input to the medical image and the medical record of the examinee are also stored.

The medical data generation unit 160 generates medical data such that not only the data of the medical images stored in the image storage bag 135, but also the annotations input to the medical images and the medical records of the examinee are included in the user field. . For example, in the case of generating medical data using a JPEG general-purpose file, as shown in FIG. 4, the medical data 260 generated in the medical data generating unit 160 may be a first file representing the start of an image file. Field (SOI, Start of Image, 261) and a second field (EOI, End of Image, 267) indicating the end of the image file, between the first field 261 and the second field (262) Medical fields stored in the image storage units 135 and 235 and user fields (EXMIF, 262) for inserting medical information such as annotations and medical records inputted by a diagnostic doctor to the medical images, and representatives of the medical data. A representative image field 266 or the like for storing the image is included. Here, the representative image refers to an image displayed externally when the jpeg file is loaded from a general PC, and is not necessarily limited to a medical condition representative image. Other fields (COM, DQT, SOF, DHT, SOS) are also included.

Here, as shown in FIG. 4, the user field EXMIF of the medical data 260 may include a first area 262a for storing n medical image data so that each condition and the medical image correspond 1: 1. Is provided. Here, 'Finding' denotes 'path' or 'disease' and corresponds to the names of the image storage bags 135 and 235. Thus, 'finding' does not necessarily have to be confined to one condition or disease. For example, as shown in FIG. 7, the diagnostic doctor looks at the medical images taken by the capsule endoscope, and stores three image memories of 'Ulcer', 'Bleeding', and 'Inflammation'. When the bags 235, 235 'and 235 "are generated and five, three and two medical images are stored in each of the image storage bags 235, 235' and 235", the user area EXMIF is as follows. 262, first region 262a is generated.

Table 1

Ulcer # 1: Medical information (Annotation data for medical image 11 stored in 'Ulcer' image memory) Ulcer # 1: Medical image (Image data of medical image 11 stored in 'Ulcer' image memory) Ulcer # 2 : Medical information (Annotation data for medical image 12 stored in 'Ulcer' image memory bag) Ulcer # 2: Medical image (Image data of medical image 12 stored in 'Ulcer' image memory bag) Ulcer # 3: Medical information (Annotation data for medical image 13 stored in 'Ulcer' image memory bag) Ulcer # 3: Medical image (Image data of medical image 13 stored in 'Ulcer' image memory bag) Ulcer # 4: Medical information ('Ulcer 'Ulcer # 4: Medical image (Image data of medical image 14 stored in' Ulcer 'image memory) Ulcer # 5: Medical information (' Ulcer 'image memory) Annotated data of a medical image 15 memorized in a bag) Ulcer # 5: Medical image (memory in 'Ulcer' Image data of medical image 15) Bleeding # 1: Medical information (comment data for medical image 21 memorized in 'Bleeding' image memory) Bleeding # 1: Medical image (memory image memorized in 'Bleeding' image memory bag) Image data of 21) Bleeding # 2: medical information (comment data for medical image 22 stored in 'Bleeding' image memory) Bleeding # 2: medical image (image of medical image 22 memorized in 'Bleeding' image memory bag) Data) Bleeding # 3: Medical information (Comment data for medical image 23 memorized in 'Bleeding' image memory) Bleeding # 3: Medical image (Image data for medical image 23 memorized in 'Bleeding' image memory) Inflammation # 1: Medical information (comment data for medical image 31 stored in 'Inflammation' image memory) Inflammation # 1: Medical image (image data for medical image 31 memorized in 'Inflammation' image memory) Inflammation # 2: Medical information (in medical image 32 stored in 'Inflammation' video memory Hanjuseok data) Inflammation # 2: Medical Image ( 'Inflammation' image data of the medical image stored in the video memory 32 in which the back)

That is, as shown in Table 1, one medical data file 260 includes variously classified medical images 11 to 32, and a doctor writes text through the annotation generator 150 for each of the medical images. Or medical information data including voice input comments, generated in association with voice or text input comments for each of the medical images classified and stored in the image storage bag while maintaining the respective attributes of the stored medical images. It becomes possible.

The user area EXMIF 262 of the medical data 260 includes a second area 262b including annotations inputted to the main image data 266 displayed as a representative image of the file, if any. The second area 262c received from the management system server 200 and including the medical record data displayed on the viewer 130 or selected by the user for diagnosis in the course of viewing the medical image through the viewer 130 is provided. It is provided. In this case, if there is a matter to be taken into account in a particular medical image among the medical records of the examinee, a part or all of the medical records displayed on the viewer 130 may be reflected and described. In this case, the medical information of the first area 262a may include a medical record of the examinee. That is, the 'medical information data' of the first area 262a is not limited to the comments input as the diagnosis findings, but includes all the various medical information necessary for diagnosis or indicating the diagnosis findings, including the annotations input by the user. Can be.

Meanwhile, the viewer 130 shown in FIG. 11 displays a medical image classified and stored in the image storage bags 135 and 235 according to a disease or a disease, an annotation containing inputted diagnostic findings for each medical image, and a medical record of an examinee. The final diagnosis is performed while comprehensively examining the data. In the user area EXMIF 262 of the medical data 260, the fourth area 262d includes the final diagnosis data finally diagnosed by the doctor. ) Is provided.

In this way, a user field (EXMIF, which allows a user to input arbitrary data in one image data file (in this case, an image that is externally viewed using general image viewer software is included in the representative image field 266). 262, a plurality of medical images and medical information data for each of them are linked to this user field (EXMIF) 262, classified according to a condition, and included in the first area 262a, and the patient management system server 200 Also, the medical records received from the data sheet and the necessary medical records are also included in the third area 262c, whereby all the data necessary for the diagnosis of the examinee can be put in one file. By using the medical data generated as one file in this way, it is easy to share the diagnostic data among diagnostic doctors and to exchange opinions (not shown in FIG. 4, but in the user field EXMIF, 262). Five areas can be provided, and the area of final diagnosis information can be used or opinions can be exchanged by commenting on each medical image.) It is also simpler, and it is much easier to establish a diagnosis database of the examinee. The advantage of being released is obtained.

 The medical data may use any one of general file formats such as jpg, tif, png, and wmf, which may include a user field in an image file. In addition, the medical data 260 is generated to include a plurality of medical images stored in the image storage bags 135 and 235 instead of only one medical image. In addition, when the medical data 260 is generated such that medical images of two or more image storage bags 235 are included, information of the image storage bag 235 to which the medical images belong is also included in the user field EXMIF. In the state where the medical data 260 is called, the image memory bag 235 to which each of the medical images belongs and the annotation or medical record recorded in each medical image may also be displayed.

As described above, the medical field includes an image field 266 including a medical image stored in the image storage bags 135 and 235 of the viewer 130, and a data field EXMIF including annotations and medical records of the medical image. As the data is generated, the medical data includes a medical image and an annotation in the user field thereof, which reflects the medical records of the examinee and the diagnostic findings of the doctor, thereby establishing a client-server environment or a communication environment between the clients. The diagnostic findings and medical records of the examinee can be secured, thereby making secondary diagnosis more efficient.

The medical data storage unit 170 stores the medical data 260 generated by the medical data generating unit 160 in a recording medium such as a CD, a DVD, a hard disk, an optical disk, or a USB memory.

The medical data exporting unit 180 transmits the generated medical data 260 to a server or P2P method to another client terminal. At this time, since the medical data 260 has a much smaller data capacity than the data of the images taken by the capsule endoscope, it is very efficient to share the medical data with other client terminals or server users.

The medical data caller 190 reads and reads medical data generated by a medical data processing apparatus of another client terminal or calls and reads medical data previously stored.

The diagnosis generator 199 may include medical images indicating a significant finding in the diagnosis generated from medical data, comments input by a doctor for each of the medical images, and a patient management system server ( After the medical records of the test subjects retrieved and extracted from the data are synthesized, the final diagnostic findings (diagonosis) input by the doctor are added, and the medical certificate generating unit 199 automatically generates the medical certificate shown in FIG. According to this, the automatically generated diagnosis is automatically printed out.

Here, the medical certificate 70 automatically generated by the medical certificate generating unit 199, as shown in Figure 12, the medical examination of the examinee including the medical history and family history of the subject, the previous medical record, the previous diagnosis results, etc. About the medical image 73 of the important part or all of the record 71, the medical image stored in the image storage bag, the name of the disease 73a to which each medical image 73 corresponds, and each of the medical image Comments entered on the findings 72 and final diagnostic findings 74 in which the diagnostic physician indicates the diagnostic findings regarding the final disease or condition in consideration of these.

At this time, the name of the condition of the diagnosis document 70 corresponds to the name of the image storage bag, and the diagnosis doctor may change the name in the diagnosis process.

Hereinafter, a process of observing and diagnosing an image captured by the capsule endoscope 301 using the medical data processing apparatus 100 of the client terminal configured as described above will be described in detail.

Step 1 : First, as shown in FIG. 1, the image receiving unit 110 receives an image captured by the capsule endoscope 301 of the organ 40 of the examinee 40. Then, if necessary, the medical image to be examined is extracted by overlapping the captured image or excluding a part of the overlapped image (S110).

Step 2 : The medical records of the examinee 40 are received from the patient management system server 200 in an encoded state and decoded, and the medical records are extracted by extracting a medical history, a previous diagnostic record, and the like necessary for diagnosis from the received data. Extract (S120).

Step 3 : Then, as shown in FIG. 5, the medical image 131 obtained from the image captured by the capsule endoscope 301 and the extracted medical record 136 are reproduced together to be displayed on the viewer 130. (S130). In this case, the viewer 130 also displays surrounding images before and after the currently displayed medical image 131 as thumbnail images 131a 'and 131a ".

As such, the medical records 136 such as the physical condition, medical history, family history, and previous diagnosis records of the examinee are received from the patient management system server 200 and the medical images 131 photographed from the capsule endoscope 301 and the like. By displaying on the viewer 130, in the process of diagnosing the captured medical image of the capsule endoscope 301, it is possible to look at medical records such as the medical history of the examinee, and not miss a genetic disease having a weak course. Not only can this be done, but it is also possible to accurately find and diagnose a particular disease in consideration of a family history or a previous history, especially for a particular disease diagnosed by synthesizing a symptom at various locations.

Step 4 : If the diagnosis is a medical image suspected of a disease or disease, the control button 132 stops the playback of the medical image, the annotation generator 150 in the blank 137 displayed on the viewer 130 Typing a comment to enter a letter or click the microphone icon (137a) to record the diagnostic findings by voice (S140).

Step 5 : Then, click the insert button (134a) or drag the medical images (131, 131a ...) for the selected medical image suspected of a disease or disease image storage bag (displayed at the bottom right of the viewer 130 ( 135) into the memory (S150). At this time, the number of the medical images contained in the image storage bag 135 is displayed 135a in the image storage bag 135, and the medical image contained in the image storage bag 135 is clicked on the upper button 135b in FIG. This can be seen as shown. If necessary, the medical image contained in the image storage bag 135 may be removed by clicking the discharge button 134b.

Meanwhile, the image memory bags 135 and 235 may be displayed on the viewer as two or more by disease or condition, so that a medical image may be separated or duplicated into each image memory bag 235 by a diagnosis doctor. As shown in FIG. 7, when three image storage bags 235, 235 ', and 235 "are generated according to the needs of the diagnoser, the medical image 131 being reproduced in the center of the viewer 130 is dragged. Therefore, any one or more of the plurality of image memory bags 235, 235 ', and 235 "may be stored in a medical image suspected of being a disease or a disease. At this time, the medical image contained in the image storage bags 235, 235 ′, and 235 ″ is stored together with the medical record 136 or the annotation 137 input for the corresponding medical image.

Furthermore, the medical images stored in the image storage bag 235 may be viewed using the switches 235a-235d formed around the image storage bag 235. For example, when the right switch 235b of the image storage bag 235 is clicked on, as shown in FIG. 8, medical images captured thereafter based on the representative medical image contained in the image storage bag 235. 235x is listed and displayed, and the location 133x of each of the medical images is displayed on the time bar 133. In this case, the positions of the medical images 235x included in the image storage bag 235 may be displayed on an organ region display map (not shown) that anatomically shows the positions of the organs rather than the time bars 133. . Even during the diagnosis, the inputted annotation may be viewed by designating the medical images 235x listed as shown in FIG. 8. When a comment is input by voice, a play button 235y is displayed on the listed medical image 235x, and the voice comment may be heard by clicking the play button 235y.

When the left switch 235a of the image memory bag 235 is clicked on, the medical images 235x previously photographed based on the representative medical image contained in the image memory bag 235, as shown in FIG. ) Are listed. When the upper or lower switches 235c and 235d of the image storage bag 235 are clicked on, various pop-up menus are displayed as shown in FIG. 9 to maximize the utilization of the image storage bag 235 of the diagnoser. have.

Step 6 : After reviewing all the medical images through steps 3 to 5, the diagnostic doctor stores the medical images stored in the image storage bags 135 and 235 in the image field 266, and inputs each of these medical images. The medical data 260 is generated such that the annotation and the medical record are included in the user field EXMIF 262 (S160). In this case, the medical information inserted into the user field (EXMIF, 262) corresponds to the meta information of the medical image together with basic information including the file name, size, type, resolution, and creation time (time of shooting) in addition to the annotation and medical record. do. As a result, the medical data generator 150 provided in the client terminal 100 generates medical data such that the information of the user field EXMIF 262 is processed as meta information.

 The medical data 260 generated therein includes an annotation 137 reflecting the medical record of the examinee and the diagnosis of the doctor in the user field EXMIF with respect to the medical image 131. In the case of establishing a communication environment between the doctors, the diagnosis findings of the doctor and the medical records of the examinee can be secured, thereby enabling the secondary diagnosis to be more efficient.

Step 7 : The medical data 260 generated as described above may be stored in the recording medium by the medical data storage 170, or transmitted to the server or another client by the medical data exporting unit 180, and the medical data call is performed. The medical device 190 may open medical data stored in the recording medium or transmitted from another client.

Here, the first client terminal transmits the medical data to the peer-to-peer (P2P) in an encoded state, and accordingly another second client terminal (not shown) receives the medical data to receive the medical data caller ( Decoded by 190) to retrieve the medical data. The second client terminal may update the same file name by rewriting the read out medical data or the like, or regenerate it with a different file name. In this case, the first client terminal may transmit medical data including watermarking information for digital rights management.

Since the medical data includes a comment input by the doctor about the medical image, the medical data may be generated and used to confirm the diagnosis later, or may be exported to another doctor to reflect the opinion of another doctor. On the contrary, diagnostic findings of medical images of other doctors may be called as medical data, and the medical findings may be modified or additionally reflected and shared with each other. In addition, since all the diagnostic information necessary for the diagnosis is included in the form of reduced data size, the diagnosis database of the examinee may be constructed based on the diagnosis information. In other words, it is easier for many doctors to share the endoscopy results of the examinee, so that the diagnosis results can be exchanged remotely by using the generated medical data. Effect is obtained.

Step 8 : When the diagnosis performed by examining the medical image 131 of the examinee is completed as described above, the viewer 130 displays the diagnosis list 80 illustrated in FIG. 10. That is, the doctor in charge should diagnose the patient #n from the patient # 1, which means that the diagnosis is completed only for the patient # 2 and the patient # 4. At this time, the number 81 of the image storage unit is displayed in the right column of each patient list, and the blank 81b is displayed for the patient whose diagnosis is not completed. That is, for patient # 2, medical images contained in three image storage units 235 are generated as medical data, which means that there are three types of diseases or conditions (eg, ulcers, bleeding, and inflammation). do.

And, at the bottom of the diagnosis list 80, the number (2) of the diagnosed patients is displayed (82) among the total number (n) of patients, so that the present doctor diagnoses the present condition can be easily grasped.

Step 9 : At this time, if the right button 81 of the patient # 2 or the patient # 4 having diagnosed in which the number of image storage units is displayed in the diagnosis list 80 is clicked, the report screen 90 shown in FIG. It is displayed at 130. That is, the report screen 90 lists and displays the medical images 92 included for each image storage unit, and when one of the listed medical images 92 is selected, the diagnosis inputted with respect to the selected medical image is selected. A finding 94, a medical record 95, and an enlarged medical image 93 are displayed.

At this time, each of the medical images 92 is labeled by the diagnostic doctor as shown by reference numeral 92x, so that the medical images 92 imported from or included in the medical data 260 are not included. You can see at a glance whether it was selected as a condition. Through this, it is easy to know which medical images 92 are retrieved from the medical data 260 and which image memory bag 235 is selected for what reason. Although not shown in the drawings, the medical images listed in the viewer 130 may be selectively or displayed together with any one of a recording time, a reproduction time, and an anatomical organ position in the capsule endoscope, and thus may be displayed on the image storage bag 235. The location of the organ of the memorized medical images 92 may be determined.

As described above, the medical images included in the medical data 260 are listed at a time, and the medical records of the examinee and the comments inputted for each medical image are comprehensively examined to synthesize the symptoms in various parts. It is possible to accurately diagnose a disease diagnosed as a disease.

The final diagnosis thus made may be written in the bottom diagnostic column 96, and automatically generated the final diagnosis as shown in FIG. 12 by clicking the "View report" button of the command button 97. FIG. The medical data generated as described above may be output only for the selected medical image using the command button 97, or may be output for all the medical images. You can modify it to "medical data" and update or recreate it with another name. You can export the created medical data to an external client or server by clicking the "Export" button. If you want to import medical data from an external client, The new medical data can be read and read by clicking the "button, or the final medical report shown in FIG. 12 can be automatically output by clicking the" Print report "button in order to output the final medical certificate at the same time.

Other objects, features and advantages of the present invention will become apparent from the detailed description of the embodiments with reference to the accompanying drawings.

Hereinafter, with reference to the accompanying drawings illustrating the configuration and operation of the embodiment of the present invention, the configuration and operation of the present invention shown in the drawings and described by it will be described by at least one embodiment, By the technical spirit of the present invention described above and its core configuration and operation is not limited.

Hereinafter, various embodiments of the method and system for processing medical image data according to the present invention will be described in detail with reference to the accompanying drawings.

13 is a block diagram showing the configuration of a medical image data processing system according to the present invention.

Referring to Fig. 13, the system of the present invention comprises a server 10, a first client terminal 20, and a second client terminal 30 to establish a client-server environment and a communication environment between the clients.

The server 10 holds encoded medical image data. Hereinafter, the medical image data may be described as EXMIF (Exchangeable Medical Information Format).

The first client terminal 20 or the second client terminal 30 downloads the medical image data from the server 10 and also uploads the medical image data to the server 10. However, in the following description, an example of implementing a client-server environment using the first client terminal 20 and the server 10 will be described, and the communication environment between the clients using the first client terminal 20 and the second client terminal 30 will be described. An example of implementing this is described.

Accordingly, the first client terminal 20 downloads the downlink processing blocks 21, 23, and 25 for downloading and processing the encoded medical image data from the server 10, and the uplink processing blocks for uploading the medical image data ( 22, 24, 26, 27). Then, the video data viewer 28 is provided.

The downstream processing blocks are a receiver 21 for receiving the medical image data encoded from the server 10, a decoder 23 for decoding the medical image data received at the receiver 21, and a medical image decoded at the decoder 23. And an extractor 25 for extracting medical information from the data.

The upstream processing blocks include a medical information generator 26 and a medical image inserted with medical information by the medical information generator 26 for inputting and inserting medical information into medical image data including an image file photographed by a human insert capsule endoscope. An encoder 24 encoding the data, and a transmitter 22 for uploading the medical image data encoded by the encoder 24 to the server 10.

On the other hand, the image data viewer 28 also reproduces the image file of the decoded medical image data on the screen while reproducing the medical information extracted by the extractor 25 on the screen.

The second client terminal 30 may also have the same configuration as the first client terminal 20 described above. However, in the present invention, it is described that the second client terminal 30 implements a communication environment between the first client terminal 20 and the clients.

Accordingly, the second client terminal 30 receives the medical image data from the first client terminal 20 as peer-to-peer (P2P), and receives the medical information and image file included in the received medical image data. It has a configuration to play simultaneously on the screen.

Description of Actions for Upstream Processing Blocks

The first client terminal 20 constitutes a capsule endoscope device together with the capsule endoscope 40 and the receiver 50 shown in FIG. 18 is a view showing an example of the configuration of the capsule endoscope, the receiver and the client terminal in the present invention. That is, the first client terminal 20 reads an image file stored in the receiver 50 as one workstation and displays it on the screen.

The capsule endoscope 40 is microscopic and shoots tens of thousands of subjects while moving according to the peristalsis of the digestive organs in the human body. In addition, the capsule endoscope 40 generates and transmits an image signal according to time-series photographing performed in the human body. In detail, the video signal is generated by capturing the inside of the digestive tract while the capsule endoscope 40 moves along the digestive tract in the human body, and the capsule endoscope 40 continuously transmits the video signal generated by using the human body as a conductor. .

The receiver 50 wirelessly receives and stores an image signal corresponding to an image captured by the capsule endoscope 40. In particular, the receiver 50 receives the video signal transmitted from the capsule endoscope 40 and stores it as an image file.

The first client terminal 20 is connected to the receiver 50 to read an image file stored in the receiver 50. The first client terminal 20 includes a generator for generating one medical image data from the image file read from the receiver 50. In particular, the first client terminal 20 generates medical image data by adding medical information to an image file read from the receiver 50 through the medical information generator 26.

The medical information generator 26 is a tool for inputting medical information including identification information of a device used for encoding medical image data, device user identification information, and identification information of the medical image data.

The identification information of the device includes a device manufacturer and a device name and version, the device user identification information includes a doctor's name and contact information, patient name / sex / age / body characteristics (key / weight), the medical image The identification information of the data includes the time of creation of the image file according to the imaging of the body part, the anatomical body part photographed, the pathology, the diagnosis result, the attribute (size and color) of the image file, and the annotation by the medical activity of the diagnosis person. Information and the like.

15 is a diagram showing an example of the screen configuration of the medical information generator in the client terminal according to the present invention, showing an example of the medical information generator 26 displayed on the screen through a graphical user interface (GUI).

In the example of FIG. 15, the medical information generator 26 includes a version of medical image data to be generated as general information (EXMIF Version), a device name for generating medical image data, a country, It includes a function window for entering the ownership, hospital name, doctor name, and e-mail address. The medical information generator 26 also includes a function window for inputting patient sex / age / height / weight as patient information. The medical information generator 26 also provides a function window for inputting a reason for referral, an anatomical region, a disease name, and comments as diagnostic information. It includes.

As various medical information is input through the medical information generator 26, the encoder 24 generates medical image data including the input medical information. In this case, the generated medical image data is encoded medical image data, and the transmitter 22 uploads the encoded medical image data to the server 10. Accordingly, the server 10 stores the uploaded medical image data in the database DB.

On the other hand, the medical image data according to the present invention has the format shown in FIG.

FIG. 14 is a diagram illustrating a format of medical image data according to the present invention. In addition to JPEG, medical image data according to the present invention has a user field into which image files of TIFF, PNG, etc. are inserted, and also medical information is inserted. This includes fields.

Specifically, with reference to FIG. 14, the medical image data according to the present invention includes a first field (SOI: Start of Image) indicating the start of an image file in a JPEG format and a field indicating the end of the image file (EOI: End). of Image), a user field (EXMIF) for inserting medical information between the two fields, and a field (IMAGE FILE) for inserting compressed image data (Compressed data). Other fields COM, DQT, SOF, DHT, and SOS in FIG. 14 are not related to the core matters or operations of the present invention, and thus detailed descriptions are omitted.

In particular, the user field EXMIF is also composed of fields as shown in Table 2 below.

TABLE 2

symbol	Size (Byte)	Explanation
AAPP3
	2	Area that marks the beginning of a user field (EXMIF)
dData length	2	Area indicating the length of medical information insertion area
EEXMIF header
	2	Header area of medical information insertion area
EXMIF data	variable	Medical Information Insertion Area

When the area of the user field EXMIF is divided with reference to Table 2, a second field APP3 indicating the start of the user field EXMIF including medical information and a length indicating the length of the user field EXMIF 3 fields (data length), a header field (EXMIF header) for reconfirmation of the user field (EXMIF), and the data field (data) including the medical information. The medical information inserted into the data field may be at least one of a text and an audio file. Thus, although not shown, the medical information generator 26 may have a function for inputting information as audio.

Meanwhile, the data field data of the user field EXMIF may further include a region in which an annotation is inserted. This will be described in detail below.

In addition, the medical image data may further include a field including watermarking information for digital rights management, which is for security when implementing a communication environment between clients.

As another example, the first client terminal 20 may generate and upload medical image data to the server 10 without inserting the above-described medical information.

Instead of generating the medical image data including the medical information after reading the image file stored in the receiver 50, the first client terminal 20 downloads the image data without the medical information inserted from the server 10. Medical image data including medical information may be generated.

Description of Actions for Downstream Processing Blocks

In the first client terminal 20, the receiver 21 receives encoded medical image data having a format as shown in FIG. 14 from the server 10.

The decoder 23 decodes the medical image data received by the receiver 21, and the extractor 25 extracts the medical information from the user field EXMIF of the medical image data decoded by the decoder 23.

The image data viewer 28 reproduces the medical information extracted from the extractor 25 on the screen through a graphical user interface (GUI) and simultaneously reproduces the image file of the decoded medical image data on the same screen.

16 and 17 are diagrams illustrating an example of a configuration of a graphical user interface (GUI) according to an operation of an image data viewer in a client terminal according to the present invention. An example of simultaneously displaying an image file together with medical information on one screen is shown. It is shown.

16 and 17, the graphical user interface (GUI) includes a plurality of display windows 1100, 1200, 1300, 1400, 1900, an anatomical location map 1500, and audio. The player 1600 and other input windows 1700 and 1800 are configured.

The first display window 1100 displays at least one image frame according to the reproduction of the image file of the medical image data. FIG. 16 shows an example of displaying several image frames at the same time, and FIG. 17 shows an example of enlarging and displaying only one selected from several image frames.

In detail, the graphical user interface (GUI) may divide and display a plurality of image frames on the first display window 1100 as shown in FIG. 16A, and may also display the image frames displayed on the first display window 1100. As one is selected, the corresponding image frame may be enlarged and displayed on the first display window 1100 as illustrated in FIG. 17.

The second display window 1200 displays text of the corresponding medical information according to the reproduction of the medical information extracted from the medical image data.

The third display window 1300 groups and displays the selected at least one image frame as one of the image frames displayed on the first display window 1100 is selected. The user may select and move at least one image frame to the third display window 1300 by using a mouse drag and drop operation.

The fourth display window 1400 displays a server list including a plurality of other servers together with a server to download medical image data.

The anatomical location map 1500 represents an anatomical position of the image frame displayed on the first display window 1100 of the entire image frame. That is, it indicates to which position the image frame displayed on the first display window 1100 among the total amount photographed by the capsule endoscope 40.

The audio player 1600 is an operation tool for audio output of the audio file included in the medical information when the medical information extracted from the medical image data includes the audio file.

Describe communication between clients

The first client terminal 20 transmits the medical image data to a peer-to-peer (P2P), and accordingly the second client terminal 30 receives the medical image data.

In particular, the first client terminal 20 transmits medical image data into which watermarking information for digital rights management is inserted. Therefore, the second client terminal 30 is preferably an authenticated client that is guaranteed to receive the medical image data.

The second client terminal 30 decodes the received medical image data, extracts medical information inserted into the medical image data, and simultaneously reproduces the medical information and the image file included in the medical image data on the screen.

The second client terminal 30 includes an annotation generator for inputting an annotation of the reproduced image file on the screen by referring to the reproduced medical information and the image file on the screen. Of course, the first client terminal 20 also preferably includes an annotation generator 27 for input insertion of annotations.

The annotation generator 27 displays a comment input window for performing annotation input to an image file on the screen, and stores the input annotation in association with the corresponding image file as the annotation is input in the comment input window. have. In particular, the annotation input through the annotation generator 27 is inserted into the user field EXMIF into which medical information is inserted. This is possible by further including an area in which the data field data of the user field EXMIF is inserted with an annotation for the image file reproduced on the screen as described above.

As a result, the annotation generated by the annotation generator of the second client terminal 30 indicates organ location information indicating which organ of the digestive organ is an image file reproduced on the screen, and which disease image is the image file. The disease type information to be shown and the disease weight information indicating how severe the disease is when the image file is an image representing one disease may be included.

The second client terminal 30 uploads the medical image data including the annotation in the user field EXMIF to the server 10.

Accordingly, the server 10 maintains a database of medical image data of various patients and downloads the medical image data when the authenticated client approaches the data, thereby sharing or exchanging medical information and diagnostic information for a specific patient. Make it possible.

FIG. 17 is a flowchart illustrating a medical image data processing procedure according to the present invention, and illustrates a method of processing encoded medical image data by a first client terminal. Referring to FIG.

Referring to FIG. 17, the receiver 21 of the first client terminal 20 receives encoded medical image data from the server 10 (S50). In detail, the first client terminal 20 provides a server list through the screen, and connects to the selected server 10 as one is selected from the server list. Subsequently, medical image data is received from the selected server. The received medical image data includes, as described above, a field SOI indicating the start of an image file, an EEO field indicating the end of an image file, a user field for inserting medical information, and a compressed image data. And an image field (IMAGE FILED) for inserting (Compressed data). In particular, the user field EXMIF is a field APP3 indicating the start of the user field EXMIF containing medical information, a data length indicating the length of the user field EXMIF, and a user field EXMIF. A header field (EXMIF header), and a data field (data) including medical information.

The decoder 23 of the first client terminal 20 decodes the received medical image data (S51).

The extractor 25 of the first client terminal 20 extracts medical information from the decoded medical image data (S52).

Subsequently, the image data viewer 28 of the first client terminal 20 simultaneously reproduces the image file of the decoded medical image data and the medical information extracted by the extractor 25 on the screen (S53). Here, the image file includes a plurality of image frames, and the graphical user interface (GUI) displays the plurality of images in units of frames on the corresponding display window.

For example, the image data viewer 28 may display a plurality of image frames by dividing them on the screen and displaying them. As one of the plurality of reproduced image frames is selected, the image data viewer 28 enlarges and displays the selected image frames on the screen. can do.

Subsequently, an annotation inputted according to the operation of the annotation generator 27 is inserted into the user field EXMIF of the medical image data, and the transmitter 22 of the first client terminal 20 includes the medical information and the image file. The annotated medical image data is uploaded to the server 10.

As another example, the transmitter 22 of the first client terminal 20 further includes watermarking information for digital rights management in the medical image data into which the medical information and the image file are inserted. Peer-to-peer (P2P) may be transmitted to the terminal 30.

In the present invention, the medical information inserted into the user field EXMIF corresponds to the meta information of the medical image data along with basic information including a file name, size (byte), type, resolution, and creation time (shooting time). As a result, the medical information generator 26 and the encoder 24 included in the first client terminal 20 generate medical image data so that the medical information is processed as meta information.

While the preferred embodiments of the present invention have been described so far, those skilled in the art may implement the present invention in a modified form without departing from the essential characteristics of the present invention.

Therefore, the embodiments of the present invention described herein are to be considered in descriptive sense only and not for purposes of limitation, and the scope of the present invention is shown in the appended claims rather than the foregoing description, and all differences within the scope are equivalent to the present invention. Should be interpreted as being included in.

Although the preferred embodiments of the present invention have been described above by way of example, the scope of the present invention is not limited to these specific embodiments, and may be appropriately changed within the scope described in the claims.

Claims (37)

1. In the medical data processing apparatus of the client terminal to look at the image taken by the capsule endoscope,

   An image receiver configured to receive an image captured by the capsule endoscope;

   A viewer displaying a medical image received from the image receiving unit;

   An annotation generator for generating an annotation using at least one of a text and a voice of the medical image displayed on the viewer;

   A first field indicating the start of the image file, a second field indicating the end of the image file, an image file of one or more medical images selected from the medical images displayed on the viewer, and an annotation input by the annotation generator, respectively A medical data generator for generating one medical data including a user field correspondingly recorded;

   A medical data exporting unit configured to export the medical data generated by the medical data generating unit to an external device;

   Medical data processing apparatus of the client terminal, characterized in that configured to include.
2. The method of claim 1,

   And a medical record receiver configured to receive a medical record including a previous diagnosis record of the examinee of the medical image from a patient management system server;

   Displaying the medical record together with the medical image on the viewer;

   And a medical record in a user field of the medical data generated by the medical data generating unit.
3. The method of claim 2,

   And the user field includes a final medical diagnosis (diagnosis) by a diagnoser.
4. The method according to any one of claims 1 to 3,

   The viewer may further display one or more image memory bags for selecting and storing the displayed medical images for each group, and the medical data is generated for the medical images stored in the image memory bags. Medical data processing apparatus of the client terminal.
5. The method according to any one of claims 1 to 3,

   And the medical data generating unit is capable of modifying medical data already generated.
6. The method according to any one of claims 1 to 3,

   And the medical data are generated and generated for each group stored in the image storage bag.
7. The method according to any one of claims 1 to 3,

   A medical data processing apparatus of a client terminal further comprising a medical data caller for calling and receiving medical data.
8. The method according to any one of claims 1 to 4,

   The viewer calls the medical data generated by the medical data generating unit, and displays the medical image included in the medical data along with any one or more of a suspected finding and a photographing time. Medical data processing device.
9. The method of claim 6,

   One or more switches are positioned around the image storage bag displayed on the viewer, and a button for selecting one or more of an annotation generation function and a peripheral image display is displayed by clicking on the switch. Data processing device.
10. The method of claim 6,

    And the viewer displays a position of a medical image stored in the image storage bag on a time bar.
11. The method of claim 6,

    One or more switches are positioned around the image storage bag displayed in the viewer, and the medical images stored in the image storage bag selected by clicking the switch are displayed as thumbnails, and the recorded voice is recorded for the medical image in which the voice annotation is generated. And a button for playing an annotation is displayed.
12. The method according to any one of claims 1 to 3,

    A medical certificate generator for automatically generating a medical certificate including a part of the medical image included in the medical data, an annotation input to each of the medical image, and a medical record of the examinee of the medical image;

    The medical data processing apparatus of the client terminal further comprising.
13. A recording medium storing medical data generated from a medical data processing apparatus of the client terminal according to any one of claims 1 to 3.
14. In the medical data processing method of the client terminal to look at the image taken by the capsule endoscope,

    A medical image receiving step of receiving a medical image photographed from a capsule endoscope;

    Playing the medical image on a viewer;

    An annotation generation step of generating and inputting an annotation while the medical image is reproduced;

    A first field indicating the start of the image file, a second field indicating the end of the image file, an image file of one or more medical images selected from the medical images displayed on the viewer, and an annotation input by the annotation generator, respectively A medical data generation step of generating one medical data including a user field correspondingly recorded;

    A medical data export step of exporting the medical data generated by the medical data generator to an external device;

    Medical data processing method of a client terminal comprising a.
15. The method of claim 14,

    Storing the selected medical image selected from the medical images in at least one image memory bag;

    The medical data generating step of the medical data processing method of the client terminal, characterized in that for generating medical data for the medical image stored in the image storage bag.
16. The method of claim 14 or 15, wherein the method

    A medical record receiving step of receiving a medical record of the examinee of the medical image from a patient management system server;

    And the reproducing step displays the medical record and the medical image at the same time.
17. The method of claim 14 or 15, wherein the method

    A medical record receiving step of receiving a medical record of the examinee of the medical image from a patient management system server;

    The medical data generating step includes generating the medical data so that the medical record is recorded in the user field.
18. The method according to claim 14 or 15,

    And a medical certificate generating step of automatically generating a medical certificate by listing the medical image stored in the image memory bag, the annotation generated for the medical image, and the medical record.
19. The method according to claim 14 or 15,

    The medical data processing method of the client terminal, characterized in that the medical data is formed in a universal file format that can include both the image data field and the text data field.
20. A method for processing encoded medical image data by a client terminal,

    A first field indicating the start of an image file, a user field containing medical information, a second field indicating the start of the user field, a third field indicating the length of the user field, and a header field for reconfirming the user field And receiving the encoded medical image data including a fourth field including the image file from a server.

    Decoding the received medical image data;

    Extracting the medical information from the user field of the decoded medical image data;

    And reproducing the image file of the decoded medical image data and the extracted medical information on a screen.
21. The method of claim 20, wherein receiving the encoded medical image data comprises:

    Providing a server list through the screen;

    Connecting to the server selected from the server list;

    And receiving the medical image data from the server.
22. 21. The method of claim 20, wherein the user field includes the medical information consisting of at least one of a text and an audio file, and the user field includes an area into which an annotation for a reproduced image file is inserted on the screen. Medical image data processing method characterized in that.
23. The method of claim 20,

    The image file is a medical image data processing method comprising a plurality of image frames.
24. The method of claim 23,

    And playing the plurality of image frames by dividing the plurality of image frames on the screen, and expanding and reproducing the corresponding image frame as one of the reproduced image frames is selected.
25. The method of claim 20, wherein the medical information,

    And identification information of the device used for encoding the medical image data, the device user identification information, and identification information of the medical image data.
26. The method of claim 20,

    And transmitting, by the client terminal, the encoded medical image data to a peer-to-peer (P2P) to another client terminal.
27. The method of claim 26,

    The encoded medical image data includes watermarking information and encryption information for digital rights management.
28. The method of claim 20,

    The audio of the medical information is displayed while displaying at least one image frame on the first display window of the screen while displaying the text of the corresponding medical information on the second display window according to the reproduction of the extracted medical information. The method may further include outputting a sound through the audio player, and selecting any one of the image frames displayed on the first display window and moving and copying the file to the third display window for grouping at least one image frame. Medical image data processing method comprising the.
29. A first field indicating the start of an image file, a user field containing medical information, a second field indicating the start of the user field, a third field indicating the length of the user field, and a header field for reconfirming the user field And a server for holding encoded medical image data including a fourth field including the image file.

    A receiver for receiving the encoded medical image data from the server, a decoder for decoding the medical image data received at the receiver, an extractor for extracting the medical information from the user field of the medical image data decoded at the decoder; And a client terminal including an image data viewer for reproducing the image file of the decoded medical image data on the screen while reproducing the medical information extracted by the extractor on the screen. Data processing system.
30. The image data viewer of claim 29, wherein the image data viewer reproduces the medical information and the image file on the screen through a graphical user interface (GUI), wherein the graphical user interface displays at least one image frame according to the reproduction of the image file. A first display window to be displayed, a second display window to display text of corresponding medical information according to reproduction of the extracted medical information, and an image frame displayed on the first display window to select at least one image frame And a third display window for grouping, and a fourth display window for displaying a server list including a plurality of servers together with the server.
31. The method of claim 30, wherein the graphical user interface,

    An anatomical location map indicating the position of the image frame displayed on the first display window of the entire image frame, and an audio player as an operation tool for voice output of the audio file included in the extracted medical information; Medical image data processing system, characterized in that configured.
32. The method of claim 29,

    Receiving medical image data including water marking information and encryption information for digital rights management from a client terminal through a peer-to-peer (P2P), and the medical image included in the received medical image data And another client terminal for simultaneously reproducing the information and the image file on the screen.
33. The method of claim 29 or 32,

    The client terminal or the other client terminal, the medical image data processing system, characterized in that each having a generator for inserting the annotation (annotation) for the reproduced image file on the screen.
34. The method of claim 31, wherein the graphical user interface,

    And displaying the plurality of image frames by dividing the plurality of image frames on the first display window, and expanding the displayed image frames on the first display window as one of the displayed image frames is selected. .
35. 32. The method of claim 31 wherein the user field is

    And an area in which an annotation for the reproduced image file is inserted on the screen.
36. The method of claim 30, wherein the client terminal,

    A generator for inputting and inserting the medical information into the medical image data including the image file photographed by an implantable capsule endoscope; an encoder for encoding the medical image data into which the medical information is inserted by the generator; And a transmitter for uploading medical image data to the server.
37. The method of claim 30,

    The human body-type capsule endoscope for generating and transmitting an image signal in the human body, and a receiver for receiving and storing the image signal transmitted from the capsule endoscope as an image file, the image signal is the capsule endoscope is digestive organs in the human body It is generated by photographing the inside of the digestive organs while moving along, and the capsule endoscope continuously transmits the generated video signal using the human body as a conductor, and the client terminal is connected to the receiver to store the stored image file. Medical image data processing method and system characterized in that the read.

Images