KR20220089004A - Digital pathology scanning method based on dicom service - Google Patents

Abstract

The present invention, the modality worklist server module 200 and the Daicom storage server module 100 of the hospital information system (EMR) interworking with, the modality worklist client module 310, hall slide scanner (WSS: Whole) A pathology scanning method of a Dicom service-based digital pathology scanning system 1000 of a Hall slide scanner 300 of different vendors having a Slide Scanner) module 320 and a local database 330, the Hall slide scanner (WSS: In the Whole Slide Scanner) module 320, extracting and recognizing label IDs of a plurality of slides of different patients, respectively (S100); retrieving information in the local database based on the label ID of the slide in the Whole Slide Scanner (WSS) module 320 (S200); loading, in the Whole Slide Scanner (WSS) module 320, slide prescription information corresponding to the label ID of the slide, received from the local database, into a memory (S300); In the Whole Slide Scanner (WSS) module 320, scanning a plurality of slides of different patients in bulk as a Whole Slide Image (WSI) (S400); In the Whole Slide Scanner (WSS) module 320, loading the hole slide image into a memory (S500); In the Whole Slide Scanner (WSS) module 320 , a die as a medical imaging standard including slide prescription information using the whole slide image and the slide prescription information corresponding to the label ID of the slide generating a hole slide image in a DICOM SM format (S600); and storing, in the Whole Slide Scanner (WSS) module 320, a hole slide image including the slide prescription information (S700); do.

Description

DIGITAL PATHOLOGY SCANNING METHOD BASED ON DICOM SERVICE

The present invention relates to a daicom service-based digital pathology scanning method, and more specifically, the problem of using different file formats for each digital pathology system company. Problems caused by scanning multiple slides at once, the slide prescription information including patient information is not included in the hole slide image scanned by the digital pathology system. Problems that cannot be managed because they are tied together, the inconvenience of having to manually input slide prescription information including patient information, problems that impair work productivity because it takes a lot of time and effort, and in some cases, an error occurs when a person enters manually It relates to a new daicom service-based digital pathology scanning method that solves the concern of erroneous medical judgment.

Pathology is a basic medical science that studies the state of a disease, the tissue structure of the diseased body, and changes in the form and function of organs in order to elucidate the principle of the disease.

In particular, digital pathology refers to an image-based information environment implemented with computer technology that manages information generated from digital slides. implemented by microscopy).

Digital pathology is recognized worldwide as one of the most promising areas of diagnostic medicine. This is because, in diagnosing and predicting cancer or other important diseases, which are generally the biggest enemies of modern health, it is possible to diagnose much faster, cheaper and more accurately than conventionally known diagnostic methods.

As such, it has begun to be in the spotlight as a promising diagnostic medicine field, but its R&D stage is still in its infancy. In Korea, research and development on the digital pathology system is minimal, and only the applicant's products exist. It is accelerating, and global companies are also in the early stages of launching products.

As a result, in the current Whole Slide Scanner (WSS), scanned slides are not standardized, and each company and foreign companies use independent formats, and radiology and imaging equipment (CT, MRI, CR, etc.) In a non-face-to-face environment that does not face the patient, unlike the workflow of

In the file format independent of each company, only slide ID (Slide ID) information recognized from slide label information exists, and detailed information on slide prescription including patient information does not exist. There have been problems in that they cannot be included and that slides made from the same sample cannot be managed because they are grouped in the same case (study).

In addition, since there is no slide prescription detailed information including patient information, patient and study information in the DICOM file could not be created normally. In order to create (convert) a Dadacom file, there was the inconvenience of having to manually input patient information and case (study) information, and it took a lot of time, impairing work productivity.

As a related patent document, in the applicant's Republic of Korea Patent No. 10-1830583 (registered on February 12, 2018, title of invention: WSI streaming method {METHOD OF STREAMING WSI}), "WSI streaming method according to the present invention is a web client A method for streaming WSI having different image compression format and tile size for each digital pathology vendor from a digital pathology server, comprising: acquiring a WSI from the digital pathology server; It includes a normalized tile definition step of defining a normalized tile having a minimum time cost; a judgment step comparing with the normalized tile; and a transforming step of performing an optimization transformation into the normalized tile."

As another related patent document, the applicant's Republic of Korea Patent No. 10-1967992 (registered on April 4, 2019, title of invention: Image compression method of digital pathology system {METHOD OF COMPRESSING IMAGE IN DIGITAL PATHOLOGY SYSTEM}), " The image compression method of the digital pathology system according to the present invention is a method of compressing a digital slide image having a first plane real image to an nth plane real image (n is a natural number greater than or equal to 2), wherein, for a block at the same location, the first An optimal block selection step of determining which block in the corresponding position of the first plane real image to the nth plane real image has the optimal focus; Forming a virtual optimal image in which only the optimal blocks are combined to form one plane image Step; Generating a descriptor for each block to form the first plane real image to the nth plane real image based on the virtual optimal image; The location information of the block and the descriptor for each block generating a first plane prediction image to an n-th plane prediction image that are most similarly out of focus from the virtual optimal image by using a second plane prediction image between the first plane real image and the first plane prediction image generating a first plane difference image and an n-th plane difference image between the n-th plane real image and the n-th plane prediction image; and compressing the first plane difference image to the n-th plane difference image; included." is disclosed.

However, in these recent R&D and related patent documents, only the technology for the WSI streaming method or compression method has been proposed, and like the present applicant, the problem of using different file formats for each company, the department of radiology and the On the other hand, in pathology, the problem caused by collectively scanning multiple slides of multiple patients in a non-face-to-face environment, the problem that the slide prescription information including patient information is not included in the hole slide image scanned by the digital pathology system, Due to this, slides made from the same sample are grouped in the same case (study) and cannot be managed, the inconvenience of having to manually input slide prescription information including patient information, a problem that takes a lot of time and effort and hinders work productivity, In some cases, there was no awareness of the concern about the possibility that an error occurred while a human was manually inputting it and made a wrong medical decision.

Republic of Korea Patent Registration No. 10-1830583 (Registered on February 12, 2018, title of invention: WSI streaming method {METHOD OF STREAMING WSI") Republic of Korea Patent No. 10-1967992 (registered on April 4, 2019, title of invention: image compression method of digital pathology system {METHOD OF COMPRESSING IMAGE IN DIGITAL PATHOLOGY SYSTEM})

The present invention was created to solve the above-mentioned problems, and the object of the present invention is to use different file formats for each digital pathology system company, and unlike radiology, in pathology, multiple patients in a non-face-to-face environment Problems caused by batch scanning of slides, the problem that slide prescription information including patient information is not included in the hole slide image scanned by the digital pathology system. Problems that cannot be managed because they are tied together, the inconvenience of having to manually input slide prescription information including patient information, problems that impair work productivity by taking a lot of time and effort, It is to provide a new daicom service-based digital pathology scanning method that solves the concern of erroneous medical judgment.

A daicom service-based digital pathology scanning method according to the present invention for achieving the above object is a hospital information system (EMR) modality worklist server module (Modality Worklist Server Module, 200) and a daicom storage server module (DICOM) Storage Server Module, 100), Modality Worklist Client Module (310), Hall Slide Scanner Module (WSS module: Whole Slide Scanner Module, 320) and local database (Local DB, 330) A pathology scanning method of the digital pathology scanning system 1000 based on the Dicom service of the hall slide scanners 300 of different vendors having a extracting and recognizing the label IDs of a plurality of slides (S100): In the Whole Slide Scanner (WSS) module 320, based on the label IDs of the slides, information is stored in the local database Searching (S200): In the Whole Slide Scanner (WSS) module 320, loading the slide prescription information received from the local database, corresponding to the label ID of the slide, into a memory (S300) ; In the Whole Slide Scanner (WSS) module 320, scanning a plurality of slides of different patients in bulk as a Whole Slide Image (WSI) (S400); In the Whole Slide Scanner (WSS) module 320, loading the hole slide image into a memory (S500); the Whole Slide Scan (WSS) ner) in the module 320, using the hole slide image and the slide prescription information corresponding to the label ID of the slide, a DICOM SM format hole, which is a medical imaging standard including slide prescription information generating a slide image (S600); and storing, in the Whole Slide Scanner (WSS) module 320, a hole slide image including the slide prescription information (S700).

In addition, in the modality worklist client module 310, automatically requesting the slide prescription information for each reference time period through the background service to the modality worklist server module 200 (S800); In the modality worklist server module 200, searching for the requested slide prescription information and returning it to the modality worklist client module 310 (S810); and storing the returned slide prescription information in the local database 330 in advance in the modality worklist client module 310 (S820).

In addition, in the step (S200) of searching for information in the local database based on the label ID of the slide in the Whole Slide Scanner (WSS) module 320, the information is stored in the local database 330 in advance. If there is no stored slide prescription information, the local database 330 may include: requesting the modality worklist client module 310 for the slide prescription information; requesting the slide prescription information to the modality worklist server module 200 through the modality worklist client module 310; retrieving, in the modality worklist server module 200, the requested slide prescription information and returning it to the modality worklist client module 310; and storing, in the modality worklist client module 310 , the received slide prescription information in the local database 330 .

In addition, the hall slide scanner 300 includes a daicom transmission module 340 and transmits the hall slide image including the slide prescription information through the daicom transmission module 340 to the daicom storage server module. Transmitting to (100) (S900); and storing, in the daicom storage server module 100, a hole slide image including the received slide prescription information (S910).

In addition, the slide prescription information includes patient information and case information, and the daicom storage server module 100 manages a hall slide image including the stored and received slide prescription information, but stores the slide prescription information. Based on this, it is stored and managed separately for each different patient and for each case of a specific patient.

In addition, by searching for the slide prescription information according to the inquiry of the hospital medical personnel accessing the DYCOM storage server module 100, the hall slide image corresponding thereto is inquired and viewed through the general-purpose DYCOM viewer and information It further includes; a step of writing (S920).

In addition, in the Whole Slide Scanner (WSS) module 320, a medical imaging standard including slide prescription information by using the hole slide image and the slide prescription information corresponding to the label ID of the slide. In the step (S600) of converting and generating the hole slide image in the DICOM SM format, the hole slide image is the image of the DICOM, and the hole slide image for the same sample is the same at different magnifications. As a series of daicom, the hole slide image for the same slide prescription for a specific patient is matched with the daicom study.

According to the improved daicom service-based digital pathology scanning method according to the present invention,

First, the modality worklist server module 200 and the Daicom storage server module 100 of the hospital information system (EMR) interworking with the modality worklist client module 310, the hall slide scanner (WSS: Whole Slide Scanner) ) In the hall slide scanner 300 having the module 320 and the local database 330, slide prescription information including patient information is automatically imported, and then the slide ID is automatically matched through DICOM SM Slide Microscopy. ), it is possible to automatically create a file and transmit it to the daicom storage server module 100 in daicom format.

Second, through the proposed workflow, the productivity of data management tasks can be maximized by automatically generating and transmitting slide data scanned by the hall slide scanner as a daicom SM file.

Third, the slide prescription information includes patient information and case information, and the daicom storage server module 100 manages a hall slide image including the stored and received slide prescription information, but based on the slide prescription information, , it is possible to separately store and manage it differently for each different patient and for each case of a specific patient.

Fourth, by searching for slide prescription information according to the inquiry of hospital medical personnel accessing the daicom storage server module 100, the hall slide image corresponding thereto is inquired and viewed through the general-purpose existing daicom viewer. It is possible to enter information.

1 schematically shows a daicom service-based digital pathology scanning system and method according to the present invention.
2 schematically shows an image of a hole slide according to the present invention.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Prior to this, the terms or words used in the present specification and claims should not be construed as being limited to conventional or dictionary meanings, and the inventor should properly understand the concept of the term in order to best describe his invention. Based on the principle that can be defined, it should be interpreted as meaning and concept consistent with the technical idea of the present invention.

Accordingly, the embodiments described in this specification and the configurations shown in the drawings are only the most preferred embodiment of the present invention and do not represent all the technical spirit of the present invention, so at the time of the present application, various There may be equivalents and variations.

(Diacom service-based digital pathology scanning system and method)

Fig. 1 schematically shows a daicom service-based digital pathology scanning system and method according to the present invention, and Fig. 2 schematically shows a hall slide image according to the present invention.

1 and 2, the daicom service-based digital pathology scanning system according to the present invention includes the daicom storage server module 100 and the modality worklist server module 200 of the hospital information system (EMR). , including a hole slide scanner 300 of different vendors.

Here, the hospital information system refers to, for example, an EMR (Electronic Medical Record) system, and is a system for computerizing medical records among hospital treatment support tasks. Medical records are often processed manually. Electronic medical records (EMR) have evolved from methods of archiving records on optical disks or CDs in terms of paperless recording methods. connected and used for treatment. Electronic Medical Record (EMR) has the effect of promptly processing work and reducing manpower and cost, enabling rapid delivery and utilization of records, and improving services such as reducing patient waiting time.

Here, the Whole Slide Scanner (WSS) 300 interworks with the Daicom storage server module 100 and the modality worklist server module 200 of the hospital information system (EMR), and the modality worklist client It includes a module 310 , a hole slide scanner module 320 , a local database 330 , and a daicom transmission module 340 .

Next, a pathology scanning method of the daicom service-based digital pathology scanning system 1000 will be described.

First, in the Whole Slide Scanner (WSS) module 320, label IDs of a plurality of slides of different patients are extracted and recognized (S100). The Whole Slide Scanner (WSS) module 320 searches for information in a local database based on the label ID of the slide (S200). In the Whole Slide Scanner (WSS) module 320, slide prescription information corresponding to the label ID of the slide, received from the local database, is loaded into the memory (S300).

Here, the label ID of the slide can be recognized by using OCR or image processing technology, or by reading the barcode technology or QR code stamped or attached to the slide.

In this case, while going through the pre-processing steps of the digital slide image: Grossing, Waxing, Paraffin Blocking, Sectioning, and Staining, manual barcode or QR code attachment at each step is performed. At this time, there is a concern that a human error may occur, the captured image of the pre-processing step of the digital pathology system and the final result, the digital slide image, are matched through image pattern analysis at the time of acquisition to determine whether or not to match the human error. It can be prevented.

Meanwhile, the Whole Slide Scanner (WSS) module 320 scans a plurality of slides of different patients in bulk as a whole slide image (WSI) (S400). Here, the hole slide image is digitally scanned at a plurality of magnifications of the same pathological specimen at various magnifications, such as low magnification, medium magnification, and high magnification, as shown in FIG. 2 . For example, when the same sample is digitally scanned as a thumbnail image (low magnification), a medium zoom image (medium magnification), and a baseline image (highest magnification) with a low magnification, the number of tiles of the same size is output differently.

Through this hall slide image, according to the digital pathology system inquiry of hospital medical personnel, the same specimen is enlarged or reduced to view the entire specimen, and the specimen is medically judged.

In the digital pathology system, when a digital slide image (WSI, Whole Slide Image) is created and stored, if the thickness of each part of the sample is not uniform, it is scanned and stored by adjusting the focus instead of a single focus. In the case of an image having various z-planes with different focal points, the amount of data increases in proportion to the plane. In the case of digital slide images, even a single plane image is basically very large in size, resulting in a lot of cost and time for storage and transmission. This very cost and time was consumed, which became many obstacles in digitizing the pathological image data. A technique for solving this was disclosed in Korean Patent Registration No. 10-1849458.

Next, in the Whole Slide Scanner (WSS) module 320, the hole slide image is loaded in the memory (S500), and the above-described hole slide image and slide prescription information corresponding to the label ID of the slide is used to generate a hole slide image in DICOM SM format, which is a medical imaging standard including slide prescription information (S600). Furthermore, the Whole Slide Scanner (WSS) module 320 stores a hole slide image including slide prescription information (S700).

In addition, in the modality worklist client module 310, the slide prescription information is converted to the modality worklist by the reference time period through the background service, for example, based on the reservation information or real-time slide prescription information that had today's slide prescription instruction. It automatically makes a request to the server module 200 (S800).

In contrast, the modality worklist server module 200 retrieves the requested slide prescription information and returns the slide prescription information to the modality worklist client module 310 ( S810 ). The modality worklist client module 310 pre-stores the returned slide prescription information in the local database 330 (S820).

At this time, in the Whole Slide Scanner (WSS) module 320, based on the label ID of the slide, in the step S200 of searching for information in the local database, the slide prescription stored in advance in the local database 330 If no information is available, proceed as follows.

First, the local database 330 requests the modality worklist client module 310 for the slide prescription information, and transmits the slide prescription information to the modality worklist server module through the modality worklist client module 310 making a request to (200), and returning the requested slide prescription information to the modality worklist client module (310) by the modality worklist server module (200); and the modality worklist client module 310 stores the returned corresponding slide prescription information in the local database 330 .

On the other hand, the hall slide scanner 300 includes the daicom transmission module 340 and transmits the hall slide image including slide prescription information to the daicom storage server module 100 through the daicom transmission module 340 . transmit (S900). The daicom storage server module 100 stores the hole slide image including the received slide prescription information (S910).

When storing a hall slide image (WSI, Whole Slide Image), it is linked with the reservation information of the electronic medical record system, and depending on the visit time, a hall slide image that will be used in the short term, such as those who will visit today or this week. is usually stored in high-speed, high-priced short-term storage, and if the visit period is undecided or the visit period is mid- to long-term, the hall slide image is usually stored in low-cost, high-capacity mid- to long-term storage with a slow speed. Depending on the time of visit, move from low-cost, high-capacity, high-capacity, short-term storage to high-priced, fast, short-term storage, or after visiting and viewing the slide image of the hall, move back from high-priced, high-capacity short-term storage to low-cost, high-capacity, mid/long-term storage It is possible to move

Here, the slide prescription information includes patient information and case information, and the daicom storage server module 100 manages a hall slide image including the stored and received slide prescription information, but based on the slide prescription information, , it becomes possible to separately store and manage it differently for each different patient and for each case of a specific patient.

Here, the structure of a DICOM study, which is a general medical imaging standard, is: Study-Series-Image. In the Whole Slide Scanner (WSS) module 320 according to the present invention, a die, which is a medical imaging standard including slide prescription information, using a hole slide image and slide prescription information corresponding to the label ID of the slide In the step (S600) of converting and generating the hole slide image in the DICOM SM format, each hole slide image is a DICOM image, a bundle of a plurality of hole slide images for the same sample at different magnifications is a series of Dicom, and a plurality of hole slide image bundles for the same slide prescription for a specific patient are matched as a study of Dicom. In this way, it is possible to inquire and browse in the general-purpose, existing, and generally used daicom viewers (PACS viewers) of different vendors.

In addition, by searching for slide prescription information according to the inquiry of hospital medical personnel (doctors, nurses, radiology department personnel, pathologists, pathologists, etc.) connected to the daicom storage server module 100, the hall slides corresponding thereto It is possible to inquire, browse, and enter information through the daicom viewer of other vendors that are generally used for general purpose (S920)

As described above, although the present invention has been described with reference to limited embodiments and drawings, the present invention is not limited thereto, and the technical spirit of the present invention and the following by those of ordinary skill in the art to which the present invention pertains. It goes without saying that various modifications and variations are possible within the scope of equivalents of the claims to be described.

100...DAICOM STORAGE SERVER MODULE
200...Modality Worklist Server Module
300...hole slide scanner
310...Modality Worklist Client Module
320...hole slide scanner module
330...local database
340...Dicom Transmission Module
1000...DAICOM service based digital pathology scanning system

Claims (7)

Modality worklist client module 310 interworking with the modality worklist server module 200 and the Daicom storage server module 100 of the hospital information system (EMR), a Whole Slide Scanner (WSS) module In the pathology scanning method of the daicom service-based digital pathology scanning system 1000 of the hall slide scanner 300 of different vendors having (320) and a local database (330),
In the Whole Slide Scanner (WSS) module 320, extracting and recognizing label IDs of a plurality of slides of different patients, respectively (S100);
retrieving information in the local database based on the label ID of the slide in the Whole Slide Scanner (WSS) module 320 (S200);
loading, in the Whole Slide Scanner (WSS) module 320, slide prescription information corresponding to the label ID of the slide, received from the local database, into a memory (S300);
In the Whole Slide Scanner (WSS) module 320, scanning a plurality of slides of different patients in bulk as a Whole Slide Image (WSI) (S400);
In the Whole Slide Scanner (WSS) module 320, loading the hole slide image into a memory (S500);
In the Whole Slide Scanner (WSS) module 320 , a die as a medical imaging standard including slide prescription information using the whole slide image and the slide prescription information corresponding to the label ID of the slide converting and generating a hole slide image in DICOM SM format (S600); and
In the Whole Slide Scanner (WSS) module 320, storing a hole slide image including the slide prescription information (S700);
Dicom service-based digital pathology scanning method.
The method of claim 1,
automatically requesting, in the modality worklist client module 310, the slide prescription information for each reference time period through the background service to the modality worklist server module 200 (S800);
In the modality worklist server module 200, searching for the requested slide prescription information and returning it to the modality worklist client module 310 (S810); and
In the modality worklist client module 310, storing the returned slide prescription information in the local database 330 in advance (S820); including;
Dicom service-based digital pathology scanning method.
3. The method of claim 2,
In the Whole Slide Scanner (WSS) module 320 , based on the label ID of the slide, in step S200 , the slide stored in advance in the local database 330 is searched for information in the local database. In the absence of prescribing information,
The local database 330 may include: requesting the modality worklist client module 310 for the slide prescription information;
requesting the slide prescription information to the modality worklist server module 200 through the modality worklist client module 310;
retrieving, in the modality worklist server module 200, the requested slide prescription information and returning it to the modality worklist client module 310; and
Storing, in the modality worklist client module 310, the received slide prescription information in the local database 330;
Dicom service-based digital pathology scanning method.
4. The method of claim 3,
The Hall slide scanner 300 includes a daicom transmission module 340,
transmitting the hole slide image including the slide prescription information to the DYCOM storage server module 100 through the DYCOM transmission module 340 (S900); and
In the daicom storage server module 100, storing the hole slide image including the received slide prescription information (S910); further comprising
Dicom service-based digital pathology scanning method.
5. The method of claim 4,
The slide prescription information includes patient information and case information,
The daicom storage server module 100 manages a hall slide image including the stored and received slide prescription information, but based on the slide prescription information, it is different for each different patient and for each case of a specific patient. characterized in that it is stored and managed separately,
Dicom service-based digital pathology scanning method.
6. The method of claim 5,
By searching for the slide prescription information according to the inquiry of the hospital medical personnel accessing the DYCOM storage server module 100, the hall slide image corresponding thereto is inquired and read through the general-purpose DYCOM viewer, and information is entered. Step (S920); further comprising,
Dicom service-based digital pathology scanning method.
7. The method of claim 6,
In the Whole Slide Scanner (WSS) module 320 , a die as a medical imaging standard including slide prescription information using the whole slide image and the slide prescription information corresponding to the label ID of the slide In the step (S600) of converting and generating a hole slide image in DICOM SM format,
The hole slide image is an image of the DICOM, the hole slide images for the same sample at different magnifications are a series of the DICOM, and the hole slide image for the same slide prescription for a specific patient is the Characterized in matching with a study of Daicom,
Dicom service-based digital pathology scanning method.

Images