TWM570689U - Automatic detection, identification and report generation system for breast calcification - Google Patents

Automatic detection, identification and report generation system for breast calcification

Info

Publication number
TWM570689U
TWM570689U TWM570689U TW M570689 U TWM570689 U TW M570689U TW M570689 U TWM570689 U TW M570689U
Authority
TW
Taiwan
Prior art keywords
calcification
breast
distribution
neural network
identification
Prior art date
Application number
Other languages
Chinese (zh)
Publication date

Links

Abstract

本新型提供一種乳房鈣化之自動檢測、辨識及報告產生系統,其包括:一伺服器,其具有一儲存乳房鈣化形態及分佈的乳房X光攝影圖檔資料庫;一類神經網路學習模組;一乳房鈣化辨識及標示模組;及一資料輸出模組。The invention provides an automatic detection, identification and report generation system for breast calcification, comprising: a server having a breast X-ray image file database for storing breast calcification morphology and distribution; a neural network learning module; A breast calcification identification and labeling module; and a data output module.

Description

乳房鈣化之自動檢測、辨識及報告產生系統Automatic detection, identification and report generation system for breast calcification

本新型係關於乳房鈣化之檢測領域。特定言之,本新型係關於乳房鈣化之自動檢測、辨識及報告產生系統。This new type relates to the field of detection of breast calcification. In particular, the present invention relates to an automatic detection, identification and report generation system for breast calcification.

乳房鈣化是指乳房X光攝影看到的鈣化白點,鈣化現象會發生在細胞死亡、發炎組織、疤痕組織或是癌組織中,鈣化是一種影像呈現,並非特定疾病。乳房鈣化大多屬於良性疾病,但也有可能是乳癌,有四分之一的乳癌患者檢查發現鈣化,其微小鈣化點沒有特定外觀,一般認為是乳癌細胞或其分泌物壞死後造成。鈣化點顆粒間形狀越相似一致,越趨近圓形,或卵圓形(punctate)其良性機會越高;形狀越不規則(irregular)、線狀(linear)或分枝狀(branching)表現,或鈣化與鈣化之間差異性大(多樣性,pleomorphic)或形似乳管形狀(模鑄狀,casting)的微小鈣化,其為惡性的機率越高。 在乳房X光攝影中,X光可以穿透的部分會呈現灰黑色,X光無法穿透的部分,會呈現白色。我們可以利用乳房X光攝影,來尋找乳房中的腫瘤及惡性鈣化。如果乳腺組織較緻密,乳房X光攝影片子呈現白色一片,尋找其中的白色鈣化點,相對上較困難。隨著年齡增長,乳腺退化,在年紀大的婦女,暗色的脂肪組織會慢慢取代白色的乳腺,鈣化點會較易於辨認。目前乳房X光攝影影像中鈣化點的辨認及惡性的判斷須靠醫師的經驗。 因此,仍有需要開發乳房鈣化之自動檢測,減少因醫師經驗差異產生之誤差,或因閱片太快而遺漏。Breast calcification refers to the calcified white spots seen by mammography. Calcification can occur in cell death, inflamed tissue, scar tissue or cancerous tissue. Calcification is an image presentation, not a specific disease. Breast calcification is mostly a benign disease, but it may also be breast cancer. A quarter of breast cancer patients have been found to have calcification, and their microcalcifications have no specific appearance. They are generally thought to be caused by necrosis of breast cancer cells or their secretions. The more similar the shape of the calcification point is, the closer to the circle, or the higher the benign chance of punctate; the more irregular, linear or branching of the shape, Or a large difference between calcification and calcification (pleomorphic) or microcalcification in the shape of a milk duct, which is more likely to be malignant. In mammography, the part that X-rays can penetrate will appear grayish black, and the part that X-rays cannot penetrate will appear white. We can use mammography to look for tumors and malignant calcification in the breast. If the breast tissue is dense, the mammogram is white, and it is relatively difficult to find the white calcification point. With age, the mammary gland is degraded. In older women, dark adipose tissue will slowly replace the white mammary gland, and calcification will be easier to identify. At present, the identification and malignant judgment of calcification points in mammography images depends on the experience of physicians. Therefore, there is still a need to develop automatic detection of breast calcification, to reduce errors due to differences in physician experience, or to miss due to reading too fast.

本新型提供一種乳房鈣化之自動檢測、辨識及報告產生系統,其包括: 一伺服器,其具有一儲存乳房鈣化形態及分佈的乳房X光攝影圖檔資料庫; 一類神經網路學習模組,其基於乳房鈣化形態及分佈特徵以類神經網路訓練模型; 一乳房鈣化辨識及標示模組,其利用訓練好的模型即時自動標示出鈣化位置、形態及分佈,並將結果輸入該模組;及 一資料輸出模組,將乳房鈣化位置、大小、形態及分佈與數目輸出形成檢測結果報告。 在一些實施態樣中,該伺服器儲存有不同類型的乳房X光攝影之乳房鈣化形態及分佈資訊。該等不同類型的乳房鈣化形態及分佈資訊係收集自多個病人,以建立大數據。該等資訊係收集自各醫院之病患資料。 一般而言,鈣化點顆粒間形狀越相似一致,越趨近圓形,或卵圓形(punctate),其良性機會越高。鈣化點顆粒越不規則(irregular)、線狀(linear)或分枝狀(branching)表現,或鈣化與鈣化之間差異性大(多樣性,pleomorphic)或形似乳管形狀(模鑄狀,casting)的微小鈣化,其為惡性的機率越高。良性鈣化點影像表現為形狀多為圓形、爆米花狀、茶杯形分布較均勻對稱大於1mm鈣化點。惡性鈣化點影像表現為具有不規則的外型大小,而且幾乎都小於0.5mm(故稱為微小鈣化點),且群聚於5mm多於5個點,如呈現分岔形(branching)、線形(linear)等,在分佈上成促聚集(cluster)或乳管形成線狀分佈,有時可能合併出現鈣化點附近的乳腺產生密度變化。美國放射線醫學會針對乳房鈣化的形態及分佈提供判斷為良性或惡性的標準(http://www.radiologyassistant.nl/en/p4793bfde0ed53/breast-calcifications-differential-diagnosis.html)。 在一些實施態樣中,使用類神經網路學習模組基於乳房鈣化形態及分佈特徵以類神經網路訓練模型。該訓練模型先進行機器學習辨識是否為乳房鈣化點,再經過深度神經網路學習自行學習找出乳房鈣化點圖像的特徵值以辨識鈣化點。 類神經網路是一種模仿生物神經網路(動物的中樞神經系統,特別是大腦的結構和功能的數學模型或計算模型,用於對函式進行估計或近似。藉由深度神經網路學習模組,將乳房鈣化特徵進行訓練模型以達到辨識乳房鈣化特徵。在一具體實施例,該類神經網路為卷積神經網路(Convolutional Neural Networks,CNN)學習模組。CNN是一種前饋神經網絡,它的人工神經元可以響應一部分覆蓋範圍內的周圍單元,對於圖像處理有出色表現,利用CNN可辨識鈣化形態及分佈圖像。 在一些實施態樣中,乳房鈣化辨識及標示模組利用訓練好的模型即時自動標示出鈣化位置、形態及分佈,並將結果輸入該模組。 在一些實施態樣中,資料輸出模組,將乳房鈣化位置、大小、形態及分佈與數目輸出形成檢測結果報告。美國放射線醫學會為了讓乳房檢查報告有一致性,發展乳房造影報告與資料解讀系統(BI-RADS),可將乳房X光攝影的結果,做標準化的判讀。前述BI-RADS系統之判讀標準如下: BI-RADs(0):需要額外的影像評估(例如:乳房超音波),或需要之前的乳房X光攝影結果進行比較。 BI-RADs(1):陰性。無其他建議,乳房無異常或可疑的鈣化現象。 BI-RADs(2):良性發現。乳房X光攝影結果正常,但伴隨著良性的發現,例如鈣化纖維瘤、分散性鈣化組織、含有脂肪的病兆(例如油脂囊腫、脂肪瘤、乳腺囊腫)、乳房內淋巴結、血管鈣化。 BI-RADs(3):可能為良性的發現。建議短期內進行追蹤檢查,以確保沒有進一步變化。 BI-RADs(4):懷疑可能是不正常組織,建議進行切片檢查。發現非典型惡性組織,和BI-RADs(3)的結果相比,這類組織有較高的可能會發展為惡性。 BI-RADs(5):高度懷疑為惡性組織,應採取適當的行動。 BI-RADs(6):已生檢且確診為惡性組織。 該資料輸出模組基於上述BI-RADs形成檢測結果報告。The invention provides an automatic detection, identification and report generation system for breast calcification, comprising: a server having a breast X-ray image file database for storing breast calcification morphology and distribution; a neural network learning module, The neural network training model is based on the morphological and distribution characteristics of the breast; a breast calcification identification and labeling module, which automatically displays the position, shape and distribution of the calcification by using the trained model, and inputs the result into the module; And a data output module, the breast calcification position, size, shape and distribution and number output form a test result report. In some embodiments, the server stores breast calcification patterns and distribution information for different types of mammography. These different types of breast calcification patterns and distribution information are collected from multiple patients to establish big data. This information is collected from patient data in each hospital. In general, the more consistent the shape of the calcification particles, the closer to a circle, or the punctate, the higher the benign chance. The more irregular, linear or branching of calcification particles, or the greater the difference between calcification and calcification (pleomorphic) or the shape of a milk duct (casting, casting) The small calcification, the higher the chance of being malignant. The image of benign calcification showed that the shape was mostly round, popcorn-like, and the teacup-shaped distribution was more uniform and symmetric than the calcification point of 1 mm. Malignant calcification images appear to have an irregular size, and are almost all smaller than 0.5 mm (so called microcalcifications), and clustered at 5 mm more than 5 points, such as branching, linear (linear), etc., in the distribution to promote clustering or milk duct formation linear distribution, sometimes combined with the occurrence of density changes in the mammary glands near the calcification point. The American Society of Radiology provides criteria for determining the form and distribution of breast calcification as benign or malignant (http://www.radiologyassistant.nl/en/p4793bfde0ed53/breast-calcifications-differential-diagnosis.html). In some embodiments, a neural network learning module is used to train a neural network based model based on breast calcification morphology and distribution characteristics. The training model first performs machine learning to identify whether it is a breast calcification point, and then through deep neural network learning to learn to find the characteristic value of the breast calcification point image to identify the calcification point. A neural network is a mathematical model or computational model that mimics the biological neural network (the central nervous system of animals, especially the structure and function of the brain, for estimating or approximating functions. By deep neural network learning model In the group, the breast calcification feature is trained to achieve the identification of breast calcification characteristics. In one embodiment, the neural network is a Convolutional Neural Networks (CNN) learning module. CNN is a feedforward neural network. The network, its artificial neurons can respond to a part of the coverage of the surrounding units, for the image processing has excellent performance, using CNN to identify the calcification morphology and distribution images. In some implementations, the breast calcification identification and labeling module The trained model is used to automatically indicate the location, shape and distribution of calcification, and the results are input into the module. In some implementations, the data output module forms the position, size, shape, distribution and number of breast calcification. Test results report. The American Society of Radiology developed a mammography report in order to make the breast examination report consistent. The data interpretation system (BI-RADS) can be used to standardize the interpretation of mammography. The interpretation criteria of the aforementioned BI-RADS system are as follows: BI-RADs(0): Additional image evaluation is required (eg: Breast ultrasound), or need to compare previous mammography results. BI-RADs (1): negative. No other suggestion, no abnormalities or suspicious calcification of the breast. BI-RADs (2): benign findings. X-ray results are normal, but with benign findings such as calcified fibroids, dispersible calcified tissue, signs of fat (eg, oil cysts, lipoma, breast cysts), intramammary lymph nodes, vascular calcification. BI-RADs (3): It may be a benign discovery. It is recommended to conduct a follow-up examination in the short term to ensure that there are no further changes. BI-RADs(4): Suspected that it may be abnormal tissue, it is recommended to perform biopsy. Atypical malignant tissue is found, and BI Compared with the results of RADs(3), such organizations have a higher probability of developing malignancy. BI-RADs(5): Highly suspected of malignant tissue, appropriate action should be taken. BI-RADs(6): Health check and diagnosis of malignancy Weaving. The output of module data report is formed based on the detection result of BI-RADs.

參照第一圖,本新型系統包含4個元件,分別為伺服器1、類神經網路學習模組2、乳房鈣化辨識及標示模組3及資料輸出模組4。伺服器1具有資料庫,儲存有不同類型的乳房X光攝影的乳房鈣化形態及分佈資訊。基於乳房鈣化形態及分佈特徵,以類神經網路學習模組2訓練模型。接著,乳房鈣化辨識及標示模組3利用訓練好的模型即時自動標示出鈣化位置、形態及分佈,並將結果輸入該模組。基於美國放射線醫學會針對乳房鈣化的形態及分佈提供判斷為良性或惡性的判讀標準,資料輸出模組4將乳房鈣化位置、大小、形態及分佈與數目輸出形成檢測結果報告。Referring to the first figure, the novel system comprises four components, namely a server 1, a neural network learning module 2, a breast calcification recognition and labeling module 3, and a data output module 4. The server 1 has a database for storing breast calcification patterns and distribution information of different types of mammography. Based on the calcification morphology and distribution characteristics of the breast, the neural network learning module 2 training model is used. Next, the breast calcification identification and labeling module 3 automatically displays the calcification position, shape and distribution using the trained model, and inputs the result into the module. Based on the American Radiological Medicine Association to provide a judging criteria for judging the morphology and distribution of breast calcification, the data output module 4 reports the position, size, shape, distribution and number of breast calcifications to form a test result report.

1‧‧‧伺服器1‧‧‧Server

2‧‧‧類神經網路學習模組 2‧‧‧ Neural Network Learning Module

3‧‧‧乳房鈣化辨識及標示模組 3‧‧‧ Breast calcification identification and labeling module

4‧‧‧資料輸出模組 4‧‧‧ Data Output Module

第一圖係為一種乳房鈣化之自動檢測、辨識及報告產生系統的各個元件的連結示意圖。The first figure is a schematic diagram of the connection of various components of the automatic detection, identification and report generation system for breast calcification.

Claims (5)

一種乳房鈣化之自動檢測、辨識及報告產生系統,其包括: 一伺服器,其具有一儲存乳房鈣化形態及分佈的乳房X光攝影圖檔資料庫; 一類神經網路學習模組,其基於乳房鈣化形態及分佈特徵以類神經網路訓練模型; 一乳房鈣化辨識及標示模組,其利用訓練好的模型即時自動標示出鈣化位置、形態及分佈,並將結果輸入該模組;及 一資料輸出模組,將乳房鈣化位置、大小、形態及分佈與數目輸出形成檢測結果報告。An automatic detection, identification and report generation system for breast calcification, comprising: a server having a breast X-ray image file database for storing breast calcification morphology and distribution; a neural network learning module based on breast The calcification morphology and distribution characteristics are based on a neural network training model; a breast calcification identification and labeling module, which uses the trained model to automatically display the calcification position, shape and distribution, and input the result into the module; The output module reports the position, size, shape, distribution and number of breast calcifications to form a test result report. 如請求項1之系統,其中乳房鈣化形態及分佈的乳房X光攝影圖檔資料係收集自多個病人,以建立大數據。The system of claim 1, wherein the mammography profile of the breast calcification morphology and distribution is collected from a plurality of patients to establish big data. 如請求項1之系統,其中該類神經網路學習模組為卷積神經網路。The system of claim 1, wherein the neural network learning module is a convolutional neural network. 如請求項1之系統,其中乳房鈣化的形態及分佈判斷為良性或惡性的標準係採用美國放射線醫學會之標準。The system of claim 1, wherein the criteria for determining the morphology and distribution of breast calcification to be benign or malignant are based on the standards of the American Society of Radiological Medicine. 如請求項7之系統,其中乳房X光攝影的結果標準化的判讀係採用乳房造影報告與資料解讀系統(BI-RADS)。The system of claim 7, wherein the interpretation of the results of mammography is standardized using a Mammography Reporting and Data Interpretation System (BI-RADS).

Family

ID=

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI790689B (en) * 2021-07-21 2023-01-21 財團法人資訊工業策進會 Method and electric device for processing breast tomosynthesis images

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI790689B (en) * 2021-07-21 2023-01-21 財團法人資訊工業策進會 Method and electric device for processing breast tomosynthesis images

Similar Documents

Publication Publication Date Title
Milosevic et al. Early diagnosis and detection of breast cancer
Zhou et al. Weakly supervised 3D deep learning for breast cancer classification and localization of the lesions in MR images
Mohamed et al. A deep learning method for classifying mammographic breast density categories
Chaudhury et al. [Retracted] Effective Image Processing and Segmentation‐Based Machine Learning Techniques for Diagnosis of Breast Cancer
Berg et al. Breast Imaging Reporting and Data System: inter-and intraobserver variability in feature analysis and final assessment
Newell et al. Selection of diagnostic features on breast MRI to differentiate between malignant and benign lesions using computer-aided diagnosis: differences in lesions presenting as mass and non-mass-like enhancement
Berg Rationale for a trial of screening breast ultrasound: American College of Radiology Imaging Network (ACRIN) 6666
Liberman et al. Breast imaging reporting and data system (BI-RADS)
Kelly et al. Breast cancer detection: radiologists’ performance using mammography with and without automated whole-breast ultrasound
Hadjiiski et al. Improvement in radiologists’ characterization of malignant and benign breast masses on serial mammograms with computer-aided diagnosis: an ROC study
Moon et al. Tumor detection in automated breast ultrasound images using quantitative tissue clustering
Younis et al. [Retracted] Early Diagnosis of Breast Cancer Using Image Processing Techniques
Hadjiiski et al. Advances in computer-aided diagnosis for breast cancer
US20120257804A1 (en) Communicative cad system for assisting breast imaging diagnosis
Chaudhury et al. [Retracted] Breast Cancer Calcifications: Identification Using a Novel Segmentation Approach
Drukker et al. Computerized detection of breast cancer on automated breast ultrasound imaging of women with dense breasts
US20140375671A1 (en) Method, system, software and medium for advanced image-based arrays for analysis and display of biomedical information
Michaels et al. Assessment and management of challenging BI-RADS category 3 mammographic lesions
US20180053297A1 (en) Methods and Apparatuses for Detection of Abnormalities in Low-Contrast Images
Honda et al. Computer-aided diagnosis scheme for distinguishing between benign and malignant masses in breast DCE-MRI
Zhao et al. Reducing the number of unnecessary biopsies of US-BI-RADS 4a lesions through a deep learning method for residents-in-training: a cross-sectional study
Li et al. Clinical value of mammography in diagnosis and identification of breast mass
Simon et al. Accuracy of synthetic 2D mammography compared with conventional 2D digital mammography obtained with 3D tomosynthesis
Ortiz-Rodriguez et al. Breast cancer detection by means of artificial neural networks
Garcia et al. Evolution of imaging in breast cancer