CN116631566B - 一种基于大数据的医学影像报告智能生成方法 - Google Patents
一种基于大数据的医学影像报告智能生成方法 Download PDFInfo
- Publication number
- CN116631566B CN116631566B CN202310582362.5A CN202310582362A CN116631566B CN 116631566 B CN116631566 B CN 116631566B CN 202310582362 A CN202310582362 A CN 202310582362A CN 116631566 B CN116631566 B CN 116631566B
- Authority
- CN
- China
- Prior art keywords
- text
- medical image
- report
- model
- loss function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000003745 diagnosis Methods 0.000 claims abstract description 54
- 238000007781 pre-processing Methods 0.000 claims abstract description 13
- 230000006870 function Effects 0.000 claims description 47
- 239000013598 vector Substances 0.000 claims description 26
- 238000012549 training Methods 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 6
- 230000002776 aggregation Effects 0.000 claims description 3
- 238000004220 aggregation Methods 0.000 claims description 3
- 230000007246 mechanism Effects 0.000 claims description 3
- 238000003062 neural network model Methods 0.000 claims description 3
- 238000005457 optimization Methods 0.000 claims description 3
- 238000003058 natural language processing Methods 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 description 6
- 238000010276 construction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000002059 diagnostic imaging Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000005481 NMR spectroscopy Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 239000012633 leachable Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/186—Templates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/0895—Weakly supervised learning, e.g. semi-supervised or self-supervised learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/70—Labelling scene content, e.g. deriving syntactic or semantic representations
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Molecular Biology (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Databases & Information Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
Claims (3)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310582362.5A CN116631566B (zh) | 2023-05-23 | 2023-05-23 | 一种基于大数据的医学影像报告智能生成方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310582362.5A CN116631566B (zh) | 2023-05-23 | 2023-05-23 | 一种基于大数据的医学影像报告智能生成方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN116631566A CN116631566A (zh) | 2023-08-22 |
CN116631566B true CN116631566B (zh) | 2024-05-24 |
Family
ID=87620743
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202310582362.5A Active CN116631566B (zh) | 2023-05-23 | 2023-05-23 | 一种基于大数据的医学影像报告智能生成方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116631566B (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117112829B (zh) * | 2023-10-24 | 2024-02-02 | 吉林大学 | 医疗数据跨模态检索方法、装置和相关设备 |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111063410A (zh) * | 2019-12-20 | 2020-04-24 | 京东方科技集团股份有限公司 | 一种医学影像文本报告的生成方法及装置 |
CN112529857A (zh) * | 2020-12-03 | 2021-03-19 | 重庆邮电大学 | 基于目标检测与策略梯度的超声图像诊断报告生成方法 |
CN113539408A (zh) * | 2021-08-31 | 2021-10-22 | 北京字节跳动网络技术有限公司 | 一种医学报告生成方法、模型的训练方法、装置及设备 |
CN114220516A (zh) * | 2021-12-17 | 2022-03-22 | 北京工业大学 | 一种基于层级循环神经网络解码的脑ct医学报告生成方法 |
CN114743630A (zh) * | 2022-04-01 | 2022-07-12 | 杭州电子科技大学 | 一种基于跨模态对比学习的医学报告生成方法 |
CN114972929A (zh) * | 2022-07-29 | 2022-08-30 | 中国医学科学院医学信息研究所 | 一种医学多模态模型的预训练方法及装置 |
CN114973226A (zh) * | 2022-05-13 | 2022-08-30 | 上海大学 | 自监督对比学习自然场景中文本识别系统训练方法 |
CN115761314A (zh) * | 2022-11-07 | 2023-03-07 | 重庆邮电大学 | 一种基于提示学习的电商图文分类方法及系统 |
CN115909002A (zh) * | 2022-10-10 | 2023-04-04 | 南京莱斯电子设备有限公司 | 一种基于对比学习的图像翻译方法 |
CN116129141A (zh) * | 2023-01-13 | 2023-05-16 | 腾讯科技(深圳)有限公司 | 医学数据处理方法、装置、设备、介质和计算机程序产品 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112992308B (zh) * | 2021-03-25 | 2023-05-16 | 腾讯科技(深圳)有限公司 | 医学图像报告生成模型的训练方法及图像报告生成方法 |
CN113836333B (zh) * | 2021-09-18 | 2024-01-16 | 北京百度网讯科技有限公司 | 图文匹配模型的训练方法、实现图文检索的方法、装置 |
US20230154164A1 (en) * | 2021-11-12 | 2023-05-18 | Siemens Healthcare Gmbh | Self-supervised learning for artificial intelligence-based systems for medical imaging analysis |
-
2023
- 2023-05-23 CN CN202310582362.5A patent/CN116631566B/zh active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111063410A (zh) * | 2019-12-20 | 2020-04-24 | 京东方科技集团股份有限公司 | 一种医学影像文本报告的生成方法及装置 |
CN112529857A (zh) * | 2020-12-03 | 2021-03-19 | 重庆邮电大学 | 基于目标检测与策略梯度的超声图像诊断报告生成方法 |
CN113539408A (zh) * | 2021-08-31 | 2021-10-22 | 北京字节跳动网络技术有限公司 | 一种医学报告生成方法、模型的训练方法、装置及设备 |
CN114220516A (zh) * | 2021-12-17 | 2022-03-22 | 北京工业大学 | 一种基于层级循环神经网络解码的脑ct医学报告生成方法 |
CN114743630A (zh) * | 2022-04-01 | 2022-07-12 | 杭州电子科技大学 | 一种基于跨模态对比学习的医学报告生成方法 |
CN114973226A (zh) * | 2022-05-13 | 2022-08-30 | 上海大学 | 自监督对比学习自然场景中文本识别系统训练方法 |
CN114972929A (zh) * | 2022-07-29 | 2022-08-30 | 中国医学科学院医学信息研究所 | 一种医学多模态模型的预训练方法及装置 |
CN115909002A (zh) * | 2022-10-10 | 2023-04-04 | 南京莱斯电子设备有限公司 | 一种基于对比学习的图像翻译方法 |
CN115761314A (zh) * | 2022-11-07 | 2023-03-07 | 重庆邮电大学 | 一种基于提示学习的电商图文分类方法及系统 |
CN116129141A (zh) * | 2023-01-13 | 2023-05-16 | 腾讯科技(深圳)有限公司 | 医学数据处理方法、装置、设备、介质和计算机程序产品 |
Non-Patent Citations (3)
Title |
---|
"Multi-modal graph reasoning for structured video text extraction";Weitao Shi等;《Computers and Electrical Engineering》;第107卷;第1-9页 * |
"Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation";An Yan等;《arXiv》;第1-7页 * |
基于深度学习的图像描述研究;杨楠等;《红外与激光工程》;47(02);第1-8页 * |
Also Published As
Publication number | Publication date |
---|---|
CN116631566A (zh) | 2023-08-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110750959B (zh) | 文本信息处理的方法、模型训练的方法以及相关装置 | |
CN109544524A (zh) | 一种基于注意力机制的多属性图像美学评价系统 | |
CN111325323A (zh) | 一种融合全局信息和局部信息的输变电场景描述自动生成方法 | |
CN108416065A (zh) | 基于层级神经网络的图像-句子描述生成系统及方法 | |
CN107622104A (zh) | 一种文字图像识别标注方法及系统 | |
CN105654135A (zh) | 一种基于递归神经网络的图像文字序列识别系统 | |
CN109544442A (zh) | 基于双重对抗的生成式对抗网络的图像局部风格迁移方法 | |
Zhu et al. | Topic-guided attention for image captioning | |
CN112164446B (zh) | 一种基于多网络融合的医疗影像报告生成方法 | |
CN116631566B (zh) | 一种基于大数据的医学影像报告智能生成方法 | |
Yang et al. | Writing by memorizing: Hierarchical retrieval-based medical report generation | |
CN110110800A (zh) | 自动图像标注方法、装置、设备及计算机可读存储介质 | |
CN112307773B (zh) | 机器阅读理解系统的自定义问题数据自动生成方法 | |
CN115690072A (zh) | 基于多模态深度学习的胸片特征提取和疾病分类方法 | |
CN116311483B (zh) | 基于局部面部区域重构和记忆对比学习的微表情识别方法 | |
CN113821668A (zh) | 数据分类识别方法、装置、设备及可读存储介质 | |
CN112488963A (zh) | 一种用于农作物病害数据的增强方法 | |
CN117593666B (zh) | 一种极光图像的地磁台站数据预测方法及系统 | |
CN115862837A (zh) | 一种基于类型推理与语义约束的医学视觉问答方法 | |
CN117236335A (zh) | 基于提示学习的两阶段命名实体识别方法 | |
CN112905750A (zh) | 一种优化模型的生成方法和设备 | |
CN111368663A (zh) | 自然场景中静态面部表情识别方法、装置、介质及设备 | |
CN116433679A (zh) | 一种基于空间位置结构先验的内耳迷路多级标注伪标签生成与分割方法 | |
CN113434668B (zh) | 一种基于模型融合的深度学习文本分类方法及系统 | |
CN112765353B (zh) | 一种基于科研文本的生物医学学科分类方法及装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20240424 Address after: 518000 1104, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Applicant after: Shenzhen Hongyue Enterprise Management Consulting Co.,Ltd. Country or region after: China Address before: 400065 Chongwen Road, Nanshan Street, Nanan District, Chongqing Applicant before: CHONGQING University OF POSTS AND TELECOMMUNICATIONS Country or region before: China |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20240427 Address after: Room 111, 112, 113, No. 200-3 Yuangang Road, Tianhe District, Guangzhou City, Guangdong Province, 510515 Applicant after: Guangzhou hehao Medical Technology Co.,Ltd. Country or region after: China Address before: 518000 1104, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Applicant before: Shenzhen Hongyue Enterprise Management Consulting Co.,Ltd. Country or region before: China |
|
GR01 | Patent grant | ||
GR01 | Patent grant |