JP7462624B2 - 深層学習に基づく超音波撮像ガイダンス並びに関連するデバイス、システム、及び方法 - Google Patents
深層学習に基づく超音波撮像ガイダンス並びに関連するデバイス、システム、及び方法 Download PDFInfo
- Publication number
- JP7462624B2 JP7462624B2 JP2021520363A JP2021520363A JP7462624B2 JP 7462624 B2 JP7462624 B2 JP 7462624B2 JP 2021520363 A JP2021520363 A JP 2021520363A JP 2021520363 A JP2021520363 A JP 2021520363A JP 7462624 B2 JP7462624 B2 JP 7462624B2
- Authority
- JP
- Japan
- Prior art keywords
- motion control
- control configuration
- coordinate system
- ultrasound imaging
- probe
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 78
- 238000012285 ultrasound imaging Methods 0.000 title claims description 70
- 238000013135 deep learning Methods 0.000 title description 72
- 230000033001 locomotion Effects 0.000 claims description 175
- 238000002604 ultrasonography Methods 0.000 claims description 60
- 230000009466 transformation Effects 0.000 claims description 56
- 210000003484 anatomy Anatomy 0.000 claims description 50
- 239000003550 marker Substances 0.000 claims description 28
- 238000004891 communication Methods 0.000 claims description 27
- 238000013519 translation Methods 0.000 claims description 17
- 239000000523 sample Substances 0.000 description 189
- 238000003384 imaging method Methods 0.000 description 48
- 238000012545 processing Methods 0.000 description 43
- 238000012549 training Methods 0.000 description 27
- 210000002216 heart Anatomy 0.000 description 22
- 230000006870 function Effects 0.000 description 16
- 238000013527 convolutional neural network Methods 0.000 description 15
- 230000014616 translation Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 14
- 230000000747 cardiac effect Effects 0.000 description 8
- 238000001514 detection method Methods 0.000 description 7
- 238000012634 optical imaging Methods 0.000 description 7
- 238000002592 echocardiography Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 210000004185 liver Anatomy 0.000 description 5
- 210000004072 lung Anatomy 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 210000000056 organ Anatomy 0.000 description 5
- 238000001914 filtration Methods 0.000 description 4
- 210000003734 kidney Anatomy 0.000 description 4
- 238000010967 transthoracic echocardiography Methods 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 3
- 229910052451 lead zirconate titanate Inorganic materials 0.000 description 3
- 230000002792 vascular Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 210000004204 blood vessel Anatomy 0.000 description 2
- 210000005242 cardiac chamber Anatomy 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000012530 fluid Substances 0.000 description 2
- 230000003601 intercostal effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000013175 transesophageal echocardiography Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 208000008589 Obesity Diseases 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 210000001367 artery Anatomy 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 210000000748 cardiovascular system Anatomy 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 210000003238 esophagus Anatomy 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 210000000232 gallbladder Anatomy 0.000 description 1
- 210000003709 heart valve Anatomy 0.000 description 1
- 210000000936 intestine Anatomy 0.000 description 1
- 238000002608 intravascular ultrasound Methods 0.000 description 1
- HFGPZNIAWCZYJU-UHFFFAOYSA-N lead zirconate titanate Chemical compound [O-2].[O-2].[O-2].[O-2].[O-2].[Ti+4].[Zr+4].[Pb+2] HFGPZNIAWCZYJU-UHFFFAOYSA-N 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000010339 medical test Methods 0.000 description 1
- 210000000653 nervous system Anatomy 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 235000020824 obesity Nutrition 0.000 description 1
- 210000000496 pancreas Anatomy 0.000 description 1
- -1 patient Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 210000000578 peripheral nerve Anatomy 0.000 description 1
- 238000011176 pooling Methods 0.000 description 1
- 230000000241 respiratory effect Effects 0.000 description 1
- 210000000278 spinal cord Anatomy 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 210000001635 urinary tract Anatomy 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5292—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves using additional data, e.g. patient information, image labeling, acquisition parameters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/42—Details of probe positioning or probe attachment to the patient
- A61B8/4245—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
- A61B8/4263—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient using sensors not mounted on the probe, e.g. mounted on an external reference frame
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
- A61B8/461—Displaying means of special interest
- A61B8/465—Displaying means of special interest adapted to display user selection data, e.g. icons or menus
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
- A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/58—Testing, adjusting or calibrating the diagnostic device
- A61B8/585—Automatic set-up of the device
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Pathology (AREA)
- Surgery (AREA)
- Molecular Biology (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Veterinary Medicine (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201862746042P | 2018-10-16 | 2018-10-16 | |
| US62/746,042 | 2018-10-16 | ||
| PCT/EP2019/078079 WO2020079077A1 (en) | 2018-10-16 | 2019-10-16 | Deep learning-based ultrasound imaging guidance and associated devices, systems, and methods |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2022504878A JP2022504878A (ja) | 2022-01-13 |
| JP2022504878A5 JP2022504878A5 (https=) | 2022-10-25 |
| JP7462624B2 true JP7462624B2 (ja) | 2024-04-05 |
Family
ID=68296466
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2021520363A Active JP7462624B2 (ja) | 2018-10-16 | 2019-10-16 | 深層学習に基づく超音波撮像ガイダンス並びに関連するデバイス、システム、及び方法 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US12245896B2 (https=) |
| EP (1) | EP3866697B1 (https=) |
| JP (1) | JP7462624B2 (https=) |
| CN (1) | CN112888370A (https=) |
| WO (1) | WO2020079077A1 (https=) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115243620A (zh) | 2020-03-05 | 2022-10-25 | 皇家飞利浦有限公司 | 超声成像引导及相关联的设备、系统和方法 |
| US20220211347A1 (en) * | 2021-01-04 | 2022-07-07 | GE Precision Healthcare LLC | Method and system for automatically detecting an apex point in apical ultrasound image views to provide a foreshortening warning |
| US12193882B2 (en) * | 2021-03-22 | 2025-01-14 | GE Precision Healthcare LLC | System and methods for adaptive guidance for medical imaging |
| CN113693623B (zh) * | 2021-08-25 | 2024-04-05 | 上海深至信息科技有限公司 | 一种基于增强现实的超声扫查引导方法及系统 |
| EP4260811A1 (en) | 2022-04-12 | 2023-10-18 | Koninklijke Philips N.V. | Graphical user interface for providing ultrasound imaging guidance |
| CN115310512B (zh) * | 2022-07-04 | 2025-08-01 | 电子科技大学 | 一种基于一阶卷积神经网络的自适应波束成形方法 |
| KR102641448B1 (ko) * | 2023-09-26 | 2024-02-27 | 주식회사 제이시스메디칼 | 초음파 조사 장치의 제어 장치 및 그 제어 방법 |
| US12611179B2 (en) * | 2024-04-01 | 2026-04-28 | Caption Health, Inc. | Guided ultrasound imaging systems |
| KR20250153349A (ko) * | 2024-04-17 | 2025-10-27 | 삼성메디슨 주식회사 | 바디 마커를 제공하는 초음파 영상 장치 및 그 제어 방법 |
| WO2025226976A1 (en) * | 2024-04-24 | 2025-10-30 | Apricity Robotics Inc. | Systems, devices, and methods for intelligently controlled medical examinations |
| WO2026052527A1 (en) | 2024-09-06 | 2026-03-12 | Koninklijke Philips N.V. | Ultrasound imaging based determination of elevational vs. azimuthal transducer motion using blind sweep protocol |
| US12521086B1 (en) * | 2025-04-25 | 2026-01-13 | Anumana, Inc. | System and method for sweep trajectory guidance |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010279486A (ja) | 2009-06-03 | 2010-12-16 | Konica Minolta Medical & Graphic Inc | 超音波診断装置 |
| WO2013161277A1 (ja) | 2012-04-23 | 2013-10-31 | パナソニック株式会社 | 超音波診断装置およびその制御方法 |
| WO2017156329A1 (en) | 2016-03-09 | 2017-09-14 | EchoNous, Inc. | Ultrasound image recognition systems and methods utilizing an artificial intelligence network |
| JP2017530744A (ja) | 2014-08-18 | 2017-10-19 | マウイ イマギング,インコーポレーテッド | ネットワークベース超音波イメージングシステム |
| US20170360401A1 (en) | 2016-06-20 | 2017-12-21 | Alex Rothberg | Automated image acquisition for assisting a user to operate an ultrasound device |
| JP2018134386A (ja) | 2016-12-07 | 2018-08-30 | ベイラブス, インク.Bay Labs, Inc. | 超音波探触子の誘導ナビゲーション |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6491632B1 (en) * | 2001-06-26 | 2002-12-10 | Geoffrey L. Taylor | Method and apparatus for photogrammetric orientation of ultrasound images |
| EP2763591A4 (en) * | 2011-10-09 | 2015-05-06 | Clear Guide Medical Llc | INTERVENTIONAL IN-SITU BILLING BY FUSION OF ULTRASOUND VIDEO |
| EP2807978A1 (en) * | 2013-05-28 | 2014-12-03 | Universität Bern | Method and system for 3D acquisition of ultrasound images |
| MX2016012612A (es) * | 2014-03-31 | 2016-12-14 | Koninklijke Philips Nv | Retroalimentacion haptica para adquisicion de imagen de ultrasonido. |
| US20160030008A1 (en) * | 2014-07-30 | 2016-02-04 | General Electric Company | System and method for registering ultrasound information to an x-ray image |
| WO2017100920A1 (en) * | 2015-12-14 | 2017-06-22 | The Governors Of The University Of Alberta | Apparatus and method for generating a fused scan image of a patient |
| US11191520B2 (en) * | 2016-03-17 | 2021-12-07 | Canon Medical Systems Corporation | Ultrasonic diagnostic apparatus, image processing apparatus, and image processing method |
| FR3059541B1 (fr) | 2016-12-07 | 2021-05-07 | Bay Labs Inc | Navigation guidee d'une sonde ultrason |
| CN112106070A (zh) | 2018-03-12 | 2020-12-18 | 皇家飞利浦有限公司 | 用于神经网络训练的超声成像数据集获取及相关装置、系统和方法 |
| CN112105301B (zh) | 2018-03-12 | 2024-10-18 | 皇家飞利浦有限公司 | 使用神经网络的超声成像平面对准及相关装置、系统和方法 |
-
2019
- 2019-10-16 CN CN201980069173.XA patent/CN112888370A/zh active Pending
- 2019-10-16 EP EP19790484.0A patent/EP3866697B1/en active Active
- 2019-10-16 US US17/285,124 patent/US12245896B2/en active Active
- 2019-10-16 WO PCT/EP2019/078079 patent/WO2020079077A1/en not_active Ceased
- 2019-10-16 JP JP2021520363A patent/JP7462624B2/ja active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010279486A (ja) | 2009-06-03 | 2010-12-16 | Konica Minolta Medical & Graphic Inc | 超音波診断装置 |
| WO2013161277A1 (ja) | 2012-04-23 | 2013-10-31 | パナソニック株式会社 | 超音波診断装置およびその制御方法 |
| JP2017530744A (ja) | 2014-08-18 | 2017-10-19 | マウイ イマギング,インコーポレーテッド | ネットワークベース超音波イメージングシステム |
| WO2017156329A1 (en) | 2016-03-09 | 2017-09-14 | EchoNous, Inc. | Ultrasound image recognition systems and methods utilizing an artificial intelligence network |
| US20170360401A1 (en) | 2016-06-20 | 2017-12-21 | Alex Rothberg | Automated image acquisition for assisting a user to operate an ultrasound device |
| JP2018134386A (ja) | 2016-12-07 | 2018-08-30 | ベイラブス, インク.Bay Labs, Inc. | 超音波探触子の誘導ナビゲーション |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2022504878A (ja) | 2022-01-13 |
| WO2020079077A1 (en) | 2020-04-23 |
| EP3866697A1 (en) | 2021-08-25 |
| CN112888370A (zh) | 2021-06-01 |
| EP3866697B1 (en) | 2024-03-20 |
| US20210369249A1 (en) | 2021-12-02 |
| US12245896B2 (en) | 2025-03-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7462624B2 (ja) | 深層学習に基づく超音波撮像ガイダンス並びに関連するデバイス、システム、及び方法 | |
| US12186132B2 (en) | Point-of-care ultrasound (POCUS) scan assistance and associated devices, systems, and methods | |
| CN115210761B (zh) | 多模态医学图像配准和相关联的设备、系统和方法 | |
| CN114073548B (zh) | 用于在混合现实/虚拟现实中生成脉管表示的系统和方法 | |
| CN114845642B (zh) | 用于超声成像的智能测量辅助以及相关联的设备、系统和方法 | |
| JP7253560B2 (ja) | ニューラルネットワークを用いた案内付き経頭蓋超音波撮像ならびに関連する装置、システムおよび方法 | |
| US20230281837A1 (en) | Method and system for registering images acquired with different modalities for generating fusion images from registered images acquired with different modalities | |
| EP4033987B1 (en) | Automatic closed-loop ultrasound plane steering for target localization in ultrasound imaging and associated devices and systems | |
| US12613336B2 (en) | Ultrasound imaging with anatomy-based acoustic settings | |
| US20260069247A1 (en) | Guided ultrasound imaging for point-of-care staging of medical conditions | |
| US12514545B2 (en) | Completeness of view of anatomy in ultrasound imaging and associated systems, devices, and methods | |
| EP4327750A1 (en) | Guided ultrasound imaging for point-of-care staging of medical conditions | |
| EP4265191A1 (en) | Ultrasound imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20221013 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20221013 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20230531 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230703 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20231002 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20231108 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240109 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20240226 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20240326 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 7462624 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |