WO2021057993A1 - 基于三维追踪相机的三维超声成像方法和系统 - Google Patents

基于三维追踪相机的三维超声成像方法和系统 Download PDF

Info

Publication number
WO2021057993A1
WO2021057993A1 PCT/CN2020/118249 CN2020118249W WO2021057993A1 WO 2021057993 A1 WO2021057993 A1 WO 2021057993A1 CN 2020118249 W CN2020118249 W CN 2020118249W WO 2021057993 A1 WO2021057993 A1 WO 2021057993A1
Authority
WO
WIPO (PCT)
Prior art keywords
dimensional
ultrasound
space information
initial
tracking camera
Prior art date
Application number
PCT/CN2020/118249
Other languages
English (en)
French (fr)
Inventor
郑永平
Original Assignee
中慧医学成像有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中慧医学成像有限公司 filed Critical 中慧医学成像有限公司
Priority to CA3152758A priority Critical patent/CA3152758A1/en
Priority to AU2020355865A priority patent/AU2020355865A1/en
Priority to JP2022519263A priority patent/JP7375180B2/ja
Priority to EP20869326.7A priority patent/EP4035603A4/en
Publication of WO2021057993A1 publication Critical patent/WO2021057993A1/zh
Priority to US17/706,575 priority patent/US20220240897A1/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/48—Diagnostic techniques
    • A61B8/483—Diagnostic techniques involving the acquisition of a 3D volume of data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/13—Tomography
    • A61B8/14—Echo-tomography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A61B8/4245—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
    • A61B8/4254—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient using sensors mounted on the probe
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/42—Details of probe positioning or probe attachment to the patient
    • A61B8/4245—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
    • A61B8/4263—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient using sensors not mounted on the probe, e.g. mounted on an external reference frame
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5246—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from the same or different imaging techniques, e.g. color Doppler and B-mode
    • A61B8/5253—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from the same or different imaging techniques, e.g. color Doppler and B-mode combining overlapping images, e.g. spatial compounding
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5269—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving detection or reduction of artifacts

Definitions

  • the invention relates to the field of three-dimensional ultrasound imaging, and more specifically, to a three-dimensional ultrasound imaging method and system based on a three-dimensional tracking camera.
  • Free-hand three-dimensional imaging that is, the human hand freely moves the ultrasound probe to scan on the target, and uses three-dimensional space sensing technology to capture the position and direction information of the ultrasound probe.
  • three-dimensional space sensing technologies include spatial reference objects or signals and corresponding detectors.
  • an electromagnetic transmitter is used to emit electromagnetic waves as a reference signal, and the detector determines the position and direction of the probe according to the change of the electromagnetic wave field strength.
  • one or more visual markers placed on the surface of the probe are used as reference objects, and one or more cameras surrounding the ultrasound probe are used to detect the position and direction of the probe.
  • the technical problem to be solved by the present invention is to provide a three-dimensional tracking camera-based camera that has strong anti-interference ability, low cost, small size, and can be used in any environment where no specific reference object is required.
  • Three-dimensional ultrasound imaging method and system Three-dimensional ultrasound imaging method and system.
  • the technical solution adopted by the present invention to solve its technical problems is to construct a three-dimensional ultrasonic imaging system based on a three-dimensional tracking camera, including:
  • Ultrasound probe used for ultrasonic scanning of the target area of interest
  • a two-dimensional ultrasound imaging device for generating a two-dimensional ultrasound image of the region of interest of the target based on the ultrasound scan
  • a three-dimensional space information acquisition device connected to the ultrasound probe and used to obtain three-dimensional space information of the ultrasound probe
  • the three-dimensional reconstruction module is used to reconstruct a three-dimensional ultrasound image based on the three-dimensional spatial information of the ultrasound probe and the two-dimensional ultrasound image.
  • the three-dimensional spatial information acquisition device includes a three-dimensional tracking camera and a processing module.
  • the three-dimensional tracking camera is used to acquire an environmental image and generate an initial three-dimensional image based on the environmental image.
  • Spatial information; the processing module is used to convert the initial three-dimensional spatial information into the three-dimensional spatial information of the ultrasound probe.
  • the three-dimensional spatial information acquisition device includes a plurality of the three-dimensional tracking cameras, and the plurality of the three-dimensional tracking cameras are installed at different parts of the ultrasonic probe to obtain multiple Groups of initial three-dimensional space information; the processing module generates three-dimensional space information of the ultrasound probe according to the acquired sets of initial three-dimensional space information.
  • the three-dimensional space information acquisition device further includes a correction module, which is used to determine the content of the two-dimensional ultrasound image based on the measured changes in the initial three-dimensional space information. The change of is corrects the initial three-dimensional space information and the position of the two-dimensional ultrasound image in the three-dimensional space.
  • the correction module corrects the initial three-dimensional space information.
  • the correction module corrects the position of the two-dimensional ultrasound image in the three-dimensional space.
  • the three-dimensional ultrasound imaging system based on the three-dimensional tracking camera of the present invention, it further includes an installation module connecting the three-dimensional spatial information acquisition device and the ultrasound probe, and the installation module includes a handle for an operator to hold.
  • the three-dimensional ultrasound imaging system based on the three-dimensional tracking camera of the present invention, it also includes a data integration and communication device for combining the two-dimensional ultrasound image obtained by the two-dimensional ultrasound imaging device and the three-dimensional ultrasound image obtained by the three-dimensional spatial information acquisition device.
  • the spatial information is integrated and transmitted to the 3D reconstruction module in a wired or wireless mode.
  • a three-dimensional ultrasound imaging method based on a three-dimensional tracking camera including:
  • step S3 includes:
  • step S31 a plurality of the three-dimensional tracking cameras installed in different parts of the ultrasound probe are used to acquire a plurality of environmental images; in step S32, Generate multiple sets of initial three-dimensional space information based on multiple environmental images; in step S33, the multiple sets of initial three-dimensional space information are converted to obtain the three-dimensional space information of the ultrasound probe.
  • the steps S32 and S33 further include:
  • the change in the initial three-dimensional spatial information is greater than the three-dimensional spatial information change threshold and the change in the content of the two-dimensional ultrasound image is less than the two-dimensional ultrasound image content change threshold.
  • the correction module corrects the initial three-dimensional space information.
  • the change in the initial three-dimensional spatial information is less than the three-dimensional spatial information change threshold and the content of the two-dimensional ultrasound image is greater than the two-dimensional ultrasound image content change threshold.
  • the correction module corrects the position of the two-dimensional ultrasound image in the three-dimensional space.
  • the three-dimensional ultrasound imaging system and method based on the three-dimensional tracking camera of the present invention by using the three-dimensional tracking camera to obtain the three-dimensional spatial information of the ultrasound probe, the three-dimensional ultrasound image can be reconstructed in a flexible, low-cost and small-volume manner, and interference can be effectively avoided. And there is no need for a specific reference at all. Further, the changes in the measured three-dimensional space information can be compared with the changes in the image information about the target collected by the ultrasound probe, so that the errors caused by the sudden changes of the two can be corrected. Furthermore, by setting up multiple tracking cameras, the quality of the three-dimensional ultrasound image is further improved.
  • Fig. 1 is a schematic diagram of the principle of the first preferred embodiment of a three-dimensional ultrasound imaging system based on a three-dimensional tracking camera of the present invention
  • FIG. 2 is a system schematic diagram of the first preferred embodiment of the three-dimensional ultrasound imaging system based on the three-dimensional tracking camera of the present invention
  • Fig. 3 is a schematic diagram of scanning the spine by the three-dimensional ultrasound imaging system based on the three-dimensional light tracking camera of the present invention
  • Fig. 4 is a flowchart of a first preferred embodiment of a three-dimensional ultrasound imaging method based on a three-dimensional tracking camera of the present invention.
  • the tracking camera combines a stereo camera to locate its position and angle in the three-dimensional space by detecting the three-dimensional image of the surrounding environment, such as a sensor and Intel's Realsense T265.
  • the tracking camera can also use built-in motion sensors (accelerometer, angular accelerometer, magnetic field meter, etc.) to further correct the three-dimensional spatial information. In this way, the tracking camera can obtain its own accurate three-dimensional space information without a special reference object.
  • the inventive concept of the present invention is to combine the ultrasonic probe and the three-dimensional tracking camera, and use the three-dimensional space information of the ultrasonic probe provided by the three-dimensional tracking camera and the two-dimensional ultrasonic image information provided by the two-dimensional ultrasonic imaging device to reconstruct the three-dimensional image.
  • a further idea of the present invention is to compare the changes in the measured three-dimensional space information with the changes in the image information about the target collected by the ultrasound probe, so that the errors caused by the sudden changes of the two can be corrected. Furthermore, by setting up multiple tracking cameras, the quality of the three-dimensional ultrasound image is further improved.
  • Fig. 1 is a schematic diagram of the principle of a first preferred embodiment of a three-dimensional ultrasound imaging system based on a three-dimensional tracking camera of the present invention.
  • Fig. 2 is a system schematic diagram of a first preferred embodiment of a three-dimensional ultrasound imaging system based on a three-dimensional tracking camera of the present invention.
  • the three-dimensional ultrasound imaging system based on the three-dimensional tracking camera of the present invention includes an ultrasound probe 10, a two-dimensional ultrasound imaging device 15, a three-dimensional spatial information acquisition device 12 and a three-dimensional reconstruction module 16.
  • the two-dimensional ultrasound imaging device 15 can be built-in or externally connected to the ultrasound probe 10 and wired or wirelessly connected to the ultrasound probe 10 to generate two-dimensional ultrasound images of the region of interest of the target based on the ultrasound probe 10 scanning; three-dimensional spatial information acquisition The device 12 is communicatively connected with the ultrasound probe 10 to obtain the three-dimensional spatial information of the ultrasound probe; the three-dimensional reconstruction module 16 is communicatively connected with the two-dimensional ultrasound imaging device 15 and the three-dimensional spatial information obtaining device 12, based on the three-dimensional spatial information of the ultrasound probe and The two-dimensional ultrasound image reconstructs the three-dimensional ultrasound image.
  • the two-dimensional ultrasound imaging device 15 is communicatively connected with the ultrasound probe 10 or is built in the ultrasound probe, so as to generate the second region of interest of the target based on the ultrasound scan.
  • Dimensional ultrasound image Further, the region of interest may be at least a part of the target, or the whole thereof.
  • any ultrasound probe or two-dimensional ultrasound imaging device known in the art can be used to construct the ultrasound probe 10 and two-dimensional ultrasound imaging device 15 of the present invention, and the present invention is not limited thereto.
  • the three-dimensional spatial information acquisition device 12 includes a three-dimensional tracking camera 13 and a processing module 17 combined with the three-dimensional tracking camera.
  • the three-dimensional tracking camera acquires an environmental image and generates an initial three-dimensional image based on the environmental image.
  • Spatial information where the initial 3D information refers to the 3D space information of the 3D tracking camera itself.
  • generating the 3D space information of the 3D tracking camera itself based on environmental images is a function of the 3D tracking camera itself.
  • the initial 3D space information is spatially transformed by the processing module to truly reflect the 3D space information of the ultrasound probe, and the ultrasound probe is converted
  • the three-dimensional space information of the ultrasound probe is transmitted to the three-dimensional reconstruction module in wired or wireless form.
  • the three-dimensional space of the three-dimensional tracking camera can be tracked through a space change method known in the art.
  • the information is converted into the three-dimensional spatial information of the ultrasound probe, which is not repeated here in the present invention.
  • the combination of the tracking camera and the processing model can make the three-dimensional ultrasound imaging system of the present invention more compact and convenient to use.
  • the processing module further preprocesses it, including smoothing processing and/or noise reduction processing.
  • smoothing processing including but not limited to Intel's Realsense T265 tracking camera, and similar devices developed in the future.
  • the three-dimensional spatial information acquisition device 12 may include a plurality of three-dimensional tracking cameras.
  • the processing module By installing the plurality of three-dimensional tracking cameras at different places or in different directions of the ultrasonic probe 10 or the installation module 11, Multiple sets of initial three-dimensional information can be obtained; the processing module generates three-dimensional information of the ultrasound probe according to the multiple sets of initial three-dimensional information, so as to improve the accuracy of the generated three-dimensional information of the ultrasound probe.
  • multiple sets of initial three-dimensional spatial information can be processed by a variety of methods, including the simplest averaging algorithm or other known methods, and the present invention is not limited thereto.
  • the three-dimensional reconstruction module 16 is communicatively connected with the two-dimensional ultrasound imaging device 15 and the three-dimensional spatial information acquisition device 12 through a data integration and communication device (not shown in the figure).
  • the data integration and communication device integrates the two-dimensional ultrasound image obtained by the two-dimensional ultrasound imaging device and the three-dimensional spatial information obtained by the three-dimensional spatial information acquisition device and transmits them to the three-dimensional reconstruction module in a wired or wireless mode.
  • the three-dimensional reconstruction module reconstructs a three-dimensional ultrasound image based on the three-dimensional space information of the ultrasound probe and the two-dimensional ultrasound image.
  • any reconstruction method known in the art can be used to achieve the reconstruction of the three-dimensional ultrasound image, which will not be repeated here.
  • the three-dimensional ultrasound imaging system further includes an installation module 11 connecting the three-dimensional spatial information acquisition device and the ultrasound probe, and the installation module 11 includes a handle 14 for an operator to hold.
  • the ultrasonic probe 10 is connected to the tracking camera through the installation module 11 and moves together in three-dimensional space.
  • the tracking camera observes the surrounding images through a stereo camera and compares them continuously, and then combines the information of other sensors to obtain its own initial three-dimensional space information.
  • the three-dimensional spatial information of the ultrasound probe can be obtained.
  • FIG. 3 shows that the ultrasonic probe performs a three-dimensional scan of the spine 21, and the operator's hand 22 holds the handle connected to the installation module to move the ultrasonic probe.
  • the three-dimensional space information acquisition device further includes a correction module (not shown in the figure), which is used to determine the difference between the measured initial three-dimensional space information and the two-dimensional ultrasound image.
  • the content change corrects the initial three-dimensional space information and the position of the two-dimensional ultrasound image in the three-dimensional space.
  • the initial three-dimensional information is corrected.
  • the correction module compares the change of the initial three-dimensional space information acquired twice or within a specific time with the change of the content of the two-dimensional ultrasound image. According to experience, the movement of the ultrasound probe will not suddenly change greatly in practical applications. Therefore, the obtained two-dimensional ultrasound image will not change suddenly. Therefore, if the content of the two-dimensional ultrasound image obtained by the two-dimensional ultrasound imaging device changes very little, the initial three-dimensional spatial information measured by the three-dimensional tracking camera will change.
  • the measured 3D space information of the 3D tracking camera has errors, and the measured initial 3D space information needs to be corrected.
  • the ultrasound probe suddenly moves while scanning the region of interest within the target, the content of the two-dimensional ultrasound image will also suddenly change. Therefore, if there is a big change in the measured three-dimensional space information, but the two-dimensional ultrasound image does not change much (the actual experience is that the scanned target is usually not moving or moving very slowly), then we know the measurement The three-dimensional space information obtained is wrong and needs to be corrected.
  • Specific correction methods include the following: 1) Two or more correct three-dimensional spatial information that has been measured and judged to be correct can be used to extrapolate the three-dimensional spatial information value judged to need to be corrected; 2) It can also be further Wait until the next one or more correct three-dimensional space information values are obtained, and then interpolate with the previous one or more correct three-dimensional space information values; 3) You can also wait until the scan is completed, and use all three-dimensional space information values judged to be correct Perform three-dimensional curve fitting to obtain those three-dimensional spatial information values that are judged to need to be corrected. Those skilled in the art can also use any other correction methods known in the art to realize the correction of the three-dimensional spatial information.
  • the correction module performs the correction on the two-dimensional ultrasound image
  • the position in the three-dimensional space is corrected. According to experience, if the scanned object moves, the content of the two-dimensional ultrasound image will change greatly. Therefore, if the measured initial three-dimensional spatial information changes very little, the content of the two-dimensional ultrasound image changes. It is very large, which means that the region of interest of the target has moved during the ultrasound scanning process, and the position of the two-dimensional ultrasound image in the three-dimensional space is corrected according to the initial three-dimensional space information.
  • Specific correction methods include the following: 1) Two or more correct three-dimensional spatial information that has been measured and judged to be correct can be used to extrapolate the three-dimensional spatial information value judged to need to be corrected; 2) It can also be further Wait until the next one or more correct three-dimensional space information values are obtained, and then interpolate with the previous one or more correct three-dimensional space information values; 3) You can also wait until the scan is completed, and use all three-dimensional space information values judged to be correct Perform three-dimensional curve fitting to obtain those three-dimensional spatial information values judged to need correction. Those skilled in the art can also use any other correction methods known in the art to realize the correction of the three-dimensional spatial information.
  • the three-dimensional ultrasound imaging system based on the three-dimensional tracking camera of the present invention can be used to obtain three-dimensional spatial information by using the three-dimensional tracking camera to reconstruct the three-dimensional ultrasound image in a flexible, low-cost and small-volume manner. A specific reference is required.
  • Fig. 4 is a flowchart of a first preferred embodiment of a three-dimensional ultrasonic imaging method based on a three-dimensional light tracking camera of the present invention.
  • the 3D ultrasound imaging method based on the 3D light tracking camera includes the following steps:
  • the region of interest may be at least a part of the target, or the whole thereof.
  • the ultrasound probe can adopt different frequencies, widths, and shapes.
  • a two-dimensional ultrasound imaging device 15 communicatively connected with the ultrasound probe 10 or built in the ultrasound probe generates a two-dimensional image of the target region of interest based on the ultrasound scan. Ultrasound image.
  • step S3 includes:
  • the initial 3D information refers to the 3D space information of the 3D tracking camera itself.
  • the 3D space information generated by the 3D tracking camera itself based on the environment image is the 3D tracking camera.
  • the built-in functions will not be repeated here; after acquiring the 3D space information of the 3D tracking camera, the initial 3D space information is spatially converted to truly reflect the 3D space information of the ultrasound probe, and the converted all
  • the three-dimensional spatial information of the ultrasound probe is transmitted to the three-dimensional reconstruction module in a wired or wireless form.
  • the three-dimensional tracking camera can be tracked by a spatial change method known in the art.
  • the three-dimensional space information of the ultrasonic probe is converted into the three-dimensional space information of the ultrasound probe, which is not repeated here in the present invention.
  • preprocessing is also performed on it, including smoothing processing and/or noise reduction processing.
  • the three-dimensional spatial information acquisition device 12 may include a plurality of three-dimensional tracking cameras.
  • the plurality of three-dimensional tracking cameras By installing the plurality of three-dimensional tracking cameras at different places or in different directions of the ultrasonic probe 10 or the installation module 11, You can get multiple sets of initial three-dimensional space information. Therefore, in another embodiment of the present invention, in step S31, a plurality of three-dimensional tracking cameras installed in different parts of the ultrasound probe are used to acquire a plurality of environmental images; in step S32, a plurality of environmental images are acquired Generate multiple sets of initial three-dimensional space information; in step S33, the multiple sets of initial three-dimensional space information are converted to obtain the three-dimensional space information of the ultrasound probe.
  • the three-dimensional spatial information of the ultrasound probe is generated according to the multiple sets of initial three-dimensional spatial information, so as to improve the accuracy of the generated three-dimensional spatial information of the ultrasound probe.
  • multiple sets of initial three-dimensional spatial information can be processed by a variety of methods, including the simplest averaging algorithm or other known methods, and the present invention is not limited thereto.
  • the method further includes:
  • the initial three-dimensional information is corrected.
  • the correction module compares the change of the initial three-dimensional space information acquired twice or within a specific time with the change of the content of the two-dimensional ultrasound image. According to experience, the movement of the ultrasound probe will not suddenly change greatly in practical applications. Therefore, the obtained two-dimensional ultrasound image will not change suddenly. Therefore, if the content of the two-dimensional ultrasound image obtained by the two-dimensional ultrasound imaging device changes very little, the initial three-dimensional spatial information measured by the three-dimensional tracking camera will change.
  • the measured three-dimensional space information of the three-dimensional tracking camera has errors, and the measured initial three-dimensional space information needs to be corrected.
  • the ultrasound probe suddenly moves while scanning the region of interest within the target, the content of the two-dimensional ultrasound image will also suddenly change. Therefore, if there is a big change in the measured three-dimensional space information, but the two-dimensional ultrasound image does not change much (the actual experience is that the scanned target is usually not moving or moving very slowly), then we know the measurement The three-dimensional space information obtained is wrong and needs to be corrected.
  • any correction method known in the art can be used to realize the correction of the three-dimensional space information. The simplest method is to infer the three-dimensional space information at this moment from the data at other time points. I won't be tired anymore.
  • the correction module performs the correction on the two-dimensional ultrasound image
  • the position in the three-dimensional space is corrected. According to experience, if the scanned object moves, the content of the two-dimensional ultrasound image will change greatly. Therefore, if the measured initial three-dimensional spatial information changes very little, the content of the two-dimensional ultrasound image changes. It is very large, which means that the region of interest of the target has moved during the ultrasound scanning process, and the position of the two-dimensional ultrasound image in the three-dimensional space is corrected according to the initial three-dimensional space information.
  • any reconstruction method known in the art may be used to achieve the reconstruction of the three-dimensional ultrasound image, which will not be repeated here.
  • the three-dimensional ultrasound imaging method based on the three-dimensional tracking camera of the present invention, by using the three-dimensional optical tracking camera to obtain three-dimensional spatial information, the three-dimensional ultrasound image can be reconstructed in a flexible, low-cost and small-volume manner, which can effectively avoid interference and does not require specific Reference.
  • the present invention can also be implemented by a computer program product.
  • the program contains all the features that can implement the method of the present invention, and when it is installed in a computer system, the method of the present invention can be implemented.
  • the computer program in this document refers to any expression of a set of instructions that can be written in any programming language, code, or symbol.
  • the instruction set enables the system to have information processing capabilities to directly implement specific functions, or to perform the next step. After one or two steps, a specific function can be realized: a) converted into other languages, codes or symbols; b) reproduced in different formats.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Radiology & Medical Imaging (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

一种基于三维追踪相机的三维超声成像系统和成像方法，包括：超声探头(10)，用于对目标的感兴趣区域进行超声扫描；二维超声成像装置(15)，用于基于超声扫描生成目标的感兴趣区域的二维超声图像；三维空间信息获取装置(12)，与超声探头(10)连接，用于获取超声探头(10)的三维空间信息；三维重建模块(16)，用于基于超声探头(10)的三维空间信息和二维超声图像重建三维超声图像。可以灵活、低成本和小体积的方式重建三维超声图像，并且可以有效避免干扰。

Description

基于三维追踪相机的三维超声成像方法和系统 技术领域
本发明涉及三维超声成像领域，更具体地说，涉及一种基于三维追踪相机的三维超声成像方法和系统。
 背景技术
自由臂（free-hand）三维成像，即由人手自由移动超声探头在目标物上作扫描，利用三维空间传感技术捕获超声探头的位置及方向信息。目前常用的三维空间传感技术包括空间参照物或信号及相应的探测器。举例来说，使用电磁发射器来发射电磁波作为参考信号，探测器根据电磁波场强的变化来判断探头的位置和方向变化。再比如，使用安放在探头表面的一个或多个的视觉标识物来作为参考物，并使用一个或多个环绕超声探头的摄像头来探测探头的位置及方向。
上述的三维空间传感技术各自存在着自身的优点与局限性。就电磁传感技术而言，其会受到周遭金属物体的干扰。而基于摄像头的传感系统通常体积庞大，费用高昂。到目前为止还没有自由臂三维超声成像系统可以在任何场合没有特定的参考物的情况下使用。
 技术解决方案
本发明要解决的技术问题在于，针对现有技术的上述缺陷，提供一种抗干扰能力强、成本低、体积小、并且可以完全不需要特定参考物的任何环境下使用的基于三维追踪相机的三维超声成像方法和系统。
本发明解决其技术问题所采用的技术方案是：构造一种基于三维追踪相机的三维超声成像系统，包括：
超声探头，用于对目标的感兴趣区域进行超声扫描；
二维超声成像装置，用于基于所述超声扫描生成所述目标的感兴趣区域的二维超声图像；
三维空间信息获取装置，与所述超声探头连接，用于获取所述超声探头的三维空间信息；
三维重建模块，用于基于所述超声探头的三维空间信息和所述二维超声图像重建三维超声图像。
在本发明的基于三维追踪相机的三维超声成像系统中，所述三维空间信息获取装置包括三维追踪相机和处理模块，所述三维追踪相机用于获取环境图像，并基于所述环境图像生成初始三维空间信息；所述处理模块用于将所述初始三维空间信息转换为所述超声探头的三维空间信息。
在本发明的基于三维追踪相机的三维超声成像系统中，所述三维空间信息获取装置包括多个所述三维追踪相机，多个所述三维追踪相机安装于所述超声探头的不同部位以获取多组初始三维空间信息；所述处理模块根据获取的多组初始三维空间信息生成所述超声探头的三维空间信息。
在本发明的基于三维追踪相机的三维超声成像系统中，所述三维空间信息获取装置还包括修正模块，用于基于测量到的所述初始三维空间信息的变化与所述二维超声图像的内容的变化对所述初始三维空间信息和所述二维超声图像在三维空间中的位置进行修正。
在本发明的基于三维追踪相机的三维超声成像系统中，在所述初始三维空间信息的变化大于三维空间信息变化阈值且所述二维超声图像的内容的变化小于二维超声图像内容变化阈值时，所述修正模块对所述初始三维空间信息进行修正。
在本发明的基于三维追踪相机的三维超声成像系统中，在所述初始三维空间信息的变化小于三维空间信息变化阈值且所述二维超声图像的内容的变化大于二维超声图像内容变化阈值时，所述修正模块对所述二维超声图像在所述三维空间中的位置进行修正。
在本发明的基于三维追踪相机的三维超声成像系统中，还包括连接所述三维空间信息获取装置和所述超声探头的安装模块，所述安装模块包括供操作者握住的手柄。
在本发明的基于三维追踪相机的三维超声成像系统中，还包括数据集成及通信装置，用于将所述二维超声成像装置得到的二维超声图像和所述三维空间信息获取装置得到的三维空间信息进行整合并通过有线或无线的模式传输给三维重建模块。
根据本发明的另一方面，还提供一种基于三维追踪相机的三维超声成像方法，包括：
S1、采用超声探头对目标的感兴趣区域进行超声扫描；
S2、基于所述超声扫描生成所述目标的感兴趣区域的二维超声图像；
S3、由三维空间信息获取装置获取所述超声探头的三维空间信息；
S4、基于所述超声探头的三维空间信息和所述二维超声图像重建三维超声图像。
在本发明提供的基于三维追踪相机的三维超声成像方法中，步骤S3包括：
S31、由所述三维空间信息获取装置的三维追踪相机获取环境图像；
S32、基于所述环境图像生成初始三维空间信息；
S33、对所述初始三维空间信息进行转换，生成所述探头的三维空间信息。
在本发明提供的基于三维追踪相机的三维超声成像方法中，在步骤S31中，使用多个安装于所述超声探头的不同部位的所述三维追踪相机获取多个环境图像；在步骤S32中，基于多个环境图像生成多组初始三维空间信息；在步骤S33中，对多组初始三维空间信息进行转换得到所述超声探头的三维空间信息。
在本发明提供的基于三维追踪相机的三维超声成像方法中，在步骤S32和S33之间还包括：
基于测量到的所述初始三维空间信息的变化与所述二维超声图像的内容的变化对所述初始三维空间信息和所述二维超声图像在三维空间中的位置进行修正。
在本发明提供的基于三维追踪相机的三维超声成像方法中，在所述初始三维空间信息的变化大于三维空间信息变化阈值且所述二维超声图像的内容的变化小于二维超声图像内容变化阈值时，所述修正模块对所述初始三维空间信息进行修正。
在本发明提供的基于三维追踪相机的三维超声成像方法中，在所述初始三维空间信息的变化小于三维空间信息变化阈值且所述二维超声图像的内容的变化大于二维超声图像内容变化阈值时，所述修正模块对所述二维超声图像在所述三维空间中的位置进行修正。
 有益效果
实施本发明的基于三维追踪相机的三维超声成像系统和方法，通过采用三维追踪相机获取超声探头的三维空间信息，可以灵活、低成本和小体积的方式重建三维超声图像，并且可以有效避免干扰，而且可以完全不需要特定的参考物。进一步地，可以通过比较测量到的三维空间信息的变化和有超声探头采集到有关目标的图像信息的变化，从而可以修正两者各自的突然变化造成的误差。再进一步地，通过设置多追踪相机的方式，进一步提升三维超声图像的质量。
 附图说明
下面将结合附图及实施例对本发明作进一步说明，附图中：
图1是本发明的基于三维追踪相机的三维超声成像系统的第一优选实施例的原理示意图；
图2是本发明的基于三维追踪相机的三维超声成像系统的第一优选实施例的系统示意图；
图3是本发明的基于三维光追踪相机的三维超声成像系统在对脊柱扫描示意图；
图4是本发明的基于三维追踪相机的三维超声成像方法的第一优选实施例的流程图。
 本发明的实施方式
为了使本发明的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
传统的三维空间定位仪通常都是需要有特别参考物获取准确的三维空间信息。而追踪相机是结合立体摄像头通过检测周边环境的三维图像来对自身在三维空间中的位置和角度进行定位，比如传感器与英特尔的Realsense T265。追踪相机除了光学追踪外，还可以利用内置的运动传感器（加速度计、角加速度计、磁场计等）对三维空间信息进行进一步的修正。这样，追踪相机可以在没有特别参考物的情况下，可以获取其自身的准确的三维空间信息。
本发明的发明构思是将超声探头和三维追踪相机结合在一起，采用由三维追踪相机提供的超声探头的三维空间信息和二维超声成像装置提供的二维超声影像信息进行三维图像重建。本发明进一步的构想是可以通过比较测量到的三维空间信息的变化和有超声探头采集到有关目标的图像信息的变化，从而可以修正两者各自的突然变化造成的误差。再进一步地，通过设置多追踪相机的方式，进一步提升三维超声图像的质量。
图1是本发明的基于三维追踪相机的三维超声成像系统的第一优选实施例的原理示意图。图2是本发明的基于三维追踪相机的三维超声成像系统的第一优选实施例的系统示意图。如图1和2所示，本发明的基于三维追踪相机的三维超声成像系统包括超声探头10、二维超声成像装置15、三维空间信息获取装置12和三维重建模块16。具体地，二维超声成像装置15可以内置在超声探头10内或外置并与超声探头10有线或无线连接，基于超声探头10扫描生成目标的感兴趣区域的二维超声图像；三维空间信息获取装置12与所述超声探头10通信连接，获取超声探头的三维空间信息；三维重建模块16与二维超声成像装置15和三维空间信息获取装置12通信连接，基于所述超声探头的三维空间信息和所述二维超声图像重建三维超声图像。
具体地，在本发明一实施例中，所述二维超声成像装置15与所述超声探头10通信连接或内置于超声探头内，从而基于所述超声扫描生成所述目标的感兴趣区域的二维超声图像。进一步地，该感兴趣区域可以是所述目标的至少一部分，或者其整体。本领域技术人员可以理解的是，可以采用本领域中已知的任何超声探头、二维超声成像装置构造本发明的超声探头10、二维超声成像装置15，本发明并不以此为限。
具体地，在本发明一实施例中，三维空间信息获取装置12包括三维追踪相机13和与三维追踪相机结合的处理模块17，通过三维追踪相机获取环境图像，并基于所述环境图像生成初始三维空间信息，其中，初始三维信息是指三维追踪相机自身的三维空间信息，本领域技术人员可以知悉的是，基于环境图像生成三维追踪相机自身的三维空间信息为三维追踪相机自带的功能，在此就不再累述了；在获取了三维追踪相机的三维空间信息后，通过处理模块对初始三维空间信息进行空间转换以真实反映超声探头的三维空间信息，并将其转换的所述超声探头的三维空间信息以有线或无线形式将所述超声探头的三维空间信息传输给三维重建模块，本领域技术人员可以知悉的是，可以通过本领域已知的空间变化方法将三维追踪相机的三维空间信息转换为超声探头的三维空间信息，本发明在此不再赘述。追踪相机与处理模的结合可以使得本发明的三维超声成像系统更加细小、方便使用。进一步地，处理模块在获取三维追踪相机的初始三维空间信息后，还对其进行预处理，包括平滑处理和/或降噪处理。本领域技术人员知悉，可以采用本领域中的任何追踪相机，包括但不限于英特尔的Realsense T265追踪相机，以及未来发展出来的类似的设备。
进一步地，在本发明另一实施例中，三维空间信息获取装置12可以包括多个三维追踪相机，通过将多个三维追踪相机安装在超声探头10或安装模块11的不同地方或朝不同方向，就可以得到多组初始三维空间信息；处理模块根据多组初始三维空间信息来生成超声探头的三维空间信息，以提高所生成的超声探头的三维空间信息的准确性。本领域技术人员可以理解的是，可以通过多种方法对多组初始三维空间信息进行处理，包括最简单的平均算法或其他已知的方法，本发明并不以此为限。
具体地，在本发明一实施例中，三维重建模块16通过数据集成及通信装置（图中未示出）与二维超声成像装置15和三维空间信息获取装置12通信连接。数据集成及通信装置将所述二维超声成像装置得到的二维超声图像和所述三维空间信息获取装置得到的三维空间信息进行整合并通过有线或无线的模式传输给三维重建模块。三维重建模块基于所述超声探头的三维空间信息和所述二维超声图像重建三维超声图像。本领域技术人员知悉，可以采用本领域中已知的任何重建方法实现三维超声图像的重建，在此就不再累述了。
具体地，在本发明一实施例中，三维超声成像系统还包括连接所述三维空间信息获取装置和所述超声探头的安装模块11，所述安装模块11包括供操作者握住的手柄14。所述超声探头10通过安装模块11与追踪相机相连并一起在三维空间中移动，追踪相机通过立体相机观测周边的图像并不断比较，再结合其他传感器的信息得到其自身的初始三维空间信息，经处理模块处理后从而可以得知超声探头的三维空间信息。图3是所述超声探头在对脊柱21作三维扫描，由操作者的手22握住连接安装模块的手柄来移动超声探头。
进一步地，在本发明一实施例中，三维空间信息获取装置还包括修正模块（图中未示出），用于基于测量到的所述初始三维空间信息的变化与所述二维超声图像的内容的变化对所述初始三维空间信息和所述二维超声图像在三维空间中的位置进行修正。
进一步地，在初始三维空间信息的变化大于三维空间信息变化阈值且所述二维超声图像的内容的变化小于二维超声图像内容变化阈值时，则对初始三维空间信息进行修正。修正模块对相邻两次或特定时间内获取的初始三维空间信息的变化与二维超声图像的内容的变化进行比较，根据经验超声探头的移动在实际应用中是不会突然有大的变化，因此，所得到的二维超声图像也就不会突然变化，所以，若二维超声成像装置得到的二维超声图像的内容的变化非常小，但三维追踪相机测量到的初始三维空间信息的变化却很大，即表示测量到的三维追踪相机的三维空间信息有误差，需要对测量到的初始三维空间信息进行修正。在正常情况下如果超声探头在进行对目标内的感兴趣的区域扫描时突然移动，那么二维超声图像的内容也会突然地变化。所以，如果测量到的三维空间信息有大的变化，但二维超声图像并没有大的变化（实际经验是被扫描目标通常是不动或动的很少很慢），这时我们就知道测量到的三维空间信息有误，从而需要修正。具体的修正方法包括如下几种：1）可以用已经测量到的并且判断为两个或以上的正确的三维空间信息来对判断为需要修正的三维空间信息值进行外插值；2）也可以进一步等到得到下一个或多个正确的三维空间信息值获得后与前一个或多个正确的三维空间信息值进行内插值；3）也可以等到扫描完成后，利用所有判断为正确的三维空间信息值进行三维曲线拟合从而得到那些判断为需要修正的三维空间信息值。本领域技术人员还可以采用其它本领域中已知的任何修正方法实现三维空间信息的修正。
进一步地，在所述初始三维空间信息的变化小于三维空间信息变化阈值且所述二维超声图像的内容的变化大于二维超声图像内容变化阈值时，所述修正模块对所述二维超声图像在所述三维空间中的位置进行修正。根据经验，如果被扫描对象发生移动，则二维超声图像的内容会发生较大变化，因此，若测量到的初始三维空间信息的变化非常小，但所述二维超声图像的内容的变化却很大，即表示所述的目标的感兴趣区域在超声扫描过程中移动了，根据所述初始三维空间信息对所述二维超声图像在三维空间中的位置进行修正。具体的修正方法包括如下几种：1）可以用已经测量到的并且判断为两个或以上的正确的三维空间信息来对判断为需要修正的三维空间信息值进行外插值；2）也可以进一步等到得到下一个或多个正确的三维空间信息值获得后与前一个或多个正确的三维空间信息值进行内插值；3）也可以等到扫描完成后，利用所有判断为正确的三维空间信息值进行三维曲线拟合从而得到那些判断为需要修正的三维空间信息值。本领域技术人员还可以采用其它本领域中已知的任何修正方法实现三维空间信息的修正。
实施本发明的基于三维追踪相机的三维超声成像系统，通过采用三维追踪相机获取三维空间信息，可以灵活、低成本和小体积的方式重建三维超声图像，可以有效避免干扰，而且在扫描过程中不需要特定的参考物。
图4是本发明的基于三维光追踪相机的三维超声成像方法的第一优选实施例的流程图。如图4所示，基于三维光追踪相机的三维超声成像方法包括以下步骤：
S1、采用超声探头对目标的感兴趣区域进行超声扫描；
具体地，在本发明一实施例中，该感兴趣区域可以是所述目标的至少一部分，或者其整体。本领域技术人员知悉，所述超声探头可以采用不同的频率、宽度、及形状。
S2、基于所述超声扫描生成所述目标的感兴趣区域的二维超声图像；
具体地，在本发明一实施例中，由与所述超声探头10通信连接或内置于超声探头内的二维超声成像装置15，基于所述超声扫描生成所述目标的感兴趣区域的二维超声图像。
S3、由三维空间信息获取装置获取所述超声探头的三维空间信息；
具体地，在本发明一实施例中，由所述的三维空间信息获取装置获取其自身的三维空间信息，并得到与其一起移动的超声探头的三维空间信息。因此，步骤S3包括：
S31、由所述三维空间信息获取装置的三维追踪相机获取环境图像；
S32、基于所述环境图像生成初始三维空间信息；
S33、对所述初始三维空间信息进行转换，生成所述探头的三维空间信息。
具体地，在本发明一实施例中，初始三维信息是指三维追踪相机自身的三维空间信息，本领域技术人员可以知悉的是，基于环境图像生成三维追踪相机自身的三维空间信息为三维追踪相机自带的功能，在此就不再累述了；在获取了三维追踪相机的三维空间信息后，对初始三维空间信息进行空间转换以真实反映超声探头的三维空间信息，并将其转换的所述超声探头的三维空间信息以有线或无线形式将所述超声探头的三维空间信息传输给三维重建模块，本领域技术人员可以知悉的是，可以通过本领域已知的空间变化方法将三维追踪相机的三维空间信息转换为超声探头的三维空间信息，本发明在此不再赘述。
进一步地，在获取三维追踪相机的初始三维空间信息后，还对其进行预处理，包括平滑处理和/或降噪处理。
进一步地，在本发明另一实施例中，三维空间信息获取装置12可以包括多个三维追踪相机，通过将多个三维追踪相机安装在超声探头10或安装模块11的不同地方或朝不同方向，就可以得到多组初始三维空间信息。因此，在本发明另一实施例中，在步骤S31中，使用多个安装于所述超声探头的不同部位的所述三维追踪相机获取多个环境图像；在步骤S32中，基于多个环境图像生成多组初始三维空间信息；在步骤S33中，对多组初始三维空间信息进行转换得到所述超声探头的三维空间信息。根据多组初始三维空间信息来生成超声探头的三维空间信息，以提高所生成的超声探头的三维空间信息的准确性。本领域技术人员可以理解的是，可以通过多种方法对多组初始三维空间信息进行处理，包括最简单的平均算法或其他已知的方法，本发明并不以此为限。
进一步地，在本发明又一实施例中，在步骤S32和S33之间还包括：
基于测量到的所述初始三维空间信息的变化与所述二维超声图像的内容的变化对所述初始三维空间信息和所述二维超声图像在三维空间中的位置进行修正。
具体地，在所述初始三维空间信息的变化大于三维空间信息变化阈值且所述二维超声图像的内容的变化小于二维超声图像内容变化阈值时，对所述初始三维空间信息进行修正。修正模块对相邻两次或特定时间内获取的初始三维空间信息的变化与二维超声图像的内容的变化进行比较，根据经验超声探头的移动在实际应用中是不会突然有大的变化，因此，所得到的二维超声图像也就不会突然变化，所以，若二维超声成像装置得到的二维超声图像的内容的变化非常小，但三维追踪相机测量到的初始三维空间信息的变化却很大，即表示测量到的三维追踪相机的三维空间信息有误差，需要对测量到的初始三维空间信息进行修正。在正常情况下如果超声探头在进行对目标内的感兴趣的区域扫描时突然移动，那么二维超声图像的内容也会突然地变化。所以，如果测量到的三维空间信息有大的变化，但二维超声图像并没有大的变化（实际经验是被扫描目标通常是不动或动的很少很慢），这时我们就知道测量到的三维空间信息有误，从而需要修正。本领域技术人员知悉的是，可以采用本领域中已知的任何修正方法实现三维空间信息的修正，最简单的方法是将这一时刻的三维空间信息由其他时间点的数据推断出，在此就不再累述了。
进一步地，在所述初始三维空间信息的变化小于三维空间信息变化阈值且所述二维超声图像的内容的变化大于二维超声图像内容变化阈值时，所述修正模块对所述二维超声图像在所述三维空间中的位置进行修正。根据经验，如果被扫描对象发生移动，则二维超声图像的内容会发生较大变化，因此，若测量到的初始三维空间信息的变化非常小，但所述二维超声图像的内容的变化却很大，即表示所述的目标的感兴趣区域在超声扫描过程中移动了，根据所述初始三维空间信息对所述二维超声图像在三维空间中的位置进行修正。
S4、基于所述超声探头的三维空间信息和所述二维超声图像重建三维超声图像。
具体地，在本发明一实施例中，可以采用本领域中已知的任何重建方法实现三维超声图像的重建，在此就不再累述了。
实施本发明的基于三维追踪相机的三维超声成像方法，通过采用三维光追踪相机获取三维空间信息，可以灵活、低成本和小体积的方式重建三维超声图像，可以有效避免干扰，而且不需要特定的参考物。
本领域技术人员进一步知悉，本发明的基于三维追踪相机的三维超声成像系统和方法可以互为应证和说明，其中各自记载的功能和步骤都可以彼此组合，结合或者替换。
以上还借助于说明某些重要功能的功能模块对本发明进行了描述。为了描述的方便，这些功能组成模块的界限在此处被专门定义。当这些重要的功能被适当地实现时，变化其界限是允许的。类似地，流程图模块也在此处被专门定义来说明某些重要的功能，为广泛应用，流程图模块的界限和顺序可以被另外定义，只要仍能实现这些重要功能。上述功能模块、流程图功能模块的界限及顺序的变化仍应被视为在权利要求保护范围内。
本发明还可以通过计算机程序产品进行实施，程序包含能够实现本发明方法的全部特征，当其安装到计算机系统中时，可以实现本发明的方法。本文件中的计算机程序所指的是：可以采用任何程序语言、代码或符号编写的一组指令的任何表达式，该指令组使系统具有信息处理能力，以直接实现特定功能，或在进行下述一个或两个步骤之后实现特定功能：a)转换成其它语言、编码或符号；b)以不同的格式再现。
虽然本发明是通过具体实施例进行说明的，本领域技术人员应当明白，在不脱离本发明范围的情况下，还可以对本发明进行各种变换及等同替代。另外，针对特定情形或材料，可以对本发明做各种修改，而不脱离本发明的范围。因此，本发明不局限于所公开的具体实施例，而应当包括落入本发明权利要求范围内的全部实施方式。
以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本发明的保护范围之内。

Claims (14)

  1. 一种基于三维追踪相机的三维超声成像系统，其特征在于，包括：
    超声探头，用于对目标的感兴趣区域进行超声扫描；
    二维超声成像装置，用于基于所述超声扫描生成所述目标的感兴趣区域的二维超声图像；
    三维空间信息获取装置，与所述超声探头连接，用于获取所述超声探头的三维空间信息；
    三维重建模块，用于基于所述超声探头的三维空间信息和所述二维超声图像重建三维超声图像。
  2. 根据权利要求1所述的基于三维追踪相机的三维超声成像系统，其特征在于，所述三维空间信息获取装置包括三维追踪相机和处理模块，所述三维追踪相机用于获取环境图像，并基于所述环境图像生成初始三维空间信息；所述处理模块用于将所述初始三维空间信息转换为所述超声探头的三维空间信息。
  3. 根据权利要求2所述的基于三维追踪相机的三维超声成像系统，其特征在于，所述三维空间信息获取装置包括多个所述三维追踪相机，多个所述三维追踪相机安装于所述超声探头的不同部位以获取多组初始三维空间信息；所述处理模块根据获取的多组初始三维空间信息生成所述超声探头的三维空间信息。
  4. 根据权利要求2所述的基于三维追踪相机的三维超声成像系统，其特征在于，所述三维空间信息获取装置还包括修正模块，用于基于测量到的所述初始三维空间信息的变化与所述二维超声图像的内容的变化对所述初始三维空间信息和所述二维超声图像在三维空间中的位置进行修正。
  5. 根据权利要求4所述的基于三维追踪相机的三维超声成像系统，其特征在于，在所述初始三维空间信息的变化大于三维空间信息变化阈值且所述二维超声图像的内容的变化小于二维超声图像内容变化阈值时，所述修正模块对所述初始三维空间信息进行修正。
  6. 根据权利要求4所述的基于三维追踪相机的三维超声成像系统，其特征在于，在所述初始三维空间信息的变化小于三维空间信息变化阈值且所述二维超声图像的内容的变化大于二维超声图像内容变化阈值时，所述修正模块对所述二维超声图像在所述三维空间中的位置进行修正。
  7. 根据权利要求1所述基于三维追踪相机的三维超声成像系统，其特征在于，还包括连接所述三维空间信息获取装置和所述超声探头的安装模块，所述安装模块包括供操作者握住的手柄。
  8. 根据权利要求1所述基于三维追踪相机的三维超声成像系统，其特征在于，还包括数据集成及通信装置，用于将所述二维超声成像装置得到的二维超声图像和所述三维空间信息获取装置得到的三维空间信息进行整合并通过有线或无线的模式传输给三维重建模块。
  9. 一种基于三维追踪相机的三维超声成像方法，其特征在于，包括：
    S1、采用超声探头对目标的感兴趣区域进行超声扫描；
    S2、基于所述超声扫描生成所述目标的感兴趣区域的二维超声图像；
    S3、由三维空间信息获取装置获取所述超声探头的三维空间信息；
    S4、基于所述超声探头的三维空间信息和所述二维超声图像重建三维超声图像。
  10. 根据权利要求9所述的基于三维追踪相机的三维超声成像方法，其特征在于，步骤S3包括：
    S31、由所述三维空间信息获取装置的三维追踪相机获取环境图像；
    S32、基于所述环境图像生成初始三维空间信息；
    S33、对所述初始三维空间信息进行转换，生成所述探头的三维空间信息。
  11. 根据权利要求10所述的基于三维追踪相机的三维超声成像方法，其特征在于，在步骤S31中，使用多个安装于所述超声探头的不同部位的所述三维追踪相机获取多个环境图像；在步骤S32中，基于多个环境图像生成多组初始三维空间信息；在步骤S33中，对多组初始三维空间信息进行转换得到所述超声探头的三维空间信息。
  12. 根据权利要求10所述的基于三维追踪相机的三维超声成像方法，其特征在于，在步骤S32和S33之间还包括：
    基于测量到的所述初始三维空间信息的变化与所述二维超声图像的内容的变化对所述初始三维空间信息和所述二维超声图像在三维空间中的位置进行修正。
  13. 根据权利要求12所述的基于三维追踪相机的三维超声成像方法，其特征在于，在所述初始三维空间信息的变化大于三维空间信息变化阈值且所述二维超声图像的内容的变化小于二维超声图像内容变化阈值时，所述修正模块对所述初始三维空间信息进行修正。
  14. 根据权利要求12所述的基于三维追踪相机的三维超声成像方法，其特征在于，在所述初始三维空间信息的变化小于三维空间信息变化阈值且所述二维超声图像的内容的变化大于二维超声图像内容变化阈值时，所述修正模块对所述二维超声图像在所述三维空间中的位置进行修正。
PCT/CN2020/118249 2019-09-29 2020-09-28 基于三维追踪相机的三维超声成像方法和系统 WO2021057993A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CA3152758A CA3152758A1 (en) 2019-09-29 2020-09-28 Three-dimensional ultrasound imaging method and system based on three-dimensional tracking camera
AU2020355865A AU2020355865A1 (en) 2019-09-29 2020-09-28 Three-dimensional ultrasound imaging method and system based on three-dimensional tracking camera
JP2022519263A JP7375180B2 (ja) 2019-09-29 2020-09-28 ３次元トラッキングカメラをベースとする３次元超音波イメージング方法及びシステム
EP20869326.7A EP4035603A4 (en) 2019-09-29 2020-09-28 THREE-DIMENSIONAL ULTRASOUND IMAGING METHOD AND SYSTEM BASED ON A THREE-DIMENSIONAL TRACKING CAMERA
US17/706,575 US20220240897A1 (en) 2019-09-29 2022-03-28 Three-dimensional ultrasound imaging method and system based on three-dimensional tracking camera

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201910933434 2019-09-29
CN201910933434.X 2019-09-29
CN201911125286.5A CN112568935B (zh) 2019-09-29 2019-11-18 基于三维追踪相机的三维超声成像方法和系统
CN201911125286.5 2019-11-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/706,575 Continuation US20220240897A1 (en) 2019-09-29 2022-03-28 Three-dimensional ultrasound imaging method and system based on three-dimensional tracking camera

Publications (1)

Publication Number Publication Date
WO2021057993A1 true WO2021057993A1 (zh) 2021-04-01

Family

ID=75116998

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/118249 WO2021057993A1 (zh) 2019-09-29 2020-09-28 基于三维追踪相机的三维超声成像方法和系统

Country Status (7)

Country Link
US (1) US20220240897A1 (zh)
EP (1) EP4035603A4 (zh)
JP (1) JP7375180B2 (zh)
CN (1) CN112568935B (zh)
AU (1) AU2020355865A1 (zh)
CA (1) CA3152758A1 (zh)
WO (1) WO2021057993A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114533111A (zh) * 2022-01-12 2022-05-27 电子科技大学 一种基于惯性导航系统的三维超声重建系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080064953A1 (en) * 2006-09-13 2008-03-13 Tony Falco Incorporating Internal Anatomy In Clinical Radiotherapy Setups
CN101569541A (zh) * 2008-04-29 2009-11-04 香港理工大学 三维超声波成像系统
US20120277588A1 (en) * 2011-04-26 2012-11-01 General Electric Company Systems and methods for fusing sensor and image data for three-dimensional volume reconstruction
US20150327841A1 (en) * 2014-05-13 2015-11-19 Kabushiki Kaisha Toshiba Tracking in ultrasound for imaging and user interface
CN105659107A (zh) * 2013-08-20 2016-06-08 库瑞法博技术有限公司 光学追踪
CN109171808A (zh) * 2018-09-07 2019-01-11 东南大学 基于三维轮廓测量的三维超声成像系统

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1866871A4 (en) * 2005-03-30 2012-01-04 Worcester Polytech Inst THREE-DIMENSIONAL FREEHAND ULTRASOUND DIAGNOSIS IMAGING WITH SENSORS FOR DETERMINING THE POSITION AND ANGLE
JP5538667B2 (ja) 2007-04-26 2014-07-02 キヤノン株式会社 位置姿勢計測装置及びその制御方法
US10542962B2 (en) * 2009-07-10 2020-01-28 Elekta, LTD Adaptive radiotherapy treatment using ultrasound
US20110172526A1 (en) * 2010-01-12 2011-07-14 Martin Lachaine Feature Tracking Using Ultrasound
JP2013164643A (ja) * 2012-02-09 2013-08-22 Honda Elesys Co Ltd 画像認識装置、画像認識方法および画像認識プログラム
CN103750860B (zh) * 2014-01-20 2016-01-06 华南理工大学 一种无线三维超声成像方法和装置
CN107635468B (zh) * 2015-03-18 2020-10-13 韩国威泰有限公司 用于重建医学图像的设备和方法
JP6945334B2 (ja) * 2016-05-26 2021-10-06 キヤノンメディカルシステムズ株式会社 超音波診断装置及び医用画像処理装置
JP6745998B2 (ja) * 2016-12-16 2020-08-26 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 手術を誘導する画像を提供するシステム
WO2018209193A1 (en) * 2017-05-11 2018-11-15 Verathon Inc. Probability map-based ultrasound scanning
CN109223030B (zh) * 2017-07-11 2022-02-18 中慧医学成像有限公司 一种掌上式三维超声成像系统和方法
CN109259793A (zh) * 2018-07-11 2019-01-25 浙江京新术派医疗科技有限公司 超声校准系统、方法、电子设备及存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080064953A1 (en) * 2006-09-13 2008-03-13 Tony Falco Incorporating Internal Anatomy In Clinical Radiotherapy Setups
CN101569541A (zh) * 2008-04-29 2009-11-04 香港理工大学 三维超声波成像系统
US20120277588A1 (en) * 2011-04-26 2012-11-01 General Electric Company Systems and methods for fusing sensor and image data for three-dimensional volume reconstruction
CN105659107A (zh) * 2013-08-20 2016-06-08 库瑞法博技术有限公司 光学追踪
US20150327841A1 (en) * 2014-05-13 2015-11-19 Kabushiki Kaisha Toshiba Tracking in ultrasound for imaging and user interface
CN109171808A (zh) * 2018-09-07 2019-01-11 东南大学 基于三维轮廓测量的三维超声成像系统

Also Published As

Publication number Publication date
JP7375180B2 (ja) 2023-11-07
US20220240897A1 (en) 2022-08-04
CN112568935B (zh) 2024-06-25
CA3152758A1 (en) 2021-04-01
EP4035603A1 (en) 2022-08-03
JP2022549698A (ja) 2022-11-28
CN112568935A (zh) 2021-03-30
AU2020355865A1 (en) 2022-05-19
EP4035603A4 (en) 2022-11-09

Similar Documents

Publication Publication Date Title
US11320536B2 (en) Imaging device and monitoring device
EP2654606B1 (en) Motion blur compensation
EP1942662B1 (en) Automatic improvement of tracking data for intraoperative C-arm images in image guided surgery
JP6429772B2 (ja) ３ｄ走査および位置決めシステム
US7110593B2 (en) Method and system for generating three-dimensional data
JP4010753B2 (ja) 形状計測システムと撮像装置と形状計測方法及び記録媒体
CN107831180B (zh) X射线原位成像方法及系统
WO2019179344A1 (zh) 基于多传感器信息融合的三维超声成像方法、装置、终端机机器可读存储介质
CN107582098B (zh) 一种二维超声图像集合重构的三维超声成像方法
JP2004144557A (ja) ３次元視覚センサ
KR100361462B1 (ko) 모션 캡쳐 데이터 획득 방법
JP2016500547A5 (zh)
JP2007171048A (ja) 位置データ補間方法及び位置検出センサ及び位置測定装置
CN111487320A (zh) 基于三维光学成像传感器的三维超声成像方法和系统
US20140285655A1 (en) Apparatus and method for measuring shape of underwater object
JP2014006179A (ja) ステレオカメラキャリブレーション装置及び方法、並びに距離測定装置
WO2018216341A1 (ja) 情報処理装置、情報処理方法、及びプログラム
JP2008045983A (ja) ステレオカメラの調整装置
JP2019517362A (ja) ３次元イメージング方法及びシステム
KR101664365B1 (ko) 파이프에 대한 3차원 스캔 영상 생성 방법
WO2021057993A1 (zh) 基于三维追踪相机的三维超声成像方法和系统
JP2010217984A (ja) 像検出装置及び像検出方法
JPH07181024A (ja) ３次元形状計測方法および装置
CN204314239U (zh) X射线ct装置
CN104502378B (zh) X射线ct装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20869326

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022519263

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 3152758

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2020869326

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2020355865

Country of ref document: AU

Date of ref document: 20200928

Kind code of ref document: A