WO2021078064A1 - Ultrasonic scanning track planning method and apparatus, and storage medium and computer device - Google Patents

Ultrasonic scanning track planning method and apparatus, and storage medium and computer device Download PDF

Info

Publication number
WO2021078064A1
WO2021078064A1 PCT/CN2020/121233 CN2020121233W WO2021078064A1 WO 2021078064 A1 WO2021078064 A1 WO 2021078064A1 CN 2020121233 W CN2020121233 W CN 2020121233W WO 2021078064 A1 WO2021078064 A1 WO 2021078064A1
Authority
WO
WIPO (PCT)
Prior art keywords
curve
trajectory
point cloud
points
point
Prior art date
Application number
PCT/CN2020/121233
Other languages
French (fr)
Chinese (zh)
Inventor
李元伟
谈继勇
杨光耀
秦辉
Original Assignee
深圳瀚维智能医疗科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳瀚维智能医疗科技有限公司 filed Critical 深圳瀚维智能医疗科技有限公司
Publication of WO2021078064A1 publication Critical patent/WO2021078064A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0825Detecting organic movements or changes, e.g. tumours, cysts, swellings for diagnosis of the breast, e.g. mammography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data

Definitions

  • This application relates to the technical field of ultrasonic scanning, and in particular to a method, device, storage medium, and computing equipment for ultrasonic scanning trajectory planning.
  • Ultrasound ultrasound is a method of ultrasound examination. This non-surgical diagnostic examination is painless, harmless, and non-radioactive to the subject.
  • ultrasound can clearly display various cross-sectional images of internal organs and their surroundings. Since the images are rich in solidity and close to the true structure of anatomy, the application of ultrasound can be used for early diagnosis. Based on the many advantages of ultrasound examination, from professional medical disease diagnosis to daily health index assessment, its application range is becoming wider and wider.
  • the existing breast screening mode basically uses conventional ultrasound equipment to scan the breast area through the operator's hand-held ultrasound probe.
  • the scanning trace of the probe is usually subjective of the operator. Selection, there may be unscanned positions, and it is difficult to adjust the probe posture according to the breast shape of the corresponding area of the breast.
  • the existing breast ultrasound scanning method is difficult to obtain a comprehensive and accurate ultrasound image technical problem.
  • this application provides an ultrasonic scanning trajectory planning method, including:
  • Each curve in the curve skeleton is divided according to the preset curve division condition, and all the division points on each curve are taken, and the division points are expressed as ⁇ S ij , 0 ⁇ i ⁇ A, 0 ⁇ j ⁇ B i ⁇ , where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
  • the step of reconstructing a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton includes:
  • said calculating the attitude angle of each trajectory point includes:
  • the neighborhood point set of the trajectory point is extracted, and the PCA is calculated for the neighborhood point set to obtain the unit normal vector Vz of the neighborhood surface where the trajectory point is located, pointing to the outside of the body, and the trajectory point is calculated according to the following formula
  • the unit direction vectors Vx and Vy on the XY axis where:
  • the unit direction vector of the XYZ coordinate axis of the track point is converted into a representation form of Euler angles, and the attitude angle is extracted.
  • the method further includes:
  • the three-dimensional point cloud data is preprocessed, and the preprocessing includes point cloud downsampling, point cloud filtering, and point cloud smoothing.
  • the method further includes:
  • Import the travel limit data of the end of the ultrasound probe and filter out the unreachable points at the end of the ultrasound probe from the track points according to the travel limit data.
  • the method further includes:
  • This application also proposes an ultrasonic scanning trajectory planning device, including:
  • Point cloud acquisition module used to acquire 3D point cloud data of the chest area
  • a skeleton model reconstruction module configured to reconstruct a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton;
  • the curve segmentation module is used to segment each curve in the curve skeleton according to preset curve segmentation conditions, and take all the segmentation points on each curve, and the segmentation points are expressed as ⁇ S ij , 0 ⁇ i ⁇ A, 0 ⁇ j ⁇ B i ⁇ , where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
  • the trajectory generation module is used to select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
  • the posture angle calculation module is used to extract multiple trajectory points from the scanning trajectory curve and calculate the posture angle of each trajectory point.
  • This application also proposes a computer program storage medium in which computer program codes are stored, and when the computer program codes are executed by a processor, the steps of the above-mentioned ultrasonic scanning trajectory planning method are realized.
  • the present application also provides a computer device, including a processor, a memory, and computer program code stored in the memory.
  • the processor implements the steps of the ultrasonic scanning trajectory planning method when calling the computer program code.
  • this application uses a fully automatic and mechanized scanning method to perform ultrasound scanning on the user’s breast area, so as to make a comprehensive and accurate judgment on the physiological condition of the breast and its surrounding organs and tissues to avoid causes.
  • Human operations lead to the occurrence of incomplete coverage and missing information of the ultrasound images obtained by the scan; and this fully automatic mechanized scan method relies on the computer based on the three-dimensional point cloud data of the chest area in the process of performing the ultrasound scan.
  • FIG. 1 is a schematic structural diagram of an example environment in which multiple embodiments disclosed in this application can be implemented;
  • FIG. 3 is a schematic flowchart of another embodiment of the ultrasonic scanning trajectory planning method of this application.
  • FIG. 5 is a schematic diagram of an original three-dimensional point cloud in multiple embodiments disclosed in this application.
  • FIG. 6 is a schematic diagram of a curved skeleton obtained through skeleton model reconstruction in multiple embodiments disclosed in this application;
  • FIG. 7 is a schematic diagram of functional modules of an embodiment of the ultrasonic scanning trajectory planning device of this application.
  • FIG. 8 is a schematic structural diagram of a computer device in which multiple embodiments disclosed in this application can be implemented.
  • This application provides an ultrasound scanning trajectory planning method, which aims to formulate the best ultrasound scanning trajectory according to the chest area of each user, so that the breast ultrasound scanning equipment can perform the scanning process according to the ultrasound scanning trajectory , And then generate comprehensive and accurate ultrasound images containing information.
  • the aforementioned breast ultrasound scanning equipment mainly includes a scanning actuator 10, a bed 20, and a point cloud acquisition device 30, wherein the scanning actuator 10 includes a host 11,
  • the robotic arm 12 connected to the host 11 and the ultrasonic probe 13 installed at the execution end of the robotic arm 12.
  • the host 11 has corresponding hardware capable of implementing communication, data processing and motion control functions, and the host 11 also has The infrastructure for installing the robotic arm 12, for example, the robotic arm 12 is configured to provide a multi-axis structure with three linear motion degrees of freedom and two or more rotational degrees of freedom, so as to ensure that the ultrasonic probe 13 can be based on the surface of the area to be scanned.
  • the shape is adapted for posture transformation.
  • the robotic arm 12 can be a five-axis robotic arm or a six-axis robotic arm.
  • the bed 20 can be a fixed support structure or a movable structure that can provide position adjustment. For example, by setting a lifting mechanism to adjust the height of the support surface of the bed 20, or by setting a horizontal moving mechanism to adjust The horizontal position of the supporting surface of the lying bed 20 can adjust the user's initial position without requiring the user to move the body.
  • the point cloud acquisition device 30 is arranged above the bed 20. In order to acquire three-dimensional point cloud data more comprehensively, two sets of point cloud acquisition devices 30 can be configured according to the structure shown in FIG. 1. In this example, the user's body is used. The longitudinal direction is the reference direction for arranging the point cloud acquisition device 30. In other embodiments, the point cloud acquisition device 30 is arranged in the lateral direction of the user's body as the reference direction.
  • the point cloud acquisition device 30 in this embodiment can also be structured.
  • the light sensor can of course also be a lidar.
  • the ultrasonic scanning trajectory planning method proposed in this application includes:
  • Step S10 acquiring three-dimensional point cloud data of the chest area.
  • the user’s breast area (for women) is a part that is susceptible to changes in its shape due to the influence of its own posture and external forces.
  • the breast area needs to be beamed before performing a comprehensive scan.
  • Shape for example, by wearing a chest vest with a certain elasticity to adjust the shape of the chest area and maintain the stability of the shape. Therefore, for each ultrasound scanning process, generally speaking, it is necessary to reacquire 3D point cloud data.
  • the user first lays on the lying bed 20 and adjusts the position according to the actual situation until the requirements of 3D point cloud data acquisition and ultrasound scanning are met, and then the 3D point cloud of the chest area is acquired by the point cloud acquisition device 30 Data, considering that the acquired original point cloud data covers a wide range, the original point cloud data needs to be filtered by boundaries to simplify the difficulty of post-processing of the data.
  • the three-dimensional structure of the chest area can be accurately described, thereby generating the motion trajectory of the ultrasound probe 13 conforming to the actual scanning contact surface through the later scanning trajectory planning algorithm.
  • the ultrasonic scanning trajectory planning method further includes:
  • the preprocessing includes point cloud downsampling, point cloud filtering and point cloud smoothing.
  • This step is performed after the 3D point cloud data is obtained.
  • point cloud data that is more suitable for the ultrasound scanning application scenario can be obtained, while reducing the complexity of the data and improving the data of the device Processing efficiency.
  • the input point cloud is relatively dense, and all processing takes a long time. Therefore, the input point cloud is down-sampled first to reduce the density of the point cloud and speed up the processing speed.
  • point cloud downsampling is to take a point from the original point cloud at a certain spatial distance to represent other points in its neighborhood, so that a more sparse point cloud can be obtained.
  • the specific point cloud downsampling setting standard It can be selected according to the data collection specifications of the point cloud collection device and the accuracy of the later data processing, and there is no restriction here.
  • the point cloud in the chest area should form a smooth continuous surface, but due to various reasons, there will be some abnormal point clouds (such as several isolated discrete points). These abnormal point clouds can be filtered out by point cloud filtering. , Output a higher quality point cloud for use in subsequent steps.
  • the filtered point cloud is not smooth due to the measurement error of the sensor, such as water wave-like ripples. Therefore, the point cloud is further smoothed to make the surface of the point cloud smoother.
  • step S20 a skeleton model of the chest region structure is reconstructed according to the three-dimensional point cloud data to obtain a curved skeleton.
  • the data volume of the acquired three-dimensional point cloud data is relatively large, and the model needs to be reconstructed to meet the application requirements of the scanning trajectory planning algorithm while simplifying the data.
  • the point cloud is sliced according to a preset direction, and the direction of the human body is taken as a reference, and the slice operation is mainly performed along the horizontal and vertical directions of the body, and in the optimal slicing constraint condition, the slicing operation is performed at equal intervals. Slicing, so as to obtain a segment of the sub-point cloud of equal width, the width of each segment of the sub-point cloud can be flexibly adjusted according to the actual situation.
  • the ultrasonic probe 13 adopts a strip scanning method, and the direction of the strip scanning is along the longitudinal direction of the body, so point cloud slices are performed along the transverse direction of the body.
  • This scanning method affects the movement mechanism. The requirements are low, and can guarantee the quality of ultrasound images.
  • step S20 includes:
  • Step S201 Obtain several segment point clouds by transversely slicing the three-dimensional point cloud data
  • step S202 a Bezier curve is used to perform curve fitting on each segment of the sub-point cloud to obtain a curve skeleton.
  • the reconstructed curved skeleton is a more stable and reliable representation of the structure of the chest region, which is conducive to the post-processing of the algorithm.
  • this step for the fitting operation of the Bezier curve, reference can be made to the detailed description of this aspect in the prior art, which will not be repeated here.
  • step S30 each curve in the curve skeleton is divided according to the preset curve dividing condition, and all the dividing points on each curve are taken.
  • the horizontally distributed curves are divided into equal arc lengths, and the division distance is set according to the coverage area of the ultrasound probe 13, so as to ensure that the ultrasound probe 13 is in During the scanning process, the complete area to be scanned can be covered, and the overlap area can be reduced at the same time.
  • the obtained segmentation point is expressed as ⁇ S ij , 0 ⁇ i ⁇ A, 0 ⁇ j ⁇ B i ⁇ , where A is the number of curves in the curve skeleton, and B i is the i-th curve
  • A is the number of curves in the curve skeleton
  • B i is the i-th curve
  • the number of division points on the above, i and j are both positive integers.
  • step S40 multiple groups of segmentation points are selected from the segmentation point set according to the preset ultrasonic scanning direction, and each group of segmentation points is connected into a scanning trajectory curve.
  • the simplest grouping method is to select The dividing points with the same number j on each curve in the curve skeleton form a group, so that a complete trajectory ⁇ S 0j , S 1j , S 2j ,..., S Aj ⁇ can be obtained.
  • any other applicable method may also be used to group the dividing points.
  • step S50 multiple trajectory points are extracted from the scanning trajectory curve, and the attitude angle of each trajectory point is calculated.
  • the trajectory points are the aforementioned segmentation points.
  • This method of extracting trajectory points can simplify the data processing process.
  • one or more points between adjacent segmentation points can also be extracted as trajectory points.
  • the mechanism motion parameters of the breast ultrasound scanning device need to be combined to avoid data redundancy.
  • the ultrasonic probe 13 can be controlled in the motion control program to move to the specific position of the area to be scanned, and according to the Roll and Pitch attitude angles, it can be controlled in the motion control program.
  • the angle and posture of the ultrasonic probe 13 should be adjusted to make the surface of the probe closely fit the surface of the area to be scanned.
  • the aforementioned calculation of the attitude angle of each trajectory point mainly adopts the following algorithm, and the specific steps include:
  • Step S501 Extract the neighborhood point set of the trajectory point, and obtain the unit normal vector Vz of the neighborhood surface where the trajectory point is located, pointing to the outside of the body, by calculating the PCA of the neighborhood point set.
  • the neighborhood point set extracted with the track point as the center can select the boundary radius according to the desired calculation accuracy.
  • the extraction range of the neighborhood point set is set Afterwards, the unit normal vector Vz pointing to the outside of the body of the surface of the neighborhood where the track point is located can be obtained by calculating the PCA of the neighborhood point set.
  • step S503 the unit direction vector of the XYZ coordinate axis of the track point is converted into the representation form of Euler angles, and the attitude angle is extracted.
  • attitude angles in three directions can actually be obtained. Specifically, several attitude angles can be extracted, which can be combined with the degree of freedom of motion provided by the ultrasonic probe 13. Take extracting the attitude angle of Roll and Pitch as an example.
  • the ultrasonic scanning trajectory planning method Also includes:
  • the movement limit of the ultrasonic probe 13 can be calibrated and stored in the form of a data table for later use.
  • the track points are verified according to the data table, which can avoid accidents in the scanning process of the equipment.
  • smooth filtering is performed on each scanning trajectory curve, so that the ultrasonic probe 13 moves more smoothly during the scanning process, and reduces local squeezing of the human body.
  • the ultrasonic scanning trajectory planning method of the present application uses a fully automatic mechanized scanning method to perform ultrasonic scanning on the user's breast area, so as to make a comprehensive and accurate judgment on the physiological condition of the breast and its surrounding organs and tissues.
  • the fully automatic mechanized scanning method depends on the computer according to the chest area during the process of performing the ultrasound scan.
  • the scanning trajectory generated by the calculation of the three-dimensional point cloud data enables the ultrasound probe to adjust the scanning posture according to the shape of the contact area to ensure that the information covered by each frame of the acquired ultrasound image is comprehensive and accurate.
  • the ultrasonic scanning trajectory planning device includes:
  • the point cloud acquisition module 100 is used to acquire three-dimensional point cloud data of the chest area;
  • the skeleton model reconstruction module 200 is used to reconstruct a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton;
  • the curve segmentation module 300 is used to segment each curve in the curve skeleton according to preset curve segmentation conditions, and take all the segmentation points on each curve, and the segmentation points are expressed as ⁇ S ij , 0 ⁇ i ⁇ A, 0 ⁇ j ⁇ B i ⁇ , where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
  • the trajectory generation module 400 is used to select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
  • the posture angle calculation module 500 is used to extract multiple trajectory points from the scanning trajectory curve and calculate the posture angle of each trajectory point.
  • Each module in the above-mentioned ultrasonic scanning trajectory planning device can be implemented in whole or in part by software, hardware and a combination thereof.
  • the above-mentioned modules may be embedded in the computer equipment in the form of hardware or independent of the computer equipment, and may also be stored in the memory in the server in the form of software, so that the computer equipment can call and execute the operations corresponding to the above-mentioned modules.
  • the computer equipment may be a central processing unit (CPU), a microcomputer equipment, a single-chip microcomputer, and so on.
  • CPU central processing unit
  • microcomputer equipment a single-chip microcomputer
  • This application also provides a computer program storage medium in which computer program codes are stored, and when the computer program codes are executed by a processor, the following steps are implemented:
  • the present application also provides a computer device.
  • the computer device includes a processor 40, a memory 50, and computer program code stored in the memory 50.
  • the processor 40 calls the computer program code, the foregoing The steps of an ultrasonic scanning trajectory planning method provided in each embodiment.
  • the computer device may be a personal computer or a server.
  • the computer device includes a processor 40, a memory 50, and a communication interface (not shown) connected by a system bus.
  • the processor 40 is used to provide calculation and control capabilities, and support the operation of the entire computer equipment.
  • the memory 50 includes a non-volatile storage medium and an internal memory. An operating system and a computer program are stored in the non-volatile storage medium, and the computer program is executed by the processor 40 to implement an ultrasonic scanning trajectory planning method.
  • the internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium.
  • the communication interface is used to communicate with an external server or terminal through a network connection.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Radiology & Medical Imaging (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

An ultrasonic scanning track planning method, comprising: acquiring three-dimensional point cloud data of a chest area (S10); performing skeleton model reconstruction on the structure of the chest area according to the three-dimensional point cloud data to obtain a curve skeleton (S20); segmenting each curve in the curve skeleton according to a preset curve segmentation condition, and obtaining all segmentation points on each curve (S30); selecting a plurality of groups of segmentation points from a segmentation point set according to a preset ultrasonic scanning direction, and connecting each group of segmentation points to form a scanning track curve (S40); and extracting a plurality of track points from the scanning track curve, and calculating an attitude angle of each track point (S50). The generated scanning track is calculated according to the three-dimensional point cloud data of the chest area, such that an ultrasonic probe can adjust the scanning attitude according to the shape of a contact area, so as to ensure that the information covered by each frame of acquired ultrasonic image is comprehensive and accurate.

Description

超声扫查轨迹规划方法、装置、存储介质及计算机设备Ultrasonic scanning trajectory planning method, device, storage medium and computer equipment 技术领域Technical field
本申请涉及超声扫查技术领域,尤其涉及一种超声扫查轨迹规划方法、装置、存储介质及计算设备。This application relates to the technical field of ultrasonic scanning, and in particular to a method, device, storage medium, and computing equipment for ultrasonic scanning trajectory planning.
背景技术Background technique
超声超声波检查是超声波检查的一种方式,这种非手术的诊断性检查,对受检者无痛苦、无损伤、无放射性。并且,超声可以清晰地显示内脏器官及器官周围的各种断面图像,由于图像富于实体感,接近于解剖的真实结构,所以应用超声检查可以早期明确诊断。基于超声检查的诸多优势,从专业的医疗疾病诊断到日常化的健康指标评估,其应用范围越来越广。Ultrasound ultrasound is a method of ultrasound examination. This non-surgical diagnostic examination is painless, harmless, and non-radioactive to the subject. In addition, ultrasound can clearly display various cross-sectional images of internal organs and their surroundings. Since the images are rich in solidity and close to the true structure of anatomy, the application of ultrasound can be used for early diagnosis. Based on the many advantages of ultrasound examination, from professional medical disease diagnosis to daily health index assessment, its application range is becoming wider and wider.
随着医疗诊断技术的发展以及经济水平的提高,越来越多女性开始关注乳腺健康,而通过超声可以方便快捷地对乳腺生理状况进行初步判断,因此不管是公立医疗机构,还是盈利性健康服务机构,推出了多种乳腺筛查服务,以满足女性用户的需求。但是,现有的乳腺筛查模式,基本上是借助于常规的超声设备,通过操作人员手持超声探头进行乳房区域的扫查,在扫查过程中,探头的扫查轨迹通常是操作人员的主观选择,可能存在未扫描到的位置,并且探头姿态也难以根据乳腺对应区域的乳房形状进行适应性调整,还可能存在超声图像信息缺失的现象,总的来说,仅依靠操作人员的主观操作来实现对乳房的全面扫查,存在诸多弊端,不利于对乳腺生理状况做出准确判断。With the development of medical diagnosis technology and the improvement of economic level, more and more women are paying attention to breast health. Ultrasound can quickly and easily make preliminary judgments on the physiological condition of breasts. Therefore, whether it is a public medical institution or a profitable health service Institutions have launched a variety of breast screening services to meet the needs of female users. However, the existing breast screening mode basically uses conventional ultrasound equipment to scan the breast area through the operator's hand-held ultrasound probe. During the scanning process, the scanning trace of the probe is usually subjective of the operator. Selection, there may be unscanned positions, and it is difficult to adjust the probe posture according to the breast shape of the corresponding area of the breast. There may also be the phenomenon of lack of ultrasound image information. In general, it only depends on the subjective operation of the operator. There are many drawbacks to achieve a comprehensive breast scan, which is not conducive to making accurate judgments on the physiological condition of the breast.
技术问题technical problem
现有的乳房超声扫查方式难以获取全面、准确的超声图像的技术问题。The existing breast ultrasound scanning method is difficult to obtain a comprehensive and accurate ultrasound image technical problem.
技术解决方案Technical solutions
应用于使用B型超声探头进行乳房自动扫查的设备中。It is used in equipment that uses B-type ultrasound probe to automatically scan breasts.
为实现上述目的,本申请提供一种超声扫查轨迹规划方法,包括:In order to achieve the above objective, this application provides an ultrasonic scanning trajectory planning method, including:
获取胸部区域的三维点云数据;Obtain 3D point cloud data of the chest area;
根据所述三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线 骨架;Performing skeleton model reconstruction on the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton;
按照预设的曲线分割条件对所述曲线骨架中的各条曲线进行分割,并取各条曲线上的所有分割点,所述分割点表示为{S ij,0≤i<A,0≤j<B i},其中A是所述曲线骨架中曲线的条数,B i是第i条曲线上的分割点数; Each curve in the curve skeleton is divided according to the preset curve division condition, and all the division points on each curve are taken, and the division points are expressed as {S ij , 0≤i<A, 0≤j <B i }, where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
根据预设的超声扫查方向从分割点集合中选取多组分割点,并将每一组分割点连接成一条扫查轨迹曲线;Select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
从所述扫查轨迹曲线中提取多个轨迹点,并计算各轨迹点的姿态角。Extract a plurality of trajectory points from the scanning trajectory curve, and calculate the attitude angle of each trajectory point.
优选地,所述根据所述三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架包括:Preferably, the step of reconstructing a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton includes:
通过对所述三维点云数据进行横向切片以得到若干段子点云;Obtaining a number of sub-point clouds by performing transverse slicing of the three-dimensional point cloud data;
使用贝塞尔曲线对每一段所述子点云进行曲线拟合以得到所述曲线骨架。Use Bezier curves to perform curve fitting on each segment of the sub-point cloud to obtain the curve skeleton.
优选地,所述计算各轨迹点的姿态角包括:Preferably, said calculating the attitude angle of each trajectory point includes:
提取所述轨迹点的邻域点集,并通过对所述邻域点集求PCA得到所述轨迹点所在邻域曲面的指向身体外部的单位法向量Vz,并按照以下公式计算所述轨迹点在XY轴的单位方向向量Vx、Vy,其中:The neighborhood point set of the trajectory point is extracted, and the PCA is calculated for the neighborhood point set to obtain the unit normal vector Vz of the neighborhood surface where the trajectory point is located, pointing to the outside of the body, and the trajectory point is calculated according to the following formula The unit direction vectors Vx and Vy on the XY axis, where:
Vy=Vz×[0 0 1] T Vy=Vz×[0 0 1] T
Vx=Vy×VzVx=Vy×Vz
将所述轨迹点XYZ坐标轴的单位方向向量转换为欧拉角的表示形式,并提取所述姿态角。The unit direction vector of the XYZ coordinate axis of the track point is converted into a representation form of Euler angles, and the attitude angle is extracted.
优选地,在所述获取胸部区域的三维点云数据的步骤之后,所述方法还包括:Preferably, after the step of obtaining the three-dimensional point cloud data of the breast area, the method further includes:
对所述三维点云数据进行预处理,所述预处理包括点云降采样、点云滤波和点云平滑。The three-dimensional point cloud data is preprocessed, and the preprocessing includes point cloud downsampling, point cloud filtering, and point cloud smoothing.
优选地,在所述计算各轨迹点的姿态角的步骤之后,所述方法还包括:Preferably, after the step of calculating the attitude angle of each trajectory point, the method further includes:
导入超声探头末端的行程极限数据,并根据所述行程极限数据从所述轨迹点中滤除所述超声探头末端不可到达的点。Import the travel limit data of the end of the ultrasound probe, and filter out the unreachable points at the end of the ultrasound probe from the track points according to the travel limit data.
优选地,在所述导入超声探头末端的行程极限数据,并根据所述行程极限数据从所述轨迹点中滤除所述超声探头末端不可到达的点的步骤之后,所述方法还包括:Preferably, after the step of importing the travel limit data of the end of the ultrasound probe, and filtering out the unreachable points at the end of the ultrasound probe from the trajectory point according to the travel limit data, the method further includes:
对每条扫查轨迹曲线进行平滑滤波。Smooth filtering is performed on each scan trajectory curve.
本申请还提出一种超声扫查轨迹规划装置,包括:This application also proposes an ultrasonic scanning trajectory planning device, including:
点云获取模块,用于获取胸部区域的三维点云数据;Point cloud acquisition module, used to acquire 3D point cloud data of the chest area;
骨架模型重建模块,用于根据所述三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架;A skeleton model reconstruction module, configured to reconstruct a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton;
曲线分割模块,用于按照预设的曲线分割条件对所述曲线骨架中的各条曲线进行分割,并取各条曲线上的所有分割点,所述分割点表示为{S ij,0≤i<A,0≤j<B i},其中A是所述曲线骨架中曲线的条数,B i是第i条曲线上的分割点数; The curve segmentation module is used to segment each curve in the curve skeleton according to preset curve segmentation conditions, and take all the segmentation points on each curve, and the segmentation points are expressed as {S ij , 0≤i <A, 0≤j<B i }, where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
轨迹生成模块,用于根据预设的超声扫查方向从分割点集合中选取多组分割点,并将每一组分割点连接成一条扫查轨迹曲线;The trajectory generation module is used to select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
姿态角计算模块,用于从所述扫查轨迹曲线中提取多个轨迹点,并计算各轨迹点的姿态角。The posture angle calculation module is used to extract multiple trajectory points from the scanning trajectory curve and calculate the posture angle of each trajectory point.
本申请还提出一种计算机程序存储介质,所述计算机程序存储介质中存储有计算机程序代码,该计算机程序代码被处理器执行时实现上述超声扫查轨迹规划方法的步骤。This application also proposes a computer program storage medium in which computer program codes are stored, and when the computer program codes are executed by a processor, the steps of the above-mentioned ultrasonic scanning trajectory planning method are realized.
本申请还提供一种计算机设备,包括处理器、存储器和存储在所述存储器中的计算机程序代码,所述处理器在调用所述计算机程序代码时,实现上述超声扫查轨迹规划方法的步骤。The present application also provides a computer device, including a processor, a memory, and computer program code stored in the memory. The processor implements the steps of the ultrasonic scanning trajectory planning method when calling the computer program code.
有益效果Beneficial effect
相较于现有技术,本申请通过采用全自动机械化的扫查方式来对用户乳房区域进行超声扫查,从而对乳腺及其周边器官、组织的生理状况进行全面、准确的判断,以避免因人为操作而导致扫查得到的超声图像覆盖面不全、信息缺失等情况的发生;并且,该全自动机械化的扫查方式在执行超声扫查的过程中,依赖于计算机根据胸部区域的三维点云数据计算生成的扫查轨迹,以使超声探头能够根据接触区域的形状调整扫查姿态,保证获取到的每一帧超声图像所涵盖的信息全面、准确。Compared with the prior art, this application uses a fully automatic and mechanized scanning method to perform ultrasound scanning on the user’s breast area, so as to make a comprehensive and accurate judgment on the physiological condition of the breast and its surrounding organs and tissues to avoid causes. Human operations lead to the occurrence of incomplete coverage and missing information of the ultrasound images obtained by the scan; and this fully automatic mechanized scan method relies on the computer based on the three-dimensional point cloud data of the chest area in the process of performing the ultrasound scan. ???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? Calculate the generated scanning trajectory, so that the ultrasound probe can adjust the scanning attitude according to the shape of the contact area, and ensure that the information covered by each frame of the acquired ultrasound image is comprehensive and accurate.
附图说明Description of the drawings
图1为本申请公开的多个实施例可以在其中实施的示例环境的结构示意图;FIG. 1 is a schematic structural diagram of an example environment in which multiple embodiments disclosed in this application can be implemented;
图2为本申请的超声扫查轨迹规划方法一实施例的流程示意图;2 is a schematic flowchart of an embodiment of the ultrasonic scanning trajectory planning method of this application;
图3为本申请的超声扫查轨迹规划方法另一实施例的流程示意图;3 is a schematic flowchart of another embodiment of the ultrasonic scanning trajectory planning method of this application;
图4为本申请的超声扫查轨迹规划方法又一实施例的流程示意图;4 is a schematic flowchart of another embodiment of the ultrasonic scanning trajectory planning method of this application;
图5为本申请公开的多个实施例中原始三维点云的示意图;FIG. 5 is a schematic diagram of an original three-dimensional point cloud in multiple embodiments disclosed in this application;
图6为本申请公开的多个实施例中经过骨架模型重建得到的曲线骨架示意图;6 is a schematic diagram of a curved skeleton obtained through skeleton model reconstruction in multiple embodiments disclosed in this application;
图7为本申请的超声扫查轨迹规划装置一实施例的功能模块示意图;FIG. 7 is a schematic diagram of functional modules of an embodiment of the ultrasonic scanning trajectory planning device of this application;
图8为本申请公开的多个实施例能够在其中实施的计算机设备的结构示意图。FIG. 8 is a schematic structural diagram of a computer device in which multiple embodiments disclosed in this application can be implemented.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
本申请的实施方式Implementation of this application
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, and not used to limit the application.
本申请提供一种超声扫查轨迹规划方法,其目的在于根据每位用户的胸部区域情况制定最佳的超声扫查轨迹,以使乳房超声扫查设备能够根据该超声扫查轨迹执行扫查过程,进而生成包含信息全面、准确的超声图像。This application provides an ultrasound scanning trajectory planning method, which aims to formulate the best ultrasound scanning trajectory according to the chest area of each user, so that the breast ultrasound scanning equipment can perform the scanning process according to the ultrasound scanning trajectory , And then generate comprehensive and accurate ultrasound images containing information.
如图1所示,为了给该方法的实施提供环境基础,前述乳房超声扫查设备主要包括扫查执行机构10、躺床20和点云获取装置30,其中扫查执行机构10包括主机11、与主机11连接的机械臂12以及安装在该机械臂12的执行末端处的超声探头13,本实施例中,主机11具有能够实现通信、数据处理和运动控制功能的相应硬件,主机11还具有用于安装机械臂12的基础架构,比如机械臂12被构造成能够提供三个直线运动自由度和两个以上旋转自由度的多轴结构,从而保证超声探头13能够根据待扫查区域的表面形状作适应性的姿态变换,具体应用时,机械臂12可以是五轴机械臂,或者是六轴机械臂。躺床20可以是固定式的支撑结构,也可以设置成能够提供位置调节的活动结构,比如通过设置升降机构,以调节躺床20的支撑面的高度,又比如通过设置水平移动机构,以调节躺床20的支撑面的水平位置,从而在不需要用户挪动身躯的情况下调节用户的初始位置。点云获取装置30设置在躺床20的上方,为了更加全面地获取三维点云数据,可以按照图1所示结构的指引,配置两套点云获取装置30,此示例中是以用户身躯的纵向为参照方向布置点云获取装置30的,在其它实施方案中,以用户身躯的横向为参照方向布置点云获取装置30也是能够满足要求的,本实施例的点云获取装置30可以是结构光传感器,当然也可以是激光雷达。As shown in Figure 1, in order to provide an environmental basis for the implementation of the method, the aforementioned breast ultrasound scanning equipment mainly includes a scanning actuator 10, a bed 20, and a point cloud acquisition device 30, wherein the scanning actuator 10 includes a host 11, The robotic arm 12 connected to the host 11 and the ultrasonic probe 13 installed at the execution end of the robotic arm 12. In this embodiment, the host 11 has corresponding hardware capable of implementing communication, data processing and motion control functions, and the host 11 also has The infrastructure for installing the robotic arm 12, for example, the robotic arm 12 is configured to provide a multi-axis structure with three linear motion degrees of freedom and two or more rotational degrees of freedom, so as to ensure that the ultrasonic probe 13 can be based on the surface of the area to be scanned. The shape is adapted for posture transformation. In specific applications, the robotic arm 12 can be a five-axis robotic arm or a six-axis robotic arm. The bed 20 can be a fixed support structure or a movable structure that can provide position adjustment. For example, by setting a lifting mechanism to adjust the height of the support surface of the bed 20, or by setting a horizontal moving mechanism to adjust The horizontal position of the supporting surface of the lying bed 20 can adjust the user's initial position without requiring the user to move the body. The point cloud acquisition device 30 is arranged above the bed 20. In order to acquire three-dimensional point cloud data more comprehensively, two sets of point cloud acquisition devices 30 can be configured according to the structure shown in FIG. 1. In this example, the user's body is used. The longitudinal direction is the reference direction for arranging the point cloud acquisition device 30. In other embodiments, the point cloud acquisition device 30 is arranged in the lateral direction of the user's body as the reference direction. The point cloud acquisition device 30 in this embodiment can also be structured. The light sensor can of course also be a lidar.
至此,已经详细介绍了本申请各个实施例的应用环境和相关设备的硬件结构和功能,并且上述乳房超声扫查设备的结构组成仅为基本功能的示例,并不是对乳房超声扫查设备实现方式的限制。下面,将基于上述应用环境和相关设备,详细介绍超声扫查轨迹规划方法的各个实施例。So far, the application environment of each embodiment of the present application and the hardware structure and functions of the related equipment have been described in detail, and the structural composition of the above-mentioned breast ultrasound scanning device is only an example of the basic functions, and is not an implementation method of the breast ultrasound scanning device. limits. Below, based on the above-mentioned application environment and related equipment, various embodiments of the ultrasonic scanning trajectory planning method will be introduced in detail.
如图2所示,在一实施例中,本申请提出的超声扫查轨迹规划方法包括:As shown in FIG. 2, in an embodiment, the ultrasonic scanning trajectory planning method proposed in this application includes:
步骤S10,获取胸部区域的三维点云数据。Step S10, acquiring three-dimensional point cloud data of the chest area.
用户的胸部区域(针对女性)作为容易受到自身姿势和外力影响而产生形状变化的部位,为了满足前述乳房超声扫查设备的技术要求,在执行全面的扫查动作前,需要对胸部区域进行束形,比如通过穿上具有一定弹性的束胸背心来调整胸部区域的形状,并保持外形的稳定性。因此,针对每一次的超声扫查过程,一般而言,均需要重新采集三维点云数据。在实际应用时,用户先平躺在躺床20上,并根据实际情况调整位置,直至满足三维点云数据采集和超声扫查的要求,然后通过点云获取装置30采集胸部区域的三维点云数据,考虑到获取的原始点云数据覆盖面较广,需要对原始点云数据进行界限过滤,以简化数据的后期处理难度。通过采集胸部区域的三维点云数据,可以准确地描述胸部区域的三维结构,由此通过后期的扫查轨迹规划算法生成符合实际扫查接触面的超声探头13运动轨迹。The user’s breast area (for women) is a part that is susceptible to changes in its shape due to the influence of its own posture and external forces. In order to meet the technical requirements of the aforementioned breast ultrasound scanning equipment, the breast area needs to be beamed before performing a comprehensive scan. Shape, for example, by wearing a chest vest with a certain elasticity to adjust the shape of the chest area and maintain the stability of the shape. Therefore, for each ultrasound scanning process, generally speaking, it is necessary to reacquire 3D point cloud data. In actual application, the user first lays on the lying bed 20 and adjusts the position according to the actual situation until the requirements of 3D point cloud data acquisition and ultrasound scanning are met, and then the 3D point cloud of the chest area is acquired by the point cloud acquisition device 30 Data, considering that the acquired original point cloud data covers a wide range, the original point cloud data needs to be filtered by boundaries to simplify the difficulty of post-processing of the data. By collecting the three-dimensional point cloud data of the chest area, the three-dimensional structure of the chest area can be accurately described, thereby generating the motion trajectory of the ultrasound probe 13 conforming to the actual scanning contact surface through the later scanning trajectory planning algorithm.
进一步地,在一较佳实施例中,该超声扫查轨迹规划方法还包括:Further, in a preferred embodiment, the ultrasonic scanning trajectory planning method further includes:
对三维点云数据进行预处理,该预处理包括点云降采样、点云滤波和点云平滑。Preprocessing the three-dimensional point cloud data, the preprocessing includes point cloud downsampling, point cloud filtering and point cloud smoothing.
该步骤是在获取到三维点云数据之后执行的,通过对三维点云数据进行预处理操作,可以获得更加符合超声扫查应用场景的点云数据,同时降低数据的复杂程度,提高设备的数据处理效率。具体地,输入的点云比较稠密,全部处理的话耗时较长,因此先对输入点云进行降采样,降低点云的密度,加快处理速度。直观上来说,点云降采样就是对原始点云每间隔一定的空间距离取一个点代表其邻域内的其它点,这样就可以得到一个更稀疏的点云,具体的点云降采样设定标准可以根据点云采集装置的数据采集规格和后期数据处理精度选择,在此不作限制。此外,理论上胸部区域的点云应当构成一个平滑连续的曲面,但由于各种原因会存在一些异常点云(如孤立的几个离散点),通过点云滤波就可以滤除这些异常点云,输出一个更高质量的点云供后续步骤使用。滤波后的点云由于传感器的测量误差,会有不平滑的现象,如水浪般的波纹,因此,进一步对点云进行平滑处理,使点云曲面更加平滑。This step is performed after the 3D point cloud data is obtained. By preprocessing the 3D point cloud data, point cloud data that is more suitable for the ultrasound scanning application scenario can be obtained, while reducing the complexity of the data and improving the data of the device Processing efficiency. Specifically, the input point cloud is relatively dense, and all processing takes a long time. Therefore, the input point cloud is down-sampled first to reduce the density of the point cloud and speed up the processing speed. Intuitively speaking, point cloud downsampling is to take a point from the original point cloud at a certain spatial distance to represent other points in its neighborhood, so that a more sparse point cloud can be obtained. The specific point cloud downsampling setting standard It can be selected according to the data collection specifications of the point cloud collection device and the accuracy of the later data processing, and there is no restriction here. In addition, theoretically the point cloud in the chest area should form a smooth continuous surface, but due to various reasons, there will be some abnormal point clouds (such as several isolated discrete points). These abnormal point clouds can be filtered out by point cloud filtering. , Output a higher quality point cloud for use in subsequent steps. The filtered point cloud is not smooth due to the measurement error of the sensor, such as water wave-like ripples. Therefore, the point cloud is further smoothed to make the surface of the point cloud smoother.
步骤与S20,根据三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架。In step S20, a skeleton model of the chest region structure is reconstructed according to the three-dimensional point cloud data to obtain a curved skeleton.
如图5所示,获取到的三维点云数据的数据量较为庞大,需要对其进行模型的重建,在简化数据的同时,满足扫查轨迹规划算法的应用要求。具体地,根据预设方向对点云进行切片,以人体身躯的方向为参照,主要沿身躯的横向和纵向这两个方向进行切片操作,并且在优选的切片约束条件中,以等间距的方式切片,从而获得一段段等宽的子点云,每段子点云的宽度可以根据实际情况灵活调整。作为一种可能的实施方式,超声探头13采用条形扫查的方式,并且该条形扫查的方向沿身躯的纵向,因此沿身躯的横向进行点云切片,这种扫查方式对运动机构的要求较低,并且能够保证超声图像的质量。As shown in Figure 5, the data volume of the acquired three-dimensional point cloud data is relatively large, and the model needs to be reconstructed to meet the application requirements of the scanning trajectory planning algorithm while simplifying the data. Specifically, the point cloud is sliced according to a preset direction, and the direction of the human body is taken as a reference, and the slice operation is mainly performed along the horizontal and vertical directions of the body, and in the optimal slicing constraint condition, the slicing operation is performed at equal intervals. Slicing, so as to obtain a segment of the sub-point cloud of equal width, the width of each segment of the sub-point cloud can be flexibly adjusted according to the actual situation. As a possible implementation manner, the ultrasonic probe 13 adopts a strip scanning method, and the direction of the strip scanning is along the longitudinal direction of the body, so point cloud slices are performed along the transverse direction of the body. This scanning method affects the movement mechanism. The requirements are low, and can guarantee the quality of ultrasound images.
如图3所示,前述步骤S20包括:As shown in Fig. 3, the foregoing step S20 includes:
步骤S201,通过对三维点云数据进行横向切片以得到若干段子点云;Step S201: Obtain several segment point clouds by transversely slicing the three-dimensional point cloud data;
步骤S202,使用贝塞尔曲线对每一段子点云进行曲线拟合以得到曲线骨架。In step S202, a Bezier curve is used to perform curve fitting on each segment of the sub-point cloud to obtain a curve skeleton.
如图6所示,重建出的曲线骨架是胸部区域结构的更稳定可靠的表示方式,有利于算法的后期处理。本步骤中,关于贝塞尔曲线的拟合操作可参照现有技术中关于这方面的详细说明,在此不作赘述。As shown in Figure 6, the reconstructed curved skeleton is a more stable and reliable representation of the structure of the chest region, which is conducive to the post-processing of the algorithm. In this step, for the fitting operation of the Bezier curve, reference can be made to the detailed description of this aspect in the prior art, which will not be repeated here.
步骤S30,按照预设的曲线分割条件对曲线骨架中的各条曲线进行分割,并取各条曲线上的所有分割点。In step S30, each curve in the curve skeleton is divided according to the preset curve dividing condition, and all the dividing points on each curve are taken.
在该步骤中,以前述选择的纵向条形扫查方式为例,对横向分布的各条曲线进行等弧长分割,并且根据超声探头13的覆盖面大小设定分割间距,从而保证超声探头13在扫查过程中能够覆盖完整的待扫查区域,同时又能减少重合区。在执行曲线分割的环节,所得到的分割点表示为{S ij,0≤i<A,0≤j<B i},其中A是曲线骨架中曲线的条数,B i是第i条曲线上的分割点数,i和j均取正整数,通过对点云进行坐标变换,可以得到各个分割点在超声探头13对应的运动坐标系下的XYZ坐标值,关于点云坐标变换的原理,可参照现有技术的详细说明,在此不作赘述。 In this step, taking the previously selected longitudinal strip scanning method as an example, the horizontally distributed curves are divided into equal arc lengths, and the division distance is set according to the coverage area of the ultrasound probe 13, so as to ensure that the ultrasound probe 13 is in During the scanning process, the complete area to be scanned can be covered, and the overlap area can be reduced at the same time. In the process of performing curve segmentation, the obtained segmentation point is expressed as {S ij , 0≤i<A, 0≤j<B i }, where A is the number of curves in the curve skeleton, and B i is the i-th curve The number of division points on the above, i and j are both positive integers. By performing coordinate transformation on the point cloud, the XYZ coordinate values of each division point in the motion coordinate system corresponding to the ultrasonic probe 13 can be obtained. Regarding the principle of point cloud coordinate transformation, With reference to the detailed description of the prior art, it will not be repeated here.
步骤S40,根据预设的超声扫查方向从分割点集合中选取多组分割点,并将每一组分割点连接成一条扫查轨迹曲线。In step S40, multiple groups of segmentation points are selected from the segmentation point set according to the preset ultrasonic scanning direction, and each group of segmentation points is connected into a scanning trajectory curve.
在该步骤中,根据预设的超声扫查方向从分割点集合中选取能够组合成扫查轨迹曲线的多组分割点,以纵向的条形扫查为例,最简单的分组方式是, 选取曲线骨架中每条曲线上同序号j的分割点为一组,这样即可得到了一条完整的轨迹{S 0j,S 1j,S 2j,...,S Aj}。除了上述作为示例的分割点组合方式,还可以采用其它任意适用的方式进行分割点分组。 In this step, according to the preset ultrasonic scanning direction, select multiple groups of segmentation points that can be combined into the scanning trajectory curve from the segmentation point set. Taking longitudinal strip scanning as an example, the simplest grouping method is to select The dividing points with the same number j on each curve in the curve skeleton form a group, so that a complete trajectory {S 0j , S 1j , S 2j ,..., S Aj } can be obtained. In addition to the above-mentioned method of combining the dividing points as an example, any other applicable method may also be used to group the dividing points.
步骤S50,从扫查轨迹曲线中提取多个轨迹点,并计算各轨迹点的姿态角。In step S50, multiple trajectory points are extracted from the scanning trajectory curve, and the attitude angle of each trajectory point is calculated.
在该步骤中,作为较佳的实施方式,轨迹点即为前述分割点,这种轨迹点的提取方式能够简化数据处理的过程。当然,除了提取前述的分割点,还可以在相邻分割点之间额外提取一个或多个点作为轨迹点,这里需要结合乳房超声扫查设备的机构运动参数,避免造成数据冗余。以提取的分割点作为轨迹点为例,并且匹配五自由度的乳房超声扫查设备,则需要获取每个轨迹点坐标值和相应的姿态角,将轨迹点表示为P i=[X i,Y i,Z i,R i,P i],这五个量分别表示P i的XYZ坐标值和P i的Roll、Pitch姿态角,其中P i的XYZ坐标值根据前述的点云数据计算可以得到,因此该步骤主要计算轨迹点的两个姿态角。但是,如果提取得到的轨迹点并非前述分割点,那么还需计算这些未知轨迹点的XYZ坐标值。通过确定每个轨迹点的五个坐标量,根据XYZ坐标值可以在运动控制程序中控制超声探头13运动至待扫查区域的具体位置,而根据Roll、Pitch姿态角可以在运动控制程序中控制超声探头13应当调整到哪种角度姿态,以使探头表面与待扫查区域表面紧密贴合。 In this step, as a preferred embodiment, the trajectory points are the aforementioned segmentation points. This method of extracting trajectory points can simplify the data processing process. Of course, in addition to extracting the aforementioned segmentation points, one or more points between adjacent segmentation points can also be extracted as trajectory points. Here, the mechanism motion parameters of the breast ultrasound scanning device need to be combined to avoid data redundancy. Taking the extracted segmentation points as trajectory points as an example, and matching a five-degree-of-freedom breast ultrasound scanning device, it is necessary to obtain the coordinate value of each trajectory point and the corresponding attitude angle, and express the trajectory point as P i =[X i , Y i, Z i, R i , P i], which respectively represent five Roll XYZ coordinate values of P i and P i a, Pitch attitude angle, wherein the XYZ coordinate values of P i may be of the preceding data point cloud computing Therefore, this step mainly calculates the two attitude angles of the trajectory point. However, if the extracted trajectory points are not the aforementioned segmentation points, then the XYZ coordinate values of these unknown trajectory points need to be calculated. By determining the five coordinates of each track point, according to the XYZ coordinate values, the ultrasonic probe 13 can be controlled in the motion control program to move to the specific position of the area to be scanned, and according to the Roll and Pitch attitude angles, it can be controlled in the motion control program. The angle and posture of the ultrasonic probe 13 should be adjusted to make the surface of the probe closely fit the surface of the area to be scanned.
如图4所示,在一较佳实施例中,前述计算各轨迹点的姿态角主要采用以下算法,具体步骤包括:As shown in Figure 4, in a preferred embodiment, the aforementioned calculation of the attitude angle of each trajectory point mainly adopts the following algorithm, and the specific steps include:
步骤S501,提取轨迹点的邻域点集,并通过对邻域点集求PCA得到轨迹点所在邻域曲面的指向身体外部的单位法向量Vz。Step S501: Extract the neighborhood point set of the trajectory point, and obtain the unit normal vector Vz of the neighborhood surface where the trajectory point is located, pointing to the outside of the body, by calculating the PCA of the neighborhood point set.
在该步骤中,以轨迹点为中心提取的邻域点集可根据所期望的计算精度选择边界半径,这里不对邻域点集的范围设定作出限制,设定好邻域点集的提取范围后,即可通过对邻域点集求PCA得到轨迹点所在邻域曲面的指向身体外部的单位法向量Vz。In this step, the neighborhood point set extracted with the track point as the center can select the boundary radius according to the desired calculation accuracy. Here, there is no restriction on the range setting of the neighborhood point set, and the extraction range of the neighborhood point set is set Afterwards, the unit normal vector Vz pointing to the outside of the body of the surface of the neighborhood where the track point is located can be obtained by calculating the PCA of the neighborhood point set.
步骤S502,按照公式Vy=Vz×[0 0 1] T、Vx=Vy×Vz计算轨迹点在XY轴的单位方向向量Vx、Vy。 Step S502: Calculate the unit direction vectors Vx and Vy of the trajectory point on the XY axis according to the formulas Vy=Vz×[0 0 1] T and Vx=Vy×Vz.
步骤S503,将轨迹点XYZ坐标轴的单位方向向量转换为欧拉角的表示形式,并提取姿态角。In step S503, the unit direction vector of the XYZ coordinate axis of the track point is converted into the representation form of Euler angles, and the attitude angle is extracted.
在将单位方向向量转换为欧拉角的表示形式后,实际上可以获取到三个方向的姿态角,具体是提取几个姿态角,可以结合超声探头13所能提供的运动自由度,本实施例以提取Roll、Pitch姿态角作为示例。After converting the unit direction vector into the representation of Euler angles, the attitude angles in three directions can actually be obtained. Specifically, several attitude angles can be extracted, which can be combined with the degree of freedom of motion provided by the ultrasonic probe 13. Take extracting the attitude angle of Roll and Pitch as an example.
此外,在计算各轨迹点的姿态角的步骤之后,考虑到一些轨迹点可能位于超声探头13末端运动范围之外,因此需要对各轨迹点进行校验,具体地,该超声扫查轨迹规划方法还包括:In addition, after the step of calculating the attitude angle of each trajectory point, considering that some trajectory points may be located outside the motion range of the end of the ultrasonic probe 13, it is necessary to verify each trajectory point. Specifically, the ultrasonic scanning trajectory planning method Also includes:
导入超声探头末端的行程极限数据,并根据行程极限数据从轨迹点中滤除超声探头末端不可到达的点。Import the travel limit data at the end of the ultrasound probe, and filter out the unreachable points from the end of the ultrasound probe based on the travel limit data.
通常,可标定出超声探头13的运动极限,并以数据表的形式存储起来备用,根据该数据表来对轨迹点进行校验,可以避免设备在扫查过程中出现意外。同时,滤除了一些轨迹点后,对每条扫查轨迹曲线进行平滑滤波,使得超声探头13在扫查过程中动作更加平滑,减少对人体的局部挤压。Generally, the movement limit of the ultrasonic probe 13 can be calibrated and stored in the form of a data table for later use. The track points are verified according to the data table, which can avoid accidents in the scanning process of the equipment. At the same time, after filtering out some trajectory points, smooth filtering is performed on each scanning trajectory curve, so that the ultrasonic probe 13 moves more smoothly during the scanning process, and reduces local squeezing of the human body.
由此可见,本申请的超声扫查轨迹规划方法通过采用全自动机械化的扫查方式来对用户乳房区域进行超声扫查,从而对乳腺及其周边器官、组织的生理状况进行全面、准确的判断,以避免因人为操作而导致扫查得到的超声图像覆盖面不全、信息缺失等情况的发生;并且,该全自动机械化的扫查方式在执行超声扫查的过程中,依赖于计算机根据胸部区域的三维点云数据计算生成的扫查轨迹,以使超声探头能够根据接触区域的形状调整扫查姿态,保证获取到的每一帧超声图像所涵盖的信息全面、准确。It can be seen that the ultrasonic scanning trajectory planning method of the present application uses a fully automatic mechanized scanning method to perform ultrasonic scanning on the user's breast area, so as to make a comprehensive and accurate judgment on the physiological condition of the breast and its surrounding organs and tissues. In order to avoid the occurrence of incomplete coverage and missing information of the ultrasound images obtained by the scan due to human operation; and, the fully automatic mechanized scanning method depends on the computer according to the chest area during the process of performing the ultrasound scan. The scanning trajectory generated by the calculation of the three-dimensional point cloud data enables the ultrasound probe to adjust the scanning posture according to the shape of the contact area to ensure that the information covered by each frame of the acquired ultrasound image is comprehensive and accurate.
此外,本申请还提供一种超声扫查轨迹规划装置,如图7所示,该超声扫查轨迹规划装置包括:In addition, this application also provides an ultrasonic scanning trajectory planning device. As shown in FIG. 7, the ultrasonic scanning trajectory planning device includes:
点云获取模块100,用于获取胸部区域的三维点云数据;The point cloud acquisition module 100 is used to acquire three-dimensional point cloud data of the chest area;
骨架模型重建模块200,用于根据三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架;The skeleton model reconstruction module 200 is used to reconstruct a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton;
曲线分割模块300,用于按照预设的曲线分割条件对曲线骨架中的各条曲线进行分割,并取各条曲线上的所有分割点,分割点表示为{S ij,0≤i<A,0≤j<B i},其中A是曲线骨架中曲线的条数,B i是第i条曲线上的分割点数; The curve segmentation module 300 is used to segment each curve in the curve skeleton according to preset curve segmentation conditions, and take all the segmentation points on each curve, and the segmentation points are expressed as {S ij , 0≤i<A, 0≤j<B i }, where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
轨迹生成模块400,用于根据预设的超声扫查方向从分割点集合中选取多组分割点,并将每一组分割点连接成一条扫查轨迹曲线;The trajectory generation module 400 is used to select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
姿态角计算模块500,用于从扫查轨迹曲线中提取多个轨迹点,并计算各轨迹点的姿态角。The posture angle calculation module 500 is used to extract multiple trajectory points from the scanning trajectory curve and calculate the posture angle of each trajectory point.
上述超声扫查轨迹规划装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中,也可以以软件形式存储于服务器中的存储器中,以便于计算机设备调用执行以上各个模块对应的操作。该计算机设备可以为中央处理单元(CPU)、微计算 机设备、单片机等。上述各功能模块所起到的工作原理及起到的作用可参见图2~4中所示的超声扫查轨迹规划方法的实现过程,在此不作赘述。Each module in the above-mentioned ultrasonic scanning trajectory planning device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules may be embedded in the computer equipment in the form of hardware or independent of the computer equipment, and may also be stored in the memory in the server in the form of software, so that the computer equipment can call and execute the operations corresponding to the above-mentioned modules. The computer equipment may be a central processing unit (CPU), a microcomputer equipment, a single-chip microcomputer, and so on. The working principles and functions of the above-mentioned functional modules can be seen in the implementation process of the ultrasonic scanning trajectory planning method shown in FIGS. 2 to 4, which will not be repeated here.
本申请还提供一种计算机程序存储介质,该计算机程序存储介质中存储有计算机程序代码,该计算机程序代码被处理器执行时实现如下步骤:This application also provides a computer program storage medium in which computer program codes are stored, and when the computer program codes are executed by a processor, the following steps are implemented:
获取胸部区域的三维点云数据;Obtain 3D point cloud data of the chest area;
根据三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架;Reconstruct the skeleton model of the chest area structure according to the 3D point cloud data to obtain a curved skeleton;
按照预设的曲线分割条件对曲线骨架中的各条曲线进行分割,并取各条曲线上的所有分割点,分割点表示为{S ij,0≤i<A,0≤j<B i},其中A是曲线骨架中曲线的条数,B i是第i条曲线上的分割点数; Divide each curve in the curve skeleton according to the preset curve division conditions, and take all the division points on each curve, and the division points are expressed as {S ij , 0≤i<A, 0≤j<B i } , Where A is the number of curves in the curve skeleton, and B i is the number of dividing points on the i-th curve;
根据预设的超声扫查方向从分割点集合中选取多组分割点,并将每一组分割点连接成一条扫查轨迹曲线;Select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
从扫查轨迹曲线中提取多个轨迹点,并计算各轨迹点的姿态角。Extract multiple trajectory points from the scanning trajectory curve, and calculate the attitude angle of each trajectory point.
该计算机程序被处理器执行时还实现了超声扫查轨迹规划方法的其它步骤,具体可参见包括上述图3、4对应实施例在内的说明,在此不作赘述。When the computer program is executed by the processor, the other steps of the ultrasonic scanning trajectory planning method are also realized. For details, please refer to the description including the corresponding embodiments in Figs. 3 and 4, which will not be repeated here.
本申请还提供了一种计算机设备,如图8所示,该计算机设备包括处理器40、存储器50和存储在存储器50中的计算机程序代码,处理器40在调用该计算机程序代码时,实现上述各实施例中提供的一种超声扫查轨迹规划方法的步骤。The present application also provides a computer device. As shown in FIG. 8, the computer device includes a processor 40, a memory 50, and computer program code stored in the memory 50. When the processor 40 calls the computer program code, the foregoing The steps of an ultrasonic scanning trajectory planning method provided in each embodiment.
具体地,该计算机设备可为个人计算机或服务器。该计算机设备包括通过系统总线连接的处理器40、存储器50和通信接口(图未示)。其中,处理器40用于提供计算和控制能力,支撑整个计算机设备的运行。存储器50包括非易失性存储介质和内存储器。非易失性存储介质中存储有操作系统和计算机程序,该计算机程序被处理器40执行时以实现一种超声扫查轨迹规划方法。内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。通信接口用于与外部的服务器或终端通过网络连接通信。Specifically, the computer device may be a personal computer or a server. The computer device includes a processor 40, a memory 50, and a communication interface (not shown) connected by a system bus. Among them, the processor 40 is used to provide calculation and control capabilities, and support the operation of the entire computer equipment. The memory 50 includes a non-volatile storage medium and an internal memory. An operating system and a computer program are stored in the non-volatile storage medium, and the computer program is executed by the processor 40 to implement an ultrasonic scanning trajectory planning method. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface is used to communicate with an external server or terminal through a network connection.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of the application, and do not limit the scope of the patent for this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of the application, or directly or indirectly applied to other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (9)

  1. 一种超声扫查轨迹规划方法,其特征在于,包括:An ultrasonic scanning trajectory planning method, which is characterized in that it includes:
    获取胸部区域的三维点云数据;Obtain 3D point cloud data of the chest area;
    根据所述三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架;Performing skeleton model reconstruction on the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton;
    按照预设的曲线分割条件对所述曲线骨架中的各条曲线进行分割,并取各条曲线上的所有分割点,所述分割点表示为{S ij,0≤i<A,0≤j<B i},其中A是所述曲线骨架中曲线的条数,B i是第i条曲线上的分割点数; Each curve in the curve skeleton is divided according to the preset curve division condition, and all the division points on each curve are taken, and the division points are expressed as {S ij , 0≤i<A, 0≤j <B i }, where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
    根据预设的超声扫查方向从分割点集合中选取多组分割点,并将每一组分割点连接成一条扫查轨迹曲线;Select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
    从所述扫查轨迹曲线中提取多个轨迹点,并计算各轨迹点的姿态角。Extract a plurality of trajectory points from the scanning trajectory curve, and calculate the attitude angle of each trajectory point.
  2. 根据权利要求1所述的超声扫查轨迹规划方法,其特征在于,所述根据所述三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架包括:The ultrasonic scanning trajectory planning method according to claim 1, wherein the reconstructing a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton comprises:
    通过对所述三维点云数据进行横向切片以得到若干段子点云;Obtaining a number of sub-point clouds by performing transverse slicing of the three-dimensional point cloud data;
    使用贝塞尔曲线对每一段所述子点云进行曲线拟合以得到所述曲线骨架。Use Bezier curves to perform curve fitting on each segment of the sub-point cloud to obtain the curve skeleton.
  3. 根据权利要求1所述的超声扫查轨迹规划方法,其特征在于,所述计算各轨迹点的姿态角包括:The ultrasonic scanning trajectory planning method according to claim 1, wherein said calculating the attitude angle of each trajectory point comprises:
    提取所述轨迹点的邻域点集,并通过对所述邻域点集求PCA得到所述轨迹点所在邻域曲面的指向身体外部的单位法向量Vz,并按照以下公式计算所述轨迹点在XY轴的单位方向向量Vx、Vy,其中:The neighborhood point set of the trajectory point is extracted, and the PCA is calculated for the neighborhood point set to obtain the unit normal vector Vz of the neighborhood surface where the trajectory point is located, pointing out of the body, and the trajectory point is calculated according to the following formula The unit direction vectors Vx and Vy on the XY axis, where:
    Vy=Vz×[0 0 1] T Vy=Vz×[0 0 1] T
    Vx=Vy×VzVx=Vy×Vz
    将所述轨迹点XYZ坐标轴的单位方向向量转换为欧拉角的表示形式,并提取所述姿态角。The unit direction vector of the XYZ coordinate axis of the track point is converted into a representation form of Euler angles, and the attitude angle is extracted.
  4. 根据权利要求1所述的超声扫查轨迹规划方法,其特征在于,在所述获取胸部区域的三维点云数据的步骤之后,所述方法还包括:The ultrasonic scanning trajectory planning method according to claim 1, wherein after the step of acquiring three-dimensional point cloud data of the chest region, the method further comprises:
    对所述三维点云数据进行预处理,所述预处理包括点云降采样、点云滤波和点云平滑。The three-dimensional point cloud data is preprocessed, and the preprocessing includes point cloud downsampling, point cloud filtering, and point cloud smoothing.
  5. 根据权利要求1所述的超声扫查轨迹规划方法,其特征在于,在所述计算各轨迹点的姿态角的步骤之后,所述方法还包括:The ultrasonic scanning trajectory planning method according to claim 1, wherein after the step of calculating the attitude angle of each trajectory point, the method further comprises:
    导入超声探头末端的行程极限数据,并根据所述行程极限数据从所述轨迹点中滤除所述超声探头末端不可到达的点。Import the travel limit data of the end of the ultrasound probe, and filter out the unreachable points at the end of the ultrasound probe from the track points according to the travel limit data.
  6. 根据权利要求5所述的超声扫查轨迹规划方法,其特征在于,在所述导入超声探头末端的行程极限数据,并根据所述行程极限数据从所述轨迹点中滤除所述超声探头末端不可到达的点的步骤之后,所述方法还包括:The ultrasonic scanning trajectory planning method according to claim 5, wherein the travel limit data of the end of the ultrasound probe is imported, and the end of the ultrasound probe is filtered from the trajectory point according to the travel limit data After the step of the unreachable point, the method further includes:
    对每条扫查轨迹曲线进行平滑滤波。Smooth filtering is performed on each scan trajectory curve.
  7. 一种超声扫查轨迹规划装置,其特征在于,包括:An ultrasonic scanning trajectory planning device is characterized in that it comprises:
    点云获取模块,用于获取胸部区域的三维点云数据;Point cloud acquisition module, used to acquire 3D point cloud data of the chest area;
    骨架模型重建模块,用于根据所述三维点云数据对胸部区域结构进行骨架模型重建,以得到曲线骨架;A skeleton model reconstruction module, configured to reconstruct a skeleton model of the chest region structure according to the three-dimensional point cloud data to obtain a curved skeleton;
    曲线分割模块,用于按照预设的曲线分割条件对所述曲线骨架中的各条曲线进行分割,并取各条曲线上的所有分割点,所述分割点表示为{S ij,0≤i<A,0≤j<B i},其中A是所述曲线骨架中曲线的条数,B i是第i条曲线上的分割点数; The curve segmentation module is used to segment each curve in the curve skeleton according to preset curve segmentation conditions, and take all the segmentation points on each curve, and the segmentation points are expressed as {S ij , 0≤i <A, 0≤j<B i }, where A is the number of curves in the curve skeleton, and B i is the number of division points on the i-th curve;
    轨迹生成模块,用于根据预设的超声扫查方向从分割点集合中选取多组分割点,并将每一组分割点连接成一条扫查轨迹曲线;The trajectory generation module is used to select multiple groups of segmentation points from the segmentation point set according to the preset ultrasonic scanning direction, and connect each group of segmentation points into a scanning trajectory curve;
    姿态角计算模块,用于从所述扫查轨迹曲线中提取多个轨迹点,并计算各轨迹点的姿态角。The posture angle calculation module is used to extract multiple trajectory points from the scanning trajectory curve and calculate the posture angle of each trajectory point.
  8. 一种计算机程序存储介质,其特征在于,所述计算机程序存储介质中存储有计算机程序代码,该计算机程序代码被处理器执行时实现权利要求1至6中任一项所述超声扫查轨迹规划方法的步骤。A computer program storage medium, wherein the computer program storage medium stores computer program code, which when executed by a processor realizes the ultrasonic scanning trajectory planning of any one of claims 1 to 6 Method steps.
  9. 一种计算机设备,包括处理器、存储器和存储在所述存储器中的计算机程序代码,其特征在于,所述处理器在调用所述计算机程序代码时,实现权利要求1至6中任意一项所述超声扫查轨迹规划方法的步骤。A computer device, comprising a processor, a memory, and computer program code stored in the memory, wherein the processor implements any one of claims 1 to 6 when calling the computer program code Describes the steps of the ultrasonic scanning trajectory planning method.
PCT/CN2020/121233 2019-10-22 2020-10-15 Ultrasonic scanning track planning method and apparatus, and storage medium and computer device WO2021078064A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911007896.5 2019-10-22
CN201911007896.5A CN110664438B (en) 2019-10-22 2019-10-22 Ultrasonic scanning track planning method and device, storage medium and computer equipment

Publications (1)

Publication Number Publication Date
WO2021078064A1 true WO2021078064A1 (en) 2021-04-29

Family

ID=69083693

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/121233 WO2021078064A1 (en) 2019-10-22 2020-10-15 Ultrasonic scanning track planning method and apparatus, and storage medium and computer device

Country Status (2)

Country Link
CN (1) CN110664438B (en)
WO (1) WO2021078064A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113456106A (en) * 2021-08-03 2021-10-01 无锡祥生医疗科技股份有限公司 Carotid scanning method, device and computer readable storage medium
CN113515513A (en) * 2021-06-30 2021-10-19 同济大学 Track correction method and device, and point cloud map generation method and device
CN114224381A (en) * 2021-12-16 2022-03-25 中国人民解放军联勤保障部队北戴河康复疗养中心 Auxiliary supporting device in ultrasonic examination and using method thereof
CN114587347A (en) * 2022-03-25 2022-06-07 深圳市华屹医疗科技有限公司 Lung function detection method, system, device, computer equipment and storage medium
CN116363330A (en) * 2023-02-27 2023-06-30 优鹰智能科技(深圳)有限公司 Space reconstruction method, device, equipment and medium based on laser scanning technology
CN116587290A (en) * 2023-07-17 2023-08-15 广州多浦乐电子科技股份有限公司 Method for generating scanning track of ultrasonic nondestructive testing of workpiece and detection method
CN116781837A (en) * 2023-08-25 2023-09-19 中南大学 Automatic change laser three-dimensional scanning system
CN117392163A (en) * 2023-12-11 2024-01-12 泉州华中科技大学智能制造研究院 3D vision-based method for extracting track of collar sticker of shoe

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110786887B (en) * 2019-10-22 2021-11-26 深圳瀚维智能医疗科技有限公司 Mammary gland ultrasonic screening method, device and system
CN110664438B (en) * 2019-10-22 2021-09-10 深圳瀚维智能医疗科技有限公司 Ultrasonic scanning track planning method and device, storage medium and computer equipment
CN112075957B (en) * 2020-07-27 2022-05-17 深圳瀚维智能医疗科技有限公司 Mammary gland circular scanning track planning method and device and computer readable storage medium
CN112419415B (en) * 2020-12-08 2022-06-17 浙江德尚韵兴医疗科技有限公司 Ultrasonic scanning method for realizing pose planning based on CRS curve fitting
CN112767309A (en) * 2020-12-30 2021-05-07 无锡祥生医疗科技股份有限公司 Ultrasonic scanning method, ultrasonic equipment and system
CN112767415A (en) * 2021-01-13 2021-05-07 深圳瀚维智能医疗科技有限公司 Chest scanning area automatic determination method, device, equipment and storage medium
CN116851930A (en) * 2023-04-28 2023-10-10 华南智能机器人创新研究院 Three-dimensional five-axis curved surface laser cutting track generation method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090088639A1 (en) * 2007-09-28 2009-04-02 Michael Maschke Ultrasound device
CN103690191A (en) * 2013-12-03 2014-04-02 华南理工大学 Ultrasonic probe intelligent continuous scanner and scanning method thereof
CN103750864A (en) * 2014-01-13 2014-04-30 华南理工大学 Scanning device and method of ultrasound elasticity imaging
CN110060337A (en) * 2019-04-25 2019-07-26 飞依诺科技(苏州)有限公司 Carotid ultrasound scanning three-dimensional rebuilding method and system
EP3574841A1 (en) * 2018-05-28 2019-12-04 Koninklijke Philips N.V. Ultrasound probe positioning system
CN110664438A (en) * 2019-10-22 2020-01-10 深圳瀚维智能医疗科技有限公司 Ultrasonic scanning track planning method and device, storage medium and computer equipment

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050107703A1 (en) * 2003-09-22 2005-05-19 Bullis James K. Ultrasonic imaging with spot focused waves
US10531858B2 (en) * 2007-07-20 2020-01-14 Elekta, LTD Methods and systems for guiding the acquisition of ultrasound images
JP5404918B2 (en) * 2010-03-15 2014-02-05 パナソニック株式会社 Moving locus calculating method and apparatus, and region dividing method
TWI476403B (en) * 2011-04-22 2015-03-11 Pai Chi Li Automated ultrasonic scanning system and scanning method thereof
ES2558558T3 (en) * 2011-12-16 2016-02-05 Gestigon Gmbh Procedure and device for estimating a posture
EP2797515A4 (en) * 2011-12-29 2015-07-22 Maui Imaging Inc M-mode ultrasound imaging of arbitrary paths
CN104856720B (en) * 2015-05-07 2017-08-08 东北电力大学 A kind of robot assisted ultrasonic scanning system based on RGB D sensors
CN106361372A (en) * 2016-09-22 2017-02-01 华南理工大学 Method for planning intelligent scanning path of ultrasonic probe
CN107330903B (en) * 2017-06-29 2020-01-14 西安理工大学 Skeleton extraction method of human point cloud model
CN107953336B (en) * 2017-12-27 2019-12-31 北京理工大学 Method and system for correcting card loading deviation of tested piece in ultrasonic nondestructive testing of manipulator
CN109671155B (en) * 2018-12-21 2023-06-23 北京林业大学 Surface grid reconstruction method, system and equipment based on point cloud data

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090088639A1 (en) * 2007-09-28 2009-04-02 Michael Maschke Ultrasound device
CN103690191A (en) * 2013-12-03 2014-04-02 华南理工大学 Ultrasonic probe intelligent continuous scanner and scanning method thereof
CN103750864A (en) * 2014-01-13 2014-04-30 华南理工大学 Scanning device and method of ultrasound elasticity imaging
EP3574841A1 (en) * 2018-05-28 2019-12-04 Koninklijke Philips N.V. Ultrasound probe positioning system
CN110060337A (en) * 2019-04-25 2019-07-26 飞依诺科技(苏州)有限公司 Carotid ultrasound scanning three-dimensional rebuilding method and system
CN110664438A (en) * 2019-10-22 2020-01-10 深圳瀚维智能医疗科技有限公司 Ultrasonic scanning track planning method and device, storage medium and computer equipment

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113515513A (en) * 2021-06-30 2021-10-19 同济大学 Track correction method and device, and point cloud map generation method and device
CN113456106B (en) * 2021-08-03 2023-11-21 无锡祥生医疗科技股份有限公司 Carotid artery scanning method, carotid artery scanning device and carotid artery scanning computer readable storage medium
CN113456106A (en) * 2021-08-03 2021-10-01 无锡祥生医疗科技股份有限公司 Carotid scanning method, device and computer readable storage medium
CN114224381A (en) * 2021-12-16 2022-03-25 中国人民解放军联勤保障部队北戴河康复疗养中心 Auxiliary supporting device in ultrasonic examination and using method thereof
CN114224381B (en) * 2021-12-16 2024-02-27 中国人民解放军联勤保障部队北戴河康复疗养中心 Auxiliary supporting device in ultrasonic inspection and application method thereof
CN114587347A (en) * 2022-03-25 2022-06-07 深圳市华屹医疗科技有限公司 Lung function detection method, system, device, computer equipment and storage medium
CN114587347B (en) * 2022-03-25 2023-04-28 深圳市华屹医疗科技有限公司 Lung function detection method, system, device, computer equipment and storage medium
CN116363330A (en) * 2023-02-27 2023-06-30 优鹰智能科技(深圳)有限公司 Space reconstruction method, device, equipment and medium based on laser scanning technology
CN116363330B (en) * 2023-02-27 2023-09-19 优鹰智能科技(深圳)有限公司 Space reconstruction method, device, equipment and medium based on laser scanning technology
CN116587290A (en) * 2023-07-17 2023-08-15 广州多浦乐电子科技股份有限公司 Method for generating scanning track of ultrasonic nondestructive testing of workpiece and detection method
CN116781837B (en) * 2023-08-25 2023-11-14 中南大学 Automatic change laser three-dimensional scanning system
CN116781837A (en) * 2023-08-25 2023-09-19 中南大学 Automatic change laser three-dimensional scanning system
CN117392163A (en) * 2023-12-11 2024-01-12 泉州华中科技大学智能制造研究院 3D vision-based method for extracting track of collar sticker of shoe
CN117392163B (en) * 2023-12-11 2024-04-12 泉州华中科技大学智能制造研究院 3D vision-based method for extracting track of collar sticker of shoe

Also Published As

Publication number Publication date
CN110664438A (en) 2020-01-10
CN110664438B (en) 2021-09-10

Similar Documents

Publication Publication Date Title
WO2021078064A1 (en) Ultrasonic scanning track planning method and apparatus, and storage medium and computer device
WO2021078066A1 (en) Breast ultrasound screening method, apparatus and system
WO2021078065A1 (en) Breast three-dimensional point cloud reconstruction method and apparatus, and storage medium and computer device
CN110675398B (en) Mammary gland ultrasonic screening method and device and computer equipment
US11735306B2 (en) Method, system and computer readable storage media for creating three-dimensional dental restorations from two dimensional sketches
CN111292314B (en) Coronary artery segmentation method, device, image processing system and storage medium
CN110766704B (en) Breast point cloud segmentation method, device, storage medium and computer equipment
CN110378881B (en) Tumor positioning system based on deep learning
Vezzetti et al. Geometry-based 3D face morphology analysis: soft-tissue landmark formalization
JP2022517769A (en) 3D target detection and model training methods, equipment, equipment, storage media and computer programs
CN112057107A (en) Ultrasonic scanning method, ultrasonic equipment and system
CN112998749B (en) Automatic ultrasonic inspection system based on visual servo
CN112785609A (en) CBCT tooth segmentation method based on deep learning
CN112767309A (en) Ultrasonic scanning method, ultrasonic equipment and system
CN112450956A (en) Automatic positioning method, device, readable storage medium, electronic equipment and system
CN116958443A (en) SMPLX-based digital human quantitative detection model reconstruction method and application
CN107170009B (en) Medical image-based goggle base curve data measurement method
CN114820730B (en) CT and CBCT registration method based on pseudo CT
CN116168097A (en) Method, device, equipment and medium for constructing CBCT sketching model and sketching CBCT image
CN114092643A (en) Soft tissue self-adaptive deformation method based on mixed reality and 3DGAN
CN112288687A (en) Inner ear space attitude analysis method and analysis system
CN117409151B (en) Three-dimensional surface reconstruction method and device for two-dimensional intracardiac ultrasonic catheter image
CN116687452B (en) Early pregnancy fetus ultrasonic autonomous scanning method, system and equipment
CN112489046B (en) AI auxiliary measurement volume compensation method and device for flexible scanning image
JP7165541B2 (en) Volume data processing device, method and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20878107

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20878107

Country of ref document: EP

Kind code of ref document: A1