WO2024140175A1 - Ultrasonic image processing method and apparatus, device, and storage medium - Google Patents

Ultrasonic image processing method and apparatus, device, and storage medium Download PDF

Info

Publication number
WO2024140175A1
WO2024140175A1 PCT/CN2023/138192 CN2023138192W WO2024140175A1 WO 2024140175 A1 WO2024140175 A1 WO 2024140175A1 CN 2023138192 W CN2023138192 W CN 2023138192W WO 2024140175 A1 WO2024140175 A1 WO 2024140175A1
Authority
WO
WIPO (PCT)
Prior art keywords
diffusion
pixel
boundary
pixel point
waveform
Prior art date
Application number
PCT/CN2023/138192
Other languages
French (fr)
Chinese (zh)
Inventor
刘恩毅
贺光琳
Original Assignee
杭州海康慧影科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州海康慧影科技有限公司 filed Critical 杭州海康慧影科技有限公司
Publication of WO2024140175A1 publication Critical patent/WO2024140175A1/en

Links

Abstract

Disclosed in the present application are an ultrasonic image processing method and apparatus, a device, and a storage medium. The method comprises: detecting a selection instruction for instructing to select a target object in an ultrasonic image, and using coordinates indicated by the selection instruction as starting point coordinates; and performing boundary diffusion identification all around by using the starting point coordinates as the center so as to identify the boundary contour of the target object in the ultrasonic image. According to the present application, the boundary contour of the target object is identified by using any point in the target object as the starting point coordinates and performing boundary diffusion all around by using the starting point coordinates as the center. The boundary of the target object is automatically identified, human intervention components are reduced, and the boundary identification efficiency and accuracy are improved. The boundary contour is identified on the basis of a change in an energy coefficient between pixel points, and the change in the energy coefficient conforms to a change of texture characteristics between inside of the target object and at a boundary part, thus the boundary contour can be accurately identified. It is also possible to display the whole boundary diffusion process on the ultrasonic image in an overlayed manner, achieving the visualization of the whole boundary diffusion process.

Description

超声图像处理方法、装置、设备及存储介质Ultrasonic image processing method, device, equipment and storage medium
本申请要求于2022年12月29日提交中国专利局、申请号为202211710098.0发明名称为“超声图像处理方法、装置、设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the China Patent Office on December 29, 2022, with application number 202211710098.0 and invention name “Ultrasonic image processing method, device, equipment and storage medium”, all contents of which are incorporated by reference in this application.
技术领域Technical Field
本申请涉及医学影像技术领域,具体涉及一种超声图像处理方法、装置、设备及存储介质。The present application relates to the field of medical imaging technology, and in particular to an ultrasonic image processing method, device, equipment and storage medium.
背景技术Background technique
目前,医师在使用超声仪器对病人进行扫描检查时,对于需要检查的可疑病灶或人体组织等目标对象,需要对目标对象的面积、周长等应用指标进行测量。在对应用指标进行测量之前需要先确定目标对象的边界轮廓。At present, when doctors use ultrasound equipment to scan patients, they need to measure application indicators such as the area and perimeter of the target object such as the suspected lesion or human tissue to be examined. Before measuring the application indicators, the boundary contour of the target object needs to be determined first.
相关技术中通常由医师根据经验判定目标对象的边界轮廓,并手动描出目标对象轮廓的边界线。但依据经验主观判定目标对象的边界轮廓,并手动描出边界线,医师操作繁琐,确定目标对象边界轮廓的效率和准确性都很低。In the related art, doctors usually determine the boundary contour of the target object based on their experience and manually draw the boundary line of the target object contour. However, the doctor's operation is cumbersome, and the efficiency and accuracy of determining the boundary contour of the target object are very low.
发明内容Summary of the invention
为解决以上问题,本申请提供一种超声图像处理方法、装置、设备及存储介质,从目标对象内的起点坐标为中心进行边界扩散,自动识别目标对象的边界轮廓,减少人为干预成分,提高边界轮廓识别的效率及准确性。To solve the above problems, the present application provides an ultrasonic image processing method, device, equipment and storage medium, which performs boundary diffusion from the starting point coordinates within the target object as the center, automatically identifies the boundary contour of the target object, reduces human intervention components, and improves the efficiency and accuracy of boundary contour recognition.
第一方面,本申请实施例提供了一种超声图像处理方法,包括:In a first aspect, an embodiment of the present application provides an ultrasound image processing method, comprising:
检测到用于指示选择超声图像中目标对象的选择指令;detecting a selection instruction for instructing selection of a target object in the ultrasound image;
将所述选择指令所指示的坐标作为起点坐标;Taking the coordinates indicated by the selection instruction as the starting point coordinates;
以所述起点坐标为中心向四周进行边界扩散识别,以从所述超声图像中识别出所述目标对象的边界轮廓。Boundary diffusion recognition is performed around the starting point coordinates to identify the boundary contour of the target object from the ultrasound image.
本申请第二方面的实施例提供了一种超声图像处理装置,包括:An embodiment of the second aspect of the present application provides an ultrasonic image processing device, comprising:
检测模块,用于检测到用于指示选择超声图像中目标对象的选择指令;A detection module, configured to detect a selection instruction for instructing to select a target object in an ultrasound image;
起点确定模块,用于将所述选择指令所指示的坐标作为起点坐标;A starting point determination module, used to use the coordinates indicated by the selection instruction as starting point coordinates;
边界识别模块,用于以所述起点坐标为中心向四周进行边界扩散识别,以从所述超声图像中识别出所述目标对象的边界轮廓。The boundary recognition module is used to perform boundary diffusion recognition around the starting point coordinates as the center, so as to recognize the boundary contour of the target object from the ultrasonic image.
本申请第三方面的实施例提供了一种电子设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时,实现上述第一方面所述的方法。An embodiment of the third aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method described in the first aspect is implemented.
本申请第四方面的实施例提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时,实现上述第一方面所述的方法。An embodiment of the fourth aspect of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in the first aspect is implemented.
本申请第五方面的实施例提供了一种计算机程序产品,包括计算机程序,所述计算机程序被处理器执行以实现上述第一方面所述的方法。An embodiment of the fifth aspect of the present application provides a computer program product, including a computer program, wherein the computer program is executed by a processor to implement the method described in the first aspect above.
本申请实施例中提供的技术方案,至少具有如下技术效果或优点:The technical solution provided in the embodiments of the present application has at least the following technical effects or advantages:
本申请以目标对象内的任一点为起点坐标,以起点坐标为中心向四周边界扩散来识别目标对象的边界轮廓。实现自动识别目标对象的边界轮廓,减少人为干预成分,提高边界 识别的效率及准确性。This application uses any point in the target object as the starting point coordinate, and spreads to the surrounding boundaries with the starting point coordinate as the center to identify the boundary contour of the target object. It realizes automatic identification of the boundary contour of the target object, reduces human intervention, and improves boundary Recognition efficiency and accuracy.
本申请附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变的明显,或通过本申请的实践了解到。Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本申请的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:
图1示出了本申请实施例所提供的超声系统的结构示意图;FIG1 is a schematic diagram showing the structure of an ultrasound system provided in an embodiment of the present application;
图2示出了本申请实施例所提供的超声系统的功能结构框图;FIG2 shows a functional structure block diagram of an ultrasound system provided in an embodiment of the present application;
图3示出了本申请实施例所提供的一种超声图像处理方法的流程图;FIG3 shows a flow chart of an ultrasound image processing method provided in an embodiment of the present application;
图4示出了本申请实施例所提供的目标对象内的起点坐标的示意图;FIG4 is a schematic diagram showing the coordinates of the starting point within the target object provided by an embodiment of the present application;
图5示出了本申请实施例所提供的在超声图像中叠加显示边界扩散形成的波形的示意图;FIG5 is a schematic diagram showing a waveform formed by superimposing and displaying boundary diffusion in an ultrasound image provided by an embodiment of the present application;
图6示出了在图5的基础上标注出每个波形上的能量系数的示意图;FIG6 is a schematic diagram showing the energy coefficient on each waveform marked on the basis of FIG5 ;
图7示出了本申请实施例所提供的由起点坐标向与其相邻的每个像素点扩散形成第一个波形W1的示意图;FIG. 7 is a schematic diagram showing a first waveform W1 formed by diffusion from a starting point coordinate to each pixel point adjacent thereto provided by an embodiment of the present application;
图8示出了本申请实施例所提供的直接设置起点坐标向外扩散形成的第一个波形W1的示意图;FIG8 is a schematic diagram showing a first waveform W1 formed by directly setting the starting point coordinates to diffuse outwards provided in an embodiment of the present application;
图9示出了本申请实施例所提供的由第一个波形W1上的像素点B继续向外扩散的示意图;FIG. 9 is a schematic diagram showing the continued outward diffusion of a pixel point B on the first waveform W1 provided by an embodiment of the present application;
图10示出了本申请实施例所提供的由像素点A扩散至像素点E的扩散路径的示意图;FIG10 is a schematic diagram showing a diffusion path from pixel point A to pixel point E provided by an embodiment of the present application;
图11示出了本申请实施例所提供的一种超声图像处理装置的结构示意图;FIG11 is a schematic diagram showing the structure of an ultrasonic image processing device provided in an embodiment of the present application;
图12示出了本申请实施例所提供的一种电子设备的结构示意图。FIG. 12 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application.
具体实施方式Detailed ways
下面将参照附图更详细地描述本申请的示例性实施方式。虽然附图中显示了本申请的示例性实施方式,然而应当理解,可以以各种形式实现本申请而不应被这里阐述的实施方式所限制。相反,提供这些实施方式是为了能够更透彻地理解本申请,并且能够将本申请的范围完整的传达给本领域的技术人员。The exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.
医师使用超声仪器对病人进行检查时,需要确定病灶或人体组织等目标对象的边界轮廓。相关技术中由医师根据经验判断目标对象的边界轮廓,通过超声仪器连接的键盘或鼠标等外部设备手动描出目标对象的边界线。但如此操作对医师的个人经验要求很高,且医师的操作繁琐,人为操作主观性很强,导致确定边界轮廓的效率和准确性都很低。When doctors use ultrasound equipment to examine patients, they need to determine the boundary contours of target objects such as lesions or human tissues. In related technologies, doctors determine the boundary contours of target objects based on their experience and manually draw the boundary lines of target objects using external devices such as keyboards or mice connected to the ultrasound equipment. However, such operations require a high level of personal experience from doctors, and the doctors' operations are cumbersome and highly subjective, resulting in low efficiency and accuracy in determining boundary contours.
基于此,本申请实施例提供一种超声图像处理方法、装置、设备及存储介质,下面结合附图进行说明。Based on this, the embodiments of the present application provide an ultrasonic image processing method, device, equipment and storage medium, which are described below in conjunction with the accompanying drawings.
图1示出了本申请实施例提高的超声图像处理方法所基于的超声系统的结构示意图。该超声系统包括主机1、超声探头2、操作装置3和显示装置4。Fig. 1 shows a schematic diagram of the structure of an ultrasound system based on which the ultrasound image processing method according to an embodiment of the present application is improved. The ultrasound system comprises a host 1, an ultrasound probe 2, an operating device 3 and a display device 4.
其中,根据不同应用场景,医师可以将超声探头2放置在受检者的体表,或将超声探头2插入受检者体内,超声波经由超声探头2发射到受检者的目标检测区域。然后超声探头2接收超声波经过目标检测区域形成的超声回波,该超声回波能够反映目标检测区域的 组织特征。基于该超声回波获得目标检测区域的超声回波数据,将该超声回波数据传输给主机1。According to different application scenarios, the doctor can place the ultrasound probe 2 on the body surface of the subject, or insert the ultrasound probe 2 into the subject's body, and the ultrasound wave is transmitted to the target detection area of the subject via the ultrasound probe 2. Then the ultrasound probe 2 receives the ultrasound echo formed by the ultrasound wave passing through the target detection area, and the ultrasound echo can reflect the target detection area. Tissue features. Ultrasonic echo data of the target detection area is obtained based on the ultrasonic echo, and the ultrasonic echo data is transmitted to the host 1.
主机1基于该超声回波数据生成目标检测区域的超声图像,将该超声图像传输给显示装置4进行显示。主机1中还可以包含存储装置,主机1可以将该超声图像存储在存储装置内。The host 1 generates an ultrasonic image of the target detection area based on the ultrasonic echo data, and transmits the ultrasonic image to the display device 4 for display. The host 1 may also include a storage device, and the host 1 may store the ultrasonic image in the storage device.
上述操作装置3可以包括与主机1连接的鼠标、键盘等外部设备。当医师利用超声探头检测受检者的目标检测区域,并利用显示装置4实时显示超声图像时,医师观察显示的超声图像,若在当前显示的超声图像中发现需要检测的病灶或目标组织等目标对象,则按下操作装置3中的冻结按键停止扫描,从已扫描得到的超声图像中选取出最佳切面的超声图像,以便后续利用本申请实施例提供的超声图像处理方法从最佳切面的超声图像中自动识别出目标对象的边界轮廓。The operating device 3 may include external devices such as a mouse and a keyboard connected to the host 1. When the physician uses the ultrasound probe to detect the target detection area of the subject and uses the display device 4 to display the ultrasound image in real time, the physician observes the displayed ultrasound image. If a target object such as a lesion or target tissue to be detected is found in the currently displayed ultrasound image, the physician presses the freeze button in the operating device 3 to stop scanning, and selects the ultrasound image of the best section from the scanned ultrasound images, so that the ultrasound image processing method provided in the embodiment of the present application can be used to automatically identify the boundary contour of the target object from the ultrasound image of the best section.
图2示出了上述超声系统的功能结构框图,上述主机1包括图像输入单元、超声图像处理单元、超声智能处理单元、视频编码单元、控制单元和操作单元,超声探头2包括处理单元、信号收发单元和操作单元。处理单元和信号收发单元获取超声回波信号,并发送给图像输入单元。图像输入单元接收超声探头2发送过来的超声回波信号,并将接收到的超声回波信号进行模拟收发、波束合成、信号转换等处理,并传输给超声图像处理单元。超声图像处理单元对图像输入单元传输的超声图像进行ISP(Image Signal Processing,图像信号处理)操作,包括但不限于亮度变换、锐化、对比度增强等。超声图像处理单元处理后的超声图像被传输给超声智能处理单元、视频编码单元或显示装置。超声智能处理单元对超声图像处理单元处理后的超声图像进行智能分析,包括但不限于基于深度学习的目标识别、检测、分割等。超声智能处理单元处理后的超声图像被传输给超声图像处理单元或视频编码单元。超声图像处理单元对超声智能处理单元处理后的超声图像的处理方式包括但不限于轮廓检测、亮度变换、叠框和缩放等。视频编码单元将超声图像处理单元或超声智能处理单元处理后的图像进行编码压缩,并传输给存储装置。控制单元控制超声系统的各个单元,控制方式包括但不限于界面操作方式、图像处理方式、超声测量方式和视频编码方式等。操作单元包括但不限于开关、按钮和触摸面板,用于接收外部指示信号,将指示信号输出到控制单元。FIG2 shows a functional block diagram of the ultrasound system. The host 1 includes an image input unit, an ultrasound image processing unit, an ultrasound intelligent processing unit, a video encoding unit, a control unit and an operation unit. The ultrasound probe 2 includes a processing unit, a signal transceiver unit and an operation unit. The processing unit and the signal transceiver unit obtain the ultrasound echo signal and send it to the image input unit. The image input unit receives the ultrasound echo signal sent by the ultrasound probe 2, and performs analog transceiver, beam synthesis, signal conversion and other processing on the received ultrasound echo signal, and transmits it to the ultrasound image processing unit. The ultrasound image processing unit performs ISP (Image Signal Processing) operations on the ultrasound image transmitted by the image input unit, including but not limited to brightness conversion, sharpening, contrast enhancement, etc. The ultrasound image processed by the ultrasound image processing unit is transmitted to the ultrasound intelligent processing unit, the video encoding unit or the display device. The ultrasound intelligent processing unit performs intelligent analysis on the ultrasound image processed by the ultrasound image processing unit, including but not limited to target recognition, detection, segmentation based on deep learning, etc. The ultrasound image processed by the ultrasound intelligent processing unit is transmitted to the ultrasound image processing unit or the video encoding unit. The ultrasonic image processing unit processes the ultrasonic image processed by the ultrasonic intelligent processing unit in a manner including but not limited to contour detection, brightness conversion, frame stacking and scaling. The video encoding unit encodes and compresses the image processed by the ultrasonic image processing unit or the ultrasonic intelligent processing unit, and transmits it to the storage device. The control unit controls the various units of the ultrasonic system, and the control methods include but are not limited to interface operation methods, image processing methods, ultrasonic measurement methods and video encoding methods. The operating unit includes but is not limited to switches, buttons and touch panels, which are used to receive external indication signals and output the indication signals to the control unit.
基于图1和2示出的超声系统,本申请实施例提供了一种超声图像处理方法,以超声图像中位于目标对象内的一点为起点向周围进行边界扩散,基于边界扩散过程中像素梯度的变化自动识别目标对象的边界轮廓,减少了人为干预成分,提高了边界轮廓识别的效率及准确性。Based on the ultrasound system shown in Figures 1 and 2, an embodiment of the present application provides an ultrasound image processing method, which uses a point in the ultrasound image located within the target object as a starting point to perform boundary diffusion to the surrounding area, and automatically identifies the boundary contour of the target object based on the change in pixel gradient during the boundary diffusion process, thereby reducing human intervention components and improving the efficiency and accuracy of boundary contour recognition.
参见图3,图3为本申请实施例所提供的一种超声图像处理方法的流程图。该方法具体包括以下步骤:See Figure 3, which is a flow chart of an ultrasound image processing method provided in an embodiment of the present application. The method specifically comprises the following steps:
步骤101:检测到用于指示选择超声图像中目标对象的选择指令,将该选择指令所指示的坐标作为起点坐标。Step 101: a selection instruction for instructing to select a target object in an ultrasound image is detected, and the coordinates indicated by the selection instruction are used as the starting point coordinates.
医师通过超声探头检测受检者的目标检测区域的过程中,超声系统的显示装置中实时显示目标检测区域的超声图像。医师观察显示的超声图像,在超声图像中出现目标对象时可以停止扫查,从当前扫查到的超声图像中选择目标对象的最佳切面的超声图像。其中,目标对象可以为病灶,或者可以为需要检查的目标组织,如甲状腺、肝、肾等。 When the physician detects the target detection area of the subject through the ultrasound probe, the ultrasound system's display device displays the ultrasound image of the target detection area in real time. The physician observes the displayed ultrasound image, and when the target object appears in the ultrasound image, the physician can stop scanning and select the ultrasound image of the best section of the target object from the currently scanned ultrasound image. The target object may be a lesion, or may be a target tissue to be examined, such as the thyroid gland, liver, kidney, etc.
显示装置显示包含目标对象的超声图像后,医师可以操作超声系统的操作装置,通过操作装置包括的鼠标或键盘等提交选择指令,该选择指令用于选择超声图像中的目标对象。例如,医师可以通过鼠标点击当前显示的超声图像中的目标对象。After the display device displays the ultrasound image containing the target object, the physician can operate the operation device of the ultrasound system and submit a selection instruction through a mouse or keyboard included in the operation device, and the selection instruction is used to select the target object in the ultrasound image. For example, the physician can click the target object in the currently displayed ultrasound image with a mouse.
超声系统主机的控制单元检测到操作装置提交的选择指令,确定该选择指令所指示的坐标,将该坐标作为起点坐标,该起点坐标即为医师通过操作装置选择目标对象的位置在该超声图像中的坐标。The control unit of the ultrasound system host detects the selection instruction submitted by the operating device, determines the coordinates indicated by the selection instruction, and uses the coordinates as the starting coordinates, which are the coordinates of the position of the target object selected by the physician through the operating device in the ultrasound image.
具体地,在当前显示的超声图像中建立图像坐标系。例如,以当前显示的超声图像的左上角顶点坐标为原点,以超声图像中经过原点的水平边为x轴,以经过原点的竖直边为y轴,基于此原点、x轴、y轴,建立图像坐标系。在实际应用中也可以超声图像中其他顶点坐标为原点建立图像坐标系。Specifically, an image coordinate system is established in the currently displayed ultrasound image. For example, the coordinates of the upper left corner vertex of the currently displayed ultrasound image are taken as the origin, the horizontal side passing through the origin in the ultrasound image is taken as the x-axis, and the vertical side passing through the origin is taken as the y-axis. Based on the origin, the x-axis, and the y-axis, the image coordinate system is established. In actual applications, the image coordinate system can also be established with the coordinates of other vertices in the ultrasound image as the origin.
在该超声图像中建立图像坐标系之后,控制单元确定医师选择目标对象的位置在该图像坐标系中的坐标,得到起点坐标。例如,在超声图像的坐标系中确定医师点击目标对象的位置的坐标,将该坐标作为起点坐标。其中,起点坐标可以为目标对象所在区域内的任意一点。如图4所示的超声图像示意图中,非阴影区域为目标对象所在的目标区域,起点坐标可以是目标区域内的任一点。After the image coordinate system is established in the ultrasound image, the control unit determines the coordinates of the position where the physician selects the target object in the image coordinate system to obtain the starting point coordinates. For example, the coordinates of the position where the physician clicks the target object are determined in the coordinate system of the ultrasound image, and the coordinates are used as the starting point coordinates. The starting point coordinates may be any point in the area where the target object is located. In the ultrasound image schematic diagram shown in FIG4 , the non-shaded area is the target area where the target object is located, and the starting point coordinates may be any point in the target area.
本申请实施例中,控制单元在检测到操作装置提交的选择指令后,还可以从超声智能处理单元中获取选择指令所指示的目标对象的检测框,该检测框的中心位置的坐标即为选择指令所指示的坐标。In an embodiment of the present application, after detecting the selection instruction submitted by the operating device, the control unit can also obtain the detection frame of the target object indicated by the selection instruction from the ultrasonic intelligent processing unit, and the coordinates of the center position of the detection frame are the coordinates indicated by the selection instruction.
虽然由医师人为确定目标对象的边界轮廓的准确性很差,但相对来说由医师选定目标对象所在区域内的任意一点的操作非常简单,准确性很高。如果出现医师选定的起点坐标位于目标对象的边界轮廓上,或者位于目标对象所在区域之外的情况,则基于本申请实施例提供的超声图像处理方法将无法识别出目标对象的边界轮廓。在这种情况下,可以在预设时长内仍未检测出目标对象的边界轮廓时,通过显示装置显示提示信息,该提示信息用于提示医师重新选择目标对象所在区域内的一点作为起点坐标。其中,预设时长可以为5s、10s、30s等,本申请实施例并不限制预设时长的具体取值,实际应用中可根据需求设定。Although the accuracy of the boundary contour of the target object determined by the physician is very poor, the operation of the physician selecting any point in the area where the target object is located is relatively simple and has high accuracy. If the starting point coordinates selected by the physician are located on the boundary contour of the target object, or are located outside the area where the target object is located, the ultrasonic image processing method provided in the embodiment of the present application will not be able to identify the boundary contour of the target object. In this case, when the boundary contour of the target object is still not detected within the preset time length, a prompt message can be displayed through a display device, and the prompt message is used to prompt the physician to reselect a point in the area where the target object is located as the starting point coordinate. Among them, the preset time length can be 5s, 10s, 30s, etc. The embodiment of the present application does not limit the specific value of the preset time length, and it can be set according to demand in actual application.
通过本步骤确定出起点坐标之后,通过如下步骤102的操作来自动识别出目标对象的边界轮廓。After the starting point coordinates are determined in this step, the boundary contour of the target object is automatically identified through the following step 102 operation.
步骤102:以起点坐标为中心向四周进行边界扩散识别,以从超声图像中识别出目标对象的边界轮廓。Step 102: Perform boundary diffusion recognition around the starting point coordinates to identify the boundary contour of the target object from the ultrasound image.
本申请实施例中,以起点坐标为中心向四周进行扩散,扩散过程中基于相同扩散方向上像素梯度的变化,来识别出目标对象的边界像素点,从而得到目标对象的边界轮廓。具体通过如下步骤S1和S2的操作来识别目标对象的边界轮廓。In the embodiment of the present application, diffusion is performed around the starting point coordinates, and the boundary pixel points of the target object are identified based on the change of pixel gradient in the same diffusion direction during the diffusion process, thereby obtaining the boundary contour of the target object. Specifically, the boundary contour of the target object is identified by the following operations S1 and S2.
S1:基于起点坐标,确定每次边界扩散形成的波形上像素点的能量系数,该能量系数与基于边界扩散经过的像素点的梯度相关联。S1: Based on the starting point coordinates, determine the energy coefficient of the pixel points on the waveform formed by each boundary diffusion, and the energy coefficient is associated with the gradient of the pixel points passed by the boundary diffusion.
本申请实施例中,采用边界扩散方式来自动识别目标对象的边界轮廓,在整个过程中进行多次边界扩散操作,每次边界扩散操作都会得到一个包围起点坐标的闭环线。因此整个过程就好像产生了以起点坐标为中心由内向外扩散的波形,类似于水波纹一样。因此本申请实施例将边界扩散过程中产生的闭环线称为波形。其中,边界扩散过程中产生的波形可以是虚拟的波形,在当前显示的超声图像中不显示该波形,或者,也可以在当前显示的 超声图像中以实体线的形式展示出该波形。In the embodiment of the present application, a boundary diffusion method is used to automatically identify the boundary contour of the target object. Multiple boundary diffusion operations are performed during the entire process, and each boundary diffusion operation will obtain a closed loop line surrounding the starting point coordinates. Therefore, the entire process is like generating a waveform that spreads from the inside to the outside with the starting point coordinates as the center, similar to water ripples. Therefore, the closed loop line generated in the boundary diffusion process is referred to as a waveform in the embodiment of the present application. Among them, the waveform generated in the boundary diffusion process can be a virtual waveform, which is not displayed in the currently displayed ultrasound image, or it can also be displayed in the currently displayed The waveform is displayed as a solid line in the ultrasound image.
在步骤101检测到起点坐标后即触发启动用于边界识别的波形,由起点坐标为中心向外扩散,在扩散过程中检测并标记边界像素点,直至识别出目标对象的边界轮廓。其中,边界像素点为边界轮廓上的像素点。After the starting point coordinates are detected in step 101, the waveform for boundary recognition is triggered and started, and the waveform diffuses outward from the starting point coordinates as the center, and boundary pixels are detected and marked during the diffusion process until the boundary contour of the target object is recognized. The boundary pixels are pixels on the boundary contour.
由于每次边界扩散的处理操作都是相同的,因此本申请实施例仅以一次边界扩散操作为例来详细说明边界扩散的处理过程。具体以当前波形向外扩散形成一个新的波形为例进行说明。其中,当前波形可以是以起点坐标为中心进行至少一次边界扩散得到的波形。在本申请实施例中,起点坐标可以看作是以起点坐标为中心进行第一次边界扩散得到的初始波形,即初始波形上只有起点坐标对应的一个像素点。当前波形可以是初始波形,或从初始波形向外进行至少一次边界扩散得到的波形中的任一波形。Since the processing operation of each boundary diffusion is the same, the embodiment of the present application only takes one boundary diffusion operation as an example to explain in detail the processing process of boundary diffusion. Specifically, the current waveform diffuses outward to form a new waveform as an example. Among them, the current waveform can be a waveform obtained by performing at least one boundary diffusion with the starting point coordinates as the center. In the embodiment of the present application, the starting point coordinates can be regarded as the initial waveform obtained by performing the first boundary diffusion with the starting point coordinates as the center, that is, there is only a pixel point corresponding to the starting point coordinates on the initial waveform. The current waveform can be the initial waveform, or any waveform among the waveforms obtained by performing at least one boundary diffusion outward from the initial waveform.
本申请实施例中,可以从当前波形上的像素点分别向多个扩散方向进行边界扩散,获得新的波形。其中,扩散方向是指从当前波形上的像素点指向远离起点坐标的方向,当前波形上的每个像素点都对应有多个扩散方向。In the embodiment of the present application, the boundary diffusion can be performed from the pixel points on the current waveform to multiple diffusion directions to obtain a new waveform. The diffusion direction refers to the direction from the pixel point on the current waveform to the direction away from the starting point coordinates, and each pixel point on the current waveform corresponds to multiple diffusion directions.
从当前波形上的一个像素点分别向该像素点对应的每个扩散方向进行边界扩散,能够扩散至多个像素点。将当前波形上每个像素点扩散至的所有像素点连接起来,就得到了从当前波形进行一次边界扩散而形成的新的波形。From a pixel point on the current waveform, boundary diffusion is performed in each diffusion direction corresponding to the pixel point, and it can diffuse to multiple pixel points. Connect all the pixel points to which each pixel point on the current waveform diffuses, and a new waveform formed by boundary diffusion from the current waveform is obtained.
由于当前波形上每个像素点的扩散操作均相同,且对像素点向每个扩散方向的扩散操作也均相同。因此以从第一像素点向第一扩散方向扩散为例来说明对当前波形上的像素点进行边界扩散的过程。第一像素点为当前波形上的任一像素点,第二像素点在第一像素点的第一扩散方向上,第一扩散方向为第一像素点对应的多个扩散方向中的任一扩散方向。基于当前波形的第一像素点与新的波形的第二像素点之间的像素梯度,分别计算第二像素点的能量系数。Since the diffusion operation of each pixel point on the current waveform is the same, and the diffusion operation of the pixel points in each diffusion direction is also the same. Therefore, the diffusion from the first pixel point to the first diffusion direction is used as an example to illustrate the process of boundary diffusion of the pixel points on the current waveform. The first pixel point is any pixel point on the current waveform, and the second pixel point is in the first diffusion direction of the first pixel point. The first diffusion direction is any diffusion direction of the multiple diffusion directions corresponding to the first pixel point. Based on the pixel gradient between the first pixel point of the current waveform and the second pixel point of the new waveform, the energy coefficient of the second pixel point is calculated respectively.
例如,获取当前波形上的第一像素点在第一扩散方向上的扩散速度。以该扩散速度从第一像素点向第一扩散方向进行边界扩散,得到新的波形上的第二像素点。其中,第二像素点在第一像素点的第一扩散方向上,扩散速度可以理解为扩散步长,即从第一像素点朝着第一扩散方向进行一次边界扩散的距离。For example, the diffusion speed of the first pixel point on the current waveform in the first diffusion direction is obtained. The boundary diffusion is performed from the first pixel point to the first diffusion direction at the diffusion speed to obtain the second pixel point on the new waveform. Among them, the diffusion speed of the second pixel point in the first diffusion direction of the first pixel point can be understood as the diffusion step length, that is, the distance of one boundary diffusion from the first pixel point to the first diffusion direction.
在一种实现方式中,可以在超声系统中预先配置好预设的扩散速度,每个像素点在每个扩散方向上都以该预设的扩散速度进行边界扩散。预设的扩散速度可以为1个像素点的距离、3个像素点的距离、5个像素点的距离等。本申请实施例不限制预设的扩散速度的具体取值,实际应用中可以根据需求设定。不同扩散方向上,预设的扩散速度可以相同,也可以不同,不同像素点的预设的扩散速度可以相同,也可以不同。In one implementation, a preset diffusion speed can be pre-configured in the ultrasound system, and each pixel performs boundary diffusion at the preset diffusion speed in each diffusion direction. The preset diffusion speed can be the distance of 1 pixel, the distance of 3 pixels, the distance of 5 pixels, etc. The embodiment of the present application does not limit the specific value of the preset diffusion speed, and it can be set according to needs in actual applications. In different diffusion directions, the preset diffusion speeds can be the same or different, and the preset diffusion speeds of different pixels can be the same or different.
采用预设的扩散速度进行边界扩散,能够减小边界扩散过程中的计算量,提高边界扩散效率。且预设的扩散速度设置的越小,边界扩散形成的波形就越密集,识别边界轮廓的准确性就越高。而预设的扩散速度设置的越大,通过边界扩散操作能够很快扩散到目标对象的真实边界处,能够快速地识别出目标对象的边界轮廓,提高边界识别的效率。通过预先配置预设的扩散速度,实现基于实际需求自定义扩散速度。Using a preset diffusion speed for boundary diffusion can reduce the amount of calculation in the boundary diffusion process and improve the efficiency of boundary diffusion. The smaller the preset diffusion speed is, the denser the waveform formed by the boundary diffusion is, and the higher the accuracy of identifying the boundary contour is. The larger the preset diffusion speed is, the faster the boundary diffusion operation can diffuse to the real boundary of the target object, and the boundary contour of the target object can be quickly identified, improving the efficiency of boundary identification. By pre-configuring the preset diffusion speed, the diffusion speed can be customized based on actual needs.
在另一种实现方式中,不预先配置预设的扩散速度,而是通过计算获得第一像素点在第一扩散方向上的扩散速度。具体地,获取第一像素点的能量系数、第三像素点的能量系数及第三像素点在第一扩散方向上的扩散速度。其中,第三像素点为与当前波形相邻的上 一个波形中的像素点,第一像素点是以第三像素点对应的扩散速度从第三像素点向第一扩散方向进行边界扩散得到的。基于第一像素点的能量系数、第三像素点的能量系数及第三像素点在第一扩散方向上的扩散速度,计算第一像素点在第一扩散方向上的扩散速度。In another implementation, the preset diffusion speed is not pre-configured, but the diffusion speed of the first pixel in the first diffusion direction is obtained by calculation. Specifically, the energy coefficient of the first pixel, the energy coefficient of the third pixel, and the diffusion speed of the third pixel in the first diffusion direction are obtained. The third pixel is the upper pixel adjacent to the current waveform. The first pixel point in a waveform is obtained by boundary diffusion from the third pixel point to the first diffusion direction at the diffusion speed corresponding to the third pixel point. The diffusion speed of the first pixel point in the first diffusion direction is calculated based on the energy coefficient of the first pixel point, the energy coefficient of the third pixel point and the diffusion speed of the third pixel point in the first diffusion direction.
例如,首先可以计算第三像素点的能量系数与第一像素点的能量系数的差值,得到从第三像素点扩散至第一像素点产生的能量衰减量;然后基于该能量衰减量,确定扩散速度的损失量,计算第三像素点在第一扩散方向上的扩散速度与该损失量的差值,得到第一像素点在第一扩散方向上的扩散速度。For example, we can first calculate the difference between the energy coefficient of the third pixel and the energy coefficient of the first pixel to obtain the energy attenuation caused by diffusion from the third pixel to the first pixel; then, based on the energy attenuation, determine the loss of diffusion speed, and calculate the difference between the diffusion speed of the third pixel in the first diffusion direction and the loss to obtain the diffusion speed of the first pixel in the first diffusion direction.
在本申请实施例中,能量系数是与像素点的梯度相关的,是对边界的梯度进行量化的一种表现形式。梯度可以为像素点之间的灰度或亮度等特征值的差值,梯度能够表示不同像素点之间的差异程度,梯度越大表示像素点之间的差异越大,梯度越小表示像素点之间的差异越小。目标对象所在区域内的像素点之间的差异会较小,而目标对象的边界处像素点之间的差异通常较大。因此从目标对象内的像素点向外边界扩散过程中,基于梯度的变化能够准确识别出目标对象的边界轮廓。In the embodiment of the present application, the energy coefficient is related to the gradient of the pixel point, which is a form of expression for quantifying the gradient of the boundary. The gradient can be the difference between the characteristic values such as grayscale or brightness between the pixels. The gradient can represent the degree of difference between different pixels. The larger the gradient, the greater the difference between the pixels, and the smaller the gradient, the smaller the difference between the pixels. The difference between the pixels in the area where the target object is located will be smaller, while the difference between the pixels at the boundary of the target object is usually larger. Therefore, in the process of diffusion from the pixels in the target object to the outer boundary, the boundary contour of the target object can be accurately identified based on the change in the gradient.
能量系数与梯度之间存在一定的映射关系,本申请实施例可以设置能量系数与梯度之间的映射函数,该映射函数可以为线性函数或非线性函数,其中非线性函数包括但不限于拟合曲线、S型曲线、Log曲线等。假设Sn(i,j)_d是坐标为(i,j)位置的像素点在第d方向上的梯度,则能量系数en(i,j)与梯度Sn(i,j)_d的映射关系可表示为:en(i,j)=F(Sn(i,j)_d),其中F为映射函数。There is a certain mapping relationship between the energy coefficient and the gradient. In the embodiment of the present application, a mapping function between the energy coefficient and the gradient can be set. The mapping function can be a linear function or a nonlinear function, wherein the nonlinear function includes but is not limited to a fitting curve, an S-shaped curve, a Log curve, etc. Assuming that Sn(i, j)_d is the gradient of the pixel point at the coordinate position (i, j) in the dth direction, the mapping relationship between the energy coefficient en(i, j) and the gradient Sn (i, j)_d can be expressed as: en(i, j) =F( Sn(i, j)_d ), where F is the mapping function.
上述第一像素点是由第三像素点朝着第一扩散方向进行边界扩散得到的,因此第一像素点的能量系数是将第三像素点与第一像素点之间的梯度代入映射函数计算得到的。第三像素点是由第三像素点所在的波形相邻的上一个波形中的第四像素点朝着第一扩散方向进行边界扩散得到的,因此第三像素点的能量系数是将第四像素点与第三像素点之间的梯度代入映射函数计算得到的。The first pixel point is obtained by boundary diffusion of the third pixel point toward the first diffusion direction, so the energy coefficient of the first pixel point is calculated by substituting the gradient between the third pixel point and the first pixel point into the mapping function. The third pixel point is obtained by boundary diffusion of the fourth pixel point in the previous waveform adjacent to the waveform where the third pixel point is located toward the first diffusion direction, so the energy coefficient of the third pixel point is calculated by substituting the gradient between the fourth pixel point and the third pixel point into the mapping function.
以Vn(i,j)_d来标识第n个波形上坐标为(i,j)的像素点在第d方向上的扩散速度,则扩散速度的计算公式可以如下所示:
Vn(i,j)_d=Vn-1(k,z)_d-a*(en-1(k,z)-en(i,j))
V n(i, j)_d is used to identify the diffusion speed of the pixel point with coordinates (i, j) on the nth waveform in the dth direction, and the calculation formula of the diffusion speed can be shown as follows:
Vn (i,j)_d = Vn -1(k,z)_d - a*( en-1(k,z) -en (i,j) )
其中,Vn-1(k,z)_d为第n-1个波形上坐标为(k,z)的像素点在第d方向上的扩散速度。以扩散速度Vn-1(k,z)_d从第n-1个波形上坐标为(k,z)的像素点朝着第d方向进行边界扩散,扩散到了第n个波形上坐标为(i,j)的像素点。en(i,j)为第n个波形上坐标为(i,j)的像素点的能量系数,en-1(k,z)为第n-1个波形上坐标为(k,z)的像素点的能量系数。a为预设系数,若a=0,则边界扩散是以匀速进行扩散的,每次边界扩散产生的波形都为圆形。而若设置a不等于0,则每个像素点在不同的扩散方向上的扩散速度都将不同,扩散速度与能量系数的衰减程度相关,基于如此计算的扩散速度进行边界扩散,与目标对象所在区域中像素点之间梯度变化的实际情况更相近,能够提高边界识别的准确性。Wherein, V n-1(k, z)_d is the diffusion speed of the pixel point with coordinates (k, z) on the n-1th waveform in the dth direction. The boundary diffusion is carried out from the pixel point with coordinates (k, z) on the n-1th waveform toward the dth direction at the diffusion speed V n-1(k, z)_d , and diffuses to the pixel point with coordinates (i, j) on the n-1th waveform. en(i, j) is the energy coefficient of the pixel point with coordinates (i, j) on the n-1th waveform, and en-1(k, z) is the energy coefficient of the pixel point with coordinates (k, z) on the n-1th waveform. a is a preset coefficient. If a=0, the boundary diffusion is carried out at a uniform speed, and the waveform generated by each boundary diffusion is circular. If a is set not equal to 0, the diffusion speed of each pixel in different diffusion directions will be different. The diffusion speed is related to the attenuation degree of the energy coefficient. Boundary diffusion based on the diffusion speed calculated in this way is closer to the actual situation of the gradient change between pixels in the area where the target object is located, which can improve the accuracy of boundary recognition.
对于上述计算第一像素点在第一扩散方向上的扩散速度,将第一像素点的能量系数、第三像素点的能量系数以及第三像素点在所述第一扩散方向上的扩散速度代入上述计算公式中,能够快速计算出第一像素点在第一扩散方向上的扩散速度。For the above calculation of the diffusion speed of the first pixel point in the first diffusion direction, the energy coefficient of the first pixel point, the energy coefficient of the third pixel point and the diffusion speed of the third pixel point in the first diffusion direction are substituted into the above calculation formula, so that the diffusion speed of the first pixel point in the first diffusion direction can be quickly calculated.
获得第一像素点对应的上述扩散速度后,以该扩散速度从当前波形上的第一像素点向第一扩散方向进行边界扩散,能够扩散到第二像素点。对于第一像素点对应的其他每个扩 散方向,按照上述方式分别获取第一像素点在其他每个扩散方向上的扩散速度,并分别进行边界扩散,得到扩散后第一像素点对应的多个像素点。After obtaining the diffusion speed corresponding to the first pixel point, boundary diffusion is performed from the first pixel point on the current waveform to the first diffusion direction at the diffusion speed, and can be diffused to the second pixel point. In each diffusion direction, the diffusion speed of the first pixel point in each other diffusion direction is obtained respectively according to the above method, and boundary diffusion is performed respectively to obtain multiple pixel points corresponding to the first pixel point after diffusion.
同样地,对于当前波形上的其他每个像素点,也都采用与第一像素点相同的操作,分别对当前波形上的其他每个像素点分别进行边界扩散,得到其他每个像素点边界扩散后对应的多个像素点。将对当前波形进行边界扩散得到的所有像素点连接起来,就得到了一个新的波形。Similarly, for each other pixel point on the current waveform, the same operation as the first pixel point is adopted, and each other pixel point on the current waveform is subjected to boundary diffusion respectively to obtain multiple pixel points corresponding to each other pixel point after boundary diffusion. All pixel points obtained by boundary diffusion of the current waveform are connected to obtain a new waveform.
然后基于当前波形与新的波形在各扩散方向上对应的两个像素点之间的像素梯度,分别计算新的波形上每个像素点的能量系数。由于每个像素点的能量系数的计算过程均相同,因此仅以新的波形上的第二像素点为例进行说明,第二像素点是从当前波形上的第一像素点进行边界扩散得到的一个像素点,第一像素点为当前波形上的任一像素点。Then, based on the pixel gradient between two corresponding pixels in each diffusion direction of the current waveform and the new waveform, the energy coefficient of each pixel on the new waveform is calculated. Since the calculation process of the energy coefficient of each pixel is the same, only the second pixel on the new waveform is used as an example for explanation. The second pixel is a pixel obtained by boundary diffusion from the first pixel on the current waveform, and the first pixel is any pixel on the current waveform.
具体地,基于当前波形上的第一像素点的特征值和新的波形上第二像素点的特征值,计算第二像素点对应的像素梯度。其中,特征值可以为像素点的灰度或亮度等。第二像素点对应的像素梯度可以为第一像素点与第二像素点之间的灰度差值或亮度差值等。Specifically, based on the characteristic value of the first pixel point on the current waveform and the characteristic value of the second pixel point on the new waveform, the pixel gradient corresponding to the second pixel point is calculated. The characteristic value may be the grayscale or brightness of the pixel point. The pixel gradient corresponding to the second pixel point may be the grayscale difference or brightness difference between the first pixel point and the second pixel point.
基于第二像素点对应的像素梯度,确定第二像素点的能量系数。具体将第二像素点对应的像素梯度代入能量系数与梯度之间的映射函数中,计算得到第二像素点的能量系数。Based on the pixel gradient corresponding to the second pixel, the energy coefficient of the second pixel is determined. Specifically, the pixel gradient corresponding to the second pixel is substituted into the mapping function between the energy coefficient and the gradient to calculate the energy coefficient of the second pixel.
对于上述新的波形上的其他每个像素点,都按照与上述第二像素点的操作,分别确定新的波形上其他每个像素点的能量系数。For each other pixel point on the new waveform, the energy coefficient of each other pixel point on the new waveform is determined according to the operation on the second pixel point.
S2:基于每个波形上像素点的能量系数,从超声图像中识别出目标对象的边界轮廓。S2: Based on the energy coefficient of each pixel point on the waveform, the boundary contour of the target object is identified from the ultrasound image.
超声图像中不同位置的像素点的梯度不同,在图像纹理变化小的区域像素点的梯度较小,在图像纹理变化大的区域像素点的梯度较大。在目标对象的边界处图像纹理变化会比较大,因此像素点梯度也很大。在边界扩散过程中,波形从内向外扩散过程中会存在能量衰减,即能量系数变小。波形从梯度小的区域向梯度大的区域扩散时衰减的能量更多,向梯度越大的区域扩散能量系数衰减的越多。当能量系数衰减到一定程度后,表明波形在扩散过程中已经跨越了目标对象的边界,已经可以识别出目标对象的边界了,因此不必再继续向外扩散。The gradients of pixels at different positions in an ultrasound image are different. The gradients of pixels in areas with small changes in image texture are small, and the gradients of pixels in areas with large changes in image texture are large. The image texture changes greatly at the boundary of the target object, so the pixel gradient is also large. During the boundary diffusion process, energy attenuation occurs when the waveform diffuses from the inside to the outside, that is, the energy coefficient decreases. When the waveform diffuses from an area with a small gradient to an area with a large gradient, the attenuated energy is greater, and the energy coefficient attenuates more when it diffuses to an area with a larger gradient. When the energy coefficient decays to a certain extent, it indicates that the waveform has crossed the boundary of the target object during the diffusion process, and the boundary of the target object can be identified, so there is no need to continue to diffuse outward.
本申请实施例中预先配置了用于判定是否不必再继续扩散的预设阈值,在能量系数衰减至该预设阈值时停止继续扩散。具体地,在边界扩散过程中,每当确定出某个波形上像素点的能量系数之后,都判断该像素点的能量系数是否小于预设阈值。如果是,则后续不再对该像素点进行边界扩散。如果否,则继续按照上述方式对该像素点进行边界扩散。In the embodiment of the present application, a preset threshold is pre-configured for determining whether it is not necessary to continue diffusion, and the diffusion is stopped when the energy coefficient decays to the preset threshold. Specifically, in the boundary diffusion process, each time the energy coefficient of a pixel point on a waveform is determined, it is determined whether the energy coefficient of the pixel point is less than the preset threshold. If yes, the boundary diffusion of the pixel point will not be performed subsequently. If not, the boundary diffusion of the pixel point will continue in the above manner.
本申请实施例将能量系数小于预设阈值的像素点称为目标像素点,对于每个目标像素点,分别确定从起点坐标扩散至每个目标像素点的扩散路径。其中,扩散路径包括多个节点像素点,每个节点像素点均为由起点坐标扩散至目标像素点过程中得到的至少一个像素点。In the embodiment of the present application, the pixel point whose energy coefficient is less than the preset threshold is called the target pixel point, and for each target pixel point, a diffusion path from the starting point coordinate to each target pixel point is determined respectively. The diffusion path includes a plurality of node pixel points, and each node pixel point is at least one pixel point obtained in the process of diffusion from the starting point coordinate to the target pixel point.
基于每个扩散路径上节点像素点的能量系数,分别确定位于每个扩散路径上的边界像素点。以第一扩散路径为例说明确定边界像素点的过程,第一扩散路径为每个扩散路径中的任一扩散路径。具体地,分别计算第一扩散路径上任意相邻的两个节点像素点的能量系数的差值绝对值,从计算得到的多个差值绝对值中确定出最大的差值绝对值。将最大的差值绝对值对应的两个节点像素点中距离起点坐标最远的那个节点像素点确定为边界像素点。 Based on the energy coefficient of the node pixel points on each diffusion path, the boundary pixel points located on each diffusion path are determined respectively. The process of determining the boundary pixel points is described by taking the first diffusion path as an example, and the first diffusion path is any diffusion path in each diffusion path. Specifically, the absolute value of the difference between the energy coefficients of any two adjacent node pixel points on the first diffusion path is calculated respectively, and the maximum absolute value of the difference is determined from the multiple absolute values of the difference calculated. The node pixel point farthest from the starting point coordinates among the two node pixel points corresponding to the maximum absolute value of the difference is determined as the boundary pixel point.
对于其他每个扩散路径也按照上述方式,分别确定出其他每个扩散路径上的边界像素点。然后将确定出的每个边界像素点连成线,即得到了目标对象的边界轮廓。For each other diffusion path, the boundary pixel points on each other diffusion path are determined in the same manner as above, and then each determined boundary pixel point is connected into a line, thus obtaining the boundary contour of the target object.
由于波形在跨越目标对象的边界时能量系数会下降很多,因此在扩散路径中相邻的两个节点像素点的能量系数若相差很大,则这两个节点像素点很可能分别位于边界的两侧。通过计算扩散路径上任意相邻的两个节点像素点的能量系数的差值绝对值,找出最大的差值绝对值对应的两个节点像素点,则这两个像素点是该扩散路径上最有可能位于边界两侧的两个像素点。将这两个像素点中距离起点坐标最远的那个像素点作为边界像素点,如此能够使得确定的边界像素点接近目标对象的真实边界,且选择上述两个像素点中距离起点坐标最远的像素点作为边界像素点,因此该边界像素点可能在目标对象的真实边界上或者真实边界外面,在真实边界内的几率很小,从而使得最终确定出的目标对象的边界轮廓能够将目标对象的所有区域包含在内。Since the energy coefficient of the waveform will drop a lot when crossing the boundary of the target object, if the energy coefficients of two adjacent node pixels in the diffusion path are very different, then these two node pixels are likely to be located on both sides of the boundary. By calculating the absolute value of the difference between the energy coefficients of any two adjacent node pixels on the diffusion path, the two node pixels corresponding to the largest absolute value of the difference are found. These two pixels are the two pixels on the diffusion path that are most likely to be located on both sides of the boundary. The pixel point farthest from the starting point coordinates of the two pixels is taken as the boundary pixel point, so that the determined boundary pixel point can be close to the real boundary of the target object, and the pixel point farthest from the starting point coordinates of the above two pixels is selected as the boundary pixel point, so that the boundary pixel point may be on the real boundary of the target object or outside the real boundary, and the probability of being inside the real boundary is very small, so that the boundary contour of the target object finally determined can include all areas of the target object.
本申请实施例中,为最大概率的确定出的目标对象的边界轮廓能够将目标对象的所有区域包含在内,在确定最大的差值绝对值对应的两个节点像素点后,以这两个节点像素点为起点,在第一扩散路径上且远离起点坐标的方向上确定边界像素点,该边界像素点与这两个节点像素点之间的距离为预设距离。预设距离可以根据实际需求进行设定。In the embodiment of the present application, the boundary contour of the target object determined with the maximum probability can include all areas of the target object. After determining the two node pixel points corresponding to the maximum absolute value of the difference, the boundary pixel points are determined on the first diffusion path and in the direction away from the starting point coordinates, with the two node pixel points as the starting point, and the distance between the boundary pixel point and the two node pixel points is the preset distance. The preset distance can be set according to actual needs.
本申请实施例以目标对象所在区域内的任一点为中心,向周围进行边界扩散,在扩散过程中基于像素点之间能量系数的变化,识别出目标对象的边界轮廓。实现自动识别目标对象的边界轮廓,无需医师主观确定边界轮廓,减少人为操作,提高了超声检测中识别目标对象边界轮廓的效率和准确性。The embodiment of the present application takes any point in the area where the target object is located as the center, performs boundary diffusion to the surrounding area, and identifies the boundary contour of the target object based on the change of energy coefficient between pixel points during the diffusion process. The boundary contour of the target object is automatically identified, and there is no need for doctors to subjectively determine the boundary contour, which reduces manual operations and improves the efficiency and accuracy of identifying the boundary contour of the target object in ultrasonic testing.
在本申请实施例中,通过上述方式识别出目标对象的边界轮廓之后,还可以在当前显示的超声图像中标注出目标对象的边界轮廓。具体地可以通过采用预设颜色或加粗等方式来标注边界轮廓,预设颜色可以为红色或黄色等。通过标注出目标对象的边界轮廓,能够使医师能够更加直观地看到目标对象的大小及形状,有助于医师对目标对象进行后续的大小测量,提高超声检测的准确性及参考价值。In the embodiment of the present application, after the boundary contour of the target object is identified in the above manner, the boundary contour of the target object can also be marked in the currently displayed ultrasound image. Specifically, the boundary contour can be marked by using a preset color or bolding, and the preset color can be red or yellow. By marking the boundary contour of the target object, the physician can see the size and shape of the target object more intuitively, which helps the physician to perform subsequent size measurements of the target object and improve the accuracy and reference value of ultrasound detection.
通过上述方式识别出目标对象的边界轮廓之后,还可以基于识别出的边界轮廓对目标对象的应用指标进行测量,该应用指标可以包括目标对象的周长、面积、纵横比等。本申请实施例自动准确地识别出目标对象的边界轮廓,有助于提高应用指标测量的精度,提高测量得到的应用指标在临床上的参考价值。After the boundary contour of the target object is identified in the above manner, the application index of the target object can also be measured based on the identified boundary contour, and the application index can include the perimeter, area, aspect ratio, etc. of the target object. The embodiment of the present application automatically and accurately identifies the boundary contour of the target object, which helps to improve the accuracy of the application index measurement and improve the clinical reference value of the measured application index.
在本申请的一些实施例中,在边界扩散过程中,还可以在当前显示的超声图像中叠加显示每次边界扩散形成的波形。如图5所示的超声图像的示意图中,显示出了起点坐标,通过加粗的方式标注出了目标对象的边界轮廓,以及叠加显示出了边界扩散过程中产生的每个波形。In some embodiments of the present application, during the boundary diffusion process, the waveform formed by each boundary diffusion can also be superimposed and displayed in the currently displayed ultrasound image. In the schematic diagram of the ultrasound image shown in FIG5 , the starting point coordinates are displayed, the boundary contour of the target object is marked in bold, and each waveform generated during the boundary diffusion process is superimposed and displayed.
图6所示的超声图像的示意图,是在图5所示的超声图像的基础上还标注出了每个波形上多处的能量系数,能够使医师基于该超声图像直观地看出边界轮廓的识别过程,使整个识别过程可视化且具有可解释性。The schematic diagram of the ultrasound image shown in FIG6 is based on the ultrasound image shown in FIG5 and also marks the energy coefficients at multiple locations on each waveform, which enables the physician to intuitively see the recognition process of the boundary contour based on the ultrasound image, making the entire recognition process visual and explainable.
在本申请的另一些实施例中,在边界扩散过程中,基于边界扩散形成的波形,生成波形扩散动画。该波形扩散动画可以按一定的显示频率,如水波纹一般由起点坐标向外扩散。在当前显示的超声图像上叠加播放该波形扩散动画。例如,可以在上一圈波形显示后消失,并显示下一圈波形。 In some other embodiments of the present application, during the boundary diffusion process, a waveform diffusion animation is generated based on the waveform formed by the boundary diffusion. The waveform diffusion animation can be displayed at a certain frequency, such as water ripples spreading outward from the starting point coordinates. The waveform diffusion animation is superimposed and played on the currently displayed ultrasound image. For example, the previous circle of waveforms can disappear after being displayed, and the next circle of waveforms can be displayed.
通过波形扩散动画的形式在当前显示的超声图像中展示边界扩散识别目标对象边界扩散的过程,能够使整个识别过程更加直观且生动有趣。The process of boundary diffusion identification of a target object is displayed in the currently displayed ultrasound image in the form of a waveform diffusion animation, which can make the entire identification process more intuitive and interesting.
在本申请实施例中,以选择目标对象的选择位置作为起点坐标,以该起点坐标为中心向四周进行边界扩散,在边界扩散的过程中识别目标对象的边界轮廓。实现了对目标对象边界轮廓的自动识别,大大减少整个过程中的人为干预成分,提高边界轮廓识别的效率,且边界轮廓识别的准确性很高。进一步地,在边界扩散过程中基于像素点之间的能量系数的变化来识别目标对象的边界轮廓,能量系数的变化符合目标对象内部及边界部位处的图像纹理特征的变化,因此能够准确地识别出目标对象的边界轮廓。进一步地,还可以将整个边界扩散过程叠加显示在当前显示的超声图像中,实现整个边界扩散过程的可视化。In an embodiment of the present application, the selected position of the target object is selected as the starting point coordinate, and the boundary diffusion is performed around the starting point coordinate as the center, and the boundary contour of the target object is identified during the boundary diffusion process. Automatic recognition of the boundary contour of the target object is achieved, which greatly reduces the human intervention component in the entire process, improves the efficiency of boundary contour recognition, and the accuracy of boundary contour recognition is very high. Furthermore, during the boundary diffusion process, the boundary contour of the target object is identified based on the change of the energy coefficient between the pixel points. The change of the energy coefficient conforms to the change of the image texture characteristics inside and at the boundary of the target object, so the boundary contour of the target object can be accurately identified. Furthermore, the entire boundary diffusion process can also be superimposed and displayed on the currently displayed ultrasound image to achieve visualization of the entire boundary diffusion process.
为了便于理解本申请实施例提供的超声图像处理过程,下面以举例的方式来说明识别目标对象的边界轮廓的具体过程。以目标对象为囊肿为例,假设医师在对受检者的腹部进行超声检测的过程中,在超声设备的显示屏实时显示的超声图像中发现了一个囊肿,则医师可以通过鼠标单击该囊肿所在区域内的任意位置。超声设备检测到鼠标输入的单击指令,确定单击的位置在该超声图像中的坐标,以该坐标作为起点坐标A。超声设备检测到该起点坐标A后,启动边界识别波形,以该起点坐标A为中心向周围进行边界扩散。In order to facilitate understanding of the ultrasound image processing process provided by the embodiment of the present application, the specific process of identifying the boundary contour of the target object is explained below by way of example. Taking the target object as a cyst as an example, assuming that the physician finds a cyst in the ultrasound image displayed in real time on the display screen of the ultrasound device during an ultrasound examination of the abdomen of the subject, the physician can click the mouse anywhere within the area where the cyst is located. The ultrasound device detects the click instruction input by the mouse, determines the coordinates of the click position in the ultrasound image, and uses the coordinates as the starting point coordinate A. After the ultrasound device detects the starting point coordinate A, it starts the boundary recognition waveform, and diffuses the boundary around the starting point coordinate A.
在一种示例中,假设扩散速度为1个像素点的距离,则从该起点坐标A向周围各个扩散方向上扩散1个像素点的距离,如图7所示,从起点坐标A扩散至周围相邻的8个像素点,这8个像素点连成的闭环波形即为边界扩散过程中形成的第一个波形W1。基于起点坐标A和与其相邻的像素点之间的梯度,分别计算扩散至的每个像素点的能量系数。In one example, assuming that the diffusion speed is the distance of one pixel, the distance of one pixel is diffused from the starting coordinate A to the surrounding diffusion directions, as shown in Figure 7, from the starting coordinate A to the surrounding 8 adjacent pixels, the closed-loop waveform formed by these 8 pixels is the first waveform W1 formed in the boundary diffusion process. Based on the gradient between the starting coordinate A and the adjacent pixels, the energy coefficient of each pixel diffused to is calculated respectively.
在另一种示例中,也可以直接设置第一个波形W1,第一个波形W1的形状可以是圆形,W1上每个像素点与起点坐标A的距离均为v0,即从起点坐标A向各个扩散方向扩散至波形W1的扩散速度均为v0。可以设置波形W1上每个像素点的能量系数均为1。图8示出了直接设置第一个波形W1的示意图。In another example, the first waveform W1 may be directly set. The shape of the first waveform W1 may be circular. The distance between each pixel point on W1 and the starting coordinate A is v 0 , that is, the diffusion speed from the starting coordinate A to each diffusion direction to the waveform W1 is v0. The energy coefficient of each pixel point on the waveform W1 may be set to 1. FIG8 shows a schematic diagram of directly setting the first waveform W1.
按照上述任一示例得到第一个波形W1后,对于波形W1上的每个像素点,均判断每个像素点中是否存在能量系数小于预设阈值的目标像素点。若存在能量系数小于预设阈值的目标像素点,则不再对该目标像素点进行边界扩散。对于能量系数大于等于预设阈值的像素点,再次对这些像素点进行边界扩散。After the first waveform W1 is obtained according to any of the above examples, for each pixel point on the waveform W1, it is determined whether there is a target pixel point whose energy coefficient is less than the preset threshold value. If there is a target pixel point whose energy coefficient is less than the preset threshold value, the boundary diffusion of the target pixel point is no longer performed. For the pixel points whose energy coefficient is greater than or equal to the preset threshold value, the boundary diffusion of these pixel points is performed again.
如图9所示,对于波形W1上的像素点B再次向多个扩散方向进行边界扩散。以从像素点B扩散至像素点C为例,首先基于像素点B的能量系数、像素点A的扩散速度和能量系数,计算出像素点B的扩散速度。以像素点B的扩散速度由像素点B扩散至像素点C。As shown in FIG9 , the pixel point B on the waveform W1 is again diffused in multiple diffusion directions. Taking diffusion from pixel point B to pixel point C as an example, the diffusion speed of pixel point B is first calculated based on the energy coefficient of pixel point B, the diffusion speed of pixel point A, and the energy coefficient. Diffusion is performed from pixel point B to pixel point C at the diffusion speed of pixel point B.
按照上述方式一圈一圈的向外扩散,扩散至能量系数小于预设阈值的目标像素点E,即停止对目标像素点E的扩散。确定出由起点坐标A扩散至该目标像素点E的扩散路径。如图10所示,该扩散路径上包括像素点A、B、C、D、E共5个节点像素点,分别计算像素点A和B的能量系数的差值绝对值,像素点B和C的能量系数的差值绝对值,像素点C和D的能量系数的差值绝对值,像素点D和E的能量系数的差值绝对值。从计算的四个差值绝对值中确定出最大的差值绝对值,假设像素点D和E的能量系数的差值绝对值最大,则将像素点E确定为囊肿的一个边界像素点。According to the above method, it diffuses outward in circles until it reaches the target pixel E whose energy coefficient is less than the preset threshold, and then stops diffusing to the target pixel E. Determine the diffusion path from the starting coordinate A to the target pixel E. As shown in Figure 10, the diffusion path includes five node pixels, namely, pixels A, B, C, D, and E. The absolute value of the difference between the energy coefficients of pixels A and B, the absolute value of the difference between the energy coefficients of pixels B and C, the absolute value of the difference between the energy coefficients of pixels C and D, and the absolute value of the difference between the energy coefficients of pixels D and E are calculated respectively. The largest absolute value of the difference is determined from the four calculated absolute values of the difference. Assuming that the absolute value of the difference between the energy coefficients of pixels D and E is the largest, pixel E is determined as a boundary pixel of the cyst.
对每个能量系数小于预设阈值的目标像素点,都按照上述方式进行处理,确定出囊肿的所有边界像素点,所有边界像素点连成的闭合环线即为囊肿的边界轮廓。 Each target pixel point whose energy coefficient is less than a preset threshold is processed in the above manner to determine all boundary pixel points of the cyst, and the closed loop formed by all boundary pixel points is the boundary contour of the cyst.
以囊肿内的一点作为起点坐标,以该起点坐标为中心向四周进行边界扩散,在边界扩散的过程中自动识别囊肿的边界轮廓,整个过程中的人为操作很少,提高了边界识别的效率和准确性。且基于像素点之间的能量系数的变化来识别囊肿的边界轮廓,能量系数的变化符合囊肿内部及边界部位处的纹理特征的变化,因此能够准确地识别出囊肿的边界轮廓。A point inside the cyst is used as the starting point coordinate, and the boundary diffusion is performed around the starting point coordinate. The boundary contour of the cyst is automatically identified during the boundary diffusion process. There is very little manual operation in the whole process, which improves the efficiency and accuracy of boundary identification. The boundary contour of the cyst is identified based on the change of the energy coefficient between the pixels. The change of the energy coefficient conforms to the change of the texture characteristics inside the cyst and at the boundary, so the boundary contour of the cyst can be accurately identified.
参见图11,本申请实施例还提供一种超声图像处理装置,该装置用于执行上述实施例所述的超声图像处理方法,该装置包括:Referring to FIG. 11 , an embodiment of the present application further provides an ultrasonic image processing device, which is used to execute the ultrasonic image processing method described in the above embodiment, and the device includes:
检测模块201,用于检测到用于指示选择超声图像中目标对象的选择指令;A detection module 201 is used to detect a selection instruction for instructing to select a target object in an ultrasound image;
起点确定模块202,用于将选择指令所指示的坐标作为起点坐标;A starting point determination module 202, configured to use the coordinates indicated by the selection instruction as starting point coordinates;
边界识别模块203,用于以起点坐标为中心向四周进行边界扩散识别,以从超声图像中识别出目标对象的边界轮廓。The boundary recognition module 203 is used to perform boundary diffusion recognition around the starting point coordinates to recognize the boundary contour of the target object from the ultrasound image.
在一些实施例中,边界识别模块203,具体可以用于基于起点坐标,确定每次边界扩散形成的波形上像素点的能量系数,能量系数与基于边界扩散经过的像素点的梯度相关联;基于每个波形上像素点的能量系数,从超声图像中识别出目标对象的边界轮廓。In some embodiments, the boundary recognition module 203 can be specifically used to determine the energy coefficient of the pixel points on the waveform formed by each boundary diffusion based on the starting point coordinates, and the energy coefficient is associated with the gradient of the pixel points through which the boundary diffusion passes; based on the energy coefficient of the pixel points on each waveform, the boundary contour of the target object is identified from the ultrasound image.
在一些实施例中,边界识别模块203,具体可以用于从当前波形上的像素点分别向多个扩散方向进行边界扩散,获得新的波形;当前波形是以起点坐标为中心进行至少一次边界扩散得到的波形;基于当前波形的第一像素点与新的波形的第二像素点之间的像素梯度,分别计算第二像素点的能量系数。其中,所述第二像素点在所述第一像素点的第一扩散方向上,所述第一像素点为所述当前波形上的任一像素点,所述第一扩散方向为所述第一像素点对应的多个扩散方向中的任一扩散方向。In some embodiments, the boundary recognition module 203 can be specifically used to perform boundary diffusion from the pixel points on the current waveform to multiple diffusion directions to obtain a new waveform; the current waveform is a waveform obtained by performing at least one boundary diffusion with the starting point coordinate as the center; based on the pixel gradient between the first pixel point of the current waveform and the second pixel point of the new waveform, the energy coefficient of the second pixel point is calculated respectively. Wherein, the second pixel point is in the first diffusion direction of the first pixel point, the first pixel point is any pixel point on the current waveform, and the first diffusion direction is any diffusion direction of the multiple diffusion directions corresponding to the first pixel point.
在一些实施例中,边界识别模块203,具体可以用于获取第一像素点在第一扩散方向上的扩散速度;以扩散速度从第一像素点向第一扩散方向进行边界扩散,得到第二像素点,多个所述第二像素点形成所述新的波形。In some embodiments, the boundary recognition module 203 can be specifically used to obtain the diffusion speed of the first pixel point in the first diffusion direction; perform boundary diffusion from the first pixel point to the first diffusion direction at the diffusion speed to obtain the second pixel point, and multiple second pixel points form the new waveform.
在一些实施例中,边界识别模块203,具体可以用于获取第一像素点的能量系数、第三像素点的能量系数及第三像素点在第一扩散方向上的扩散速度;第三像素点为与当前波形相邻的上一个波形中的像素点,第一像素点是以第三像素点对应的扩散速度从第三像素点向第一扩散方向进行边界扩散得到的;基于第一像素点的能量系数、第三像素点的能量系数及第三像素点在第一扩散方向上的扩散速度,计算第一像素点在第一扩散方向上的扩散速度。In some embodiments, the boundary recognition module 203 can be specifically used to obtain the energy coefficient of the first pixel point, the energy coefficient of the third pixel point and the diffusion speed of the third pixel point in the first diffusion direction; the third pixel point is a pixel point in the previous waveform adjacent to the current waveform, and the first pixel point is obtained by boundary diffusion from the third pixel point to the first diffusion direction at the diffusion speed corresponding to the third pixel point; based on the energy coefficient of the first pixel point, the energy coefficient of the third pixel point and the diffusion speed of the third pixel point in the first diffusion direction, the diffusion speed of the first pixel point in the first diffusion direction is calculated.
在一些实施例中,边界识别模块203,具体可以用于计算第三像素点的能量系数与第一像素点的能量系数的差值,得到从第三像素点扩散至第一像素点产生的能量衰减量;基于能量衰减量,确定扩散速度的损失量;计算第三像素点在第一扩散方向上的扩散速度与损失量的差值,得到第一像素点在第一扩散方向上的扩散速度。In some embodiments, the boundary identification module 203 can be specifically used to calculate the difference between the energy coefficient of the third pixel point and the energy coefficient of the first pixel point, and obtain the energy attenuation generated by diffusion from the third pixel point to the first pixel point; based on the energy attenuation, determine the loss of diffusion speed; calculate the difference between the diffusion speed of the third pixel point in the first diffusion direction and the loss, and obtain the diffusion speed of the first pixel point in the first diffusion direction.
在一些实施例中,边界识别模块203,具体可以用于基于当前波形上的第一像素点的特征值和新的波形上第二像素点的特征值,计算第二像素点对应的像素梯度;基于第二像素点对应的像素梯度,确定第二像素点的能量系数。In some embodiments, the boundary recognition module 203 can be specifically used to calculate the pixel gradient corresponding to the second pixel point based on the characteristic value of the first pixel point on the current waveform and the characteristic value of the second pixel point on the new waveform; and determine the energy coefficient of the second pixel point based on the pixel gradient corresponding to the second pixel point.
在一些实施例中,边界识别模块203,具体可以用于在边界扩散过程中,分别确定从起点坐标扩散至每个目标像素点的扩散路径,其中,所述目标像素点为能量系数小于预设阈值的像素点,扩散路径包括多个节点像素点,节点像素点为由起点坐标扩散至目标像素点过程中得到的至少一个像素点;基于每个扩散路径上节点像素点的能量系数,分别确定 位于每个扩散路径上的边界像素点;将确定出的每个边界像素点连成目标对象的边界轮廓。In some embodiments, the boundary recognition module 203 can be specifically used to determine the diffusion path from the starting point coordinates to each target pixel point during the boundary diffusion process, wherein the target pixel point is a pixel point whose energy coefficient is less than a preset threshold, and the diffusion path includes a plurality of node pixel points, and the node pixel point is at least one pixel point obtained in the process of diffusion from the starting point coordinates to the target pixel point; based on the energy coefficient of the node pixel point on each diffusion path, respectively determine The boundary pixel points located on each diffusion path; each determined boundary pixel point is connected to form the boundary contour of the target object.
在一些实施例中,边界识别模块203,具体可以用于分别计算第一扩散路径上任意相邻的两个节点像素点的能量系数的差值绝对值,第一扩散路径为每个扩散路径中的任一扩散路径;将最大的差值绝对值对应的两个节点像素点中距离起点坐标最远的节点像素点确定为边界像素点。In some embodiments, the boundary identification module 203 can be specifically used to calculate the absolute value of the difference in energy coefficients between any two adjacent node pixel points on the first diffusion path, where the first diffusion path is any diffusion path in each diffusion path; and the node pixel point farthest from the starting point coordinates among the two node pixel points corresponding to the largest absolute value of the difference is determined as a boundary pixel point.
在一些实施例中,上述超声图像处理装置还可以包括:显示模块,用于在边界扩散过程中,在当前显示的超声图像中叠加显示每次边界扩散形成的波形。In some embodiments, the ultrasonic image processing device may further include: a display module, configured to superimpose and display a waveform formed by each boundary diffusion in the currently displayed ultrasonic image during the boundary diffusion process.
该显示模块,还可以用于在边界扩散过程中,基于边界扩散形成的波形,生成波形扩散动画;在当前显示的超声图像上叠加播放波形扩散动画。The display module can also be used to generate a waveform diffusion animation based on the waveform formed by the boundary diffusion during the boundary diffusion process; and to overlay and play the waveform diffusion animation on the currently displayed ultrasound image.
在一些实施例中,上述超声图像处理装置还可以包括:标注模块,用于在当前显示的超声图像中标注出边界轮廓。In some embodiments, the ultrasound image processing apparatus may further include: a marking module, configured to mark a boundary contour in the currently displayed ultrasound image.
在一些实施例中,上述超声图像处理装置还可以包括:提示模块,用于若在预设时长内未检测出目标对象的边界轮廓,则显示提示信息,提示信息用于提示重新选择目标对象所在区域内的任意一点作为起点坐标。In some embodiments, the ultrasonic image processing device may further include: a prompt module for displaying a prompt message if the boundary contour of the target object is not detected within a preset time period, wherein the prompt message is used to prompt the user to reselect any point within the area where the target object is located as the starting point coordinate.
本申请实施例提供的超声图像处理装置与上述实施例提供的超声图像处理方法出于相同的发明构思,具有与其采用、运行或实现的方法相同的有益效果。The ultrasonic image processing device provided in the embodiment of the present application and the ultrasonic image processing method provided in the above embodiment are based on the same inventive concept and have the same beneficial effects as the methods adopted, operated or implemented therein.
本申请实施方式还提供一种与前述实施方式所提供的超声图像处理方法对应的电子设备,该电子设备可以为超声设备。请参考图12,其示出了本申请的一些实施方式所提供的一种电子设备的示意图。如图12所示,所述电子设备30可以包括:处理器300、存储器301、总线302和通信接口303,所述处理器300、通信接口303和存储器301通过总线302连接;所述存储器301中存储有可在所述处理器300上运行的计算机程序,所述处理器300运行所述计算机程序时执行本申请前述任一实施方式所提供的超声图像处理方法。The embodiment of the present application also provides an electronic device corresponding to the ultrasonic image processing method provided in the aforementioned embodiment, and the electronic device may be an ultrasonic device. Please refer to Figure 12, which shows a schematic diagram of an electronic device provided in some embodiments of the present application. As shown in Figure 12, the electronic device 30 may include: a processor 300, a memory 301, a bus 302 and a communication interface 303, and the processor 300, the communication interface 303 and the memory 301 are connected via the bus 302; the memory 301 stores a computer program that can be run on the processor 300, and the processor 300 executes the ultrasonic image processing method provided in any of the aforementioned embodiments of the present application when running the computer program.
其中,存储器301可能包含高速随机存取存储器(RAM:Random Access Memory),也可能还包括非不稳定的存储器(non-volatile memory),例如至少一个磁盘存储器。通过至少一个物理端口303(可以是有线或者无线)实现该系统网元与至少一个其他网元之间的通信连接,可以使用互联网、广域网、本地网、城域网等。The memory 301 may include a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one physical port 303 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used.
总线302可以是工业标准结构(Industry Standard Architecture,ISA)总线、外设部件互连标准(Peripheral Component Interconnect,PCI)总线或扩展工业标准结构(Extended Industry Standard Architecture,EISA)总线等。所述总线可以分为地址总线、数据总线、控制总线等。其中,存储器301用于存储程序,所述处理器300在接收到执行指令后,执行所述程序,前述本申请实施例任一实施方式揭示的所述超声图像处理方法可以应用于处理器300中,或者由处理器300实现。The bus 302 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. Among them, the memory 301 is used to store programs, and the processor 300 executes the program after receiving an execution instruction. The ultrasonic image processing method disclosed in any implementation of the aforementioned embodiment of the present application may be applied to the processor 300, or implemented by the processor 300.
处理器300可能是一种集成电路,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器300中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器300可以是通用处理器,包括中央处理器(Central Processing Unit,CPU)、网络处理器(Network Processor,NP)等;还可以是数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。 The processor 300 may be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor 300 or instructions in the form of software. The above processor 300 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
处理器300可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。The processor 300 can implement or execute the methods, steps and logic diagrams disclosed in the embodiments of the present application. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor to be executed, or a combination of hardware and software modules in the decoding processor to be executed.
软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器301中,处理器300读取存储器301中的信息,结合其硬件完成上述方法的步骤。The software module may be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 301, and the processor 300 reads the information in the memory 301 and completes the steps of the above method in combination with its hardware.
本申请实施例提供的电子设备与本申请实施例提供的超声图像处理方法出于相同的发明构思,具有与其采用、运行或实现的方法相同的有益效果。The electronic device provided in the embodiment of the present application and the ultrasound image processing method provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, operated or implemented therein.
本申请实施方式还提供一种与前述实施方式所提供的超声图像处理方法对应的计算机可读存储介质,其上存储有计算机程序(即程序产品),所述计算机程序在被处理器运行时,会执行前述任意实施方式所提供的超声图像处理方法。An embodiment of the present application also provides a computer-readable storage medium corresponding to the ultrasonic image processing method provided in the aforementioned embodiment, on which a computer program (i.e., a program product) is stored. When the computer program is run by a processor, it will execute the ultrasonic image processing method provided in any of the aforementioned embodiments.
需要说明的是,所述计算机可读存储介质的例子还可以包括,但不限于相变随机存取存储器(Phase-chang Random Access Memory,PRAM)、静态随机存取存储器(Static Random Access Memory,SRAM)、动态随机存取存储器(Dynamic Random Access Memory,DRAM)、其他类型的随机存取存储器(Random Access Memory,RAM)、只读存储器(Read-Only Memory,ROM)、电可擦除可编程只读存储器(Electrically Erasable Programmable Read Only Memory,EEPROM)、快闪记忆体或其他光学、磁性存储介质,在此不再一一赘述。It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase-change random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.
本申请实施方式还提供一种与前述实施方式所提供的超声图像处理方法对应的计算机程序产品,包括计算机程序,该计算机程序被处理器执行以实现上述各实施例提供的超声图像处理方法。An embodiment of the present application also provides a computer program product corresponding to the ultrasound image processing method provided in the aforementioned embodiment, including a computer program, which is executed by a processor to implement the ultrasound image processing method provided in the aforementioned embodiments.
本申请的上述实施例提供的计算机可读存储介质、计算机程序产品均与本申请实施例提供的超声图像处理方法出于相同的发明构思,具有与其存储的应用程序所采用、运行或实现的方法相同的有益效果。The computer-readable storage medium and computer program product provided in the above-mentioned embodiments of the present application are based on the same inventive concept as the ultrasound image processing method provided in the embodiments of the present application, and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.
需要说明的是:It should be noted:
在此提供的算法和显示不与任何特定计算机、虚拟装置或者其它设备有固有相关。各种通用装置也可以与基于在此的示教一起使用。根据上面的描述,构造这类装置所要求的结构是显而易见的。此外,本申请也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本申请的内容,并且上面对特定语言所做的描述是为了披露本申请的最佳实施方式。The algorithm and display provided herein are not inherently related to any particular computer, virtual device or other equipment. Various general purpose devices can also be used together with the teachings based on this. According to the above description, it is obvious to construct the structure required for this type of device. In addition, the application is not directed to any specific programming language. It should be understood that the content of the application described herein can be realized by various programming languages, and the description of the specific language above is to disclose the best mode of implementation of the application.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本申请的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.
类似地,应当理解,为了精简本申请并帮助理解各个发明方面中的一个或多个,在上面对本申请的示例性实施例的描述中,本申请的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本申请要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身 都作为本申请的单独实施例。Similarly, it should be understood that in order to streamline the present application and aid in understanding one or more of the various inventive aspects, in the above description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: the claimed application requires more features than those expressly recited in each claim. Rather, as reflected in the claims below, inventive aspects lie in less than all of the features of a single embodiment disclosed above. Therefore, the claims that follow the detailed description are hereby expressly incorporated into the detailed description, with each claim itself being herein incorporated by reference. All of them are considered as separate embodiments of this application.
本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and/or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本申请的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present application and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.
本申请的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本申请实施例的虚拟机的创建装置中的一些或者全部部件的一些或者全部功能。本申请还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本申请的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。The various component embodiments of the present application can be implemented in hardware, or implemented in software modules running on one or more processors, or implemented in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components in the creation device of the virtual machine according to the embodiment of the present application. The application can also be implemented as a device or device program (e.g., computer program and computer program product) for executing part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
应该注意的是上述实施例对本申请进行说明而不是对本申请进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本申请可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above embodiments illustrate the present application rather than limit the present application, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets should not be constructed as a limitation to the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of multiple such elements. The present application may be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim that lists several devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.
以上所述,仅为本申请较佳的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。 The above is only a preferred specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims (25)

  1. 一种超声图像处理方法,其特征在于,包括:An ultrasonic image processing method, characterized by comprising:
    检测到用于指示选择超声图像中目标对象的选择指令;detecting a selection instruction for instructing selection of a target object in the ultrasound image;
    将所述选择指令所指示的坐标作为起点坐标;Taking the coordinates indicated by the selection instruction as the starting point coordinates;
    以所述起点坐标为中心向四周进行边界扩散识别,以从所述超声图像中识别出所述目标对象的边界轮廓。Boundary diffusion recognition is performed around the starting point coordinates to identify the boundary contour of the target object from the ultrasound image.
  2. 根据权利要求1所述的方法,其特征在于,以所述起点坐标为中心向四周进行边界扩散识别,以从所述超声图像中识别出所述目标对象的边界轮廓,包括:The method according to claim 1, characterized in that the boundary diffusion recognition is performed around the starting point coordinates to identify the boundary contour of the target object from the ultrasonic image, comprising:
    基于所述起点坐标,确定每次边界扩散形成的波形上像素点的能量系数,所述能量系数与基于边界扩散经过的像素点的梯度相关联;Based on the starting point coordinates, determining an energy coefficient of a pixel point on a waveform formed by each boundary diffusion, wherein the energy coefficient is associated with a gradient of the pixel point through which the boundary diffusion passes;
    基于每个所述波形上像素点的能量系数,从所述超声图像中识别出所述目标对象的边界轮廓。Based on the energy coefficient of each pixel point on the waveform, a boundary contour of the target object is identified from the ultrasound image.
  3. 根据权利要求2所述的方法,其特征在于,所述基于所述起点坐标,确定每次边界扩散形成的波形上像素点的能量系数,包括:The method according to claim 2, characterized in that the step of determining the energy coefficient of the pixel point on the waveform formed by each boundary diffusion based on the starting point coordinates comprises:
    从当前波形上的像素点分别向多个扩散方向进行边界扩散,获得新的波形;所述当前波形是以所述起点坐标为中心进行至少一次边界扩散得到的波形;Perform boundary diffusion in multiple diffusion directions from pixel points on the current waveform to obtain a new waveform; the current waveform is a waveform obtained by performing boundary diffusion at least once with the starting point coordinate as the center;
    基于所述当前波形的第一像素点与所述新的波形的第二像素点之间的像素梯度,分别计算所述第二像素点的能量系数,其中,所述第二像素点在所述第一像素点的第一扩散方向上,所述第一像素点为所述当前波形上的任一像素点,所述第一扩散方向为所述第一像素点对应的多个扩散方向中的任一扩散方向。Based on the pixel gradient between the first pixel point of the current waveform and the second pixel point of the new waveform, the energy coefficient of the second pixel point is calculated respectively, wherein the second pixel point is in the first diffusion direction of the first pixel point, the first pixel point is any pixel point on the current waveform, and the first diffusion direction is any diffusion direction of multiple diffusion directions corresponding to the first pixel point.
  4. 根据权利要求3所述的方法,其特征在于,所述从当前波形上的像素点分别向多个扩散方向进行边界扩散,获得新的波形,包括:The method according to claim 3 is characterized in that the step of performing boundary diffusion in multiple diffusion directions from pixel points on the current waveform to obtain a new waveform comprises:
    获取所述第一像素点在所述第一扩散方向上的扩散速度;Acquire a diffusion speed of the first pixel point in the first diffusion direction;
    以所述扩散速度从所述第一像素点向所述第一扩散方向进行边界扩散,得到所述第二像素点,多个所述第二像素点形成所述新的波形。Boundary diffusion is performed from the first pixel point to the first diffusion direction at the diffusion speed to obtain the second pixel point, and a plurality of the second pixel points form the new waveform.
  5. 根据权利要求4所述的方法,其特征在于,所述获取所述第一像素点在所述第一扩散方向上的扩散速度,包括:The method according to claim 4, characterized in that obtaining the diffusion speed of the first pixel in the first diffusion direction comprises:
    获取所述第一像素点的能量系数、第三像素点的能量系数及所述第三像素点在所述第一扩散方向上的扩散速度;所述第三像素点为与所述当前波形相邻的上一个波形中的像素点,所述第一像素点是以所述第三像素点对应的扩散速度从所述第三像素点向所述第一扩散方向进行边界扩散得到的;Obtaining an energy coefficient of the first pixel point, an energy coefficient of a third pixel point, and a diffusion speed of the third pixel point in the first diffusion direction; the third pixel point is a pixel point in a previous waveform adjacent to the current waveform, and the first pixel point is obtained by boundary diffusion from the third pixel point to the first diffusion direction at a diffusion speed corresponding to the third pixel point;
    基于所述第一像素点的能量系数、第三像素点的能量系数及所述第三像素点在所述第一扩散方向上的扩散速度,计算所述第一像素点在所述第一扩散方向上的扩散速度。The diffusion speed of the first pixel in the first diffusion direction is calculated based on the energy coefficient of the first pixel, the energy coefficient of the third pixel, and the diffusion speed of the third pixel in the first diffusion direction.
  6. 根据权利要求5所述的方法,其特征在于,所述基于所述第一像素点的能量系数、第三像素点的能量系数及所述第三像素点在所述第一扩散方向上的扩散速度,计算所述第一像素点在所述第一扩散方向上的扩散速度,包括:The method according to claim 5, characterized in that the calculating the diffusion speed of the first pixel in the first diffusion direction based on the energy coefficient of the first pixel, the energy coefficient of the third pixel and the diffusion speed of the third pixel in the first diffusion direction comprises:
    计算所述第三像素点的能量系数与所述第一像素点的能量系数的差值,得到从所述第三像素点扩散至所述第一像素点产生的能量衰减量;Calculating a difference between an energy coefficient of the third pixel and an energy coefficient of the first pixel to obtain an energy attenuation caused by diffusion from the third pixel to the first pixel;
    基于所述能量衰减量,确定扩散速度的损失量; Determining a loss in diffusion speed based on the energy attenuation;
    计算所述第三像素点在所述第一扩散方向上的扩散速度与所述损失量的差值,得到所述第一像素点在所述第一扩散方向上的扩散速度。The difference between the diffusion speed of the third pixel point in the first diffusion direction and the loss amount is calculated to obtain the diffusion speed of the first pixel point in the first diffusion direction.
  7. 根据权利要求3所述的方法,其特征在于,所述基于所述当前波形的第一像素点与所述新的波形的第二像素点之间的像素梯度,分别计算所述第二像素点的能量系数,包括:The method according to claim 3, characterized in that the step of calculating the energy coefficient of the second pixel point based on the pixel gradient between the first pixel point of the current waveform and the second pixel point of the new waveform comprises:
    基于所述当前波形上的第一像素点的特征值和所述新的波形上第二像素点的特征值,计算所述第二像素点对应的像素梯度;Calculating a pixel gradient corresponding to a first pixel point on the current waveform and a second pixel point on the new waveform based on a characteristic value of the first pixel point on the current waveform and a characteristic value of the second pixel point on the new waveform;
    基于所述第二像素点对应的像素梯度,确定所述第二像素点的能量系数。An energy coefficient of the second pixel is determined based on a pixel gradient corresponding to the second pixel.
  8. 根据权利要求2-7任一项所述的方法,其特征在于,所述基于每个所述波形上像素点的能量系数,从所述超声图像中识别出所述目标对象的边界轮廓,包括:The method according to any one of claims 2 to 7, characterized in that the step of identifying the boundary contour of the target object from the ultrasound image based on the energy coefficient of each pixel point on the waveform comprises:
    在边界扩散过程中,分别确定从所述起点坐标扩散至每个目标像素点的扩散路径,其中,所述目标像素点为能量系数小于预设阈值的像素点,所述扩散路径包括多个节点像素点,所述节点像素点为由所述起点坐标扩散至所述目标像素点过程中得到的至少一个像素点;In the process of boundary diffusion, a diffusion path from the starting point coordinate to each target pixel point is determined respectively, wherein the target pixel point is a pixel point whose energy coefficient is less than a preset threshold, and the diffusion path includes a plurality of node pixel points, and the node pixel point is at least one pixel point obtained in the process of diffusion from the starting point coordinate to the target pixel point;
    基于每个扩散路径上节点像素点的能量系数,分别确定位于每个扩散路径上的边界像素点;Based on the energy coefficient of the node pixel points on each diffusion path, the boundary pixel points on each diffusion path are determined respectively;
    将确定出的每个边界像素点连成所述目标对象的边界轮廓。Each determined boundary pixel point is connected to form a boundary contour of the target object.
  9. 根据权利要求8所述的方法,其特征在于,所述基于每个扩散路径上节点像素点的能量系数,分别确定位于每个扩散路径上的边界像素点,包括:The method according to claim 8, characterized in that the step of determining the boundary pixel points located on each diffusion path based on the energy coefficient of the node pixel points on each diffusion path comprises:
    分别计算第一扩散路径上任意相邻的两个节点像素点的能量系数的差值绝对值,所述第一扩散路径为所述每个扩散路径中的任一扩散路径;respectively calculating the absolute value of the difference between the energy coefficients of any two adjacent node pixels on a first diffusion path, where the first diffusion path is any diffusion path in each of the diffusion paths;
    将最大的差值绝对值对应的两个节点像素点中距离所述起点坐标最远的节点像素点确定为边界像素点。The node pixel point farthest from the starting point coordinates among the two node pixel points corresponding to the largest absolute value of the difference is determined as the boundary pixel point.
  10. 根据权利要求1-7任一项所述的方法,其特征在于,所述方法还包括以下至少之一:The method according to any one of claims 1 to 7, characterized in that the method further comprises at least one of the following:
    在边界扩散过程中,在当前显示的所述超声图像中叠加显示每次边界扩散形成的波形;During the boundary diffusion process, a waveform formed by each boundary diffusion is superimposed and displayed on the currently displayed ultrasound image;
    在边界扩散过程中,基于边界扩散形成的波形,生成波形扩散动画;在当前显示的所述超声图像上叠加播放所述波形扩散动画;In the process of boundary diffusion, a waveform diffusion animation is generated based on the waveform formed by the boundary diffusion; and the waveform diffusion animation is superimposed and played on the currently displayed ultrasound image;
    识别出所述目标对象的边界轮廓之后,在当前显示的所述超声图像中标注出所述边界轮廓。After the boundary contour of the target object is identified, the boundary contour is marked in the currently displayed ultrasound image.
  11. 根据权利要求1-7任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 1 to 7, characterized in that the method further comprises:
    若在预设时长内未检测出所述目标对象的边界轮廓,则显示提示信息,所述提示信息用于提示重新选择所述目标对象所在区域内的任意一点作为起点坐标。If the boundary contour of the target object is not detected within the preset time period, a prompt message is displayed, and the prompt message is used to prompt to reselect any point in the area where the target object is located as the starting point coordinate.
  12. 一种超声图像处理装置,其特征在于,包括:An ultrasonic image processing device, characterized by comprising:
    检测模块,用于检测到用于指示选择超声图像中目标对象的选择指令;A detection module, configured to detect a selection instruction for instructing to select a target object in an ultrasound image;
    起点确定模块,用于将所述选择指令所指示的坐标作为起点坐标;A starting point determination module, used to use the coordinates indicated by the selection instruction as starting point coordinates;
    边界识别模块,用于以所述起点坐标为中心向四周进行边界扩散识别,以从所述超声图像中识别出所述目标对象的边界轮廓。The boundary recognition module is used to perform boundary diffusion recognition around the starting point coordinates as the center, so as to recognize the boundary contour of the target object from the ultrasonic image.
  13. 根据权利要求12所述的装置,其特征在于,所述边界识别模块,具体用于: The device according to claim 12, characterized in that the boundary identification module is specifically used to:
    基于所述起点坐标,确定每次边界扩散形成的波形上像素点的能量系数,所述能量系数与基于边界扩散经过的像素点的梯度相关联;Based on the starting point coordinates, determining an energy coefficient of a pixel point on a waveform formed by each boundary diffusion, wherein the energy coefficient is associated with a gradient of the pixel point through which the boundary diffusion passes;
    基于每个所述波形上像素点的能量系数,从所述超声图像中识别出所述目标对象的边界轮廓。Based on the energy coefficient of each pixel point on the waveform, a boundary contour of the target object is identified from the ultrasound image.
  14. 根据权利要求13所述的装置,其特征在于,所述边界识别模块,具体用于:The device according to claim 13, characterized in that the boundary identification module is specifically used to:
    从当前波形上的像素点分别向多个扩散方向进行边界扩散,获得新的波形;所述当前波形是以所述起点坐标为中心进行至少一次边界扩散得到的波形;Perform boundary diffusion in multiple diffusion directions from pixel points on the current waveform to obtain a new waveform; the current waveform is a waveform obtained by performing boundary diffusion at least once with the starting point coordinate as the center;
    基于所述当前波形的第一像素点与所述新的波形的第二像素点之间的像素梯度,分别计算所述第二像素点的能量系数,其中,所述第二像素点在所述第一像素点的第一扩散方向上,所述第一像素点为所述当前波形上的任一像素点,所述第一扩散方向为所述第一像素点对应的多个扩散方向中的任一扩散方向。Based on the pixel gradient between the first pixel point of the current waveform and the second pixel point of the new waveform, the energy coefficient of the second pixel point is calculated respectively, wherein the second pixel point is in the first diffusion direction of the first pixel point, the first pixel point is any pixel point on the current waveform, and the first diffusion direction is any diffusion direction of multiple diffusion directions corresponding to the first pixel point.
  15. 根据权利要求14所述的装置,其特征在于,所述边界识别模块,具体用于:The device according to claim 14, characterized in that the boundary identification module is specifically used to:
    获取所述第一像素点在所述第一扩散方向上的扩散速度;Acquire a diffusion speed of the first pixel point in the first diffusion direction;
    以所述扩散速度从所述第一像素点向所述第一扩散方向进行边界扩散,得到所述第二像素点,多个所述第二像素点形成所述新的波形。Boundary diffusion is performed from the first pixel point to the first diffusion direction at the diffusion speed to obtain the second pixel point, and a plurality of the second pixel points form the new waveform.
  16. 根据权利要求15所述的装置,其特征在于,所述边界识别模块,具体用于:The device according to claim 15, characterized in that the boundary identification module is specifically used to:
    获取所述第一像素点的能量系数、第三像素点的能量系数及所述第三像素点在所述第一扩散方向上的扩散速度;所述第三像素点为与所述当前波形相邻的上一个波形中的像素点,所述第一像素点是以所述第三像素点对应的扩散速度从所述第三像素点向所述第一扩散方向进行边界扩散得到的;Obtaining an energy coefficient of the first pixel point, an energy coefficient of a third pixel point, and a diffusion speed of the third pixel point in the first diffusion direction; the third pixel point is a pixel point in a previous waveform adjacent to the current waveform, and the first pixel point is obtained by boundary diffusion from the third pixel point to the first diffusion direction at a diffusion speed corresponding to the third pixel point;
    基于所述第一像素点的能量系数、第三像素点的能量系数及所述第三像素点在所述第一扩散方向上的扩散速度,计算所述第一像素点在所述第一扩散方向上的扩散速度。The diffusion speed of the first pixel in the first diffusion direction is calculated based on the energy coefficient of the first pixel, the energy coefficient of the third pixel, and the diffusion speed of the third pixel in the first diffusion direction.
  17. 根据权利要求16所述的装置,其特征在于,所述边界识别模块,具体用于:The device according to claim 16, characterized in that the boundary identification module is specifically used to:
    计算所述第三像素点的能量系数与所述第一像素点的能量系数的差值,得到从所述第三像素点扩散至所述第一像素点产生的能量衰减量;Calculating a difference between an energy coefficient of the third pixel and an energy coefficient of the first pixel to obtain an energy attenuation caused by diffusion from the third pixel to the first pixel;
    基于所述能量衰减量,确定扩散速度的损失量;Determining a loss in diffusion speed based on the energy attenuation;
    计算所述第三像素点在所述第一扩散方向上的扩散速度与所述损失量的差值,得到所述第一像素点在所述第一扩散方向上的扩散速度。The difference between the diffusion speed of the third pixel point in the first diffusion direction and the loss amount is calculated to obtain the diffusion speed of the first pixel point in the first diffusion direction.
  18. 根据权利要求14所述的装置,其特征在于,所述边界识别模块,具体用于:The device according to claim 14, characterized in that the boundary identification module is specifically used to:
    基于所述当前波形上的第一像素点的特征值和所述新的波形上第二像素点的特征值,计算所述第二像素点对应的像素梯度;Calculating a pixel gradient corresponding to a first pixel point on the current waveform and a second pixel point on the new waveform based on a characteristic value of the first pixel point on the current waveform and a characteristic value of the second pixel point on the new waveform;
    基于所述第二像素点对应的像素梯度,确定所述第二像素点的能量系数。An energy coefficient of the second pixel is determined based on a pixel gradient corresponding to the second pixel.
  19. 根据权利要求13-18任一项所述的装置,其特征在于,所述边界识别模块,具体用于:The device according to any one of claims 13 to 18, wherein the boundary recognition module is specifically used to:
    在边界扩散过程中,分别确定从所述起点坐标扩散至每个目标像素点的扩散路径,其中,所述目标像素点为能量系数小于预设阈值的像素点,所述扩散路径包括多个节点像素点,所述节点像素点为由所述起点坐标扩散至所述目标像素点过程中得到的至少一个像素点;In the process of boundary diffusion, a diffusion path from the starting point coordinate to each target pixel point is determined respectively, wherein the target pixel point is a pixel point whose energy coefficient is less than a preset threshold, and the diffusion path includes a plurality of node pixel points, and the node pixel point is at least one pixel point obtained in the process of diffusion from the starting point coordinate to the target pixel point;
    基于每个扩散路径上节点像素点的能量系数,分别确定位于每个扩散路径上的边界像 素点;Based on the energy coefficient of the node pixel points on each diffusion path, the boundary image on each diffusion path is determined respectively. Plain Points;
    将确定出的每个边界像素点连成所述目标对象的边界轮廓。Each determined boundary pixel point is connected to form a boundary contour of the target object.
  20. 根据权利要求19所述的装置,其特征在于,所述边界识别模块,具体用于:The device according to claim 19, characterized in that the boundary identification module is specifically used to:
    分别计算第一扩散路径上任意相邻的两个节点像素点的能量系数的差值绝对值,所述第一扩散路径为所述每个扩散路径中的任一扩散路径;respectively calculating the absolute value of the difference between the energy coefficients of any two adjacent node pixels on a first diffusion path, where the first diffusion path is any diffusion path in each of the diffusion paths;
    将最大的差值绝对值对应的两个节点像素点中距离所述起点坐标最远的节点像素点确定为边界像素点。The node pixel point farthest from the starting point coordinates among the two node pixel points corresponding to the largest absolute value of the difference is determined as the boundary pixel point.
  21. 根据权利要求12-18任一项所述的装置,其特征在于,所述装置还包括以下至少之一:显示模块和标注模块;The device according to any one of claims 12 to 18, characterized in that the device further comprises at least one of the following: a display module and a marking module;
    显示模块,用于在边界扩散过程中,在当前显示的所述超声图像中叠加显示每次边界扩散形成的波形;或A display module is used for superimposing and displaying a waveform formed by each boundary diffusion in the currently displayed ultrasound image during the boundary diffusion process; or
    显示模块,用于在边界扩散过程中,基于边界扩散形成的波形,生成波形扩散动画;在当前显示的所述超声图像上叠加播放所述波形扩散动画;A display module is used to generate a waveform diffusion animation based on the waveform formed by the boundary diffusion during the boundary diffusion process; and to overlay and play the waveform diffusion animation on the currently displayed ultrasound image;
    标注模块,用于识别出所述目标对象的边界轮廓之后,在当前显示的所述超声图像中标注出所述边界轮廓。The marking module is used to mark the boundary contour in the currently displayed ultrasound image after identifying the boundary contour of the target object.
  22. 根据权利要求12-18任一项所述的装置,其特征在于,所述装置还包括:提示模块,用于若在预设时长内未检测出所述目标对象的边界轮廓,则显示提示信息,所述提示信息用于提示重新选择所述目标对象所在区域内的任意一点作为起点坐标。The device according to any one of claims 12-18 is characterized in that the device also includes: a prompt module, which is used to display a prompt message if the boundary contour of the target object is not detected within a preset time period, and the prompt message is used to prompt to reselect any point in the area where the target object is located as the starting point coordinate.
  23. 一种电子设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时,实现权利要求1-11任一项所述的方法。An electronic device comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method described in any one of claims 1 to 11 is implemented.
  24. 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时,实现权利要求1-11任一项所述的方法。A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.
  25. 一种计算机程序产品,包括计算机程序,其特征在于,所述计算机程序被处理器执行以实现权利要求1-11任一项所述的方法。 A computer program product, comprising a computer program, characterized in that the computer program is executed by a processor to implement the method according to any one of claims 1 to 11.
PCT/CN2023/138192 2022-12-29 2023-12-12 Ultrasonic image processing method and apparatus, device, and storage medium WO2024140175A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211710098.0 2022-12-29

Publications (1)

Publication Number Publication Date
WO2024140175A1 true WO2024140175A1 (en) 2024-07-04

Family

ID=

Similar Documents

Publication Publication Date Title
US8677282B2 (en) Multi-finger touch adaptations for medical imaging systems
US10424067B2 (en) Image processing apparatus, image processing method and storage medium
JP4909378B2 (en) Image processing apparatus, control method therefor, and computer program
US20210295510A1 (en) Heat map based medical image diagnostic mechanism
US20140200452A1 (en) User interaction based image segmentation apparatus and method
US20080119734A1 (en) Method, system, and computer product for automatically extracting and tracking cardiac calcifications and determining a tracking centerline
JP5949558B2 (en) Ultrasonic diagnostic apparatus and control method of ultrasonic diagnostic apparatus
WO2019223123A1 (en) Lesion part identification method and apparatus, computer apparatus and readable storage medium
JP2008100073A (en) Ultrasonic diagnostic apparatus and method for measuring size of target object
JP2015531918A (en) Hit test method and apparatus
JP2012008027A (en) Pathological diagnosis support device, pathological diagnosis support method, control program for supporting pathological diagnosis, and recording medium recorded with control program
CN111414124A (en) Image measuring method, device, equipment and storage medium
Grgurevic et al. Assessment of clinically significant portal hypertension by two‐dimensional shear wave elastography
JP2024513722A (en) Coronary artery plaque status evaluation methods, devices, and electronic devices
WO2024140175A1 (en) Ultrasonic image processing method and apparatus, device, and storage medium
CN116407154A (en) Ultrasonic diagnosis data processing method and device, ultrasonic equipment and storage medium
WO2021120589A1 (en) Method and apparatus for abnormal image filtering for use on 3d images, device, and storage medium
CN112634309A (en) Image processing method, image processing device, electronic equipment and storage medium
CN112890866A (en) Ultrasound imaging method, system and computer readable storage medium
CN113689355B (en) Image processing method, image processing device, storage medium and computer equipment
WO2021056645A1 (en) Elastography method and system as well as computer readable storage medium
CN116030003A (en) Ultrasonic image processing method, device, equipment and storage medium
JP2004113644A (en) Diagnostic support device, diagnostic support method, program and recording medium
CN114503166A (en) Method and system for measuring three-dimensional volume data, medical instrument, and storage medium
TWI825643B (en) Medical auxiliary information generation method and medical auxiliary information generation system