Disclosure of Invention
In order to solve the technical problems in the background art, the invention provides a carotid artery ultrasound image plaque classification detection method and system, which can reduce the marking workload of a carotid artery ultrasound image and ensure the accuracy of plaque detection classification.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention provides a carotid artery ultrasonic image plaque classification detection method, which comprises the following steps:
acquiring carotid cross section video information and carotid longitudinal section video information;
respectively extracting key continuous frames from the carotid artery cross section video information and the carotid artery longitudinal section video information, and performing feature enhancement on the extracted key continuous frames;
firstly, identity prediction is carried out on the carotid transverse plane image and the carotid longitudinal plane image after feature enhancement, then, the image corresponding to each identity is tracked and pixel-level segmentation is carried out, so that the correlation of identity information and a segmentation result in a time domain is realized;
traversing each column of the mask pixels according to the segmentation result, determining coordinates through a color difference mark, and determining the size and area of a plaque and the stenosis rate corresponding to the identity information associated with the segmentation result;
and determining the plaque type according to the size and area of the plaque and the stenosis rate so as to output early warning prompts in different degrees.
A second aspect of the present invention provides a carotid artery ultrasound image plaque classification detection system, which includes:
the video information acquisition module is used for acquiring carotid cross section video information and carotid longitudinal section video information;
the characteristic enhancement module is used for respectively extracting key continuous frames from the carotid cross section video information and the carotid longitudinal section video information and carrying out characteristic enhancement on the extracted key continuous frames;
the pixel level segmentation module is used for firstly carrying out identity prediction on the carotid artery cross-section image and the carotid artery longitudinal-section image after the characteristic enhancement, then tracking the image corresponding to each identity and carrying out pixel level segmentation so as to realize the correlation of identity information and a segmentation result in a time domain;
the patch information determining module is used for traversing each column of the mask pixels according to the segmentation result, determining coordinates through the color difference marks, and determining the size, the area and the stenosis rate of a patch corresponding to the identity information associated with the segmentation result;
and the plaque type determining module is used for determining the plaque type according to the plaque size, the plaque area and the stenosis rate so as to output early warning prompts in different degrees.
A third aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps in the carotid artery ultrasound image plaque classification detection method as described above.
A fourth aspect of the present invention provides a computer device, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to implement the steps of the carotid artery ultrasound image plaque classification detection method as described above.
Compared with the prior art, the invention has the beneficial effects that:
the invention respectively extracts key continuous frames from the carotid artery cross section video information and the carotid artery longitudinal section video information, feature enhancement is carried out on the extracted key continuous frames, identity prediction is carried out on the carotid artery cross-section image and the carotid artery longitudinal-section image after feature enhancement, then the image corresponding to each identity is tracked and pixel-level segmentation is carried out, so as to realize the correlation of identity information and segmentation results in a time domain, according to the segmentation result, traversing each column of the mask pixels, determining coordinates through the color difference marks, determining the size, the area and the stenosis rate of the plaque corresponding to the identity information associated with the segmentation result, finally determining the plaque type according to the size, the area and the stenosis rate of the plaque, outputting early warning prompts in different degrees, and not marking a plaque label, so that a large amount of workload is saved, and the accuracy of plaque type detection can be guaranteed.
Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Detailed Description
The invention is further described with reference to the following figures and examples.
It is to be understood that the following detailed description is exemplary and is intended to provide further explanation of the invention as claimed. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
Example one
As shown in fig. 1, the present embodiment provides a method for classifying and detecting carotid artery ultrasound image plaque, which specifically includes the following steps:
s101: and acquiring the transverse section video information and the longitudinal section video information of the carotid artery.
In a specific implementation, the carotid artery cross section video information and the carotid artery longitudinal section video information are acquired by an ultrasonic device.
It should be noted that the ultrasound acquisition module includes, but is not limited to, an ultrasound acquisition instrument, a palm ultrasound device, a 5G remote ultrasound acquisition device, and the like.
S102: and respectively extracting key continuous frames from the carotid artery cross-section video information and the carotid artery longitudinal-section video information, and performing feature enhancement on the extracted key continuous frames.
In the specific implementation process, the key continuous frame extraction process is as follows:
and correspondingly dividing the carotid cross-section video information and the carotid longitudinal-section video information into a plurality of sections according to the frame number, judging the number of key frames in each section, and selecting the relevant sections as corresponding continuous key frames.
Specifically, the process of performing feature enhancement on each extracted key continuous frame comprises the following steps:
extracting the characteristics of each key continuous frame;
and denoising the extracted features to realize feature enhancement.
For example: and (4) performing characteristic enhancement such as image transformation denoising, and the like, wherein blind pixel level denoising can be used, a real image denoising method is used for reference, and similar pixels are searched in a global area to enhance the denoising performance.
The algorithm for extracting the features of each key continuous frame comprises but is not limited to an SIFI algorithm, a variance gradient histogram, a Gaussian function difference, MDS, automatic coding of a sparse mode in deep learning and the like;
the algorithm for realizing the feature enhancement includes, but is not limited to, RETINEX image enhancement algorithm, SSD algorithm and the like, and avoids the interference caused by the noise of the ultrasonic machine to the maximum extent.
S103: and performing identity prediction on the carotid cross-section image and the carotid longitudinal-section image after the characteristic enhancement, tracking the image corresponding to each identity, and performing pixel-level segmentation to realize the correlation of identity information and a segmentation result in a time domain.
The method comprises the steps of carrying out pixel level segmentation on images of a cross section and a longitudinal section, adopting an end-to-end instance segmentation method, adding a dynamic tracking task head to predict identity information of an instance in a continuous video frame to realize association in a time domain, and carrying out tracking after detection.
S104: and traversing each column of the mask pixels according to the segmentation result, determining coordinates through the color difference marks, and determining the size and the area of the plaque and the stenosis rate corresponding to the identity information associated with the segmentation result.
In an implementation, based on the determined coordinates, the vertical distances from the left side to the right side and from the upper side to the lower side of the longitudinal section are determined, and the size and the area of the plaque are calculated.
And measuring the normal diameter of the carotid artery and the diameter of the stenosis based on the determined coordinates and the cross section, and calculating the stenosis rate by using a stenosis rate calculation formula.
S105: and determining the plaque type according to the size and area of the plaque and the stenosis rate so as to output early warning prompts in different degrees.
And determining the plaque type based on a pre-trained deep learning network according to the plaque size, the plaque area and the stenosis rate.
The deep learning network includes but is not limited to algorithms such as SVM, AlexNet, ResNet, Faster R-CNN, CNN + LSTM, etc. The plaque types include hard plaque, soft plaque, and mixed plaque.
In the embodiment, the carotid plaque is detected and classified in a weak supervision mode, and is displayed in real time to assist diagnosis, so that the diagnosis efficiency is improved.
As shown in fig. 2, plaque properties are predicted by calculating parameters such as vulnerability index according to the classification result. After plaque detection and classification, real-time display can be carried out, and predicted plaque properties can be displayed.
Example two
As shown in fig. 3, the present embodiment provides a carotid artery ultrasound image plaque classification detection system, which specifically includes the following modules:
a video information obtaining module 201, configured to obtain carotid artery cross-plane video information and carotid artery longitudinal-plane video information;
the feature enhancement module 202 is configured to perform key continuous frame extraction on the carotid artery cross-plane video information and the carotid artery longitudinal-plane video information respectively, and perform feature enhancement on all the extracted key continuous frames;
the pixel level segmentation module 203 is configured to perform identity prediction on the carotid artery cross-plane image and the carotid artery longitudinal-plane image after feature enhancement, and then track the image corresponding to each identity and perform pixel level segmentation to implement association of identity information and a segmentation result in a time domain;
the patch information determining module 204 is configured to traverse each column of the mask pixels according to the segmentation result, determine coordinates through the color difference markers, and determine the size, the area, and the stenosis rate of a patch corresponding to the identity information associated with the segmentation result;
and the plaque type determining module 205 is used for determining the plaque type according to the plaque size, the plaque area and the stenosis rate so as to output early warning prompts in different degrees.
It should be noted that, each module in the present embodiment corresponds to each step in the first embodiment one to one, and the specific implementation process is the same, which will not be described again here.
EXAMPLE III
The present embodiment provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps in the carotid artery ultrasound image plaque classification detection method as described above.
Among others, a computer-readable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like.
Example four
The present embodiment provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the above when executing the program. The carotid artery ultrasonic image plaque classification detection method.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.