WO2022095254A1 - 一种肌肉超声图像检测方法、系统、终端以及存储介质 - Google Patents

一种肌肉超声图像检测方法、系统、终端以及存储介质 Download PDF

Info

Publication number
WO2022095254A1
WO2022095254A1 PCT/CN2020/139413 CN2020139413W WO2022095254A1 WO 2022095254 A1 WO2022095254 A1 WO 2022095254A1 CN 2020139413 W CN2020139413 W CN 2020139413W WO 2022095254 A1 WO2022095254 A1 WO 2022095254A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
muscle
image sequence
swe
mode
Prior art date
Application number
PCT/CN2020/139413
Other languages
English (en)
French (fr)
Inventor
肖杨
张湘楠
张世全
王丛知
马腾
郑海荣
Original Assignee
深圳先进技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳先进技术研究院 filed Critical 深圳先进技术研究院
Publication of WO2022095254A1 publication Critical patent/WO2022095254A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08—Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0858—Detecting organic movements or changes, e.g. tumours, cysts, swellings involving measuring tissue layers, e.g. skin, interfaces
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4411—Device being modular
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/48—Diagnostic techniques
    • A61B8/485—Diagnostic techniques involving measuring strain or elastic properties
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5223—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for extracting a diagnostic or physiological parameter from medical diagnostic data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20112—Image segmentation details
    • G06T2207/20132—Image cropping

Definitions

  • the present application belongs to the technical field of muscle ultrasound image detection, and in particular relates to a muscle ultrasound image detection method, system, terminal and storage medium.
  • Medical ultrasonography is a medical imaging diagnostic technique based on ultrasound (ultrasound) that enables visualization of muscles and internal organs (including their size, structure, and pathological lesions), which is of great clinical significance.
  • ultrasound ultrasound
  • various studies have shown that medical imaging diagnostic technology plays an important role in the assessment of muscle atrophy and other diseases, but its limitation is that it cannot assess the biomechanical properties of muscles.
  • the traditional ultrasonic elastography technology can also evaluate the mechanical properties of muscle tissue, its defects are: the one-dimensional elastography technology can only measure the average elastic modulus value of the tissue, cannot quantitatively measure the tissue elasticity, lacks objectivity and accuracy. Repeatability; quasi-static elastography technology can only give a relative two-dimensional pseudo-color displacement/strain map, and cannot give the specific value of local tissue hardness.
  • Ultrasonic shear wave elastography is an emerging technology for evaluating biomechanical properties in recent years.
  • the basic principle is that the acoustic pulse emitted by the ultrasonic probe is focused at different depths of the tissue to generate transverse shear waves.
  • This technology breaks through the limitations of traditional ultrasound elastography technology and realizes a true quantitative measurement of tissue elasticity.
  • the present application provides a method, system, terminal, and storage medium for muscle ultrasonic image detection, aiming to solve one of the above-mentioned technical problems in the prior art at least to a certain extent.
  • a muscle ultrasound image detection method comprising:
  • the original elastic image is input into the trained 3D-ResNet network, and the muscle detection result of the part to be tested is output through the 3D-ResNet network.
  • the dynamic acquisition of the muscle ultrasound image of the part to be measured of the subject includes:
  • B-mode mode of the ultrasonic imaging system uses the B-mode mode of the ultrasonic imaging system to continuously acquire the B-mode image sequence of the tested part in the passive stretching process, and at the same time, use the shear wave elastography mode of the ultrasonic imaging system to acquire the measured part in the passive stretching process. SWE image sequence during stretching.
  • the technical solution adopted in the embodiment of the present application further includes: the obtaining of the original elastic image of the to-be-measured part of the subject includes:
  • the B-mode image sequence and the SWE image sequence are respectively subjected to framing operations, and a preset number of B-mode image frames and SWE image frames are extracted from the middle-spaced pictures after the framing;
  • the pixel values of the ROI area of the SWE image frame and the ROI area of the B-mode image frame are subtracted one-to-one to obtain the original elasticity image of the measured part of the subject.
  • the technical solution adopted in the embodiment of the present application further includes: the obtaining of the original elastic image of the to-be-measured part of the subject further includes:
  • the original elastic image is size normalized.
  • the technical solution adopted in the embodiment of the present application further includes: the inputting the original elastic image into the trained 3D-ResNet network further includes:
  • a preset number of original elastic images of subjects are acquired, a sample set for model training is made according to the original elastic images of the subjects, and the 3D-ResNet network is trained through the sample set.
  • the training of the 3D-ResNet network includes:
  • the 3D-ResNet network includes a convolution layer, a maximum pooling layer, a residual block and a connection layer.
  • the convolution layer uses a 7*7*7 convolution core to perform a convolution operation on the input image, and extract the input image.
  • the feature map of The fully connected layer combines features and outputs prediction results.
  • training the 3D-ResNet network further includes:
  • a muscle ultrasonic image detection system comprising:
  • Image acquisition module used to dynamically collect the muscle ultrasound image of the subject to be tested, wherein the muscle ultrasound image includes the B-mode image sequence and the SWE image sequence of the subject to be tested during passive stretching;
  • Image preprocessing module used to obtain the ROI regions in the B-mode image sequence and the SWE image sequence respectively, and subtract the pixel values of the ROI regions of the SWE image sequence and the B-mode image sequence one-to-one to obtain the original elastic image of the subject to be tested;
  • Image detection module used to input the original elastic image into the trained 3D-ResNet network, and output the muscle detection result of the subject to be measured through the 3D-ResNet network.
  • a terminal includes a processor and a memory coupled to the processor, wherein,
  • the memory stores program instructions for implementing the muscle ultrasonic image detection method
  • the processor is configured to execute the program instructions stored in the memory to control muscle ultrasound image detection.
  • a storage medium storing program instructions executable by a processor, where the program instructions are used to execute the muscle ultrasonic image detection method.
  • the beneficial effects of the embodiments of the present application are: the muscle ultrasonic image detection method, system, terminal and storage medium of the embodiments of the present application use ultrasonic shear wave elastography technology to dynamically collect the muscle elasticity of a subject Image, and use 3D-ResNet to identify and classify dynamic muscle elasticity images, while retaining the time dimension information, it can automatically analyze the image features that change with time and the feature information of the image itself, so that the image detection results are more objective and accurate.
  • the embodiments of the present application expand the new application field of shear wave ultrasound elastography technology, and provide a new perspective for the assessment of amyotrophic diseases.
  • FIG. 1 is a flowchart of a method for detecting a muscle ultrasound image according to a first embodiment of the present application
  • FIG. 2 is a flowchart of a method for detecting a muscle ultrasound image according to a second embodiment of the present application
  • FIG. 3 is a schematic diagram of a B-mode image sequence and an elastic image sequence collected in an embodiment of the present application;
  • FIG. 4 is a schematic diagram of an acquisition method of an original elastic image according to an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a picture after a frame division operation is performed on a B-mode image sequence and an elastic image sequence according to an embodiment of the present application;
  • FIG. 6 is a schematic diagram of a ROI region intercepted by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of an original elastic image obtained in an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a comparison between two-dimensional and three-dimensional convolution kernels according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a 3D-ResNet network structure according to an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of a muscle ultrasound image detection system according to an embodiment of the application.
  • FIG. 11 is a schematic structural diagram of a terminal according to an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of a storage medium according to an embodiment of the present application.
  • FIG. 1 is a flowchart of a method for detecting a muscle ultrasound image according to an embodiment of the present application.
  • the muscle ultrasonic image detection method of the embodiment of the present application includes the following steps:
  • S1 Dynamically collect a muscle ultrasound image of the subject to be tested, wherein the muscle ultrasound image includes a B-mode (real-time black and white) image sequence and a SWE (ShearWave Elastography) image sequence of the subject to be tested during passive stretching. , shear wave elastography mode) image sequence;
  • B-mode real-time black and white
  • SWE ShearWave Elastography
  • the acquisition method of the muscle ultrasound image is as follows: the subject is in a supine position, the subject's part to be tested is fixed by the isokinetic muscle training system, and the subject is completely relaxed without any main force or resistance.
  • the isokinetic muscle strength training system drives the measured part to passively move at a constant speed, so that the measured part of the subject is passively stretched; during the passive stretching process, the B-mode mode of the ultrasound imaging system is used to continuously collect the The B-mode image sequence of the measured part is used to obtain the structural and morphological changes of the muscle tissue in the measured part during the passive stretching process.
  • the SWE image sequence of the measured part is collected by the shear wave elastography mode of the ultrasonic imaging system. , to obtain different elastic image sequences of the muscle tissue in this part during passive stretching.
  • the acquisition method of the original elastic image is as follows: first, use opencv to divide the B-mode image sequence and the SWE image sequence into frames respectively, and extract a preset number of B-modes from the divided images at medium intervals. image frame and SWE image frame; then, crop the ROI area from each B-mode image frame and SWE image frame respectively; finally, by using the pixel value of the ROI area of the SWE image frame and the ROI area of the B-mode image frame By one-to-one subtraction, the original elastic image of the tested part of the subject can be obtained, and the size of the original elastic image is normalized.
  • S3 Input the original elastic image into the trained 3D-ResNet network, and output the muscle detection results of the subject to be tested through the 3D-ResNet network.
  • FIG. 2 is a schematic diagram of a 3D-ResNet network training process according to an embodiment of the present application.
  • the 3D-ResNet network training process in the embodiment of the present application includes the following steps:
  • the isokinetic muscle strength training system is used to drive the ankle joints of multiple subjects to perform passive stretching at a uniform speed, and the ultrasound imaging system is used to simultaneously obtain the B-mode image sequence and the SWE image sequence of the ankle joint during the passive stretching process;
  • the number of subjects is 203 in total, including 123 normal subjects and 80 muscular atrophy patients.
  • the acquisition method of the B-mode image sequence and SWE image sequence of the ankle joint is as follows: the subject takes a supine position, and the subject's right foot (or left foot) is fixed on the pedal of the isokinetic muscle strength training system.
  • the isokinetic muscle training system drives the ankle joint to passively move from 40° of plantar flexion to 40° of dorsiflexion at a uniform speed, and pulls the gastrocnemius muscle of the subject for passive stretching;
  • the B-mode image sequence of the gastrocnemius muscle structure was continuously acquired using the B-mode mode of the ultrasound imaging system to obtain the structural and morphological changes of the muscle tissue during the passive stretching process.
  • the shear wave of the ultrasound imaging system was used.
  • the elastography mode synchronously acquires the SWE image sequence of the gastrocnemius muscle to obtain different elastic image sequences of the muscle tissue during passive stretching.
  • the collected B-mode image sequence and SWE image sequence are shown in Figure 3.
  • the left side is the B-mode image sequence
  • the right side is the SWE image sequence.
  • the SWE image sequence is superimposed on the B-mode image sequence. Color map.
  • the imaging areas of the B-mode image sequence and the SWE image sequence are respectively 13mm*7mm, and the sequence duration is 28s to 32s, which can be specifically set according to the actual scene.
  • the embodiment of the present application adopts the ultrasonic shear wave elastography technology to obtain the elasticity image sequence of the skeletal muscle, which is more convenient and fast, has real-time performance, and can quantitatively evaluate the hardness of the muscle compared with electromyography, CT or MRI. It can be understood that when the elastic image sequence of the subject is dynamically collected, the joint movement mode of the subject and its variation range can be adjusted according to the actual situation. When detecting other skeletal muscles such as head and neck muscles, trunk muscles, etc., other methods can be used to dynamically collect the subject's elastic image sequence.
  • S20 Obtain the ROI (region of interest, region of interest) region in the B-mode image sequence and the SWE image sequence of each subject respectively, and combine the SWE image sequence and B-mode image sequence of each subject The pixel values of the ROI area are subtracted one-to-one to obtain the original elastic image of each subject with background pixels removed, and the original elastic images of multiple subjects are used as the sample set of the training model;
  • the acquisition method of the original elastic image is shown in FIG. 4 .
  • the specific acquisition method is as follows: First, use opencv to divide the B-mode image sequence and SWE image sequence of each subject into frames, and the framed pictures are shown in Figure 5; The video lengths of the -mode image sequence and the SWE image sequence are different, so the total number of pictures after framing is also different. In order to accurately reflect the changes in muscle elasticity and simplify the calculation amount, the divided pictures of each subject are divided into medium intervals. Extract a preset number of B-mode image frames and SWE image frames (this application is preferably set to 35 frames, which can be adjusted according to the application scenario), and then cut out from each B-mode image frame and SWE image frame respectively.
  • the cropped ROI area is shown in Figure 6, where the box in the left picture is the ROI area of the B-mode image frame, and the box in the right picture is the ROI area of the SWE image frame
  • the ROI area of the SWE image frame is the superposition of the color image and the background grayscale, and the background gray pixels need to be subtracted. Therefore, in this embodiment of the present application, the pixel values of the ROI area of the SWE image frame and the ROI area of the B-mode image frame are equal to one another. Subtract one pair and subtract the gray content on the left to get 35 original elastic images for each subject with background pixels removed; finally, normalize all original elastic image sizes to 64*64.
  • the obtained original elastic image is shown in Figure 7.
  • the original elastic images of 203 subjects were obtained by the above method, and the original elastic images of 203 subjects were used as the sample set of the training model, and each sample data respectively included 35 original elastic images of each subject.
  • ResNet the basic idea of ResNet is to propose a residual learning structure to change the function H(x) to be learned into F(x)+x to simplify the solution of the fitting function.
  • a problem is decomposed into a multi-scale residual problem through a reproduction to solve the difficult problem of deep network training optimization.
  • a 3D convolution kernel is used instead of the ResNet network.
  • the two-dimensional convolution kernel is used to construct a 3D-ResNet network, which can directly extract the convolutional features of the input elastic image, and also extract the time dimension information, so as to better restore the video data.
  • the comparison of 2D and 3D convolution kernels is shown in Figure 8.
  • FIG. 9 is a schematic diagram of a 3D-ResNet network structure according to an embodiment of the present application.
  • the original elastic image sample set of 203 subjects is divided into training set and test set according to the ratio of 7:3 (the specific ratio can be set according to the actual operation), and the data is labeled, and then input into the 3D-ResNet network
  • the 3D-ResNet network includes a convolution layer, a maximum pooling layer, multiple residual blocks and a connection layer.
  • the convolution layer uses a 7*7*7 convolution kernel to perform a convolution operation on the input image and extract the input image.
  • the feature map of the image, the maximum pooling layer uses a 3*3*3 convolution kernel to downsample the feature map, and then input it to the residual block for learning. After each residual block, the feature map reaches the fully connected layer for feature combination. , and output the prediction result. It can be understood that the number of layers or the convolution kernel size of the 3D-ResNet network can be changed according to the application scenario.
  • a 3D-ResNet network is constructed by introducing residual connections on the basis of a convolutional neural network, using a 3D convolution kernel instead of a two-dimensional convolution kernel, and using the 3D-ResNet network to automatically analyze changes over time It can solve the problem of performance degradation during deep convolutional neural network training, and make the detection results more objective and accurate. And the residual connection can deepen the convergence of the deep network and maintain the accuracy improvement by greatly increasing the network depth.
  • the accuracy rate (Accuracy) index cannot comprehensively evaluate the performance of the model, and there may be cases of missed detection and wrong identification. Therefore, the evaluation index also needs to consider the accuracy rate and Recall rate and other indicators.
  • the model prediction result is compared with the diagnosis result given by the doctor, and the test result is divided into a true class (TruePositive, TP), a false positive class (False Positive, FP), a true negative class ( True Negative, TN) and False Negative (False Negative, FN), the accuracy, precision, recall, negative coverage (Specificity) and f1-score ( Score) and other indicators to evaluate the prediction results of the model, in which the precision rate represents the proportion of the correct predictions as positive to all the positive predictions; the recall rate refers to the proportion of the correct predictions as positive to all the positive samples.
  • the calculation formula of each indicator is as follows:
  • the evaluation results show that the accuracy rate of the 3D-ResNet network in the embodiment of the present application can reach 86.89%, and the detection results are more objective and accurate.
  • the muscle ultrasonic image detection method of the embodiment of the present application uses the ultrasonic shear wave elastography technology to dynamically collect the muscle elasticity image sequence of the subject, obtains the change sequence diagram of muscle tissue hardness, and uses 3D-ResNet to analyze the elasticity image.
  • the sequence is identified and classified, while retaining the time dimension information, it can automatically analyze the image features that change with time and the feature information of the image itself, without the need to manually extract and filter features, and can evaluate the hardness of the muscles in real time and quantitatively, making the detection results more accurate. Objectively accurate.
  • the embodiments of the present application expand the new application field of the shear wave ultrasonic elastography technology, and provide a new perspective for muscle ultrasonic image detection.
  • Image acquisition module 41 used to acquire a muscle ultrasound image of the subject to be measured, wherein the muscle ultrasound image includes a B-mode image sequence and a SWE image sequence of the subject to be measured during passive stretching;
  • the image preprocessing module 42 is used to obtain the ROI regions in the B-mode image sequence and the SWE image sequence respectively, and subtract the pixel values of the ROI regions in the SWE image sequence and the B-mode image sequence one-to-one to obtain the elimination of the background raw elastic image of pixels;
  • Image detection module 43 used to input the original elastic image into the trained 3D-ResNet network, and output the muscle detection result of the part to be measured of the subject through the 3D-ResNet network.
  • FIG. 11 is a schematic structural diagram of a terminal according to an embodiment of the present application.
  • the terminal 50 includes a processor 51 and a memory 52 coupled to the processor 51 .
  • the memory 52 stores program instructions for implementing the above-described method for detecting an ultrasonic image of a muscle.
  • the processor 51 is configured to execute program instructions stored in the memory 52 to control the muscle ultrasound image detection.
  • the processor 51 may also be referred to as a CPU (Central Processing Unit, central processing unit).
  • the processor 51 may be an integrated circuit chip with signal processing capability.
  • the processor 51 may also be a general purpose processor, digital signal processor (DSP), application specific integrated circuit (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component .
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA off-the-shelf programmable gate array
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • FIG. 12 is a schematic structural diagram of a storage medium according to an embodiment of the present application.
  • the storage medium of this embodiment of the present application stores a program file 61 capable of implementing all the above methods, wherein the program file 61 may be stored in the above-mentioned storage medium in the form of a software product, and includes several instructions to make a computer device (which may It is a personal computer, a server, or a network device, etc.) or a processor (processor) that executes all or part of the steps of the methods of the various embodiments of the present application.
  • a computer device which may It is a personal computer, a server, or a network device, etc.
  • processor processor
  • the aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes , or terminal devices such as computers, servers, mobile phones, and tablets.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Biology (AREA)
  • Computing Systems (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Physiology (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

本申请实施例涉及一种肌肉超声图像检测方法、系统、终端以及存储介质。包括：动态采集被检测者待测部位的肌肉超声图像；分别获取B-mode图像序列和SWE图像序列中的ROI区域，将SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到原始弹性图像；将原始弹性图像输入训练好的3D-ResNet网络，通过3D-ResNet网络输出被检测者待测部位的肌肉检测结果。本申请使用3D神经网络对弹性图像序列进行识别分类，保留了时间维度信息的同时，可以自动分析随时间变化的图像特征以及图像本身的特征信息，使检测结果更加客观准确。

Description

一种肌肉超声图像检测方法、系统、终端以及存储介质 技术领域
本申请属于肌肉超声图像检测技术领域，特别涉及一种肌肉超声图像检测方法、系统、终端以及存储介质。
背景技术
医学超声检测是一种基于超声波(超声)的医学影像学诊断技术，使肌肉和内脏器官(包括其大小、结构和病理学病灶)可视化，在临床上具有重要意义。以肌肉超声检测为例，多种研究表明，医学影像学诊断技术在肌萎缩等疾病的评估中起着重要作用，但它的局限性在于不能评估肌肉体内的生物力学特性。传统的超声弹性成像技术虽然也可以评估肌肉组织力学特性，但它的缺陷在于：一维弹性成像技术只能测量出组织的平均弹性模量值，无法对组织弹性进行定量测量，缺乏客观性和可重复性；准静态弹性成像技术只能给出一个相对的二维伪彩位移/应变图，无法给出组织局部硬度的具体数值。
超声剪切波弹性成像技术是近年来评估生物力学特性的新兴技术，其基本原理是：超声探头发射的声脉冲在组织不同深度聚焦产生横向剪切波，通过定量分析系统可以计算反应组织内剪切波传播速度的物理量—杨氏模量值。杨氏模量值与剪切波传播速度间的关系为：E＝3ρc 2(E:杨氏模量；c:剪切波传播速度；ρ：组织密度)。组织越硬，密度越大，剪切波传播速度越大，杨氏模量值就越大。该项技术突破了传统超声弹性成像技术的局限性，实现了对组织弹性真正的定量测量。但由于肌肉组织的结构与乳腺、甲状腺等组织不同，其硬度会随着肌力变化而改变，根据剪切波弹性成像骨骼肌的研究表明，在松弛位的状态下，健康的肌肉和萎缩的肌肉硬度变化不明显。而当肌肉从松弛状态被动拉伸到张力状态时，两组之间的硬度差异会显著增加，无法检测出肌肉的健康状态。
发明内容
本申请提供了一种肌肉超声图像检测方法、系统、终端以及存储介质，旨在至少在一定程度上解决现有技术中的上述技术问题之一。
为了解决上述问题，本申请提供了如下技术方案：
一种肌肉超声图像检测方法，包括：
动态采集被检测者待测部位的肌肉超声图像，其中，所述肌肉超声图像包括被检测者待测部位在被动拉伸过程中的B-mode图像序列和SWE图像序列；
分别获取所述B-mode图像序列和SWE图像序列中的ROI区域，将所述SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到所述被检测者待测部位的原始弹性图像；
将所述原始弹性图像输入训练好的3D-ResNet网络，通过所述3D-ResNet网络输出被检测者待测部位的肌肉检测结果。
本申请实施例采取的技术方案还包括：所述动态采集被检测者待测部位的肌肉超声图像包括：
使所述被检测者待测部位做被动拉伸；
使用超声成像系统的B-mode模式连续采集所述被测部位在被动拉伸过程中的B-mode图像序列，同时，利用超声成像系统的剪切波弹性成像模式采集所述被测部位在被动拉伸过程中的SWE图像序列。
本申请实施例采取的技术方案还包括：所述得到所述被检测者待测部位的原始弹性图像包括：
将所述B-mode图像序列和SWE图像序列分别进行分帧操作，从所述分帧后的图片中等间距各抽取预设数量的B-mode图像帧和SWE图像帧；
分别从每张B-mode图像帧和SWE图像帧中剪裁出ROI区域；
将所述SWE图像帧的ROI区域与所述B-mode图像帧的ROI区域的像素值一对一相减，得到所述被检测者被测部位的原始弹性图像。
本申请实施例采取的技术方案还包括：所述得到所述被检测者待测部位的原始弹性图像还包括：
将所述原始弹性图像进行尺寸归一化。
本申请实施例采取的技术方案还包括：所述将所述原始弹性图像输入训练好的3D-ResNet网络还包括：
获取预设数量的受试者的原始弹性图像，根据所述受试者的原始弹性图像制作模型训练的样本集，通过所述样本集对所述3D-ResNet网络进行训练。
本申请实施例采取的技术方案还包括：所述对所述3D-ResNet网络进行训练包括：
所述3D-ResNet网络包括卷积层、最大池化层、残差块和连接层，所述卷积层采用7*7*7的卷积核对输入图像进行卷积操作，提取所述输入图像的特征图；所述最大池化层采用3*3*3的卷积核对所述特征图进行下采样操作后，输入至残差块进行学习；所述特征图经过残差块之后到达所述全连接层进行特征结合，并输出预测结果。
本申请实施例采取的技术方案还包括：对所述3D-ResNet网络进行训练还包括：
将所述预测结果与实际检测结果进行对比，将预测结果分为真正类TP、假正类FP、真负类TN和假负类FN，并计算准确率Accuracy、精准率Precision、召回率Recall、负例的覆盖率Specificity和f1-score分数指标，对所述模型预测结果进行评估；其中，精准率代表正确预测为正占全部预测为正的比例，召回率指正确预测为正占全部正样本的比例，各指标计算公式为：
Figure PCTCN2020139413-appb-000001
Figure PCTCN2020139413-appb-000002
Figure PCTCN2020139413-appb-000003
Figure PCTCN2020139413-appb-000004
Figure PCTCN2020139413-appb-000005
本申请实施例采取的另一技术方案为：一种肌肉超声图像检测系统，包括：
图像获取模块：用于动态采集被检测者待测部位的肌肉超声图像，其中，所述肌肉超声图像包括被检测者待测部位在被动拉伸过程中的B-mode图像序列和SWE图像序列；
图像预处理模块：用于分别获取所述B-mode图像序列和SWE图像序列中的ROI区域，将所述SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到所述被检测者待测部位的原始弹性图像；
图像检测模块：用于将所述原始弹性图像输入训练好的3D-ResNet网络，通过所述3D-ResNet网络输出被检测者待测部位的肌肉检测结果。
本申请实施例采取的又一技术方案为：一种终端，所述终端包括处理器、与所述处理器耦接的存储器，其中，
所述存储器存储有用于实现所述肌肉超声图像检测方法的程序指令；
所述处理器用于执行所述存储器存储的所述程序指令以控制肌肉超声图像检测。
本申请实施例采取的又一技术方案为：一种存储介质，存储有处理器可运行的程序指令，所述程序指令用于执行所述肌肉超声图像检测方法。
相对于现有技术，本申请实施例产生的有益效果在于：本申请实施例的肌肉超声图像检测方法、系统、终端及存储介质使用超声剪切波弹性成像技术动态地采集受试者的肌肉弹性图像，并使用3D-ResNet对动态肌肉弹性图像进行识别分类，保留了时间维度信息的同时，可以自动分析随时间变化的图像特征以及图像本身的特征信息，使图像检测结果更加客观准确。本申请实施例扩展了剪切波超声弹性成像技术新的应用领域，为肌萎缩疾病的评估提供了新的视角。
附图说明
图1是本申请第一实施例的肌肉超声图像检测方法的流程图；
图2是本申请第二实施例的肌肉超声图像检测方法的流程图；
图3是本申请实施例采集的B-mode图像序列和弹性图像序列示意图；
图4是本申请实施例原始弹性图像获取方式示意图；
图5是本申请实施例对B-mode图像序列和弹性图像序列进行分帧操作后的图片示意图；
图6是本申请实施例截取的ROI区域示意图；
图7是本申请实施例获取到的原始弹性图像示意图；
图8是本申请实施例二维与三维卷积核的对比示意图；
图9为本申请实施例的3D-ResNet网络结构示意图；
图10为本申请实施例的肌肉超声图像检测系统结构示意图；
图11为本申请实施例的终端结构示意图；
图12为本申请实施例的存储介质的结构示意图。
具体实施方式
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本申请，并不用于限定本申请。
请参阅图1，是本申请实施例的肌肉超声图像检测方法的流程图。本申请实施例的肌肉超声图像检测方法包括以下步骤：
S1：动态采集被检测者待测部位的肌肉超声图像，其中，所述肌肉超声图像包括被检测者待测部位在被动拉伸过程中的B-mode(实时黑白)图像序列和SWE(ShearWave Elastography,剪切波弹性成像模式)图像序列；
本步骤中，肌肉超声图像的采集方式具体为：被检测者采取仰卧位，通过等速肌力训练系统对被检测者的被测部位进行固定，在被检测者完全放松且无任何主力或阻力的状态下，等速肌力训练系统带动被测部位匀速被动运动，使被检测者的被测部位做被动拉伸；在被动拉伸过程中，使用超声成像系统的B-mode模式连续采集被测部位的B-mode图像序列，获得该被测部位的肌肉组织在被动拉伸过程中的结构形态变化，同时，利用超声成像系统的剪切波弹性成像模式采集该被测部位的SWE图像序列，获得该部位的肌肉组织在被动拉伸过程中的不同弹性图像序列。
S2：分别获取B-mode图像序列和SWE图像序列中的ROI(region of interest，感兴趣区域)区域，并将SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到消除背景像素的原始弹性图像；
本步骤中，原始弹性图像的获取方式具体为：首先，使用opencv将B-mode图像序列和SWE图像序列分别进行分帧操作，从分帧后的图片中等间距各抽取预设数量的B-mode图像帧和SWE图像帧；然后，分别从每张B-mode图像帧和SWE图像帧中剪裁出ROI区域；最后，通过用SWE图像帧的ROI区域与B-mode图像帧的ROI区域的像素值一对一相减，即可得到被检测者被测部位的原始弹性图像，并对原始弹性图像进行尺寸归一化。
S3：将原始弹性图像输入训练好的3D-ResNet网络，通过3D-ResNet网络输出被检测者待测部位的肌肉检测结果。
进一步地，请参阅图2，是本申请实施例的3D-ResNet网络训练过程示意图。以腓肠肌的肌肉超声图像作为训练样本为例，本申请实施例的3D-ResNet网络训练过程包括以下步骤：
S10：采用等速肌力训练系统带动多个受试者的踝关节进行匀速被动拉伸，并采用超声成像系统同步获取踝关节在被动拉伸过程中的B-mode图像序列和SWE图像序列；
本步骤中，受试者数量一共为203例，其中，正常受试者为123例，肌萎缩患者为80例。踝关节的B-mode图像序列和SWE图像序列获取方式具体为：受试者采取仰卧位，将 受试者的右脚(或左脚)固定在等速肌力训练系统的踏板上，在受试者完全放松小腿肌肉无任何主力或阻力的状态下，等速肌力训练系统带动踝关节从跖屈40°到背屈40°匀速被动运动，牵引受试者的腓肠肌做被动拉伸；在被动拉伸过程中，使用超声成像系统的B-mode模式连续采集腓肠肌结构的B-mode图像序列，获得肌肉组织在被动拉伸过程中的结构形态变化，同时，利用超声成像系统的剪切波弹性成像模式同步采集该腓肠肌的SWE图像序列，获得肌肉组织在被动拉伸过程中的不同弹性图像序列。采集的B-mode图像序列和SWE图像序列如图3所示，其中，左侧为B-mode图像序列，右侧为SWE图像序列，SWE图像序列即为在B-mode图像序列基础上叠加了彩色图。本申请实施例中，B-mode图像序列和SWE图像序列的成像区域分别为13mm*7mm，序列时长为28s～32s，具体可根据实际场景进行设置。
基于上述，本申请实施例采用超声剪切波弹性成像技术获取骨骼肌的弹性图像序列，相较于肌电图、CT或MRI，更加方便快速，具有实时性，且能定量评估肌肉的硬度。可以理解，动态采集受试者的弹性图像序列时，受试者的关节运动方式及其变化范围可以根据实际情况进行调整。对头颈肌、躯干肌等其他骨骼肌进行检测时，可以采用其他方式动态采集受试者的弹性图像序列。
S20：分别获取每个受试者的B-mode图像序列和SWE图像序列中的ROI(region of interest，感兴趣区域)区域，并将每个受试者的SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到每个受试者的消除背景像素的原始弹性图像，将多个受试者的原始弹性图像作为训练模型的样本集；
本步骤中，原始弹性图像的获取方式如图4所示。具体获取方式为：首先，使用opencv将每个受试者的B-mode图像序列和SWE图像序列分别进行分帧操作，分帧后的图片如图5所示；由于每个受试者的B-mode图像序列和SWE图像序列的视频长度不同，因此分帧后的图片总数也不相同，为了能准确反映肌肉弹性变化并简化计算量，从每个受试者分帧后的图片中等间距各抽取预设数量(本申请优选设定为35帧，具体可根据应用场景进行调节)的B-mode图像帧和SWE图像帧，然后，分别从每张B-mode图像帧和SWE图像帧中剪裁出ROI区域(剪裁的ROI区域如图6所示，其中，左侧图片中的方框为B-mode图像帧的ROI区域，右侧图片中的方框为SWE图像帧的ROI区域)，由于SWE图像帧的ROI区域为彩色图与背景灰度的叠加，需要减去背景灰色像素，因此，本申请实施例通过用SWE图像帧的ROI区域与B-mode图像帧的ROI区域的像素值一对一相减，减去左侧的灰 色内容，即可得到每个受试者的35张消除背景像素的原始弹性图像；最后，将所有原始弹性图像尺寸归一化为64*64。获取到的原始弹性图像如图7所示。
通过上述方式获取203例受试者的原始弹性图像，将203例受试者的原始弹性图像作为训练模型的样本集，每个样本数据中分别包括每个受试者的35张原始弹性图像。
S30：按照预设比例将获取到的原始弹性图像划分为训练集和测试集，并打好标签后，将训练集输入3D-ResNet网络进行训练；
本步骤中，ResNet的基本思想是提出一个残差学习结构，将需要学习的函数H(x)变为F(x)+x，以简化拟合函数的求解。根据图像中的残差向量编码，通过一个重制，将一个问题分解成多尺度的残差问题，以解决深度网络训练优化难的问题。
由于视频数据是由一帧一帧的图像组成，如果使用二维神经网络对视频数据进行训练，会丢失掉时间维度的信息，因此，本申请实施例在ResNet网络基础上使用3D卷积核代替二维卷积核，构建3D-ResNet网络，能够在对输入的弹性图像直接进行卷积特征提取的同时，也对时间维度信息进行提取，从而更好地还原视频数据。二维与三维卷积核的对比如图8所示。
请参阅图9，为本申请实施例的3D-ResNet网络结构示意图。首先，将203例受试者的原始弹性图像样本集按照7：3的比例(具体比例可根据实际操作进行设定)划分为训练集和测试集并将数据打上标签后，输入3D-ResNet网络中进行训练；3D-ResNet网络包括卷积层、最大池化层、多个残差块和连接层，卷积层采用7*7*7的卷积核对输入图像进行卷积操作，提取到输入图像的特征图，最大池化层采用3*3*3的卷积核对特征图进行下采样操作后，输入至残差块进行学习，特征图经过各个残差块之后到达全连接层进行特征结合，并输出预测结果。可以理解，3D-ResNet网络的层数或卷积核大小可根据应用场景进行更改。
基于上述，本申请实施例通过在卷积神经网络的基础上引入残差连接，并采用3D卷积核代替二维卷积核，构建3D-ResNet网络，采用3D-ResNet网络自动分析随时间变化的图像特征以及图像本身的特征信息，无需人为提取和筛选特征，能够在深层次的卷积神经网络训练时解决其性能退化的问题，使检测结果更加客观准确。且残差连接可以加深深度网络的收敛，并通过大幅度提高网络深度来保持准确率的提高。
S40：对3D-ResNet网络进行参数优化及模型评估；
本申请实施例中，在二分类的问题上，准确率(Accuracy)指标并不能做到综合评估模型的性能，还可能存在着漏检和错误识别的情况，因此评估指标还需要考虑精准率和召回率等指标。本申请实施例在模型评估时，将模型预测结果与医生给出的诊断结果进行对比，将测试结果分为真正类(TruePositive，TP)、假正类(False Positive,FP)、真负类(True Negative,TN)和假负类(False Negative,FN)，由这四类情况计算准确率、精准率(Precision)、召回率(Recall)、负例的覆盖率(Specificity)和f1-score(分数)等指标对模型的预测结果进行评估，其中精准率代表正确预测为正占全部预测为正的比例；召回率指正确预测为正占全部正样本的比例，各指标计算公式如下：
Figure PCTCN2020139413-appb-000006
Figure PCTCN2020139413-appb-000007
Figure PCTCN2020139413-appb-000008
Figure PCTCN2020139413-appb-000009
Figure PCTCN2020139413-appb-000010
通过测试集对训练好的模型性能进行评估，评估结果如下表1所示：
表1模型评估结果
指标 Accuracy Precision Recall Specificity F1-Score
值 86.89％ 96.97％ 82.05％ 95.45％ 88.89％
评估结果表明，本申请实施例的3D-ResNet网络准确率可达到86.89％，检测结果更加客观准确。
基于上述，本申请实施例的肌肉超声图像检测方法使用超声剪切波弹性成像技术动态地采集受试者的肌肉弹性图像序列，获取肌肉组织硬度的变化序列图，并使用3D-ResNet对弹性图像序列进行识别分类，保留了时间维度信息的同时，可以自动分析随时间变化的图像特征以及图像本身的特征信息，无需人为提取和筛选特征，能够实时且能定量评估肌肉的硬度，使检测结果更加客观准确。本申请实施例扩展了剪切波超声弹性成像技术新的应用领域，为肌肉超声图像检测提供了新的视角。
请参阅图10，是本申请实施例的肌肉超声图像检测系统的结构图。本申请实施例的肌肉超声图像检测系统40包括：
图像获取模块41：用于获取被检测者待测部位的肌肉超声图像，其中，所述肌肉超声图像包括被检测者待测部位在被动拉伸过程中的B-mode图像序列和SWE图像序列；
图像预处理模块42：用于分别获取B-mode图像序列和SWE图像序列中的ROI区域，并将SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到消除背景像素的原始弹性图像；
图像检测模块43：用于将原始弹性图像输入训练好的3D-ResNet网络，通过3D-ResNet网络输出被检测者待测部位的肌肉检测结果。
请参阅图11，为本申请实施例的终端结构示意图。该终端50包括处理器51、与处理器51耦接的存储器52。
存储器52存储有用于实现上述肌肉超声图像检测方法的程序指令。
处理器51用于执行存储器52存储的程序指令以控制肌肉超声图像检测。
其中，处理器51还可以称为CPU(Central Processing Unit，中央处理单元)。处理器51可能是一种集成电路芯片，具有信号的处理能力。处理器51还可以是通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
请参阅图12，为本申请实施例的存储介质的结构示意图。本申请实施例的存储介质存储有能够实现上述所有方法的程序文件61，其中，该程序文件61可以以软件产品的形式存储在上述存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器(processor)执行本申请各个实施方式方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质，或者是计算机、服务器、手机、平板等终端设备。
对所公开的实施例的上述说明，使本领域专业技术人员能够实现或使用本申请。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的，本申请中所定义的一般原理可以在不脱离本申请的精神或范围的情况下，在其它实施例中实现。因此，本申 请将不会被限制于本申请所示的这些实施例，而是要符合与本申请所公开的原理和新颖特点相一致的最宽的范围。

Claims (10)

  1. 一种肌肉超声图像检测方法，其特征在于，包括：
    动态采集被检测者待测部位的肌肉超声图像，其中，所述肌肉超声图像包括被检测者待测部位在被动拉伸过程中的B-mode图像序列和SWE图像序列；
    分别获取所述B-mode图像序列和SWE图像序列中的ROI区域，将所述SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到所述被检测者待测部位的原始弹性图像；
    将所述原始弹性图像输入训练好的3D-ResNet网络，通过所述3D-ResNet网络输出被检测者待测部位的肌肉检测结果。
  2. 根据权利要求1所述的肌肉超声图像检测方法，其特征在于，所述动态采集被检测者待测部位的肌肉超声图像包括：
    使所述被检测者待测部位做被动拉伸；
    使用超声成像系统的B-mode模式连续采集所述被测部位在被动拉伸过程中的B-mode图像序列，同时，利用超声成像系统的剪切波弹性成像模式采集所述被测部位在被动拉伸过程中的SWE图像序列。
  3. 根据权利要求2所述的肌肉超声图像检测方法，其特征在于，所述得到所述被检测者待测部位的原始弹性图像包括：
    将所述B-mode图像序列和SWE图像序列分别进行分帧操作，从所述分帧后的图片中等间距各抽取预设数量的B-mode图像帧和SWE图像帧；
    分别从每张B-mode图像帧和SWE图像帧中剪裁出ROI区域；
    将所述SWE图像帧的ROI区域与所述B-mode图像帧的ROI区域的像素值一对一相减，得到所述被检测者被测部位的原始弹性图像。
  4. 根据权利要求3所述的肌肉超声图像检测方法，其特征在于，所述得到所述被检测者待测部位的原始弹性图像还包括：
    将所述原始弹性图像进行尺寸归一化。
  5. 根据权利要求1至4任一项所述的肌肉超声图像检测方法，其特征在于，所述将所述原始弹性图像输入训练好的3D-ResNet网络还包括：
    获取预设数量的受试者的原始弹性图像，根据所述受试者的原始弹性图像制作模型训练的样本集，通过所述样本集对所述3D-ResNet网络进行训练。
  6. 根据权利要求5所述的肌肉超声图像检测方法，其特征在于，所述对所述3D-ResNet网络进行训练包括：
    所述3D-ResNet网络包括卷积层、最大池化层、残差块和连接层，所述卷积层采用7*7*7的卷积核对输入图像进行卷积操作，提取所述输入图像的特征图；所述最大池化层采用3*3*3的卷积核对所述特征图进行下采样操作后，输入至残差块进行学习；所述特征图经过残差块之后到达所述全连接层进行特征结合，并输出预测结果。
  7. 根据权利要求6所述的肌肉超声图像检测方法，其特征在于，对所述3D-ResNet网络进行训练还包括：
    将所述预测结果与实际检测结果进行对比，将预测结果分为真正类TP、假正类FP、真负类TN和假负类FN，并计算准确率Accuracy、精准率Precision、召回率Recall、负例的覆盖率Specificity和f1-score分数指标，对所述模型预测结果进行评估；其中，精准率代表正确预测为正占全部预测为正的比例，召回率指正确预测为正占全部正样本的比例，各指标计算公式为：
    Figure PCTCN2020139413-appb-100001
    Figure PCTCN2020139413-appb-100002
    Figure PCTCN2020139413-appb-100003
    Figure PCTCN2020139413-appb-100004
    Figure PCTCN2020139413-appb-100005
  8. 一种肌肉超声图像检测系统，其特征在于，包括：
    图像获取模块：用于动态采集被检测者待测部位的肌肉超声图像，其中，所述肌肉超声图像包括被检测者待测部位在被动拉伸过程中的B-mode图像序列和SWE图像序列；
    图像预处理模块：用于分别获取所述B-mode图像序列和SWE图像序列中的ROI区域，将所述SWE图像序列和B-mode图像序列的ROI区域的像素值一对一相减，得到所述被检测者待测部位的原始弹性图像；
    图像检测模块：用于将所述原始弹性图像输入训练好的3D-ResNet网络，通过所述3D-ResNet网络输出被检测者待测部位的肌肉检测结果。
  9. 一种终端，其特征在于，所述终端包括处理器、与所述处理器耦接的存储器，其中，
    所述存储器存储有用于实现权利要求1-7任一项所述的肌肉超声图像检测方法的程序指令；
    所述处理器用于执行所述存储器存储的所述程序指令以控制肌肉超声图像检测。
  10. 一种存储介质，其特征在于，存储有处理器可运行的程序指令，所述程序指令用于执行权利要求1至7任一项所述肌肉超声图像检测方法。
PCT/CN2020/139413 2020-11-06 2020-12-25 一种肌肉超声图像检测方法、系统、终端以及存储介质 WO2022095254A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011230395.6 2020-11-06
CN202011230395.6A CN112288733A (zh) 2020-11-06 2020-11-06 一种肌肉超声图像检测方法、系统、终端以及存储介质

Publications (1)

Publication Number Publication Date
WO2022095254A1 true WO2022095254A1 (zh) 2022-05-12

Family

ID=74351042

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/139413 WO2022095254A1 (zh) 2020-11-06 2020-12-25 一种肌肉超声图像检测方法、系统、终端以及存储介质

Country Status (2)

Country Link
CN (1) CN112288733A (zh)
WO (1) WO2022095254A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115177291A (zh) * 2022-08-01 2022-10-14 首都医科大学附属北京朝阳医院 用于识别重症监护病房获得性肌无力的方法和装置

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114241187A (zh) * 2021-11-25 2022-03-25 深圳高性能医疗器械国家研究院有限公司 基于超声双模态影像的肌肉疾病诊断系统、设备及介质
CN115486869A (zh) * 2022-09-08 2022-12-20 深圳大学 一种用于模型小动物的肌肉超声图像分析方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108764340A (zh) * 2018-05-29 2018-11-06 上海大学 一种b型超声和超声弹性双模态图像的定量分析方法
CN109820482A (zh) * 2019-03-05 2019-05-31 浙江强脑科技有限公司 肌肉状态检测方法、装置及计算机可读存储介质
CN110693526A (zh) * 2019-11-11 2020-01-17 深圳先进技术研究院 一种肌肉疾病评估方法、系统及电子设备
CN110930367A (zh) * 2019-10-31 2020-03-27 上海交通大学 多模态超声影像分类方法以及乳腺癌诊断装置
CN111584074A (zh) * 2019-02-18 2020-08-25 清华大学 肌肉损伤的评价方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108764340A (zh) * 2018-05-29 2018-11-06 上海大学 一种b型超声和超声弹性双模态图像的定量分析方法
CN111584074A (zh) * 2019-02-18 2020-08-25 清华大学 肌肉损伤的评价方法及装置
CN109820482A (zh) * 2019-03-05 2019-05-31 浙江强脑科技有限公司 肌肉状态检测方法、装置及计算机可读存储介质
CN110930367A (zh) * 2019-10-31 2020-03-27 上海交通大学 多模态超声影像分类方法以及乳腺癌诊断装置
CN110693526A (zh) * 2019-11-11 2020-01-17 深圳先进技术研究院 一种肌肉疾病评估方法、系统及电子设备

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
CUNNINGHAM RYAN J., PETER J. HARDING, IAN D. LORAM: "The Application of Deep Convolutional Neural Networks to Ultrasound for Modeling of Dynamic States within Human Skeletal Muscle", ARXIV PREPRINT ARXIV:1706.09450, 28 June 2017 (2017-06-28), XP055928324, Retrieved from the Internet <URL:https://arxiv.org/ftp/arxiv/papers/1706/1706.09450.pdf> *
CUNNINGHAM RYAN, SáNCHEZ MARíA, MAY GREGORY, LORAM IAN: "Estimating Full Regional Skeletal Muscle Fibre Orientation from B-Mode Ultrasound Images Using Convolutional, Residual, and Deconvolutional Neural Networks", JOURNAL OF IMAGING, vol. 4, no. 2, pages 29, XP055815673, DOI: 10.3390/jimaging4020029 *
HARA KENSHO; KATAOKA HIROKATSU; SATOH YUTAKA: "Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognition", 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), IEEE, 22 October 2017 (2017-10-22), pages 3154 - 3160, XP033303800, DOI: 10.1109/ICCVW.2017.373 *
RYAN J CUNNINGHAM, IAN D LORAM: "Estimation of absolute states of human skeletal muscle via standard B-mode ultrasound imaging and deep convolutional neural networks", JOURNAL OF THE ROYAL SOCIETY INTERFACE, vol. 17, no. 162, 29 January 2020 (2020-01-29), pages 1 - 12, XP009536485, ISSN: 1742-5662, DOI: 10.1098/rsif.2019.0715 *
ZHANG QI; XIAO YANG; DAI WEI; SUO JINGFENG; WANG CONGZHI; SHI JUN; ZHENG HAIRONG: "Deep learning based classification of breast tumors with shear-wave elastography", ULTRASONICS., IPC SCIENCE AND TECHNOLOGY PRESS LTD. GUILDFORD., GB, vol. 72, 6 August 2016 (2016-08-06), GB , pages 150 - 157, XP029712972, ISSN: 0041-624X, DOI: 10.1016/j.ultras.2016.08.004 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115177291A (zh) * 2022-08-01 2022-10-14 首都医科大学附属北京朝阳医院 用于识别重症监护病房获得性肌无力的方法和装置
CN115177291B (zh) * 2022-08-01 2023-11-10 首都医科大学附属北京朝阳医院 用于识别重症监护病房获得性肌无力的方法和装置

Also Published As

Publication number Publication date
CN112288733A (zh) 2021-01-29

Similar Documents

Publication Publication Date Title
WO2022095254A1 (zh) 一种肌肉超声图像检测方法、系统、终端以及存储介质
US10028700B2 (en) Method and system for non-invasive determination of human body fat
US8840555B2 (en) System and method of ultrasound image processing
US20150005637A1 (en) Tissue displacement estimation by ultrasound speckle tracking
US20210321979A1 (en) Non-Invasive Determination of Muscle Tissue Quality and Intramuscular Fat
JP2016503706A (ja) 超音波プローブ及び超音波撮像システム
US11627934B2 (en) Non-invasive determination of pennation angle and/or fascicle length
Soleimani et al. Carotid artery wall motion estimation from consecutive ultrasonic images: Comparison between block-matching and maximum-gradient algorithms
US20220383500A1 (en) System and method for analyzing medical images based on spatio-temporal data
CN114241187A (zh) 基于超声双模态影像的肌肉疾病诊断系统、设备及介质
CN114943688A (zh) 基于触诊和超声数据对乳腺图像中感兴趣区域的提取方法
JP7215053B2 (ja) 超音波画像評価装置、超音波画像評価方法および超音波画像評価プログラム
CN107684438B (zh) 一种基于超声图像的疼痛程度检测方法及装置
CN116433560A (zh) 基于超声双模态影像的肌肉疾病识别方法、装置及设备
CN108720870A (zh) 一种基于超声衰减系数的脂肪肝检测系统
Carvalho et al. 3D tendon strain estimation on high-frequency 3D ultrasound images a simulation and phantom study
JP2022118244A5 (zh)
WO2023133929A1 (zh) 一种基于超声的人体组织对称性检测分析方法
Nesovic et al. Ultrasound image quality evaluation using a structural similarity based autoencoder
Mankar et al. Comparison of different imaging techniques used for chronic wounds
JP2019208904A (ja) 脂肪細胞を包む線維構造の線維化レベルの推定方法、推定装置及び推定プログラム、並びに、顔の肌の運動性の推定方法、推定装置及び推定プログラム
Wei et al. A study on using texture analysis methods for identifying lobar fissure regions in isotropic CT images
Banerjee Automatic Assessment of Scoliosis Using 3D Ultrasound Imaging and Convolutional Neural Network
Brown et al. Controlled motion strain measurement using lateral speckle tracking in Achilles tendons during healing
Lipor et al. Eye biometry prediction from ultrasound images using convolutional neural networks

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20960711

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20960711

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20960711

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/12/2023)