WO2022099704A1 - Ultrasonic imaging method and ultrasonic imaging system of fetus in middle and late pregnancy - Google Patents

Ultrasonic imaging method and ultrasonic imaging system of fetus in middle and late pregnancy Download PDF

Info

Publication number
WO2022099704A1
WO2022099704A1 PCT/CN2020/129099 CN2020129099W WO2022099704A1 WO 2022099704 A1 WO2022099704 A1 WO 2022099704A1 CN 2020129099 W CN2020129099 W CN 2020129099W WO 2022099704 A1 WO2022099704 A1 WO 2022099704A1
Authority
WO
WIPO (PCT)
Prior art keywords
trimesters
fetus
ultrasound data
standard
section
Prior art date
Application number
PCT/CN2020/129099
Other languages
French (fr)
Chinese (zh)
Inventor
张福
邹耀贤
林穆清
梁天柱
陈志杰
Original Assignee
深圳迈瑞生物医疗电子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳迈瑞生物医疗电子股份有限公司 filed Critical 深圳迈瑞生物医疗电子股份有限公司
Priority to CN202080105560.7A priority Critical patent/CN116322521A/en
Priority to PCT/CN2020/129099 priority patent/WO2022099704A1/en
Publication of WO2022099704A1 publication Critical patent/WO2022099704A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings

Definitions

  • the present application relates to the technical field of ultrasound imaging, and more particularly, to an ultrasound imaging method and an ultrasound imaging system for a fetus in the second and third trimesters.
  • Abdominal ultrasonography is an indispensable part of prenatal ultrasonography. When performing ultrasonography on the abdomen, it is often necessary to check the deformity through standard sections. Whether there are deformities in structures such as kidneys, bladder, and the entrance of the abdominal wall of the umbilical cord. This prenatal examination method can timely and effectively detect fetal abdominal malformations, and carry out corresponding diagnosis and treatment.
  • a first aspect of the embodiments of the present application provides an ultrasound imaging method for a fetus in the middle and late pregnancy, the method comprising:
  • the at least one abdominal standard slice is displayed.
  • a second aspect of the embodiments of the present application provides an ultrasound imaging method for a fetus in the second and third trimesters, the method comprising:
  • the at least one abdominal standard slice is displayed.
  • a third aspect of the embodiments of the present application provides an ultrasound imaging method for a fetus in the second and third trimesters, the method comprising:
  • the at least two different second and third trimester target feature structures include at least two of the following: gastric vesicles, spine bones, liver, umbilicus Veins, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder;
  • the at least one abdominal standard slice is displayed.
  • a fourth aspect of the embodiments of the present application provides an ultrasonic imaging system
  • the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, where a computer program executed by the processor is stored in the memory , the computer program executes the steps of the ultrasound imaging method for a fetus in the second and third trimesters of the first aspect of the embodiments of the present application when the computer program is run by the processor.
  • a fifth aspect of the embodiments of the present application provides an ultrasonic imaging system, where the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, where a computer program executed by the processor is stored in the memory , the computer program executes the steps of the ultrasound imaging method for a fetus in the second and third trimesters of the second aspect of the embodiments of the present application when the computer program is run by the processor.
  • a sixth aspect of the embodiments of the present application provides an ultrasonic imaging system, where the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, where a computer program executed by the processor is stored in the memory , the computer program executes the steps of the method for ultrasound imaging of a fetus in the second and third trimesters of the third aspect of the embodiments of the present application when the computer program is run by the processor.
  • the ultrasound imaging method and ultrasound imaging system of the fetus in the second and third trimesters of the present application it is possible to automatically extract the standard abdominal slices of the fetus in the second and third trimesters according to the three-dimensional ultrasound data collected in a single time, without the need for doctors to manually extract the standard slices one by one, which greatly optimizes the It can improve the workflow of prenatal examination, effectively improve work efficiency, and improve the stability of the obtained standard section quality, and promote the popularization and application of structural screening in middle and late pregnancy.
  • FIG. 1 shows a schematic block diagram of an ultrasound imaging system according to an embodiment of the present application
  • FIG. 2 shows a schematic flowchart of an ultrasound imaging method for a fetus in the second and third trimesters according to an embodiment of the present invention
  • FIG. 3 shows a schematic diagram of the relationship between the long-axis direction of the body region of the fetus in the second and third trimesters and the standard section of the abdomen according to an embodiment of the present invention
  • FIG. 4 shows a schematic diagram of a cut surface of an umbilical cord insertion opening of a fetus in the second and third trimesters according to an embodiment of the present invention
  • FIG. 5 shows a schematic flowchart of an ultrasound imaging method for a fetus in the second and third trimesters according to another embodiment of the present invention
  • FIG. 6 shows a schematic flowchart of a method for ultrasound imaging of a fetus in the second and third trimesters according to yet another embodiment of the present invention.
  • FIG. 1 shows a schematic structural block diagram of an ultrasound imaging system 100 according to an embodiment of the present application.
  • the ultrasound imaging system 100 includes an ultrasound probe 110 , a transmit/receive circuit 112 , a processor 114 , a display 116 , and a memory 118 . Further, the ultrasound imaging system 100 may further include a beam forming circuit, a transmit/receive selection switch, and the like.
  • the ultrasonic probe 110 includes a plurality of transducer array elements, and the plurality of transducer array elements can be arranged in a row to form a linear array, or arranged in a two-dimensional matrix to form an area array, and the plurality of transducer array elements can also be arranged form a convex array.
  • the transducer is used to transmit ultrasonic waves according to the excitation electrical signal, or convert the received ultrasonic waves into electrical signals, so each array element can be used to realize the mutual conversion of electrical pulse signals and ultrasonic waves, so as to realize the tissue emission to the target area of the measured object.
  • Ultrasound can also be used to receive ultrasound echoes reflected back by tissue.
  • transducers are used for transmitting ultrasonic waves and which transducers are used for receiving ultrasonic waves, or which transducers are used for transmitting ultrasonic waves or receiving ultrasonic waves in time slots through the transmitting sequence and receiving sequence.
  • the transducers participating in ultrasonic emission can be excited by electrical signals at the same time, so as to emit ultrasonic waves at the same time; or, the transducers participating in ultrasonic beam emission can also be excited by several electrical signals with a certain time interval, so as to continuously emit a certain time interval. Ultrasound.
  • the transmit/receive circuit 112 may be connected to the ultrasound probe 110 through a transmit/receive selection switch.
  • the transmit/receive selection switch may also be called a transmit/receive controller, which may include a transmit controller and a receive controller, the transmit controller is used to excite the ultrasound probe 110 to transmit ultrasound to the area where the fetus is located in the second and third trimesters via the transmit circuit; the receive control The device is used to receive ultrasonic echoes returned from the region where the fetus is located in the second and third trimesters through the ultrasonic probe 110 via the receiving circuit, so as to obtain ultrasonic echo data.
  • the transmitting/receiving circuit 112 sends the electrical signal of the ultrasonic echo into the beam forming circuit, and the beam forming circuit performs processing such as focusing delay, weighting and channel summation on the electrical signal, and then sends the processed ultrasonic echo data to the beam forming circuit. into the processor 114.
  • the processor 114 may be implemented by software, hardware, firmware or any combination thereof, and may use circuits, single or multiple application specific integrated circuits (ASICs), single or multiple general-purpose integrated circuits, single or multiple microprocessors, single or multiple programmable logic devices, or any combination of the foregoing circuits and/or devices, or other suitable circuits or devices, thereby enabling the processor 114 to perform the various corresponding steps of the method. Also, the processor 114 may control other components in the ultrasound imaging system 100 to perform desired functions.
  • ASICs application specific integrated circuits
  • microprocessors single or multiple programmable logic devices
  • the processor 114 may control other components in the ultrasound imaging system 100 to perform desired functions.
  • the processor 114 processes the received ultrasound echo data to obtain three-dimensional ultrasound data of the fetus in the second and third trimesters.
  • the ultrasound probe 110 transmits/receives ultrasound in a series of scanning planes, and is integrated by the processor 114 according to its three-dimensional spatial relationship to realize the scanning of the fetus in the three-dimensional space and the reconstruction of the three-dimensional image in the second and third trimesters.
  • the processor 114 performs some or all of the image post-processing steps such as denoising, smoothing, and enhancement, the three-dimensional ultrasound data of the fetus in the second and third trimesters is acquired.
  • the processor 114 may acquire three-dimensional ultrasound data of the whole body of the fetus in the second and third trimesters, or may acquire only the three-dimensional ultrasound data of the head or body of the fetus in the second and third trimesters.
  • the processor 114 is also used for extracting standard slices of the fetus in the second and third trimesters from the three-dimensional ultrasound data. Standard slices obtained by processor 114 may be stored in memory or displayed on display 116 . Also, the processor 114 may render and display the three-dimensional ultrasound data on the display 116 .
  • the display 116 is connected to the processor 114, and the display 116 may be a touch display screen, a liquid crystal display screen, etc.; or the display 116 may be an independent display device such as a liquid crystal display, a television set, etc. independent of the ultrasound imaging system 100; or the display 116 may be Displays of electronic devices such as smartphones, tablets, etc.
  • the number of displays 116 may be one or more.
  • the display 116 may include a main screen and a touch screen, where the main screen is mainly used for displaying ultrasound images, and the touch screen is mainly used for human-computer interaction.
  • Display 116 may display ultrasound images obtained by processor 114 .
  • the display 116 can also provide a graphical interface for the user to perform human-computer interaction while displaying the ultrasonic image, set one or more controlled objects on the graphical interface, and provide the user with a human-computer interaction device to input operating instructions to control these objects.
  • the controlled object so as to perform the corresponding control operation.
  • an icon is displayed on a graphical interface, and the icon can be operated by using a human-computer interaction device to perform a specific function.
  • the ultrasound imaging system 100 may further include other human-computer interaction devices other than the display 116, which are connected to the processor 114.
  • the processor 114 may be connected to the human-computer interaction device through an external input/output port, and the external input/output port may be connected to the human-computer interaction device.
  • the output port can be a wireless communication module, a wired communication module, or a combination of the two.
  • External input/output ports may also be implemented based on USB, bus protocols such as CAN, and/or wired network protocols, and the like.
  • the human-computer interaction device may include an input device for detecting the user's input information, for example, the input information may be a control instruction for the ultrasonic transmission/reception sequence, or a point, line or frame drawn on the ultrasonic image. Manipulate input instructions, or may also include other instruction types.
  • the input device may include one or a combination of a keyboard, a mouse, a scroll wheel, a trackball, a mobile input device (eg, a mobile device with a touch display screen, a cell phone, etc.), a multi-function knob, and the like.
  • the human-computer interaction apparatus may also include an output device such as a printer.
  • the ultrasound imaging system 100 may also include a memory 118 for storing instructions executed by the processor, storing received ultrasound echoes, storing ultrasound images, and the like.
  • the memory 118 may be a flash memory card, solid state memory, hard disk, or the like. It may be volatile memory and/or non-volatile memory, removable memory and/or non-removable memory, and the like.
  • the components included in the ultrasound imaging system 100 shown in FIG. 1 are only illustrative, and may include more or less components. This application is not limited to this.
  • FIG. 2 is a schematic flowchart of a method 200 for ultrasound imaging of a fetus in the second and third trimesters according to an embodiment of the present application.
  • the ultrasound imaging method 200 of a fetus in the second and third trimesters includes the following steps:
  • step S210 ultrasonic waves are transmitted to the fetus in the second and third trimesters, and echoes of the ultrasonic waves are received to obtain ultrasonic echo signals.
  • the fetus in the second and third trimesters includes the fetus in the second trimester and the fetus in the third trimester.
  • the fetus in the second trimester generally refers to the fetus from the 14th to the 27th week of pregnancy
  • the fetus in the third trimester generally refers to the fetus at the 28th week of pregnancy and above.
  • an ultrasound scan may be performed based on the ultrasound imaging system 100 shown in FIG. 1 .
  • the user moves the ultrasound probe 110 to select an appropriate position and angle, and the transmit circuit in the transmit/receive circuit 120 sends a set of delayed and focused pulses to the ultrasound probe 110 , and the ultrasound probe 110 transmits ultrasound to the fetus in the second and third trimesters along the 2D scanning plane.
  • the ultrasonic probe 110 receives the reflected ultrasonic echoes, it converts them into electrical signals, and the beamforming circuit performs corresponding delay and weighted summation processing on the ultrasonic echo signals obtained from multiple transmissions/receptions, so as to realize the beam forming process. It is synthesized and then sent to the processor 114 for subsequent signal processing.
  • step S220 three-dimensional ultrasound data of the fetus in the second and third trimesters is obtained based on the ultrasound echo signal.
  • the three-dimensional spatial relationship of the ultrasound echoes obtained by the ultrasound probe 110 transmitted/received in a series of scanning planes can be integrated, so as to realize the scanning of the fetus in the three-dimensional space and the reconstruction of the three-dimensional ultrasound data in the second and third trimesters.
  • image post-processing steps such as denoising, smoothing, and enhancement
  • three-dimensional ultrasound data of the fetus in the second and third trimesters are obtained.
  • the three-dimensional ultrasound data of the whole body of the fetus in the second and third trimesters may be acquired, or only the three-dimensional ultrasound data of the fetal body region in the second and third trimesters may be acquired.
  • a visualization algorithm may be used to render the three-dimensional ultrasound data, so as to obtain a three-dimensional ultrasound image and display it by using a display device.
  • the method used for rendering the three-dimensional image includes, for example, a surface rendering method or a volume rendering method, which is not limited in this embodiment of the present application.
  • the standard abdominal section is a two-dimensional section containing key information of the abdomen in the three-dimensional ultrasound image.
  • the physiological characteristic structure with clinical value can be observed through the standard abdominal section, which is an important basis for screening abdominal deformities.
  • the subsequently extracted standard abdominal slices include at least one of the following standard slices: abdominal girth slice, umbilical cord insertion slice slice, gallbladder slice, bilateral kidney transverse slice, and bladder and double umbilical artery slice.
  • the abdominal girth section is usually round or oval, and contains information about the gastric vesicle, the umbilical vein, and the transverse section of the spine.
  • the cut surface of the umbilical cord insertion port is usually round or oval, and the normal abdominal wall entrance of the umbilical cord is located in the center of the anterior abdominal wall, which is in a straight line with the spinal echo of the posterior abdominal wall, forming the anterior and posterior central axis of the cut surface of the umbilical cord insertion port.
  • the gallbladder section is usually round or oval in shape and contains information about structures such as the gallbladder.
  • the cross-section of both kidneys is usually round or oval, which contains information about the structure of the two kidneys.
  • the section of the bladder and double umbilical arteries is a transverse section of the lower abdomen, which shows the anechoic area of the bladder, and the color Doppler image shows the umbilical arteries on both sides of the bladder. Subsequent extraction of some or all of the standard abdominal slices above can be performed to perform comprehensive screening of the fetal body region in the second and third trimesters.
  • step S230 the long-axis direction of the fetal body region in the second and third trimesters is determined according to the three-dimensional ultrasound data.
  • determining the long-axis direction of the fetal body region in the second and third trimesters includes but is not limited to the following implementations:
  • the spine region of the fetus in the second and third trimesters may be determined from the three-dimensional ultrasound data acquired in step S220, and the long axis direction of the fetal body in the second and third trimesters may be determined according to the direction of the spine region. Since the spine region is more obvious in the three-dimensional ultrasound images of the fetus in the second and third trimesters, the long-axis direction of the fetal body in the second and third trimesters can be accurately determined according to the position of the spine region.
  • determining the spine region of the fetus in the second and third trimesters in the three-dimensional ultrasound data includes segmenting the spine region of the fetus in the second and third trimesters from the three-dimensional ultrasound data, and the methods include but are not limited to the following two: one is to divide the three-dimensional spine region; The segmentation is transformed into two-dimensional spine region segmentation, that is, the spine region is segmented in multiple two-dimensional slice images of the three-dimensional ultrasound data, and the segmentation results of the spine region on the multiple two-dimensional slice images are combined to obtain the spine in the three-dimensional ultrasound image.
  • the second is to directly perform 3D segmentation on the 3D ultrasound data to obtain the 3D segmentation result of the spine region.
  • the multiple 2D slices extracted from the 3D ultrasound data can be all 2D slices of the 3D ultrasound data, and then the segmentation of the spine region from all the 2D slices can be synthesized results to obtain the segmentation results of the spine in the entire 3D ultrasound data.
  • all the two-dimensional slices of the three-dimensional ultrasound data may be acquired by taking the three-dimensional ultrasound data according to horizontal slices, upper and lower slices, and the like.
  • the multiple 2D slices extracted from the 3D ultrasound data may also be part of the 2D slices in the 3D ultrasound data, that is, the 2D slices are sampled images obtained by sampling the 3D ultrasound data with preset rules, for example
  • the sampled images can be obtained equidistantly in a certain direction or rotated according to a center point to obtain the sampled images, and the spine regions in the sampled images can be segmented. 3D segmentation results of the spine region.
  • a machine learning method or a traditional image processing method can be used to segment the spinal region in a plurality of two-dimensional slice images of the three-dimensional ultrasound data.
  • the 3D ultrasound data in the database is first sliced, and multiple 2D slice images are obtained as training samples, and each 2D slice image is marked with the location of the spine area.
  • These training samples are sent to the network model constructed in advance, and the loss function of the network model is optimized for training until the network model reaches convergence.
  • the network model can learn how to recognize the spine region from a two-dimensional slice image. the location. After training the network model, you only need to input a single two-dimensional slice image into the network model to get the segmentation result of the spine region.
  • the threshold-based image segmentation algorithm is relatively simple and straightforward. Since the spine region and other regions in the ultrasound image have different gray values, based on this property of the spine region, the threshold-based image segmentation can achieve better results. .
  • one or more grayscale values may be preset as a threshold, so that the ultrasound image is divided into a spine region and a background region based on the grayscale values of the ultrasound image.
  • suitable methods can also be used to segment the spine region in the two-dimensional slice images. For example, first pre-segment the 2D slice image by threshold segmentation, Snake, level set, GraphCut, ASM, AAM and other methods to obtain a set of candidate boundary ranges; then perform feature extraction for each candidate boundary range.
  • the extraction method can be to extract traditional image features such as PCA, LDA, HOG, Harr, LBP, etc., or to extract image features based on neural networks; after that, compare the extracted image features with the images extracted from the marked spine regions in the pre-built database. The features are matched, and the discriminators such as KNN, SVM, random forest or neural network are used for classification to determine whether the current candidate boundary range contains the spine region.
  • a 3D convolutional neural network can be used to perform 3D segmentation to obtain a 3D spine region, determine the long axis direction of the spine region, and then determine the long axis direction of the body region.
  • a three-dimensional ultrasound database is pre-built, wherein each three-dimensional ultrasound data is marked with a position corresponding to the spine region, and then the three-dimensional convolutional neural network is trained based on the pre-built database.
  • the 3D ultrasound data does not need to be sliced, and the 3D ultrasound data can be directly input into the trained model to obtain the segmentation results of the spine region.
  • Available 3D Convolutional Neural Networks include, but are not limited to, 3DUnet, 3DFCN, Medical-Net, etc.
  • a traditional 3D segmentation algorithm can be used to segment the spine region in the 3D ultrasound data.
  • Optional 3D segmentation algorithms include but are not limited to 3D Otsu method, 3D threshold segmentation, 3D region growing, 3D level set, split and merge method, etc.
  • the three-dimensional spine region can be directly segmented by the three-dimensional segmentation algorithm, and then the long-axis direction of the fetus can be calculated by using the spine.
  • the long axis direction of the spine region is determined according to the range of the spine region, and the long axis direction is the long axis direction of the fetal body region in the second and third trimesters.
  • a straight line proximate the spinal region may be determined and the direction of the straight line determined as the direction of the spinal region.
  • the straight line closest to the spine region can be fitted by methods such as least squares.
  • RANSAC Hough transform and random sampling consensus algorithm
  • the body region of the second and third trimester fetuses can be determined in the three-dimensional ultrasound data, and the long axis direction of the second and third trimester fetal body can be determined according to the shape of the body region.
  • the manner in which the body region of the fetus in the second and third trimesters is determined in the three-dimensional ultrasound data is similar to the manner in which the spine region is determined as described above.
  • the body region may be firstly segmented in multiple 2D slice images of the 3D ultrasound data, and the segmentation results of the body area on the multiple 2D slice images may be integrated to obtain the 3D segmentation result of the body area in the 3D ultrasound image, wherein
  • the methods for segmenting body regions on 2D slice images include but are not limited to machine learning methods and traditional image processing methods; alternatively, 3D convolutional neural networks or traditional 3D segmentation algorithms can also be used to directly process 3D ultrasound data and directly segment The body area of the fetus in the second and third trimesters.
  • the long axis of the body region is determined according to the shape of the body region, and the long axis direction is determined as the up and down direction of the fetal body region in the second and third trimesters.
  • the principal component analysis (PCA) method or the least squares method can be used to determine the long-axis direction of the body region, or to divide the two points that are farthest away in the above-mentioned body region, and the connection between the two points is the body region. long axis.
  • manual segmentation methods can also be used to determine the long axis direction of the fetal body in the second and third trimesters. That is, a user instruction for determining the direction of the long axis is received, and the direction of the long axis of the fetal body in the second and third trimesters is determined according to the received user instruction. Users only need to specify the direction of the long axis to obtain at least one standard abdominal slice without manually extracting the standard abdominal slices one by one.
  • step S240 information about the target feature structure of the fetus in the second and third trimesters of pregnancy is extracted from the three-dimensional ultrasound data, and the feature structure of the second and third trimester fetuses includes at least one of the following: gastric vesicles, spine bones, liver, umbilical veins , descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder.
  • the above-mentioned target feature structure in the second and third trimesters is a specific target feature structure in the second and third trimesters of pregnancy, and is also a landmark structure for obtaining a specific standard abdominal section. Therefore, it is first necessary to analyze the information of the characteristic structures of these mid-late pregnancy targets, such as obtaining their positions and volumes. Among them, it is possible to detect the region where the feature structure of the mid-late pregnancy target is located in multiple two-dimensional slice images of the three-dimensional ultrasound data, and synthesize the segmentation results of the feature structure of the mid-late pregnancy target on the multiple two-dimensional slice images, so as to obtain the mid-late pregnancy target feature structure.
  • the 3D segmentation result of the feature structure of the pregnancy target in the 3D ultrasound image it can also directly perform 3D segmentation on the 3D ultrasound data, so as to obtain the 3D segmentation result of the feature structure of the middle and late pregnancy target.
  • the pre-trained target segmentation network can be used to extract the target feature structure of the second and third trimesters in the multiple 2D slice images of the 3D ultrasound data.
  • the segmentation method based on machine learning needs to construct an ultrasound image database in advance, in which each ultrasound image is marked with the information of each mid-late pregnancy target feature structure in various abdominal standard slices, specifically including: whether the mid-late pregnancy target feature structure exists, Types of target eigenstructures in the second and third trimesters and the location of the second and third trimester target eigenstructures.
  • the target segmentation method based on deep learning mainly includes the feature learning and parameter regression of the pre-built database by stacking convolutional layers and fully connected layers, so that after obtaining the input ultrasound image, the network can directly predict the The position of the late pregnancy target feature structure, and the category of the middle and late pregnancy target feature structure is output.
  • Optional networks include: RCNN, Fast RCNN, Faster-RCNN, YOLO, SSD, Retina-Net, and more.
  • a 3D convolutional neural network can be used for 3D segmentation to obtain a 3D region where the target feature structure of the middle and late pregnancy is located.
  • a three-dimensional ultrasound database is pre-built, in which each three-dimensional ultrasound data is marked with information such as the position and type corresponding to the feature structure of the target in the middle and late pregnancy, and then the three-dimensional convolutional neural network is trained based on the pre-built database.
  • the 3D ultrasound data does not need to be sliced, and the 3D ultrasound data can be directly input into the trained model to obtain the information of the target feature structure in the second and third trimesters.
  • hypoechoic structures such as transparent bladder, gastric vesicle, gallbladder, and umbilical vein to obtain the locations of these hypoechoic structures, and then use KNN, SVM, random forest or A classifier such as a neural network performs category judgment on these positions to determine the position of the target feature structure in the second and third trimesters.
  • step S250 at least one standard abdominal slice of the fetus in the second and third trimesters is extracted from the three-dimensional ultrasound data according to the long-axis direction of the fetal body in the second and third trimesters and the information on the target feature structure of the second and third trimesters.
  • the cut plane that forms a preset angle with the long axis direction of the fetal body region in the second and third trimesters and meets the preset requirements with the overlapping area with the target feature structure of the second and third trimesters can be determined as the abdominal standard cut plane.
  • the preset angle may be approximately equal to or equal to 90°, that is, the standard abdominal section is perpendicular to the long axis direction.
  • FIG. 3 shows the three-dimensional ultrasound image of the fetus in the second and third trimesters, the direction of the long axis and the direction of the standard slice of the abdomen perpendicular to the direction of the long axis.
  • the target feature structure of the second and third pregnancy Since the target feature structure of the second and third pregnancy has a certain volume, it is at a preset angle to the long axis, and there may be multiple sections passing through the area where the target feature structure of the second and third pregnancy is located.
  • the slices whose overlapping areas meet the preset requirements are used as the standard slices of the abdomen.
  • the coincidence area with the target feature structure of the second and third trimesters meets the preset requirements, which may be that the target feature structure of the second and third trimesters has the largest area on the standard abdominal section, or the standard section of the abdomen passes through the center point of the target feature structure of the second and third trimesters.
  • the standard abdominal section extracted in this way can provide more information, and is helpful to standardize the extraction standard of standard abdominal section between different regions, different hospitals and different doctors.
  • a section perpendicular to the long axis direction and at least partially coincident with the at least two mid-late pregnancy target feature structures may also be determined as a standard abdominal section, so as to improve the accuracy of the extracted standard abdominal section.
  • the abdominal girth section is a section perpendicular to the long axis and at least partially coincident with the gastric bubble area and the umbilical vein area;
  • the umbilical cord insertion port section is a section perpendicular to the long axis and at least partially coincident with the umbilical cord insertion port area, as shown in the figure 4;
  • the gallbladder section is the section perpendicular to the long axis and at least partially coincident with the gallbladder area;
  • the double kidney section is the section perpendicular to the long axis and at least partially coincident with the double kidney area;
  • the bladder section is perpendicular to the long axis and a section that at least partially coincides with the bladder area and the umbilical artery area on both sides of the bladder.
  • the method for automatically obtaining the standard abdominal slice is shown above.
  • a semi-automatic detection method can also be used, that is, the extraction range of the standard abdominal slice is first limited, and the ultrasound imaging system receives the user who determines the extraction range of the standard abdominal slice. an instruction, determining an extraction range according to the received user instruction, and extracting the abdominal standard slice within the extraction range.
  • the user can limit the extraction range to the abdominal area of the fetus in the second and third trimesters to remove some unnecessary interferences, thereby improving the quality of the standard abdominal section.
  • the automatic extraction of a standard slice of the abdomen may be performed automatically after acquiring the three-dimensional ultrasound data, or may be performed according to a received user instruction.
  • a user can activate the function of automatically extracting a standard abdominal slice by triggering a button for extracting a standard abdominal slice.
  • the standard slice of the abdomen is extracted.
  • the user may also activate the function of automatically extracting a standard abdominal slice before starting to acquire ultrasound data, and then automatically extract a standard slice of the abdomen after acquiring the three-dimensional ultrasound data.
  • the standard abdominal section is an important basis for the screening of abdominal deformities. By observing the standard abdominal section, it can be judged whether the fetal abdominal development is normal in the second and third trimesters.
  • the standard slice to be extracted may also be determined first according to the received user input. For example, options for standard abdominal slices such as abdominal circumference slices and umbilical cord insertion opening slices may be displayed on the user interface, and the standard abdominal slices to be extracted may be determined according to the user's selection.
  • step S260 the standard abdominal slice is displayed.
  • the displayed standard cut planes may be all the standard cut planes extracted in step S250, or may be part of the standard cut planes. Exemplarily, when the standard slices extracted in step S250 are displayed, some of the standard slices may be displayed according to the received user instruction. The corresponding standard slice is displayed.
  • the position of the second and third trimester target feature structures detected from the three-dimensional ultrasound data can also be displayed, so as to For users to conduct comparative analysis.
  • the long-axis direction determined in step S230 may also be displayed, so that the user can view the associated standard abdominal slice in combination with the target direction.
  • the target direction may be displayed at the same time as the three-dimensional ultrasound image is displayed.
  • the direction of the long axis of the fetal body region in the second and third trimesters can be displayed by graphical markers such as arrows.
  • the name of each determined standard slice may also be displayed, so that the user can intuitively determine the type of the standard slice, or select the standard slice to be viewed according to the name of the standard slice.
  • the names of the standard slices can be displayed synchronously with the standard slices, or, the names of each standard slice can be displayed on the display interface first, and when the user selects the name of the standard slice, the corresponding standard slice is displayed.
  • the ultrasound imaging method 200 of the fetus in the second and third trimesters of the embodiment of the present application can automatically determine at least one standard abdominal slice according to the long-axis direction of the body region of the fetus in the second and third trimesters and the information on the target feature structure of the second and third trimesters, without the need for
  • the doctor manually extracts the standard abdominal sections one by one, which greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and can improve the stability of the quality of the obtained standard abdominal sections, and promote the promotion and application of structural screening in the middle and late pregnancy.
  • Embodiments of the present application further provide an ultrasound imaging system for implementing the above-mentioned ultrasound imaging method 200 for a fetus in the second and third trimesters.
  • the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor and a display, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, an ultrasonic imaging method for a fetus in the second and third trimesters is executed 200 steps.
  • the ultrasound imaging system may be implemented as ultrasound imaging system 100 as shown in FIG. 1 .
  • the ultrasound imaging system 100 may include the ultrasound probe 110 , the transmit/receive circuit 112 , the processor 114 , and the display 116 , and the relevant descriptions of the various components can be referred to above.
  • the transmitting/receiving circuit 112 is used to excite the ultrasonic probe 110 to transmit ultrasonic waves to the fetus in the second and third trimesters, and receive the echoes of the ultrasonic waves to obtain ultrasonic echo signals; the processor 114 The method is used for: obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal; determining the long-axis direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data; extracting the target features of the fetus in the second and third trimesters from the three-dimensional ultrasound data Structural information, the target feature structure in the second and third trimester includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, um
  • the ultrasound imaging system of the embodiment of the present application can automatically determine the standard abdominal section of the fetus in the second and third trimesters, thereby improving the work efficiency and the quality of the standard abdominal section.
  • FIG. 5 is a schematic flowchart of a method 500 for ultrasound imaging of a fetus in the second and third trimesters according to an embodiment of the present application.
  • the ultrasound imaging method 500 of the fetus in the second and third trimesters includes the following steps:
  • step S510 transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving echoes of the ultrasonic waves to obtain ultrasonic echo signals;
  • step S520 obtain three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
  • step S530 the target direction of the fetal body region in the second and third trimesters is determined according to the three-dimensional ultrasound data
  • step S540 extract information about the target feature structure of the fetus in the second and third trimesters from the three-dimensional ultrasound data;
  • step S550 extract at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data according to the target direction and the information on the target feature structure of the second and third trimesters;
  • step S560 the at least one abdominal standard slice is displayed.
  • Steps S510 and S520 in the ultrasound imaging method 500 for a fetus in the second and third trimesters according to the embodiment of the present application are substantially similar to steps S210 and S220 in the ultrasound imaging method 200 described with reference to FIG. Repeating the same details, the following mainly describes in detail the manner in which the standard slice is determined according to the three-dimensional ultrasound data in the method 500 .
  • the target direction determined according to the three-dimensional ultrasound data is not limited to the long axis direction of the fetal body region in the second and third trimesters.
  • the target direction may include the up-down direction of the body region (ie, the long-axis direction above), the front-rear direction, and the left-right direction, hereinafter referred to as the first direction, the second direction, and the third direction, respectively.
  • determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data includes: determining the spine region of the fetus in the second and third trimesters from the three-dimensional ultrasound data, and determining the middle and late pregnancy according to the direction of the spine region.
  • Target orientation of fetal body regions during pregnancy Since the spine region is more obvious in the three-dimensional ultrasound image, the target direction of the fetal body region in the second and third trimesters can be accurately determined according to the position of the spine region.
  • the method for determining the spine region may include segmenting the spine region in multiple two-dimensional slice images of the three-dimensional ultrasound data, and synthesizing the segmentation results of the spine region on the multiple two-dimensional slice images, so as to obtain the three-dimensional spine in the three-dimensional ultrasound image. segmentation result; or, directly perform 3D segmentation on the 3D ultrasound data to obtain a 3D segmentation result of the spine region.
  • the specific details of the method of determining the spine region in the three-dimensional ultrasound data can be referred to above.
  • the up-down and front-back directions of the fetal body region in the second and third trimesters can be directly determined through the segmentation results of the spine region.
  • determining the up and down direction of the fetal body region in the second and third trimesters according to the direction of the spine region includes: determining a straight line close to the spine region, and determining the direction of the straight line as the first direction of the fetal body region in the second and third trimesters, that is, the up and down direction.
  • the straight line closest to the spine region can be fitted by methods such as least squares, or the straight line with the brightest brightness obtained by using methods such as Hough transform and RANSAC in traditional image processing methods can be directly used as the closest line.
  • Straight lines in the spine area can be fitted by methods such as least squares, or the straight line with the brightest brightness obtained by using methods such as Hough transform and RANSAC in traditional image processing methods can be directly used as the closest line.
  • Straight lines in the spine area can be fitted by methods such as least squares, or
  • the second direction of the fetal body region in the second and third trimesters can be further determined according to the up and down direction, that is, the front-rear direction.
  • one or more cross-sections of the body region perpendicular to the above-determined up-down direction can be extracted from the three-dimensional ultrasound data of the fetal body in the second and third trimesters, and machine learning or traditional image processing methods are used to detect the body region in the cross-section of the body region
  • the position of the center point and the spine is determined, and the direction of the line connecting the center point of the body region and the position of the spine is determined as the second direction of the fetal body region in the second and third trimesters, that is, the front-to-back direction, and the second direction is perpendicular to the first direction.
  • the front-back direction of the body region can also be directly determined according to the segmentation result of the spine region, without the need to determine the front-back direction based on the up-down direction of the body region.
  • a curve close to the spine can be determined, and the convex direction of the curve can be determined as the front-back direction of the fetal body region in the second and third trimesters.
  • a method such as least squares can be used to fit an arc closest to the spine as the above curve, or the arc with the brightest brightness obtained in the traditional image processing method can be directly obtained as the above curve.
  • the direction of the body region can also be determined according to the shape characteristics of the fetal body region in the second and third trimesters, that is, the body region of the second and third trimester fetuses can be detected from the 3D ultrasound data, and the target direction can be determined according to the shape of the body region. Since the shape characteristics of the fetal body region in the upper and lower directions in the second and third trimesters are more obvious, and the shape difference between the front and rear directions and the left and right directions is small, this method is mainly used to determine the upper and lower directions of the fetal body region in the second and third trimesters.
  • a machine learning or image processing method can be used to determine the body region of the fetus in the second and third trimesters in the three-dimensional ultrasound data, wherein the determined body region may be a region of interest frame (ROI) that is determined to surround the body of the fetus in the second and third trimesters, or Segment the specific area of the fetal body in the second and third trimesters.
  • ROI region of interest frame
  • the long axis of the body region is determined according to the shape of the body region, and the direction of the long axis is determined as the up-down direction of the fetal body region in the second and third trimesters.
  • a principal component analysis (PCA) method can be used to determine the long axis of the body region, or to detect the two most distant points in the above body region, and the line connecting the two points is the long axis of the body region.
  • PCA principal component analysis
  • the up-down direction and the anterior-posterior direction of the fetal body region in the second and third trimesters can be determined by using any of the above methods or any other feasible methods.
  • the direction perpendicular to the anterior-posterior direction is determined as the left-right direction of the fetal body in the second and third trimesters.
  • the left and right directions of the fetal body region in the second and third trimesters can also be determined according to some specific target feature structures of the fetus in the second and third trimesters.
  • symmetrical features in the fetal body region in the second and third trimesters can be detected in the three-dimensional ultrasound data.
  • the position of the structure was determined, and the direction of the line connecting the symmetrical features was determined as the left and right direction of the fetal body area in the second and third trimesters.
  • the symmetrical characteristic structure is, for example, a symmetrical characteristic structure such as two kidneys, two lungs, and left and right ribs.
  • the left and right atriums of the fetus in the second and third trimesters can also be detected.
  • the direction of the connection between the left and right atriums generally forms an angle of 45° with the left and right directions of the fetal body region in the second and third trimesters. According to this feature, the left and right directions of the fetal body region in the second and third trimesters can also be determined.
  • step S540 information about the target feature structure of the fetus in the second and third trimesters is extracted from the three-dimensional ultrasound data.
  • the target feature structure of the second and third pregnancy includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder .
  • the target feature structure of the second and third trimesters corresponds to the standard abdominal section to be extracted.
  • the type of the standard abdominal slice to be extracted is first determined, and then the target feature structure of the second and third trimesters corresponding to the type of the standard abdominal slice is determined.
  • the standard abdominal section includes at least one of the following: abdominal girth section, umbilical cord insertion port section, gallbladder section, bilateral kidney transverse section, bladder and double umbilical artery section.
  • the target feature structure of the second trimester includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta and inferior vena cava; when the standard abdominal section is the umbilical cord insertion port
  • the target feature structures of the second and third trimesters include at least one of the following: umbilical cord insertion, umbilical cord, spine, anterior abdominal wall and descending aorta
  • the second trimester target feature structures include: At least one of the following: bladder and umbilical artery; when the standard abdominal section is the gallbladder section, the target characteristic structures in the second and third trimesters include gallbladder and spine; when the standard abdominal section is the transverse section of both kidneys, the target characteristic structures in the second and third trimesters include Kidneys and spine.
  • any suitable image detection or segmentation method can be used to determine the position of the target feature structure of the second and third trimesters.
  • a traditional machine learning method or a deep learning method can be used to train a machine learning model for the target feature structure of the middle and late pregnancy corresponding to each standard abdominal slice, so as to determine the position of the target feature structure.
  • a fetal ultrasound database in the second and third trimesters is established in advance. Each 3D ultrasound data in the database marks the position of the fetal target feature structure in the second and third trimesters, such as its region of interest frame or specific region range.
  • a machine learning method or a deep learning method is used to learn an optimal mapping function, which is used to obtain the region of interest frame or specific area range of the target feature structure of the second and third trimesters from the three-dimensional ultrasound data of the fetus in the second and third trimesters, so as to realize the target feature of the second and third trimesters. Detection or segmentation of structures.
  • step S550 according to the target direction determined in step S530 and the information of the target feature structure of the second and third trimesters determined in step S540, at least one standard abdominal section of the fetus in the second and third trimesters is extracted from the three-dimensional ultrasound data. Specifically, a cut plane that forms a preset angle with the target direction and meets the preset requirements with the overlapping area with the target feature structure of the second and third trimesters can be determined as the standard abdomen cut plane.
  • the overlapping area with the target feature structure of the second and third trimesters meeting the preset requirements includes: the target feature structure of the second and third trimesters has the largest area on the standard abdominal section, or the standard section of the abdomen passes through the center point of the target feature structure of the second and third trimesters. .
  • the above preset angles are different.
  • the transverse section of the body region such as the abdominal circumference section, the umbilical cord insertion incision section, and the bilateral kidney transverse section are parallel or approximately parallel to the anterior-posterior or left-right direction of the body area, that is, the preset angle with the anterior-posterior or left-right direction is about 0 °; perpendicular or approximately perpendicular to the up-down direction of the body area, that is, the preset angle with the up-down direction is about 90°.
  • the displayed standard slices of the abdomen may be part or all of the standard slices extracted in step S550.
  • the name of the abdominal standard slices can also be displayed.
  • the target feature structures of the second and third trimesters detected from the 3D ultrasound data can also be displayed.
  • a ROI frame surrounding the target feature structure of the second and third trimesters is displayed or an outline showing the feature structure of the second and third trimester target is displayed.
  • Embodiments of the present application further provide an ultrasound imaging system for implementing the above-mentioned ultrasound imaging method 500 for a fetus in the second and third trimesters.
  • the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor and a display, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, an ultrasonic imaging method for a fetus in the second and third trimesters is executed 500 steps.
  • the ultrasound imaging system may be implemented as ultrasound imaging system 100 as shown in FIG. 1 .
  • the ultrasound imaging system 100 may include the ultrasound probe 110 , the transmit/receive circuit 112 , the processor 114 , and the display 116 , and the relevant descriptions of the various components can be referred to above.
  • the transmitting/receiving circuit 112 is used to excite the ultrasonic probe 110 to transmit ultrasonic waves to the fetus in the second and third trimesters, and receive the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
  • the processor 114 It is used for: determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data; extracting the information about the target feature structure of the second and third trimester fetuses in the three-dimensional ultrasound data; according to the target direction Extracting at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data and the information on the target feature structure of the second and third trimesters; the display 116 is configured to display the at least one standard abdominal section.
  • the ultrasound imaging method 500 and the ultrasound imaging system of the fetus in the second and third trimesters of the present application automatically determine the standard abdominal section of the fetus in the second and third trimesters according to the target direction of the fetus in the second and third trimesters and the target feature structure of the second and third trimesters, without the need for doctors to manually extract the abdomen one by one.
  • the standard section greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and can improve the stability of the quality of the obtained standard abdominal section, and promote the popularization and application of structural screening in the middle and late pregnancy.
  • FIG. 6 is a schematic flowchart of a method 600 for ultrasound imaging of a fetus in the second and third trimesters according to an embodiment of the present application.
  • an ultrasound imaging method 600 of a fetus in the second and third trimesters includes the following steps:
  • step S610 transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving echoes of the ultrasonic waves to obtain ultrasonic echo signals;
  • step S620 obtain three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
  • step S630 at least two different regions of the second and third pregnancy target feature structures are detected from the three-dimensional ultrasound data, and the at least two different second and third trimester pregnancy target feature structures include at least two of the following: gastric bubbles, spine bones , liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder;
  • step S640 at least one section that at least partially overlaps with each of the at least two different regions of the second and third trimester target feature structures is determined as the at least one section of the second and third trimester fetuses.
  • step S650 the at least one standard abdominal slice is displayed.
  • Steps S610 and S620 in the ultrasound imaging method 600 for a fetus in the second and third trimesters according to the embodiment of the present application are substantially similar to steps S210 and S220 in the ultrasound imaging method 200 described with reference to FIG. Repeating the same details, the following mainly describes in detail the manner in which the standard slice is determined according to the three-dimensional ultrasound data in the method 600 .
  • step S630 detecting at least two different regions of target feature structures of the second and third trimesters from the three-dimensional ultrasound data includes: acquiring the type of the standard abdominal slice; detecting at least two regions corresponding to the type of the standard abdominal slice from the three-dimensional ultrasound data regions with different target feature structures in the second and third trimesters.
  • the standard view of the abdomen of the fetus in the second and third trimesters includes at least one of the following: abdominal circumference view, umbilical cord insertion port view, gallbladder view, bilateral kidney transverse view, bladder and double umbilical artery view.
  • the target feature structures that need to be detected in the second and third trimesters include at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta and inferior vena cava; when the standard abdominal section is umbilical cord insertion
  • the target feature structures of the second and third trimesters that need to be detected include at least one of the following: umbilical cord insertion, umbilical cord, spinal bone, anterior abdominal wall and descending aorta; when the standard abdominal view is the bladder and double umbilical arteries, the The target feature structure in the second and third trimesters includes at least one of the bladder and the umbilical artery; when the standard abdominal section is the gallbladder section, the target feature structure in the second and third trimesters to be detected includes at least one of the gallbladder and the spine; when the standard abdominal section is the double When the kidney is cross-sectioned, the target feature structures that need to be detected
  • any suitable image detection or segmentation method can be used to determine the position of the feature structure of the target in the second and third trimesters.
  • a traditional machine learning method or a deep learning method can be used to train a machine learning model for the feature structure corresponding to each standard slice, so as to determine the position of the feature structure.
  • a fetal ultrasound database in the second and third trimesters is established in advance, and each 3D ultrasound data in the database marks the position of the fetal target feature structure in the second and third trimesters, such as its region of interest (ROI) or specific area range, Then, traditional machine learning methods or deep learning methods are used to learn an optimal mapping function, which is used to obtain the region of interest box (ROI) or specific area range of the target feature structure of the second and third trimesters from the three-dimensional ultrasound data of the fetus in the second and third trimesters.
  • ROI region of interest box
  • step S640 for the standard abdominal slice to be extracted, first obtain the type of the standard abdominal slice, determine the target feature structure of the middle and late pregnancy corresponding to the type of the standard abdominal slice, and detect the difference between the standard slice and the abdominal slice from the three-dimensional ultrasound data. Types of regions corresponding to at least two different target features in the second and third trimesters. Afterwards, a section that at least partially overlaps with the at least two different target feature structures of the second and third trimesters is determined as the detection result of the standard section of the abdomen. Specifically, a cut plane substantially coincident with each of the regions of the at least two different mid-late pregnancy target feature structure regions may be determined as a standard cut plane.
  • substantially coincident with the area of each mid-late pregnancy target feature structure in at least two different mid-late pregnancy target feature structure regions can be realized as passing through the center point of at least two mid-late pregnancy target feature structures, or at least The two target feature structures in the second and third trimesters have the largest cross-sectional area on the extracted standard slices of the abdomen, and so on.
  • slices that at least partially overlap with three or more different mid-late pregnancy target feature structures may be determined as the detection results of the standard slices of the abdomen.
  • the displayed abdominal standard slices may be part or all of the abdominal standard slices extracted in step S640.
  • it can also display the name of the standard abdominal slices.
  • it can also display the target feature structure of the second and third pregnancy detected from the 3D ultrasound data.
  • the target feature structure of the second and third pregnancy can be displayed in the middle and late pregnancy In the three-dimensional ultrasound image of the fetus during pregnancy, for example, a ROI frame surrounding the target feature structure of the second and third trimesters is displayed or an outline showing the feature structure of the second and third trimester target is displayed.
  • Embodiments of the present application further provide an ultrasound imaging system for implementing the above-mentioned ultrasound imaging method 600 for a fetus in the second and third trimesters.
  • the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor and a display, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, an ultrasonic imaging method for a fetus in the second and third trimesters is executed 600 steps.
  • the ultrasound imaging system may be implemented as ultrasound imaging system 100 as shown in FIG. 1 .
  • the ultrasound imaging system 100 may include the ultrasound probe 110 , the transmit/receive circuit 112 , the processor 114 , and the display 116 , and the relevant descriptions of the various components can be referred to above.
  • the transmitting/receiving circuit 112 is used to excite the ultrasonic probe 110 to transmit ultrasonic waves to the fetus in the second and third trimester, and receive the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
  • the processor 114 Used for: obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signals; in step S630, detecting at least two different regions of the second and third trimester target feature structures from the three-dimensional ultrasound data, at least two different regions of the second trimester and third trimester pregnancy
  • the target feature structure includes at least two of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, and gallbladder; in step S640 , determining at least one cut plane that at least partially
  • the ultrasound imaging method 600 for a fetus in the second and third trimesters and the ultrasound imaging system of the embodiments of the present application automatically determine the standard abdominal section of the fetus in the second and third trimesters according to at least two target feature structures of the fetus in the second and third trimesters, eliminating the need for a doctor to manually extract the abdomen one by one
  • the standard section greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and can improve the stability of the quality of the obtained standard abdominal section, and promote the popularization and application of structural screening in the middle and late pregnancy.
  • a computer storage medium is also provided, where program instructions are stored on the computer storage medium, and the program instructions are used to execute the methods of the embodiments of the present application when the program instructions are run by a computer or a processor 200. Corresponding steps of method 500 or method 600.
  • the storage medium may include, for example, a memory card of a smartphone, a storage component of a tablet computer, a hard disk of a personal computer, read only memory (ROM), erasable programmable read only memory (EPROM), portable compact disk read only memory (CD-ROM), USB memory, or any combination of the above storage media.
  • the computer-readable storage medium can be any combination of one or more computer-readable storage media.
  • a computer program is also provided, and the computer program can be stored in the cloud or on a local storage medium.
  • the computer program is run by a computer or a processor, it is used to execute the corresponding steps of the ultrasound imaging method for a fetus in the second and third trimesters of the embodiments of the present application.
  • the standard abdominal section of the fetus in the second and third trimesters can be automatically determined according to the three-dimensional ultrasound data collected in a single time, without the need for a doctor to manually extract the abdomen one by one.
  • the standard section greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and improves the stability of the quality of the obtained standard abdominal section, and promotes the popularization and application of structural screening in middle and late pregnancy.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented.
  • Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof.
  • a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some modules according to the embodiments of the present application.
  • DSP digital signal processor
  • the present application can also be implemented as a program of apparatus (eg, computer programs and computer program products) for performing part or all of the methods described herein.
  • Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

Abstract

An ultrasonic imaging method and an ultrasonic imaging system of a fetus in middle and late pregnancy. The method comprises: S220, obtaining three-dimensional ultrasonic data of a fetus in middle and late pregnancy; S230, determining a direction of a long axis of a body region of the fetus in the middle and late pregnancy according to the three-dimensional ultrasonic data; S540, extracting, from the three-dimensional ultrasonic data, information of middle and late pregnancy target characteristic structures of the fetus, the middle and late pregnancy target characteristic structures comprising at least one of: the stomach bubble, spine, liver, umbilical veins, descending aorta, postcava, position where an umbilical cord is inserted, umbilical cord, anterior abdominal wall, bladder, both legs, umbilical artery, and gall bladder; and according to the direction of the long axis and the information of the middle and late pregnancy target characteristic structures, S560, extracting, from the three-dimensional ultrasonic data, at least one standard abdomen section of the fetus in the middle and late pregnancy and displaying the standard abdomen section. In the ultrasonic imaging method and the ultrasonic imaging system, the standard abdomen section of the fetus in the middle and late pregnancy is automatically extracted according to the three-dimensional ultrasonic data collected at one time without manually extracting the standard abdomen sections one by one by a doctor, thus improving the efficiency of extracting the standard abdomen sections and the quality of the extracted standard abdomen sections.

Description

中晚孕期胎儿的超声成像方法和超声成像系统Ultrasound imaging method and ultrasound imaging system of the fetus in the second and third trimesters
说明书manual
技术领域technical field
本申请涉及超声成像技术领域,更具体地涉及一种中晚孕期胎儿的超声成像方法和超声成像系统。The present application relates to the technical field of ultrasound imaging, and more particularly, to an ultrasound imaging method and an ultrasound imaging system for a fetus in the second and third trimesters.
背景技术Background technique
随着人民生活水平的提高和社会进步,人们对产前超声检查的准确性充满无限期待。近年来,随着产前超声检查水平不断提高,临床对产前超声检查的需求也相应增加,同时,不同地区、不同医院、不同超声医师之间,产前超声检查方法、检查以及留取图像等无统一标准,缺乏规范化,直接影响了产前超声检查的质量和学科的发展。With the improvement of people's living standards and social progress, people have unlimited expectations for the accuracy of prenatal ultrasonography. In recent years, with the continuous improvement of the level of prenatal ultrasonography, the clinical demand for prenatal ultrasonography has also increased accordingly. There is no unified standard and lack of standardization, which directly affects the quality of prenatal ultrasonography and the development of the discipline.
腹部超声检查是产前超声检查必不可少的部分,在对腹部进行超声检查时往往需要通过标准的切面来进行畸形的排查,通过这些特定的标准切面来观察胎儿腹部内腹壁、肝、胃、双肾、膀胱、脐带腹壁入口等结构是否存在畸形。这种产前检查手段能及时有效发现胎儿腹部畸形,并进行相应的诊治。Abdominal ultrasonography is an indispensable part of prenatal ultrasonography. When performing ultrasonography on the abdomen, it is often necessary to check the deformity through standard sections. Whether there are deformities in structures such as kidneys, bladder, and the entrance of the abdominal wall of the umbilical cord. This prenatal examination method can timely and effectively detect fetal abdominal malformations, and carry out corresponding diagnosis and treatment.
在获取腹部标准切面的实际操作中,医生往往需要不断的调整探头的位置来获取这些切面。这一过程不仅仅需要医生熟练的采图操作手法,同时其操作流程相对繁琐耗时。在医院需要对大量孕妇进行检查的情况下,存在大量重复性的工作,极大地限制了产前检查的效率。同时,在基层医院中,许多医生受水平及经验所限,不容易获取到最佳的腹部标准切面;不同地区、不同医院和不同医生之间对腹部标准切面的提取也无统一的标准。In the actual operation of obtaining standard abdominal views, doctors often need to constantly adjust the position of the probe to obtain these views. This process not only requires the doctor's skilled image acquisition operation, but also the operation process is relatively cumbersome and time-consuming. When the hospital needs to examine a large number of pregnant women, there is a lot of repetitive work, which greatly limits the efficiency of prenatal examinations. At the same time, in primary hospitals, many doctors are limited by their level and experience, and it is not easy to obtain the best standard abdominal section; there is no uniform standard for the extraction of abdominal standard section between different regions, hospitals and doctors.
发明内容SUMMARY OF THE INVENTION
在发明内容部分中引入了一系列简化形式的概念,这将在具体实施方式部分中进一步详细说明。本发明的发明内容部分并不意味着要试图限定出所要求保护的技术方案的关键特征和必要技术特征,更不意味着试图确定所要求保护的技术方案的保护范围。A series of concepts in simplified form have been introduced in the Summary section, which are described in further detail in the Detailed Description section. The Summary of the Invention section of the present invention is not intended to attempt to limit the key features and essential technical features of the claimed technical solution, nor is it intended to attempt to determine the protection scope of the claimed technical solution.
本申请实施例第一方面提供一种中晚孕期胎儿的超声成像方法,所述方 法包括:A first aspect of the embodiments of the present application provides an ultrasound imaging method for a fetus in the middle and late pregnancy, the method comprising:
向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
根据所述三维超声数据确定所述中晚孕期胎儿身体区域的长轴方向;determining the long-axis direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data;
在所述三维超声数据中提取所述胎儿的中晚孕目标特征结构的信息,所述中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊;Extract information about the target feature structure of the fetus in the second and third trimesters from the three-dimensional ultrasound data, where the feature structure of the second trimester target includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior Vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder;
根据所述中晚孕期胎儿身体区域的长轴方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面;Extracting at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data according to the long-axis direction of the fetal body region in the second and third trimesters and the information on the target feature structure of the second and third trimesters;
显示所述至少一个腹部标准切面。The at least one abdominal standard slice is displayed.
本申请实施例第二方面提供一种中晚孕期胎儿的超声成像方法,所述方法包括:A second aspect of the embodiments of the present application provides an ultrasound imaging method for a fetus in the second and third trimesters, the method comprising:
向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
根据所述三维超声数据确定所述中晚孕期胎儿身体区域的目标方向;determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data;
在所述三维超声数据中提取所述中晚孕期胎儿中晚孕目标特征结构的信息;extracting information about the target feature structure of the second- and third-trimester fetuses from the three-dimensional ultrasound data;
根据所述目标方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面;extracting at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data according to the target direction and the information on the target feature structure of the second and third trimesters;
显示所述至少一个腹部标准切面。The at least one abdominal standard slice is displayed.
本申请实施例第三方面提供一种中晚孕期胎儿的超声成像方法,所述方法包括:A third aspect of the embodiments of the present application provides an ultrasound imaging method for a fetus in the second and third trimesters, the method comprising:
向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
从所述三维超声数据中检测至少两个不同的中晚孕目标特征结构的区域,所述至少两个不同的中晚孕目标特征结构包括以下至少两个:胃泡、脊柱骨、 肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊;Detecting at least two different regions of the second and third trimester target feature structures from the three-dimensional ultrasound data, the at least two different second and third trimester target feature structures include at least two of the following: gastric vesicles, spine bones, liver, umbilicus Veins, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder;
确定与所述至少两个不同的中晚孕目标特征结构区域中每个中晚孕目标特征结构的区域均至少部分重合的至少一个切面,以作为所述中晚孕胎儿的至少一个腹部标准切面;Determining at least one cut plane that at least partially overlaps with the region of each of the at least two different mid-late pregnancy target feature structure regions, as at least one abdominal standard cut plane of the second-late pregnancy fetus ;
显示所述至少一个腹部标准切面。The at least one abdominal standard slice is displayed.
本申请实施例第四方面提供一种超声成像系统,所述超声成像系统包括超声探头、发射/接收电路、存储器、处理器和显示器,所述存储器上存储有由所述处理器运行的计算机程序,所述计算机程序在被所述处理器运行时执行本申请实施例第一方面的中晚孕期胎儿的超声成像方法的步骤。A fourth aspect of the embodiments of the present application provides an ultrasonic imaging system, the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, where a computer program executed by the processor is stored in the memory , the computer program executes the steps of the ultrasound imaging method for a fetus in the second and third trimesters of the first aspect of the embodiments of the present application when the computer program is run by the processor.
本申请实施例第五方面提供一种超声成像系统,所述超声成像系统包括超声探头、发射/接收电路、存储器、处理器和显示器,所述存储器上存储有由所述处理器运行的计算机程序,所述计算机程序在被所述处理器运行时执行本申请实施例第二方面的中晚孕期胎儿的超声成像方法的步骤。A fifth aspect of the embodiments of the present application provides an ultrasonic imaging system, where the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, where a computer program executed by the processor is stored in the memory , the computer program executes the steps of the ultrasound imaging method for a fetus in the second and third trimesters of the second aspect of the embodiments of the present application when the computer program is run by the processor.
本申请实施例第六方面提供一种超声成像系统,所述超声成像系统包括超声探头、发射/接收电路、存储器、处理器和显示器,所述存储器上存储有由所述处理器运行的计算机程序,所述计算机程序在被所述处理器运行时执行本申请实施例第三方面的中晚孕期胎儿的超声成像方法的步骤。A sixth aspect of the embodiments of the present application provides an ultrasonic imaging system, where the ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, where a computer program executed by the processor is stored in the memory , the computer program executes the steps of the method for ultrasound imaging of a fetus in the second and third trimesters of the third aspect of the embodiments of the present application when the computer program is run by the processor.
根据本申请实施例的中晚孕期胎儿的超声成像方法和超声成像系统,能够根据单次采集的三维超声数据自动提取中晚孕期胎儿的腹部标准切面,无需医生逐一手动提取标准切面,极大地优化了产前检查的工作流,有效地提升工作效率,并且能提升所获取的标准切面质量的稳定性,促进中晚孕结构筛查的推广与应用。According to the ultrasound imaging method and ultrasound imaging system of the fetus in the second and third trimesters of the present application, it is possible to automatically extract the standard abdominal slices of the fetus in the second and third trimesters according to the three-dimensional ultrasound data collected in a single time, without the need for doctors to manually extract the standard slices one by one, which greatly optimizes the It can improve the workflow of prenatal examination, effectively improve work efficiency, and improve the stability of the obtained standard section quality, and promote the popularization and application of structural screening in middle and late pregnancy.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative labor.
在附图中:In the attached image:
图1示出根据本申请实施例的超声成像系统的示意性框图;FIG. 1 shows a schematic block diagram of an ultrasound imaging system according to an embodiment of the present application;
图2示出根据本发明一实施例的中晚孕期胎儿的超声成像方法的示意性流程图;FIG. 2 shows a schematic flowchart of an ultrasound imaging method for a fetus in the second and third trimesters according to an embodiment of the present invention;
图3示出根据本发明一实施例的中晚孕期胎儿的身体区域的长轴方向与腹部标准切面的关系的示意图;3 shows a schematic diagram of the relationship between the long-axis direction of the body region of the fetus in the second and third trimesters and the standard section of the abdomen according to an embodiment of the present invention;
图4示出根据本发明一实施例的中晚孕期胎儿的脐带插入口切面的示意图;4 shows a schematic diagram of a cut surface of an umbilical cord insertion opening of a fetus in the second and third trimesters according to an embodiment of the present invention;
图5示出根据本发明另一实施例的中晚孕期胎儿的超声成像方法的示意性流程图;FIG. 5 shows a schematic flowchart of an ultrasound imaging method for a fetus in the second and third trimesters according to another embodiment of the present invention;
图6示出根据本发明又一实施例的中晚孕期胎儿的超声成像方法的示意性流程图。FIG. 6 shows a schematic flowchart of a method for ultrasound imaging of a fetus in the second and third trimesters according to yet another embodiment of the present invention.
具体实施方式Detailed ways
为了使得本申请的目的、技术方案和优点更为明显,下面将参照附图详细描述根据本申请的示例实施例。显然,所描述的实施例仅仅是本申请的一部分实施例,而不是本申请的全部实施例,应理解,本申请不受这里描述的示例实施例的限制。基于本申请中描述的本申请实施例,本领域技术人员在没有付出创造性劳动的情况下所得到的所有其它实施例都应落入本申请的保护范围之内。In order to make the objectives, technical solutions and advantages of the present application more apparent, the exemplary embodiments according to the present application will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited by the example embodiments described herein. Based on the embodiments of the present application described in the present application, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present application.
在下文的描述中,给出了大量具体的细节以便提供对本申请更为彻底的理解。然而,对于本领域技术人员而言显而易见的是,本申请可以无需一个或多个这些细节而得以实施。在其他的例子中,为了避免与本申请发生混淆,对于本领域公知的一些技术特征未进行描述。In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced without one or more of these details. In other instances, some technical features known in the art have not been described in order to avoid confusion with the present application.
应当理解的是,本申请能够以不同形式实施,而不应当解释为局限于这里提出的实施例。相反地,提供这些实施例将使公开彻底和完全,并且将本申请的范围完全地传递给本领域技术人员。It should be understood that the application may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of this application to those skilled in the art.
在此使用的术语的目的仅在于描述具体实施例并且不作为本申请的限制。在此使用时,单数形式的“一”、“一个”和“所述/该”也意图包括复数形式,除非上下文清楚指出另外的方式。还应明白术语“组成”和/或“包括”,当在该说明书中使用时,确定所述特征、整数、步骤、操作、元件和/或部件的存在,但不排除一个或更多其它的特征、整数、步骤、操作、元件、部件和/或组的存在或添加。在此使用时,术语“和/或”包括相关所列项目的任何及 所有组合。The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the singular forms "a," "an," and "the/the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the terms "compose" and/or "include", when used in this specification, identify the presence of stated features, integers, steps, operations, elements and/or components, but do not exclude one or more other The presence or addition of features, integers, steps, operations, elements, parts and/or groups. As used herein, the term "and/or" includes any and all combinations of the associated listed items.
为了彻底理解本申请,将在下列的描述中提出详细的结构,以便阐释本申请提出的技术方案。本申请的可选实施例详细描述如下,然而除了这些详细描述外,本申请还可以具有其他实施方式。For a thorough understanding of the present application, detailed structures will be presented in the following description in order to explain the technical solutions proposed by the present application. Alternative embodiments of the present application are described in detail below, however, the present application may have other embodiments in addition to these detailed descriptions.
下面,首先参考图1描述根据本申请一个实施例的超声成像系统,图1示出了根据本申请实施例的超声成像系统100的示意性结构框图。In the following, an ultrasound imaging system according to an embodiment of the present application is first described with reference to FIG. 1 , which shows a schematic structural block diagram of an ultrasound imaging system 100 according to an embodiment of the present application.
如图1所示,超声成像系统100包括超声探头110、发射/接收电路112、处理器114、显示器116以及存储器118。进一步地,超声成像系统100还可以包括波束合成电路和发射/接收选择开关等。As shown in FIG. 1 , the ultrasound imaging system 100 includes an ultrasound probe 110 , a transmit/receive circuit 112 , a processor 114 , a display 116 , and a memory 118 . Further, the ultrasound imaging system 100 may further include a beam forming circuit, a transmit/receive selection switch, and the like.
具体地,超声探头110包括多个换能器阵元,多个换能器阵元可以排列成一排构成线阵,或排布成二维矩阵构成面阵,多个换能器阵元也可以构成凸阵列。换能器用于根据激励电信号发射超声波,或将接收的超声波转换为电信号,因此每个阵元可用于实现电脉冲信号和超声波的相互转换,从而实现向被测对象的目标区域的组织发射超声波、也可用于接收经组织反射回的超声波回波。在进行超声成像时,可通过发射序列和接收序列控制哪些换能器用于发射超声波,哪些换能器用于接收超声波,或者控制换能器分时隙用于发射超声波或接收超声波的回波。参与超声波发射的换能器可以同时被电信号激励,从而同时发射超声波;或者,参与超声波束发射的换能器也可以被具有一定时间间隔的若干电信号激励,从而持续发射具有一定时间间隔的超声波。Specifically, the ultrasonic probe 110 includes a plurality of transducer array elements, and the plurality of transducer array elements can be arranged in a row to form a linear array, or arranged in a two-dimensional matrix to form an area array, and the plurality of transducer array elements can also be arranged form a convex array. The transducer is used to transmit ultrasonic waves according to the excitation electrical signal, or convert the received ultrasonic waves into electrical signals, so each array element can be used to realize the mutual conversion of electrical pulse signals and ultrasonic waves, so as to realize the tissue emission to the target area of the measured object. Ultrasound can also be used to receive ultrasound echoes reflected back by tissue. During ultrasonic imaging, which transducers are used for transmitting ultrasonic waves and which transducers are used for receiving ultrasonic waves, or which transducers are used for transmitting ultrasonic waves or receiving ultrasonic waves in time slots through the transmitting sequence and receiving sequence. The transducers participating in ultrasonic emission can be excited by electrical signals at the same time, so as to emit ultrasonic waves at the same time; or, the transducers participating in ultrasonic beam emission can also be excited by several electrical signals with a certain time interval, so as to continuously emit a certain time interval. Ultrasound.
发射/接收电路112可以通过发射/接收选择开关与超声探头110连接。发射/接收选择开关也可以被称为发送/接收控制器,其可以包括发送控制器和接收控制器,发送控制器用于激励超声探头110经由发射电路向中晚孕期胎儿所在区域发射超声波;接收控制器用于通过超声探头110经由接收电路接收从中晚孕期胎儿所在区域返回的超声回波,从而获得超声回波数据。之后,发射/接收电路112将超声回波的电信号送入波束合成电路,波束合成电路对该电信号进行聚焦延时、加权和通道求和等处理,然后将处理后的超声回波数据送入处理器114。The transmit/receive circuit 112 may be connected to the ultrasound probe 110 through a transmit/receive selection switch. The transmit/receive selection switch may also be called a transmit/receive controller, which may include a transmit controller and a receive controller, the transmit controller is used to excite the ultrasound probe 110 to transmit ultrasound to the area where the fetus is located in the second and third trimesters via the transmit circuit; the receive control The device is used to receive ultrasonic echoes returned from the region where the fetus is located in the second and third trimesters through the ultrasonic probe 110 via the receiving circuit, so as to obtain ultrasonic echo data. After that, the transmitting/receiving circuit 112 sends the electrical signal of the ultrasonic echo into the beam forming circuit, and the beam forming circuit performs processing such as focusing delay, weighting and channel summation on the electrical signal, and then sends the processed ultrasonic echo data to the beam forming circuit. into the processor 114.
可选地,处理器114可以通过软件、硬件、固件或其任意组合来实现,可以使用电路、单个或多个专用集成电路(Application Specific Integrated Circuit,ASIC)、单个或多个通用集成电路、单个或多个微处理器、单个或多 个可编程逻辑器件、或者前述电路和/或器件的任意组合、或者其他适合的电路或器件,从而使得处理器114可以执行本说明书中的各个实施例中的方法的相应步骤。并且,处理器114可以控制所述超声成像系统100中的其它组件以执行期望的功能。Optionally, the processor 114 may be implemented by software, hardware, firmware or any combination thereof, and may use circuits, single or multiple application specific integrated circuits (ASICs), single or multiple general-purpose integrated circuits, single or multiple microprocessors, single or multiple programmable logic devices, or any combination of the foregoing circuits and/or devices, or other suitable circuits or devices, thereby enabling the processor 114 to perform the various corresponding steps of the method. Also, the processor 114 may control other components in the ultrasound imaging system 100 to perform desired functions.
处理器114对其接收到的超声回波数据进行处理,得到中晚孕期胎儿的三维超声数据。作为示例,超声探头110在一系列扫描平面内发射/接收超声波,由处理器114根据其三维空间关系进行整合,实现中晚孕期胎儿在三维空间的扫描以及三维图像的重建。最后,由处理器114对其进行去噪、平滑、增强等部分或全部图像后处理步骤后,获取中晚孕期胎儿的三维超声数据。处理器114可以获取中晚孕期胎儿全身的三维超声数据,也可以仅获取中晚孕期胎儿头部或者身体的三维超声数据。处理器114还用于从三维超声数据中提取中晚孕期胎儿的标准切面。处理器114得到的标准切面可以存储于存储器中或在显示器116上显示。并且,处理器114还可以对三维超声数据进行绘制并在显示器116上显示。The processor 114 processes the received ultrasound echo data to obtain three-dimensional ultrasound data of the fetus in the second and third trimesters. As an example, the ultrasound probe 110 transmits/receives ultrasound in a series of scanning planes, and is integrated by the processor 114 according to its three-dimensional spatial relationship to realize the scanning of the fetus in the three-dimensional space and the reconstruction of the three-dimensional image in the second and third trimesters. Finally, after the processor 114 performs some or all of the image post-processing steps such as denoising, smoothing, and enhancement, the three-dimensional ultrasound data of the fetus in the second and third trimesters is acquired. The processor 114 may acquire three-dimensional ultrasound data of the whole body of the fetus in the second and third trimesters, or may acquire only the three-dimensional ultrasound data of the head or body of the fetus in the second and third trimesters. The processor 114 is also used for extracting standard slices of the fetus in the second and third trimesters from the three-dimensional ultrasound data. Standard slices obtained by processor 114 may be stored in memory or displayed on display 116 . Also, the processor 114 may render and display the three-dimensional ultrasound data on the display 116 .
显示器116与处理器114连接,显示器116可以为触摸显示屏、液晶显示屏等;或者显示器116可以为独立于超声成像系统100之外的液晶显示器、电视机等独立显示设备;或者显示器116可以是智能手机、平板电脑等电子设备的显示屏,等等。其中,显示器116的数量可以为一个或多个。例如,显示器116可以包括主屏和触摸屏,主屏主要用于显示超声图像,触摸屏主要用于人机交互。The display 116 is connected to the processor 114, and the display 116 may be a touch display screen, a liquid crystal display screen, etc.; or the display 116 may be an independent display device such as a liquid crystal display, a television set, etc. independent of the ultrasound imaging system 100; or the display 116 may be Displays of electronic devices such as smartphones, tablets, etc. The number of displays 116 may be one or more. For example, the display 116 may include a main screen and a touch screen, where the main screen is mainly used for displaying ultrasound images, and the touch screen is mainly used for human-computer interaction.
显示器116可以显示处理器114得到的超声图像。此外,显示器116在显示超声图像的同时还可以提供给用户进行人机交互的图形界面,在图形界面上设置一个或多个被控对象,提供给用户利用人机交互装置输入操作指令来控制这些被控对象,从而执行相应的控制操作。例如,在图形界面上显示图标,利用人机交互装置可以对该图标进行操作,用来执行特定的功能。 Display 116 may display ultrasound images obtained by processor 114 . In addition, the display 116 can also provide a graphical interface for the user to perform human-computer interaction while displaying the ultrasonic image, set one or more controlled objects on the graphical interface, and provide the user with a human-computer interaction device to input operating instructions to control these objects. The controlled object, so as to perform the corresponding control operation. For example, an icon is displayed on a graphical interface, and the icon can be operated by using a human-computer interaction device to perform a specific function.
可选地,超声成像系统100还可以包括显示器116之外的其他人机交互装置,其与处理器114连接,例如,处理器114可以通过外部输入/输出端口与人机交互装置连接,外部输入/输出端口可以是无线通信模块,也可以是有线通信模块,或者两者的组合。外部输入/输出端口也可基于USB、如CAN等总线协议、和/或有线网络协议等来实现。Optionally, the ultrasound imaging system 100 may further include other human-computer interaction devices other than the display 116, which are connected to the processor 114. For example, the processor 114 may be connected to the human-computer interaction device through an external input/output port, and the external input/output port may be connected to the human-computer interaction device. / The output port can be a wireless communication module, a wired communication module, or a combination of the two. External input/output ports may also be implemented based on USB, bus protocols such as CAN, and/or wired network protocols, and the like.
其中,人机交互装置可以包括输入设备,用于检测用户的输入信息,该 输入信息例如可以是对超声波发射/接收时序的控制指令,可以是在超声图像上绘制出点、线或框等的操作输入指令,或者还可以包括其他指令类型。输入设备可以包括键盘、鼠标、滚轮、轨迹球、移动式输入设备(比如带触摸显示屏的移动设备、手机等等)、多功能旋钮等等其中之一或者多个的结合。人机交互装置还可以包括诸如打印机之类的输出设备。Wherein, the human-computer interaction device may include an input device for detecting the user's input information, for example, the input information may be a control instruction for the ultrasonic transmission/reception sequence, or a point, line or frame drawn on the ultrasonic image. Manipulate input instructions, or may also include other instruction types. The input device may include one or a combination of a keyboard, a mouse, a scroll wheel, a trackball, a mobile input device (eg, a mobile device with a touch display screen, a cell phone, etc.), a multi-function knob, and the like. The human-computer interaction apparatus may also include an output device such as a printer.
超声成像系统100还可以包括存储器118,用于存储处理器执行的指令、存储接收到的超声回波、存储超声图像,等等。存储器118可以为闪存卡、固态存储器、硬盘等。其可以为易失性存储器和/或非易失性存储器,为可移除存储器和/或不可移除存储器等。The ultrasound imaging system 100 may also include a memory 118 for storing instructions executed by the processor, storing received ultrasound echoes, storing ultrasound images, and the like. The memory 118 may be a flash memory card, solid state memory, hard disk, or the like. It may be volatile memory and/or non-volatile memory, removable memory and/or non-removable memory, and the like.
应理解,图1所示的超声成像系统100所包括的部件只是示意性的,其可以包括更多或更少的部件。本申请对此不限定。It should be understood that the components included in the ultrasound imaging system 100 shown in FIG. 1 are only illustrative, and may include more or less components. This application is not limited to this.
下面,将参考图2描述根据本申请实施例的中晚孕期胎儿的超声成像方法。图2是本申请实施例的中晚孕期胎儿的超声成像方法200的一个示意性流程图。Hereinafter, an ultrasound imaging method of a fetus in the second and third trimesters according to an embodiment of the present application will be described with reference to FIG. 2 . FIG. 2 is a schematic flowchart of a method 200 for ultrasound imaging of a fetus in the second and third trimesters according to an embodiment of the present application.
如图2所示,本申请一个实施例的中晚孕期胎儿的超声成像方法200包括如下步骤:As shown in FIG. 2 , the ultrasound imaging method 200 of a fetus in the second and third trimesters according to an embodiment of the present application includes the following steps:
首先,在步骤S210,向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号。First, in step S210, ultrasonic waves are transmitted to the fetus in the second and third trimesters, and echoes of the ultrasonic waves are received to obtain ultrasonic echo signals.
其中,中晚孕期胎儿包括中孕期胎儿和晚孕期胎儿,中孕期胎儿一般指孕十四周至孕二十七周的胎儿,晚孕期胎儿一般指在孕二十八周及以上的胎儿。示例性地,可以基于图1所示的超声成像系统100进行超声扫描。用户移动超声探头110选择合适的位置和角度,发射/接收电路120中的发射电路将一组经过延迟聚焦的脉冲发送到超声探头110,超声探头110沿2D扫描平面向中晚孕期胎儿发射超声波。超声探头110接收到反射回的超声回波后,将其转化为电信号,由波束合成电路对多次发射/接收得到的超声回波信号进行相应的延时与加权求和的处理,实现波束合成,再送入处理器114进行后续的信号处理。Among them, the fetus in the second and third trimesters includes the fetus in the second trimester and the fetus in the third trimester. The fetus in the second trimester generally refers to the fetus from the 14th to the 27th week of pregnancy, and the fetus in the third trimester generally refers to the fetus at the 28th week of pregnancy and above. Exemplarily, an ultrasound scan may be performed based on the ultrasound imaging system 100 shown in FIG. 1 . The user moves the ultrasound probe 110 to select an appropriate position and angle, and the transmit circuit in the transmit/receive circuit 120 sends a set of delayed and focused pulses to the ultrasound probe 110 , and the ultrasound probe 110 transmits ultrasound to the fetus in the second and third trimesters along the 2D scanning plane. After the ultrasonic probe 110 receives the reflected ultrasonic echoes, it converts them into electrical signals, and the beamforming circuit performs corresponding delay and weighted summation processing on the ultrasonic echo signals obtained from multiple transmissions/receptions, so as to realize the beam forming process. It is synthesized and then sent to the processor 114 for subsequent signal processing.
在步骤S220,基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据。In step S220, three-dimensional ultrasound data of the fetus in the second and third trimesters is obtained based on the ultrasound echo signal.
具体地,可以对超声探头110在一系列扫描平面内发射/接收获得的超声 回波的三维空间关系进行整合,从而实现中晚孕期胎儿在三维空间的扫描以及三维超声数据的重建。最后,经过去噪、平滑、增强等部分或全部图像后处理步骤后,获得中晚孕期胎儿的三维超声数据。其中,可以获取中晚孕期胎儿全身的三维超声数据,也可以仅获取中晚孕期胎儿身体区域的三维超声数据。Specifically, the three-dimensional spatial relationship of the ultrasound echoes obtained by the ultrasound probe 110 transmitted/received in a series of scanning planes can be integrated, so as to realize the scanning of the fetus in the three-dimensional space and the reconstruction of the three-dimensional ultrasound data in the second and third trimesters. Finally, after some or all image post-processing steps such as denoising, smoothing, and enhancement, three-dimensional ultrasound data of the fetus in the second and third trimesters are obtained. Among them, the three-dimensional ultrasound data of the whole body of the fetus in the second and third trimesters may be acquired, or only the three-dimensional ultrasound data of the fetal body region in the second and third trimesters may be acquired.
在一些实施例中,获取三维超声数据之后,可以对三维超声数据使用可视化算法进行绘制,从而获得三维超声图像,并利用显示设备进行显示。绘制三维图像所采用的方法例如包括表面绘制方法或体绘制方法等,本申请实施例对此不做限制。In some embodiments, after acquiring the three-dimensional ultrasound data, a visualization algorithm may be used to render the three-dimensional ultrasound data, so as to obtain a three-dimensional ultrasound image and display it by using a display device. The method used for rendering the three-dimensional image includes, for example, a surface rendering method or a volume rendering method, which is not limited in this embodiment of the present application.
在本申请实施例中,腹部标准切面为三维超声图像中包含腹部关键信息的二维切面,通过腹部标准切面可以观察到具有临床价值的生理特征结构,是筛查腹部畸形的重要依据。示例性地,后续提取的腹部标准切面包括以下标准切面中的至少一个:腹围切面、脐带插入口切面、胆囊切面、双肾横切面以及膀胱与双脐动脉切面。In the embodiment of the present application, the standard abdominal section is a two-dimensional section containing key information of the abdomen in the three-dimensional ultrasound image. The physiological characteristic structure with clinical value can be observed through the standard abdominal section, which is an important basis for screening abdominal deformities. Exemplarily, the subsequently extracted standard abdominal slices include at least one of the following standard slices: abdominal girth slice, umbilical cord insertion slice slice, gallbladder slice, bilateral kidney transverse slice, and bladder and double umbilical artery slice.
具体地,腹围切面通常呈圆形或者椭圆形,其中包含胃泡、脐静脉、以及脊柱横切面的信息。脐带插入口切面通常呈圆形或椭圆形,正常的脐带腹壁入口位于前腹壁中央,与后腹壁脊柱回声连成一直线,构成脐带插入口切面的前后中轴线。胆囊切面通常呈圆形或者椭圆形,其中包含胆囊等结构的信息。双肾横切面通常呈圆形或者椭圆形,其中包含两肾脏结构等结构的信息。膀胱与双脐动脉切面是下腹部横切面,其中显示有膀胱无回声区,彩色多普勒图像显示有膀胱两侧的脐动脉。后续可以提取以上标准切面中的部分或全部的腹部标准切面,以对中晚孕期胎儿的身体区域进行全面的筛查。Specifically, the abdominal girth section is usually round or oval, and contains information about the gastric vesicle, the umbilical vein, and the transverse section of the spine. The cut surface of the umbilical cord insertion port is usually round or oval, and the normal abdominal wall entrance of the umbilical cord is located in the center of the anterior abdominal wall, which is in a straight line with the spinal echo of the posterior abdominal wall, forming the anterior and posterior central axis of the cut surface of the umbilical cord insertion port. The gallbladder section is usually round or oval in shape and contains information about structures such as the gallbladder. The cross-section of both kidneys is usually round or oval, which contains information about the structure of the two kidneys. The section of the bladder and double umbilical arteries is a transverse section of the lower abdomen, which shows the anechoic area of the bladder, and the color Doppler image shows the umbilical arteries on both sides of the bladder. Subsequent extraction of some or all of the standard abdominal slices above can be performed to perform comprehensive screening of the fetal body region in the second and third trimesters.
在步骤S230,根据所述三维超声数据确定所述中晚孕期胎儿身体区域的长轴方向。In step S230, the long-axis direction of the fetal body region in the second and third trimesters is determined according to the three-dimensional ultrasound data.
由于根据中晚孕期胎儿的三维超声数据能够较为准确地确定身体区域的长轴方向,且腹部标准切面一般与身体区域的长轴方向具有一定的角度关系,因而首先确定身体区域的长轴方向、再根据身体区域的长轴方向进一步提取腹部标准切面,能够提高所提取到的腹部标准切面的质量。示例性地,确定中晚孕期胎儿身体区域的长轴方向包括但不限于以下几种实现方式:Since the long-axis direction of the body region can be more accurately determined according to the 3D ultrasound data of the fetus in the second and third trimesters, and the standard abdominal section generally has a certain angular relationship with the long-axis direction of the body region, first determine the long-axis direction of the body region, Further extracting the abdominal standard slice according to the long axis direction of the body region can improve the quality of the extracted abdominal standard slice. Exemplarily, determining the long-axis direction of the fetal body region in the second and third trimesters includes but is not limited to the following implementations:
在一种方式中,可以在步骤S220中获取的三维超声数据中确定中晚孕期胎儿的脊柱区域,并根据脊柱区域的方向确定中晚孕期胎儿身体的长轴方向。 由于脊柱区域在中晚孕期胎儿的三维超声图像中较为明显,因而根据脊柱区域的位置能够准确地确定中晚孕期胎儿身体的长轴方向。In one manner, the spine region of the fetus in the second and third trimesters may be determined from the three-dimensional ultrasound data acquired in step S220, and the long axis direction of the fetal body in the second and third trimesters may be determined according to the direction of the spine region. Since the spine region is more obvious in the three-dimensional ultrasound images of the fetus in the second and third trimesters, the long-axis direction of the fetal body in the second and third trimesters can be accurately determined according to the position of the spine region.
示例性地,在三维超声数据中确定中晚孕期胎儿的脊柱区域包括在三维超声数据中分割出中晚孕期胎儿的脊柱区域,其方式包括但不限于以下两种:其一是将三维脊柱区域分割转化成二维脊柱区域分割,也就是在三维超声数据的多个二维切面图像中分割脊柱区域,并综合多个二维切面图像上脊柱区域的分割结果,以得到脊柱在三维超声图像中的三维分割结果;其二是直接对三维超声数据进行三维分割,以得到脊柱区域的三维分割结果。Exemplarily, determining the spine region of the fetus in the second and third trimesters in the three-dimensional ultrasound data includes segmenting the spine region of the fetus in the second and third trimesters from the three-dimensional ultrasound data, and the methods include but are not limited to the following two: one is to divide the three-dimensional spine region; The segmentation is transformed into two-dimensional spine region segmentation, that is, the spine region is segmented in multiple two-dimensional slice images of the three-dimensional ultrasound data, and the segmentation results of the spine region on the multiple two-dimensional slice images are combined to obtain the spine in the three-dimensional ultrasound image. The second is to directly perform 3D segmentation on the 3D ultrasound data to obtain the 3D segmentation result of the spine region.
当将三维脊柱区域分割转化成二维脊柱区域分割时,从三维超声数据中提取的多个二维切面可以是三维超声数据的所有二维切面,之后可以综合所有二维切面的脊柱区域的分割结果来获取整个三维超声数据中脊柱的分割结果。示例性地,可以将三维超声数据按照水平切面、上下切面等方式,来获取三维超声数据的所有二维切面。或者,从三维超声数据中提取的多个二维切面也可以为三维超声数据中的部分二维切面,即二维切面是对三维超声数据中以预设规则进行采样以得到的采样图像,例如可以按照某一方向等距获取采样图像或者按照一个中心点进行旋转以获取采样图像,分割采样图像中的脊柱区域,之后,对多个采样图像的脊柱区域的分割结果进行三维插值,以得到整个脊柱区域的三维分割结果。When converting the 3D spine region segmentation into 2D spine region segmentation, the multiple 2D slices extracted from the 3D ultrasound data can be all 2D slices of the 3D ultrasound data, and then the segmentation of the spine region from all the 2D slices can be synthesized results to obtain the segmentation results of the spine in the entire 3D ultrasound data. Exemplarily, all the two-dimensional slices of the three-dimensional ultrasound data may be acquired by taking the three-dimensional ultrasound data according to horizontal slices, upper and lower slices, and the like. Alternatively, the multiple 2D slices extracted from the 3D ultrasound data may also be part of the 2D slices in the 3D ultrasound data, that is, the 2D slices are sampled images obtained by sampling the 3D ultrasound data with preset rules, for example The sampled images can be obtained equidistantly in a certain direction or rotated according to a center point to obtain the sampled images, and the spine regions in the sampled images can be segmented. 3D segmentation results of the spine region.
其中,作为示例,可以采用机器学习方法或传统的图像处理方法在三维超声数据的多个二维切面图像中分割脊柱区域。Wherein, as an example, a machine learning method or a traditional image processing method can be used to segment the spinal region in a plurality of two-dimensional slice images of the three-dimensional ultrasound data.
具体地,当采用机器学习算法对二维切面图像中的脊柱区域进行分割时,需要预先构建一个中晚孕期胎儿的二维切面图像数据库,其中每一个二维切面图像数据均标记了脊柱区域对应的位置,之后采学习一个最优映射函数,用于从二维切面图像映射到脊柱区的域感兴趣区域框或脊柱区域的具体区域范围。Specifically, when using a machine learning algorithm to segment the spine region in the two-dimensional slice image, it is necessary to build a two-dimensional slice image database of the fetus in the second and third trimesters in advance, in which each two-dimensional slice image data is marked with the corresponding spine region. , and then learn an optimal mapping function for mapping from the two-dimensional slice image to the spine region's domain region of interest box or the spine region's specific region range.
当基于深度学习方法分割脊柱区域时,首先对数据库中的三维超声数据进行切面处理,得到多张二维切面图像以作为训练样本,每张二维切面图像均标记由脊柱区域所在的位置。将这些训练样本送入提前构建好的网络模型中,优化网络模型的损失函数以进行训练,直到网络模型达到收敛,在训练过程中网络模型能够学习到如何从一张二维切面图像中识别到脊柱区域所在的位置。训练好网络模型后,只需要将单张二维切面图像输入进网络模型中,即可得到脊柱区域的分割结果。When segmenting the spine region based on the deep learning method, the 3D ultrasound data in the database is first sliced, and multiple 2D slice images are obtained as training samples, and each 2D slice image is marked with the location of the spine area. These training samples are sent to the network model constructed in advance, and the loss function of the network model is optimized for training until the network model reaches convergence. During the training process, the network model can learn how to recognize the spine region from a two-dimensional slice image. the location. After training the network model, you only need to input a single two-dimensional slice image into the network model to get the segmentation result of the spine region.
当基于传统图像处理方法分割脊柱区域时,可以采用像素聚类法、边缘分割、图切割或基于阈值的图像分割算法。其中,基于阈值的图像分割算法较为简单直接,由于超声图像中脊柱区域和其他区域之间具有不同的灰度值,基于脊柱区域的这种性质,采用基于阈值的图像分割能够获得较好的效果。基于阈值进行图像分割时,可以预先设定一个或多个灰度值作为阈值,从而基于超声图像的灰度值将超声图像分为脊柱区域和背景区域。When segmenting the spine region based on traditional image processing methods, pixel clustering, edge segmentation, graph cutting, or threshold-based image segmentation algorithms can be used. Among them, the threshold-based image segmentation algorithm is relatively simple and straightforward. Since the spine region and other regions in the ultrasound image have different gray values, based on this property of the spine region, the threshold-based image segmentation can achieve better results. . When performing image segmentation based on a threshold, one or more grayscale values may be preset as a threshold, so that the ultrasound image is divided into a spine region and a background region based on the grayscale values of the ultrasound image.
除以上方法以外,还可以采用其他合适的方法在二维切面图像中分割脊柱区域。例如,先通过阈值分割、Snake、水平集、GraphCut、ASM、AAM等方法对二维切面图像进行预分割,以获取一组候选的边界范围;再对每一个候选的边界范围进行特征提取,特征提取方法可以是提取PCA、LDA、HOG、Harr、LBP等传统图像特征,也可以基于神经网络提取图像特征;之后,将提取到的图像特征与预先构建的数据库中标记的脊柱区域所提取的图像特征进行匹配,利用KNN、SVM、随机森林或神经网络等判别器进行分类,确定当前候选的边界范围是否包含脊柱区域。In addition to the above methods, other suitable methods can also be used to segment the spine region in the two-dimensional slice images. For example, first pre-segment the 2D slice image by threshold segmentation, Snake, level set, GraphCut, ASM, AAM and other methods to obtain a set of candidate boundary ranges; then perform feature extraction for each candidate boundary range. The extraction method can be to extract traditional image features such as PCA, LDA, HOG, Harr, LBP, etc., or to extract image features based on neural networks; after that, compare the extracted image features with the images extracted from the marked spine regions in the pre-built database. The features are matched, and the discriminators such as KNN, SVM, random forest or neural network are used for classification to determine whether the current candidate boundary range contains the spine region.
当直接对三维超声数据进行三维分割时,可以使用三维卷积神经网络进行三维分割以得到三维的脊柱区域,确定脊柱区域的长轴方向,进而确定身体区域的长轴方向。具体地,预先构建一个三维超声数据库,其中每个三维超声数据均标记有脊柱区域对应的位置,之后基于预先构建的数据库对三维卷积神经网络进行训练。基于三维卷积神经网络,不需要将三维超声数据进行切面处理,只需要将三维超声数据直接输入到训练好的模型中,即可得到脊柱区域的分割结果。可用的三维卷积神经网络包括但不限于3DUnet、3DFCN、Medical-Net等。When directly performing 3D segmentation on 3D ultrasound data, a 3D convolutional neural network can be used to perform 3D segmentation to obtain a 3D spine region, determine the long axis direction of the spine region, and then determine the long axis direction of the body region. Specifically, a three-dimensional ultrasound database is pre-built, wherein each three-dimensional ultrasound data is marked with a position corresponding to the spine region, and then the three-dimensional convolutional neural network is trained based on the pre-built database. Based on the 3D convolutional neural network, the 3D ultrasound data does not need to be sliced, and the 3D ultrasound data can be directly input into the trained model to obtain the segmentation results of the spine region. Available 3D Convolutional Neural Networks include, but are not limited to, 3DUnet, 3DFCN, Medical-Net, etc.
或者,可以采用传统的三维分割算法分割出三维超声数据中的脊柱区域,可选的三维分割算法包括但不限于三维大津法、三维阈值分割、三维区域生长、三维水平集、分裂合并法等。通过三维分割算法可以直接分割出三维的脊柱区域,再利用脊柱计算出胎儿的长轴方向。Alternatively, a traditional 3D segmentation algorithm can be used to segment the spine region in the 3D ultrasound data. Optional 3D segmentation algorithms include but are not limited to 3D Otsu method, 3D threshold segmentation, 3D region growing, 3D level set, split and merge method, etc. The three-dimensional spine region can be directly segmented by the three-dimensional segmentation algorithm, and then the long-axis direction of the fetus can be calculated by using the spine.
在采用例如以上方法分割出三维超声数据中的脊柱区域之后,再根据脊柱区域的范围确定其长轴方向,该长轴方向即为中晚孕期胎儿身体区域的长轴方向。示例性地,可以确定贴近脊柱区域的直线,并将该直线的方向确定为脊柱区域的方向。其中,可以采用最小二乘等方法拟合出最贴近脊柱区域的直线。或者,在传统图像处理方法中,可以采用霍夫变换、随机抽样一致 性算法(RANSAC)等方法,在中晚孕期胎儿的三维超声数据中检测亮度最亮的直线作为脊柱区域的检测结果,并将该直线的方向确定为脊柱区域的方向。After the spine region in the 3D ultrasound data is segmented by the above method, the long axis direction of the spine region is determined according to the range of the spine region, and the long axis direction is the long axis direction of the fetal body region in the second and third trimesters. Illustratively, a straight line proximate the spinal region may be determined and the direction of the straight line determined as the direction of the spinal region. Among them, the straight line closest to the spine region can be fitted by methods such as least squares. Alternatively, in traditional image processing methods, methods such as Hough transform and random sampling consensus algorithm (RANSAC) can be used to detect the brightest straight line in the three-dimensional ultrasound data of the fetus in the second and third trimesters as the detection result of the spine region, and The orientation of this line is determined as the orientation of the spine region.
在确定中晚孕期胎儿身体的长轴方向的另外一种方式中,可以在三维超声数据中确定中晚孕期胎儿的身体区域,并根据身体区域的形状确定中晚孕期胎儿身体的长轴方向。In another way of determining the long axis direction of the fetal body in the second and third trimesters, the body region of the second and third trimester fetuses can be determined in the three-dimensional ultrasound data, and the long axis direction of the second and third trimester fetal body can be determined according to the shape of the body region.
其中,在三维超声数据中确定中晚孕期胎儿的身体区域的方式与上文所述的确定脊柱区域的方式类似。例如,可以首先在三维超声数据的多个二维切面图像中分割身体区域,并综合多个二维切面图像上身体区域的分割结果,以得到身体区域在三维超声图像中的三维分割结果,其中在二维切面图像上分割身体区域的方法包括但不限于机器学习方法和传统的图像处理方法;或者,也可以采用三维卷积神经网络或者传统三维分割算法直接对三维超声数据进行处理,直接分割出中晚孕期胎儿的身体区域。The manner in which the body region of the fetus in the second and third trimesters is determined in the three-dimensional ultrasound data is similar to the manner in which the spine region is determined as described above. For example, the body region may be firstly segmented in multiple 2D slice images of the 3D ultrasound data, and the segmentation results of the body area on the multiple 2D slice images may be integrated to obtain the 3D segmentation result of the body area in the 3D ultrasound image, wherein The methods for segmenting body regions on 2D slice images include but are not limited to machine learning methods and traditional image processing methods; alternatively, 3D convolutional neural networks or traditional 3D segmentation algorithms can also be used to directly process 3D ultrasound data and directly segment The body area of the fetus in the second and third trimesters.
之后,再根据中晚孕期胎儿身体区域的分割结果,根据身体区域的形状确定身体区域的长轴,并将该长轴方向确定为中晚孕期胎儿身体区域的上下方向。示例性地,可以采用主成分分析(PCA)方法或最小二乘法确定身体区域的长轴方向,或分割上述身体区域中距离最远的两个点,两点间的连线即为身体区域的长轴。Then, according to the segmentation result of the fetal body region in the second and third trimesters, the long axis of the body region is determined according to the shape of the body region, and the long axis direction is determined as the up and down direction of the fetal body region in the second and third trimesters. Exemplarily, the principal component analysis (PCA) method or the least squares method can be used to determine the long-axis direction of the body region, or to divide the two points that are farthest away in the above-mentioned body region, and the connection between the two points is the body region. long axis.
除了以上的自动分割方式以外,还可以采用手动分割方式确定中晚孕期胎儿身体的长轴方向。即接收确定长轴方向的用户指令,根据接收到的用户指令确定中晚孕期胎儿身体的长轴方向。用户只需要指定长轴方向,即可以获得至少一个腹部标准切面,而无需逐一手动提取腹部标准切面。In addition to the above automatic segmentation methods, manual segmentation methods can also be used to determine the long axis direction of the fetal body in the second and third trimesters. That is, a user instruction for determining the direction of the long axis is received, and the direction of the long axis of the fetal body in the second and third trimesters is determined according to the received user instruction. Users only need to specify the direction of the long axis to obtain at least one standard abdominal slice without manually extracting the standard abdominal slices one by one.
在步骤S240,在所述三维超声数据中提取所述中晚孕期胎儿中晚孕目标特征结构的信息,所述中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊。In step S240, information about the target feature structure of the fetus in the second and third trimesters of pregnancy is extracted from the three-dimensional ultrasound data, and the feature structure of the second and third trimester fetuses includes at least one of the following: gastric vesicles, spine bones, liver, umbilical veins , descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder.
上述中晚孕目标特征结构是针对中晚孕期胎儿的特异性中晚孕目标特征结构,也是获取特定腹部标准切面的标志性结构。因此,首先需要对这些中晚孕目标特征结构的信息进行分析,例如获取其位置、体积等。其中,既可以在三维超声数据的多个二维切面图像中检测中晚孕目标特征结构所在的区域,并综合多个二维切面图像上中晚孕目标特征结构的分割结果,以得到中晚孕目标特征结构在三维超声图像中的三维分割结果;也可以是直接对三维 超声数据进行三维分割,以得到中晚孕目标特征结构的三维分割结果。The above-mentioned target feature structure in the second and third trimesters is a specific target feature structure in the second and third trimesters of pregnancy, and is also a landmark structure for obtaining a specific standard abdominal section. Therefore, it is first necessary to analyze the information of the characteristic structures of these mid-late pregnancy targets, such as obtaining their positions and volumes. Among them, it is possible to detect the region where the feature structure of the mid-late pregnancy target is located in multiple two-dimensional slice images of the three-dimensional ultrasound data, and synthesize the segmentation results of the feature structure of the mid-late pregnancy target on the multiple two-dimensional slice images, so as to obtain the mid-late pregnancy target feature structure. The 3D segmentation result of the feature structure of the pregnancy target in the 3D ultrasound image; it can also directly perform 3D segmentation on the 3D ultrasound data, so as to obtain the 3D segmentation result of the feature structure of the middle and late pregnancy target.
与上文中分割脊柱区域的方法类似,可以利用预先训练的目标分割网络提取三维超声数据的多个二维切面图像中的中晚孕目标特征结构。基于机器学习的分割方法需要预先构建一个超声图像数据库,其中每幅超声图像标记了各类腹部标准切面中的各个中晚孕目标特征结构的信息,具体包括:中晚孕目标特征结构是否存在,中晚孕目标特征结构的类型以及中晚孕目标特征结构的位置。Similar to the method for segmenting the spine region above, the pre-trained target segmentation network can be used to extract the target feature structure of the second and third trimesters in the multiple 2D slice images of the 3D ultrasound data. The segmentation method based on machine learning needs to construct an ultrasound image database in advance, in which each ultrasound image is marked with the information of each mid-late pregnancy target feature structure in various abdominal standard slices, specifically including: whether the mid-late pregnancy target feature structure exists, Types of target eigenstructures in the second and third trimesters and the location of the second and third trimester target eigenstructures.
基于深度学习的目标分割方法主要包括通过堆叠卷积层和全连接层来对预先构建的数据库进行特征的学习和参数的回归,使其在获得输入的超声图像以后,可以通过网络直接预测出中晚孕目标特征结构的位置,同时输出中晚孕目标特征结构的类别。可选的网络包括:RCNN、Fast RCNN、Faster-RCNN、YOLO、SSD、Retina-Net等等。在对网络进行训练时,首先获取数据库中三维超声数据的二维切面图像,每个二维切面图像对应一个标签,该标签包含中晚孕目标特征结构的位置及中晚孕目标特征结构的类别,最后通过二维切面图像以及对应的标签训练中晚孕目标特征结构分割模型。训练好分割模型之后,只需要将待分割的三维超声数据的二维切面图像输入到训练好的分割模型中即可以获得各中晚孕目标特征结构的位置和类型。The target segmentation method based on deep learning mainly includes the feature learning and parameter regression of the pre-built database by stacking convolutional layers and fully connected layers, so that after obtaining the input ultrasound image, the network can directly predict the The position of the late pregnancy target feature structure, and the category of the middle and late pregnancy target feature structure is output. Optional networks include: RCNN, Fast RCNN, Faster-RCNN, YOLO, SSD, Retina-Net, and more. When training the network, first obtain the 2D slice images of the 3D ultrasound data in the database, each 2D slice image corresponds to a label, and the label includes the location of the target feature structure in the second and third trimesters and the category of the target feature structure in the second and third trimesters. , and finally train the mid-late pregnancy target feature structure segmentation model through the two-dimensional slice images and the corresponding labels. After the segmentation model is trained, it is only necessary to input the 2D slice images of the 3D ultrasound data to be segmented into the trained segmentation model to obtain the location and type of the feature structures of each middle-late pregnancy target.
当直接对三维超声数据进行三维分割时,可以使用三维卷积神经网络进行三维分割以得到三维的中晚孕目标特征结构所在的区域。具体地,预先构建一个三维超声数据库,其中每个三维超声数据均标记有中晚孕目标特征结构对应的位置和类型等信息,之后基于预先构建的数据库对三维卷积神经网络进行训练。基于三维卷积神经网络,不需要将三维超声数据进行切面处理,只需要将三维超声数据直接输入到训练好的模型中,即可得到中晚孕目标特征结构的信息。When directly performing 3D segmentation on the 3D ultrasound data, a 3D convolutional neural network can be used for 3D segmentation to obtain a 3D region where the target feature structure of the middle and late pregnancy is located. Specifically, a three-dimensional ultrasound database is pre-built, in which each three-dimensional ultrasound data is marked with information such as the position and type corresponding to the feature structure of the target in the middle and late pregnancy, and then the three-dimensional convolutional neural network is trained based on the pre-built database. Based on the 3D convolutional neural network, the 3D ultrasound data does not need to be sliced, and the 3D ultrasound data can be directly input into the trained model to obtain the information of the target feature structure in the second and third trimesters.
除此之外,还可以根据中晚孕目标特征结构的形态特征在三维超声数据中确定至少一个候选特征结构,利用分类器判定候选特征结构的类别,并根据候选特征结构的类别在候选特征结构中确定中晚孕目标特征结构。例如,可以采用传统图像处理方法,对于透明的膀胱、胃泡、胆囊、脐静脉等低回声结构进行阈值分割与形态学操作,获得这些低回声结构的位置,再利用KNN、SVM、随机森林或神经网络等分类器对这些位置进行类别的判定,以确定中晚孕目标特征结构的位置。In addition, it is also possible to determine at least one candidate feature structure in the 3D ultrasound data according to the morphological features of the target feature structure in the second and third trimesters, use a classifier to determine the category of the candidate feature structure, and classify the candidate feature structure according to the category of the candidate feature structure. Determining the target characteristic structure in the second and third trimesters. For example, traditional image processing methods can be used to perform threshold segmentation and morphological operations on hypoechoic structures such as transparent bladder, gastric vesicle, gallbladder, and umbilical vein to obtain the locations of these hypoechoic structures, and then use KNN, SVM, random forest or A classifier such as a neural network performs category judgment on these positions to determine the position of the target feature structure in the second and third trimesters.
在步骤S250,根据所述中晚孕期胎儿身体的长轴方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面。In step S250, at least one standard abdominal slice of the fetus in the second and third trimesters is extracted from the three-dimensional ultrasound data according to the long-axis direction of the fetal body in the second and third trimesters and the information on the target feature structure of the second and third trimesters.
在一个实施例中,可以将与中晚孕期胎儿身体区域的长轴方向呈预设角度、并且与中晚孕目标特征结构的重合区域满足预设要求的切面确定为所述腹部标准切面。其中,当腹部标准切面为腹部横切面时,预设角度可以近似于或等于90°,即腹部标准切面与长轴方向垂直。图3示出了中晚孕期胎儿的三维超声图像、长轴方向以及与长轴方向相垂直的腹部标准切面的方向。In one embodiment, the cut plane that forms a preset angle with the long axis direction of the fetal body region in the second and third trimesters and meets the preset requirements with the overlapping area with the target feature structure of the second and third trimesters can be determined as the abdominal standard cut plane. Wherein, when the standard abdominal section is the transverse section of the abdomen, the preset angle may be approximately equal to or equal to 90°, that is, the standard abdominal section is perpendicular to the long axis direction. FIG. 3 shows the three-dimensional ultrasound image of the fetus in the second and third trimesters, the direction of the long axis and the direction of the standard slice of the abdomen perpendicular to the direction of the long axis.
由于中晚孕目标特征结构具有一定体积,与长轴方向呈预设角度、且经过中晚孕目标特征结构所在区域的切面可能有多个,因而需要在其中选择与中晚孕目标特征结构的重合区域满足预设要求的切面作为腹部标准切面。可选地,与中晚孕目标特征结构的重合区域满足预设要求可以是中晚孕目标特征结构在腹部标准切面上具有最大面积,或者,腹部标准切面经过中晚孕目标特征结构的中心点,如此提取的腹部标准切面能够提供更多的信息,且有利于规范不同地区、不同医院和不同医生之间对腹部标准切面的提取标准。在一些实施例中,也可以将与长轴方向垂直、且与至少两个中晚孕目标特征结构至少部分重合的切面确定为腹部标准切面,以提高提取到的腹部标准切面的准确性。Since the target feature structure of the second and third pregnancy has a certain volume, it is at a preset angle to the long axis, and there may be multiple sections passing through the area where the target feature structure of the second and third pregnancy is located. The slices whose overlapping areas meet the preset requirements are used as the standard slices of the abdomen. Optionally, the coincidence area with the target feature structure of the second and third trimesters meets the preset requirements, which may be that the target feature structure of the second and third trimesters has the largest area on the standard abdominal section, or the standard section of the abdomen passes through the center point of the target feature structure of the second and third trimesters. , the standard abdominal section extracted in this way can provide more information, and is helpful to standardize the extraction standard of standard abdominal section between different regions, different hospitals and different doctors. In some embodiments, a section perpendicular to the long axis direction and at least partially coincident with the at least two mid-late pregnancy target feature structures may also be determined as a standard abdominal section, so as to improve the accuracy of the extracted standard abdominal section.
例如,腹围切面为垂直于长轴切面且与胃泡区域和脐静脉区域至少部分重合的切面;脐带插入口切面为垂直于长轴方向且与脐带插入口区域至少部分重合的切面,如图4所示;胆囊切面为垂直于长轴方向且与胆囊区域至少部分重合的切面;双肾切面为垂直于长轴方向且与双肾区域至少部分重合的切面;膀胱切面为垂直于长轴方向且与膀胱区域和膀胱两侧的脐动脉区域至少部分重合的切面。For example, the abdominal girth section is a section perpendicular to the long axis and at least partially coincident with the gastric bubble area and the umbilical vein area; the umbilical cord insertion port section is a section perpendicular to the long axis and at least partially coincident with the umbilical cord insertion port area, as shown in the figure 4; the gallbladder section is the section perpendicular to the long axis and at least partially coincident with the gallbladder area; the double kidney section is the section perpendicular to the long axis and at least partially coincident with the double kidney area; the bladder section is perpendicular to the long axis and a section that at least partially coincides with the bladder area and the umbilical artery area on both sides of the bladder.
上文示出了自动获取腹部标准切面的方法,在此基础上,也可以采用半自动的检测方法,即先由限定腹部标准切面的提取范围,超声成像系统接收确定腹部标准切面的提取范围的用户指令,根据接收到的用户指令确定提取范围,并在所述提取范围内提取所述腹部标准切面。用户可以将提取范围限定在中晚孕期胎儿的腹部区域,以去除一些不必要的干扰物,从而提高腹部标准切面的质量。The method for automatically obtaining the standard abdominal slice is shown above. On this basis, a semi-automatic detection method can also be used, that is, the extraction range of the standard abdominal slice is first limited, and the ultrasound imaging system receives the user who determines the extraction range of the standard abdominal slice. an instruction, determining an extraction range according to the received user instruction, and extracting the abdominal standard slice within the extraction range. The user can limit the extraction range to the abdominal area of the fetus in the second and third trimesters to remove some unnecessary interferences, thereby improving the quality of the standard abdominal section.
示例性地,腹部标准切面的自动提取可以在获取到三维超声数据后自动 执行,也可以据接收到的用户指令而执行。例如,用户可以通过触发提取腹部标准切面的按键而启动自动提取腹部标准切面的功能,该按键可以是设置在显示器用户交互界面上的虚拟按键,也可以是实体按键。在获取三维超声数据后,当接收到提取腹部标准切面的用户指令时,提取腹部标准切面。在一些实施例中,用户也可以在开始采集超声数据之前启动自动提取腹部标准切面的功能,则在获得三维超声数据之后,自动提取腹部标准切面。腹部标准切面是筛查腹部畸形的重要依据,通过观察腹部标准切面可以判断中晚孕期胎儿腹部发育是否正常。Exemplarily, the automatic extraction of a standard slice of the abdomen may be performed automatically after acquiring the three-dimensional ultrasound data, or may be performed according to a received user instruction. For example, a user can activate the function of automatically extracting a standard abdominal slice by triggering a button for extracting a standard abdominal slice. After acquiring the three-dimensional ultrasound data, when a user instruction for extracting a standard abdominal slice is received, the standard slice of the abdomen is extracted. In some embodiments, the user may also activate the function of automatically extracting a standard abdominal slice before starting to acquire ultrasound data, and then automatically extract a standard slice of the abdomen after acquiring the three-dimensional ultrasound data. The standard abdominal section is an important basis for the screening of abdominal deformities. By observing the standard abdominal section, it can be judged whether the fetal abdominal development is normal in the second and third trimesters.
在一些实施例中,还可以首先根据接收到的用户输入确定待提取的标准切面。例如,可以在用户交互界面上显示腹围切面、脐带插入口切面等腹部标准切面的选项,并根据用户的选择确定待提取的腹部标准切面。In some embodiments, the standard slice to be extracted may also be determined first according to the received user input. For example, options for standard abdominal slices such as abdominal circumference slices and umbilical cord insertion opening slices may be displayed on the user interface, and the standard abdominal slices to be extracted may be determined according to the user's selection.
最后,步骤S260,显示所述腹部标准切面。Finally, in step S260, the standard abdominal slice is displayed.
其中,所显示的标准切面可以是步骤S250中提取的全部的标准切面,也可以是其中的部分标准切面。示例性地,在显示步骤S250中提取的标准切面时,可以根据接收到的用户指令显示其中的部分标准切面,例如,可以在显示界面上显示标准切面的名称或缩略图,并根据用户的选择显示相应的标准切面。The displayed standard cut planes may be all the standard cut planes extracted in step S250, or may be part of the standard cut planes. Exemplarily, when the standard slices extracted in step S250 are displayed, some of the standard slices may be displayed according to the received user instruction. The corresponding standard slice is displayed.
在一些实施例中,由于在步骤S240中在三维超声数据中对中晚孕目标特征结构进行了检测,因而还可以显示从三维超声数据中检测出的中晚孕目标特征结构所在的位置,以供用户进行对照分析。In some embodiments, since the feature structures of the second and third pregnancy targets are detected in the three-dimensional ultrasound data in step S240, the position of the second and third trimester target feature structures detected from the three-dimensional ultrasound data can also be displayed, so as to For users to conduct comparative analysis.
除此之外,还可以将步骤S230中所确定的长轴方向进行显示,以便于用户结合目标方向查看与之相关联的腹部标准切面。作为示例,可以在显示三维超声图像的同时显示目标方向。例如,可以通过箭头等图形标记显示中晚孕期胎儿身体区域的长轴方向。Besides, the long-axis direction determined in step S230 may also be displayed, so that the user can view the associated standard abdominal slice in combination with the target direction. As an example, the target direction may be displayed at the same time as the three-dimensional ultrasound image is displayed. For example, the direction of the long axis of the fetal body region in the second and third trimesters can be displayed by graphical markers such as arrows.
在一些实施例中,还可以显示所确定的各个标准切面的名称,以便于用户直观地确定标准切面的类型,或根据标准切面的名称选择所要查看的标准切面。标准切面的名称可以与标准切面同步显示,或者,可以首先在显示界面上显示各个标准切面的名称,当用户选中标准切面的名称时,显示相应的标准切面。In some embodiments, the name of each determined standard slice may also be displayed, so that the user can intuitively determine the type of the standard slice, or select the standard slice to be viewed according to the name of the standard slice. The names of the standard slices can be displayed synchronously with the standard slices, or, the names of each standard slice can be displayed on the display interface first, and when the user selects the name of the standard slice, the corresponding standard slice is displayed.
综上所述,本申请实施例的中晚孕期胎儿的超声成像方法200能够根据中晚孕期胎儿的身体区域的长轴方向和中晚孕目标特征结构的信息自动确定 至少一个腹部标准切面,无需医生逐一手动提取腹部标准切面,极大地优化了产前检查的工作流,有效地提升工作效率,并且能够提高所获取的腹部标准切面质量的稳定性,促进中晚孕结构筛查的推广与应用。To sum up, the ultrasound imaging method 200 of the fetus in the second and third trimesters of the embodiment of the present application can automatically determine at least one standard abdominal slice according to the long-axis direction of the body region of the fetus in the second and third trimesters and the information on the target feature structure of the second and third trimesters, without the need for The doctor manually extracts the standard abdominal sections one by one, which greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and can improve the stability of the quality of the obtained standard abdominal sections, and promote the promotion and application of structural screening in the middle and late pregnancy. .
本申请实施例还提供一种超声成像系统,用于实现上述的中晚孕期胎儿的超声成像方法200。该超声成像系统包括超声探头、发射/接收电路、存储器、处理器和显示器,存储器上存储有由处理器运行的计算机程序,该计算机程序在被处理器运行时执行中晚孕期胎儿的超声成像方法200的步骤。现在重新参照图1,该超声成像系统可以实现为如图1所示的超声成像系统100。如上所述,超声成像系统100可以包括超声探头110、发射/接收电路112、处理器114以及显示器116,各个部件的相关描述可以参照上文。Embodiments of the present application further provide an ultrasound imaging system for implementing the above-mentioned ultrasound imaging method 200 for a fetus in the second and third trimesters. The ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor and a display, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, an ultrasonic imaging method for a fetus in the second and third trimesters is executed 200 steps. Referring now back to FIG. 1 , the ultrasound imaging system may be implemented as ultrasound imaging system 100 as shown in FIG. 1 . As described above, the ultrasound imaging system 100 may include the ultrasound probe 110 , the transmit/receive circuit 112 , the processor 114 , and the display 116 , and the relevant descriptions of the various components can be referred to above.
当用于实现超声成像方法200时,发射/接收电路112用于激励所述超声探头110向中晚孕期胎儿发射超声波,并接收所述超声波的回波,以获得超声回波信号;处理器114用于:基于该超声回波信号获得中晚孕期胎儿的三维超声数据;根据三维超声数据确定所述中晚孕期胎儿身体区域的长轴方向;在三维超声数据中提取胎儿的中晚孕目标特征结构的信息,中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊;根据中晚孕期胎儿身体区域的长轴方向和中晚孕目标特征结构的信息,从三维超声数据中提取中晚孕期胎儿的至少一个腹部标准切面;显示器116用于显示该至少一个腹部股标准切面。When used to implement the ultrasonic imaging method 200, the transmitting/receiving circuit 112 is used to excite the ultrasonic probe 110 to transmit ultrasonic waves to the fetus in the second and third trimesters, and receive the echoes of the ultrasonic waves to obtain ultrasonic echo signals; the processor 114 The method is used for: obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal; determining the long-axis direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data; extracting the target features of the fetus in the second and third trimesters from the three-dimensional ultrasound data Structural information, the target feature structure in the second and third trimester includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery , gallbladder; according to the information of the long-axis direction of the fetal body region in the second and third trimesters and the information of the target characteristic structure of the second and third trimesters, extract at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data; the display 116 is used to display the at least one abdomen Standard section of the stock.
以上仅描述了超声成像系统100各部件的主要功能,更多细节参见对中晚孕期胎儿的超声成像方法200进行的相关描述。本申请实施例的超声成像系统能够自动确定中晚孕期胎儿的腹部标准切面,提高了工作效率和腹部标准切面的质量。Only the main functions of the components of the ultrasound imaging system 100 are described above. For more details, please refer to the related description of the ultrasound imaging method 200 for a fetus in the second and third trimesters. The ultrasound imaging system of the embodiment of the present application can automatically determine the standard abdominal section of the fetus in the second and third trimesters, thereby improving the work efficiency and the quality of the standard abdominal section.
下面,将参考图5描述根据本申请另一实施例的中晚孕期胎儿的超声成像方法。图5是本申请实施例的中晚孕期胎儿的超声成像方法500的一个示意性流程图。Hereinafter, an ultrasound imaging method of a fetus in the second and third trimesters according to another embodiment of the present application will be described with reference to FIG. 5 . FIG. 5 is a schematic flowchart of a method 500 for ultrasound imaging of a fetus in the second and third trimesters according to an embodiment of the present application.
如图5所示,所述中晚孕期胎儿的超声成像方法500包括如下步骤:As shown in FIG. 5 , the ultrasound imaging method 500 of the fetus in the second and third trimesters includes the following steps:
在步骤S510,向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;In step S510, transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving echoes of the ultrasonic waves to obtain ultrasonic echo signals;
在步骤S520,基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;In step S520, obtain three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
在步骤S530,根据所述三维超声数据确定所述中晚孕期胎儿身体区域的目标方向;In step S530, the target direction of the fetal body region in the second and third trimesters is determined according to the three-dimensional ultrasound data;
在步骤S540,在所述三维超声数据中提取所述胎儿的中晚孕目标特征结构的信息;In step S540, extract information about the target feature structure of the fetus in the second and third trimesters from the three-dimensional ultrasound data;
在步骤S550,根据所述目标方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面;In step S550, extract at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data according to the target direction and the information on the target feature structure of the second and third trimesters;
在步骤S560,显示所述至少一个腹部标准切面。In step S560, the at least one abdominal standard slice is displayed.
根据本申请实施例的中晚孕期胎儿的超声成像方法500中的步骤S510和步骤S520与参考图2描述的超声成像方法200中的步骤S210和步骤S220大体上类似,为了简洁,此处不再赘述相同的细节内容,以下主要对方法500中根据三维超声数据确定标准切面的方式进行详细描述。Steps S510 and S520 in the ultrasound imaging method 500 for a fetus in the second and third trimesters according to the embodiment of the present application are substantially similar to steps S210 and S220 in the ultrasound imaging method 200 described with reference to FIG. Repeating the same details, the following mainly describes in detail the manner in which the standard slice is determined according to the three-dimensional ultrasound data in the method 500 .
本实施例的中晚孕期胎儿的超声成像方法500与上文中的超声成像方法200的主要区别在于:根据三维超声数据确定的目标方向不限于中晚孕期胎儿身体区域的长轴方向。例如,该目标方向可以包括身体区域的上下方向(也即上文中的长轴方向)、前后方向和左右方向,以下分别称为第一方向、第二方向和第三方向。The main difference between the ultrasound imaging method 500 of the fetus in the second and third trimesters of this embodiment and the ultrasonic imaging method 200 above is that the target direction determined according to the three-dimensional ultrasound data is not limited to the long axis direction of the fetal body region in the second and third trimesters. For example, the target direction may include the up-down direction of the body region (ie, the long-axis direction above), the front-rear direction, and the left-right direction, hereinafter referred to as the first direction, the second direction, and the third direction, respectively.
在一个实施例中,根据三维超声数据确定中晚孕期胎儿身体区域的目标方向包括:在所述三维超声数据中确定所述中晚孕期胎儿的脊柱区域,根据所述脊柱区域的方向确定中晚孕期胎儿身体区域的目标方向。由于脊柱区域在三维超声图像中较为明显,因而根据脊柱区域的位置能够准确地确定中晚孕期胎儿身体区域的目标方向。其中,确定脊柱区域的方法可以包括在三维超声数据的多个二维切面图像中分割脊柱区域,并综合多个二维切面图像上脊柱区域的分割结果,以得到脊柱在三维超声图像中的三维分割结果;或者,直接对三维超声数据进行三维分割,以得到脊柱区域的三维分割结果。在三维超声数据中确定脊柱区域的方法的具体细节可以参照上文。In one embodiment, determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data includes: determining the spine region of the fetus in the second and third trimesters from the three-dimensional ultrasound data, and determining the middle and late pregnancy according to the direction of the spine region. Target orientation of fetal body regions during pregnancy. Since the spine region is more obvious in the three-dimensional ultrasound image, the target direction of the fetal body region in the second and third trimesters can be accurately determined according to the position of the spine region. The method for determining the spine region may include segmenting the spine region in multiple two-dimensional slice images of the three-dimensional ultrasound data, and synthesizing the segmentation results of the spine region on the multiple two-dimensional slice images, so as to obtain the three-dimensional spine in the three-dimensional ultrasound image. segmentation result; or, directly perform 3D segmentation on the 3D ultrasound data to obtain a 3D segmentation result of the spine region. The specific details of the method of determining the spine region in the three-dimensional ultrasound data can be referred to above.
通过脊柱区域的分割结果可以直接确定中晚孕期胎儿身体区域的上下方向和前后方向。其中,根据脊柱区域的方向确定中晚孕期胎儿身体区域的上下方向包括:确定贴近脊柱区域的直线,并将该直线的方向确定为中晚孕期胎儿身体区域的第一方向,即上下方向。示例性地,可以采用最小二乘等方法拟合出最贴近脊柱区域的直线,或者,也可以直接采用传统图像处理方法 中采用霍夫变换、RANSAC等方法获得的亮度最亮的直线作为最贴近脊柱区域的直线。The up-down and front-back directions of the fetal body region in the second and third trimesters can be directly determined through the segmentation results of the spine region. Wherein, determining the up and down direction of the fetal body region in the second and third trimesters according to the direction of the spine region includes: determining a straight line close to the spine region, and determining the direction of the straight line as the first direction of the fetal body region in the second and third trimesters, that is, the up and down direction. Exemplarily, the straight line closest to the spine region can be fitted by methods such as least squares, or the straight line with the brightest brightness obtained by using methods such as Hough transform and RANSAC in traditional image processing methods can be directly used as the closest line. Straight lines in the spine area.
根据脊柱区域的分割结果确定中晚孕期胎儿身体区域的上下方向以后,可以根据该上下方向进一步确定中晚孕期胎儿身体区域的第二方向,即前后方向。具体地,可以从中晚孕期胎儿身体的三维超声数据中提取与上文确定的上下方向相垂直的一个或多个身体区域横切面,使用机器学习或传统图像处理方法检测身体区域横切面中身体区域中心点与脊柱的位置,并将身体区域中心点与脊柱的位置连线方向确定为中晚孕期胎儿身体区域的第二方向,即前后方向,该第二方向与第一方向相垂直。After the up-down direction of the fetal body region in the second and third trimesters is determined according to the segmentation result of the spine region, the second direction of the fetal body region in the second and third trimesters can be further determined according to the up and down direction, that is, the front-rear direction. Specifically, one or more cross-sections of the body region perpendicular to the above-determined up-down direction can be extracted from the three-dimensional ultrasound data of the fetal body in the second and third trimesters, and machine learning or traditional image processing methods are used to detect the body region in the cross-section of the body region The position of the center point and the spine is determined, and the direction of the line connecting the center point of the body region and the position of the spine is determined as the second direction of the fetal body region in the second and third trimesters, that is, the front-to-back direction, and the second direction is perpendicular to the first direction.
在另一实施例中,也可以直接根据脊柱区域的分割结果确定身体区域的前后方向,而无需基于身体区域的上下方向来确定前后方向。具体地,由于脊柱向身体的后方凸起,因而可以确定贴近脊柱的曲线,并将该曲线的凸起方向确定为中晚孕期胎儿身体区域的前后方向。其中,可以采用最小二乘等方法拟合出最贴近脊柱的一条弧线作为上述曲线,或者直接获取传统图像处理方法中获得的亮度最亮的弧线作为上述曲线。In another embodiment, the front-back direction of the body region can also be directly determined according to the segmentation result of the spine region, without the need to determine the front-back direction based on the up-down direction of the body region. Specifically, since the spine is convex toward the back of the body, a curve close to the spine can be determined, and the convex direction of the curve can be determined as the front-back direction of the fetal body region in the second and third trimesters. Wherein, a method such as least squares can be used to fit an arc closest to the spine as the above curve, or the arc with the brightest brightness obtained in the traditional image processing method can be directly obtained as the above curve.
除此之外,还可以根据中晚孕期胎儿身体区域的形状特征确定身体区域的方向,即从三维超声数据中检测出中晚孕期胎儿的身体区域,并根据身体区域的形状确定目标方向。由于中晚孕期胎儿身体区域的上下方向的形状特征较为明显,而前后方向和左右方向的形状差别较小,因而该方式主要用于确定中晚孕期胎儿身体区域的上下方向。In addition, the direction of the body region can also be determined according to the shape characteristics of the fetal body region in the second and third trimesters, that is, the body region of the second and third trimester fetuses can be detected from the 3D ultrasound data, and the target direction can be determined according to the shape of the body region. Since the shape characteristics of the fetal body region in the upper and lower directions in the second and third trimesters are more obvious, and the shape difference between the front and rear directions and the left and right directions is small, this method is mainly used to determine the upper and lower directions of the fetal body region in the second and third trimesters.
具体地,可以采用机器学习或图像处理方法在三维超声数据中确定出中晚孕期胎儿的身体区域,其中确定的身体区域可以是确定包围中晚孕期胎儿身体的感兴趣区域框(ROI),或分割出中晚孕期胎儿身体的具体区域范围。之后,再根据身体区域的形状确定身体区域的长轴,并将该长轴的方向确定为中晚孕期胎儿身体区域的上下方向。示例性地,可以采用主成分分析(PCA)方法确定身体区域的长轴,或检测上述身体区域中距离最远的两个点,两点间的连线即为身体区域的长轴。Specifically, a machine learning or image processing method can be used to determine the body region of the fetus in the second and third trimesters in the three-dimensional ultrasound data, wherein the determined body region may be a region of interest frame (ROI) that is determined to surround the body of the fetus in the second and third trimesters, or Segment the specific area of the fetal body in the second and third trimesters. After that, the long axis of the body region is determined according to the shape of the body region, and the direction of the long axis is determined as the up-down direction of the fetal body region in the second and third trimesters. Exemplarily, a principal component analysis (PCA) method can be used to determine the long axis of the body region, or to detect the two most distant points in the above body region, and the line connecting the two points is the long axis of the body region.
至于中晚孕期胎儿身体区域的第三方向(即左右方向)的确定,可以在采用上述任意方式或其他任何可行的方式确定出中晚孕期胎儿身体区域的上下方向和前后方向之后,将与上下方向和前后方向相垂直的方向确定为中晚孕期胎儿身体的左右方向。除此之外,也可以根据中晚孕期胎儿的一些特定中晚孕目标特征结构确定中晚孕期胎儿身体区域的左右方向,例如,可以在三维超声数据中检测中晚孕期胎儿身体区域中对称特征结构的位置,并将对 称特征结构连线的方向确定为中晚孕期胎儿身体区域的左右方向。其中,对称特征结构例如为双肾、双肺、左右肋骨等具有对称性的特征结构。或者,也可以检测中晚孕期胎儿的左右心房,左右心房连线方向与中晚孕期胎儿身体区域的左右方向一般成45°角,根据该特性也可以确定中晚孕期胎儿身体区域的左右方向。As for the determination of the third direction (ie, the left-right direction) of the fetal body region in the second and third trimesters, the up-down direction and the anterior-posterior direction of the fetal body region in the second and third trimesters can be determined by using any of the above methods or any other feasible methods. The direction perpendicular to the anterior-posterior direction is determined as the left-right direction of the fetal body in the second and third trimesters. In addition, the left and right directions of the fetal body region in the second and third trimesters can also be determined according to some specific target feature structures of the fetus in the second and third trimesters. For example, symmetrical features in the fetal body region in the second and third trimesters can be detected in the three-dimensional ultrasound data. The position of the structure was determined, and the direction of the line connecting the symmetrical features was determined as the left and right direction of the fetal body area in the second and third trimesters. The symmetrical characteristic structure is, for example, a symmetrical characteristic structure such as two kidneys, two lungs, and left and right ribs. Alternatively, the left and right atriums of the fetus in the second and third trimesters can also be detected. The direction of the connection between the left and right atriums generally forms an angle of 45° with the left and right directions of the fetal body region in the second and third trimesters. According to this feature, the left and right directions of the fetal body region in the second and third trimesters can also be determined.
在步骤S540,在三维超声数据中提取胎儿的中晚孕目标特征结构的信息。其中,中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊。In step S540, information about the target feature structure of the fetus in the second and third trimesters is extracted from the three-dimensional ultrasound data. Among them, the target feature structure of the second and third pregnancy includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder .
中晚孕目标特征结构与待提取的腹部标准切面相对应。在一些实施例中,首先确定待提取的腹部标准切面的类型,进而确定与该腹部标准切面的类型对应的中晚孕目标特征结构。具体地,腹部标准切面包括以下至少一个:腹围切面、脐带插入口切面、胆囊切面、双肾横切面、膀胱与双脐动脉切面。当腹部标准切面为腹围切面时,所述中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉和下腔静脉;当腹部标准切面为脐带插入口切面时,中晚孕目标特征结构包括以下至少一个:脐带插入处、脐带、脊柱骨、前腹壁和降主动脉;当腹部标准切面为膀胱与双脐动脉切面时,中晚孕目标特征结构包括以下至少一个:膀胱、脐动脉;当腹部标准切面为胆囊切面时,所述中晚孕目标特征结构包括胆囊、脊柱骨;当腹部标准切面为双肾横切面时,中晚孕目标特征结构包括双肾、脊柱骨。The target feature structure of the second and third trimesters corresponds to the standard abdominal section to be extracted. In some embodiments, the type of the standard abdominal slice to be extracted is first determined, and then the target feature structure of the second and third trimesters corresponding to the type of the standard abdominal slice is determined. Specifically, the standard abdominal section includes at least one of the following: abdominal girth section, umbilical cord insertion port section, gallbladder section, bilateral kidney transverse section, bladder and double umbilical artery section. When the standard abdominal section is the abdominal girth section, the target feature structure of the second trimester includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta and inferior vena cava; when the standard abdominal section is the umbilical cord insertion port In the view, the target feature structures of the second and third trimesters include at least one of the following: umbilical cord insertion, umbilical cord, spine, anterior abdominal wall and descending aorta; when the standard view of the abdomen is the bladder and double umbilical arteries, the second trimester target feature structures include: At least one of the following: bladder and umbilical artery; when the standard abdominal section is the gallbladder section, the target characteristic structures in the second and third trimesters include gallbladder and spine; when the standard abdominal section is the transverse section of both kidneys, the target characteristic structures in the second and third trimesters include Kidneys and spine.
在步骤S540中,可以采用任何合适的图像检测或分割方法确定中晚孕目标特征结构的位置。例如,可以采用传统的机器学习方法或深度学习方法,为与各个腹部标准切面对应的中晚孕目标特征结构训练一个机器学习模型,以用于确定目标该特征结构的位置。在模型训练之前,预先建立一个中晚孕期胎儿超声数据库,数据库中每一个三维超声数据均标记了胎儿的中晚孕目标特征结构的位置,例如其感兴趣区域框或具体区域范围,之后采用传统机器学习方法或深度学习方法,学习一个最优映射函数,用于从中晚孕期胎儿的三维超声数据中获取中晚孕目标特征结构的感兴趣区域框或具体区域范围,实现该中晚孕目标特征结构的检测或分割。In step S540, any suitable image detection or segmentation method can be used to determine the position of the target feature structure of the second and third trimesters. For example, a traditional machine learning method or a deep learning method can be used to train a machine learning model for the target feature structure of the middle and late pregnancy corresponding to each standard abdominal slice, so as to determine the position of the target feature structure. Before model training, a fetal ultrasound database in the second and third trimesters is established in advance. Each 3D ultrasound data in the database marks the position of the fetal target feature structure in the second and third trimesters, such as its region of interest frame or specific region range. A machine learning method or a deep learning method is used to learn an optimal mapping function, which is used to obtain the region of interest frame or specific area range of the target feature structure of the second and third trimesters from the three-dimensional ultrasound data of the fetus in the second and third trimesters, so as to realize the target feature of the second and third trimesters. Detection or segmentation of structures.
在步骤S550,根据步骤S530确定的目标方向和步骤S540中确定的中晚孕目标特征结构的信息,从三维超声数据中提取中晚孕期胎儿的至少一个腹 部标准切面。具体地,可以将与目标方向呈预设角度、并且与中晚孕目标特征结构的重合区域满足预设要求的切面确定为腹部标准切面。示例性地,与中晚孕目标特征结构的重合区域满足预设要求包括:中晚孕目标特征结构在腹部标准切面上具有最大面积,或者,腹部标准切面经过中晚孕目标特征结构的中心点。In step S550, according to the target direction determined in step S530 and the information of the target feature structure of the second and third trimesters determined in step S540, at least one standard abdominal section of the fetus in the second and third trimesters is extracted from the three-dimensional ultrasound data. Specifically, a cut plane that forms a preset angle with the target direction and meets the preset requirements with the overlapping area with the target feature structure of the second and third trimesters can be determined as the standard abdomen cut plane. Exemplarily, the overlapping area with the target feature structure of the second and third trimesters meeting the preset requirements includes: the target feature structure of the second and third trimesters has the largest area on the standard abdominal section, or the standard section of the abdomen passes through the center point of the target feature structure of the second and third trimesters. .
对于不同的目标方向,上述预设角度不同。例如,腹围切面、脐带插入口切面、双肾横切面等身体区域的横切面平行或近似平行于身体区域前后方向或左右方向,即与前后方向或左右方向之间的预设角度约为0°;垂直或近似垂直于身体区域的上下方向,即与上下方向之间的预设角度约为90°。For different target directions, the above preset angles are different. For example, the transverse section of the body region such as the abdominal circumference section, the umbilical cord insertion incision section, and the bilateral kidney transverse section are parallel or approximately parallel to the anterior-posterior or left-right direction of the body area, that is, the preset angle with the anterior-posterior or left-right direction is about 0 °; perpendicular or approximately perpendicular to the up-down direction of the body area, that is, the preset angle with the up-down direction is about 90°.
在步骤S560中,所显示的腹部标准切面可以是步骤S550中提取的标准切面中的部分或全部标准切面。除了显示所提取的标准切面以外,还可以显示腹部标准切面的名称,此外,还可以显示从三维超声数据中检测出的中晚孕目标特征结构,中晚孕目标特征结构可以显示在中晚孕期胎儿的三维超声图像中,例如,显示包围中晚孕目标特征结构的ROI框或显示中晚孕目标特征结构的轮廓。In step S560, the displayed standard slices of the abdomen may be part or all of the standard slices extracted in step S550. In addition to displaying the extracted standard slices, the name of the abdominal standard slices can also be displayed. In addition, the target feature structures of the second and third trimesters detected from the 3D ultrasound data can also be displayed. In the three-dimensional ultrasound image of the fetus, for example, a ROI frame surrounding the target feature structure of the second and third trimesters is displayed or an outline showing the feature structure of the second and third trimester target is displayed.
本申请实施例还提供一种超声成像系统,用于实现上述的中晚孕期胎儿的超声成像方法500。该超声成像系统包括超声探头、发射/接收电路、存储器、处理器和显示器,存储器上存储有由处理器运行的计算机程序,该计算机程序在被处理器运行时执行中晚孕期胎儿的超声成像方法500的步骤。现在重新参照图1,该超声成像系统可以实现为如图1所示的超声成像系统100。如上所述,超声成像系统100可以包括超声探头110、发射/接收电路112、处理器114以及显示器116,各个部件的相关描述可以参照上文。Embodiments of the present application further provide an ultrasound imaging system for implementing the above-mentioned ultrasound imaging method 500 for a fetus in the second and third trimesters. The ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor and a display, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, an ultrasonic imaging method for a fetus in the second and third trimesters is executed 500 steps. Referring now back to FIG. 1 , the ultrasound imaging system may be implemented as ultrasound imaging system 100 as shown in FIG. 1 . As described above, the ultrasound imaging system 100 may include the ultrasound probe 110 , the transmit/receive circuit 112 , the processor 114 , and the display 116 , and the relevant descriptions of the various components can be referred to above.
当用于实现超声成像方法500时,发射/接收电路112用于激励所述超声探头110向中晚孕期胎儿发射超声波,并接收所述超声波的回波,以获得超声回波信号;处理器114用于:根据所述三维超声数据确定所述中晚孕期胎儿身体区域的目标方向;在所述三维超声数据中提取所述中晚孕期胎儿中晚孕目标特征结构的信息;根据所述目标方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面;显示器116用于显示该至少一个腹部股标准切面。When used to implement the ultrasonic imaging method 500, the transmitting/receiving circuit 112 is used to excite the ultrasonic probe 110 to transmit ultrasonic waves to the fetus in the second and third trimesters, and receive the echoes of the ultrasonic waves to obtain ultrasonic echo signals; the processor 114 It is used for: determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data; extracting the information about the target feature structure of the second and third trimester fetuses in the three-dimensional ultrasound data; according to the target direction Extracting at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data and the information on the target feature structure of the second and third trimesters; the display 116 is configured to display the at least one standard abdominal section.
以上仅描述了超声成像系统100各部件的主要功能,更多细节参见对中晚孕期胎儿的超声成像方法500进行的相关描述。Only the main functions of the components of the ultrasound imaging system 100 are described above. For more details, please refer to the related description of the ultrasound imaging method 500 for a fetus in the second and third trimesters.
本申请实施例的中晚孕期胎儿的超声成像方法500和超声成像系统根据中晚孕期胎儿的目标方向和中晚孕目标特征结构自动确定中晚孕期胎儿的腹部标准切面,无需医生逐一手动提取腹部标准切面,极大地优化了产前检查的工作流,有效地提升工作效率,并且能够提高所获取的腹部标准切面质量的稳定性,促进中晚孕结构筛查的推广与应用。The ultrasound imaging method 500 and the ultrasound imaging system of the fetus in the second and third trimesters of the present application automatically determine the standard abdominal section of the fetus in the second and third trimesters according to the target direction of the fetus in the second and third trimesters and the target feature structure of the second and third trimesters, without the need for doctors to manually extract the abdomen one by one. The standard section greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and can improve the stability of the quality of the obtained standard abdominal section, and promote the popularization and application of structural screening in the middle and late pregnancy.
下面,将参考图6描述根据本申请另一实施例的中晚孕期胎儿的超声成像方法。图6是本申请实施例的中晚孕期胎儿的超声成像方法600的一个示意性流程图。Hereinafter, an ultrasound imaging method for a fetus in the second and third trimesters according to another embodiment of the present application will be described with reference to FIG. 6 . FIG. 6 is a schematic flowchart of a method 600 for ultrasound imaging of a fetus in the second and third trimesters according to an embodiment of the present application.
如图6所示,本申请一个实施例的中晚孕期胎儿的超声成像方法600包括如下步骤:As shown in FIG. 6 , an ultrasound imaging method 600 of a fetus in the second and third trimesters according to an embodiment of the present application includes the following steps:
在步骤S610,向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;In step S610, transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving echoes of the ultrasonic waves to obtain ultrasonic echo signals;
在步骤S620,基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;In step S620, obtain three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
在步骤S630,从所述三维超声数据中检测至少两个不同的中晚孕目标特征结构的区域,所述至少两个不同的中晚孕目标特征结构包括以下至少两个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊;In step S630, at least two different regions of the second and third pregnancy target feature structures are detected from the three-dimensional ultrasound data, and the at least two different second and third trimester pregnancy target feature structures include at least two of the following: gastric bubbles, spine bones , liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder;
在步骤S640,确定与所述至少两个不同的中晚孕目标特征结构区域中每个中晚孕目标特征结构的区域均至少部分重合的至少一个切面,以作为所述中晚孕胎儿的至少一个腹部标准切面;In step S640, at least one section that at least partially overlaps with each of the at least two different regions of the second and third trimester target feature structures is determined as the at least one section of the second and third trimester fetuses. A standard section of the abdomen;
在步骤S650,显示所述至少一个腹部标准切面。In step S650, the at least one standard abdominal slice is displayed.
根据本申请实施例的中晚孕期胎儿的超声成像方法600中的步骤S610和步骤S620与参考图2描述的超声成像方法200中的步骤S210和步骤S220大体上类似,为了简洁,此处不再赘述相同的细节内容,以下主要对方法600中根据三维超声数据确定标准切面的方式进行详细描述。Steps S610 and S620 in the ultrasound imaging method 600 for a fetus in the second and third trimesters according to the embodiment of the present application are substantially similar to steps S210 and S220 in the ultrasound imaging method 200 described with reference to FIG. Repeating the same details, the following mainly describes in detail the manner in which the standard slice is determined according to the three-dimensional ultrasound data in the method 600 .
在步骤S630中,从三维超声数据中检测至少两个不同的中晚孕目标特征结构的区域包括:获取腹部标准切面的类型;从三维超声数据中检测与腹部标准切面的类型相对应的至少两个不同的中晚孕目标特征结构的区域。In step S630, detecting at least two different regions of target feature structures of the second and third trimesters from the three-dimensional ultrasound data includes: acquiring the type of the standard abdominal slice; detecting at least two regions corresponding to the type of the standard abdominal slice from the three-dimensional ultrasound data regions with different target feature structures in the second and third trimesters.
示例性地,中晚孕期胎儿的腹部标准切面包括以下至少一个:腹围切面、 脐带插入口切面、胆囊切面、双肾横切面、膀胱与双脐动脉切面。当腹部标准切面为腹围切面时,需要检测的中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉和下腔静脉;当腹部标准切面为脐带插入口切面时,需要检测的中晚孕目标特征结构包括以下至少一个:脐带插入处、脐带、脊柱骨、前腹壁和降主动脉;当腹部标准切面为膀胱与双脐动脉切面时,需要检测的中晚孕目标特征结构包括膀胱和脐动脉中的至少一个;当腹部标准切面为胆囊切面时,需要检测的中晚孕目标特征结构包括胆囊和脊柱骨中的至少一个;当腹部标准切面为双肾横切面时,需要检测的中晚孕目标特征结构包括双肾和脊柱骨中的至少一个。Exemplarily, the standard view of the abdomen of the fetus in the second and third trimesters includes at least one of the following: abdominal circumference view, umbilical cord insertion port view, gallbladder view, bilateral kidney transverse view, bladder and double umbilical artery view. When the standard abdominal section is the abdominal girth section, the target feature structures that need to be detected in the second and third trimesters include at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta and inferior vena cava; when the standard abdominal section is umbilical cord insertion When the oral view is used, the target feature structures of the second and third trimesters that need to be detected include at least one of the following: umbilical cord insertion, umbilical cord, spinal bone, anterior abdominal wall and descending aorta; when the standard abdominal view is the bladder and double umbilical arteries, the The target feature structure in the second and third trimesters includes at least one of the bladder and the umbilical artery; when the standard abdominal section is the gallbladder section, the target feature structure in the second and third trimesters to be detected includes at least one of the gallbladder and the spine; when the standard abdominal section is the double When the kidney is cross-sectioned, the target feature structures that need to be detected in the second and third trimesters include at least one of the kidneys and the spine.
在步骤S630中,可以采用任何合适的图像检测或分割方法确定中晚孕目标特征结构的位置。例如,可以采用传统的机器学习方法或深度学习方法,为与各个标准切面对应的特征结构训练一个机器学习模型,以用于确定该特征结构的位置。在模型训练之前,预先建立一个中晚孕期胎儿超声数据库,数据库中每一个三维超声数据均标记了胎儿的中晚孕目标特征结构的位置,例如其感兴趣区域框(ROI)或具体区域范围,之后采用传统机器学习方法或深度学习方法,学习一个最优映射函数,用于从中晚孕期胎儿的三维超声数据中获取中晚孕目标特征结构的感兴趣区域框(ROI)或具体区域范围,实现该中晚孕目标特征结构的检测或分割。In step S630, any suitable image detection or segmentation method can be used to determine the position of the feature structure of the target in the second and third trimesters. For example, a traditional machine learning method or a deep learning method can be used to train a machine learning model for the feature structure corresponding to each standard slice, so as to determine the position of the feature structure. Before model training, a fetal ultrasound database in the second and third trimesters is established in advance, and each 3D ultrasound data in the database marks the position of the fetal target feature structure in the second and third trimesters, such as its region of interest (ROI) or specific area range, Then, traditional machine learning methods or deep learning methods are used to learn an optimal mapping function, which is used to obtain the region of interest box (ROI) or specific area range of the target feature structure of the second and third trimesters from the three-dimensional ultrasound data of the fetus in the second and third trimesters. The detection or segmentation of the feature structure of the mid-late pregnancy target.
在步骤S640中,对于待提取的腹部标准切面,首先获取腹部标准切面的类型,确定与该腹部标准切面的类型对应的中晚孕目标特征结构,并从三维超声数据中检测与腹部标准切面的类型相对应的至少两个不同的中晚孕目标特征结构的区域。之后,再确定与所述至少两个不同的中晚孕目标特征结构均至少部分重合的切面,以作为该腹部标准切面的检测结果。具体地,可以确定与至少两个不同的中晚孕目标特征结构区域中每个中晚孕目标特征结构的区域均基本重合的一个切面,以作为标准切面。示例性地,与至少两个不同的中晚孕目标特征结构区域中每个中晚孕目标特征结构的区域均基本重合可以实现为经过至少两个中晚孕目标特征结构的中心点,或者至少两个中晚孕目标特征结构在所提取的腹部标准切面上具有最大的截面积,等等。可选地,为了使所得到的标准切面更加准确,也可以确定与三个或三个以上不同的中晚孕目标特征结构至少部分重合的切面,以作为腹部标准切面的检测结果。In step S640, for the standard abdominal slice to be extracted, first obtain the type of the standard abdominal slice, determine the target feature structure of the middle and late pregnancy corresponding to the type of the standard abdominal slice, and detect the difference between the standard slice and the abdominal slice from the three-dimensional ultrasound data. Types of regions corresponding to at least two different target features in the second and third trimesters. Afterwards, a section that at least partially overlaps with the at least two different target feature structures of the second and third trimesters is determined as the detection result of the standard section of the abdomen. Specifically, a cut plane substantially coincident with each of the regions of the at least two different mid-late pregnancy target feature structure regions may be determined as a standard cut plane. Exemplarily, substantially coincident with the area of each mid-late pregnancy target feature structure in at least two different mid-late pregnancy target feature structure regions can be realized as passing through the center point of at least two mid-late pregnancy target feature structures, or at least The two target feature structures in the second and third trimesters have the largest cross-sectional area on the extracted standard slices of the abdomen, and so on. Optionally, in order to make the obtained standard slices more accurate, slices that at least partially overlap with three or more different mid-late pregnancy target feature structures may be determined as the detection results of the standard slices of the abdomen.
在步骤S650中,所显示的腹部标准切面可以是步骤S640中提取的腹部标准切面中的部分或全部腹部标准切面。除了显示所提取的腹部标准切面以外,还可以显示腹部标准切面的名称,此外,还可以显示从三维超声数据中检测出的中晚孕目标特征结构,中晚孕目标特征结构可以显示在中晚孕期胎儿的三维超声图像中,例如,显示包围中晚孕目标特征结构的ROI框或显示中晚孕目标特征结构的轮廓。In step S650, the displayed abdominal standard slices may be part or all of the abdominal standard slices extracted in step S640. In addition to displaying the extracted standard abdominal slices, it can also display the name of the standard abdominal slices. In addition, it can also display the target feature structure of the second and third pregnancy detected from the 3D ultrasound data. The target feature structure of the second and third pregnancy can be displayed in the middle and late pregnancy In the three-dimensional ultrasound image of the fetus during pregnancy, for example, a ROI frame surrounding the target feature structure of the second and third trimesters is displayed or an outline showing the feature structure of the second and third trimester target is displayed.
本申请实施例还提供一种超声成像系统,用于实现上述的中晚孕期胎儿的超声成像方法600。该超声成像系统包括超声探头、发射/接收电路、存储器、处理器和显示器,存储器上存储有由处理器运行的计算机程序,该计算机程序在被处理器运行时执行中晚孕期胎儿的超声成像方法600的步骤。现在重新参照图1,该超声成像系统可以实现为如图1所示的超声成像系统100。如上所述,超声成像系统100可以包括超声探头110、发射/接收电路112、处理器114以及显示器116,各个部件的相关描述可以参照上文。Embodiments of the present application further provide an ultrasound imaging system for implementing the above-mentioned ultrasound imaging method 600 for a fetus in the second and third trimesters. The ultrasonic imaging system includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor and a display, wherein a computer program executed by the processor is stored in the memory, and when the computer program is executed by the processor, an ultrasonic imaging method for a fetus in the second and third trimesters is executed 600 steps. Referring now back to FIG. 1 , the ultrasound imaging system may be implemented as ultrasound imaging system 100 as shown in FIG. 1 . As described above, the ultrasound imaging system 100 may include the ultrasound probe 110 , the transmit/receive circuit 112 , the processor 114 , and the display 116 , and the relevant descriptions of the various components can be referred to above.
当用于实现超声成像方法600时,发射/接收电路112用于激励所述超声探头110向中晚孕期胎儿发射超声波,并接收所述超声波的回波,以获得超声回波信号;处理器114用于:基于超声回波信号获得中晚孕期胎儿的三维超声数据;在步骤S630,从三维超声数据中检测至少两个不同的中晚孕目标特征结构的区域,至少两个不同的中晚孕目标特征结构包括以下至少两个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊;在步骤S640,确定与至少两个不同的中晚孕目标特征结构区域中每个中晚孕目标特征结构的区域均至少部分重合的至少一个切面,以作为中晚孕胎儿的至少一个腹部标准切面;显示器116用于显示该至少一个腹部股标准切面。When used to implement the ultrasonic imaging method 600, the transmitting/receiving circuit 112 is used to excite the ultrasonic probe 110 to transmit ultrasonic waves to the fetus in the second and third trimester, and receive the echoes of the ultrasonic waves to obtain ultrasonic echo signals; the processor 114 Used for: obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signals; in step S630, detecting at least two different regions of the second and third trimester target feature structures from the three-dimensional ultrasound data, at least two different regions of the second trimester and third trimester pregnancy The target feature structure includes at least two of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, and gallbladder; in step S640 , determining at least one cut plane that at least partially overlaps with the region of each of the at least two different mid-late pregnancy target feature structure regions, as at least one abdominal standard cut plane of the second-late pregnancy fetus; the display 116 Used to display the at least one abdominal femoral standard slice.
以上仅描述了超声成像系统100各部件的主要功能,更多细节参见对中晚孕期胎儿的超声成像方法600进行的相关描述。Only the main functions of the components of the ultrasound imaging system 100 are described above. For more details, please refer to the related description of the ultrasound imaging method 600 for a fetus in the second and third trimesters.
本申请实施例的中晚孕期胎儿的超声成像方法600和超声成像系统根据中晚孕期胎儿的至少两个中晚孕目标特征结构自动确定中晚孕期胎儿的腹部标准切面,无需医生逐一手动提取腹部标准切面,极大地优化了产前检查的工作流,有效地提升工作效率,并且能够提高所获取的腹部标准切面质量的稳定性,促进中晚孕结构筛查的推广与应用。The ultrasound imaging method 600 for a fetus in the second and third trimesters and the ultrasound imaging system of the embodiments of the present application automatically determine the standard abdominal section of the fetus in the second and third trimesters according to at least two target feature structures of the fetus in the second and third trimesters, eliminating the need for a doctor to manually extract the abdomen one by one The standard section greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and can improve the stability of the quality of the obtained standard abdominal section, and promote the popularization and application of structural screening in the middle and late pregnancy.
此外,根据本申请实施例,还提供了一种计算机存储介质,在所述计算 机存储介质上存储了程序指令,在所述程序指令被计算机或处理器运行时用于执行本申请实施例的方法200、方法500或方法600的相应步骤。所述存储介质例如可以包括智能电话的存储卡、平板电脑的存储部件、个人计算机的硬盘、只读存储器(ROM)、可擦除可编程只读存储器(EPROM)、便携式紧致盘只读存储器(CD-ROM)、USB存储器、或者上述存储介质的任意组合。所述计算机可读存储介质可以是一个或多个计算机可读存储介质的任意组合。In addition, according to the embodiments of the present application, a computer storage medium is also provided, where program instructions are stored on the computer storage medium, and the program instructions are used to execute the methods of the embodiments of the present application when the program instructions are run by a computer or a processor 200. Corresponding steps of method 500 or method 600. The storage medium may include, for example, a memory card of a smartphone, a storage component of a tablet computer, a hard disk of a personal computer, read only memory (ROM), erasable programmable read only memory (EPROM), portable compact disk read only memory (CD-ROM), USB memory, or any combination of the above storage media. The computer-readable storage medium can be any combination of one or more computer-readable storage media.
此外,根据本申请实施例,还提供了一种计算机程序,该计算机程序可以存储在云端或本地的存储介质上。在该计算机程序被计算机或处理器运行时用于执行本申请实施例的中晚孕期胎儿的超声成像方法的相应步骤。In addition, according to the embodiments of the present application, a computer program is also provided, and the computer program can be stored in the cloud or on a local storage medium. When the computer program is run by a computer or a processor, it is used to execute the corresponding steps of the ultrasound imaging method for a fetus in the second and third trimesters of the embodiments of the present application.
基于上面的描述,根据本申请实施例的中晚孕期胎儿的超声成像方法和超声成像系统,能够根据单次采集的三维超声数据自动确定中晚孕期胎儿的腹部标准切面,无需医生逐一手动提取腹部标准切面,极大地优化了产前检查的工作流,有效地提升工作效率,并且能提升所获取的腹部标准切面质量的稳定性,促进中晚孕结构筛查的推广与应用。Based on the above description, according to the ultrasound imaging method and ultrasound imaging system of the fetus in the second and third trimesters of the present application, the standard abdominal section of the fetus in the second and third trimesters can be automatically determined according to the three-dimensional ultrasound data collected in a single time, without the need for a doctor to manually extract the abdomen one by one. The standard section greatly optimizes the workflow of prenatal examination, effectively improves work efficiency, and improves the stability of the quality of the obtained standard abdominal section, and promotes the popularization and application of structural screening in middle and late pregnancy.
尽管这里已经参考附图描述了示例实施例,应理解上述示例实施例仅仅是示例性的,并且不意图将本申请的范围限制于此。本领域普通技术人员可以在其中进行各种改变和修改,而不偏离本申请的范围和精神。所有这些改变和修改意在被包括在所附权利要求所要求的本申请的范围之内。Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above-described example embodiments are exemplary only, and are not intended to limit the scope of the application thereto. Various changes and modifications may be made therein by those of ordinary skill in the art without departing from the scope and spirit of the present application. All such changes and modifications are intended to be included within the scope of this application as claimed in the appended claims.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个设备,或一些特征可以忽略,或不执行。In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本申请的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未 详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. It will be understood, however, that the embodiments of the present application may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
类似地,应当理解,为了精简本申请并帮助理解各个发明方面中的一个或多个,在对本申请的示例性实施例的描述中,本申请的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该本申请的方法解释成反映如下意图:即所要求保护的本申请要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如相应的权利要求书所反映的那样,其发明点在于可以用少于某个公开的单个实施例的所有特征的特征来解决相应的技术问题。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本申请的单独实施例。Similarly, it is to be understood that in the description of the exemplary embodiments of the present application, various features of the present application are sometimes grouped together into a single embodiment, FIG. , or in its description. However, this method of application should not be construed as reflecting an intention that the claimed application requires more features than are expressly recited in each claim. Rather, as the corresponding claims reflect, the invention lies in the fact that the corresponding technical problem may be solved with less than all features of a single disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this application.
本领域的技术人员可以理解,除了特征之间相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。It will be understood by those skilled in the art that all features disclosed in this specification (including the accompanying claims, abstract and drawings) and any method or apparatus so disclosed may be used in any combination, except that the features are mutually exclusive. Processes or units are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本申请的范围之内并且形成不同的实施例。例如,在权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will appreciate that although some of the embodiments described herein include certain features, but not others, included in other embodiments, that combinations of features of different embodiments are intended to be within the scope of the present application within and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
本申请的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本申请实施例的一些模块的一些或者全部功能。本申请还可以实现为用于执行这里所描述的方法的一部分或者全部的装置程序(例如,计算机程序和计算机程序产品)。这样的实现本申请的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some modules according to the embodiments of the present application. The present application can also be implemented as a program of apparatus (eg, computer programs and computer program products) for performing part or all of the methods described herein. Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.
应该注意的是上述实施例对本申请进行说明而不是对本申请进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。本申请可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若 干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-described embodiments illustrate rather than limit the application, and alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The application can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.
以上所述,仅为本申请的具体实施方式或对具体实施方式的说明,本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。本申请的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present application or descriptions of the specific embodiments, and the protection scope of the present application is not limited thereto. Any changes or substitutions should be included within the protection scope of the present application. The protection scope of the present application shall be subject to the protection scope of the claims.

Claims (30)

  1. 一种中晚孕期胎儿的超声成像方法,其特征在于,所述方法包括:A method for ultrasound imaging of a fetus in the second and third trimester, characterized in that the method comprises:
    向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
    基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
    根据所述三维超声数据确定所述中晚孕期胎儿身体区域的长轴方向;determining the long-axis direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data;
    在所述三维超声数据中提取所述胎儿的中晚孕目标特征结构的信息,所述中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊;Extract information about the target feature structure of the fetus in the second and third trimesters from the three-dimensional ultrasound data, where the feature structure of the second trimester target includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta, inferior Vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder;
    根据所述中晚孕期胎儿身体区域的长轴方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面;Extracting at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data according to the long-axis direction of the fetal body region in the second and third trimesters and the information on the target feature structure of the second and third trimesters;
    显示所述至少一个腹部标准切面。The at least one abdominal standard slice is displayed.
  2. 根据权利要求1所述的方法,其特征在于,所述腹部标准切面包括以下至少一个:腹围切面、脐带插入口切面、胆囊切面、双肾横切面、膀胱与双脐动脉切面。The method according to claim 1, wherein the standard abdominal section includes at least one of the following: abdominal circumference section, umbilical cord insertion port section, gallbladder section, bilateral kidney transverse section, bladder and double umbilical artery section.
  3. 根据权利要求2所述的方法,其特征在于,当所述腹部标准切面为腹围切面时,所述中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉和下腔静脉;The method according to claim 2, characterized in that, when the standard abdominal section is an abdominal girth section, the target feature structure of the middle and late pregnancy includes at least one of the following: gastric bubble, spine bone, liver, umbilical vein, descending aorta and inferior vena cava;
    当所述腹部标准切面为脐带插入口切面时,所述中晚孕目标特征结构包括以下至少一个:脐带插入处、脐带、脊柱骨、前腹壁和降主动脉;When the standard abdominal cut plane is the cut plane of the umbilical cord insertion port, the target feature structure of the second and third pregnancy includes at least one of the following: the umbilical cord insertion site, the umbilical cord, the spine, the anterior abdominal wall and the descending aorta;
    当所述腹部标准切面为膀胱与双脐动脉切面时,所述中晚孕目标特征结构包括以下至少一个:膀胱、脐动脉;When the standard abdominal section is the section of the bladder and the double umbilical artery, the target characteristic structure of the second and third pregnancy includes at least one of the following: the bladder and the umbilical artery;
    当所述腹部标准切面为胆囊切面时,所述中晚孕目标特征结构包括胆囊、脊柱骨;When the standard abdominal section is the gallbladder section, the target characteristic structure of the second and third pregnancy includes the gallbladder and the spine;
    当所述腹部标准切面为双肾横切面时,所述中晚孕目标特征结构包括双肾、脊柱骨。When the standard abdominal section is a transverse section of both kidneys, the target characteristic structures of the second and third trimesters include both kidneys and spine bones.
  4. 根据权利要求1所述的方法,其特征在于,所述根据所述中晚孕期胎儿身体区域的长轴方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面,包括:The method according to claim 1, wherein the extracting the three-dimensional ultrasound data according to the long-axis direction of the fetal body region in the second and third trimesters and information on the target feature structure of the second and third trimesters At least one standard abdominal section of the fetus in the second and third trimesters, including:
    将与所述中晚孕期胎儿身体区域的长轴方向呈预设角度、并且与所述中晚孕目标特征结构的重合区域满足预设要求的切面确定为所述腹部标准切面。The cut plane that forms a preset angle with the long axis direction of the fetal body region in the second and third trimesters and meets the preset requirements with the overlapping region of the second and third trimester target feature structures is determined as the abdominal standard cut plane.
  5. 根据权利要求4所述的方法,其特征在于,所述与所述中晚孕目标特征结构的重合区域满足预设要求包括:The method according to claim 4, wherein the overlapping area with the target feature structure of the second and third trimester satisfies a preset requirement comprising:
    所述中晚孕目标特征结构在所述腹部标准切面上具有最大面积,或者,所述腹部标准切面经过所述中晚孕目标特征结构的中心点。The mid-late pregnancy target feature structure has the largest area on the abdominal standard section, or the abdominal standard section passes through the center point of the mid-late pregnancy target feature structure.
  6. 根据权利要求1所述的方法,其特征在于,所述根据所述三维超声数据确定所述中晚孕期胎儿身体区域的长轴方向,包括:The method according to claim 1, wherein the determining the long-axis direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data comprises:
    在所述三维超声数据中确定所述中晚孕期胎儿的脊柱区域;determining the spinal region of the fetus in the second and third trimesters in the three-dimensional ultrasound data;
    根据所述脊柱区域的方向确定所述中晚孕期胎儿身体区域的长轴方向。The direction of the long axis of the fetal body region in the second and third trimesters is determined according to the direction of the spine region.
  7. 根据权利要求6所述的方法,其特征在于,所述在所述三维超声数据中确定所述中晚孕期胎儿的脊柱区域,包括:The method according to claim 6, wherein the determining, in the three-dimensional ultrasound data, the spine region of the fetus in the second and third trimesters comprises:
    在所述三维超声数据的多个二维切面图像中对所述脊柱区域进行分割;segmenting the spine region in a plurality of two-dimensional slice images of the three-dimensional ultrasound data;
    综合多个所述二维切面图像上所述脊柱区域的分割结果,以得到所述脊柱区域在所述三维超声图像中的三维分割结果。The segmentation results of the spine region on a plurality of the two-dimensional slice images are integrated to obtain a three-dimensional segmentation result of the spine region in the three-dimensional ultrasound image.
  8. 根据权利要求7所述的方法,其特征在于,所述三维超声数据的多个二维切面图像为所述三维超声数据中的所有二维切面图像,或者,The method according to claim 7, wherein the plurality of 2D slice images of the 3D ultrasound data are all 2D slice images in the 3D ultrasound data, or,
    所述三维超声数据的多个二维切面为对所述三维超声数据中以预设规则进行采样以得到的采样图像,所述综合多个所述二维切面上的所述脊柱区域的分割结果包括:对所述采样图像的分割结果进行三维插值,以得到所述脊柱区域的三维分割结果。The multiple two-dimensional slices of the three-dimensional ultrasound data are sampled images obtained by sampling the three-dimensional ultrasound data with a preset rule, and the integration of the segmentation results of the spine region on the multiple two-dimensional slices The method includes: performing three-dimensional interpolation on the segmentation result of the sampled image, so as to obtain the three-dimensional segmentation result of the spine region.
  9. 根据权利要求6所述的方法,其特征在于,所述在所述三维超声数据中确定所述中晚孕期胎儿的脊柱区域,包括:The method according to claim 6, wherein the determining, in the three-dimensional ultrasound data, the spine region of the fetus in the second and third trimesters comprises:
    对所述三维超声数据进行三维分割,以得到所述脊柱区域的三维分割结果。Three-dimensional segmentation is performed on the three-dimensional ultrasound data to obtain a three-dimensional segmentation result of the spine region.
  10. 根据权利要求1所述的方法,其特征在于,所述根据所述三维超声数据确定所述中晚孕期胎儿身体区域的长轴方向,包括:The method according to claim 1, wherein the determining the long-axis direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data comprises:
    在所述三维超声数据中确定所述中晚孕期胎儿的身体区域;determining the body region of the fetus in the second and third trimesters in the three-dimensional ultrasound data;
    将所述身体区域的长轴方向确定为所述中晚孕期胎儿身体区域的长轴方向。The long-axis direction of the body region is determined as the long-axis direction of the fetal body region in the second and third trimesters.
  11. 根据权利要求10所述的方法,其特征在于,所述在所述三维超声数据中确定所述中晚孕期胎儿的身体区域包括:The method according to claim 10, wherein the determining the body region of the fetus in the second and third trimesters in the three-dimensional ultrasound data comprises:
    在所述三维超声数据的多个二维切面图像中对所述身体区域进行分割;segmenting the body region in a plurality of two-dimensional slice images of the three-dimensional ultrasound data;
    综合多个所述二维切面图像上所述身体区域的分割结果,以得到所述身体区域在所述三维超声图像中的三维分割结果。The segmentation results of the body region on a plurality of the 2D slice images are integrated to obtain a 3D segmentation result of the body region in the 3D ultrasound image.
  12. 根据权利要求10所述的方法,其特征在于,所述在所述三维超声数据中确定所述中晚孕期胎儿的身体区域包括:The method according to claim 10, wherein the determining the body region of the fetus in the second and third trimesters in the three-dimensional ultrasound data comprises:
    对所述三维超声数据进行三维分割,以得到所述身体区域的三维分割结果。Three-dimensional segmentation is performed on the three-dimensional ultrasound data to obtain a three-dimensional segmentation result of the body region.
  13. 根据权利要求1所述的方法,其特征在于,所述根据所述三维超声数据确定所述中晚孕期胎儿身体区域的长轴方向,包括:The method according to claim 1, wherein the determining the long-axis direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data comprises:
    接收确定所述长轴方向的用户指令,根据所述用户指令确定所述中晚孕期胎儿身体区域的长轴方向。A user instruction for determining the long-axis direction is received, and the long-axis direction of the fetal body region in the second and third trimesters is determined according to the user instruction.
  14. 根据权利要求1所述的方法,其特征在于,所述在所述三维超声数据中提取所述中晚孕期胎儿中晚孕目标特征结构的信息,包括:The method according to claim 1, wherein the extracting information on the target feature structure of the fetus in the second and third trimesters from the three-dimensional ultrasound data comprises:
    利用预先训练的目标检测网络提取所述三维超声数据中的所述中晚孕目标特征结构;Use a pre-trained target detection network to extract the feature structure of the second- and late-pregnancy target in the three-dimensional ultrasound data;
    或者,根据中晚孕目标特征结构的形态特征在所述三维超声数据中确定至少一个候选特征结构,利用分类器判定所述候选特征结构的类别,并根据所述候选特征结构的类别在所述候选特征结构中确定所述中晚孕目标特征结构。Alternatively, at least one candidate feature structure is determined in the three-dimensional ultrasound data according to the morphological feature of the feature structure of the second-late pregnancy target, and a classifier is used to determine the category of the candidate feature structure, and according to the category of the candidate feature structure, the The target feature structure of the middle and late pregnancy is determined in the candidate feature structure.
  15. 根据权利要求1所述的方法,其特征在于,所述方法还包括:接收确定所述腹部标准切面的提取范围的用户指令,根据所述用户指令确定所述提取范围,并在所述提取范围内提取所述腹部标准切面。The method according to claim 1, characterized in that the method further comprises: receiving a user instruction for determining the extraction range of the abdominal standard slice, determining the extraction range according to the user instruction, and performing the extraction in the extraction range Extract the standard section of the abdomen.
  16. 根据权利要求1所述的方法,其特征在于,所述方法还包括以下至少一项:显示所述腹部标准切面中的所述中晚孕目标特征结构所在的位置、显示所述长轴方向。The method according to claim 1, characterized in that, the method further comprises at least one of the following: displaying the position of the target feature structure of the middle and late pregnancy in the standard abdominal section, and displaying the long axis direction.
  17. 一种中晚孕期胎儿的超声成像方法,其特征在于,所述方法包括:A method for ultrasound imaging of a fetus in the second and third trimester, characterized in that the method comprises:
    向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
    基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
    根据所述三维超声数据确定所述中晚孕期胎儿身体区域的目标方向;determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data;
    在所述三维超声数据中提取所述中晚孕期胎儿中晚孕目标特征结构的信息;extracting information about the target feature structure of the second- and third-trimester fetuses from the three-dimensional ultrasound data;
    根据所述目标方向和所述中晚孕目标特征结构的信息,从所述三维超声数据中提取所述中晚孕期胎儿的至少一个腹部标准切面;extracting at least one standard abdominal section of the fetus in the second and third trimesters from the three-dimensional ultrasound data according to the target direction and the information on the target feature structure of the second and third trimesters;
    显示所述至少一个腹部标准切面。The at least one abdominal standard slice is displayed.
  18. 根据权利要求17所述的方法,其特征在于,所述根据所述三维超声 数据确定所述中晚孕期胎儿身体区域的目标方向包括:The method according to claim 17, wherein the determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data comprises:
    在所述三维超声数据中确定所述中晚孕期胎儿的脊柱区域,根据所述脊柱区域的方向确定所述中晚孕期胎儿身体区域的第一方向;determining the spine region of the fetus in the second and third trimesters in the three-dimensional ultrasound data, and determining the first direction of the body region of the second and third trimester fetuses according to the direction of the spine region;
    或者,在所述三维超声数据中确定所述中晚孕期胎儿的身体区域,将所述身体区域的长轴方向确定为所述中晚孕期胎儿身体区域的目标方向。Alternatively, the body region of the fetus in the second and third trimesters is determined in the three-dimensional ultrasound data, and the long axis direction of the body region is determined as the target direction of the body region of the fetus in the second and third trimesters.
  19. 根据权利要求17所述的方法,其特征在于,所述根据所述三维超声数据确定所述中晚孕期胎儿身体区域的目标方向包括:The method according to claim 17, wherein the determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data comprises:
    在所述三维超声数据中确定所述中晚孕期胎儿的对称特征结构的区域,并将对称特征结构的区域连线的方向确定为所述中晚孕期胎儿身体区域的目标方向。In the three-dimensional ultrasound data, the region of the symmetrical feature structure of the fetus in the second and third trimesters is determined, and the direction of the line connecting the regions of the symmetrical feature structure is determined as the target direction of the fetal body region in the second and third trimester.
  20. 根据权利要求17所述的方法,其特征在于,所述根据所述三维超声数据确定所述中晚孕期胎儿身体区域的目标方向包括:The method according to claim 17, wherein the determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data comprises:
    在所述三维超声数据中提取与所述第一方向相垂直的至少一个身体区域横切面;extracting at least one body region transverse plane perpendicular to the first direction in the three-dimensional ultrasound data;
    检测所述身体区域横切面中身体区域中心点与脊柱的位置,并将所述身体区域中心点与所述脊柱的位置的连线方向确定为所述中晚孕期胎儿身体区域的目标方向。Detecting the position of the center point of the body region and the spine in the cross section of the body region, and determining the direction of the line connecting the center point of the body region and the position of the spine as the target direction of the fetal body region in the second and third trimesters.
  21. 根据权利要求17所述的方法,其特征在于,所述根据所述三维超声数据确定所述中晚孕期胎儿身体区域的目标方向包括:The method according to claim 17, wherein the determining the target direction of the fetal body region in the second and third trimesters according to the three-dimensional ultrasound data comprises:
    在所述三维超声数据中确定所述中晚孕期胎儿的脊柱区域,确定贴近所述脊柱区域的曲线,并将所述曲线的凸起方向确定为所述中晚孕期胎儿身体区域的目标方向。The spine region of the fetus in the second and third trimesters is determined from the three-dimensional ultrasound data, a curve close to the spine region is determined, and the convex direction of the curve is determined as the target direction of the fetal body region in the second and third trimesters.
  22. 一种中晚孕期胎儿的超声成像方法,其特征在于,所述方法包括:A method for ultrasound imaging of a fetus in the second and third trimester, characterized in that the method comprises:
    向中晚孕期胎儿发射超声波,接收所述超声波的回波,以获得超声回波信号;transmitting ultrasonic waves to the fetus in the second and third trimesters, and receiving the echoes of the ultrasonic waves to obtain ultrasonic echo signals;
    基于所述超声回波信号获得所述中晚孕期胎儿的三维超声数据;obtaining three-dimensional ultrasound data of the fetus in the second and third trimesters based on the ultrasound echo signal;
    从所述三维超声数据中检测至少两个不同的中晚孕目标特征结构的区域,所述至少两个不同的中晚孕目标特征结构包括以下至少两个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉、下腔静脉、脐带插入处、脐带、前腹壁、膀胱、双腿、脐动脉、胆囊;Detect regions of at least two different mid-late pregnancy target feature structures from the three-dimensional ultrasound data, the at least two different mid-late pregnancy target feature structures include at least two of the following: gastric vesicles, spine bones, liver, umbilicus Veins, descending aorta, inferior vena cava, umbilical cord insertion, umbilical cord, anterior abdominal wall, bladder, legs, umbilical artery, gallbladder;
    确定与所述至少两个不同的中晚孕目标特征结构区域中每个中晚孕目标特征结构的区域均至少部分重合的至少一个切面,以作为所述中晚孕胎儿的至少一个腹部标准切面;Determining at least one cut plane that at least partially overlaps with the region of each of the at least two different mid-late pregnancy target feature structure regions, as at least one abdominal standard cut plane of the second-late pregnancy fetus ;
    显示所述至少一个腹部标准切面。The at least one abdominal standard slice is displayed.
  23. 根据权利要求22所述的方法,其特征在于,所述从所述三维超声数据中检测至少两个不同的中晚孕目标特征结构的区域包括:The method according to claim 22, wherein the detecting from the three-dimensional ultrasound data at least two different regions of the target feature structure of the second and third trimesters comprises:
    获取腹部标准切面的类型;Get the type of standard abdominal section;
    从所述三维超声数据中检测与所述腹部标准切面的类型相对应的至少两个不同的中晚孕目标特征结构的区域。Regions of at least two different mid-late pregnancy target feature structures corresponding to the type of the abdominal standard slice are detected from the three-dimensional ultrasound data.
  24. 根据权利要求22所述的方法,其特征在于,所述方法还包括:The method of claim 22, wherein the method further comprises:
    显示所述至少两个不同的中晚孕目标特征结构的区域。Regions showing the at least two distinct mid- to late-trimester target features.
  25. 根据权利要求22所述的方法,其特征在于,所述确定与所述至少两个不同的中晚孕目标特征结构区域中每个所述中晚孕目标特征结构的区域均至少部分重合的至少一个切面,以作为所述中晚孕期胎儿的至少一个腹部标准切面,包括:23. The method of claim 22, wherein the determining of at least a region of the at least two different second and third trimester target feature structure regions that at least partially overlaps One slice, as at least one standard slice of the abdomen of the fetus in the second and third trimesters, including:
    确定与所述至少两个不同的中晚孕目标特征结构区域中每个所述中晚孕目标特征结构的区域均基本重合的一个切面,以作为所述中晚孕孕期胎儿的一个腹部标准切面。Determining a section that is substantially coincident with each of the at least two different regions of the target feature structure in the second and third trimesters, as a standard section of the abdomen of the fetus in the second and third trimesters .
  26. 根据权利要求22所述的方法,其特征在于,所述腹部标准切面包括以下至少一个:腹围切面、脐带插入口切面、胆囊切面、双肾横切面、膀胱与双脐动脉切面。The method according to claim 22, wherein the standard abdominal section includes at least one of the following: abdominal girth section, umbilical cord insertion port section, gallbladder section, bilateral kidney transverse section, bladder and double umbilical artery section.
  27. 根据权利要求26所述的方法,其特征在于,当所述腹部标准切面为腹围切面时,所述中晚孕目标特征结构包括以下至少一个:胃泡、脊柱骨、肝脏、脐静脉、降主动脉和下腔静脉;The method according to claim 26, characterized in that, when the standard abdominal section is an abdominal girth section, the target feature structure of the middle and late pregnancy includes at least one of the following: gastric vesicle, spinal bone, liver, umbilical vein, descending aorta and inferior vena cava;
    当所述腹部标准切面为脐带插入口切面时,所述中晚孕目标特征结构包括以下至少一个:脐带插入处、脐带、脊柱骨、前腹壁和降主动脉;When the standard abdominal cut plane is the cut plane of the umbilical cord insertion port, the target feature structure of the second and third pregnancy includes at least one of the following: the umbilical cord insertion site, the umbilical cord, the spine, the anterior abdominal wall and the descending aorta;
    当所述腹部标准切面为膀胱与双脐动脉切面时,所述中晚孕目标特征结构包括以下至少一个:膀胱、脐动脉;When the standard abdominal section is the section of the bladder and the double umbilical artery, the target characteristic structure of the second and late pregnancy includes at least one of the following: the bladder and the umbilical artery;
    当所述腹部标准切面为胆囊切面时,所述中晚孕目标特征结构包括胆囊、脊柱骨;When the standard abdominal section is the gallbladder section, the target characteristic structure of the second and third pregnancy includes the gallbladder and the spine;
    当所述腹部标准切面为双肾横切面时,所述中晚孕目标特征结构包括双肾、脊柱骨。When the standard abdominal section is a transverse section of both kidneys, the target characteristic structures of the second and third trimesters include both kidneys and spine bones.
  28. 一种超声成像系统,其特征在于,包括超声探头、发射/接收电路、存储器、处理器和显示器,所述存储器上存储有由所述处理器运行的计算机程序,所述计算机程序在被所述处理器运行时执行权利要求1-16中任一项所述的中晚孕期胎儿的超声成像方法的步骤。An ultrasonic imaging system, characterized in that it includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, wherein the memory stores a computer program run by the processor, and the computer program is executed by the processor. The processor executes the steps of the method for ultrasound imaging of the fetus in the second and third trimesters of any one of claims 1-16 when the processor is running.
  29. 一种超声成像系统,其特征在于,包括超声探头、发射/接收电路、存储器、处理器和显示器,所述存储器上存储有由所述处理器运行的计算机程序,所述计算机程序在被所述处理器运行时执行权利要求17-21中任一项所述的中晚孕期胎儿的超声成像方法的步骤。An ultrasonic imaging system, characterized in that it includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, wherein the memory stores a computer program run by the processor, and the computer program is executed by the processor. The processor executes the steps of the method for ultrasound imaging of a fetus in the second and third trimesters of any one of claims 17-21 when the processor is running.
  30. 一种超声成像系统,其特征在于,包括超声探头、发射/接收电路、存储器、处理器和显示器,所述存储器上存储有由所述处理器运行的计算机程序,所述计算机程序在被所述处理器运行时执行权利要求22-27中任一项所述的中晚孕期胎儿的超声成像方法的步骤。An ultrasonic imaging system, characterized in that it includes an ultrasonic probe, a transmitting/receiving circuit, a memory, a processor, and a display, wherein the memory stores a computer program run by the processor, and the computer program is executed by the processor. The processor executes the steps of the method for ultrasound imaging of a fetus in the second and third trimesters of any one of claims 22-27 when the processor is running.
PCT/CN2020/129099 2020-11-16 2020-11-16 Ultrasonic imaging method and ultrasonic imaging system of fetus in middle and late pregnancy WO2022099704A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080105560.7A CN116322521A (en) 2020-11-16 2020-11-16 Ultrasonic imaging method and ultrasonic imaging system for midnight pregnancy fetus
PCT/CN2020/129099 WO2022099704A1 (en) 2020-11-16 2020-11-16 Ultrasonic imaging method and ultrasonic imaging system of fetus in middle and late pregnancy

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/129099 WO2022099704A1 (en) 2020-11-16 2020-11-16 Ultrasonic imaging method and ultrasonic imaging system of fetus in middle and late pregnancy

Publications (1)

Publication Number Publication Date
WO2022099704A1 true WO2022099704A1 (en) 2022-05-19

Family

ID=81602062

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/129099 WO2022099704A1 (en) 2020-11-16 2020-11-16 Ultrasonic imaging method and ultrasonic imaging system of fetus in middle and late pregnancy

Country Status (2)

Country Link
CN (1) CN116322521A (en)
WO (1) WO2022099704A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116362548A (en) * 2023-04-19 2023-06-30 江苏久和机械有限公司 Standard knot availability management method, system, device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103955698A (en) * 2014-03-12 2014-07-30 深圳大学 Method for automatically positioning standard tangent plane from ultrasonic image
CN110742654A (en) * 2019-11-05 2020-02-04 深圳度影医疗科技有限公司 Method for positioning and measuring standard tangent plane based on three-dimensional ultrasonic image
US20200155114A1 (en) * 2018-11-15 2020-05-21 Samsung Medison Co., Ltd. Ultrasound diagnosis apparatus for determining abnormality of fetal heart, and operating method thereof
CN111368586A (en) * 2018-12-25 2020-07-03 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic imaging method and system
US20200261053A1 (en) * 2019-02-15 2020-08-20 Samsung Medison Co., Ltd. Method and apparatus for displaying ultrasound image and computer program product

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103955698A (en) * 2014-03-12 2014-07-30 深圳大学 Method for automatically positioning standard tangent plane from ultrasonic image
US20200155114A1 (en) * 2018-11-15 2020-05-21 Samsung Medison Co., Ltd. Ultrasound diagnosis apparatus for determining abnormality of fetal heart, and operating method thereof
CN111368586A (en) * 2018-12-25 2020-07-03 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic imaging method and system
US20200261053A1 (en) * 2019-02-15 2020-08-20 Samsung Medison Co., Ltd. Method and apparatus for displaying ultrasound image and computer program product
CN110742654A (en) * 2019-11-05 2020-02-04 深圳度影医疗科技有限公司 Method for positioning and measuring standard tangent plane based on three-dimensional ultrasonic image

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116362548A (en) * 2023-04-19 2023-06-30 江苏久和机械有限公司 Standard knot availability management method, system, device and storage medium
CN116362548B (en) * 2023-04-19 2023-10-31 江苏久和机械有限公司 Standard knot availability management method, system, device and storage medium

Also Published As

Publication number Publication date
CN116322521A (en) 2023-06-23

Similar Documents

Publication Publication Date Title
RU2657855C2 (en) Three-dimensional ultrasound imaging system
WO2018129737A1 (en) Method for measuring parameters in ultrasonic image and ultrasonic imaging system
US20110201935A1 (en) 3-d ultrasound imaging
US11521363B2 (en) Ultrasonic device, and method and system for transforming display of three-dimensional ultrasonic image thereof
US11931201B2 (en) Device and method for obtaining anatomical measurements from an ultrasound image
EP3621524B1 (en) Fetal development monitoring
WO2018195946A1 (en) Method and device for displaying ultrasonic image, and storage medium
US20210393240A1 (en) Ultrasonic imaging method and device
KR102063374B1 (en) Automatic alignment of ultrasound volumes
JP2020527080A (en) Fetal ultrasound image processing
US11534133B2 (en) Ultrasonic detection method and ultrasonic imaging system for fetal heart
WO2022099705A1 (en) Early-pregnancy fetus ultrasound imaging method and ultrasound imaging system
WO2022099704A1 (en) Ultrasonic imaging method and ultrasonic imaging system of fetus in middle and late pregnancy
WO2022133806A1 (en) Fetal face volume image inpainting method and ultrasound imaging system
CN113229850A (en) Ultrasonic pelvic floor imaging method and ultrasonic imaging system
CN116763347A (en) Fetal head direction angle measuring method based on ultrasonic image and related device
CN115886877A (en) Guiding method for ultrasonic scanning and ultrasonic imaging system
WO2020133236A1 (en) Spinal imaging method and ultrasonic imaging system
JP5302761B2 (en) Ultrasonic diagnostic equipment
WO2022134049A1 (en) Ultrasonic imaging method and ultrasonic imaging system for fetal skull
JP2016140588A (en) Ultrasonic diagnostic apparatus
CN113974688B (en) Ultrasonic imaging method and ultrasonic imaging system
CN117814840A (en) Ultrasonic imaging method and ultrasonic imaging system for early pregnancy fetus
CN115886876A (en) Fetal posture evaluation method, ultrasonic imaging method and ultrasonic imaging system
CN116327237A (en) Ultrasonic imaging system and method, ultrasonic image processing system and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20961258

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20961258

Country of ref document: EP

Kind code of ref document: A1