CN117557591A - Contour editing method based on ultrasonic image and ultrasonic imaging system - Google Patents
Contour editing method based on ultrasonic image and ultrasonic imaging system Download PDFInfo
- Publication number
- CN117557591A CN117557591A CN202210933480.1A CN202210933480A CN117557591A CN 117557591 A CN117557591 A CN 117557591A CN 202210933480 A CN202210933480 A CN 202210933480A CN 117557591 A CN117557591 A CN 117557591A
- Authority
- CN
- China
- Prior art keywords
- contour
- target tissue
- controllable
- cursor
- points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000003384 imaging method Methods 0.000 title abstract description 12
- 230000004044 response Effects 0.000 claims abstract description 51
- 230000008859 change Effects 0.000 claims abstract description 17
- 238000002604 ultrasonography Methods 0.000 claims description 108
- 239000000523 sample Substances 0.000 claims description 23
- 230000005540 biological transmission Effects 0.000 claims description 17
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 230000004323 axial length Effects 0.000 claims description 13
- 238000005259 measurement Methods 0.000 claims description 12
- 238000010801 machine learning Methods 0.000 claims description 8
- 238000012285 ultrasound imaging Methods 0.000 claims description 8
- 238000003708 edge detection Methods 0.000 claims description 5
- 210000000056 organ Anatomy 0.000 description 23
- 238000012545 processing Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 238000006073 displacement reaction Methods 0.000 description 8
- 238000001514 detection method Methods 0.000 description 7
- 230000008901 benefit Effects 0.000 description 6
- 238000002592 echocardiography Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 210000003754 fetus Anatomy 0.000 description 4
- 239000003550 marker Substances 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000000877 morphologic effect Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000007637 random forest analysis Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 210000004291 uterus Anatomy 0.000 description 2
- 206010008342 Cervix carcinoma Diseases 0.000 description 1
- 206010020880 Hypertrophy Diseases 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- 208000006105 Uterine Cervical Neoplasms Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 201000010881 cervical cancer Diseases 0.000 description 1
- 210000003679 cervix uteri Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 210000003734 kidney Anatomy 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000002243 precursor Substances 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000004579 scanning voltage microscopy Methods 0.000 description 1
- 210000002784 stomach Anatomy 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/181—Segmentation; Edge detection involving edge growing; involving edge linking
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
- A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
- A61B8/469—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means for selection of a region of interest
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
Abstract
The contour editing method based on the ultrasonic image and the ultrasonic imaging system provide a new contour editing scheme based on the ultrasonic image, the contour of the target tissue is obtained and displayed on the ultrasonic image, contour points meeting preset conditions are set as controllable anchor points in response to a controllable anchor point selection instruction, and the controllable anchor points are displayed on the ultrasonic image; the contour points are points obtained after the contour of the target tissue is discretized, the controllable anchor points are moved in response to user operation so as to change the positions of the controllable anchor points, and the contour of the target tissue displayed on the ultrasonic image is updated in real time according to the position-updated controllable anchor points; the contour editing scheme based on the ultrasonic image can improve the fineness and accuracy of contour editing.
Description
Technical Field
The invention relates to the field of ultrasonic imaging, in particular to an outline editing method based on an ultrasonic image and an ultrasonic imaging system.
Background
The ultrasonic imaging device is generally used for observing the internal tissue structure of a human body by a doctor, and the doctor places an ultrasonic probe on the external surface of the human body corresponding to the organ of the human body so as to obtain an ultrasonic image of the organ. Because of the characteristics of safety, convenience, no damage, low cost and the like, the ultrasonic equipment has become one of main auxiliary means for doctor diagnosis, and provides important reference information for clinical decision.
Ultrasonic imaging technology is widely used for evaluating the morphology and the function of various organs in clinic at present, wherein the morphology and the size information of human tissue organs are important indexes for measuring whether the organs are diseased or not; taking obstetrical field as an example, the morphological measurement of each organ of the fetus plays an important role in monitoring the growth and development of the organs of the fetus, and the morphologies of the organs such as the heart, the kidney and the stomach of the fetus can be used for judging whether the fetus has abnormal development and evaluating the functions of the organs; taking the gynaecologic field as an example, the morphological and dimensional measurement information of uterus, uterus and cervix is an important diagnostic basis for judging cervical hypertrophy, gong Gengji tumor, cervical insufficiency and cervical cancer.
There is still a need in the art for improvements in this regard in that, after ultrasound imaging of the organ or other tissue, the edge contours of the organ and tissue need to be acquired and possibly further manual editing of the edge contours of the organ and tissue is required.
Disclosure of Invention
In view of the above problems, the present invention provides an ultrasound image-based contour editing method and an ultrasound imaging system, which are described in detail below.
According to a first aspect, in one embodiment, there is provided an ultrasound image-based contour editing method, including:
displaying an ultrasound image of the target tissue;
acquiring the outline of the target tissue and displaying the outline of the target tissue on the ultrasonic image;
responding to a controllable anchor point selection instruction, setting a contour point nearest to a cursor as a controllable anchor point, and displaying the controllable anchor point on the ultrasonic image; wherein the contour points are points obtained after the contour of the target tissue is discretized;
capturing the movement of a cursor on the ultrasonic image, and controlling the controllable anchor point to correspondingly move along with the cursor on the ultrasonic image so as to change the position of the controllable anchor point;
and updating the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor points with updated positions.
In an embodiment, the setting the contour point closest to the cursor as the controllable anchor point includes: and setting one contour point nearest to the cursor as a controllable anchor point.
In an embodiment, the setting the contour point closest to the cursor as the controllable anchor point includes:
acquiring the current coordinate position of a cursor;
acquiring the coordinate position of each contour point;
and calculating the distance between each contour point and the cursor and comparing the calculated distances to obtain the contour point closest to the cursor.
In an embodiment, the displaying the controllable anchor on the ultrasound image includes: and displaying the controllable anchor point on the ultrasonic image by a preset mark.
In one embodiment, after the controllable anchor point is set, auxiliary information is also displayed on the ultrasound image; the auxiliary information includes at least one of: the coordinate system, the network line, the current coordinate position of controllable anchor point, the real-time coordinate position of cursor.
In an embodiment, the updating, in real time, the outline of the target tissue displayed on the ultrasound image according to the location updated controllable anchor point includes:
and performing interpolation operation according to the coordinate positions of the controllable anchor points and the coordinate positions of other contour points after the position updating, and fitting out a new contour of the target tissue to update the contour of the target tissue.
In one embodiment, in response to a contour editing instruction, a contour editing mode is entered; in the contour editing mode, a contour point nearest to a cursor can be set as a controllable anchor point in response to a controllable anchor point selection instruction;
And responding to an exit instruction, exiting the contour editing mode, and taking the updated contour of the target tissue as the final contour of the target tissue for subsequent measurement.
In one embodiment, the contour editing method further includes: generating at least one axial length of the target tissue according to the outline of the target tissue and displaying the axial length on the ultrasonic image;
and updating the axial length in real time after the contour of the target tissue is updated.
In one embodiment, the acquiring the contour of the target tissue includes:
acquiring a curve or a plurality of mark points input by a user on the ultrasonic image, and generating the outline of the target tissue in the ultrasonic image according to the curve or the plurality of mark points;
or,
acquiring a search area input by a user on the ultrasonic image, and detecting in the search area through an edge detection algorithm to obtain the outline of the target tissue in the ultrasonic image;
or,
a model trained by machine learning is acquired and contours of the target tissue are segmented from the ultrasound image based on the model.
In an embodiment, after the outline of the target tissue is displayed on the ultrasound image, the outline of the target tissue is selected in response to an outline selection instruction, so that the outline of the selected target tissue can be discretized in response to a controllable anchor point selection instruction, and the outline point closest to the cursor is set as the controllable anchor point.
According to a second aspect, an embodiment provides an ultrasound image-based contour editing method, including:
displaying an ultrasound image of the target tissue;
acquiring the outline of the target tissue and displaying the outline of the target tissue on the ultrasonic image;
setting contour points meeting preset conditions as controllable anchor points in response to a controllable anchor point selection instruction, and displaying the controllable anchor points on the ultrasonic image; wherein the contour points are points obtained after the contour of the target tissue is discretized;
responding to user operation, moving the controllable anchor point to change the position of the controllable anchor point;
and updating the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor points with updated positions.
In an embodiment, the setting the contour point satisfying the preset condition as the controllable anchor point includes:
capturing the position of a cursor, and setting a first number of contour points closest to the cursor as controllable anchor points;
or,
capturing the position of a cursor, and setting contour points with the distance from the cursor smaller than a threshold value as controllable anchor points.
In one embodiment, the first number is 1, 2, 3, or 4.
In one embodiment, the moving the controllable anchor in response to a user operation includes:
Capturing movement of a cursor, and controlling the controllable anchor point to correspondingly move along with the cursor; or,
responding to clicking of a cursor, and acquiring the clicking position of the cursor; moving the controllable anchor point to the clicking position of the cursor; or,
responding to a movement command, and moving the controllable anchor point by a preset distance according to the direction indicated by the movement command; or,
and acquiring an input coordinate position, and moving the controllable anchor point to the coordinate position.
In one embodiment, after the controllable anchor point is set, auxiliary information is also displayed on the ultrasound image; the auxiliary information includes at least one of: the coordinate system, the network line, the current coordinate position of controllable anchor point, the real-time coordinate position of cursor.
In an embodiment, after the outline of the target tissue is displayed on the ultrasound image, the outline of the target tissue is selected in response to an outline selection instruction, so that the outline of the selected target tissue can be discretized in response to a controllable anchor point selection instruction, and among outline points obtained after the outline of the selected target tissue is discretized, the outline point meeting a preset condition is set as a controllable anchor point.
According to a third aspect, an embodiment provides an ultrasound imaging system comprising:
An ultrasonic probe for transmitting ultrasonic waves to a target tissue and receiving corresponding ultrasonic echo signals;
a transmission and reception control circuit for controlling the ultrasonic probe to perform transmission of ultrasonic waves and reception of ultrasonic echo signals; the method comprises the steps of,
a processor configured to perform the ultrasound image based contour editing method as described in any of the embodiments herein.
According to a fourth aspect, an embodiment provides a computer-readable storage medium comprising a program executable by a processor to implement an ultrasound image-based contour editing method as described in any of the embodiments herein
According to the contour editing method based on the ultrasonic image, the ultrasonic imaging system and the computer readable storage medium of the embodiment, a new contour editing scheme based on the ultrasonic image is provided, by acquiring the contour of the target tissue and displaying the contour of the target tissue on the ultrasonic image, contour points meeting preset conditions are set as controllable anchor points in response to a controllable anchor point selection instruction, and the controllable anchor points are displayed on the ultrasonic image; the contour points are points obtained after the contour of the target tissue is discretized, the controllable anchor points are moved in response to user operation so as to change the positions of the controllable anchor points, and the contour of the target tissue displayed on the ultrasonic image is updated in real time according to the position-updated controllable anchor points; the contour editing scheme based on the ultrasonic image can improve the fineness and accuracy of contour editing.
Drawings
FIG. 1 is a schematic illustration of contour editing in one approach;
FIG. 2 is a schematic diagram of the structure of an ultrasound imaging system of an embodiment;
FIG. 3 is a schematic diagram of contour editing of an embodiment;
FIG. 4 is a schematic diagram of contour editing of an embodiment;
FIG. 5 is a schematic diagram of contour editing of an embodiment;
FIG. 6 is a flow chart of an ultrasound image based contour editing method of an embodiment;
FIG. 7 is a flow chart of an ultrasound image based contour editing method of an embodiment;
fig. 8 is a flow chart of an ultrasound image based contour editing method according to one embodiment.
Detailed Description
The invention will be described in further detail below with reference to the drawings by means of specific embodiments. Wherein like elements in different embodiments are numbered alike in association. In the following embodiments, numerous specific details are set forth in order to provide a better understanding of the present application. However, one skilled in the art will readily recognize that some of the features may be omitted, or replaced by other elements, materials, or methods in different situations. In some instances, some operations associated with the present application have not been shown or described in the specification to avoid obscuring the core portions of the present application, and may not be necessary for a person skilled in the art to describe in detail the relevant operations based on the description herein and the general knowledge of one skilled in the art.
Furthermore, the described features, operations, or characteristics of the description may be combined in any suitable manner in various embodiments. Also, various steps or acts in the method descriptions may be interchanged or modified in a manner apparent to those of ordinary skill in the art. Thus, the various orders in the description and drawings are for clarity of description of only certain embodiments, and are not meant to be required orders unless otherwise indicated.
The numbering of the components itself, e.g. "first", "second", etc., is used herein merely to distinguish between the described objects and does not have any sequential or technical meaning. The terms "coupled" and "connected," as used herein, are intended to encompass both direct and indirect coupling (coupling), unless otherwise indicated.
The generation and editing of the contour line of the tissue organ are a commonly used function in the ultrasonic imaging system, please refer to fig. 1, a contour editing mode is that an initial contour line is obtained roughly, then 10-20 controllable anchor points (see black solid points in fig. 1) with fixed quantity and relative positions are sampled at the initial contour line, and the contour line is modified by adjusting the positions of the controllable anchor points, so that the contour line is expected to be attached to the real boundary of the tissue organ more accurately, and the contour line of the tissue organ is obtained more accurately.
The applicant found that: because the number and the relative positions of the control points (namely controllable anchor points) are fixed, the positions of a plurality of control points are often required to be repeatedly adjusted to control one section of contour editing during editing, and the real boundary contour of the organ tissue is difficult to adjust in a region with a complex edge contour because the number of the control points in a local region is too small, the effect of contour line editing is poor, the operation is complex, the time and the effort are consumed, and the use experience is not friendly.
In view of the above problems, the applicant proposes a contour editing scheme based on an ultrasound image, after an initial contour of a tissue organ is obtained, a controllable anchor point is adaptively generated according to preset conditions, the controllable anchor point is moved to edit a contour line, after one-time editing is completed, the controllable anchor point can be continuously adaptively generated again, and the contour line is continuously edited by moving the controllable anchor point, so that the editing operation difficulty is reduced, the accuracy is improved, and the use is more flexible and convenient.
The scheme of the invention can be realized on an ultrasonic imaging system. Referring to fig. 2, the ultrasound imaging system of some embodiments includes an ultrasound probe 10, transmit and receive control circuitry 20, an echo processing module 30, a processor 40, and a display module 50, which are described below.
The ultrasound probe 10 is used to transmit ultrasound waves to a tissue of interest including a target tissue, and to receive corresponding ultrasound echo signals. The target tissue may be an organ or tissue, etc. In some embodiments, the ultrasound probe 10 includes a plurality of array elements for performing interconversion of electrical pulse signals and ultrasound waves to thereby transmit ultrasound waves to a biological tissue 60 being examined (a biological tissue in a human or animal body, such as a tissue of interest including a target tissue) and receive ultrasound echoes reflected back from the tissue to obtain ultrasound echo signals. The plurality of array elements included in the ultrasonic probe 10 may be arranged in a row to form a linear array, or may be arranged in a two-dimensional matrix to form an area array, and the plurality of array elements may also form a convex array. The array elements may emit ultrasonic waves according to an excitation electrical signal or may convert received ultrasonic waves into an electrical signal. Each array element may thus be used to transmit ultrasound waves to biological tissue in the region of interest, as well as to receive ultrasound echoes returned through the tissue. In the ultrasonic detection, the transmitting sequence and the receiving sequence can control which array elements are used for transmitting ultrasonic waves and which array elements are used for receiving ultrasonic waves, or control the time slots of the array elements to be used for transmitting ultrasonic waves or receiving ultrasonic echoes. All array elements participating in ultrasonic wave transmission can be excited by the electric signals at the same time, so that ultrasonic waves are transmitted at the same time; or the array elements participating in the ultrasonic wave transmission can be excited by a plurality of electric signals with a certain time interval, so that the ultrasonic wave with a certain time interval can be continuously transmitted.
In some embodiments, three-dimensional ultrasound volume data may also be acquired by the ultrasound probe 10. The three-dimensional ultrasonic volume data is obtained by collecting a series of two-dimensional images in a scanning plane and integrating the two-dimensional images according to the three-dimensional space relation of the two-dimensional images, so that the volume data of a three-dimensional space is collected; the interior of the ultrasonic probe 10 may be composed of a conventional one-dimensional probe array element sequence and a built-in stepping motor driving the array element sequence to swing, and the stepping motor can enable a scanning plane of the array element sequence to swing back and forth along the normal direction of the scanning plane, so as to realize scanning of a three-dimensional space. The ultrasonic probe 10 may also be an area array probe, which has thousands of array elements arranged in a matrix form, and can directly transmit and receive in different directions in a three-dimensional space, so as to realize rapid volume data acquisition. And reconstructing the two-dimensional image acquired by each scanning plane according to the spatial relationship, converting coordinates according to the spatial position of each plane, and interpolating to obtain the voxel value of each point in the three-dimensional ultrasonic volume data.
The transmission and reception control circuit 20 is for controlling the ultrasound probe 10 to perform transmission of ultrasound waves and reception of ultrasound echo signals, in particular, the transmission and reception control circuit 20 is for controlling the ultrasound probe 10 to transmit ultrasound beams to a biological tissue 60 such as a tissue of interest including a target tissue on the one hand, and for controlling the ultrasound probe 10 to receive ultrasound echoes reflected by the tissue from the ultrasound beams on the other hand. In a specific embodiment, the transmission and reception control circuit 20 is configured to generate a transmission sequence and a reception sequence, and output the transmission sequence and the reception sequence to the ultrasound probe 10. The transmit sequence is used to control the transmission of ultrasound waves to a portion or all of a plurality of array elements in the ultrasound probe 10 to biological tissue 60, such as tissue of interest including target tissue, and the parameters of the transmit sequence include the number of array elements used for transmission and the ultrasound wave transmission parameters (e.g., amplitude, frequency, number of waves transmitted, transmission interval, transmission angle, mode, and/or focus position, etc.). The receiving sequence is used for controlling part or all of the plurality of array elements to receive the echo of the ultrasonic wave after being organized, and the parameters of the receiving sequence comprise the number of array elements for receiving and the receiving parameters (such as receiving angle, depth and the like) of the echo. The ultrasound echo is used differently or the image generated from the ultrasound echo is different, so are the ultrasound parameters in the transmit sequence and the echo parameters in the receive sequence.
The echo processing module 30 is configured to process the ultrasonic echo signal received by the ultrasonic probe 10, for example, perform filtering, amplifying, beam forming, and the like on the ultrasonic echo signal, so as to obtain ultrasonic echo data. In a specific embodiment, the echo processing module 30 may output the ultrasonic echo data to the processor 40, or may store the ultrasonic echo data in a memory, and when an operation based on the ultrasonic echo data is required, the processor 40 reads the ultrasonic echo data from the memory. Those skilled in the art will appreciate that in some embodiments, the echo processing module 30 may be omitted when filtering, amplifying, beam forming, etc., of the ultrasound echo signals is not required.
The processor 40 is configured to process the ultrasonic echo signals to obtain an ultrasonic image of the target tissue.
In some embodiments, a complete three-dimensional imaging process may be such that: the transmitting and receiving control circuit 20 transmits a group of pulses subjected to delay focusing to the ultrasonic probe 10, the ultrasonic probe 10 transmits ultrasonic waves to the tissue of the tested organism, receives ultrasonic echoes with tissue information reflected from the tissue of the tested organism after a certain delay, and reconverts the ultrasonic echoes into electric signals; the transmit and receive control circuit 20 receives these electrical signals and feeds these ultrasonic echo signals into the echo processing module 30; the ultrasonic echo signals complete focusing delay, weighting and channel summation in the echo processing module 30, and then are subjected to signal processing by the signal processor 40; a complete probe sector scanning period is subjected to signal processing to obtain a volume of reconstructed precursor data (polar coordinates), and then the processor 40 performs coordinate transformation relationship to convert the polar coordinate system volume data into rectangular coordinate system volume data; and processing the reconstructed volume data and displaying the result, or displaying the obtained visual section image and the 3D rendering image through a display module 50, thereby completing the whole three-dimensional imaging process.
The display module 50 may be used to display information such as parameters and images calculated by the processor 40. Those skilled in the art will appreciate that in some embodiments, the ultrasound imaging system itself may not incorporate a display module, but rather may be connected to a computer device (e.g., a computer) through which information is displayed via the display module (e.g., a display screen) of the computer device.
The above are some illustrations of ultrasound imaging systems. The ultrasound image of the target tissue may be displayed by the display module 50, and the processor 40 acquires the contour of the target tissue and controls the display module 50 to display the contour of the target tissue on the ultrasound image.
There are a number of ways to obtain the contour of the target tissue, especially the initial contour. The contour can be a two-dimensional contour or a three-dimensional contour; in general, especially the initial contour, the accuracy may not be required too high, as editing is subsequently required. In some embodiments, the contours of the target tissue on the ultrasound image may be acquired manually, semi-automatically, or fully automatically, as described in more detail below.
The mode of manually obtaining the two-dimensional contour of the target body can be that a closed curve which is tightly attached to the contour is directly drawn at the contour of the target body through a track ball, the two-dimensional contour of the target body of the current frame is manually marked by providing a function of modifying the curve position, or a series of marking points are marked at the contour of the target body, and then the two-dimensional contour of the target body group is generated through an interpolation fitting mode. Thus, in some embodiments, the processor 40 obtains a curve or a plurality of marker points entered by a user on the ultrasound image and generates a two-dimensional contour of the target tissue in the ultrasound image based on the curve or the plurality of marker points.
The semi-automatic contour detection mode can be that a user marks some interested area ranges on an image approximately by means of drawing points or lines and the like manually, then an accurate edge contour is detected through an image processing algorithm for detecting the edge contour, and a semi-automatic workflow can reduce the detection and positioning search range according to input information of the user, so that detection efficiency and accuracy are improved. Thus, in some embodiments, the processor 40 obtains a search area entered by the user on the ultrasound image and detects within the search area by an edge detection algorithm to obtain a two-dimensional profile of the target tissue in the ultrasound image.
The full-automatic edge contour detection mode can be that a frame of two-dimensional section image is input and an image processing algorithm of edge detection is adopted to automatically detect the two-dimensional contour of the target body; the image processing method adopted for detecting the edge contour can be one or more of a template matching algorithm, an image feature extraction algorithm, an edge extraction algorithm and a morphological operation algorithm, the adopted image segmentation method can be one or more of a graph algorithm, a level set method, an active contour model algorithm, an active shape model algorithm and an active appearance model algorithm, and the adopted machine learning method can be one or more of a deep learning method, a support vector machine, an adaboost and a random forest algorithm. The method for edge contour detection and region-of-interest segmentation can be to learn the characteristics or rules of the target region and the non-target region in a database by adopting a machine learning method, and then segment other images and detect edge contours or key points according to the learned characteristics or rules.
In some embodiments, different target region positioning and edge contour extractors can be constructed according to the tangential planes of different organ tissue structures, and the edge contour extractor of the organ tissue is constructed, so that the contour detection model is obtained; the main steps may include:
step 1, constructing a database; the database usually contains a plurality of standard tangential planes or three-dimensional ultrasonic volume data and corresponding calibration results; the calibration result can be set according to the actual task requirement, and can be the contour of the ROI (region of interest) containing the target, or a Mask (Mask) for accurately dividing the target;
step 2, positioning and dividing; after the database is built, the machine learning algorithm is designed to learn the characteristics or rules of the target area and the non-target area in the database so as to realize the positioning and the segmentation of the image interested area;
for example, this can be achieved by conventional sliding window based methods, commonly in the form of: firstly, extracting features of a region in a sliding window, wherein the feature extraction method can be a traditional PCA, LDA, harr feature and/or texture feature, or the like, or can also adopt a deep neural network to extract the features, then matching the extracted features with a database, classifying the extracted features by using a KNN, SVM, random forest or neural network and other discriminators, and determining whether the current sliding window is a region of interest;
For example, the edge contour method based on deep learning can be used for detecting and identifying, and the common form is as follows: the constructed database is subjected to feature learning and parameter regression by stacking a base layer convolution layer and a full connection layer, and for an input image, the edge outline of a corresponding region of interest can be directly regressed through a network, wherein common networks include R-CNN, fast-RCNN, SSD, YOLO and other networks and variants thereof.
The method is similar to the deep learning-based structure, and is different in that a full-connection layer is removed, and then an up-sampling or deconvolution layer is added to enable the input and output sizes to be the same, so that the interested region of the input image and the corresponding edge outline thereof are directly obtained, and common networks include FCN, U-Net, mask R-CNN and other networks and variants thereof.
After the characteristics and the rules of the target tissue and organs are learned by adopting the machine learning method, the method can be used for detecting the target tissue in the ultrasonic image. For example, one or a plurality of approximate initial two-dimensional contour lines or three-dimensional contour curved surfaces are directly generated according to the detected edge contour, a series of key points are obtained, one or a plurality of approximate initial two-dimensional contour lines or three-dimensional contour curved surfaces can be obtained through a minimum surrounding mode, or parameters capable of representing a geometric model are obtained through regression, and one or a plurality of approximate initial two-dimensional contour lines or three-dimensional contour curved surfaces are calculated.
Thus, in some embodiments, the processor 40 obtains a model trained by machine learning and segments a contour of the target tissue from the ultrasound image based on the model.
After the contour of the target tissue is obtained, a further editing may be performed. For example, selecting a contour to be edited and adaptively generating a controllable anchor point according to conditions, changing the shape and position of the contour by editing the position of the controllable anchor point, so that the contour can be more accurately attached to the contour boundary of the organ tissue, and dividing a target area and a background area.
In some embodiments, referring to fig. 3, in response to the controllable anchor selection instruction, the processor 40 sets the contour points satisfying the preset condition as controllable anchors, and displays the controllable anchors on the ultrasound image, for example, displays the controllable anchors on the ultrasound image with preset marks; wherein the contour point is a point obtained after the contour of the target tissue is discretized. Since the contour points are points obtained after the contour of the target tissue is discretized, the number of contour points is relatively large and dense. In fig. 3 there is shown a cursor (black arrow in the figure) and a controllable anchor (shown by a solid black circle). It should be noted that fig. 3 shows contour points and controllable anchor points; in some embodiments, the profile and controllable anchor point may also be displayed, for example, as shown in FIG. 4.
In some embodiments, the preset condition may be: the processor 40 captures the position of the cursor and sets a first number of contour points closest to the cursor as controllable anchor points. In some embodiments, the first number is 1, 2, 3, or 4. In response to the controllable anchor selection instruction, the processor 40 sets the contour point closest to the cursor as the controllable anchor, for example, sets one contour point closest to the cursor as the controllable anchor. In some embodiments, the processor 40 obtains the current coordinate position of the cursor, obtains the coordinate position of each contour point, calculates the distance between each contour point and the cursor, and compares the distances to obtain the contour point closest to the cursor. Specifically, N contour points Ppn are obtained by dispersing or sampling the contour of the target tissue, where N is 1 to N; and responding to a controllable anchor point selection instruction (for example, the user triggers the controllable anchor point selection instruction through a mouse or a key, and the like), acquiring the current position Pmt of the cursor on the image, and respectively calculating the distance between Pmt and each outline point Ppn, so that the outline point closest to the current cursor is set as the controllable anchor point.
In some embodiments, the preset condition may be: the processor 40 captures the position of the cursor and sets the contour point at a distance from the cursor less than the threshold as the controllable anchor point. Specifically, N contour points Ppn are obtained by dispersing or sampling the contour of the target tissue, where N is 1 to N; and responding to a controllable anchor point selection instruction (for example, the user triggers the controllable anchor point selection instruction through a mouse or a key, and the like), acquiring the current position Pmt of the cursor on the image, and respectively calculating the distances between Pmt and each contour point Ppn, so that the contour point with the distance smaller than the threshold value from the current cursor is set as the controllable anchor point.
It should be noted that the discrete operation of the contour may be performed before the controllable anchor selection instruction is received, or after the controllable anchor selection instruction is received, which is not limited by the present invention.
After the controllable anchor is determined, the controllable anchor may be displayed with a preset mark, for example, by a mark having a specific color and/or shape, such as a red circle or a yellow five-pointed star, etc., as described above; when there are a plurality of controllable anchors, each controllable anchor can be displayed by using marks with the same color and shape, or can be displayed by using marks with different colors and/or different shapes.
After setting the controllable anchor, the processor 40 may also control the display module 50 to display auxiliary information on the ultrasound image; in some embodiments, the auxiliary information includes at least one of: the coordinate system, the network line, the current coordinate position of controllable anchor point, the real-time coordinate position of cursor.
In some embodiments, after setting the controllable anchor, processor 40 moves the controllable anchor in response to a user operation to change the position of the controllable anchor.
For example, the processor 40 captures the movement of the cursor and controls the controllable anchor to follow the cursor for corresponding movement. In some embodiments, the controllable anchor may be edited after the controllable anchor is set, and at this time, the controllable anchor may move along with the displacement of the cursor, and when the position of the cursor moves, the processor 40 calculates the relative displacement vector Vm of the cursor in the established coordinate system in real time; the processor 40 moves the controllable anchor from also real time by the same relative displacement Vm, based on the relative displacement Vm of the cursor.
For another example, the processor 40 obtains a click position of the cursor in response to clicking of the cursor and moves the controllable anchor to the click position of the cursor.
For another example, the processor 40 moves the controllable anchor a preset distance in the direction indicated by the move command in response to the move command. In some embodiments, the up-down, left-right movement of the controllable anchor point can be controlled by a keyboard or other modes, the system supports setting the minimum step length S of each keyboard key operation, for example, the movement of the controllable anchor point in the Y-axis direction is controlled by the up-down keys of the keyboard, and the movement of the controllable anchor point in the X-axis direction is controlled by the left-right keys; and each time the direction key is pressed, the controllable anchor point is moved towards the corresponding direction by a step S distance.
For another example, the processor 40 obtains the entered coordinate position and moves the controllable anchor to the entered coordinate position.
In some embodiments, the processor 40 updates the contour of the target tissue displayed on the ultrasound image in real time according to the location updated controllable anchor point, for example, the processor 40 performs interpolation (such as nearest neighbor interpolation, bilinear interpolation, tri-linear interpolation, spline interpolation, or polynomial interpolation) according to the coordinate location of the location updated controllable anchor point and the coordinate locations of other contour points, and fits a new contour of the target tissue to update the contour of the target tissue.
FIG. 5 is an example of moving a controllable anchor to change the position of the controllable anchor and update the contour of a target tissue displayed on an ultrasound image in real time.
In some embodiments, processor 40 generates at least one axial length of the target tissue from the contour of the target tissue and controls display component 50 to display on the ultrasound image; as the contour of the target tissue is updated, the processor 40 updates the axial length in real time.
It can be seen that the contour points meeting the preset conditions are set as controllable anchor points, then the positions of the controllable anchor points are moved to update the contour of the target tissue in real time to finish one-time editing, then the contour points of the preset conditions can be set as the controllable anchor points again, then the positions of the new controllable anchor points are moved to update the contour of the target tissue in real time to finish one-time editing, the setting and the movement of the controllable anchor points are repeated, all parts of the contour can be subjected to fine editing, and finally the contour boundary of the organ tissue can be attached more accurately.
In some embodiments, in response to the profile editing instructions, processor 40 controls entry into profile editing mode; in profile editing mode, the processor 40 is capable of setting, in response to a controllable anchor selection instruction, a profile point satisfying a preset condition, such as closest to the cursor, as a controllable anchor; in response to the exit instruction, the processor 40 controls exiting the contour editing mode and regarding the updated contour of the target tissue as the final contour of the target tissue for subsequent measurements, such as measurements of the area or axial length of the target tissue, and the like.
One particular embodiment may be such that: in response to the profile editing instructions, the processor 40 controls entry into the profile editing mode; in response to the controllable anchor selection instruction, the processor 40 sets the contour point closest to the cursor as the controllable anchor, and controls the display module 50 to display the controllable anchor on the ultrasound image; the processor 40 captures the movement of the cursor on the ultrasound image and controls the controllable anchor to follow the cursor on the ultrasound image to perform corresponding movement so as to change the position of the controllable anchor; the processor 40 updates the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor point after the position update; in response to the exit instruction, the processor 40 controls exiting the contour editing mode and taking the updated contour of the target tissue as the final contour of the target tissue for subsequent measurements.
One particular embodiment may also be such that: in response to the profile editing instructions, the processor 40 controls entry into the profile editing mode; in response to the controllable anchor selection instruction, the processor 40 sets the contour point nearest to the current cursor as the controllable anchor, and controls the display module 50 to display the controllable anchor on the ultrasound image; the processor 40 captures the movement of the cursor on the ultrasound image and controls the controllable anchor to follow the cursor on the ultrasound image to perform corresponding movement so as to change the position of the controllable anchor; the processor 40 updates the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor point after the position update, and completes one-time editing; in response to the controllable anchor selection instruction, the processor 40 sets the contour point nearest to the current cursor as the controllable anchor, and controls the display module 50 to display the controllable anchor on the ultrasound image; the processor 40 captures the movement of the cursor on the ultrasound image and controls the controllable anchor to follow the cursor on the ultrasound image to perform corresponding movement so as to change the position of the controllable anchor; the processor 40 updates the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor point after the position update, and completes the editing again; in response to the exit instruction, the processor 40 controls exiting the contour editing mode and taking the updated contour of the target tissue as the final contour of the target tissue for subsequent measurements.
In some embodiments, after displaying the contour of the target tissue on the ultrasound image, the processor 40 further responds to the contour selection instruction to select the contour of the target tissue, so that the contour point satisfying the preset condition, for example, the contour point closest to the cursor, among contour points obtained by dispersing the selected contour of the target tissue in response to the controllable anchor point selection instruction, is set as the controllable anchor point. Thus, some specific embodiments may be such that: displaying an ultrasound image of the target tissue by the display module 50, the processor 40 acquiring a contour of the target tissue, and controlling the display module 50 to display the contour of the target tissue on the ultrasound image; in response to the contour selection instruction, the processor 40 selects a contour of the target tissue, for example, a contour of the target tissue to be edited from among the contours of one or more target tissues; in response to the controllable anchor selection instruction, the processor 40 sets a contour point meeting a preset condition, for example, a contour point closest to the cursor, as the controllable anchor, and controls the display module 50 to display the controllable anchor on the ultrasound image, wherein the contour point is a point obtained after the contour of the selected or to-be-edited target tissue is discretized; responsive to user operation, the processor 40 moves the controllable anchor to change the position of the controllable anchor, e.g., the processor 40 captures movement of a cursor on the ultrasound image and controls the controllable anchor to follow the cursor to move correspondingly on the ultrasound image to change the position of the controllable anchor; the processor 40 updates the contour of the target tissue displayed on the ultrasound image in real time based on the location updated controllable anchor.
An example of operation may be as follows: after acquiring the outline of the target tissue in the ultrasonic image, a user moves a cursor to approach the outline, the user presses a left mouse button to generate a controllable anchor point selection instruction, the processor 40 sets an outline point which meets preset conditions such as closest to the current cursor as a controllable anchor point, the user moves the controllable anchor point of the mouse to move to a designated position along with the cursor of the mouse, in the process, the system continuously fits a new outline according to the new position of the controllable anchor point and the positions of other outline points, and the left mouse button is lifted to finish one-time editing; then the user can move the cursor to approach the outline again, the user presses the left mouse button to generate a controllable anchor point selection instruction, the processor 40 sets the outline point which meets preset conditions such as closest to the current cursor as the controllable anchor point, the user moves the controllable anchor point of the mouse to move to a designated position along with the cursor of the mouse, in the process, the system continuously fits a new outline according to the new position of the controllable anchor point and the positions of other outline points, and the system completes the editing again after lifting the left mouse button; the above process is repeated to complete the editing of each part of the whole contour, and a more accurate contour is obtained.
Some embodiments of the present application further disclose a contour editing method based on an ultrasound image, which is specifically described below.
Referring to fig. 6, the contour editing method based on the ultrasound image in some embodiments includes the following steps:
step 100: an ultrasound image of the target tissue is displayed.
Step 110: the contour of the target tissue is acquired and displayed on the ultrasound image.
In some embodiments, step 110 may acquire the contour of the target tissue in a variety of ways, such as manually, semi-automatically, or fully automatically, to acquire the contour of the target tissue on the ultrasound image, as described in more detail below.
In some embodiments, step 110 obtains a curve or a plurality of marker points entered by a user on the ultrasound image, and generates a contour of the target tissue in the ultrasound image based on the curve or the plurality of marker points.
In some embodiments, step 110 obtains a search area entered by a user on an ultrasound image, and detects the search area by an edge detection algorithm to obtain a two-dimensional contour of a target tissue in the ultrasound image.
In some embodiments, step 110 obtains a model trained by machine learning and segments a contour of the target tissue from the ultrasound image based on the model.
Step 130: setting contour points meeting preset conditions as controllable anchor points in response to a controllable anchor point selection instruction, and displaying the controllable anchor points on an ultrasonic image; wherein the contour point is a point obtained after the contour of the target tissue is discretized.
In some embodiments, the preset condition may be: step 130 captures the position of the cursor, setting a first number of contour points closest to the cursor as controllable anchor points. In some embodiments, the first number is 1, 2, 3, or 4. In response to the controllable anchor selection instruction, step 130 sets the contour point closest to the cursor as the controllable anchor, for example, sets the one contour point closest to the cursor as the controllable anchor. In some embodiments, step 130 obtains the current coordinate position of the cursor, obtains the coordinate position of each contour point, calculates the distance between each contour point and the cursor, and compares the calculated distances to obtain the contour point closest to the cursor.
In some embodiments, the preset condition may be: step 130 captures the position of the cursor and sets contour points at a distance from the cursor less than a threshold as controllable anchor points.
Step 130 may display the controllable anchor in a preset mark, for example by a mark having a specific color and/or shape, such as a red circle or a yellow five-pointed star, etc.; when there are a plurality of controllable anchors, each controllable anchor can be displayed by using marks with the same color and shape, or can be displayed by using marks with different colors and/or different shapes.
In some embodiments, step 130 may also display auxiliary information on the ultrasound image; in some embodiments, the auxiliary information includes at least one of: the coordinate system, the network line, the current coordinate position of controllable anchor point, the real-time coordinate position of cursor.
Step 140: and responding to the user operation, moving the controllable anchor point to change the position of the controllable anchor point.
For example, step 140 captures the movement of the cursor and controls the controllable anchor to follow the cursor for corresponding movement. In some embodiments, the controllable anchor point can be edited after being set, and then the controllable anchor point can move along with the displacement of the cursor, and when the position of the cursor moves, step 140 calculates the relative displacement vector Vm of the cursor in the established coordinate system in real time; step 140 moves the controllable anchor from also real time by the same relative displacement Vm, based on the relative displacement Vm of the cursor.
For another example, step 140 obtains the click position of the cursor in response to the click of the cursor and moves the controllable anchor to the click position of the cursor.
For another example, step 140 moves the controllable anchor a preset distance in the direction indicated by the move command in response to the move command. In some embodiments, the up-down, left-right movement of the controllable anchor point can be controlled by a keyboard or other modes, the system supports setting the minimum step length S of each keyboard key operation, for example, the movement of the controllable anchor point in the Y-axis direction is controlled by the up-down keys of the keyboard, and the movement of the controllable anchor point in the X-axis direction is controlled by the left-right keys; and each time the direction key is pressed, the controllable anchor point is moved towards the corresponding direction by a step S distance.
For another example, step 140 obtains the entered coordinate position and moves the controllable anchor to the entered coordinate position.
In some embodiments, step 140 updates the contour of the target tissue displayed on the ultrasound image in real time according to the location updated controllable anchor point, for example, step 140 performs interpolation (such as nearest neighbor interpolation, bilinear interpolation, tri-linear interpolation, spline interpolation, or polynomial interpolation) according to the coordinate location of the location updated controllable anchor point and the coordinate locations of other contour points, and fits a new contour of the target tissue to update the contour of the target tissue.
Step 150: and updating the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor point after the position updating. For example, step 150 performs interpolation (such as nearest neighbor interpolation, bilinear interpolation, trilinear interpolation, spline interpolation, or polynomial interpolation) according to the coordinate position of the controllable anchor point after the position update and the coordinate positions of other contour points, and fits a new contour of the target tissue to update the contour of the target tissue.
In some embodiments, the contour editing method based on the ultrasound image further comprises a step of: generating at least one axial length of the target tissue according to the outline of the target tissue and displaying the at least one axial length on the ultrasonic image; and updating the axial length in real time after the contour of the target tissue is updated.
Referring to fig. 7, the contour editing method based on the ultrasound image according to some embodiments further includes step 120 and step 160; step 120: responding to a contour editing instruction, and entering a contour editing mode; in the contour editing mode, a contour point satisfying a preset condition, such as closest to a cursor, can be set as a controllable anchor in response to a controllable anchor selection instruction. Step 160: in response to the exit instruction, the contour editing mode is exited and the updated contour of the target tissue is taken as the final contour of the target tissue for subsequent measurements, such as measurements of the area or axial length of the target tissue, etc.
Thus, one specific procedure may be as follows:
step 100 displays an ultrasound image of a target tissue; step 110, acquiring the outline of the target tissue and displaying the outline of the target tissue on an ultrasonic image; step 120: responding to a contour editing instruction, and entering a contour editing mode; in some embodiments, the order of steps 110 and 120 may be reversed; step 130, setting contour points meeting preset conditions as controllable anchor points in response to a controllable anchor point selection instruction, and displaying the controllable anchor points on an ultrasonic image, wherein the contour points are points obtained after the contours of target tissues are discretized; step 140, responding to user operation, moving the controllable anchor point to change the position of the controllable anchor point; step 150, updating the outline of the target tissue displayed on the ultrasonic image in real time according to the position updated controllable anchor point; in some embodiments, steps 140 and 150 may be repeated to complete editing of each part of the profile; step 160: in response to the exit instruction, the contour editing mode is exited and the updated contour of the target tissue is taken as the final contour of the target tissue for subsequent measurements.
Referring to fig. 8, the contour editing method based on the ultrasound image according to some embodiments further includes step 112: after the outline of the target tissue is displayed on the ultrasonic image, the outline of the target tissue is selected (for example, the outline of one target tissue to be edited is selected from the outlines of one or more target tissues) in response to the outline selection instruction, so that the outline of the selected target tissue can be discretized to obtain outline points in response to the controllable anchor point selection instruction, and the outline points meeting preset conditions, such as the outline points closest to a cursor, are set as controllable anchor points.
Thus, one specific procedure may be as follows:
step 100 displays an ultrasound image of a target tissue; step 110, acquiring the outline of the target tissue and displaying the outline of the target tissue on an ultrasonic image; step 112, responding to the outline selection instruction, selecting the outline of the target tissue; 130, setting contour points meeting preset conditions as controllable anchor points in response to a controllable anchor point selection instruction, and displaying the controllable anchor points on an ultrasonic image, wherein the contour points are points obtained after the contours of the selected target tissues are discretized; step 140, responding to user operation, moving the controllable anchor point to change the position of the controllable anchor point; step 150, updating the outline of the target tissue displayed on the ultrasonic image in real time according to the position updated controllable anchor point; in some embodiments, steps 140 and 150 may be repeated continuously to complete editing of various portions of the contour.
One specific procedure may also be as follows:
step 100 displays an ultrasound image of a target tissue; step 110, acquiring the outline of the target tissue and displaying the outline of the target tissue on an ultrasonic image; step 112, responding to the outline selection instruction, selecting the outline of the target tissue; step 120: responding to a contour editing instruction, and entering a contour editing mode; in some embodiments, the order of steps 110 and 120 may be reversed; in some embodiments, the order of steps 112 and 120 may be reversed; 130, setting contour points meeting preset conditions as controllable anchor points in response to a controllable anchor point selection instruction, and displaying the controllable anchor points on an ultrasonic image, wherein the contour points are points obtained after the contours of the selected target tissues are discretized; step 140, responding to user operation, moving the controllable anchor point to change the position of the controllable anchor point; step 150, updating the outline of the target tissue displayed on the ultrasonic image in real time according to the position updated controllable anchor point; in some embodiments, steps 140 and 150 may be repeated to complete editing of each part of the profile; step 160: in response to the exit instruction, the contour editing mode is exited and the updated contour of the target tissue is taken as the final contour of the target tissue for subsequent measurements.
Reference is made to various exemplary embodiments herein. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope herein. For example, the various operational steps and components used to perform the operational steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or combined into other steps) depending on the particular application or taking into account any number of cost functions associated with the operation of the system.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Additionally, as will be appreciated by one of skill in the art, the principles herein may be reflected in a computer program product on a computer readable storage medium preloaded with computer readable program code. Any tangible, non-transitory computer readable storage medium may be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD-to-ROM, DVD, blu-Ray disks, etc.), flash memory, and/or the like. These computer program instructions may be loaded onto a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions which execute on the computer or other programmable data processing apparatus create means for implementing the functions specified. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including means which implement the function specified. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified.
While the principles herein have been shown in various embodiments, many modifications of structure, arrangement, proportions, elements, materials, and components, which are particularly adapted to specific environments and operative requirements, may be used without departing from the principles and scope of the present disclosure. The above modifications and other changes or modifications are intended to be included within the scope of this document.
The foregoing detailed description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes may be made without departing from the scope of the present disclosure. Accordingly, the present disclosure is to be considered as illustrative and not restrictive in character, and all such modifications are intended to be included within the scope thereof. Also, advantages, other advantages, and solutions to problems have been described above with regard to various embodiments. The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, system, article, or apparatus. Furthermore, the term "couple" and any other variants thereof are used herein to refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections, and/or any other connection.
Those skilled in the art will recognize that many changes may be made to the details of the above-described embodiments without departing from the underlying principles of the invention. Accordingly, the scope of the invention should be determined only by the following claims.
Claims (17)
1. An ultrasound image-based contour editing method, comprising:
displaying an ultrasound image of the target tissue;
acquiring the outline of the target tissue and displaying the outline of the target tissue on the ultrasonic image;
responding to a controllable anchor point selection instruction, setting a contour point nearest to a cursor as a controllable anchor point, and displaying the controllable anchor point on the ultrasonic image; wherein the contour points are points obtained after the contour of the target tissue is discretized;
capturing the movement of a cursor on the ultrasonic image, and controlling the controllable anchor point to correspondingly move along with the cursor on the ultrasonic image so as to change the position of the controllable anchor point;
and updating the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor points with updated positions.
2. The contour editing method as defined in claim 1, wherein said setting a contour point closest to a cursor as a controllable anchor point comprises: and setting one contour point nearest to the cursor as a controllable anchor point.
3. The contour editing method as defined in claim 1, wherein said setting a contour point closest to a cursor as a controllable anchor point comprises:
acquiring the current coordinate position of a cursor;
acquiring the coordinate position of each contour point;
and calculating the distance between each contour point and the cursor and comparing the calculated distances to obtain the contour point closest to the cursor.
4. The contour editing method of claim 1, wherein said displaying said controllable anchor on said ultrasound image comprises: and displaying the controllable anchor point on the ultrasonic image by a preset mark.
5. The contour editing method as defined in claim 1, further comprising displaying auxiliary information on said ultrasound image after said controllable anchor point is set; the auxiliary information includes at least one of: the coordinate system, the network line, the current coordinate position of controllable anchor point, the real-time coordinate position of cursor.
6. The contour editing method as defined in claim 1, wherein said updating in real time the contour of the target tissue displayed on the ultrasound image according to the position-updated controllable anchor point includes:
and performing interpolation operation according to the coordinate positions of the controllable anchor points and the coordinate positions of other contour points after the position updating, and fitting out a new contour of the target tissue to update the contour of the target tissue.
7. The contour editing method as defined in claim 1 or 6, wherein a contour editing mode is entered in response to a contour editing instruction; in the contour editing mode, a contour point nearest to a cursor can be set as a controllable anchor point in response to a controllable anchor point selection instruction;
and responding to an exit instruction, exiting the contour editing mode, and taking the updated contour of the target tissue as the final contour of the target tissue for subsequent measurement.
8. The contour editing method as defined in claim 1, further comprising: generating at least one axial length of the target tissue according to the outline of the target tissue and displaying the axial length on the ultrasonic image;
and updating the axial length in real time after the contour of the target tissue is updated.
9. The contour editing method as defined in claim 1, wherein said acquiring a contour of said target tissue includes:
acquiring a curve or a plurality of mark points input by a user on the ultrasonic image, and generating the outline of the target tissue in the ultrasonic image according to the curve or the plurality of mark points;
or,
acquiring a search area input by a user on the ultrasonic image, and detecting in the search area through an edge detection algorithm to obtain the outline of the target tissue in the ultrasonic image;
Or,
a model trained by machine learning is acquired and contours of the target tissue are segmented from the ultrasound image based on the model.
10. The contour editing method according to claim 1, further comprising selecting a contour of the target tissue in response to a contour selection instruction after displaying the contour of the target tissue on the ultrasound image, so as to obtain a contour point after discretizing the contour of the selected target tissue in response to a controllable anchor point selection instruction, wherein a contour point closest to a cursor is set as a controllable anchor point.
11. An ultrasound image-based contour editing method, comprising:
displaying an ultrasound image of the target tissue;
acquiring the outline of the target tissue and displaying the outline of the target tissue on the ultrasonic image;
setting contour points meeting preset conditions as controllable anchor points in response to a controllable anchor point selection instruction, and displaying the controllable anchor points on the ultrasonic image; wherein the contour points are points obtained after the contour of the target tissue is discretized;
responding to user operation, moving the controllable anchor point to change the position of the controllable anchor point;
And updating the outline of the target tissue displayed on the ultrasonic image in real time according to the controllable anchor points with updated positions.
12. The contour editing method as defined in claim 11, wherein said setting contour points satisfying a preset condition as controllable anchor points comprises:
capturing the position of a cursor, and setting a first number of contour points closest to the cursor as controllable anchor points;
or,
capturing the position of a cursor, and setting contour points with the distance from the cursor smaller than a threshold value as controllable anchor points.
13. The contour editing method of claim 12, wherein said first number is 1, 2, 3 or 4.
14. The contour editing method of claim 11, wherein said moving said controllable anchor in response to a user operation comprises:
capturing movement of a cursor, and controlling the controllable anchor point to correspondingly move along with the cursor; or,
responding to clicking of a cursor, and acquiring the clicking position of the cursor; moving the controllable anchor point to the clicking position of the cursor; or,
responding to a movement command, and moving the controllable anchor point by a preset distance according to the direction indicated by the movement command; or,
And acquiring an input coordinate position, and moving the controllable anchor point to the coordinate position.
15. The contour editing method of claim 11, further displaying auxiliary information on said ultrasound image after setting a controllable anchor point; the auxiliary information includes at least one of: the coordinate system, the network line, the current coordinate position of controllable anchor point, the real-time coordinate position of cursor.
16. The contour editing method as defined in claim 11, further comprising selecting a contour of the target tissue in response to a contour selection instruction after displaying the contour of the target tissue on the ultrasound image, so as to be able to obtain contour points after discretizing the contour of the selected target tissue in response to a controllable anchor point selection instruction, wherein the contour points satisfying a preset condition are set as controllable anchors.
17. An ultrasound imaging system, comprising:
an ultrasonic probe for transmitting ultrasonic waves to a target tissue and receiving corresponding ultrasonic echo signals;
a transmission and reception control circuit for controlling the ultrasonic probe to perform transmission of ultrasonic waves and reception of ultrasonic echo signals; the method comprises the steps of,
the processor is used for obtaining an ultrasonic image of the target tissue according to the ultrasonic echo signal;
A display for displaying the ultrasound image;
the processor is further configured to perform the ultrasound image based contour editing method of any of claims 1 to 16.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210933480.1A CN117557591A (en) | 2022-08-04 | 2022-08-04 | Contour editing method based on ultrasonic image and ultrasonic imaging system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210933480.1A CN117557591A (en) | 2022-08-04 | 2022-08-04 | Contour editing method based on ultrasonic image and ultrasonic imaging system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117557591A true CN117557591A (en) | 2024-02-13 |
Family
ID=89817189
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210933480.1A Pending CN117557591A (en) | 2022-08-04 | 2022-08-04 | Contour editing method based on ultrasonic image and ultrasonic imaging system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117557591A (en) |
-
2022
- 2022-08-04 CN CN202210933480.1A patent/CN117557591A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230068399A1 (en) | 3d ultrasound imaging system | |
| JP6367425B2 (en) | Ultrasonic diagnostic equipment | |
| RU2667617C2 (en) | System and method of elastographic measurements | |
| CN110087550B (en) | Ultrasonic image display method, equipment and storage medium | |
| EP2433567A1 (en) | Medical image diagnosis device and region-of-interest setting method therefor | |
| CN110087555B (en) | Ultrasonic equipment and display transformation method and system of three-dimensional ultrasonic image thereof | |
| RU2708792C2 (en) | Ultrasound diagnosis of heart operation using cardiac model segmentation under user control | |
| US11931201B2 (en) | Device and method for obtaining anatomical measurements from an ultrasound image | |
| US11712224B2 (en) | Method and systems for context awareness enabled ultrasound scanning | |
| CN108720807A (en) | Multi-modal medical imaging method and system for model-driven | |
| US20210045717A1 (en) | Methods and system for camera-aided ultrasound scan setup and control | |
| JP7427002B2 (en) | Systems and methods for frame indexing and image review | |
| CN112168210A (en) | Medical image processing terminal, ultrasonic diagnostic equipment and fetal image processing method | |
| CN117557591A (en) | Contour editing method based on ultrasonic image and ultrasonic imaging system | |
| EP4006832A1 (en) | Predicting a likelihood that an individual has one or more lesions | |
| EP3849424B1 (en) | Tracking a tool in an ultrasound image | |
| WO2020132953A1 (en) | Imaging method, and ultrasonic imaging device | |
| CN117122349A (en) | Ultrasound diagnosis of cardiac function by single degree of freedom chamber segmentation | |
| CN112294361A (en) | Ultrasonic imaging equipment and method for generating section image of pelvic floor | |
| CN117557491A (en) | Three-dimensional ultrasonic volume measurement method and ultrasonic imaging system | |
| US20170219705A1 (en) | Ultrasonic diagnosis apparatus and storage medium | |
| US20230267618A1 (en) | Systems and methods for automated ultrasound examination | |
| US11413019B2 (en) | Method and apparatus for displaying ultrasound image of target object | |
| CN116138807A (en) | Ultrasonic imaging equipment and ultrasonic detection method of abdominal aorta | |
| CN116115267A (en) | Ultrasound imaging method, ultrasound imaging system, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |