EP3854313A1 - Ultrasound diagnostic apparatus and method of controlling the same, and computer program product - Google Patents
Ultrasound diagnostic apparatus and method of controlling the same, and computer program product Download PDFInfo
- Publication number
- EP3854313A1 EP3854313A1 EP21152799.9A EP21152799A EP3854313A1 EP 3854313 A1 EP3854313 A1 EP 3854313A1 EP 21152799 A EP21152799 A EP 21152799A EP 3854313 A1 EP3854313 A1 EP 3854313A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- ultrasound
- micro
- calcification
- data
- diagnostic apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/08—Clinical applications
- A61B8/0825—Clinical applications for diagnosis of the breast, e.g. mammography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/08—Clinical applications
- A61B8/0833—Clinical applications involving detecting or locating foreign bodies or organic structures
- A61B8/085—Clinical applications involving detecting or locating foreign bodies or organic structures for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/13—Tomography
- A61B8/14—Echo-tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
- A61B8/4444—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to the probe
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
- A61B8/461—Displaying means of special interest
- A61B8/465—Displaying means of special interest adapted to display user selection data, e.g. icons or menus
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/48—Diagnostic techniques
- A61B8/483—Diagnostic techniques involving the acquisition of a 3D volume of data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
- A61B8/5223—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for extracting a diagnostic or physiological parameter from medical diagnostic data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
- A61B8/523—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for generating planar views from image data in a user selectable plane not corresponding to the acquisition plane
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/54—Control of the diagnostic device
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
- G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
- G06T2207/10136—3D ultrasound image
Definitions
- the disclosure relates to an ultrasound diagnostic apparatus and a method of controlling the same, and a computer program product, and more particularly, to a technology for generating and displaying an image representing micro-calcification tissues in the ultrasound diagnostic apparatus.
- a production of micro-calcification according to the accumulation of calcium in a human body causes disorders in organs or cardiovascular function in the human body and manifests various diseases.
- micro-calcification tissues present in a breast are known to have a high possibility of metastasis to malignant tumors, and thus a technology capable of detecting the micro-calcification tissues at an early stage is required to diagnose breast cancer early.
- X-ray images can be used in consideration of the fact that calcareous material absorbs relatively little X-rays.
- this technology has disadvantages that it is impossible to detect the micro-calcification tissues in real time, the accessibility of the user is poor, and there is a potential risk (blood flow apoptosis, cancer expression, DNA mutation) due to exposure of a patient to radiation.
- evaluation of objectivity and standardized criteria are insufficient.
- an ultrasound diagnostic apparatus irradiates an ultrasound signal generated from a transducer of a probe to an object, receives information of a signal reflected from the object, and obtains at least one image of a portion (for example, soft tissue or blood flow) inside the object.
- the ultrasound diagnostic apparatus is harmless to the human body and has the advantage of being able to observe an internal structure and characteristics of the human body noninvasively.
- the ultrasound diagnostic apparatus may provide various types of clinical information (tissue shape, elasticity, blood flow rate, etc.).
- the ultrasound diagnostic apparatus may be used for monitoring micro-calcification, or for real-time monitoring for biopsy of micro-calcification tissues.
- breast ultrasound or musculoskeletal ultrasound may be used.
- An aspect of the disclosure provides an ultrasound diagnostic apparatus that detects a plurality of micro-calcification tissues distributed at different depths or positions, and displays the detected micro-calcification tissues as an image.
- an ultrasound diagnostic apparatus including: a probe; an ultrasound transceiver configured to transmit an ultrasound signal to an object through the probe and receive an echo signal reflected from the object; a controller configured to obtain first data by controlling the ultrasound transceiver to transmit a first ultrasound pulse to the object and receive the echo signal reflected from the object, to obtain second data by controlling the ultrasound transceiver to repeat an operation of transmitting a second ultrasound pulse different from the first ultrasound pulse to a first position of the object and receiving the echo signal reflected from the first position of the object a plurality of times at predetermined time intervals, to obtain third data by controlling the ultrasound transceiver to repeat an operation of transmitting the second ultrasound pulse to a second position of the object and receiving the echo signal reflected from the second position of the object the plurality of times at predetermined time intervals, and to detect the micro-calcification tissues of the first position and the second position by analyzing the obtained second and third data; and a display configured to display an ultrasound image generated based on the obtained first data and
- the first position of the object may be a position that is a different depth from the second position and is spaced apart from each other.
- the controller may be configured to set the first position and the second position of the object as a first focal point and a second focal point to which the transmitted second ultrasound pulse is focused, respectively.
- the controller may be configured to control the ultrasound transceiver so that the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object are transmitted at predetermined time intervals.
- the controller may be configured to control the ultrasound transceiver so that the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object are simultaneously transmitted.
- the second ultrasound pulse may be a pulse designed based on characteristics of the micro-calcification tissues.
- the second ultrasound pulse may be an asymmetric pulse in which a negative pressure component is dominant compared to a positive pressure component, and have a longer wavelength than the first ultrasound pulse.
- the controller may be configured to reconstruct the obtained second and third data into three-dimensional (3D) data including information about an axial depth, a lateral width, and a time, and to extract the micro-calcification tissues by analyzing the 3D data.
- 3D three-dimensional
- the controller may be configured to estimate at least one of an intensity, frequency, or phase of the echo signal reflected from each area of the object by applying singular value decomposition (SVD) to the obtained second and third data, and to detect the micro-calcification tissues in the object based on the estimated value.
- SSVD singular value decomposition
- the controller may be configured to calculate a dispersion of a phase change over time of the echo signal reflected from each area of the object based on the obtained second and third data, and to detect an area in which the dispersion of the phase change is greater than or equal to a predetermined value as the micro-calcification tissues in the object.
- the display may be configured to display an index indicating focusing lines in which the set first focal point and second focal point are located in a brightness mode (B-mode) image of a cross section of the object.
- B-mode brightness mode
- the display is configured to display a color bar representing a plurality of colors corresponding to values representing characteristics of the micro-calcification tissues, to select a color from the color bar based on the value representing the characteristics of the detected micro-calcification tissues, and to display the selected color in an area corresponding to the detected micro-calcification tissues included in the ultrasound image.
- the value representing the characteristics of the micro-calcification tissues may represent a roughness of a phase change over time of the echo signal reflected from the micro-calcification tissues.
- the ultrasound image may be a brightness mode (B-mode) image for a cross section of the object.
- the display may be configured to display an area corresponding to the detected micro-calcification tissues on the ultrasound image.
- a method of controlling an ultrasound diagnostic apparatus including: obtaining, by a controller, first data by transmitting a first ultrasound pulse to the object and receiving the echo signal reflected from the object; obtaining, by the controller, second data by repeating an operation of transmitting a second ultrasound pulse different from the first ultrasound pulse to a first position of the object and receiving the echo signal reflected from the first position of the object a plurality of times at predetermined time intervals; obtaining, by the controller, third data by repeating an operation of transmitting the second ultrasound pulse to a second position of the object and receiving the echo signal reflected from the second position of the object the plurality of times at predetermined time intervals; detecting, by the controller, the micro-calcification tissues of the first position and the second position by analyzing the obtained second and third data; and displaying, by a display, an ultrasound image generated based on the obtained first data and an image representing micro-calcification tissues detected in the first position and the second position.
- the first position of the object may be a position that is a different depth from the second position and is spaced apart from each other.
- the method may further include setting, by the controller, the first position and the second position of the object as a first focal point and a second focal point to which the transmitted second ultrasound pulse is focused, respectively.
- the transmitting of the second ultrasound pulse may further include controlling the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object to be transmitted at predetermined time intervals.
- the transmitting of the second ultrasound pulse may further include controlling the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object to be simultaneously transmitted.
- the detecting of the micro-calcification tissues of the first position and the second position may further include reconstructing the obtained second and third data into three-dimensional (3D) data including information about an axial depth, a lateral width, and a time; and extracting the micro-calcification tissues by analyzing the 3D data.
- 3D three-dimensional
- the detecting of the micro-calcification tissues of the first position and the second position may further include estimating at least one of an intensity, frequency, or phase of the echo signal reflected from each area of the object by applying singular value decomposition (SVD) to the obtained second and third data; and detecting the micro-calcification tissues in the object based on the estimated value.
- SMD singular value decomposition
- the detecting of the micro-calcification tissues of the first position and the second position may further include calculating a dispersion of a phase change over time of the echo signal reflected from each area of the object based on the obtained second and third data; and detecting an area in which the dispersion of the phase change is greater than or equal to a predetermined value as the micro-calcification tissues in the object.
- the method may further include displaying, by the display, an index indicating focusing lines in which the set first focal point and second focal point are located in a brightness mode (B-mode) image of a cross section of the object.
- B-mode brightness mode
- the displaying of the ultrasound image and the image representing the micro-calcification tissues detected in the first position and the second position may further include displaying, by the display, a color bar representing a plurality of colors corresponding to values representing characteristics of the micro-calcification tissues; selecting, by the display, a color from the color bar based on the value representing the characteristics of the detected micro-calcification tissues; and displaying, by the display, the selected color in an area corresponding to the detected micro-calcification tissues included in the ultrasound image.
- the value representing the characteristics of the micro-calcification tissues may represent a roughness of a phase change over time of the echo signal reflected from the micro-calcification tissues.
- the ultrasound image may be a brightness mode (B-mode) image for a cross section of the object.
- the displaying of the ultrasound image and the image representing the micro-calcification tissues detected in the first position and the second position may further include displaying an area corresponding to the detected micro-calcification tissues on the ultrasound image.
- a computer program product including: non-transitory computer readable recording medium storing a computer program code for performing the method of controlling the ultrasound diagnostic apparatus.
- an "image” may include a medical image obtained by a medical imaging device such as a magnetic resonance imaging (MRI) apparatus, a computed tomography (CT) apparatus, an ultrasound imaging apparatus, or an X-ray imaging apparatus.
- MRI magnetic resonance imaging
- CT computed tomography
- ultrasound imaging apparatus an ultrasound imaging apparatus
- X-ray imaging apparatus an X-ray imaging apparatus
- an 'object' is to be captured, and may include a person, an animal, or a part thereof.
- the object may include a portion (e.g., organ) of a human body or a phantom.
- an "ultrasound image” may refer to an image of the object transmitted to the object and processed based on an ultrasound signal reflected from the object.
- FIG. 1 is a block diagram illustrating a configuration of an ultrasound diagnostic apparatus according to an embodiment.
- an ultrasound diagnostic apparatus 100 may include a probe 20, an ultrasound transceiver 110, a controller 120, an image processor 130, a display 140, a storage 150, a communication interface 160, and an input 170.
- the ultrasound diagnostic apparatus 100 may be implemented not only in a cart type but also in a portable type.
- Examples of the portable ultrasound diagnostic apparatus may include a smart phone including a probe and an application, a laptop computer, a PDA, and a tablet PC, but are not limited thereto.
- the probe 20 may include a plurality of transducers.
- the plurality of transducers may transmit the ultrasound signal to the object 10 according to a transmission signal applied from a transmitter 113.
- the plurality of transducers may receive the ultrasound signal reflected from the object 10 and form a received signal.
- the probe 20 may be implemented integrally with the ultrasound diagnostic apparatus 100 or may be implemented as a separate type connected to the ultrasound diagnostic apparatus 100 by wire or wireless.
- the ultrasound diagnostic apparatus 100 may be provided with one or a plurality of probes 20 depending on an implementation form.
- the controller 120 may control the transmitter 113 to form the transmission signal to be applied to each of the plurality of transducers in consideration of positions and focal points of the plurality of transducers included in the probe 20.
- the controller 120 may convert the received signal received from the probe 20 to analog to digital, and may control a receiver 115 to generate ultrasound data by summing the digitally converted received signals in consideration of the positions and focal points of the plurality of transducers.
- the image processor 130 may generate an ultrasound image by using the ultrasound data generated by the receiver 115.
- the display 140 may display the generated ultrasound image and various information processed by the ultrasound diagnostic apparatus 100.
- the ultrasound diagnostic apparatus 100 may include one or a plurality of displays 140 depending on the implementation form.
- the display 140 may be implemented as a touch screen in combination with a touch panel.
- the controller 120 may control an overall operation of the ultrasound diagnostic apparatus 100 and signal flow between internal components of the ultrasound diagnostic apparatus 100.
- the controller 120 may include a memory storing a program or data for performing a function of the ultrasound diagnostic apparatus 100, a processor processing the program or data.
- the controller 120 may control the operation of the ultrasound diagnostic apparatus 100 by receiving a control signal from the input 170 or an external device.
- the ultrasound diagnostic apparatus 100 may include a communication interface 160, and may be connected to the external device (for example, a server, a medical apparatus, a portable apparatus (smart phone, tablet PC, wearable device, etc.)) through the communication interface 160.
- the external device for example, a server, a medical apparatus, a portable apparatus (smart phone, tablet PC, wearable device, etc.)
- the communication interface 160 may include one or more components enabling communication with the external device, and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.
- the communication interface 160 may transmit and receive control signals and data with the external devices.
- the storage 150 may store various data or programs for driving and controlling the ultrasound diagnostic apparatus 100, input/output ultrasound data, and the obtained ultrasound images.
- the input 170 may receive a user input for controlling the ultrasound diagnostic apparatus 100.
- the user input may include an input for manipulating buttons, a keypad, a mouse, trackballs, jog switches, knobs, etc., an input of touching a touch pad or a touch screen, a voice input, a motion input, a biometric information input (for example, iris recognition, fingerprint recognition, etc.), but the disclosure is not limited thereto.
- FIGS. 2A to 2C An example of the ultrasound diagnostic apparatus 100 according to an embodiment will be described later through FIGS. 2A to 2C .
- FIG. 2 are views illustrating an ultrasound diagnostic apparatus according to an embodiment.
- the ultrasound diagnostic apparatuses 100a and 100b may include a main display 121 and a sub display 122.
- One of the main display 121 and the sub display 122 may be implemented as a touch screen.
- the main display 121 and the sub display 122 may display various types of information processed by the ultrasound diagnostic apparatuses 100a and 100b.
- the main display 121 and the sub display 122 are implemented as the touch screen, and may receive data for controlling the ultrasound diagnostic apparatuses 100a and 100b from a user by providing a GUI.
- the main display 121 may display the ultrasound image
- the sub display 122 may display a control panel for controlling the display of the ultrasound image in a GUI form.
- the sub display 122 may receive data for controlling the display of an image through the control panel displayed in the GUI form.
- the ultrasound diagnostic apparatuses 100a and 100b may control the display of the ultrasound image displayed on the main display 121 using the input control data.
- the ultrasound diagnostic apparatus 100b may further include a control panel 165 in addition to the main display 121 and the sub display 122.
- the control panel 165 may include buttons, trackballs, jog switches, knobs, and the like, and may receive data for controlling the ultrasound diagnostic apparatus 100b from the user.
- the control panel 165 may include a Time Gain Compensation (TGC) button 171, a Freeze button 172, and the like.
- TGC button 171 is a button for setting a TGC value for each depth of the ultrasound image.
- the ultrasound diagnostic apparatus 100b may maintain a state in which a frame image at a time point is displayed.
- buttons, the trackballs, the jog switches, and the knobs included in the control panel 165 may be provided on the main display 121 or the sub display 122 as the GUI.
- the ultrasound diagnostic apparatus 100c may also be implemented in a portable type.
- Examples of the portable ultrasound diagnostic apparatus 100c may include the smart phone including the probe and the application, the laptop computer, the PDA, and the tablet PC, but are not limited thereto.
- the ultrasound diagnostic apparatus 100c may include a probe 20 and a body 40, and the probe 20 may be connected to one side of the body 40 by wire or wirelessly.
- the body 40 may include a touch screen 145.
- the touch screen 145 may display the ultrasound image, various information processed by the ultrasound diagnostic apparatus 100c, and a GUI.
- the ultrasound diagnostic apparatus 100c may provide various types of clinical information including micro-calcification (shape of tissue, elasticity, speed of blood flow, etc.).
- the ultrasound diagnostic apparatus 100c may use a method of imaging micro-calcification using a post-processing algorithm of images such as imaging micro-calcification using various beamforming techniques based on channel data, or performing feature enhancement of only hyperechoic components.
- the ultrasound diagnostic apparatus 100c uses a method of extracting an area suspected of micro-calcification through post-processing of the ultrasound image, there may be a problem in that it is difficult to identify the presence of calcification tissues and that only micro-calcification tissues cannot be independently detected when information of various human tissues (muscles, fats, blood flow, etc.) is mixed in the area of interest.
- FIG. 3 is a view illustrating a structure of an ultrasound diagnostic apparatus capable of independently detecting micro-calcification according to an embodiment
- FIG. 4 is a view illustrating a structure of a controller of an ultrasound diagnostic apparatus according to an embodiment
- FIGS. 5 and 6 are views illustrating setting a focal point at which a second ultrasound pulse is focused according to an embodiment
- FIGS. 7 to 9 are views for describing pulses transmitted to detect micro-calcification according to an embodiment
- FIG. 10 is a view for describing spatiotemporal data generated according to an embodiment
- FIG. 11 is a view for describing characteristics of micro-calcification tissues according to an embodiment.
- the ultrasound diagnostic apparatus 100 may include the probe 20, the ultrasound transceiver 110, the controller 120, and the display 140. Each configuration of the ultrasound diagnostic apparatus 100 of FIG. 3 may be applied to the description of the ultrasound diagnostic apparatus 100 of FIG. 1 . Therefore, redundant descriptions are omitted.
- the ultrasound transceiver 110 may transmit an ultrasound pulse to the object through the probe 20 based on the control signal applied from the controller 120, receive a radio frequency (RF) signal reflected from the object through the probe 20, and output it to the controller 120.
- RF radio frequency
- the ultrasound transceiver 110 may obtain first data by allowing the probe 20 to transmit a first ultrasound pulse to the object and receive an echo signal reflected from the object.
- the first ultrasound pulse may be a pulse designed to obtain a brightness mode (B-mode).
- the ultrasound transceiver 110 may obtain second data by allowing the probe 20 to transmit a second ultrasound pulse different from the first ultrasound pulse to the object and repeat the operation of receiving the echo signal reflected from the object a plurality of times at predetermined time intervals.
- the ultrasound transceiver 110 may transmit the second ultrasound pulse through the probe 20 to a plurality of positions such as a first position and a second position of the object, respectively, and receive echo signals reflected from the plurality of positions of the object.
- the micro-calcification tissues present in the object may be distributed at various depths or positions.
- the controller 120 may control the ultrasound transceiver 110 to transmit the second ultrasound pulses simultaneously or at a predetermined time interval to the plurality of positions of the object in which the micro-calcification tissues are located.
- the first position and the second position of the object to which the second ultrasound pulse is reached are positions where the micro-calcification tissues are present, and are positions of the focal point preset so that the second ultrasound pulse is reached.
- the controller 120 may set the first position to a third position in which the micro-calcification tissues are present in the object as a first focal point f1 to a third focal point f3 to which the second ultrasound pulse is focused.
- the positions of the micro-calcification tissues of the object may have different depths from each other and may be spaced apart from each other, and the number of positions may be plural, so there is no limit to the number of focal points to which the second ultrasound pulse is focused.
- the controller 120 may set the first position in which the micro-calcification of the object exists as the first focal point f1 to which the second ultrasound pulse is focused.
- the controller 120 may set the second position having a different depth from the first position and having the micro-calcification of a position spaced apart from each other as the second focal point f2 to which the second ultrasound pulse is focused.
- the controller 120 may set the third position having a different depth from the first position and the second position and having the micro-calcification of a position spaced apart from each other as the third focal point f3 to which the third ultrasound pulse is focused.
- the first position to the third position in which the micro-calcification exists are located at different depths and are located at positions spaced apart from each other in a longitudinal direction.
- the first position to the third position in which the micro-calcification exists are located at different depths, but exist on a straight line in the longitudinal direction.
- the controller 120 may obtain second to fourth data by repeating an operation of transmitting the second ultrasound pulse to the first position to the third position of the object through the ultrasound transceiver 110 and receiving the echo signal reflected from the first position to the third position the plurality of times at predetermined time intervals.
- the ultrasound diagnostic apparatus 100 in order to detect the micro-calcifications present at different depths and different positions in the object, by setting a plurality of focal points to which second ultrasound pulses are focused, and transmitting the second ultrasound pulses to each of the set focal points, the micro-calcifications tissues present at different depths may be effectively detected.
- the controller 120 may control the ultrasound transceiver 110 so that the second ultrasound pulses transmitted to the plurality of positions where the micro-calcification tissues, such as the first position to the third position of the object are present, are transmitted at predetermined time intervals. That is, the controller 120 may control the ultrasound transceiver 110 so that the second ultrasound pulse is transmitted to the first focal point f1 where the micro-calcification tissues are present and the second ultrasound pulse is transmitted to the second focal point f2 after a certain period of time.
- the controller 120 may control the ultrasound transmitter 110 so that the second ultrasound pulses transmitted to the plurality of positions of the object are simultaneously transmitted. That is, by setting an area in which the ultrasound pulses are transmitted in a transducer array provided in the probe 20 in advance, the controller 120 may control the ultrasound transceiver 110 so that the second ultrasound pulses are simultaneously transmitted to the plurality of focal points of the object in each predetermined area of the transducer array.
- the micro-calcification tissues present in the object a plurality of tissues may exist, and the existing areas may be distributed at different depths or positions.
- the existing areas may be distributed at different depths or positions.
- the micro-calcification tissues exist in the first and second positions of the object, and the focal points to be set are also the first focal point f1 and the second focal point f2.
- the second ultrasound pulse may be a pulse designed based on the characteristics of the micro-calcification tissues.
- the second ultrasound pulse may be a pulse having a predefined sequence of a waveform size, a phase sign, a period, etc. to detect micro-calcification.
- the second ultrasound pulse may be designed such that a negative pressure component is a predominant asymmetric pulse compared to a positive pressure component, and has a longer wavelength than the first ultrasound pulse.
- the controller 120 may obtain data including information about the echo signal reflected from the object from the ultrasound transceiver 110. That is, the controller 120 may obtain the first data from the ultrasound transceiver 110. In addition, the controller 120 may obtain the second data from the first position of the object, and may obtain the third data from the second position of the object. The controller 120 may obtain RF channel data or complex baseband I/Q data that has passed through an ADC.
- the controller 120 may detect the micro-calcification tissues present at different positions in the object by analyzing the second data and the third data.
- the controller 120 may reconstruct the second data and the third data into three-dimensional (3D) data including information about an axial depth, a lateral width, and a time axis, and may extract the micro-calcification tissues by analyzing the 3D data.
- the 3D data may be spatiotemporal data based on the axial depth, the lateral area, and the time axis.
- the controller 120 may estimate at least one of an intensity, frequency, and phase of the echo signal reflected from each area of the object by applying singular value decomposition (SVD) to the second data and the third data, based on the estimated value, the micro-calcification tissues in the object may be detected.
- SMD singular value decomposition
- the controller 120 may calculate a dispersion of a phase change over time of the echo signal reflected from each area of the object based on the second data and detect an area in which the dispersion of the phase change is greater than or equal to a predetermined value as the micro-calcification tissues in the object.
- the display 140 may display the ultrasound image generated based on the first data, and may display the image representing the micro-calcification tissues detected at the first and second positions of the object.
- the display 140 may independently display the ultrasound image and the image representing the micro-calcification in different areas, respectively.
- the display 140 may display a single image by fusing a B-mode image of a cross section of the object and the image representing the micro-calcification.
- the display 140 may display an area corresponding to the detected micro-calcification tissues on the ultrasound image, which is the B-mode image of the cross section of the object.
- the display 140 may independently display the micro-calcification tissues present at different positions within the object.
- the display 140 may display a color bar representing a plurality of colors corresponding to values representing characteristics of the micro-calcification tissues, select a color from the color bar based on values representing characteristics of the detected micro-calcification tissues, and display the selected color in the area corresponding to the detected micro-calcification tissues included in the ultrasound image.
- a value representing the characteristics of the micro-calcification tissues may represent a roughness of the phase change over time of the echo signal reflected from the microscopic tissue.
- the controller 120 may include a pulse generator 210, a spatiotemporal data obtainer 220, an ultrasound image generator 230, a micro-calcification detector 240, and a micro-calcification image generator 250.
- a pulse generator 210 may include a spatiotemporal data obtainer 220, an ultrasound image generator 230, a micro-calcification detector 240, and a micro-calcification image generator 250.
- Each of the blocks 210, 220, 230, 240, and 250 included in the controller 120 illustrated in FIG. 4 may be an individual hardware configuration or may be functional blocks implemented by the controller 120. Accordingly, the operations of the blocks 210, 220, 230, 240, and 250 described below may be performed by the controller 120.
- the pulse generator 210 may generate the ultrasound pulse to be transmitted to the object through the probe 20.
- the pulse generator 210 may control the ultrasound transceiver 110 to form the transmission signal to be applied to each of the plurality of transducers in consideration of the positions and focal points of the plurality of transducers included in the probe 20.
- the pulse generator 210 may transmit the ultrasound pulse by controlling the ultrasound transceiver 110.
- the pulse generator 210 may generate not only a gray scale ultrasound image of the object scanned according to an amplitude mode (A-mode), the B-mode, and a motion mode (M-mode), but also the ultrasound pulse designed to obtain a Doppler image representing the movement of the object.
- A-mode amplitude mode
- M-mode motion mode
- the pulse generator 210 may generate a pre-designed first ultrasound pulse to obtain the B-mode image.
- the pulse generator 210 may generate a pre-designed second ultrasound pulse for micro-calcification detection.
- the pulse generator 210 may generate the second ultrasound pulse in which transmission parameters such as a sign, a magnitude, a phase, a period, etc. of a waveform are determined in advance based on the micro-calcification characteristic.
- the pulse generator 210 may generate the ultrasound pulse having a symmetrical (+)/(-) size as the first ultrasound pulse, and may generate a pulse having an asymmetrical (+)/(-) size as the second ultrasound pulse.
- the pulse generator 210 may improve a micro-calcification detection performance by using an asymmetric ultrasound pulse.
- the asymmetric ultrasound pulse may include a pulse in which a positive pressure is dominant as in a graph 510 or a pulse in which a negative pressure is dominant as in a graph 520.
- the pulse illustrated in FIG. 7 may be designed in a form in which a harmonic component is added to a transmission center frequency f0 as illustrated in [Equation 1] below.
- the harmonic component may be designed in a form in which a 2f0 component is multiplied by a weight of a0.
- f n f 0 + 2 f 0 ⁇ a 0
- the ultrasound pulse optimized for micro-calcification detection may be designed based on experimental results of FIGS. 8 and 9 .
- the graph 600 of FIG. 8 illustrates an average value of the micro-calcification signal received from the object when the ultrasound pulse of the waveform illustrated in FIG. 7 is applied to the object including a phantom simulating breast micro-calcification.
- the micro-calcification signal may refer to a signal of a micro-calcification area extracted based on data obtained from the echo signal received from the object.
- the micro-calcification signal may be obtained through processes illustrated in FIGS. 10 and 12 , and a specific method of obtaining the micro-calcification signal will be described later.
- the graph 610 of FIG. 8 illustrates a change in the average value of the micro-calcification signal received from the object when a high voltage of the ultrasound pulse dominated by the positive pressure illustrated in the graph 510 of FIG. 7 is increased.
- the graph 620 of FIG. 8 illustrates the change in the average value of the micro-calcification signal received from the object when the high voltage of the ultrasound pulse dominated by the positive pressure illustrated in the graph 520 of FIG. 7 is increased.
- the pulse generator 210 may preferably generate the ultrasound pulse with the predominant negative pressure as the second ultrasound pulse.
- the graph 700 of FIG. 9 illustrates the average value of the micro-calcification signal received from the object when the ultrasound pulse of the waveform illustrated in the graph 520 of FIG. 7 is applied to the object including the phantom simulating breast micro-calcification.
- the graph 700 of FIG. 9 illustrates the change in the average value of the micro-calcification signal received from the object when the negative pressure illustrated in the graph 520 of FIG. 7 increases the negative pressure of the predominant ultrasound pulse.
- the graph 710 of FIG. 9 illustrates the change in the average value of the micro-calcification signal received from the object when the negative pressure having a low (penetration) frequency increases the negative pressure of the predominant ultrasound pulse.
- the graph 720 of FIG. 9 illustrates the change in the average value of the micro-calcification signal received from the object when the negative pressure having a general frequency increases the negative pressure of the predominant ultrasound pulse.
- the pulse generator 210 may preferably generate the ultrasound pulse having the wavelength longer than the predetermined value as the second ultrasound pulse.
- the pulse generator 210 may preferably generate the ultrasound pulse having the negative pressure greater than the predetermined value as the second ultrasound pulse.
- the pulse generator 210 may generate the ultrasound pulse in which the magnitude of the negative pressure is greater than the magnitude of the negative pressure of the first ultrasound pulse as the second ultrasound pulse.
- the spatiotemporal data obtainer 220 may reconstruct the ultrasound data reflected from the object into spatiotemporal data including spatiotemporal information.
- the spatiotemporal data obtainer 220 may obtain spatiotemporal data from the second data obtained from the echo signal reflected from the object in response to the second ultrasound pulse transmitted to the first position and the second position of the object.
- the ultrasound diagnostic apparatus 100 may obtain the second data by repeatedly performing an operation of transmitting the second ultrasound pulse to the first position in which the micro-calcification of the object exists through the probe 20 and receiving the echo signal at a predefined number of times and time intervals.
- the ultrasound diagnostic apparatus 100 may obtain the third data by repeatedly performing an operation of transmitting the second ultrasound pulse to the second position, which is a position different from the first position of the object, and receiving the echo signal at the predefined number of times and time intervals.
- the second data and the third data may include a plurality of image data obtained with respect to the cross section of the object at a predetermined period, and each image data may include spatial information about the cross section of the object.
- the spatiotemporal data obtainer 220 may be reconstructed into the 3D data 801 including information about the axial depth, the lateral width, and the time by arranging the plurality of image data included in the second data and the third data on the time axis. Since the data obtained by the spatiotemporal data obtainer 220 includes both temporal information and spatial information, it may be described as spatiotemporal data.
- the micro-calcification detector 240 may independently detect the spatiotemporal data obtained from the spatiotemporal data obtainer 220 by distinguishing between general tissues and the micro-calcification through spatiotemporal characteristic analysis. For example, the micro-calcification detector 240 may independently detect the micro-calcification signal by performing singular value decomposition 440 on spatiotemporal data. In addition, the micro-calcification detector 240 may perform independent micro-calcification signal detection based on a power or an average frequency of the micro-calcification signal, a phase change, etc. using an autocorrelation function. For example, the micro-calcification detector 240 may utilize a micro-calcification power estimation value based on the autocorrelation function.
- the micro-calcification detector 240 may separate and detect the micro-calcification signal from the spatiotemporal data based on the characteristics of the micro-calcification.
- the micro-calcification has a random phase change characteristic compared to the general tissues. It is known that this is due to a non-uniform nature of a surface of the calcification tissue.
- the graph 910 of FIG. 11 illustrates a phase change of a signal of a blood flow area extracted based on data obtained in response to the transmitted ultrasound pulse when the ultrasound pulse is transmitted to the object including a blood vessel a plurality of times.
- the graph 920 of FIG. 11 illustrates the phase change of the signal of the micro-calcification area extracted based on data obtained in response to the transmitted ultrasound pulse when the ultrasound pulse is transmitted to the object including the micro-calcification the plurality of times.
- the micro-calcification detector 240 may separate and detect the micro-calcification signal from the spatiotemporal data based on the phase change characteristic of the micro-calcification.
- the micro-calcification detector 240 may determine that it is the micro-calcification tissues when the roughness of the phase change is greater than or equal to the predetermined value based on the predetermined value.
- FIG. 12 is a view illustrating a method of detecting micro-calcification tissues by a micro-calcification detector according to an embodiment.
- the micro-calcification detector 240 may generate a Casorati matrix (x ⁇ z, t) to arrange the data in a spatiotemporal manner, based on the spatiotemporal data (1010) obtained by the spatiotemporal data obtainer 220 (1020).
- the micro-calcification detector 240 may perform the singular value decomposition on the generated Casorati matrix (1030).
- an U vector may denote data for spatial information
- a V vector denote data for temporal information
- a ⁇ vector may denote a ranking of singular values.
- the micro-calcification detector 240 may apply a spatiotemporal signal characteristic analysis function to the obtained singular value vector S.
- the spatiotemporal signal characteristic analysis function may include a codispersion matrix analysis, the autocorrelation function, and the like.
- the micro-calcification detector 240 may obtain a spatiotemporal codispersion matrix based on the obtained singular value vector S (1040).
- the micro-calcification detector 240 may separate and detect an independent micro-calcification signal by analyzing a spatiotemporal signal characteristic based on a result of applying the spatiotemporal signal characteristic analysis function. For example, the micro-calcification detector 240 may detect the signal in the area having a wide distribution of the phase change over time as the micro-calcification signal (1050).
- the ultrasound image generator 230 may reconstruct an A-mode image, a B-mode image, an M-mode image, a Doppler image, and the like, based on data received in response to the ultrasound pulse applied to the object.
- the ultrasound image generator 230 may generate the B-mode image representing the cross section of the object by reconstructing the first data received in response to the first ultrasound pulse transmitted to the object.
- the ultrasound image generator 230 may output the generated ultrasound image to the display 140.
- the micro-calcification image generator 250 may generate the micro-calcification image by reconstructing the micro-calcification signal independently detected by the micro-calcification detector 240 into a two-dimensional (2D) image.
- the micro-calcification image generator 250 may generate the micro-calcification image in which the micro-calcification area included in the cross section of the object to which the ultrasound pulse is transmitted is displayed.
- the micro-calcification image generator 250 may apply various image post-processing to the generated micro-calcification image.
- the micro-calcification image generator 250 may output the generated micro-calcification image to the display 140.
- FIGS. 13 and 14 are views illustrating screens displayed on an ultrasound diagnostic apparatus according to an embodiment.
- the display 140 may independently display an ultrasound image 1110 generated by the controller 120 and an image 1130 representing the micro-calcification in different areas on a screen 1100.
- An area 1113 on the ultrasound image 1110 is an area in which the micro-calcification is concentrated in the object, and is the plurality of areas in which the micro-calcification exists, such as an area 1113-1 corresponding to the first position in which the micro-calcification exists to an area 1113-3 corresponding to the third position.
- the image 1130 in which only the micro-calcification area is independently displayed may be generated and displayed. Similar to the ultrasound image 1110, it is identified that micro-calcifications are concentrated in the areas 1133-1, 1113-2, and 1113-3 on the image 1130.
- the embodiment of the disclosure is not limited to the embodiment illustrated in FIG. 13 , and a screen in which the ultrasound image and the image representing the micro-calcification are fused may be displayed.
- the display 140 may display an image in which the area corresponding to the micro-calcification is displayed on the ultrasound image by fusing the ultrasound image and the image representing the micro-calcification.
- the area corresponding to the micro-calcification may be displayed as one of a predetermined color, brightness, figure, and symbol on the ultrasound image, or may be displayed to flash.
- the display 140 may simultaneously display the color bar representing the plurality of colors corresponding to values representing characteristics of the micro-calcification tissues.
- the display 140 may select the color from the color bar based on the value representing characteristics of the detected micro-calcification tissues, and display the selected color in an area corresponding to the detected micro-calcification tissues.
- embodiments are not limited thereto, and various methods for expressing the characteristics of the micro-calcification tissues other than a color bar form may be used.
- the value representing the characteristics of micro-calcification tissues may include roughness of the phase of the micro-calcification signal obtained from the corresponding micro-calcification tissues.
- the ultrasound diagnostic apparatus 100 may increase an accuracy of breast cancer diagnosis by displaying the phase roughness of the micro-calcification signal corresponding to the micro-calcification tissues together with the image representing the micro-calcification tissues.
- FIG. 14 illustrates an example of a screen displaying the roughness of the phase as the characteristic of micro-calcification tissues.
- the display 140 may display an image 1210 in which areas 1211, 1212, 1213, and 1214 corresponding to the micro-calcifications existing in a first position 1210-1 of the object on the ultrasound image are displayed.
- the areas 1211, 1212, 1213, and 1214 corresponding to micro-calcification may be displayed in predetermined colors on the ultrasound image.
- the display 140 may display the image 1210 in which the areas 1215, 1216, 1217, and 1218 corresponding to micro-calcification existing in a second position 1210-2 of the object are displayed on the ultrasound image.
- the areas 1215, 1216, 1217, and 1218 corresponding to micro-calcification may be displayed in predetermined colors on the ultrasound image.
- the display 140 may also display a color bar 1230 representing the plurality of colors corresponding to values representing characteristics of micro-calcification tissues.
- An area 1220 of FIG. 14 illustrates that the roughness of the phase of the micro-calcification signal increases toward the top of the color bar 1230.
- the display 140 may display the areas 1211 to 1218 in which the micro-calcifications exist by using different colors selected from the color bar, based on the value representing the characteristics of the detected micro-calcification tissues.
- FIG. 15 is a view illustrating an index representing focusing lines in which a plurality of focal points for a second ultrasound pulse are located, according to an embodiment.
- the display 140 may display an index 1240 indicating focusing lines L1 and L2 in which the first focal point f1 and the second focal point f2 to which the second ultrasound pulse is focused is located in the B-mode image of the cross section of the object.
- the controller 120 may set the first and second positions in which the micro-calcification tissues exist in the object as the first focal point f1 and the second focal point f2 at which the second ultrasound pulse is focused.
- the display 140 may display an index 1241 for the focusing line L1 indicating the first focal point f1 set at the first position in which micro-calcification tissues of the object exist. Likewise, the display 140 may display an index 1242 for the focusing line L2 indicating the second focal point f2 set at the second position in which micro-calcification tissues of the object exist.
- the user may identify the first position and the second position of the object set as the focal point for micro-calcification detection through a display screen of the display 140.
- FIG. 15 a case in which there are two focal points set for micro-calcification detection is described as an example, but when the plurality of micro-calcification tissues exist in the object at different depths or positions, the controller 120 may set two or more focal points to which the second ultrasound pulse is focused, and accordingly, the plurality of focusing lines and indexes 1240 indicating the plurality of focal points may be displayed on the display 140.
- FIG. 16 is a flowchart of a method of displaying an ultrasound image according to an embodiment.
- Each operation of a method described below may be performed by each component of the ultrasound diagnostic apparatus 100 illustrated in FIG. 3 .
- the description above with respect to the ultrasound diagnostic apparatus 100 may also be applied to each operation of the following methods.
- the ultrasound diagnostic apparatus 100 may obtain the first data by transmitting the first ultrasound pulse to the object and receiving the echo signal reflected from the object.
- the ultrasound diagnostic apparatus 100 may obtain the second data by repeating the operation of transmitting the second ultrasound pulse different from the first ultrasound pulse to the first position of the object and receiving the echo signal reflected from the object the plurality of times at predetermined time intervals.
- the ultrasound diagnostic apparatus 100 may obtain the second data by repeating the operation of transmitting the second ultrasound pulse different from the first ultrasound pulse to the second position of the object and receiving the echo signal reflected from the object the plurality of times at predetermined time intervals.
- the second ultrasound pulse may be the pulse designed based on the characteristics of micro-calcification tissues.
- the second ultrasound pulse is an asymmetric pulse in which the negative pressure component is dominant compared to the positive pressure component, and may have the longer wavelength than the first ultrasound pulse.
- the operation may increase in correspondence with the depth at which the micro-calcification tissues exist.
- the ultrasound diagnostic apparatus 100 may detect micro-calcification tissues of the first position and the second position in the object by analyzing the second data and the third data.
- the ultrasound diagnostic apparatus 100 may detect only the micro-calcification signal independently from the general tissue by analyzing the received RF signal or the I/Q signal in spatiotemporal manner in response to the ultrasound pulse transmitted to the object.
- a method of detecting the micro-calcification signal a method of estimating power using the spatiotemporal signal characteristic analysis function (e.g., autocorrelation) and estimating the average frequency or dispersion may be used.
- the spatiotemporal signal characteristic analysis function e.g., autocorrelation
- the ultrasound diagnostic apparatus 100 may reconstruct the second and third data obtained in operations 2100 and 2200 into 3D data including information about the axial depth, the lateral width, and the time.
- the ultrasound diagnostic apparatus 100 may extract micro-calcification tissues present at different positions within the object by analyzing the 3D data.
- the ultrasound diagnostic apparatus 100 may estimate at least one of the intensity, frequency, and phase of the echo signal reflected from each area of the object by applying SVD to the second data and the third data, and may detect the micro-calcification tissues in the object based on the estimated value.
- the ultrasound diagnostic apparatus 100 may calculate the dispersion of the phase change over time of the echo signal reflected from each area of the object based on the second data and the third data, and detect the area in which the dispersion of the phase change is more than the predetermined value as the micro-calcification tissues in the object.
- the ultrasound diagnostic apparatus 100 may display the ultrasound image generated based on the first data, and may display the image representing micro-calcification tissues detected in the first and second positions of the object.
- the ultrasound diagnostic apparatus 100 may generate the ultrasound image by reconstructing the first data, and may generate the micro-calcification image by reconstructing the micro-calcification signal detected in operation 2300 for a purpose of displaying on the screen.
- the ultrasound diagnostic apparatus 100 may individually display the ultrasound images and the images representing micro-calcification tissues in different areas. Alternatively, the ultrasound diagnostic apparatus 100 may display a single image by fusing the ultrasound image and the image representing micro-calcification tissues. The ultrasound diagnostic apparatus 100 may display the single image, indicating the area corresponding to micro-calcification tissues detected on the ultrasound image.
- the ultrasound image generated based on the first data is the B-mode image representing the cross section of the object
- the image representing micro-calcification tissues may be the image displaying the position of micro-calcification tissues within the cross section by color, contrast, symbols, figures, blinking, and the like.
- the ultrasound diagnostic apparatus 100 may further display the color bar representing the plurality of colors corresponding to values representing characteristics of micro-calcification tissues.
- the ultrasound diagnostic apparatus 100 may select the color from the color bar based on the value representing the characteristic of the detected micro-calcification tissues, and display the selected color in the area corresponding to the detected micro-calcification tissues.
- the value representing characteristics of micro-calcification tissues may be the value representing roughness of the phase change over time of the echo signal reflected from the micro-calcification tissues.
- the ultrasound diagnostic apparatus may accurately detect micro-calcification tissues distributed at different depths or positions, and may independently display only micro-calcification images, or display images representing micro-calcification by fusion with ultrasound B-mode images.
- micro-calcification not only can breast cancer be diagnosed early, but also micro-calcification generated in organs other than breasts as calcium is accumulated in the human body can be monitored, thereby improving the accuracy of diagnosis of various diseases.
- the disclosed embodiments may be implemented as S/W program including instructions stored in a computer-readable storage medium.
- the computer may include the ultrasound diagnostic apparatus according to the disclosed embodiments as a device capable of calling a stored command from the storage medium and operating according to the disclosed embodiments according to the called command.
- the computer-readable storage medium may be provided in the form of a non-transitory storage medium.
- 'non-transitory' may refer to that the storage medium does not contain a signal and is tangible, but does not distinguish between semi-permanent or temporary storage of data in the storage medium.
- the ultrasound diagnostic apparatus or method according to the disclosed embodiments may be provided by being included in a computer program product.
- the computer program product is commodities that can be traded between sellers and buyers.
- the computer program product may include the S/W program and the storage medium readable by the computer in which the S/W program is stored.
- the computer program product includes a manufacturer of the ultrasound diagnostic apparatus or a product (e.g., a downloadable app) in the form of the S/W program that is electronically distributed through an electronic market (e.g., Google Play Store, App Store).
- an electronic market e.g., Google Play Store, App Store
- at least a part of the S/W program may be stored in the storage medium or may be temporarily generated.
- the storage medium may be a server of the manufacturer, the server of the electronic market, or the storage medium of a relay server temporarily storing SW programs.
- the computer program product may include the storage medium of the server or the storage medium of a terminal in a system composed of the server and a terminal (e.g., ultrasound diagnostic apparatus).
- a terminal e.g., ultrasound diagnostic apparatus
- the computer program product may include the storage medium of the third device.
- the computer program product may include the S/W program itself transmitted from the server to the terminal or the third device, or transmitted from the third device to the terminal.
- one of the server, the terminal, and the third device may execute the computer program product to perform the method according to the disclosed embodiments.
- two or more of the server, the terminal, and the third device may execute the computer program product to distribute the method according to the disclosed embodiments.
- a server e.g., a cloud server or an artificial intelligence server
- the third device may control the terminal connected in communication with the third device to perform the method according to the disclosed embodiment.
- the third device may control the ultrasound diagnostic apparatus to remotely control the ultrasound diagnostic apparatus to irradiate the ultrasound signal as the object and to generate the image of the portion inside the object based on signal information reflected from the object.
- the third device may execute the computer program product to directly perform the method according to the disclosed embodiment based on a value input from an auxiliary device (e.g., the probe of the medical apparatus).
- the auxiliary device may irradiate the ultrasound signal as the object and obtain the ultrasound signal reflected from the object.
- the third device may receive reflected signal information from the auxiliary device, and may generate the image of the portion inside the object based on the input signal information.
- the third device may download the computer program product from the server and execute the downloaded computer program product.
- the third device may perform the method according to the disclosed embodiments by executing the computer program product provided in a preloaded state.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Pathology (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- Heart & Thoracic Surgery (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Vascular Medicine (AREA)
- Human Computer Interaction (AREA)
- Physiology (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
Description
- This application is based on and claims priority under 35 U.S.C. §119 to Korean Patent Application No.
, the disclosure of which is incorporated herein by reference.10-2020-0008399, filed on January 22, 2020 - The disclosure relates to an ultrasound diagnostic apparatus and a method of controlling the same, and a computer program product, and more particularly, to a technology for generating and displaying an image representing micro-calcification tissues in the ultrasound diagnostic apparatus.
- A production of micro-calcification according to the accumulation of calcium in a human body causes disorders in organs or cardiovascular function in the human body and manifests various diseases. Particularly, micro-calcification tissues present in a breast are known to have a high possibility of metastasis to malignant tumors, and thus a technology capable of detecting the micro-calcification tissues at an early stage is required to diagnose breast cancer early.
- In a conventional micro-calcification detection technology, mainly X-ray images can be used in consideration of the fact that calcareous material absorbs relatively little X-rays. However, this technology has disadvantages that it is impossible to detect the micro-calcification tissues in real time, the accessibility of the user is poor, and there is a potential risk (blood flow apoptosis, cancer expression, DNA mutation) due to exposure of a patient to radiation. In addition, in clinically reading the micro-calcification tissues, evaluation of objectivity and standardized criteria are insufficient.
- On the other hand, an ultrasound diagnostic apparatus irradiates an ultrasound signal generated from a transducer of a probe to an object, receives information of a signal reflected from the object, and obtains at least one image of a portion (for example, soft tissue or blood flow) inside the object.
- The ultrasound diagnostic apparatus is harmless to the human body and has the advantage of being able to observe an internal structure and characteristics of the human body noninvasively. The ultrasound diagnostic apparatus may provide various types of clinical information (tissue shape, elasticity, blood flow rate, etc.). In particular, the ultrasound diagnostic apparatus may be used for monitoring micro-calcification, or for real-time monitoring for biopsy of micro-calcification tissues. In this case, breast ultrasound or musculoskeletal ultrasound may be used.
- In recent years, the importance of a method of efficiently detecting a plurality of micro-calcification tissues distributed at different depths or different positions within the object is increasing.
- An aspect of the disclosure provides an ultrasound diagnostic apparatus that detects a plurality of micro-calcification tissues distributed at different depths or positions, and displays the detected micro-calcification tissues as an image.
- Additional aspects of the disclosure will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the disclosure.
- According to an aspect of the disclosure, there is provided an ultrasound diagnostic apparatus including: a probe; an ultrasound transceiver configured to transmit an ultrasound signal to an object through the probe and receive an echo signal reflected from the object; a controller configured to obtain first data by controlling the ultrasound transceiver to transmit a first ultrasound pulse to the object and receive the echo signal reflected from the object, to obtain second data by controlling the ultrasound transceiver to repeat an operation of transmitting a second ultrasound pulse different from the first ultrasound pulse to a first position of the object and receiving the echo signal reflected from the first position of the object a plurality of times at predetermined time intervals, to obtain third data by controlling the ultrasound transceiver to repeat an operation of transmitting the second ultrasound pulse to a second position of the object and receiving the echo signal reflected from the second position of the object the plurality of times at predetermined time intervals, and to detect the micro-calcification tissues of the first position and the second position by analyzing the obtained second and third data; and a display configured to display an ultrasound image generated based on the obtained first data and an image representing micro-calcification tissues detected in the first position and the second position.
- The first position of the object may be a position that is a different depth from the second position and is spaced apart from each other. The controller may be configured to set the first position and the second position of the object as a first focal point and a second focal point to which the transmitted second ultrasound pulse is focused, respectively.
- The controller may be configured to control the ultrasound transceiver so that the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object are transmitted at predetermined time intervals.
- The controller may be configured to control the ultrasound transceiver so that the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object are simultaneously transmitted.
- The second ultrasound pulse may be a pulse designed based on characteristics of the micro-calcification tissues.
- The second ultrasound pulse may be an asymmetric pulse in which a negative pressure component is dominant compared to a positive pressure component, and have a longer wavelength than the first ultrasound pulse.
- In detecting the micro-calcification tissues, the controller may be configured to reconstruct the obtained second and third data into three-dimensional (3D) data including information about an axial depth, a lateral width, and a time, and to extract the micro-calcification tissues by analyzing the 3D data.
- In detecting the micro-calcification tissues, the controller may be configured to estimate at least one of an intensity, frequency, or phase of the echo signal reflected from each area of the object by applying singular value decomposition (SVD) to the obtained second and third data, and to detect the micro-calcification tissues in the object based on the estimated value.
- In detecting the micro-calcification tissues, the controller may be configured to calculate a dispersion of a phase change over time of the echo signal reflected from each area of the object based on the obtained second and third data, and to detect an area in which the dispersion of the phase change is greater than or equal to a predetermined value as the micro-calcification tissues in the object.
- The display may be configured to display an index indicating focusing lines in which the set first focal point and second focal point are located in a brightness mode (B-mode) image of a cross section of the object.
- The display is configured to display a color bar representing a plurality of colors corresponding to values representing characteristics of the micro-calcification tissues, to select a color from the color bar based on the value representing the characteristics of the detected micro-calcification tissues, and to display the selected color in an area corresponding to the detected micro-calcification tissues included in the ultrasound image.
- The value representing the characteristics of the micro-calcification tissues may represent a roughness of a phase change over time of the echo signal reflected from the micro-calcification tissues.
- The ultrasound image may be a brightness mode (B-mode) image for a cross section of the object. The display may be configured to display an area corresponding to the detected micro-calcification tissues on the ultrasound image.
- According to another aspect of the disclosure, there is provided a method of controlling an ultrasound diagnostic apparatus including: obtaining, by a controller, first data by transmitting a first ultrasound pulse to the object and receiving the echo signal reflected from the object; obtaining, by the controller, second data by repeating an operation of transmitting a second ultrasound pulse different from the first ultrasound pulse to a first position of the object and receiving the echo signal reflected from the first position of the object a plurality of times at predetermined time intervals; obtaining, by the controller, third data by repeating an operation of transmitting the second ultrasound pulse to a second position of the object and receiving the echo signal reflected from the second position of the object the plurality of times at predetermined time intervals; detecting, by the controller, the micro-calcification tissues of the first position and the second position by analyzing the obtained second and third data; and displaying, by a display, an ultrasound image generated based on the obtained first data and an image representing micro-calcification tissues detected in the first position and the second position.
- The first position of the object may be a position that is a different depth from the second position and is spaced apart from each other. The method may further include setting, by the controller, the first position and the second position of the object as a first focal point and a second focal point to which the transmitted second ultrasound pulse is focused, respectively.
- The transmitting of the second ultrasound pulse may further include controlling the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object to be transmitted at predetermined time intervals.
- The transmitting of the second ultrasound pulse may further include controlling the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object to be simultaneously transmitted.
- The detecting of the micro-calcification tissues of the first position and the second position may further include reconstructing the obtained second and third data into three-dimensional (3D) data including information about an axial depth, a lateral width, and a time; and extracting the micro-calcification tissues by analyzing the 3D data.
- The detecting of the micro-calcification tissues of the first position and the second position may further include estimating at least one of an intensity, frequency, or phase of the echo signal reflected from each area of the object by applying singular value decomposition (SVD) to the obtained second and third data; and detecting the micro-calcification tissues in the object based on the estimated value.
- The detecting of the micro-calcification tissues of the first position and the second position may further include calculating a dispersion of a phase change over time of the echo signal reflected from each area of the object based on the obtained second and third data; and detecting an area in which the dispersion of the phase change is greater than or equal to a predetermined value as the micro-calcification tissues in the object.
- The method may further include displaying, by the display, an index indicating focusing lines in which the set first focal point and second focal point are located in a brightness mode (B-mode) image of a cross section of the object.
- The displaying of the ultrasound image and the image representing the micro-calcification tissues detected in the first position and the second position may further include displaying, by the display, a color bar representing a plurality of colors corresponding to values representing characteristics of the micro-calcification tissues; selecting, by the display, a color from the color bar based on the value representing the characteristics of the detected micro-calcification tissues; and displaying, by the display, the selected color in an area corresponding to the detected micro-calcification tissues included in the ultrasound image.
- The value representing the characteristics of the micro-calcification tissues may represent a roughness of a phase change over time of the echo signal reflected from the micro-calcification tissues.
- The ultrasound image may be a brightness mode (B-mode) image for a cross section of the object. The displaying of the ultrasound image and the image representing the micro-calcification tissues detected in the first position and the second position may further include displaying an area corresponding to the detected micro-calcification tissues on the ultrasound image.
- According to another aspect of the disclosure, there is provided a computer program product including: non-transitory computer readable recording medium storing a computer program code for performing the method of controlling the ultrasound diagnostic apparatus.
- These and/or other aspects of the disclosure will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
-
FIG. 1 is a block diagram illustrating a configuration of an ultrasound diagnostic apparatus according to an embodiment. -
FIG. 2 are views illustrating an ultrasound diagnostic apparatus according to an embodiment. -
FIG. 3 is a view illustrating a structure of an ultrasound diagnostic apparatus capable of independently detecting micro-calcification according to an embodiment. -
FIG. 4 is a view illustrating a structure of a controller of an ultrasound diagnostic apparatus according to an embodiment. -
FIGS. 5 and6 are views illustrating setting a focal point at which a second ultrasound pulse is focused according to an embodiment. -
FIGS. 7 to 9 are views for describing pulses transmitted to detect micro-calcification according to an embodiment. -
FIG. 10 is a view for describing spatiotemporal data generated according to an embodiment. -
FIG. 11 is a view for describing characteristics of micro-calcification tissues according to an embodiment. -
FIG. 12 is a view illustrating a method of detecting micro-calcification tissues by a micro-calcification detector according to an embodiment. -
FIGS. 13 and14 are views illustrating screens displayed on an ultrasound diagnostic apparatus according to an embodiment. -
FIG. 15 is a view illustrating an index representing focusing lines in which a plurality of focal points for a second ultrasound pulse are located, according to an embodiment. -
FIG. 16 is a flowchart of a method of displaying an ultrasound image according to an embodiment. - Configurations shown in the embodiments and drawings described herein are only embodiments of the disclosed invention, there may be various modifications that can replace the embodiments and drawings of the present specification at the time of filing of the present application.
- Like reference numerals refer to like elements throughout the specification. Not all elements of the embodiments of the disclosure will be described, and the description of what are commonly known in the art or what overlap each other in the exemplary embodiments will be omitted. The terms as used throughout the specification, such as "∼ part," "∼ module," "∼ member," "∼ block," etc., may be implemented in software and/or hardware, and a plurality of "∼ parts," "∼ modules," "∼ members," or "∼ blocks" may be implemented in a single element, or a single "∼ part," "∼ module," "∼ member," or "∼ block" may include a plurality of elements.
- In the present specification, an "image" may include a medical image obtained by a medical imaging device such as a magnetic resonance imaging (MRI) apparatus, a computed tomography (CT) apparatus, an ultrasound imaging apparatus, or an X-ray imaging apparatus.
- In the present specification, an 'object' is to be captured, and may include a person, an animal, or a part thereof. For example, the object may include a portion (e.g., organ) of a human body or a phantom.
- Throughout the specification, an "ultrasound image" may refer to an image of the object transmitted to the object and processed based on an ultrasound signal reflected from the object.
- Hereinafter, embodiments of the disclosure will be described in detail with reference to the accompanying drawings.
-
FIG. 1 is a block diagram illustrating a configuration of an ultrasound diagnostic apparatus according to an embodiment. - Referring to
FIG. 1 , an ultrasounddiagnostic apparatus 100 may include aprobe 20, anultrasound transceiver 110, acontroller 120, animage processor 130, adisplay 140, astorage 150, acommunication interface 160, and aninput 170. - The ultrasound
diagnostic apparatus 100 may be implemented not only in a cart type but also in a portable type. Examples of the portable ultrasound diagnostic apparatus may include a smart phone including a probe and an application, a laptop computer, a PDA, and a tablet PC, but are not limited thereto. - The
probe 20 may include a plurality of transducers. The plurality of transducers may transmit the ultrasound signal to theobject 10 according to a transmission signal applied from atransmitter 113. The plurality of transducers may receive the ultrasound signal reflected from theobject 10 and form a received signal. In addition, theprobe 20 may be implemented integrally with the ultrasounddiagnostic apparatus 100 or may be implemented as a separate type connected to the ultrasounddiagnostic apparatus 100 by wire or wireless. In addition, the ultrasounddiagnostic apparatus 100 may be provided with one or a plurality ofprobes 20 depending on an implementation form. - The
controller 120 may control thetransmitter 113 to form the transmission signal to be applied to each of the plurality of transducers in consideration of positions and focal points of the plurality of transducers included in theprobe 20. - The
controller 120 may convert the received signal received from theprobe 20 to analog to digital, and may control areceiver 115 to generate ultrasound data by summing the digitally converted received signals in consideration of the positions and focal points of the plurality of transducers. - The
image processor 130 may generate an ultrasound image by using the ultrasound data generated by thereceiver 115. - The
display 140 may display the generated ultrasound image and various information processed by the ultrasounddiagnostic apparatus 100. The ultrasounddiagnostic apparatus 100 may include one or a plurality ofdisplays 140 depending on the implementation form. In addition, thedisplay 140 may be implemented as a touch screen in combination with a touch panel. - The
controller 120 may control an overall operation of the ultrasounddiagnostic apparatus 100 and signal flow between internal components of the ultrasounddiagnostic apparatus 100. Thecontroller 120 may include a memory storing a program or data for performing a function of the ultrasounddiagnostic apparatus 100, a processor processing the program or data. In addition, thecontroller 120 may control the operation of the ultrasounddiagnostic apparatus 100 by receiving a control signal from theinput 170 or an external device. - The ultrasound
diagnostic apparatus 100 may include acommunication interface 160, and may be connected to the external device (for example, a server, a medical apparatus, a portable apparatus (smart phone, tablet PC, wearable device, etc.)) through thecommunication interface 160. - The
communication interface 160 may include one or more components enabling communication with the external device, and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module. - The
communication interface 160 may transmit and receive control signals and data with the external devices. - The
storage 150 may store various data or programs for driving and controlling the ultrasounddiagnostic apparatus 100, input/output ultrasound data, and the obtained ultrasound images. - The
input 170 may receive a user input for controlling the ultrasounddiagnostic apparatus 100. For example, the user input may include an input for manipulating buttons, a keypad, a mouse, trackballs, jog switches, knobs, etc., an input of touching a touch pad or a touch screen, a voice input, a motion input, a biometric information input (for example, iris recognition, fingerprint recognition, etc.), but the disclosure is not limited thereto. - An example of the ultrasound
diagnostic apparatus 100 according to an embodiment will be described later throughFIGS. 2A to 2C . -
FIG. 2 are views illustrating an ultrasound diagnostic apparatus according to an embodiment. - Referring to
FIGS. 2A and 2B , the ultrasound 100a and 100b may include adiagnostic apparatuses main display 121 and asub display 122. One of themain display 121 and thesub display 122 may be implemented as a touch screen. Themain display 121 and thesub display 122 may display various types of information processed by the ultrasound 100a and 100b. In addition, thediagnostic apparatuses main display 121 and thesub display 122 are implemented as the touch screen, and may receive data for controlling the ultrasound 100a and 100b from a user by providing a GUI. For example, thediagnostic apparatuses main display 121 may display the ultrasound image, and thesub display 122 may display a control panel for controlling the display of the ultrasound image in a GUI form. Thesub display 122 may receive data for controlling the display of an image through the control panel displayed in the GUI form. The ultrasound 100a and 100b may control the display of the ultrasound image displayed on thediagnostic apparatuses main display 121 using the input control data. - Referring to
FIG. 2B , the ultrasounddiagnostic apparatus 100b may further include acontrol panel 165 in addition to themain display 121 and thesub display 122. Thecontrol panel 165 may include buttons, trackballs, jog switches, knobs, and the like, and may receive data for controlling the ultrasounddiagnostic apparatus 100b from the user. For example, thecontrol panel 165 may include a Time Gain Compensation (TGC)button 171, aFreeze button 172, and the like. TheTGC button 171 is a button for setting a TGC value for each depth of the ultrasound image. In addition, when the input of theFreeze button 172 is detected while scanning the ultrasound image, the ultrasounddiagnostic apparatus 100b may maintain a state in which a frame image at a time point is displayed. - Meanwhile, the buttons, the trackballs, the jog switches, and the knobs included in the
control panel 165 may be provided on themain display 121 or thesub display 122 as the GUI. - Referring to
FIG. 2C , the ultrasounddiagnostic apparatus 100c may also be implemented in a portable type. Examples of the portable ultrasounddiagnostic apparatus 100c may include the smart phone including the probe and the application, the laptop computer, the PDA, and the tablet PC, but are not limited thereto. - The ultrasound
diagnostic apparatus 100c may include aprobe 20 and abody 40, and theprobe 20 may be connected to one side of thebody 40 by wire or wirelessly. Thebody 40 may include atouch screen 145. Thetouch screen 145 may display the ultrasound image, various information processed by the ultrasounddiagnostic apparatus 100c, and a GUI. - On the other hand, the ultrasound
diagnostic apparatus 100c may provide various types of clinical information including micro-calcification (shape of tissue, elasticity, speed of blood flow, etc.). - The ultrasound
diagnostic apparatus 100c may use a method of imaging micro-calcification using a post-processing algorithm of images such as imaging micro-calcification using various beamforming techniques based on channel data, or performing feature enhancement of only hyperechoic components. - However, when the ultrasound
diagnostic apparatus 100c uses a method of extracting an area suspected of micro-calcification through post-processing of the ultrasound image, there may be a problem in that it is difficult to identify the presence of calcification tissues and that only micro-calcification tissues cannot be independently detected when information of various human tissues (muscles, fats, blood flow, etc.) is mixed in the area of interest. - When the user identifies the presence of calcification tissue in the object through images with enhanced features of hyperechoic components and performs a diagnosis, depending on the user who reads the ultrasound image, there may be difficulties in standardizing the standard of diagnosis due to low diagnosis agreement. Therefore, there is a need for a technology capable of automatically detecting micro-calcification quickly and accurately, and in particular, development of a technology capable of independently detecting micro-calcification using the ultrasound
diagnostic apparatus 100 capable of obtaining real-time images is required. -
FIG. 3 is a view illustrating a structure of an ultrasound diagnostic apparatus capable of independently detecting micro-calcification according to an embodiment,FIG. 4 is a view illustrating a structure of a controller of an ultrasound diagnostic apparatus according to an embodiment,FIGS. 5 and6 are views illustrating setting a focal point at which a second ultrasound pulse is focused according to an embodiment,FIGS. 7 to 9 are views for describing pulses transmitted to detect micro-calcification according to an embodiment,FIG. 10 is a view for describing spatiotemporal data generated according to an embodiment, andFIG. 11 is a view for describing characteristics of micro-calcification tissues according to an embodiment. - The ultrasound
diagnostic apparatus 100 may include theprobe 20, theultrasound transceiver 110, thecontroller 120, and thedisplay 140. Each configuration of the ultrasounddiagnostic apparatus 100 ofFIG. 3 may be applied to the description of the ultrasounddiagnostic apparatus 100 ofFIG. 1 . Therefore, redundant descriptions are omitted. - The
ultrasound transceiver 110 may transmit an ultrasound pulse to the object through theprobe 20 based on the control signal applied from thecontroller 120, receive a radio frequency (RF) signal reflected from the object through theprobe 20, and output it to thecontroller 120. - The
ultrasound transceiver 110 may obtain first data by allowing theprobe 20 to transmit a first ultrasound pulse to the object and receive an echo signal reflected from the object. The first ultrasound pulse may be a pulse designed to obtain a brightness mode (B-mode). - The
ultrasound transceiver 110 may obtain second data by allowing theprobe 20 to transmit a second ultrasound pulse different from the first ultrasound pulse to the object and repeat the operation of receiving the echo signal reflected from the object a plurality of times at predetermined time intervals. - At this time, the
ultrasound transceiver 110 may transmit the second ultrasound pulse through theprobe 20 to a plurality of positions such as a first position and a second position of the object, respectively, and receive echo signals reflected from the plurality of positions of the object. - That is, as will be described later, the micro-calcification tissues present in the object may be distributed at various depths or positions. The
controller 120 may control theultrasound transceiver 110 to transmit the second ultrasound pulses simultaneously or at a predetermined time interval to the plurality of positions of the object in which the micro-calcification tissues are located. - The first position and the second position of the object to which the second ultrasound pulse is reached are positions where the micro-calcification tissues are present, and are positions of the focal point preset so that the second ultrasound pulse is reached.
- Referring to
FIGS. 5 and6 , thecontroller 120 may set the first position to a third position in which the micro-calcification tissues are present in the object as a first focal point f1 to a third focal point f3 to which the second ultrasound pulse is focused. - The positions of the micro-calcification tissues of the object may have different depths from each other and may be spaced apart from each other, and the number of positions may be plural, so there is no limit to the number of focal points to which the second ultrasound pulse is focused.
- As disclosed in
FIGS. 5 and6 , thecontroller 120 may set the first position in which the micro-calcification of the object exists as the first focal point f1 to which the second ultrasound pulse is focused. In addition, thecontroller 120 may set the second position having a different depth from the first position and having the micro-calcification of a position spaced apart from each other as the second focal point f2 to which the second ultrasound pulse is focused. In addition, thecontroller 120 may set the third position having a different depth from the first position and the second position and having the micro-calcification of a position spaced apart from each other as the third focal point f3 to which the third ultrasound pulse is focused. - In the case of
FIG. 5 , the first position to the third position in which the micro-calcification exists are located at different depths and are located at positions spaced apart from each other in a longitudinal direction. On the other hand, in the case ofFIG. 5 , the first position to the third position in which the micro-calcification exists are located at different depths, but exist on a straight line in the longitudinal direction. - The
controller 120 may obtain second to fourth data by repeating an operation of transmitting the second ultrasound pulse to the first position to the third position of the object through theultrasound transceiver 110 and receiving the echo signal reflected from the first position to the third position the plurality of times at predetermined time intervals. - In other words, according to the ultrasound
diagnostic apparatus 100, in order to detect the micro-calcifications present at different depths and different positions in the object, by setting a plurality of focal points to which second ultrasound pulses are focused, and transmitting the second ultrasound pulses to each of the set focal points, the micro-calcifications tissues present at different depths may be effectively detected. - The
controller 120 may control theultrasound transceiver 110 so that the second ultrasound pulses transmitted to the plurality of positions where the micro-calcification tissues, such as the first position to the third position of the object are present, are transmitted at predetermined time intervals. That is, thecontroller 120 may control theultrasound transceiver 110 so that the second ultrasound pulse is transmitted to the first focal point f1 where the micro-calcification tissues are present and the second ultrasound pulse is transmitted to the second focal point f2 after a certain period of time. - In addition, the
controller 120 may control theultrasound transmitter 110 so that the second ultrasound pulses transmitted to the plurality of positions of the object are simultaneously transmitted. That is, by setting an area in which the ultrasound pulses are transmitted in a transducer array provided in theprobe 20 in advance, thecontroller 120 may control theultrasound transceiver 110 so that the second ultrasound pulses are simultaneously transmitted to the plurality of focal points of the object in each predetermined area of the transducer array. - As described above, in the micro-calcification tissues present in the object, a plurality of tissues may exist, and the existing areas may be distributed at different depths or positions. However, there is no limit the number of positions where the second ultrasound pulse is focused. However, in the following, for convenience of description, it is assumed that the micro-calcification tissues exist in the first and second positions of the object, and the focal points to be set are also the first focal point f1 and the second focal point f2.
- The second ultrasound pulse may be a pulse designed based on the characteristics of the micro-calcification tissues. The second ultrasound pulse may be a pulse having a predefined sequence of a waveform size, a phase sign, a period, etc. to detect micro-calcification.
- For example, the second ultrasound pulse may be designed such that a negative pressure component is a predominant asymmetric pulse compared to a positive pressure component, and has a longer wavelength than the first ultrasound pulse.
- The
controller 120 may obtain data including information about the echo signal reflected from the object from theultrasound transceiver 110. That is, thecontroller 120 may obtain the first data from theultrasound transceiver 110. In addition, thecontroller 120 may obtain the second data from the first position of the object, and may obtain the third data from the second position of the object. Thecontroller 120 may obtain RF channel data or complex baseband I/Q data that has passed through an ADC. - The
controller 120 may detect the micro-calcification tissues present at different positions in the object by analyzing the second data and the third data. Thecontroller 120 may reconstruct the second data and the third data into three-dimensional (3D) data including information about an axial depth, a lateral width, and a time axis, and may extract the micro-calcification tissues by analyzing the 3D data. The 3D data may be spatiotemporal data based on the axial depth, the lateral area, and the time axis. - For example, the
controller 120 may estimate at least one of an intensity, frequency, and phase of the echo signal reflected from each area of the object by applying singular value decomposition (SVD) to the second data and the third data, based on the estimated value, the micro-calcification tissues in the object may be detected. - The
controller 120 may calculate a dispersion of a phase change over time of the echo signal reflected from each area of the object based on the second data and detect an area in which the dispersion of the phase change is greater than or equal to a predetermined value as the micro-calcification tissues in the object. - The
display 140 may display the ultrasound image generated based on the first data, and may display the image representing the micro-calcification tissues detected at the first and second positions of the object. - The
display 140 may independently display the ultrasound image and the image representing the micro-calcification in different areas, respectively. In addition, thedisplay 140 may display a single image by fusing a B-mode image of a cross section of the object and the image representing the micro-calcification. In addition, thedisplay 140 may display an area corresponding to the detected micro-calcification tissues on the ultrasound image, which is the B-mode image of the cross section of the object. - In particular, the
display 140 may independently display the micro-calcification tissues present at different positions within the object. - The
display 140 may display a color bar representing a plurality of colors corresponding to values representing characteristics of the micro-calcification tissues, select a color from the color bar based on values representing characteristics of the detected micro-calcification tissues, and display the selected color in the area corresponding to the detected micro-calcification tissues included in the ultrasound image. For example, a value representing the characteristics of the micro-calcification tissues may represent a roughness of the phase change over time of the echo signal reflected from the microscopic tissue. - Referring to
FIG. 4 , thecontroller 120 may include apulse generator 210, aspatiotemporal data obtainer 220, anultrasound image generator 230, amicro-calcification detector 240, and amicro-calcification image generator 250. Each of the 210, 220, 230, 240, and 250 included in theblocks controller 120 illustrated inFIG. 4 may be an individual hardware configuration or may be functional blocks implemented by thecontroller 120. Accordingly, the operations of the 210, 220, 230, 240, and 250 described below may be performed by theblocks controller 120. - The
pulse generator 210 may generate the ultrasound pulse to be transmitted to the object through theprobe 20. Thepulse generator 210 may control theultrasound transceiver 110 to form the transmission signal to be applied to each of the plurality of transducers in consideration of the positions and focal points of the plurality of transducers included in theprobe 20. Thepulse generator 210 may transmit the ultrasound pulse by controlling theultrasound transceiver 110. - The
pulse generator 210 may generate not only a gray scale ultrasound image of the object scanned according to an amplitude mode (A-mode), the B-mode, and a motion mode (M-mode), but also the ultrasound pulse designed to obtain a Doppler image representing the movement of the object. - The
pulse generator 210 may generate a pre-designed first ultrasound pulse to obtain the B-mode image. In addition, thepulse generator 210 may generate a pre-designed second ultrasound pulse for micro-calcification detection. Thepulse generator 210 may generate the second ultrasound pulse in which transmission parameters such as a sign, a magnitude, a phase, a period, etc. of a waveform are determined in advance based on the micro-calcification characteristic. - With respect to the second ultrasound pulse transmitted by the ultrasound
diagnostic apparatus 100 to detect the micro-calcification, it will be described in detail below with reference toFIGS. 7 to 9 . - The
pulse generator 210 may generate the ultrasound pulse having a symmetrical (+)/(-) size as the first ultrasound pulse, and may generate a pulse having an asymmetrical (+)/(-) size as the second ultrasound pulse. Thepulse generator 210 may improve a micro-calcification detection performance by using an asymmetric ultrasound pulse. - For example, as illustrated in
FIG. 7 , the asymmetric ultrasound pulse may include a pulse in which a positive pressure is dominant as in agraph 510 or a pulse in which a negative pressure is dominant as in agraph 520. The pulse illustrated inFIG. 7 may be designed in a form in which a harmonic component is added to a transmission center frequency f0 as illustrated in [Equation 1] below. The harmonic component may be designed in a form in which a 2f0 component is multiplied by a weight of a0. - The ultrasound pulse optimized for micro-calcification detection may be designed based on experimental results of
FIGS. 8 and9 . - The
graph 600 ofFIG. 8 illustrates an average value of the micro-calcification signal received from the object when the ultrasound pulse of the waveform illustrated inFIG. 7 is applied to the object including a phantom simulating breast micro-calcification. - The micro-calcification signal may refer to a signal of a micro-calcification area extracted based on data obtained from the echo signal received from the object. According to an embodiment, the micro-calcification signal may be obtained through processes illustrated in
FIGS. 10 and12 , and a specific method of obtaining the micro-calcification signal will be described later. - The
graph 610 ofFIG. 8 illustrates a change in the average value of the micro-calcification signal received from the object when a high voltage of the ultrasound pulse dominated by the positive pressure illustrated in thegraph 510 ofFIG. 7 is increased. Thegraph 620 ofFIG. 8 illustrates the change in the average value of the micro-calcification signal received from the object when the high voltage of the ultrasound pulse dominated by the positive pressure illustrated in thegraph 520 ofFIG. 7 is increased. - According to the experimental results illustrated in
FIG. 8 , it can be seen that when the ultrasound pulse with a predominant negative pressure is used, the micro-calcification signal is detected larger than when the ultrasound pulse with a predominance positive pressure is used. Therefore, thepulse generator 210 may preferably generate the ultrasound pulse with the predominant negative pressure as the second ultrasound pulse. - The
graph 700 ofFIG. 9 illustrates the average value of the micro-calcification signal received from the object when the ultrasound pulse of the waveform illustrated in thegraph 520 ofFIG. 7 is applied to the object including the phantom simulating breast micro-calcification. - The
graph 700 ofFIG. 9 illustrates the change in the average value of the micro-calcification signal received from the object when the negative pressure illustrated in thegraph 520 ofFIG. 7 increases the negative pressure of the predominant ultrasound pulse. Thegraph 710 ofFIG. 9 illustrates the change in the average value of the micro-calcification signal received from the object when the negative pressure having a low (penetration) frequency increases the negative pressure of the predominant ultrasound pulse. Thegraph 720 ofFIG. 9 illustrates the change in the average value of the micro-calcification signal received from the object when the negative pressure having a general frequency increases the negative pressure of the predominant ultrasound pulse. - According to the experimental results illustrated in
FIG. 9 , it can be seen that when the ultrasound pulse having the low frequency (long wavelength) is used, the micro-calcification signal is detected larger than when the ultrasound pulse having a relatively high frequency (short wavelength) is used. Accordingly, thepulse generator 210 may preferably generate the ultrasound pulse having the wavelength longer than the predetermined value as the second ultrasound pulse. In addition, according to the experimental results illustrated inFIG. 9 , it can be seen that as the negative pressure of the ultrasound pulse increases, the average value of the micro-calcification signal received from the object increases. Therefore, thepulse generator 210 may preferably generate the ultrasound pulse having the negative pressure greater than the predetermined value as the second ultrasound pulse. For example, thepulse generator 210 may generate the ultrasound pulse in which the magnitude of the negative pressure is greater than the magnitude of the negative pressure of the first ultrasound pulse as the second ultrasound pulse. - Returning to
FIG. 4 again, the structure of thecontroller 120 of the ultrasounddiagnostic apparatus 100 will be described. - The
spatiotemporal data obtainer 220 may reconstruct the ultrasound data reflected from the object into spatiotemporal data including spatiotemporal information. Thespatiotemporal data obtainer 220 may obtain spatiotemporal data from the second data obtained from the echo signal reflected from the object in response to the second ultrasound pulse transmitted to the first position and the second position of the object. - The ultrasound
diagnostic apparatus 100 may obtain the second data by repeatedly performing an operation of transmitting the second ultrasound pulse to the first position in which the micro-calcification of the object exists through theprobe 20 and receiving the echo signal at a predefined number of times and time intervals. In addition, the ultrasounddiagnostic apparatus 100 may obtain the third data by repeatedly performing an operation of transmitting the second ultrasound pulse to the second position, which is a position different from the first position of the object, and receiving the echo signal at the predefined number of times and time intervals. - The second data and the third data may include a plurality of image data obtained with respect to the cross section of the object at a predetermined period, and each image data may include spatial information about the cross section of the object.
- As illustrated in
FIG. 10 , thespatiotemporal data obtainer 220 may be reconstructed into the3D data 801 including information about the axial depth, the lateral width, and the time by arranging the plurality of image data included in the second data and the third data on the time axis. Since the data obtained by thespatiotemporal data obtainer 220 includes both temporal information and spatial information, it may be described as spatiotemporal data. - The
micro-calcification detector 240 may independently detect the spatiotemporal data obtained from thespatiotemporal data obtainer 220 by distinguishing between general tissues and the micro-calcification through spatiotemporal characteristic analysis. For example, themicro-calcification detector 240 may independently detect the micro-calcification signal by performing singular value decomposition 440 on spatiotemporal data. In addition, themicro-calcification detector 240 may perform independent micro-calcification signal detection based on a power or an average frequency of the micro-calcification signal, a phase change, etc. using an autocorrelation function. For example, themicro-calcification detector 240 may utilize a micro-calcification power estimation value based on the autocorrelation function. - The
micro-calcification detector 240 may separate and detect the micro-calcification signal from the spatiotemporal data based on the characteristics of the micro-calcification. For example, the micro-calcification has a random phase change characteristic compared to the general tissues. It is known that this is due to a non-uniform nature of a surface of the calcification tissue. - The
graph 910 ofFIG. 11 illustrates a phase change of a signal of a blood flow area extracted based on data obtained in response to the transmitted ultrasound pulse when the ultrasound pulse is transmitted to the object including a blood vessel a plurality of times. Thegraph 920 ofFIG. 11 illustrates the phase change of the signal of the micro-calcification area extracted based on data obtained in response to the transmitted ultrasound pulse when the ultrasound pulse is transmitted to the object including the micro-calcification the plurality of times. - As illustrated in
FIG. 11 , when compared with the general tissues such as the blood flow, it can be seen that the micro-calcification has the random phase change (i.e., the distribution of the phase change is wide). Themicro-calcification detector 240 may separate and detect the micro-calcification signal from the spatiotemporal data based on the phase change characteristic of the micro-calcification. Themicro-calcification detector 240 may determine that it is the micro-calcification tissues when the roughness of the phase change is greater than or equal to the predetermined value based on the predetermined value. -
FIG. 12 is a view illustrating a method of detecting micro-calcification tissues by a micro-calcification detector according to an embodiment. - The
micro-calcification detector 240 may generate a Casorati matrix (x∗z, t) to arrange the data in a spatiotemporal manner, based on the spatiotemporal data (1010) obtained by the spatiotemporal data obtainer 220 (1020). Themicro-calcification detector 240 may perform the singular value decomposition on the generated Casorati matrix (1030). In this case, an U vector may denote data for spatial information, a V vector denote data for temporal information, and a Σ vector may denote a ranking of singular values. - The
micro-calcification detector 240 may apply a spatiotemporal signal characteristic analysis function to the obtained singular value vector S. The spatiotemporal signal characteristic analysis function may include a codispersion matrix analysis, the autocorrelation function, and the like. For example, themicro-calcification detector 240 may obtain a spatiotemporal codispersion matrix based on the obtained singular value vector S (1040). - The
micro-calcification detector 240 may separate and detect an independent micro-calcification signal by analyzing a spatiotemporal signal characteristic based on a result of applying the spatiotemporal signal characteristic analysis function. For example, themicro-calcification detector 240 may detect the signal in the area having a wide distribution of the phase change over time as the micro-calcification signal (1050). - Returning to
FIG. 4 again, the structure of thecontroller 120 of the ultrasounddiagnostic apparatus 100 will be described. - The
ultrasound image generator 230 may reconstruct an A-mode image, a B-mode image, an M-mode image, a Doppler image, and the like, based on data received in response to the ultrasound pulse applied to the object. Theultrasound image generator 230 may generate the B-mode image representing the cross section of the object by reconstructing the first data received in response to the first ultrasound pulse transmitted to the object. Theultrasound image generator 230 may output the generated ultrasound image to thedisplay 140. - The
micro-calcification image generator 250 may generate the micro-calcification image by reconstructing the micro-calcification signal independently detected by themicro-calcification detector 240 into a two-dimensional (2D) image. Themicro-calcification image generator 250 may generate the micro-calcification image in which the micro-calcification area included in the cross section of the object to which the ultrasound pulse is transmitted is displayed. Themicro-calcification image generator 250 may apply various image post-processing to the generated micro-calcification image. Themicro-calcification image generator 250 may output the generated micro-calcification image to thedisplay 140. -
FIGS. 13 and14 are views illustrating screens displayed on an ultrasound diagnostic apparatus according to an embodiment. - Referring to
FIG. 13 , thedisplay 140 may independently display anultrasound image 1110 generated by thecontroller 120 and animage 1130 representing the micro-calcification in different areas on ascreen 1100. - An area 1113 on the
ultrasound image 1110 is an area in which the micro-calcification is concentrated in the object, and is the plurality of areas in which the micro-calcification exists, such as an area 1113-1 corresponding to the first position in which the micro-calcification exists to an area 1113-3 corresponding to the third position. - According to the ultrasound
diagnostic apparatus 100 according to the embodiment, theimage 1130 in which only the micro-calcification area is independently displayed may be generated and displayed. Similar to theultrasound image 1110, it is identified that micro-calcifications are concentrated in the areas 1133-1, 1113-2, and 1113-3 on theimage 1130. - Meanwhile, the embodiment of the disclosure is not limited to the embodiment illustrated in
FIG. 13 , and a screen in which the ultrasound image and the image representing the micro-calcification are fused may be displayed. - The
display 140 may display an image in which the area corresponding to the micro-calcification is displayed on the ultrasound image by fusing the ultrasound image and the image representing the micro-calcification. For example, the area corresponding to the micro-calcification may be displayed as one of a predetermined color, brightness, figure, and symbol on the ultrasound image, or may be displayed to flash. - In addition, the
display 140 may simultaneously display the color bar representing the plurality of colors corresponding to values representing characteristics of the micro-calcification tissues. Thedisplay 140 may select the color from the color bar based on the value representing characteristics of the detected micro-calcification tissues, and display the selected color in an area corresponding to the detected micro-calcification tissues. However, embodiments are not limited thereto, and various methods for expressing the characteristics of the micro-calcification tissues other than a color bar form may be used. - For example, the value representing the characteristics of micro-calcification tissues may include roughness of the phase of the micro-calcification signal obtained from the corresponding micro-calcification tissues. In general, it is known that the higher the roughness of the phase of the micro-calcification signal, the higher a probability of metastasis to a malignant tumor. Therefore, the ultrasound
diagnostic apparatus 100 may increase an accuracy of breast cancer diagnosis by displaying the phase roughness of the micro-calcification signal corresponding to the micro-calcification tissues together with the image representing the micro-calcification tissues. -
FIG. 14 illustrates an example of a screen displaying the roughness of the phase as the characteristic of micro-calcification tissues. - The
display 140 may display animage 1210 in which 1211, 1212, 1213, and 1214 corresponding to the micro-calcifications existing in a first position 1210-1 of the object on the ultrasound image are displayed. For example, theareas 1211, 1212, 1213, and 1214 corresponding to micro-calcification may be displayed in predetermined colors on the ultrasound image.areas - Likewise, the
display 140 may display theimage 1210 in which the 1215, 1216, 1217, and 1218 corresponding to micro-calcification existing in a second position 1210-2 of the object are displayed on the ultrasound image. For example, theareas 1215, 1216, 1217, and 1218 corresponding to micro-calcification may be displayed in predetermined colors on the ultrasound image.areas - In addition, the
display 140 may also display acolor bar 1230 representing the plurality of colors corresponding to values representing characteristics of micro-calcification tissues. Anarea 1220 ofFIG. 14 illustrates that the roughness of the phase of the micro-calcification signal increases toward the top of thecolor bar 1230. As illustrated inFIG. 14 , thedisplay 140 may display theareas 1211 to 1218 in which the micro-calcifications exist by using different colors selected from the color bar, based on the value representing the characteristics of the detected micro-calcification tissues. -
FIG. 15 is a view illustrating an index representing focusing lines in which a plurality of focal points for a second ultrasound pulse are located, according to an embodiment. - Referring to
FIG. 15 , thedisplay 140 may display anindex 1240 indicating focusing lines L1 and L2 in which the first focal point f1 and the second focal point f2 to which the second ultrasound pulse is focused is located in the B-mode image of the cross section of the object. - As described above in
FIGS. 5 and6 , thecontroller 120 may set the first and second positions in which the micro-calcification tissues exist in the object as the first focal point f1 and the second focal point f2 at which the second ultrasound pulse is focused. - The
display 140 may display anindex 1241 for the focusing line L1 indicating the first focal point f1 set at the first position in which micro-calcification tissues of the object exist. Likewise, thedisplay 140 may display anindex 1242 for the focusing line L2 indicating the second focal point f2 set at the second position in which micro-calcification tissues of the object exist. - The user may identify the first position and the second position of the object set as the focal point for micro-calcification detection through a display screen of the
display 140. InFIG. 15 , a case in which there are two focal points set for micro-calcification detection is described as an example, but when the plurality of micro-calcification tissues exist in the object at different depths or positions, thecontroller 120 may set two or more focal points to which the second ultrasound pulse is focused, and accordingly, the plurality of focusing lines andindexes 1240 indicating the plurality of focal points may be displayed on thedisplay 140. -
FIG. 16 is a flowchart of a method of displaying an ultrasound image according to an embodiment. - Each operation of a method described below may be performed by each component of the ultrasound
diagnostic apparatus 100 illustrated inFIG. 3 . The description above with respect to the ultrasounddiagnostic apparatus 100 may also be applied to each operation of the following methods. - In
operation 2000, the ultrasounddiagnostic apparatus 100 may obtain the first data by transmitting the first ultrasound pulse to the object and receiving the echo signal reflected from the object. - In
operation 2100, the ultrasounddiagnostic apparatus 100 may obtain the second data by repeating the operation of transmitting the second ultrasound pulse different from the first ultrasound pulse to the first position of the object and receiving the echo signal reflected from the object the plurality of times at predetermined time intervals. - Similarly, in
operation 2200, the ultrasounddiagnostic apparatus 100 may obtain the second data by repeating the operation of transmitting the second ultrasound pulse different from the first ultrasound pulse to the second position of the object and receiving the echo signal reflected from the object the plurality of times at predetermined time intervals. - The second ultrasound pulse may be the pulse designed based on the characteristics of micro-calcification tissues. For example, the second ultrasound pulse is an asymmetric pulse in which the negative pressure component is dominant compared to the positive pressure component, and may have the longer wavelength than the first ultrasound pulse.
- In the case of
2100 and 2200, when the micro-calcification tissues existing in the object are distributed at different depths at the plurality of positions, the operation may increase in correspondence with the depth at which the micro-calcification tissues exist.operations - In
operation 2300, the ultrasounddiagnostic apparatus 100 may detect micro-calcification tissues of the first position and the second position in the object by analyzing the second data and the third data. - The ultrasound
diagnostic apparatus 100 may detect only the micro-calcification signal independently from the general tissue by analyzing the received RF signal or the I/Q signal in spatiotemporal manner in response to the ultrasound pulse transmitted to the object. As a method of detecting the micro-calcification signal, a method of estimating power using the spatiotemporal signal characteristic analysis function (e.g., autocorrelation) and estimating the average frequency or dispersion may be used. - Particularly, the ultrasound
diagnostic apparatus 100 may reconstruct the second and third data obtained in 2100 and 2200 into 3D data including information about the axial depth, the lateral width, and the time. The ultrasoundoperations diagnostic apparatus 100 may extract micro-calcification tissues present at different positions within the object by analyzing the 3D data. - The ultrasound
diagnostic apparatus 100 may estimate at least one of the intensity, frequency, and phase of the echo signal reflected from each area of the object by applying SVD to the second data and the third data, and may detect the micro-calcification tissues in the object based on the estimated value. - The ultrasound
diagnostic apparatus 100 may calculate the dispersion of the phase change over time of the echo signal reflected from each area of the object based on the second data and the third data, and detect the area in which the dispersion of the phase change is more than the predetermined value as the micro-calcification tissues in the object. - In
operation 2400, the ultrasounddiagnostic apparatus 100 may display the ultrasound image generated based on the first data, and may display the image representing micro-calcification tissues detected in the first and second positions of the object. - The ultrasound
diagnostic apparatus 100 may generate the ultrasound image by reconstructing the first data, and may generate the micro-calcification image by reconstructing the micro-calcification signal detected inoperation 2300 for a purpose of displaying on the screen. - The ultrasound
diagnostic apparatus 100 may individually display the ultrasound images and the images representing micro-calcification tissues in different areas. Alternatively, the ultrasounddiagnostic apparatus 100 may display a single image by fusing the ultrasound image and the image representing micro-calcification tissues. The ultrasounddiagnostic apparatus 100 may display the single image, indicating the area corresponding to micro-calcification tissues detected on the ultrasound image. - For example, the ultrasound image generated based on the first data is the B-mode image representing the cross section of the object, and the image representing micro-calcification tissues may be the image displaying the position of micro-calcification tissues within the cross section by color, contrast, symbols, figures, blinking, and the like.
- The ultrasound
diagnostic apparatus 100 may further display the color bar representing the plurality of colors corresponding to values representing characteristics of micro-calcification tissues. The ultrasounddiagnostic apparatus 100 may select the color from the color bar based on the value representing the characteristic of the detected micro-calcification tissues, and display the selected color in the area corresponding to the detected micro-calcification tissues. For example, the value representing characteristics of micro-calcification tissues may be the value representing roughness of the phase change over time of the echo signal reflected from the micro-calcification tissues. - As described above, according to the embodiments of the disclosure, the ultrasound diagnostic apparatus may accurately detect micro-calcification tissues distributed at different depths or positions, and may independently display only micro-calcification images, or display images representing micro-calcification by fusion with ultrasound B-mode images. In addition, by accurately detecting micro-calcification, not only can breast cancer be diagnosed early, but also micro-calcification generated in organs other than breasts as calcium is accumulated in the human body can be monitored, thereby improving the accuracy of diagnosis of various diseases.
- The disclosed embodiments may be implemented as S/W program including instructions stored in a computer-readable storage medium.
- The computer may include the ultrasound diagnostic apparatus according to the disclosed embodiments as a device capable of calling a stored command from the storage medium and operating according to the disclosed embodiments according to the called command.
- The computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' may refer to that the storage medium does not contain a signal and is tangible, but does not distinguish between semi-permanent or temporary storage of data in the storage medium.
- In addition, the ultrasound diagnostic apparatus or method according to the disclosed embodiments may be provided by being included in a computer program product. The computer program product is commodities that can be traded between sellers and buyers.
- The computer program product may include the S/W program and the storage medium readable by the computer in which the S/W program is stored. For example, the computer program product includes a manufacturer of the ultrasound diagnostic apparatus or a product (e.g., a downloadable app) in the form of the S/W program that is electronically distributed through an electronic market (e.g., Google Play Store, App Store). For electronic distribution, at least a part of the S/W program may be stored in the storage medium or may be temporarily generated. In this case, the storage medium may be a server of the manufacturer, the server of the electronic market, or the storage medium of a relay server temporarily storing SW programs.
- The computer program product may include the storage medium of the server or the storage medium of a terminal in a system composed of the server and a terminal (e.g., ultrasound diagnostic apparatus). Alternatively, when there is a third device (e.g., a smartphone) that is communicatively connected to the server or the terminal, the computer program product may include the storage medium of the third device. Alternatively, the computer program product may include the S/W program itself transmitted from the server to the terminal or the third device, or transmitted from the third device to the terminal.
- In this case, one of the server, the terminal, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the terminal, and the third device may execute the computer program product to distribute the method according to the disclosed embodiments.
- For example, a server (e.g., a cloud server or an artificial intelligence server) may execute the computer program product stored in the server, and control the terminal connected to the server to perform the method according to the disclosed embodiments.
- As another example, by executing the computer program product, the third device may control the terminal connected in communication with the third device to perform the method according to the disclosed embodiment. As a specific example, the third device may control the ultrasound diagnostic apparatus to remotely control the ultrasound diagnostic apparatus to irradiate the ultrasound signal as the object and to generate the image of the portion inside the object based on signal information reflected from the object.
- As another example, the third device may execute the computer program product to directly perform the method according to the disclosed embodiment based on a value input from an auxiliary device (e.g., the probe of the medical apparatus). As a specific example, the auxiliary device may irradiate the ultrasound signal as the object and obtain the ultrasound signal reflected from the object. The third device may receive reflected signal information from the auxiliary device, and may generate the image of the portion inside the object based on the input signal information.
- When the third device executes the computer program product, the third device may download the computer program product from the server and execute the downloaded computer program product. Alternatively, the third device may perform the method according to the disclosed embodiments by executing the computer program product provided in a preloaded state.
- Embodiments of the disclosure have been described with reference to the accompanying drawings. It should be obvious to a person of ordinary skill in the art that the disclosure may be practiced in other forms by modifying and substituting some or all of the components of the embodiments as described above without changing the technical idea or essential features of the disclosure. The above embodiments are only by way of example, and should not be interpreted as a limitation to the embodiments.
Claims (15)
- An ultrasound diagnostic apparatus comprising:a probe;an ultrasound transceiver configured to transmit an ultrasound signal to an object through the probe and receive an echo signal reflected from the object;a controller configured to:obtain first data by controlling the ultrasound transceiver to transmit a first ultrasound pulse to the object and receive the echo signal reflected from the object,obtain second data by controlling the ultrasound transceiver to repeat an operation of transmitting a second ultrasound pulse different from the first ultrasound pulse to a first position of the object and receiving the echo signal reflected from the first position of the object a plurality of times at predetermined time intervals,obtain third data by controlling the ultrasound transceiver to repeat an operation of transmitting the second ultrasound pulse to a second position of the object and receiving the echo signal reflected from the second position of the object the plurality of times at predetermined time intervals, anddetect the micro-calcification tissues of the first position and the second position by analyzing the obtained second and third data; anda display configured to display an ultrasound image generated based on the obtained first data and an image representing micro-calcification tissues detected in the first position and the second position.
- The ultrasound diagnostic apparatus according to claim 1, wherein:the first position of the object is a position that is a different depth from the second position and is spaced apart from each other; andthe controller is configured to set the first position and the second position of the object as a first focal point and a second focal point to which the transmitted second ultrasound pulse is focused, respectively.
- The ultrasound diagnostic apparatus according to claim 1, wherein the controller is configured to control the ultrasound transceiver so that the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object are transmitted at predetermined time intervals.
- The ultrasound diagnostic apparatus according to claim 1, wherein the controller is configured to control the ultrasound transceiver so that the second ultrasound pulse transmitted to the first position of the object and the second ultrasound pulse transmitted to the second position of the object are simultaneously transmitted.
- The ultrasound diagnostic apparatus according to claim 1, wherein the second ultrasound pulse is a pulse designed based on characteristics of the micro-calcification tissues.
- The ultrasound diagnostic apparatus according to claim 5, wherein the second ultrasound pulse is an asymmetric pulse in which a negative pressure component is dominant compared to a positive pressure component, and has a longer wavelength than the first ultrasound pulse.
- The ultrasound diagnostic apparatus according to claim 1, wherein, in detecting the micro-calcification tissues, the controller is configured to reconstruct the obtained second and third data into three-dimensional (3D) data including information about an axial depth, a lateral width, and a time, and to extract the micro-calcification tissues by analyzing the 3D data.
- The ultrasound diagnostic apparatus according to claim 1, wherein, in detecting the micro-calcification tissues, the controller is configured to estimate at least one of an intensity, frequency, or phase of the echo signal reflected from each area of the object by applying singular value decomposition (SVD) to the obtained second and third data, and to detect the micro-calcification tissues in the object based on the estimated value.
- The ultrasound diagnostic apparatus according to claim 1, wherein, in detecting the micro-calcification tissues, the controller is configured to calculate a dispersion of a phase change over time of the echo signal reflected from each area of the object based on the obtained second and third data, and to detect an area in which the dispersion of the phase change is greater than or equal to a predetermined value as the micro-calcification tissues in the object.
- The ultrasound diagnostic apparatus according to claim 1, wherein the display is configured to display an index indicating focusing lines in which the set first focal point and second focal point are located in a brightness mode (B-mode) image of a cross section of the object.
- The ultrasound diagnostic apparatus according to claim 1, wherein the display is configured to:display a color bar representing a plurality of colors corresponding to values representing characteristics of the micro-calcification tissues;select a color from the color bar based on the value representing the characteristics of the detected micro-calcification tissues; anddisplay the selected color in an area corresponding to the detected micro-calcification tissues included in the ultrasound image.
- The ultrasound diagnostic apparatus according to claim 11, wherein the value representing the characteristics of the micro-calcification tissues represents a roughness of a phase change over time of the echo signal reflected from the micro-calcification tissues.
- The ultrasound diagnostic apparatus according to claim 1, wherein:the ultrasound image is a brightness mode (B-mode) image for a cross section of the object; andthe display is configured to display an area corresponding to the detected micro-calcification tissues on the ultrasound image.
- A method of controlling an ultrasound diagnostic apparatus comprising:obtaining, by a controller, first data by transmitting a first ultrasound pulse to the object and receiving the echo signal reflected from the object;obtaining, by the controller, second data by repeating an operation of transmitting a second ultrasound pulse different from the first ultrasound pulse to a first position of the object and receiving the echo signal reflected from the first position of the object a plurality of times at predetermined time intervals;obtaining, by the controller, third data by repeating an operation of transmitting the second ultrasound pulse to a second position of the object and receiving the echo signal reflected from the second position of the object the plurality of times at predetermined time intervals;detecting, by the controller, the micro-calcification tissues of the first position and the second position by analyzing the obtained second and third data; anddisplaying, by a display, an ultrasound image generated based on the obtained first data and an image representing micro-calcification tissues detected in the first position and the second position.
- The method according to claim 14, wherein the first position of the object is a position that is a different depth from the second position and is spaced apart from each other, and
the method further comprises:
setting, by the controller, the first position and the second position of the object as a first focal point and a second focal point to which the transmitted second ultrasound pulse is focused, respectively.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020200008399A KR102940670B1 (en) | 2020-01-22 | 2020-01-22 | Ultrasound diagnosis apparatus, control method for ultrasound diagnosis apparatus and computer program product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP3854313A1 true EP3854313A1 (en) | 2021-07-28 |
| EP3854313B1 EP3854313B1 (en) | 2023-09-13 |
Family
ID=74205667
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP21152799.9A Active EP3854313B1 (en) | 2020-01-22 | 2021-01-21 | Ultrasound diagnostic apparatus and method of controlling the same |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20210219958A1 (en) |
| EP (1) | EP3854313B1 (en) |
| KR (1) | KR102940670B1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7828231B2 (en) * | 2022-05-16 | 2026-03-11 | 富士フイルム株式会社 | Ultrasonic time series data processing device and ultrasonic time series data processing program |
| WO2025036045A1 (en) * | 2023-08-17 | 2025-02-20 | 叶秩光 | Ultrasonic detection auxiliary system for catheter and method therefor |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120232390A1 (en) * | 2011-03-08 | 2012-09-13 | Samsung Electronics Co., Ltd. | Diagnostic apparatus and method |
| US20140364733A1 (en) * | 2012-02-03 | 2014-12-11 | Los Alamos National Security, Llc | Time reversal and phase coherent music techniques for super-resolution ultrasound imaging |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003310587A (en) | 2002-04-26 | 2003-11-05 | Fuji Photo Film Co Ltd | Display device for abnormal shadow detected result |
| JP5067253B2 (en) | 2008-04-23 | 2012-11-07 | コニカミノルタエムジー株式会社 | Ultrasonic diagnostic equipment |
| JP6158143B2 (en) * | 2014-07-18 | 2017-07-05 | ジーイー・メディカル・システムズ・グローバル・テクノロジー・カンパニー・エルエルシー | Calcification display device, photographing device and program |
| US11389371B2 (en) * | 2018-05-21 | 2022-07-19 | Softwave Tissue Regeneration Technologies, Llc | Acoustic shock wave therapeutic methods |
| WO2020157536A1 (en) * | 2019-01-31 | 2020-08-06 | Oron Zachar | Transcranial ultrasound focusing |
| WO2020037674A1 (en) * | 2018-08-24 | 2020-02-27 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic imaging apparatus and method, and ultrasonic elastic testing apparatus and method |
| WO2020047204A1 (en) * | 2018-08-31 | 2020-03-05 | Seno Medical Instruments, Inc. | Methods and systems to determine cancer molecular subtypes based on ultrasound and-or optoacoustic ( oa/us) features |
-
2020
- 2020-01-22 KR KR1020200008399A patent/KR102940670B1/en active Active
-
2021
- 2021-01-19 US US17/151,772 patent/US20210219958A1/en not_active Abandoned
- 2021-01-21 EP EP21152799.9A patent/EP3854313B1/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120232390A1 (en) * | 2011-03-08 | 2012-09-13 | Samsung Electronics Co., Ltd. | Diagnostic apparatus and method |
| US20140364733A1 (en) * | 2012-02-03 | 2014-12-11 | Los Alamos National Security, Llc | Time reversal and phase coherent music techniques for super-resolution ultrasound imaging |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20210095258A (en) | 2021-08-02 |
| KR102940670B1 (en) | 2026-03-19 |
| US20210219958A1 (en) | 2021-07-22 |
| EP3854313B1 (en) | 2023-09-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114903522B (en) | Machine-Assisted Workflow in Ultrasound Imaging | |
| RU2667617C2 (en) | System and method of elastographic measurements | |
| CN113397589A (en) | System and method for ultrasound image quality determination | |
| CN101896123A (en) | Robotic ultrasound system with microadjustment and positioning control using feedback responsive to acquired image data | |
| CN111885964A (en) | System and method for identifying characteristics of ultrasound images | |
| US11564663B2 (en) | Ultrasound imaging apparatus and control method thereof | |
| CN114072060A (en) | Ultrasonic imaging method and ultrasonic imaging system | |
| CN115279275B (en) | Ultrasonic diagnostic equipment and method of operating the same | |
| US20190130564A1 (en) | Medical image processing apparatus | |
| KR20210075831A (en) | Method and apparatus for quantitative ultrasound imaging using single-ultrasound probe | |
| JP2020509862A (en) | Optimal scanning plane selection for organ recognition | |
| US12303326B2 (en) | Method of determining scan planes in the acquisition of ultrasound images and ultrasound system for the implementation of the method | |
| EP3854313B1 (en) | Ultrasound diagnostic apparatus and method of controlling the same | |
| JP2025188308A (en) | Ultrasonic image diagnostic apparatus, discriminator change method and discriminator change program | |
| EP4391920B1 (en) | Method for use in analysing ultrasound image data of a subject | |
| US20250331827A1 (en) | Ultrasonic imaging system and control method thereof | |
| US12076191B2 (en) | Ultrasound diagnosis apparatus, method for displaying ultrasound image, and computer program product | |
| CN115551416A (en) | Measurement of hip | |
| US20260069247A1 (en) | Guided ultrasound imaging for point-of-care staging of medical conditions | |
| KR101956460B1 (en) | Method for detecting microcalcification using ultrasound medical imaging device and ultrasound medical imaging device thereof | |
| JP7535189B2 (en) | Analysis of ultrasound image data of the rectus abdominis muscle | |
| CN119074043A (en) | Ultrasound imaging techniques for shear wave elastography | |
| CN114246613A (en) | Ultrasonic diagnostic equipment and thyroid nodule rating display method thereof | |
| CN114098687B (en) | Method and system for automatic heart rate measurement in ultrasound motion mode | |
| EP4327750A1 (en) | Guided ultrasound imaging for point-of-care staging of medical conditions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20211027 |
|
| RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20230424 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602021005015 Country of ref document: DE Owner name: SAMSUNG MEDISON CO., LTD., NAM-MYEON, KR Free format text: FORMER OWNER: SAMSUNG MEDISON CO., LTD., HONGCHEON-GUN, GANGWON-DO, KR |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602021005015 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231214 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231213 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231214 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1610452 Country of ref document: AT Kind code of ref document: T Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240113 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240113 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240115 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602021005015 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| 26N | No opposition filed |
Effective date: 20240614 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240131 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240131 |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20240131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20210121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20210121 |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20250121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20250121 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230913 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20251209 Year of fee payment: 6 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20251208 Year of fee payment: 6 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20251209 Year of fee payment: 6 |