WO2022107525A1 - 画像処理装置および画像処理装置の制御方法 - Google Patents
画像処理装置および画像処理装置の制御方法 Download PDFInfo
- Publication number
- WO2022107525A1 WO2022107525A1 PCT/JP2021/038407 JP2021038407W WO2022107525A1 WO 2022107525 A1 WO2022107525 A1 WO 2022107525A1 JP 2021038407 W JP2021038407 W JP 2021038407W WO 2022107525 A1 WO2022107525 A1 WO 2022107525A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- accuracy
- ultrasonic
- unit
- threshold value
- image
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 41
- 210000004204 blood vessel Anatomy 0.000 claims abstract description 137
- 238000001514 detection method Methods 0.000 claims abstract description 41
- 238000004364 calculation method Methods 0.000 claims abstract description 40
- 239000000523 sample Substances 0.000 claims description 73
- 230000005540 biological transmission Effects 0.000 claims description 16
- 238000006243 chemical reaction Methods 0.000 description 7
- 230000003321 amplification Effects 0.000 description 5
- 238000003199 nucleic acid amplification method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 210000001519 tissue Anatomy 0.000 description 4
- 239000008280 blood Substances 0.000 description 3
- 210000004369 blood Anatomy 0.000 description 3
- FYYHWMGAXLPEAU-UHFFFAOYSA-N Magnesium Chemical compound [Mg] FYYHWMGAXLPEAU-UHFFFAOYSA-N 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 210000000577 adipose tissue Anatomy 0.000 description 2
- 230000001174 ascending effect Effects 0.000 description 2
- HFGPZNIAWCZYJU-UHFFFAOYSA-N lead zirconate titanate Chemical compound [O-2].[O-2].[O-2].[O-2].[O-2].[Ti+4].[Zr+4].[Pb+2] HFGPZNIAWCZYJU-UHFFFAOYSA-N 0.000 description 2
- 229910052451 lead zirconate titanate Inorganic materials 0.000 description 2
- 229910052749 magnesium Inorganic materials 0.000 description 2
- 239000011777 magnesium Substances 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000002604 ultrasonography Methods 0.000 description 2
- BQCIDUSAKPWEOX-UHFFFAOYSA-N 1,1-Difluoroethene Chemical compound FC(F)=C BQCIDUSAKPWEOX-UHFFFAOYSA-N 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 210000001367 artery Anatomy 0.000 description 1
- 239000000919 ceramic Substances 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 229920000131 polyvinylidene Polymers 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000006104 solid solution Substances 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
- A61B8/5223—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for extracting a diagnostic or physiological parameter from medical diagnostic data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/08—Detecting organic movements or changes, e.g. tumours, cysts, swellings
- A61B8/0833—Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures
- A61B8/085—Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/13—Tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5269—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving detection or reduction of artifacts
- A61B8/5276—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving detection or reduction of artifacts due to motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/08—Detecting organic movements or changes, e.g. tumours, cysts, swellings
- A61B8/0891—Detecting organic movements or changes, e.g. tumours, cysts, swellings for diagnosis of blood vessels
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/42—Details of probe positioning or probe attachment to the patient
- A61B8/4245—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
- A61B8/4254—Details of probe positioning or probe attachment to the patient involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient using sensors mounted on the probe
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
- A61B8/461—Displaying means of special interest
- A61B8/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/48—Diagnostic techniques
- A61B8/488—Diagnostic techniques involving Doppler signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/58—Testing, adjusting or calibrating the diagnostic device
- A61B8/585—Automatic set-up of the device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
Definitions
- the ultrasonic image becomes bright as a whole, and an artifact may appear in the blood vessel.
- the boundary between the blood vessel and the surrounding tissue in the ultrasonic image may be blurred.
- the appearance of blood vessels in an ultrasonic image differs depending on the subject. Therefore, even if the technique disclosed in Patent Document 1 is used, the blood vessels in the ultrasonic image may not be accurately detected depending on the subject.
- the accuracy calculation unit that analyzes the ultrasonic image of the subject frame by frame and calculates the accuracy of the blood vessels in the ultrasonic image, and the accuracy calculated by the accuracy calculation unit are accurate.
- a blood vessel detection unit that detects blood vessels higher than the threshold value, and an accuracy threshold change unit that changes the accuracy threshold based on multiple accuracy calculated by the accuracy calculation unit for ultrasonic images of multiple frames. It is characterized by having.
- the device control unit can determine that the ultrasonic probe is stationary, and when it is determined that the ultrasonic probe is stationary for a predetermined time or longer, the accuracy can be stored in the accuracy memory. In addition, the device control unit determines that the ultrasonic probe is in contact with the body surface of the subject, and when it is determined that the ultrasonic probe is in contact with the body surface of the subject, the accuracy is determined. It can also be saved in memory.
- the image processing device can include a change notification unit that notifies the user of the change in the accuracy threshold value. Further, the image processing apparatus can be provided with an accuracy threshold memory for storing the accuracy threshold changed by the accuracy threshold changing unit for each subject. Further, the image processing device can have an input device for the user to perform an input operation and a manual change unit for changing the accuracy threshold value based on the input operation via the input device.
- the ultrasonic image of the subject is analyzed frame by frame, the accuracy of the blood vessel in the ultrasonic image is calculated, and the blood vessel whose accuracy is higher than the accuracy threshold is detected.
- the accuracy threshold is changed based on a plurality of accuracy calculated for an ultrasonic image of a plurality of frames.
- the image processing device analyzes an ultrasonic image of a plurality of frames of a subject frame by frame, and is calculated by an accuracy calculation unit and an accuracy calculation unit that calculates the accuracy of blood vessels in the ultrasonic image. Since it is provided with a blood vessel detection unit that detects a blood vessel whose accuracy is higher than the accuracy threshold value and an accuracy threshold value change unit that changes the accuracy threshold value based on a plurality of accuracy calculations calculated by the accuracy calculation unit. It is possible to detect blood vessels in an ultrasonic image with high accuracy.
- Embodiment 2 of this invention It is a block diagram which shows the structure of the transmission / reception circuit in Embodiment 2 of this invention. It is a block diagram which shows the structure of the image generation part in Embodiment 2 of this invention. It is a flowchart which shows the operation of the ultrasonic diagnostic apparatus which concerns on Embodiment 2 of this invention.
- FIG. 1 shows the configuration of the image processing apparatus 1 according to the first embodiment of the present invention.
- the image processing device 1 receives an ultrasonic image from an external device (not shown) such as an ultrasonic diagnostic device, and displays and analyzes the ultrasonic image.
- an external device not shown
- an ultrasonic diagnostic device such as an ultrasonic diagnostic device
- the image processing device 1 includes a display control unit 11, and a monitor 12 is connected to the display control unit 11. Further, the image processing device 1 includes an accuracy calculation unit 13, an accuracy memory 14 is connected to the accuracy calculation unit 13, and an accuracy threshold value changing unit 15 is connected to the accuracy memory 14. Further, the blood vessel detection unit 16, the accuracy threshold memory 17, and the change notification unit 19 are connected to the accuracy threshold change unit 15. The accuracy threshold memory 17 is connected to the blood vessel detection unit 16. Further, the image processing device 1 includes a manual change unit 18, and the manual change unit 18 is connected to the blood vessel detection unit 16 and the change notification unit 19. Further, the blood vessel detection unit 16 and the change notification unit 19 are connected to the display control unit 11.
- the display control unit 11, the accuracy calculation unit 13, the accuracy memory 14, the accuracy threshold change unit 15, the blood vessel detection unit 16, the accuracy threshold memory 17, the manual change unit 18, and the change notification unit 19 are combined with the device control unit. 20 is connected. Further, the input device 21 is connected to the device control unit 20.
- the processor 22 is composed of a display control unit 11, an accuracy calculation unit 13, an accuracy threshold value change unit 15, a blood vessel detection unit 16, a manual change unit 18, a change notification unit 19, and a device control unit 20. Further, an ultrasonic image is input to the display control unit 11 and the accuracy calculation unit 13 from an external device (not shown) such as a so-called ultrasonic diagnostic apparatus.
- the accuracy calculation unit 13 analyzes the ultrasonic image of the subject for each frame and calculates the accuracy of the blood vessels in the ultrasonic image.
- the accuracy of a blood vessel in an ultrasonic image is an index showing the plausibility of a blood vessel-like structure contained in the ultrasonic image, and is expressed by, for example, the probability that the structure is a blood vessel.
- the accuracy calculation unit 13 calculates the accuracy of each ultrasonic image for each structure that seems to be a blood vessel in the ultrasonic image.
- the blood vessels for which the accuracy is calculated include veins and arteries.
- the accuracy memory 14 is a memory for storing the accuracy calculated by the accuracy calculation unit 13.
- the accuracy stored in the accuracy memory 14 is transmitted to the accuracy threshold value changing unit 15 under the control of the device control unit 20.
- the accuracy memory 14 includes, for example, a flash memory, an HDD (Hard Disc Drive), an SSD (Solid State Drive), an FD (Flexible Disc), and an MO disk (Magneto-Optical disc).
- Optical magnetic disc Optical magnetic disc
- MT Magnetic Tape: magnetic tape
- RAM Random Access Memory: random access memory
- CD Compact Disc: compact disc
- DVD Digital Versatile Disc: digital versatile disc
- SD card Secure Digital card
- USB memory Universal Serial Bus memory
- the blood vessel detection unit 16 has an accuracy threshold value for the accuracy of the blood vessel, and detects a blood vessel whose accuracy calculated by the accuracy calculation unit 13 is higher than the accuracy threshold value. When the accuracy calculated by the accuracy calculation unit 13 is equal to or less than the accuracy threshold value, the blood vessel detection unit 16 does not detect a blood vessel having that accuracy. For example, among the three structures A1, A2, and A3 shown in FIG. 2, when the accuracy for the structures A1 and A2 is larger than the accuracy threshold and the accuracy for the structure A3 is equal to or less than the accuracy threshold. , Structures A1 and A2 are detected as blood vessels, and structures A3 are not detected as blood vessels.
- the accuracy threshold value changing unit 15 calculates the accuracy change value for each of the structures A1, A2, and A3 based on the plurality of accuracy calculated by the accuracy calculation unit 13 for the ultrasonic image U of a plurality of frames. Moreover, the accuracy threshold value of the blood vessel detection unit 16 is changed to the changed value.
- the input device 21 is for the user to perform an input operation.
- the input device 21 is composed of, for example, a keyboard, a mouse, a trackball, a touch pad, a touch panel, and other devices for the user to perform an input operation.
- the monitor 12 performs various displays under the control of the display control unit 11.
- the monitor 12 includes, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL display (Organic Electroluminescence Display).
- step S5 the blood vessel detection unit 16 detects a blood vessel having a higher accuracy than the accuracy threshold value changed in step S4.
- the accuracy calculated for the structures A1 and A2 shown in FIG. 2 is higher than the accuracy threshold value
- the accuracy calculated for the structure A3 is equal to or less than the accuracy threshold value.
- the structures A1 and A2 are detected as blood vessels, and the structures A3 are not detected as blood vessels.
- the blood vessel detection unit 16 emphasizes the structures A1 and A2 detected as blood vessels in step S5 and displays them on the monitor 12.
- the blood vessel detection unit 16 can, for example, superimpose the contour lines of the structures A1 and A2 detected as blood vessels on the ultrasonic image U and display them on the monitor 12.
- the structures A1 and A2 may be given a color different from the surroundings to be emphasized. Thereby, the user can easily grasp the structures A1 and A2 as blood vessels.
- the change notification unit 19 notifies the user of the change of the accuracy threshold value at the timing when the accuracy threshold value change unit 15 tries to change the accuracy threshold value. You can also notify the user that the value has already changed. As a result, the user can smoothly confirm the blood vessel while clearly grasping that the accuracy threshold has been changed.
- the image generation unit 33 has a configuration in which a signal processing unit 45, a DSC (Digital Scan Converter) 46, and an image processing unit 47 are sequentially connected in series.
- the signal processing unit 45 corrects the attenuation of the sound line signal transmitted from the transmission / reception circuit 32 by the distance according to the depth of the reflection position of the ultrasonic wave, and then performs the envelope detection process to perform the subject.
- Generates a B-mode image signal which is tomographic image information about the tissue inside.
- step S13 the ultrasonic image U is generated in the same manner as in step S11.
- step S14 the accuracy calculation unit 13 analyzes the ultrasonic image U generated in step S13 and calculates the accuracy of the structures A1 to A3 in the ultrasonic image U.
- the accuracy of the blood vessels calculated for the structures A1 to A3 in this way is stored in the accuracy memory 14 under the control of the device control unit 20A.
- step S15 the device control unit 20A determines whether or not the number of frames of the ultrasonic image U for which the accuracy of the blood vessel is calculated in step S14 is N.
- N is an integer of 2 or more, and for example, 20 to 100 is set as N.
- steps S13 to S15 are repeated until the number of frames of the ultrasonic image U for which the accuracy of the blood vessel is calculated in step S14 becomes N, and the calculated accuracy is sequentially stored in the accuracy memory 14. Will be done.
- step S15 if it is determined that the number of frames of the ultrasonic image U for which the accuracy of the blood vessel is calculated in step S14 is N, the process proceeds to step S16.
- the accuracy threshold value changing unit 15 is the accuracy threshold value of the blood vessel detection unit 16 based on a plurality of accuracy calculated for the ultrasonic image U of the N frame by repeating steps S13 to S15. Calculate the change value for.
- the accuracy threshold value is set based on a plurality of certainty calculated by the accuracy calculation unit 13 for the ultrasonic image U of the N frame. Even if the blood vessels in the ultrasonic image U are difficult to see due to the condition of the subject, the blood vessels can be detected with high accuracy as in the image processing apparatus 1 of the first embodiment. Can be done.
- connection method between the ultrasonic probe 2 and the diagnostic apparatus main body 3 is not particularly limited, and may be a wired connection or a wireless connection.
- the diagnostic device main body 3 may be a so-called handheld type that can be easily carried by the user, or may be a so-called stationary type.
- step S12 the device control unit 20A determines that the instruction has been accepted when the user has input an instruction to start a series of processes for detecting the blood vessel via the input device 21.
- the trigger for determining that the instruction to start a series of processes for detecting the blood vessel has been received is not particularly limited to the input of the instruction via the input device 21.
- the device control unit 20A determines whether or not the ultrasonic probe 2 is in contact with the body surface of the subject, and when it is determined that the ultrasonic probe 2 is in contact with the body surface of the subject. , It can also be determined that the instruction to start a series of processes for detecting the blood vessel has been accepted.
- the ultrasonic probe 2 when the ultrasonic probe 2 is in contact with the body surface of the subject, an ultrasonic image U having a certain brightness or higher corresponding to the tissue in the subject is taken, but the ultrasonic probe 2 is taken.
- the ultrasonic image U which is entirely painted black may be taken because the ultrasonic echo does not propagate to the transducer array 31.
- the device control unit 20A determines that the ultrasonic probe 2 is in contact with the body surface of the subject when the ultrasonic image U having a certain brightness or higher is taken, and the whole is painted black. When the ultrasonic image U is taken, it can be determined that the ultrasonic probe 2 is away from the body surface of the subject.
- the device control unit 20A can determine that when the imaging of the ultrasonic image U is started, the instruction to start a series of processes for detecting the blood vessel is received. By these methods, it is determined that the instruction to start a series of processes for detecting the blood vessel has been received, so that the user can save the trouble of performing the input operation via the input device 21 and more smoothly. A series of processes for detecting blood vessels can be performed.
- steps S13 to S15 is repeated until the accuracy of the blood vessel is calculated for the specified N-frame ultrasonic image U, but the processing is determined from the time when the processing of the first step S13 is started.
- the process of step S13 to step S15 may be repeated until the elapsed time elapses.
- the device control unit 20A determines whether or not a predetermined time has elapsed since the start of the first step S13. This defined time can be set, for example, from 1 second to 5 seconds.
- the predetermined number of frames of the ultrasonic image U used for the determination in step S15 and the elapsed time from the time when the first step S13 is started are set in advance by the user via the input device 21. be able to.
- Two-dimensional codes such as a method of recognizing a voice pattern from a user's voice recorded by a microphone, a method of reading a barcode (one-dimensional code) corresponding to the user, and a QR (Quick Response) code (registered trademark) corresponding to the user.
- the method of reading can be mentioned.
- a motion sensor such as an acceleration sensor or a gyro sensor for detecting the motion of the ultrasonic probe 2 and a pressure sensor or the like are attached, and the device control unit 20A attaches the ultrasonic probe 2 based on the values measured by those sensors.
- ultrasonic images U similar to each other are often continuously captured, so that the device control unit 20A is continuously captured by, for example, the image generation unit 33.
- the similarity of the entire image between the generated ultrasonic images U is calculated, and when the calculated similarity is equal to or higher than the defined similarity threshold, it can be determined that the ultrasonic probe 2 is stationary. ..
- the device control unit 20A may, for example, analyze the ultrasonic image U or the ultrasonic probe. It is determined whether or not the ultrasonic probe 2 is in contact with the body surface of the subject by making a judgment using the measured values of the pressure sensor attached to 2, and the ultrasonic probe 2 is the body surface of the subject. The accuracy can be saved when it is determined that the ultrasonic probe 2 is in contact with the subject, and the preservation of the accuracy can be stopped when the ultrasonic probe 2 is determined to be away from the body surface of the subject.
- the moving speed of the ultrasonic probe 2 can be measured, for example, by attaching an acceleration sensor or the like (not shown) to the ultrasonic probe 2.
- the device control unit 20A can determine whether or not the moving speed measured by the sensor attached to the ultrasonic probe 2 is lower than the predetermined moving speed.
- the moving speed of the ultrasonic probe 2 is often relatively high when the user cannot photograph the blood vessel to be inspected, and the moving speed of the ultrasonic probe 2 when the user can photograph the blood vessel to be inspected. Is relatively low, so in order to improve the accuracy of the changed value calculated by the accuracy threshold change unit 15, the lower the moving speed of the ultrasonic probe 2, the larger the number of stored probabilities. It is preferable that the higher the moving speed of the ultrasonic probe 2, the smaller the number of accuracy of storage.
- the flowchart shown in FIG. 10 shows an embodiment in which the accuracy threshold value is changed only once, the ultrasonic image U is continuously generated even after the accuracy threshold value is changed.
- the change value is calculated every time the accuracy for the ultrasonic image U of the N frame is calculated, and the accuracy threshold value of the blood vessel detection unit 16 can be changed to the change value.
- the accuracy threshold can be sequentially changed to a more accurate change value.
- the accuracy threshold value is changed a predetermined number of times, for example, 1 to 5 times, and thereafter. Can stop changing the accuracy threshold.
- the blood vessels in the ultrasonic image U cannot be detected for some reason, it is difficult to identify whether the cause is due to the ultrasonic image U or a change in the accuracy threshold value. Therefore, by determining the number of times that the accuracy threshold value can be changed, the user can easily determine the cause and take appropriate measures even if the blood vessel in the ultrasonic image U is no longer detected. It is possible.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physiology (AREA)
- Vascular Medicine (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
Description
また、画像処理装置は、確度算出部により算出された確度を保存する確度メモリを備えることができる。
さらに、画像処理装置は、確度メモリへの確度の保存を制御する装置制御部を備えることができる。
また、装置制御部は、超音波プローブが被検体の体表に接触していることを判定し、超音波プローブが被検体の体表に接触していると判定された場合に、確度を確度メモリに保存することもできる。
また、装置制御部は、画像生成部により生成された複数フレームの超音波画像のうち超音波プローブの移動速度に応じたフレーム間隔により選択されたフレームの超音波画像に基づいて算出された確度を確度メモリに保存することもできる。
また、確度しきい値変更部は、複数フレームの超音波画像に対して算出された複数の確度を統計的に解析することにより変更値を算出し、確度しきい値を変更値に変更することもできる。
確度しきい値変更部は、変更値が血管検出部の確度しきい値よりも低い場合に、確度しきい値を変更値に変更することが好ましい。
また、画像処理装置は、確度しきい値変更部により変更された確度しきい値を被検体毎に記憶する確度しきい値メモリを備えることができる。
また、画像処理装置は、ユーザが入力操作をするための入力装置と、入力装置を介した入力操作に基づいて確度しきい値を変更する手動変更部を有することができる。
以下に記載する構成要件の説明は、本発明の代表的な実施態様に基づいてなされるが、本発明はそのような実施態様に限定されるものではない。
なお、本明細書において、「~」を用いて表される数値範囲は、「~」の前後に記載される数値を下限値および上限値として含む範囲を意味する。
本明細書において、「同一」、「同じ」は、技術分野で一般的に許容される誤差範囲を含むものとする。
図1に、本発明の実施の形態1に係る画像処理装置1の構成を示す。画像処理装置1は、超音波診断装置等の図示しない外部の機器から超音波画像を受け取って、その超音波画像の表示および解析を行う。
また、表示制御部11と確度算出部13には、いわゆる超音波診断装置等の図示しない外部の機器から超音波画像が入力される。
この際に、確度しきい値変更部15は、いわゆる外れ値に相当する値を有する確度を除外することが望ましい。確度しきい値変更部15は、例えば、複数の確度の平均値と標準偏差を算出し、さらに、算出された標準偏差の3倍と平均値との和以上の値を有する確度を、複数の確度から除外することにより、外れ値に相当する確度を除外することができる。
変更通知部19は、例えば図4に示すように、確度しきい値が変更されようとしている場合に、確度しきい値の変更を実行するか取り消すかを選択するためのダイアログパネルP1をモニタ12に表示させることができる。このダイアログパネルP1には、「血管の検出しやすさを変更しますか?」というメッセージと、変更前および変更後の検出しやすさの値と、確度しきい値の変更を実行するための実行ボタンC1と、確度しきい値の変更を取り消すための取り消しボタンC2が含まれている。
表示制御部11は、装置制御部20の制御の下で、超音波画像Uおよび血管検出部16により血管として検出された構造体A1、A2等に対して所定の処理を施して、モニタ12に表示する。
このようにして算出された複数の確度は、確度メモリ14に保存される。
このように、確度しきい値の変更がユーザに通知されることにより、ユーザは、血管の検出しやすさが変更されたことを明確に把握することができる。
このように、入力装置21を介した入力操作に基づいて確度しきい値を変更することにより、血管の検出しやすさを、さらに詳細に調整することができる。
実施の形態1の画像処理装置1は、図示しない外部の機器から超音波画像Uを受け取っているが、この態様には特に限定されない。例えば、画像処理装置1は、超音波プローブを備えた超音波診断装置でもよく、この超音波プローブを用いて撮像された超音波画像Uを解析することもできる。
超音波診断装置1Aは、超音波プローブ2と診断装置本体3を備えており、超音波プローブ2と診断装置本体3は互いに接続されている。
超音波プローブ2は、振動子アレイ31を備えており、振動子アレイ31に送受信回路32が接続されている。
信号処理部45は、送受信回路32から送出された音線信号に対し、超音波の反射位置の深度に応じて距離による減衰の補正を施した後、包絡線検波処理を施すことにより、被検体内の組織に関する断層画像情報であるBモード画像信号を生成する。
画像処理部47は、DSC46から入力されるBモード画像信号に階調処理等の各種の必要な画像処理を施した後、装置制御部20による指令に応じて、Bモード画像信号を表示制御部11および確度算出部13に送出する。画像処理部47により画像処理が施されたBモード画像信号を、単に、超音波画像Uと呼ぶ。
この際に、送受信回路32は、装置制御部20Aの制御の下で、予め設定された音速値を用いて受信フォーカス処理を行って、音線信号を生成する。このようにして送受信回路32により生成された音線信号は、画像生成部33に送出される。画像生成部33は、送受信回路32から送出された音線信号を用いて超音波画像Uを生成する。このようにして生成された超音波画像Uは、表示制御部11に送出されて、モニタ12に表示される。
ステップS14において、確度算出部13は、ステップS13で生成された超音波画像Uを解析して、超音波画像U内の構造体A1~A3の確度を算出する。こうして構造体A1~A3に対して算出された血管の確度は、装置制御部20Aの制御の下で、確度メモリ14に保存される。
ステップS16において、確度しきい値変更部15は、ステップS13~ステップS15の繰り返しによりNフレームの超音波画像Uに対して算出された複数の確度に基づいて、血管検出部16の確度しきい値に対する変更値を算出する。
ステップS18において、血管検出部16は、ステップS13~ステップS15の繰り返しにおいて最後に生成された超音波画像Uすなわち最新の超音波画像Uに対して、ステップS17で変更済の確度しきい値よりも高い確度を有する血管を検出する。例えば、図2に示す血管らしき構造体A1~A3のうち、構造体A1、A2の確度が確度しきい値より高く、構造体A3の確度が確度しきい値より低い場合に、血管検出部16は、構造体A1およびA2を血管として検出する。
また、画像生成部33は、診断装置本体3に備えられているが、診断装置本体3に備えられる代わりに、超音波プローブ2に備えられていてもよい。
また、図9に示すように、画像生成部33は、信号処理部45、DSC46および画像処理部47を備えているが、そのうち、信号処理部45は超音波プローブ2に含まれることもできる。
また、診断装置本体3は、ユーザが容易に携帯することが可能ないわゆるハンドヘルド型でもよく、いわゆる据え置き型でもよい。
これらの方法により、血管を検出するための一連の処理を開始する指示が受け付けられたと判定されることにより、入力装置21を介してユーザが入力操作を行う手間を省くことができ、より円滑に血管を検出するための一連の処理を実行することができる。
また、超音波プローブ2が静止している場合には、互いに類似する超音波画像Uが連続的に撮影されることが多いため、装置制御部20Aは、例えば、画像生成部33により連続的に生成された超音波画像U間の画像全体の類似度を算出し、算出された類似度が定められた類似度しきい値以上である場合に、超音波プローブ2が静止していると判定できる。
Claims (15)
- 被検体の超音波画像をフレーム毎に解析して、前記超音波画像内の血管の確度を算出する確度算出部と、
前記確度算出部により算出された前記確度が確度しきい値よりも高い前記血管を検出する血管検出部と、
複数フレームの前記超音波画像に対して前記確度算出部により算出された複数の前記確度に基づいて前記確度しきい値を変更する確度しきい値変更部と
を備える画像処理装置。 - 超音波プローブと、
前記超音波プローブを用いた超音波ビームの送受信に基づいて、前記確度算出部により解析される前記超音波画像を生成する画像生成部と
を備える請求項1に記載の画像処理装置。 - 前記確度算出部により算出された前記確度を保存する確度メモリを備える請求項2に記載の画像処理装置。
- 前記確度メモリへの前記確度の保存を制御する装置制御部を備える請求項3に記載の画像処理装置。
- 前記装置制御部は、前記超音波プローブが静止していることを判定し、前記超音波プローブが定められた時間以上静止していると判定された場合に、前記確度を前記確度メモリに保存する請求項4に記載の画像処理装置。
- 前記装置制御部は、前記超音波プローブが前記被検体の体表に接触していることを判定し、前記超音波プローブが前記被検体の前記体表に接触していると判定された場合に、前記確度を前記確度メモリに保存する請求項4に記載の画像処理装置。
- 前記装置制御部は、前記超音波プローブの移動速度が定められた移動速度よりも低いと判定された場合に、前記確度を前記確度メモリに保存する請求項4に記載の画像処理装置。
- 前記装置制御部は、前記画像生成部により生成された前記複数フレームの超音波画像のうち前記超音波プローブの移動速度に応じたフレーム間隔により選択されたフレームの前記超音波画像に基づいて算出された前記確度を前記確度メモリに保存する請求項4に記載の画像処理装置。
- 前記確度しきい値変更部は、前記複数フレームの超音波画像に対して算出された前記複数の確度の最高値に定められた割合を乗じて変更値を算出し、前記確度しきい値を前記変更値に変更する請求項1~8のいずれか一項に記載の画像処理装置。
- 前記確度しきい値変更部は、前記複数フレームの超音波画像に対して算出された前記複数の確度を統計的に解析することにより変更値を算出し、前記確度しきい値を前記変更値に変更する請求項1~8のいずれか一項に記載の画像処理装置。
- 前記確度しきい値変更部は、前記変更値が前記血管検出部の前記確度しきい値よりも低い場合に、前記確度しきい値を前記変更値に変更する請求項9または10に記載の画像処理装置。
- 前記確度しきい値の変更をユーザに通知する変更通知部を備える請求項1~11のいずれか一項に記載の画像処理装置。
- 前記確度しきい値変更部により変更された確度しきい値を被検体毎に記憶する確度しきい値メモリを備える請求項1~12のいずれか一項に記載の画像処理装置。
- ユーザが入力操作をするための入力装置と、
前記入力装置を介した入力操作に基づいて前記確度しきい値を変更する手動変更部を有する請求項1~13のいずれか一項に記載の画像処理装置。 - 被検体の複数フレームの超音波画像をフレーム毎に解析して前記超音波画像内の血管の確度を算出し、
前記確度が確度しきい値よりも高い前記血管を検出し、
複数の前記確度に基づいて、前記確度しきい値を変更する
画像処理装置の制御方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202180077666.5A CN116456908A (zh) | 2020-11-19 | 2021-10-18 | 图像处理装置及图像处理装置的控制方法 |
EP21894399.1A EP4248880A4 (en) | 2020-11-19 | 2021-10-18 | IMAGE PROCESSING DEVICE AND METHOD FOR CONTROLLING THE IMAGE PROCESSING DEVICE |
JP2022563640A JPWO2022107525A1 (ja) | 2020-11-19 | 2021-10-18 | |
US18/319,399 US20230285003A1 (en) | 2020-11-19 | 2023-05-17 | Image processing apparatus and control method of image processing apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020192655 | 2020-11-19 | ||
JP2020-192655 | 2020-11-19 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/319,399 Continuation US20230285003A1 (en) | 2020-11-19 | 2023-05-17 | Image processing apparatus and control method of image processing apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022107525A1 true WO2022107525A1 (ja) | 2022-05-27 |
Family
ID=81709019
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/038407 WO2022107525A1 (ja) | 2020-11-19 | 2021-10-18 | 画像処理装置および画像処理装置の制御方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20230285003A1 (ja) |
EP (1) | EP4248880A4 (ja) |
JP (1) | JPWO2022107525A1 (ja) |
CN (1) | CN116456908A (ja) |
WO (1) | WO2022107525A1 (ja) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012147505A1 (ja) | 2011-04-27 | 2012-11-01 | オリンパスメディカルシステムズ株式会社 | 医用画像処理装置及び医用画像処理方法 |
JP2013180160A (ja) * | 2012-03-05 | 2013-09-12 | Fujifilm Corp | 画像診断支援装置、方法およびプログラム |
JP2016159116A (ja) * | 2015-03-05 | 2016-09-05 | パナソニックIpマネジメント株式会社 | 3次元モデル生成装置及び方法、及び、3次元モデル生成用プログラム |
JP2017221774A (ja) * | 2017-09-27 | 2017-12-21 | キヤノン株式会社 | 情報処理装置および方法 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6924905B2 (ja) * | 2018-08-27 | 2021-08-25 | 富士フイルム株式会社 | 超音波診断装置および超音波診断装置の制御方法 |
WO2020087732A1 (zh) * | 2018-11-02 | 2020-05-07 | 无锡祥生医疗科技股份有限公司 | 基于神经网络的静脉与动脉识别方法与系统 |
-
2021
- 2021-10-18 WO PCT/JP2021/038407 patent/WO2022107525A1/ja active Application Filing
- 2021-10-18 EP EP21894399.1A patent/EP4248880A4/en active Pending
- 2021-10-18 JP JP2022563640A patent/JPWO2022107525A1/ja active Pending
- 2021-10-18 CN CN202180077666.5A patent/CN116456908A/zh active Pending
-
2023
- 2023-05-17 US US18/319,399 patent/US20230285003A1/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012147505A1 (ja) | 2011-04-27 | 2012-11-01 | オリンパスメディカルシステムズ株式会社 | 医用画像処理装置及び医用画像処理方法 |
JP2013180160A (ja) * | 2012-03-05 | 2013-09-12 | Fujifilm Corp | 画像診断支援装置、方法およびプログラム |
JP2016159116A (ja) * | 2015-03-05 | 2016-09-05 | パナソニックIpマネジメント株式会社 | 3次元モデル生成装置及び方法、及び、3次元モデル生成用プログラム |
JP2017221774A (ja) * | 2017-09-27 | 2017-12-21 | キヤノン株式会社 | 情報処理装置および方法 |
Non-Patent Citations (3)
Title |
---|
CSURKA ET AL.: "Visual Categorization with Bags of Keypoints", PROC. OF ECCV WORKSHOP ON STATISTICAL LEARNING IN COMPUTER VISION, 2004, pages 59 - 74 |
KRIZHEVSK ET AL.: "ImageNet Classification with Deep Convolutional Neural Networks", ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS, vol. 25, 2012, pages 1106 - 1114 |
See also references of EP4248880A4 |
Also Published As
Publication number | Publication date |
---|---|
EP4248880A1 (en) | 2023-09-27 |
CN116456908A (zh) | 2023-07-18 |
US20230285003A1 (en) | 2023-09-14 |
JPWO2022107525A1 (ja) | 2022-05-27 |
EP4248880A4 (en) | 2023-11-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6924905B2 (ja) | 超音波診断装置および超音波診断装置の制御方法 | |
US20210128102A1 (en) | Ultrasound diagnostic apparatus and control method of ultrasound diagnostic apparatus | |
EP3845133B1 (en) | Ultrasonic diagnostic device and ultrasonic diagnostic device control method | |
JP7259052B2 (ja) | 超音波診断装置および超音波診断装置の制御方法 | |
JP7235868B2 (ja) | 超音波診断装置および超音波診断装置の制御方法 | |
JP6875541B2 (ja) | 音響波診断装置および音響波診断装置の制御方法 | |
US20180168546A1 (en) | Ultrasound diagnostic apparatus and method for controlling ultrasound diagnostic apparatus | |
EP3513738A1 (en) | Ultrasonic diagnostic device and method for controlling ultrasonic diagnostic device | |
US20220031288A1 (en) | Ultrasound diagnostic apparatus, control method of ultrasound diagnostic apparatus, and processor for ultrasound diagnostic apparatus | |
EP3338643A1 (en) | Ultrasonic diagnostic device and method for controlling ultrasonic diagnostic device | |
US11812920B2 (en) | Ultrasound diagnostic apparatus and method for controlling ultrasound diagnostic apparatus | |
US11116481B2 (en) | Ultrasound diagnostic apparatus and control method of ultrasound diagnostic apparatus | |
WO2022107525A1 (ja) | 画像処理装置および画像処理装置の制御方法 | |
JP6885908B2 (ja) | 超音波診断装置および超音波診断装置の制御方法 | |
JP6937731B2 (ja) | 超音波診断装置および超音波診断装置の制御方法 | |
US20220378397A1 (en) | Ultrasound diagnostic apparatus, method for controlling ultrasound diagnostic apparatus, and processor for ultrasound diagnostic apparatus | |
EP4193930A1 (en) | Ultrasound diagnostic apparatus and control method of ultrasound diagnostic apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21894399 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022563640 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202180077666.5 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021894399 Country of ref document: EP Effective date: 20230619 |