WO2018079344A1 - Dispositif et programme de traitement d'images ultrasonores - Google Patents

Dispositif et programme de traitement d'images ultrasonores Download PDF

Info

Publication number
WO2018079344A1
WO2018079344A1 PCT/JP2017/037548 JP2017037548W WO2018079344A1 WO 2018079344 A1 WO2018079344 A1 WO 2018079344A1 JP 2017037548 W JP2017037548 W JP 2017037548W WO 2018079344 A1 WO2018079344 A1 WO 2018079344A1
Authority
WO
WIPO (PCT)
Prior art keywords
section
cross
coordinate system
normalized
observation
Prior art date
Application number
PCT/JP2017/037548
Other languages
English (en)
Japanese (ja)
Inventor
笠原　英司
裕哉 宍戸
優子 永瀬
Original Assignee
株式会社日立製作所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社日立製作所 filed Critical 株式会社日立製作所
Publication of WO2018079344A1 publication Critical patent/WO2018079344A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/13—Tomography
    • A61B8/14—Echo-tomography

Definitions

  • the present invention relates to an ultrasonic image processing apparatus and a program, and more particularly to a technique for processing volume data.
  • An ultrasonic image can be obtained by transmitting and receiving an ultrasonic beam to and from a subject using an ultrasonic diagnostic apparatus.
  • an ultrasonic beam is scanned in a three-dimensional space, and echo data is sequentially collected from the three-dimensional space. Based on the collected echo data, three-dimensional ultrasonic data (volume data) or volume data is obtained.
  • An STIC (Spatio-Temporal Image Correlation) method for generating four-dimensional ultrasound data arranged in the time direction is known.
  • a user such as a doctor may specify an observation cross section (main cross section) in the volume data and perform observation or diagnosis using a tomographic image in the specified observation cross section.
  • volume data including a fetal heart image may be acquired in advance, and a tomographic image of an arbitrary observation cross section in the volume data may be displayed on the display unit for diagnosis or observation.
  • the cross section to be observed is predetermined for each diagnosis content. For example, in the case of the heart, when an abnormality of the left ventricle, left atrium, right ventricle, and right atrium is observed, a four-chamber cross section (a cross section including the left ventricle, left atrium, right ventricle, and right atrium) is observed. It becomes a power section. Therefore, the user needs to appropriately specify the observation cross section in the volume data according to the diagnosis contents.
  • ⁇ Operation to specify an appropriate observation section in volume data may be difficult.
  • the fetal heart since the fetus can take various postures within the mother's body, the fetal heart can be in various positions relative to a predetermined position on the mother's surface (ie, a predetermined ultrasonic wave transmitting / receiving surface).
  • the orientation (posture) can be taken. That is, for each volume data, the position or orientation of the fetal heart can vary. Therefore, it may be difficult or time-consuming to specify a target observation cross section in the fetal heart from the volume data.
  • Patent Documents 1 to 6 Conventionally, techniques for automatically specifying an observation cross section in volume data have been proposed (for example, Patent Documents 1 to 6).
  • JP 2014-36863 A Japanese Patent No. 5479138 US Patent Publication No. 2015/0190112 JP 2009-72593 A Special table 2009-513221 gazette Special table 2015-534872 gazette
  • a method of first specifying a reference cross section and specifying an observation cross section based on the reference cross section For example, in Patent Document 1, a reference cross section is first specified from volume data, and a plane obtained by horizontally moving the specified reference cross section by a predetermined distance is used as an observation cross section. In Patent Document 2, a reference cross section is specified based on three reference points detected in an observation target (heart) included in volume data, and a plane obtained by rotating the reference cross section by a predetermined angle in a predetermined direction is an observation cross section. It is said. In Patent Document 3, a user inputs a plurality of feature points (reference points) in an observation target (heart) included in volume data, and specifies a plurality of arbitrary cross sections based on the plurality of reference points.
  • the cross section specified as the observation cross section may not be an accurate observation cross section intended by the user.
  • a cross section horizontally moved by a predetermined distance from a four-chamber cross section as a reference cross section as a five-chamber cross section (a cross section including the left ventricle, left atrium, right ventricle, right atrium, and aorta)
  • the shape of the heart in this case
  • the distance between the four-chamber cross-section and the five-chamber cross-section has individual differences. Therefore, in this method, an accurate five-chamber cross-section may not be specified depending on the subject.
  • An object of the present invention is to easily and more accurately specify an observation cross section in consideration of individual differences of target tissues in volume data obtained by transmission and reception of ultrasonic waves.
  • the ultrasonic image processing apparatus is based on the target tissue image included in the volume data obtained by transmission and reception of ultrasonic waves, and the real coordinate system included in the volume data and the calculated normalized coordinate system.
  • Correspondence generation means for calculating a correspondence relation, and based on the correspondence relation, from a normalized observation cross section defined in the normalized coordinate system, a cross section specifying means for specifying an actual data observation cross section in the real coordinate system, Image forming means for forming a tomographic image corresponding to the identified actual data observation section from the volume data.
  • the correspondence between the real coordinate system and the normalized coordinate system of the volume data is calculated.
  • the correspondence relationship indicates coordinate conversion between the real coordinate system and the normalized coordinate system.
  • a normalized observation section is defined in the normalized coordinate system.
  • the normalized observation cross section is defined by three coordinates in the normalized coordinate system.
  • a target tissue image having a prescribed size or orientation can be defined. Therefore, a normalized observation cross section corresponding to each observation cross section can be uniquely defined without considering individual differences in the target tissue image.
  • each real data observation section on the real coordinate system corresponding to each normalized observation section defined in the normalized coordinate system can be specified.
  • the correspondence between the real coordinate system and the normalized coordinate system can be calculated for each target tissue image. Therefore, by specifying the actual data observation cross section based on the normalized observation cross section and the correspondence relationship, even if there is an individual difference in the target tissue image, the individual difference is absorbed, and in any target tissue image A more accurate actual data observation section is specified in the volume data.
  • the correspondence generation means calculates the correspondence based on a representative point group detected from the target tissue image.
  • the representative point group includes a reference point of the target tissue image and both end points of the target tissue image on each coordinate axis of the real coordinate system, and the normalized coordinate system includes the reference point and Defined based on the endpoints.
  • the normalized coordinate system has at least two different scales.
  • the normalized coordinate system has a plurality of different scales, it is possible to specify a more accurate actual data observation section in the volume data in consideration of the size balance of each part included in the target tissue and distortion of the arrangement relationship. be able to.
  • the difference in the shape of the heart due to individual differences may not only be different in outline but also in the ratio of the size of the left and right ventricles, for example.
  • by changing the left and right scales based on the septum of the heart in the normalized coordinate system it is possible to specify the actual data observation section while eliminating the balance of the left and right ventricle sizes. .
  • a plurality of the normalized observation cross sections are defined, and the cross section specifying means is configured to select the realization corresponding to the selected normalized observation cross section based on a selected normalization observation cross section selected from the plurality of normalization observation cross sections. Identify the data observation cross section.
  • a plurality of normalized observation sections can be defined in advance. According to the present invention, even if any one of the plurality of normalized observation sections is selected, the actual data observation section corresponding to the selected normal observation section based on the correspondence between the actual coordinate system and the normalized coordinate system. Can be specified.
  • it further includes a representative cross-section specifying means for specifying a representative cross-section in the volume data, wherein the correspondence relationship generating means includes the coordinates in the real coordinate system and the normality of a plurality of representative points detected in the representative cross-section. The correspondence is calculated based on the relationship with the coordinates in the coordinated coordinate system.
  • the representative cross-section specifying means includes a posture specifying means for specifying a posture of the volume data so that a target tissue image included in the temporary representative cross-section specified in the volume data matches template data, and the posture Representative volume search means for searching for the representative cross section in the vicinity of the temporary representative cross section in the volume data of the posture defined by the defining means.
  • the volume data is rotated so that the specified temporary representative cross-section predetermined (orientation) is in the prescribed orientation.
  • the direction of the representative cross-sectional image is the direction indicated by the template data. For example, the direction on the apex side of the heart is defined.
  • This orientation corresponds to the orientation of the target tissue image defined in the normalized coordinate system.
  • searching for the vicinity of the temporary representative cross-section in the rotated volume data the representative cross-section facing the specified direction can be specified.
  • a display unit that displays the tomographic image, and in the normalized coordinate system, a label space region that corresponds to each part of the target tissue image and includes label information indicating each part is defined,
  • the display unit displays label information corresponding to the label space region crossed by the normalized observation cross section together with a tomographic image corresponding to the normalized observation cross section. indicate.
  • the label information corresponding to the label space region traversed by the normalized section, regardless of which normalized section is selected.
  • the user can easily grasp which part is which part in the displayed tomographic image.
  • the label information is displayed so that the correspondence between the part included in the tomographic image corresponding to the normalized observation section and the part corresponding to the label information becomes clear.
  • FIG. 1 is a schematic configuration diagram of an ultrasonic diagnostic apparatus according to the present embodiment. It is a figure for demonstrating the three-dimensional scanning in this embodiment. It is a figure which shows several volume data corresponding to each time phase. It is a figure which shows the observation cross section in the heart of a fetus. It is a figure which shows the detailed structure of a volume data processing part. It is a figure which shows the mode of the reversal binarization process with respect to a temporary four-chamber cross section. It is a graph which shows the threshold value for a binarization process. It is a figure which shows template data. It is a figure which shows the mode of a matching process with provisional four-chamber cross-sectional data and template data.
  • FIG. 6 is an enlarged view near a feature point C. It is a figure which shows a heart area
  • FIG. 1 is a schematic configuration diagram of an ultrasonic diagnostic apparatus 10 as an ultrasonic image processing apparatus.
  • the ultrasonic diagnostic apparatus 10 is generally a medical device that is installed in a medical institution such as a hospital and performs ultrasonic diagnosis on a living body.
  • a target tissue is a fetal heart and a tomographic image of an observation cross section in the fetal heart is formed, but the present invention is not limited thereto.
  • Probe 12 is an ultrasonic probe that transmits and receives ultrasonic waves to and from the fetal heart.
  • the probe 12 is communicably connected to the apparatus main body including the transmission / reception unit 14 and below by a cable or wirelessly.
  • the probe 12 has a transducer array including a plurality of transducer elements, and ultrasonic waves are transmitted and received by the transducer array.
  • a scanning plane is formed in a space including the fetal heart by transmitting and receiving ultrasonic waves from the transducer array.
  • a fetal heart that is a subject is included by mechanically moving a scanning surface that is electronically formed by a plurality of one-dimensionally arranged vibration elements (1D array transducers).
  • An ultrasonic beam is scanned in the dimensional space.
  • a plurality of vibration elements (2D array transducers) arranged two-dimensionally may be electronically controlled to scan the ultrasonic beam three-dimensionally.
  • FIG. 2 is a diagram for explaining the three-dimensional scanning in the present embodiment.
  • the three-dimensional space including the fetal heart is represented by an xyz coordinate system which is a real coordinate system.
  • the scanning surface S is formed so as to be substantially parallel to the xy plane, and the plurality of scanning surfaces S are formed along the z-axis direction while slowly moving the scanning surface S in the z-axis direction. It is formed.
  • the scanning plane S is slowly moved in the z-axis direction over a plurality of cardiac cycles (beating cycles) of the fetal heart.
  • the transmission / reception unit 14 forms a transmission beam of ultrasonic waves by supplying a transmission signal corresponding to each transducer included in the transducer array of the probe 12.
  • the transmission / reception unit 14 receives a plurality of reception signals from each transducer included in the transducer array of the probe 12.
  • the phasing addition unit 16 performs phasing addition processing on the plurality of reception signals received by the transmission / reception unit 14 to form an ultrasonic reception beam, and outputs echo data obtained along the reception beam.
  • the beam processing unit 18 performs various signal processing such as gain correction processing, logarithmic amplification processing, envelope detection processing, and filter processing on the echo data output from the phasing addition unit 16. Thereby, beam data corresponding to each echo data is formed.
  • the DSC (Digital Scan Converter) 20 has an interpolation function and a coordinate conversion function, and forms a display frame, that is, an ultrasonic image, based on a plurality of beam data output from the beam processing unit 18.
  • a B-mode image that is a tomographic image is formed.
  • the DSC 20 forms an ultrasonic image for each scanning plane S (see FIG. 2).
  • a plurality of ultrasonic images arranged in the z-axis direction are formed.
  • the plurality of ultrasonic images are stored in the storage unit 22 described later.
  • the ultrasonic image formed by the DSC 20 may be directly output to the image composition unit 32 (described later).
  • the storage unit 22 includes, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), or a hard disk.
  • the storage unit 22 stores a program for operating each unit of the ultrasound diagnostic apparatus 10. Further, as shown in FIG. 1, a previous memory 24 and a data memory 26 are constructed in the storage unit 22. A plurality of ultrasonic images formed by the DSC 20 are stored in the previous memory 24.
  • the data memory 26 stores four-dimensional volume data (a plurality of volume data arranged in the time direction) formed by a reconstruction processing unit 28 described later.
  • the reconstruction processing unit 28 searches a plurality of reference images at a frame interval (image interval) corresponding to the cardiac cycle of the fetal heart from a plurality of ultrasonic images stored in the previous memory 24.
  • the reconstruction processing unit 28 sets the plurality of ultrasonic images stored in the previous memory 24 as a plurality of images by using each of the plurality of reference images as a unit of division. Divide into groups. Then, a plurality of tomographic image data corresponding to each time phase in the cardiac cycle is extracted from each of the plurality of image groups, thereby realizing reconstruction processing (reconstruction processing).
  • a plurality of volume data including a fetal heart three-dimensional image as a target tissue image is formed from a plurality of ultrasonic images stored in the previous memory 24.
  • the plurality of volume data corresponds to each time phase in the cardiac cycle. Since the plurality of volume data are arranged in the time direction, it can be said that the reconstruction processing unit 28 forms the four-dimensional volume data.
  • the four-dimensional volume data formed by the reconstruction processing unit 28 is stored in the data memory 26.
  • FIG. 3 shows a plurality of volume data 40 stored in the data memory 26.
  • the data memory 26 stores a plurality of volume data 40 for one cardiac cycle, but the volume data 40 over a longer period may be stored.
  • the position and posture of the probe 12 are adjusted by a user such as a doctor, so that at least a cross section (provisional four chambers) in the vicinity of the four-chamber cross section in each scanning plane S group constituting each volume data. Cross section).
  • the provisional four-chamber section does not need to be an accurate four-chamber section, and may be a section that is complexly displaced from the exact four-chamber section in the xyz-axis direction.
  • the orientation (rotation direction) and size of the provisional four-chamber cross section in the xy plane need not be specific. It should be noted that ultrasonic waves are transmitted and received in a relatively wide area, a heart stereoscopic image is detected from the volume data obtained thereby, and volume data including at least a provisional four-chamber section is automatically cut out as a scanning plane S by image processing. You may do it.
  • the volume data processing unit 30 performs processing on the four-dimensional volume data stored in the data memory 26, and automatically selects one or a plurality of actual data observation sections desired by the user for each volume data. And forming a tomographic image in the actual data observation cross section.
  • the detailed configuration of the volume data processing unit 30 and the details of the processing will be described later.
  • the image composition unit 32 synthesizes images or characters indicating various information with the tomographic image (B-mode image) of the actual data observation section formed by the volume data processing unit 30 to form display screen data.
  • the display screen data may include an ultrasonic image formed by the DSC 20.
  • the display unit 34 is composed of, for example, a liquid crystal panel or an organic EL panel. Display screen data formed by the image composition unit 32 is displayed on the display unit 34.
  • the control unit 36 is constituted by, for example, a CPU or a microcontroller, and controls each unit of the ultrasonic diagnostic apparatus 10 according to a program stored in the storage unit 22.
  • each of the transmission / reception unit 14, the phasing addition unit 16, the beam processing unit 18, the DSC 20, the reconstruction processing unit 28, the volume data processing unit 30, and the image composition unit 32 is, for example, It can be realized using hardware such as an electronic circuit or a processor, and a device such as a memory may be used as necessary in the realization. In addition, functions corresponding to the above-described units may be realized by cooperation between hardware such as a CPU, a processor, and a memory, and software (program) that defines the operation of the CPU and the processor.
  • the observation cross section means a cross section mainly used by a doctor or the like for diagnosis or observation.
  • FIG. 4 shows a schematic diagram of the fetal heart.
  • a fetal heart 42, aorta 44, pulmonary artery 46, superior vena cava 48, and lung 50 are shown.
  • the apex of an adult heart is directed to the stomach side (the lower side in FIG. 4), but in the case of a fetus, air is not contained in the lung 50, and the heart 42 has a diaphragm (not shown in FIG. 4). Therefore, the direction of the heart 42 is generally the direction in which the apex 42a faces sideways.
  • an observation cross section cross section orthogonal to the paper surface indicated by reference numeral 52 in FIG.
  • the observation cross section indicated by reference numeral 54 translated from the head to the head side shows the five-chamber cross section.
  • the observation cross section indicated by reference numeral 56 translated from the head side shows a three blood vessel cross section (a cross section including the pulmonary artery, the aorta, and the superior vena cava), and further, the reference numeral 58 translated from the head side.
  • the observation cross section shown by (3) shows a three-vascular tracheal cross section (a cross section including the pulmonary artery, aorta, superior vena cava and trachea). Note that the observation cross section shown in FIG.
  • observation cross sections 4 is a part, and there are various other observation cross sections (for example, observation cross sections that are not parallel to the four-chamber cross section).
  • observation cross sections for example, observation cross sections that are not parallel to the four-chamber cross section.
  • the volume data processing unit 30 one or a plurality of actual data observation sections are automatically specified in the four-dimensional volume data stored in the data memory 26.
  • FIG. 5 shows a detailed configuration of the volume data processing unit 30.
  • the details of the processing of the volume data processing unit 30 will be described along the processing flow.
  • the filter unit 60 extracts volume data 40 of a specific time phase from a plurality of volume data 40 (see FIG. 3) stored in the data memory 26.
  • volume data 40 corresponding to the end diastole is extracted from the cardiac cycle. This is because the end-diastolic volume data 40 in which the heart chamber becomes the largest is more suitable for later processing because the four-chamber cross section is specified later as the reference cross section.
  • the filter unit 60 extracts volume data 40 at a specific time phase by performing image processing on each volume data 40.
  • the volume data 40 corresponding to the end diastole can be detected based on the volume of the blood flow part (for example, in the heart chamber) of the fetal heart in each volume data 40.
  • the outline of the heart is extracted by three-dimensional image processing, and the volume data 40 having the largest volume of the heart cavity that is the inner space is identified as the volume data 40 at the end diastole. can do.
  • the filter unit 60 performs a process such as a smoothing filter for smoothing the omission of the tissue on the data or the boundary part on the extracted end-diastolic volume data 40.
  • the filter process reduces the possibility of erroneous detection or erroneous determination in subsequent processes.
  • the adjustment unit 62 first specifies a provisional four-chamber section as a provisional representative section in the end-diastolic volume data 40 extracted and filtered by the filter unit 60.
  • the xy section at the center in the z-axis direction is specified as the provisional four-chamber section 90 in the volume data 40.
  • the provisional four-chamber cross section 90 thus identified is generally not an accurate four-chamber cross section. That is, it does not include an accurate four-chamber cross-sectional image.
  • the provisional four-chamber cross section 90 is not limited to the cross section at the center in the z-axis direction, and may be specified based on other criteria as long as the provisional four-chamber cross section 90 can be specified in the volume data 40.
  • the adjustment unit 62 performs binarization processing on the volume data 40. That is, the adjustment unit 62 also functions as a binarization processing unit. By the binarization processing, subsequent processing can be simplified.
  • the adjustment unit 62 performs inversion binarization processing on the volume data 40.
  • FIG. 6 shows a provisional four-chamber cross section 92 in the volume data 40 subjected to the reverse binarization process.
  • the threshold value for binarization processing is determined by analyzing the luminance distribution of each voxel in the volume data 40. In general, the luminance distribution of each voxel in the volume data 40 is a bimodal graph as shown in FIG. In the present embodiment, the adjustment unit 62 performs binarization processing using the luminance corresponding to the first inflection point (the inflection point closest to the luminance value 0) in the bimodal graph as a threshold value.
  • the adjustment unit 62 defines the posture of the volume data 40 so that the orientation and size of the provisional four-chamber cross-sectional image 92a (see FIG. 6) included in the provisional four-chamber cross section 92 become the prescribed orientation and size. I do. That is, the adjustment unit 62 also functions as a posture defining unit. In the present embodiment, the adjustment unit 62 performs a process of defining the posture based on the template data 64 stored in advance in the storage unit 22.
  • FIG. 8 shows a schematic diagram of the template data 64.
  • the template data 64 defines the direction and size of the four-chamber cross-sectional image.
  • the template data 64 is used to define the orientation and size of the provisional four-chamber cross-sectional image 92a.
  • the template data 64 in the present embodiment is image data.
  • the template data 64 has an oval part 64a corresponding to the heart cavity part of the four-chamber cross-sectional image.
  • the egg-shaped portion 64a has an asymmetric shape in the up-down direction, and this indicates the prescribed direction of the four-chamber cross-sectional image, particularly the left-right direction as the first direction.
  • the left-right direction means the left-right direction when the fetal heart is viewed from the front (see FIG. 4).
  • the direction of the apex is shown in the template data 64.
  • one end portion of the egg-shaped portion 64a is a narrow end portion 64b
  • the other end portion is a thick end portion 64c
  • the narrow end portion 64b side is the apex side of the four-chamber cross-sectional image. Show.
  • the size (area) of the egg shaped portion 64a indicates the prescribed size (area) of the four-chamber cross-sectional image.
  • the template data 64 includes a slit 64d that extends from the narrow end portion 64b of the egg-shaped portion 64a toward the thick end portion 64c. The slit 64d corresponds to the septum of the four-chamber cross-sectional image.
  • “1” is set as the luminance value for the pixel of the egg-shaped portion 64a, and “0” is set as the luminance value for the other pixels including the slit 64d.
  • the adjustment unit 62 uses such template data 64 to rotate, enlarge, and enlarge the volume data 40 so that the provisional four-chamber cross-sectional image 92a has a specified orientation and a predetermined size.
  • a reduction process or a parallel movement process of the three-dimensional heart image included in the volume data 40 is performed.
  • these processes are collectively referred to as a matching process.
  • the state of the matching process is shown in FIG.
  • the luminance value of each pixel corresponding to the heart chamber portion of the provisional four-chamber section 92 that has been inverted and binarized is approximately “1”, and the luminance value of the pixel corresponding to the other portion (such as the myocardium or septum). Is “0”.
  • the luminance value of the pixel of the egg-shaped portion 64a corresponding to the heart cavity portion of the template data 64 is “1”
  • the luminance value of the pixel corresponding to the other portion is “0”.
  • the adjustment unit 62 superimposes the provisional four-chamber section 92 and the template data 64 so that the sum of the products of the luminance values of the corresponding pixels is maximized between the provisional four-chamber section 92 and the template data 64.
  • the provisional four-chamber cross section 92 is rotated, enlarged / reduced, or translated. Accordingly, the volume data 40 is also rotated, enlarged / reduced, and the heart stereoscopic image included in the volume data 40 is translated.
  • the weight is increased as the distance from the slit 64d is increased in the horizontal direction (left and right direction in FIG. 8) of the template data 64, and the weight is decreased as the distance from the slit 64d is increased.
  • the orientation and size of the provisional four-chamber cross-sectional image 92a can be determined based on the position of the septum of the slit 64d and the provisional four-chamber cross-sectional image 92a.
  • the orientation of the volume data 40 can be defined so that the orientation and size of the provisional four-chamber cross-sectional image 92a are as defined in the template data 64.
  • FIG. 9 shows a provisional four-chamber cross section 94 including a provisional four-chamber cross-sectional image 94a subjected to matching processing.
  • the rotation process of the volume data 40 can be expressed by an equation using a quaternion.
  • the quaternion is expressed by the following expression by four elements that are one real part and three imaginary parts.
  • t is a real part and x, y, and z are imaginary parts.
  • a certain coordinate (X, Y, Z) in the coordinate system is expressed as follows according to a quaternion.
  • the rotation axis does not start from the coordinate origin
  • the rotation axis and the coordinates of the target of the rotation process are translated and the rotation axis is set to the coordinate origin. Then, the coordinates after the rotation processing are obtained by the above formula, and the target coordinates can be obtained by translating the coordinates in the reverse direction.
  • the adjustment unit 62 holds each parameter related to the rotation processing of the volume data 40 in the storage unit 22. Specifically, a unit vector ( ⁇ , ⁇ , ⁇ ) representing the rotation axis and ⁇ representing the rotation angle are held. When the volume data 40 is enlarged / reduced, the enlargement / reduction ratio is retained. Furthermore, when a translation is performed with respect to the heart stereoscopic image, a vector indicating the translation is held.
  • the template data 64 is used to perform the matching process, but the orientation and size of the provisional four-chamber cross-sectional image 92a are adjusted by performing image recognition processing on the provisional four-chamber section 92. You may do it. For example, a feature point (for example, apex portion, central part of the septum, etc.) included in the provisional four-chamber cross-sectional image 92a is detected, and based on the detected feature point, the provisional four-chamber cross-sectional image 92a (and thus the volume data 40) is You may make it perform the process to perform. In such a process, a machine learning method that uses the accumulated results of past adjustment processes may be used.
  • a feature point for example, apex portion, central part of the septum, etc.
  • the representative cross-section detector 66 as representative cross-section search means searches for the (true) four-chamber cross section as the representative cross-section in the adjusted volume data with reference to the provisional four-chamber cross section 94 matched by the adjusting section 62.
  • FIG. 10 shows a processing flow of the representative cross-section detection unit 66.
  • a post-adjustment volume data 96 whose posture has been adjusted by the adjustment unit 62 and a provisional four-chamber cross section 94 including the provisional four-chamber cross-sectional image 94a that has been adjusted are shown.
  • the representative cross-section detection unit 66 superimposes the temporary four-chamber cross-sectional image 94a included in the temporary four-chamber cross section 94 and the template data 64, and the rotation axis that is the tangent to the lower end (the lower end of the thick end portion 64c) in the template data 64.
  • the temporary four-chamber cross section 94 and the template data 64 are both rotated about 98a (see the upper right figure in FIG. 10).
  • the brightness of each coordinate corresponding to the cross-sectional image included in the rotated provisional four-chamber section 94 and the template data 64 is similar to the matching process shown in FIG.
  • the sum of the products of the values is calculated, and in the adjusted volume data 96, the first detection cross section 100 (see the lower left figure in FIG. 10) that is the cross section in which the sum is maximized (that is, the area in the heart chamber is maximized). To detect.
  • the representative cross-section detection unit 66 sets both the first detection cross-section 100 and the template data 64 around the rotation axis 98b that is the tangent to the upper end (the upper end of the narrow end 64b) of the template data 64 in the first detection cross-section 100. Rotate. Then, while rotating the first detection section 100 and the template data 64, the sum of the products of the brightness values of the corresponding coordinates of the rotated first detection section 100 and the template data 64 is calculated.
  • the second detection cross section 102 (see the lower right diagram in FIG. 10), which is the cross section in which the sum is the maximum, is detected. Note that either the rotation process based on the lower end of the template data 64 or the rotation process based on the upper end may be performed first.
  • the representative cross-section detector 66 rotates both the second detection cross-section 102 and the template data 64 around the central axis 98c (axis along the slit 64d) 98c of the template data 64 in the second detection cross-section 102. Then, while rotating the second detection cross section 102 and the template data 64, the sum of the products of the brightness values of the corresponding coordinates of the rotated second detection cross section 102 and the template data 64 is calculated. The cross section where the sum is the maximum is detected.
  • a cross section having a larger heart chamber area is searched in the vicinity of the provisional four-chamber cross section 94 in the adjusted volume data 96.
  • the cross section having the maximum cardiac chamber area searched in this way is specified as the four-chamber cross section.
  • the apex direction of the four-chamber cross-sectional image included in the four-chamber cross section specified in this way indicates the apex direction of the three-dimensional heart image in the adjusted volume data 96.
  • the adjustment unit 62 and the representative cross-section detection unit 66 constitute a representative cross-section specifying unit or a first direction specifying unit.
  • each rotation process by the representative cross-section detection unit 66 is also executed using an expression including a quaternion, and the representative cross-section detection unit 66 holds each parameter related to each rotation process in the storage unit 22. Specifically, a unit vector ( ⁇ , ⁇ , ⁇ ) representing each rotation axis and ⁇ representing each rotation angle are held.
  • the feature point / size detection unit 68 performs image processing on the four-chamber cross section detected by the representative cross-section detection unit 66 to detect a plurality of feature points in the four-chamber cross-sectional image included in the four-chamber cross section.
  • FIG. 11 shows feature points detected in the four-chamber cross-sectional image 104 a included in the four-chamber cross-section 104.
  • FIG. 11 shows the coordinate axes of the rotating real coordinate system in which the four-chamber cross section is the rxry plane and the direction orthogonal to the rxry plane is the rz axis.
  • seven feature points are detected in the four-chamber cross-sectional image 104a. Specifically, as shown in FIG. 11, a total of seven feature points A to G including the upper and lower ends, the left and right ends, and the three feature points indicating the centers as reference points are detected.
  • Feature point A indicates the upper end of the four-chamber cross-sectional image 104a.
  • an approximate curve that passes through a plurality of points (represented by x marks in FIG. 12A) detected as a result of the edge search in the vicinity of the upper end of the four-chamber cross-sectional image 104a is calculated.
  • the vertex is identified as the feature point A.
  • the feature point B indicates the lower end of the four-chamber cross-sectional image 104a and is identified by the same method as the feature point A.
  • Feature point C indicates the center of the four-chamber cross-sectional image 104a.
  • the feature point C is defined as a midpoint between the feature point D and the feature point E.
  • the feature point D indicates one of the left and right ventricular end portions on the septal side and the valve side.
  • the right edge of the septum is searched from the upper end to the lower end of the four-chamber cross-sectional image 104a, and when the inflection point is detected, the inflection point is specified as the feature point D. Is done.
  • the inflection point can be detected as a point where the amount of change in the ry coordinate between the edge point detected immediately before and the edge point detected this time is 0 or negative.
  • the feature point E indicates the other septum side and valve end of the left or right ventricle.
  • the left edge of the septum is searched from the upper end to the lower end of the four-chamber cross-sectional image 104a, and when the inflection point is detected, the inflection point is specified as the feature point E.
  • Feature point F indicates the left end of the four-chamber cross-sectional image 104a.
  • the edge search is performed along the left line from the upper end to the lower end of the four-chamber cross-sectional image 104a, and when the inflection point is detected, the inflection point becomes the feature point F.
  • the feature point G indicates the right end of the four-chamber cross-sectional image 104a.
  • the edge search is performed along the right line from the upper end to the lower end of the four-chamber cross-sectional image 104a, and when the inflection point is detected, the inflection point is specified as the feature point G.
  • the feature point / size detection unit 68 performs processing for detecting the size of the heart stereoscopic image in the adjusted volume data 96. Specifically, the feature point / size detection unit 68 performs a process of detecting a rectangular parallelepiped-shaped region (hereinafter referred to as “heart solid region”) circumscribing the heart stereoscopic image in the adjusted volume data 96.
  • heart solid region a rectangular parallelepiped-shaped region circumscribing the heart stereoscopic image in the adjusted volume data 96.
  • the feature point / size detection unit 68 specifies the rx coordinates of the left and right ends of the four-chamber cross-sectional image 104a in the four-chamber cross-section 104 as shown in FIG. As described above, the left and right ends of the four-chamber cross-sectional image 104 a are detected by the feature point / size detection unit 68. Specifically, the rx coordinate of the feature point F is the rx coordinate (min_rx) at the left end of the four-chamber cross-sectional image 104a, and the rx coordinate of the feature point G is the rx coordinate (max_rx) at the right end of the four-chamber cross-sectional image 104a.
  • the feature point / size detection unit 68 specifies the ry coordinates of the upper and lower ends of the four-chamber cross-sectional image 104a in the four-chamber cross-section 104. As described above, the upper and lower ends of the four-chamber cross-sectional image 104a are also detected by the feature point / size detection unit 68. Specifically, the ry coordinate of the feature point A is the rx coordinate (min_ry) of the upper end of the four-chamber cross-sectional image 104a, and the ry coordinate of the feature point B is the ry coordinate (max_ry) of the lower end of the four-chamber cross-sectional image 104a.
  • the feature point / size detection unit 68 performs processing for detecting both ends of the heart stereoscopic image in the rz-axis direction.
  • FIG. 14 shows how the processing is performed.
  • the feature point / size detection unit 68 translates the processing surface parallel to and the same size as the heart region surface 106 specified in the four-chamber cross section 104 in the negative direction of the rz axis, and the luminance on the processing surface. The number of pixels with the value “1” is monitored. Then, the point of the luminance value “1” on the processing surface 106 a immediately before the number of pixels of the luminance value “1” is 0, that is, the processing surface becomes a black image, is specified as the feature point H.
  • the center of gravity of the plurality of points is obtained and set as the feature point H.
  • the rz coordinate of the feature point H (that is, the processing surface 106a) is specified as min_rz that is the end of the heart solid region in the negative direction of the rz axis.
  • the number of pixels with the luminance value “1” on the processing surface is monitored while the processing surface parallel to the heart region surface 106 and having the same size is translated in the positive direction of the rz axis.
  • the point of the luminance value “1” on the processing surface 106b immediately before the number becomes 0 is specified as the feature point I.
  • the processing in the case where there are a plurality of points having the luminance value “1” on the processing surface 106 b is the same as the method for specifying the feature point H.
  • the rz coordinate of the feature point I is specified as max_rz which is the end of the heart solid region in the positive direction of the rz axis.
  • max_rz is the end of the heart solid region in the positive direction of the rz axis.
  • the one-side partial heart stereoscopic image on one side in the rz-axis direction and the other-side partial heart stereoscopic image on the other side in the rz-axis direction The shapes are different from each other. From this, by comparing the one-side partial heart stereoscopic image and the other-side partial heart stereoscopic image, the orientation of the cardiac stereoscopic image in the up-down direction as the second direction can be specified.
  • the vertical direction means a vertical direction when the fetal heart is viewed from the front (see FIG. 4), and a direction orthogonal to the horizontal direction. In FIG.
  • the vertical direction is indicated by the rz-axis direction.
  • the section length from one end of the three-dimensional heart region to the heart region surface 106 (four-chamber cross section) (that is, the length along the rz axis from min_rz to the rz coordinate of the heart region surface 106))
  • the vertical direction of the three-dimensional heart image is specified. can do.
  • the longer section length is the head side
  • the shorter section length is the stomach side.
  • the feature point / size detection unit 68 also functions as a second direction specifying unit.
  • the three-dimensional heart region 108 is specified in the adjusted volume data 96 as shown in FIG.
  • the heart solid region 108 is a region where rx coordinates are min_rx to max_rx, ry coordinates are min_ry to max_ry, and rz coordinates are min_rz to max_rz.
  • six feature points (feature points A, B, F, G, H, and I) among the nine feature points (feature points A to I) identified in the heart stereoscopic image. Based on this, the three-dimensional heart region 108 is specified.
  • the feature point / size detection unit 68 stores each value of min_rx, max_rx, min_ry, max_ry, min_rz, and max_rz in the storage unit 22 and holds them. Further, among the identified feature points, at least the coordinates of the feature points A, B, and C in the rotating coordinate system are held in the storage unit 22.
  • the coordinates of the feature point A are (ax, ay, az)
  • the coordinates of the feature point B are (bx, by, bz)
  • the coordinates of the feature point C are (cx, cy, cz).
  • the normalized coordinate setting unit 70 sets a normalized coordinate system in the heart solid region 108 specified by the feature point / size detection unit 68. Specifically, a process of associating the coordinates of the rotating real coordinate system with the coordinates of the normalized coordinate system in the heart solid region 108 is performed.
  • FIG. 16 shows a three-dimensional heart region 110 converted to normalized coordinates.
  • the normalized coordinate system has a feature point C (the center point of the four-chamber cross-sectional image) in the rotating real coordinate system as the origin. That is, the coordinates (cx, cy, cz) in the rotating real coordinate system correspond to the coordinates (0, 0, 0) in the normalized coordinate system.
  • the coordinates (min_rx, min_ry, min_rz) in the rotating real coordinate system correspond to ( ⁇ 1, ⁇ 1, ⁇ 1) in the normalized coordinate system
  • the coordinates (max_rx, max_ry, max_rz) in the rotating real coordinate system are normal. This corresponds to (1, 1, 1) in the generalized coordinate system. That is, both ends of each axis of the heart solid region 108 in the rotating real coordinate system correspond to ⁇ 1 and 1 of each axis in the normalized coordinate system.
  • FIG. 17A shows the position of the origin (feature point C) on the nxnz plane.
  • FIG. 17B shows the position of the origin (feature point C) on the nynz plane.
  • the normalized coordinate system has multiple scales. Specifically, each of the nx axis direction, the ny axis direction, and the nz axis direction has different scales on both sides of the origin. Although details will be described later, since the normalized coordinate system has a plurality of scales, it is possible to specify the actual data observation cross section after successfully absorbing the individual differences of the fetal heart.
  • the conversion function generation unit 72 as the correspondence generation unit is defined by a real coordinate system (see FIGS. 3 and 6) defined by the x-axis, y-axis, and z-axis, and the nx-axis, ny-axis, and nz-axis.
  • a conversion function is generated as a correspondence relationship with the normalized coordinate system (see FIG. 16).
  • the conversion function generation unit 72 includes a first conversion function that is a conversion function between a normalized coordinate system and a rotating real coordinate system (see FIG. 15 and the like), and a rotating real coordinate system and a real coordinate system.
  • a second conversion function that is a conversion function between and is generated.
  • the first conversion function is to convert coordinates in the normalized coordinate system into coordinates in the rotating real coordinate system
  • the second conversion function is to convert coordinates in the rotating real coordinate system into coordinates in the real coordinate system. is there.
  • the first conversion function is generated based on a correspondence relationship between the coordinates of the feature point in the rotating real coordinate system and the coordinates of the feature point in the normalized coordinate system.
  • the conversion formulas for converting the coordinates of the normalized coordinate system into the actual rotation coordinate system are different in each region.
  • the eight conversion expressions corresponding to the eight regions are collectively referred to as a first conversion function.
  • each conversion formula regarding Xr, Yr, and Zr will be described taking the region R1 as an example.
  • a conversion formula from the nx coordinate to the rx coordinate will be described.
  • the rx coordinate cx of the feature point C in the rotated actual coordinate system corresponds to the origin (0) of the nx coordinate in the normalized coordinate system
  • the rx coordinate max_rx in the rotated actual coordinate system is the nx coordinate in the normalized coordinate system.
  • the difference between max_rx and cx is calculated, and the difference is multiplied by the nx coordinate Xn of the normalized coordinate system.
  • the basic value of Xr is calculated by adding cx, which is the rx coordinate of the feature point C, to the value (second term on the right side).
  • a correction term (third term on the right side) that takes into account the gap or distortion of the septum is further added to the basic value calculated as described above.
  • the septal shift or distortion is a shift or distortion with respect to the template data 64. This is caused by a positional shift of each part of the fetal heart such as the left ventricle, the left atrium, the right ventricle, and the right atrium, a size balance shift, and the like.
  • the septal line may not be parallel to the ry axis of the rotating real coordinate system, that is, may be displaced from the slit 64d of the template data 64 due to individual differences.
  • the line connecting the feature points A, C, and B specified in the four-chamber cross-sectional image (see FIG. 15 and the like) in the rotating real coordinate system is not parallel to the ry axis, or the feature points A, C and B may not be on a straight line.
  • the Xr coordinate is corrected based on the amount of deviation in the rx-axis direction between the feature point C and the feature point B in the actual rotation coordinate system.
  • FIG. 19 shows a diagram for explaining the correction term.
  • the conversion formula from the ny coordinate to the ry coordinate and the conversion formula from the nz coordinate to the rz coordinate have the same concept as that except for the correction term in the conversion formula from the nx coordinate to the rx coordinate. Is omitted. Further, the conversion formulas for the coordinates of the other regions (R2 to R8) can be described in the same manner as the conversion formulas for the region R1 described above, and thus the description thereof is omitted here.
  • the correction term in the conversion formula from the nx coordinate to the rx coordinate in the regions R5 to R8 indicates correction of the Xr coordinate based on the inclination with respect to the ry axis of the straight line connecting the feature point A and the feature point C in the rotating real coordinate system. It is.
  • Each conversion formula corresponding to each area described above may be stored in the storage unit 22 in advance.
  • the conversion function generation unit 72 fits each value of min_rx, max_rx, min_ry, max_ry, min_rz, max_rz, ax, bx, cx, cy, and cz detected by the feature point / size detection unit 68 to the conversion equation. Thus, the first conversion function is generated.
  • min_rx is determined by the feature point F
  • max_rx is determined by the feature point G
  • min_ry and ax are determined by the feature point A
  • max_ry and bx are determined by the feature point B
  • min_rz is determined by the feature point H
  • cx, cy, and cz are defined by a feature point C.
  • the normalized observation section defined in the normalized coordinate system is the actual data rotation observation section (specifically, the actual data) in the rotation actual coordinate system.
  • Three rotation real coordinates indicating the rotation observation section are calculated.
  • the first conversion function is generated based on a plurality of feature points specified in the heart image of the fetus to be observed or diagnosed. That is, the first conversion function varies depending on the observation or diagnosis target.
  • each observation cross section is uniquely specified.
  • each observation section can be uniquely specified in the normalized coordinate system, but the diagnosis target is calculated by the first conversion function calculated for each observation or diagnosis target. The individual differences are absorbed, and the real rotation data observation section can be specified in the real rotation coordinate system.
  • the normalized coordinate system has a plurality of scales.
  • different scales are provided in the normalization axis directions with respect to the center of the four-chamber cross section.
  • conversion considering the balance of each part to be diagnosed is performed. That is, according to the present embodiment, a suitable rotation actual data observation cross section in which not only the individual difference in the outer shape of the diagnosis target but also the individual difference in the shape of each part included therein is absorbed is specified.
  • a correction term is added in consideration of a positional shift of each part to be diagnosed or a shape distortion. In the above-described example, a correction term is added in consideration of septal deviation or distortion. Therefore, according to the first transformation function, individual differences such as a positional shift of each part to be diagnosed or a size balance shift are eliminated, and a suitable rotation actual data observation section is specified.
  • the second transformation function is a function that realizes the three-dimensional affine transformation in which the matching process (rotation process, enlargement / reduction process, and parallel movement process) described in FIG. 9 and the rotation process described in FIG. 10 are performed in the reverse direction. is there. That is, the second conversion function includes a conversion formula indicating a rotation process in which the rotation process for the matching process and the representative cross-section search is performed in the reverse direction, a conversion formula for performing the enlargement / reduction process in the matching process in the reverse direction, and the matching process. It is comprised by the conversion type
  • the real rotation coordinate system is converted to the real coordinate system, that is, the real rotation data observation cross section (more specifically, the three real rotation coordinates indicating the real rotation data observation cross section) is the real data observation cross section (more specifically, the real data 3 real coordinates indicating the observation section).
  • the rotation process is a process of rotating the same rotation axis by the same angle in the opposite direction on the same rotation axis.
  • the rotation process in the matching process is represented by two quaternions Q and R.
  • the representative cross section detecting unit 66 holds the parameters ⁇ , ⁇ , ⁇ , and ⁇ in the quaternions Q and R for each rotation (three types of rotations in the above description) in the storage unit 22. Therefore, the conversion function generation unit 72 generates each conversion expression indicating the reverse rotation of each rotation process using each parameter.
  • the parameters ⁇ , ⁇ , and ⁇ of the quaternions Q and R described above are maintained as they are (that is, each rotation axis is the same as the representative section search process), and ⁇ is set to ⁇ ( That is, each quaternion Q ′ and R ′ is generated (indicating rotation in the opposite direction to the representative cross-section search process).
  • the second conversion function includes the quaternions Q ′ and R ′.
  • the conversion equation indicating the rotation processing of the second conversion function includes a conversion equation for rotating the same rotation axis in the opposite direction by the same angle as the rotation processing in the matching processing described in FIG.
  • the conversion function generating unit 72 maintains the parameters ⁇ , ⁇ , and ⁇ of the quaternions Q and R held by the adjusting unit 62 in the storage unit 22 during the matching process as they are (that is, rotation).
  • the axes are the same as in the matching process), and quaternions Q ′ and R ′ are generated with ⁇ being ⁇ (that is, indicating rotation in the opposite direction to the matching process).
  • the second conversion function further includes the quaternions Q ′ and R ′.
  • the conversion expression indicating the enlargement / reduction process in the second conversion function is a conversion expression indicating a process for returning the enlargement / reduction process in the matching process, and this is held in the storage unit 22 by the adjustment unit 62. It is determined based on the enlargement / reduction ratio in the matching process.
  • the conversion formula indicating the translation process in the second conversion function is a conversion formula indicating a process for returning the translation process in the matching process, and this is a matching process held in the storage unit 22 by the adjustment unit 62. Is determined on the basis of a vector indicating the parallel movement at.
  • the second conversion function is generated as described above. Similar to the first conversion function, the second conversion function also differs depending on the observation or diagnosis target.
  • the coordinates of the real coordinate system corresponding to each coordinate in the normalized coordinate system can be calculated. That is, the normalized coordinate system is associated with the real coordinate system.
  • the cross-section specifying unit 74 serving as the cross-section specifying means performs an actual observation in the real coordinate system from the normalized observation cross-section defined in the normalized coordinate system stored in the cross-section table 76. Identify the data observation cross section.
  • the cross section table 76 defines one or more normalized observation cross sections corresponding to one or a plurality of observation cross sections. In the present embodiment, as described above, each normalized observation cross section is defined by three coordinates.
  • the three blood vessel cross section is a cross section obtained by translating the four-chamber cross section specified as the representative cross section, but the normalized observation cross section may not be a cross section parallel to the four-chamber cross section.
  • FIG. 20 shows a state in which the normalized observation section is converted to the actual data observation section.
  • the cross section specifying unit 74 uses the first and second conversion functions generated by the conversion function generation unit 72 to select the normalization.
  • the first transformation function converts the three coordinates to coordinates (rx1, rx2, rx3), (rx1, rx2) in the rotating real coordinate system. , Rx3) and (rx1, rx2, rx3).
  • the three blood vessel cross section 112 as the rotation real data whose direction and size are specified is specified.
  • the three-vessel section 114 as the actual data observation section in the real coordinate system is specified. .
  • the cross-section position correcting unit 78 corrects the position of the actual data observation cross-section specified by the cross-section specifying unit 74 based on a user instruction.
  • the operation unit (Not shown) can be used to instruct correction of the position of the actual data observation section.
  • the cross-section position correction unit 78 corrects the position of the actual data observation cross-section.
  • the tomographic image forming unit 80 as an image forming unit is specified by the cross-section specifying unit 74 or corrected by the cross-sectional position correcting unit 78 in each of a plurality of volume data 40 (see FIG. 3) stored in the data memory 26.
  • a tomographic image is formed in the actual data observation section.
  • a plurality of tomographic images of the three blood vessel cross sections in each time phase are formed.
  • the plurality of tomographic images generated in this way are processed by the image composition unit 32 and displayed on the display unit 34.
  • FIG. 21 shows a first display example of a tomographic image of an actual data observation cross section.
  • the tomographic image 120 of the identified actual data observation cross section (four-chamber cross section in FIG. 21) is enlarged and displayed. Since the actual data observation section is specified in each of the plurality of volume data 40 arranged in the time direction, a moving image can be displayed as the tomographic image 120 by continuously switching the tomographic image corresponding to each volume data 40. .
  • a label 120a indicating each part of the heart for example, left ventricle, left atrium, right ventricle, right atrium
  • the display process of the label 120a will be described later.
  • a guide image 122 indicating the position of the observation cross section is displayed together with the tomographic image 120.
  • a three-dimensional model of the heart prepared in advance and a cross-sectional index 122a indicating the position of the actual data observation cross-section with respect to the heart are shown.
  • the guide image 122 may be displayed based on a normalized coordinate system. For example, the position and orientation of the cross-sectional index 122a relative to the three-dimensional model of the heart may be determined based on the selected normalized observation cross section.
  • the user can preferably grasp which cross section the displayed tomographic image 120 corresponds to.
  • the guide image 122 includes a direction indicator 122b indicating the rotation direction of the tomographic image 120.
  • the cross-section index 122a is shown as a rectangular surface, and the direction index 122b is attached to one corner of the surface.
  • a direction indicator 120b is also attached to one corner of the rectangular frame of the tomographic image 120.
  • the direction indicators 120b and 122b correspond to each other, and the user can grasp the rotation direction of the tomographic image 120 by checking the direction indicators 120b and 122b.
  • the positions to which the direction indicators 120b and 122b are attached may be determined according to the rotation angle in the second conversion function.
  • FIG. 22 shows a second display example of the tomographic image of the actual data observation cross section.
  • a plurality of actual data observation sections are specified in each volume data 40, and the tomographic image groups 124 corresponding to the specified plurality of actual data observation sections are displayed in parallel.
  • the guide image 126 is also displayed in the second display example.
  • the guide image 126 shows a three-dimensional model of the heart and a plurality of cross-sectional indices 126a indicating the positions of a plurality of actual data observation cross sections. Note that correspondence between a plurality of tomographic images and a plurality of cross-sectional indices 126a may be shown.
  • the color of the frame of each tomographic image may correspond to the color of the cross-sectional index 126a.
  • a tomographic image group 128 corresponding to a plurality of observation cross sections (parallel multi-sections) parallel to the four-chamber cross section as a representative cross section may be displayed.
  • the guide image 130 is also displayed in the parallel multi-section display, and a plurality of cross-sectional indices 130a indicating the positions of the four-chamber cross section and a plurality of observation cross sections parallel thereto are displayed.
  • a tomographic image group 132 corresponding to a four-chamber cross section as a representative cross section and two observation cross sections (orthogonal cross sections) orthogonal thereto may be displayed.
  • the guide image 134 is also shown in the orthogonal cross-section display, and a plurality of cross-sectional indices 134a indicating the positions of the four-chamber cross section and two observation cross sections orthogonal to the four-chamber cross section are displayed.
  • each label space region 140 is a three-dimensional region and corresponds to each part of the fetal heart.
  • the label space region 140a corresponds to the left ventricle
  • the label space region 140b corresponds to the right ventricle
  • the label space region 140c corresponds to the left atrium
  • the label space Region 140d corresponds to the right atrium.
  • the position of the label space region 140 corresponding to each part can be defined in the normalized coordinate system.
  • the label space area 140 may have a predetermined shape. However, as described later, the label space area 140 corresponds to a heart stereoscopic image (see FIG. 16) converted into a normalized coordinate system (that is, for each subject). The shape may be adjusted accordingly.
  • Each label space area 140 has label information indicating each part of the corresponding heart.
  • the label space region 140a corresponding to the left ventricle includes “LV” character data indicating the left ventricle as label information
  • the label space region 140b corresponding to the right ventricle includes the character “RV” indicating the right ventricle. Data is included as label information.
  • a normalized observation section 142 is defined in the three-dimensional heart region 110 of the normalized coordinate system as shown in FIG.
  • a label plane area 144 that is an area intersecting with the label space area 140 is generated on the normalized observation cross section 142.
  • the label plane area 144a corresponding to the label space area 140a on the normalized observation cross section 142
  • a label plane area 144b corresponding to the label space area 140b is generated.
  • the label processing unit 82 centroid of the label plane area 144 in the normalized coordinate system.
  • the coordinates 146 are calculated.
  • a known image processing technique can be used. In the example shown in FIG. 26, the barycentric coordinates 146a of the label plane area 144a and the barycentric coordinates 146b of the label plane area 144b are calculated.
  • the label processing unit 82 uses the first conversion function and the second conversion function to convert the barycentric coordinates 146 in the normalized coordinate system into the barycentric coordinates in the real coordinate system. Convert to Then, the image compositing unit 32 uses a position based on the converted barycentric coordinates of the real coordinate system in a tomographic image corresponding to the real data observation cross section (the barycentric coordinates of the real coordinate system are located on the real data observation cross section) Display the label information.
  • FIG. 27A shows a tomographic image 148 displayed on the display unit 34.
  • the label information 152a is displayed around the barycentric coordinate 150a in the real coordinate system corresponding to the barycentric coordinate 146a (see FIG. 26) in the normalized coordinate system.
  • the barycentric coordinates 150a are indicated by black dots, but the barycentric coordinates 150a may not be displayed.
  • the letters “LV” indicating the left ventricle are displayed as the label information 152a.
  • the label information 152b is displayed around the barycentric coordinate 150b in the real coordinate system corresponding to the barycentric coordinate 146b in the normalized coordinate system.
  • the characters “RV” indicating the right ventricle are displayed as the label information 152b.
  • FIG. 27B shows another display example of the label information 152.
  • the label information 152 may be displayed in the outer region of the tomographic image 148 as shown in FIG. 27B. Thereby, it is possible to display the label information while suppressing a decrease in the visibility of the tomographic image.
  • the leader line is drawn from the barycentric coordinates 150, and the label information 152 corresponding to the tip of the leader line is displayed. Also good.
  • the label processing unit 82 adjusts the shape of the label space region 140 by a three-dimensional region growing process based on a heart stereoscopic image in a normalized coordinate system.
  • FIG. 28 shows the state of the three-dimensional region growing process. In FIG. 28, one cross section in the heart stereo image included in the heart stereo region 110 is shown.
  • the three-dimensional region growing process is a process for expanding or reducing each label space region 140 so as to be adapted to each part of the heart stereoscopic image.
  • the label space region 140a corresponding to the left ventricle is expanded so as to fit the left ventricle region of the cardiac stereoscopic image, and the adjusted label space region 160a is formed.
  • the three-dimensional region growing process will be described with reference to FIG. 29, taking the label space region 140a corresponding to the left ventricle as an example.
  • “1” is set as a data value in each voxel constituting the label space area 140a.
  • the label processing unit 82 calculates the product of the data value of each voxel constituting the label space region 140a and the luminance value of the inverted binarized heart stereoscopic image at the coordinates corresponding to each voxel. Then, the voxel whose calculation result is “0” is excluded from the label space area 140a.
  • the luminance of the heart chamber is “1” and the luminance values of the other positions are “0”.
  • a label space region 162a is generated in which a portion outside the (left ventricle) is excluded (see the left diagram in FIG. 29).
  • the label processing unit 82 calculates the product of the voxel adjacent to the label space region 162a and the luminance value of the inverted binarized heart stereoscopic image at the coordinates corresponding to the voxel. If the calculation result is “1”, the adjacent voxel is added to the label space area 162a. When the calculation result is “0”, the voxel is not added to the label space area 162a. By repeating this process until the shape of the label space region 162a does not change, an adjusted label space region 160a suitable for the heart chamber (left ventricle) is formed. It should be noted that in the three-dimensional heart region, a region (processing boundary) that can be taken by the left ventricle is determined in advance, and the expansion processing may be performed within the processing boundary.
  • the processing of the valve part becomes a problem.
  • the valve portion since the valve portion may not be closed in the three-dimensional heart image, the label space region 160 corresponding to a certain portion is adjacent via the valve portion by the three-dimensional region growing process. It may expand to other parts.
  • the adjusted label space region 160a corresponding to the left ventricle may expand to the left atrial region.
  • the label processing unit 82 generates a boundary surface of the three-dimensional region glowing process at the valve portion of the heart stereoscopic image with the annulus portion (the base portion of the valve) as a reference.
  • FIG. 30 shows the state of the boundary surface generation process in the valve portion.
  • the label processing unit 82 detects a feature point 170 indicating the annulus.
  • the feature point 170 may be detected, for example, by a technique similar to the detection process of the feature points D to G shown in FIG. 11 on the four-chamber cross section of the heart stereoscopic image.
  • feature points 170a and 170b indicating the two annulus portions of the mitral valve are detected (see the upper left diagram in FIG. 30).
  • the label processing unit 82 When the two feature points 170a and 170b are detected, the label processing unit 82 generates a straight line 172 that connects the two feature points (see the central diagram in the upper part of FIG. 30).
  • the label processing unit 82 performs an edge search process in the direction orthogonal to the straight line 172 on both sides of the straight line 172 (see the upper right diagram in FIG. 30).
  • the edge search process a plurality of high-luminance pixels 174 corresponding to valves are detected on one side of the straight line 172 (see the left diagram in the lower part of FIG. 30).
  • the label processing unit 82 generates an approximate curve (secondary curve) 176 based on the plurality of high-luminance pixels 174 (see the lower center diagram in FIG. 30).
  • the label processing unit 82 rotates the generated approximate curve 176 around a rotation axis that passes through the midpoint of the straight line 172 and is orthogonal to the straight line 172 (see the lower right diagram in FIG. 30).
  • a boundary surface is formed as a processing boundary of the three-dimensional region growing process between the left ventricle and the left atrium.
  • the real coordinate system of the volume data and the heart of a predetermined size and orientation First and second conversion functions are generated that indicate a correspondence relationship with a normalized coordinate system in which a stereoscopic image is defined. Thereby, the first and second conversion relations are generated for each fetal heart, that is, for each target tissue. And based on the 1st and 2nd conversion function, the real data observation cross section in a real coordinate system is specified from the normalization observation cross section previously defined in the normalization coordinate system. Through the above processing, the actual data observation cross section can be identified more preferably when the individual difference of the fetal heart is absorbed.
  • the prescribed orientation (posture) of the fetal heart image in the volume data it is possible to specify the prescribed orientation (posture) of the fetal heart image in the volume data.
  • the left-right direction (apical portion side) and the up-down direction (head side, stomach side) of the fetal heart are specified. Therefore, for example, when a three-dimensional heart image included in the volume data is displayed in a three-dimensional manner, a three-dimensional heart image can be displayed.
  • a cardiac tomographic image oriented in a predetermined direction can be displayed. As a result, the user can more easily observe or diagnose the fetal heart image using the volume data.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

Avec une unité de réglage (62), une unité de détection de section transversale représentative (66), et une unité de détection de taille/point caractéristique (68), relativement à des données de volume (40) qui comprennent une image tridimensionnelle d'un cœur fœtal, les données de volume (40) sont tournées de sorte que l'image tridimensionnelle du cœur fœtal soit dans une orientation stipulée. Une pluralité de points caractéristiques est détectée dans l'image tridimensionnelle du cœur fœtal qui a été placée dans l'orientation stipulée. Sur la base des coordonnées de la pluralité de points caractéristiques dans un système de coordonnées réel (après rotation), une unité de définition de coordonnées normalisées (70) définit un système de coordonnées normalisées. Une unité de génération de fonction de conversion (72) génère une correspondance entre le système de coordonnées réel et le système de coordonnées normalisées. Sur la base de la correspondance, une unité d'identification de section transversale (74) identifie une section transversale d'observation de données réelles dans le système de coordonnées réel à partir d'une section transversale d'observation normalisée qui a été définie dans le système de coordonnées normalisées.
PCT/JP2017/037548 2016-10-26 2017-10-17 Dispositif et programme de traitement d'images ultrasonores WO2018079344A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016209919A JP2018068494A (ja) 2016-10-26 2016-10-26 超音波画像処理装置及びプログラム
JP2016-209919 2016-10-26

Publications (1)

Publication Number Publication Date
WO2018079344A1 true WO2018079344A1 (fr) 2018-05-03

Family

ID=62023495

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/037548 WO2018079344A1 (fr) 2016-10-26 2017-10-17 Dispositif et programme de traitement d'images ultrasonores

Country Status (2)

Country Link
JP (1) JP2018068494A (fr)
WO (1) WO2018079344A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110613480A (zh) * 2019-01-14 2019-12-27 广州爱孕记信息科技有限公司 基于深度学习的胎儿超声动态影像检测方法及系统
CN112367923A (zh) * 2018-07-13 2021-02-12 古野电气株式会社 超声波拍摄装置、超声波拍摄系统、超声波拍摄方法、以及超声波拍摄程序

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009072593A (ja) * 2007-09-18 2009-04-09 Siemens Medical Solutions Usa Inc ３次元心臓エコーグラフデータからの平面の自動検出方法
JP2011125708A (ja) * 2009-12-15 2011-06-30 Medison Co Ltd ３次元超音波映像から２次元スライス映像を選択する超音波システムおよび方法
JP2012217791A (ja) * 2011-04-14 2012-11-12 Hitachi Aloka Medical Ltd 超音波診断装置
JP5479138B2 (ja) * 2010-02-09 2014-04-23 富士フイルム株式会社 医用画像表示装置、医用画像表示方法、及びそのプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009072593A (ja) * 2007-09-18 2009-04-09 Siemens Medical Solutions Usa Inc ３次元心臓エコーグラフデータからの平面の自動検出方法
JP2011125708A (ja) * 2009-12-15 2011-06-30 Medison Co Ltd ３次元超音波映像から２次元スライス映像を選択する超音波システムおよび方法
JP5479138B2 (ja) * 2010-02-09 2014-04-23 富士フイルム株式会社 医用画像表示装置、医用画像表示方法、及びそのプログラム
JP2012217791A (ja) * 2011-04-14 2012-11-12 Hitachi Aloka Medical Ltd 超音波診断装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112367923A (zh) * 2018-07-13 2021-02-12 古野电气株式会社 超声波拍摄装置、超声波拍摄系统、超声波拍摄方法、以及超声波拍摄程序
US11948324B2 (en) 2018-07-13 2024-04-02 Furuno Electric Company Limited Ultrasound imaging device, ultrasound imaging system, ultrasound imaging method, and ultrasound imaging program
CN110613480A (zh) * 2019-01-14 2019-12-27 广州爱孕记信息科技有限公司 基于深度学习的胎儿超声动态影像检测方法及系统

Also Published As

Publication number Publication date
JP2018068494A (ja) 2018-05-10

Similar Documents

Publication Publication Date Title
JP6745861B2 (ja) リアルタイム超音波イメージングのトリプレーン画像の自動セグメント化
JP5138369B2 (ja) 超音波診断装置及びその画像処理方法
JP6160487B2 (ja) 超音波診断装置およびその制御方法
JP6574532B2 (ja) 超音波胎児撮像に対する３ｄ画像合成
JP3872424B2 (ja) 超音波診断装置
JP6640922B2 (ja) 超音波診断装置及び画像処理装置
JP5462598B2 (ja) 超音波診断システム
BR112015011288B1 (pt) Sistema de diagnóstico por ultrassom para imagear múltiplos planos de um coração fetal; método para imagear por ultrassom uma pluralidade de diferentes planos de imagens selecionados de uma anatomia alvo, em tempo real; e método para imagear por ultrassom uma pluralidade de diferentes planos de imagens selecionados de um coração fetal, em tempo real
US20070249935A1 (en) System and method for automatically obtaining ultrasound image planes based on patient specific information
JP2007296335A (ja) 超音波システムに表示させた関連情報を特定するためのユーザインタフェース及び方法
US20180092628A1 (en) Ultrasonic diagnostic apparatus
JP7375140B2 (ja) 超音波診断装置、医用画像診断装置、医用画像処理装置及び医用画像処理プログラム
JP2010227568A (ja) 機能超音波画像化システムおよび方法
JP2018068495A (ja) 超音波画像処理装置及びプログラム
WO2018205274A1 (fr) Dispositif ultrasonore et procédé et système de transformation de l'affichage d'une image ultrasonore tridimensionnelle correspondante
JP4870449B2 (ja) 超音波診断装置及び超音波画像処理方法
JP4652780B2 (ja) 超音波診断装置
WO2018079344A1 (fr) Dispositif et programme de traitement d'images ultrasonores
JP2007117252A (ja) 超音波診断装置
JP4758578B2 (ja) 心臓壁運動評価装置
EP3409210B1 (fr) Appareil de diagnostic ultrasonique et procédé de fonctionnement associé
US9842427B2 (en) Methods and systems for visualization of flow jets
JP6251002B2 (ja) 画像処理装置及び画像処理方法、コンピュータプログラム
JP5182932B2 (ja) 超音波ボリュームデータ処理装置
US11883241B2 (en) Medical image diagnostic apparatus, ultrasonic diagnostic apparatus, medical imaging system, and imaging control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17866313

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17866313

Country of ref document: EP

Kind code of ref document: A1