JP2013123582A - Ultrasonic diagnostic apparatus and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an ultrasonic diagnostic apparatus and an image processing method to contribute to improvement in diagnostic capability of an ultrasonic image relatively difficult to grasp an internal structure.SOLUTION: The apparatus stores a plurality of biological structure volume data which show an anatomical structure corresponding to the same site as in a subject. A biological structure three-dimensional image 114 is composed by selecting one biological structure volume data among a plurality of these biological structure volume data. Moreover, ultrasonic images 111, 112, and 113 are created based on ultrasonic volume data obtained by imaging the subject. The biological structure three-dimensional image 114 and the ultrasonic images 111, 112, and 113 are displayed simultaneously.

Description

  The present invention relates to an ultrasonic diagnostic apparatus and an image display method, and more particularly to a display technique in an ultrasonic diagnostic apparatus.

  Ultrasound diagnostic equipment used in fetal diagnosis is not only based on conventional two-dimensional tomographic images, but also coordinate conversion of three-dimensional data obtained by scanning the probe in the short axis direction automatically or manually. After that, it is common to reconstruct ultrasound image data in the line-of-sight direction set for the two-dimensional projection plane and display it on the image display. A technique called real-time 3D or 4D, which is implemented in time and displays a moving 3D image, has become common and is prevalent in fetal morphology diagnosis.

  However, since the anatomical form of the fetus changes greatly on a weekly basis, doctors and examiners who perform fetal diagnosis need to have the anatomical information correctly associated with temporal changes. Learning takes a lot of time and experience.

  In addition, the diagnostic criteria on the ultrasound image require the diagnosis part to be correctly identified and diagnosed, but there are parts with similar structures. But it takes a lot of work.

  As described above, as an example of changing the display content according to the change in the number of gestational weeks of the fetus, for example, in Patent Document 1, a tertiary model that imitates the contour of a fetus that matches from the information on the number of gestational weeks used during diagnosis and measurement information. An ultrasonic diagnostic apparatus that recognizes the shape of an observed fetus by automatically selecting an original body mark and displaying it on a screen is disclosed.

JP 2010-187987 A

  However, in Patent Document 1, it is easy to grasp the outline of the fetus, but there is still a problem that it is difficult to grasp the internal structure.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an ultrasonic diagnostic apparatus and an image processing method that contribute to improving the diagnostic ability of an ultrasonic image in which it is relatively difficult to grasp the internal structure.

  In order to solve the above problems, an ultrasonic diagnostic apparatus according to the present invention radiates an ultrasonic wave to a subject and receives an ultrasonic wave reflected from the ultrasonic wave, and the reflected wave. An ultrasonic volume data generation unit that generates ultrasonic volume data of the subject using a reflection echo signal based thereon, and an anatomical structure corresponding to the same site as the imaging site of the subject imaged by the ultrasound A plurality of anatomical volume data storage units that store anatomical volume data, an ultrasonic image forming unit that forms an ultrasonic image based on the ultrasonic volume data, and a anatomical volume data storage unit A anatomical volume data selection unit for selecting one anatomical volume data among the plurality of anatomical volume data, and the selected anatomical volume data Based on Mudeta, characterized in that it comprises the anatomical image construction unit that constitute the anatomy images in a predetermined cross-section, and a display unit that displays the ultrasonic image and the anatomy image.

  The image display method according to the present invention includes a step of generating volume data of the subject obtained by imaging the subject with a medical image imaging device, and a subject image based on the ultrasonic volume data. One anatomical volume data among a plurality of anatomical structure volume data indicating an anatomical structure corresponding to the same part as the imaging part of the subject imaged by the ultrasound stored in advance A step of selecting, a step of constructing a anatomical image in a predetermined section based on the selected anatomical volume data, and a step of displaying the subject image and the anatomical image. And

  ADVANTAGE OF THE INVENTION According to this invention, the ultrasonic diagnostic apparatus and image processing method which contribute to improvement of the diagnostic capability of the ultrasonic image for which grasping | ascertainment of an internal structure is comparatively difficult by displaying a biological structure image can be provided.

1 is a block diagram showing a schematic configuration of an ultrasonic diagnostic apparatus according to the present embodiment Schematic diagram showing an example of an ultrasound image Schematic diagram showing an example of anatomical volume data of fetal brain Schematic diagram showing an example of anatomical volume data of fetal heart Schematic diagram showing an example of anatomical tomographic image Explanatory drawing explaining the concept of position adjustment processing The flowchart which shows the process sequence in 1st embodiment. Explanatory drawing showing an example of setting the first reference point Explanatory drawing showing a setting example of the second reference point Explanatory drawing showing an example of setting the third reference point Schematic diagram showing an example of a display screen according to the first embodiment The schematic diagram which shows the other example of the display screen which concerns on 1st embodiment. The schematic diagram which shows the other example of the display screen which concerns on 1st embodiment. The schematic diagram which shows the other example of the display screen which concerns on 1st embodiment. The flowchart which shows the process sequence which concerns on 2nd embodiment. Schematic diagram showing an example of the display screen of the second embodiment

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The same reference numerals are given to the procedures having the same functions and the same processing contents, and the description thereof will not be repeated.

  First, a schematic configuration of the ultrasonic diagnostic apparatus according to the present embodiment will be described based on FIG. FIG. 1 is a block diagram showing a schematic configuration of the ultrasonic diagnostic apparatus according to the present embodiment.

  An ultrasonic diagnostic apparatus 1 shown in FIG. 1 includes an ultrasonic probe (also referred to as an ultrasonic probe) 3 that radiates an ultrasonic wave from an ultrasonic radiation surface and receives a reflected wave reflected in a subject 2, and its And a main body 4 that is electrically connected to the ultrasonic probe 3 and implements the functions of the ultrasonic diagnostic apparatus 1 such as transmission / reception of ultrasonic waves and display of ultrasonic images.

  Inside the main body 4, a control unit 4 a that controls each component of the ultrasonic diagnostic apparatus 1, an operation unit 4 b that receives an operation by an operator, and an ultrasonic probe 3 are electrically connected, and an ultrasonic wave An ultrasonic transmission / reception unit 4c that outputs a transmission / reception instruction signal to the ultrasonic probe 3 and receives a reflected echo signal, and an ultrasonic volume data generation unit that generates ultrasonic volume data of the subject 2 based on the reflected echo signal 4d, an ultrasonic volume data storage unit 4e for storing the ultrasonic volume data, and a two-dimensional ultrasonic tomographic image or a three-dimensional ultrasonic three-dimensional image (ultrasonic tomographic image and supersonic image based on the ultrasonic volume data). An ultrasonic image constructing unit 4f constituting a three-dimensional acoustic image (hereinafter referred to as an "ultrasonic image") and an ultrasonic tomographic image or an ultrasonic three-dimensional image. Comprising a measuring unit 4g which measures the actual value of the site that was the measurement data storage unit 4h which stores measurement data obtained by the measurement section 4g, a display portion 4p for displaying an image.

  Furthermore, in the main body 4, subject information such as the subject's sex, age, and number of gestation weeks as a characteristic component of the present invention (particularly in this embodiment, the fetus is handled as the subject. The anatomical structure of the subject (especially fetus) whose fetal information acquisition unit 4i for acquiring fetal information) and the fetal information storage unit 4j for storing fetal information differ from each other in sex, gestational age, region, etc. A living body volume data storage unit 4k for storing a plurality of types of living body structure volume data, a living body volume data selection unit 41 for selecting a desired one of the plurality of living body volume data, and the selected living body Two-dimensional anatomical tomographic images or three-dimensional anatomical three-dimensional images based on the structure volume data (collectively anatomical tomographic images and anatomical three-dimensional images 4m), a positioning unit 4n for matching the viewpoint and display magnification of the ultrasound volume data with the viewpoint and display magnification of the biological volume data, and the periodic motion time phase of the subject Among these, a time phase designating unit 4o for designating a desired time phase is provided.

  The ultrasonic probe 3 is brought into contact with the subject 2, repeatedly transmits ultrasonic waves to the subject 2 at a predetermined time interval, and receives a reflected echo signal reflected in the subject 2. is there. The ultrasonic probe 3 can measure along two axes of θ and φ, for example, while switching the transmission / reception direction two-dimensionally simultaneously with the transmission / reception of ultrasonic waves. Here, θ represents a signal reception angle on the ZX plane when three axes of XYZ in the real space are defined, and φ represents a signal reception angle on the YZ plane. A plurality of transducers are arranged in a line inside the ultrasonic probe 3. Each vibrator may be configured in a rectangular shape or a fan shape, but the shape is not limited. The ultrasonic wave can be transmitted and received in three dimensions by mechanically swinging the vibrator in a direction orthogonal to the direction of arrangement of the plurality of vibrators. The ultrasonic probe 3 may be a probe in which a plurality of transducers are arranged two-dimensionally and ultrasonic transmission / reception can be controlled electronically.

  The control unit 4a controls each component of the ultrasound diagnostic apparatus 1, and is configured to include an arithmetic device such as a CPU or MPU, for example.

  The operation unit 4b performs various inputs to the control unit 4a and includes an input device such as a keyboard, a trackball, and a touch panel.

  The ultrasonic transmission / reception unit 4c generates a transmission pulse for driving the transducer of the ultrasonic probe 3 to generate an ultrasonic wave. The ultrasonic transmission / reception unit 4c has a function of setting a convergence point of ultrasonic waves to be transmitted to a certain depth. Further, the ultrasonic transmission / reception unit 4c receives the reflected echo signal received by the ultrasonic probe 3, performs phasing addition, and amplifies the signal with a predetermined gain to generate an RF signal, that is, a reception signal. Further, the phase of the received signal is controlled to generate RF signal frame data (corresponding to RAW data) in which an ultrasonic beam is formed at one or more convergence points.

  The ultrasonic volume data generation unit 4 d collects RF signal frame data generated at each position of the ultrasonic probe 3 and generates ultrasonic volume data of the subject 2. In the second embodiment, the volume data and the periodic motion data of the part that performs the periodic motion of the subject 2 are acquired at the same time, the RF signal frame data of a specific time phase is collected, and the ultrasonic wave in that time phase is collected. Generate volume data. Then, ultrasonic volume data composed of a collection of volume data of different time phases is generated.

  The ultrasonic volume data storage unit 4e stores the generated ultrasonic volume data data.

  The ultrasonic image constructing unit 4f reconstructs a two-dimensional ultrasonic tomographic image and an ultrasonic three-dimensional image in an arbitrary cross section based on the ultrasonic volume data. The ultrasonic image construction unit 4f inputs the ultrasonic volume data output from the ultrasonic volume data storage unit 4e based on the setting conditions in the control unit 4a, and performs gain correction, log compression, detection, contour enhancement, smoothing. Signal processing such as processing is performed. Further, the ultrasonic image constructing unit 4f performs rendering processing such as volume rendering, surface rendering, maximum value projection, and minimum value projection to construct an ultrasonic three-dimensional image.

  The measurement unit 4g measures an actual measurement value of a subject part imaged in an ultrasonic image. For example, the measurement unit 4g sets two points to be measured on the ultrasonic image and uses a scale or the like for measuring a distance between the two points. Composed.

  The measurement data storage unit 4h stores measurement data indicating measurement results obtained by the measurement unit 4g.

  The fetal information acquisition unit 4i acquires fetal information such as the fetal growth week, sex, and observation site from the operation unit 4b, an electronic medical chart system (not shown), and the like.

  The fetal information storage unit 4j stores the acquired fetal information data described above.

  The anatomical volume data storage section 4k stores a plurality of types of fetal anatomical volume data. The anatomical volume data here is volume data indicating the anatomy of the fetus in which average growth is seen, and if it is volume data indicating a growth model using a standard anatomical structure of the fetus, It doesn't matter what kind.

  The anatomical structure volume data is volume data indicating an anatomical structure corresponding to the same part as the imaging part of the subject imaged by ultrasound. For example, if the heart is imaged with ultrasound, the anatomical volume data storage unit 4k stores a plurality of anatomical volume data indicating anatomical structures corresponding to the heart.

  For example, the data type of the anatomical volume data may be volume data of a numerical model obtained by converting a standard anatomical structure configured based on anatomical knowledge into a scalar value, other medical imaging devices, For example, it may be three-dimensional volume data obtained by an MRI apparatus or an X-ray CT apparatus, or ultrasonic three-dimensional volume data. Moreover, you may use the volume data obtained by imaging the phantom manufactured based on anatomical knowledge with said medical imaging device. Alternatively, volume data indicating a standard anatomical structure may be generated by drawing with another image processing apparatus.

  The anatomical volume data and the anatomical structure image constructed based on the anatomical volume data are data and images with known positional relationships and shapes of the structures. Useful for diagnosis.

  The anatomical volume data selection unit 4l is the anatomical volume data most similar to fetal information stored in the fetal information storage unit 4j, for example, fetal information including at least one of gestation week, age, observation site, or sex. Alternatively, the time phase volume data designated by the time phase designation unit 4o described later is selected from the anatomy volume data storage unit 4k.

  The anatomical image forming unit 4m forms a anatomical tomographic image in a predetermined cross section based on the selected anatomical volume data. For example, a anatomical tomographic image having the same cross section as the ultrasound image is constructed. In addition, the anatomical structure image configuration unit 4m performs rendering processing such as volume rendering, surface rendering, maximum value projection, and minimum value projection to configure a anatomical structure three-dimensional image.

  The positioning unit 4n matches the viewpoints and display magnifications of the ultrasound volume data and the anatomy volume data, that is, matches the position, orientation, and size, and the processing content will be described later.

  The time phase designating unit 4o designates the time phase of the periodic movement when the observation site of the subject 2 performs the periodic movement. In the present embodiment, in particular, in a plurality of different time phases. Of the volume data, it functions as designating volume data of a desired time phase.

  The display unit 4p displays an ultrasonic image or a anatomy image, and is configured to include, for example, a CRT or a liquid crystal panel.

  Next, an ultrasonic tomographic image reconstructed by the ultrasonic image construction unit 4f will be described with reference to FIG. FIG. 2 is a schematic diagram illustrating an example of an ultrasonic image.

  The ultrasonic image configuration unit 4f has a function of simultaneously generating and displaying an ultrasonic tomographic image and a three-dimensional image in three cross sections orthogonal to each other based on the ultrasonic volume data. More specifically, for example, if the three axes are defined as the X axis, the Y axis, and the Z axis as three cross sections orthogonal to each other, the XY plane ultrasonic tomographic image 21, the YZ plane ultrasonic tomographic image 22, and the ZX plane ultrasonic tomography The image 23 is reconstructed. Furthermore, an ultrasonic three-dimensional image (hereinafter abbreviated as “three-dimensional image”) 24 is also reconstructed.

  The ultrasonic image constructing unit 4 f has a function of displaying on the three-dimensional image 24 a slice plane that specifies the positions of the three orthogonal cross sections. The slice plane 25 on the three-dimensional image 24 determines the cutout position of the XY plane ultrasonic tomographic image 21, the slice plane 26 determines the cutout position of the YZ plane ultrasonic tomographic image 22, and the slice plane 27 sets the ZX plane ultrasonic wave. The cut-out position of the tomographic image 23 is determined.

  The viewpoint for the three-dimensional image 24 can be set in an arbitrary direction via the operation unit 4b. The ultrasonic image reconstruction unit 106 reconstructs the three-dimensional image 24 viewed from the input viewpoint. Furthermore, the positions of the slice planes 25, 26, and 27 with respect to the three-dimensional image 24 can be arbitrarily set via the operation unit 4b. Then, the ultrasonic image reconstruction unit 106 reconstructs the XY plane ultrasonic tomographic image 21, the YZ plane ultrasonic tomographic image 22, and the ZX plane ultrasonic tomographic image 23 cut out at the position input from the operation unit 4b. .

  Next, the anatomical volume data stored in the anatomical volume data storage unit 4k will be described with reference to FIGS. FIG. 3 is a schematic diagram showing an example of the anatomical volume data of the fetal brain. FIG. 4 is a schematic diagram showing an example of the anatomical volume data of the fetal heart.

  As shown in FIG. 3, the anatomical volume data storage unit 4k stores a plurality of anatomical volume data of fetal brains having different gestational weeks. As an example, in the present embodiment, fetal brain volume data 31 at 5 weeks, fetal brain volume data 32 at 15 weeks, fetal brain volume data 33 at 30 weeks, and fetal brain volume data 34 at 40 weeks are included. And stored in the anatomical volume data storage unit 4k in association with the number of weeks of pregnancy. When the observation site is a fetal brain site, the anatomy volume data selection unit 4l out of these fetal brain volume databases stored in the anatomy volume data storage unit 4k stores the anatomy volume data of the nearest week number. select.

  Further, as shown in FIG. 4, the anatomical volume data storage unit 4k stores a plurality of anatomical volume data of fetal hearts having different gestational weeks. As an example, in this embodiment, fetal heart volume data 41 at 5 weeks, fetal heart volume data 42 at 15 weeks, fetal heart volume data 43 at 30 weeks, and fetal heart volume data 44 at 40 weeks are living organisms. When stored in the structured volume data storage unit 4k and the observation site is a fetal heart site, among these fetal heart volume databases stored in the anatomical volume data storage unit 4k, the anatomical volume data selection unit 4l Selects the anatomical volume data of the nearest week number.

  The anatomical volume data shown in FIGS. 3 and 4 is a fetal heart and a fetal brain, but the part is not limited to the above, and may be an abdomen, a trunk, an extremity, or the like. It is also possible to treat the whole body as one volume data and to cut out and select according to the selected observation site.

  Moreover, in a part where the anatomy differs depending on the gender, it is possible to have an anatomical volume data set for each gender and to select the anatomical volume data using the sex information stored in the fetal information storage unit 4j.

  3 and 4 show examples of anatomical volume data for 5 weeks, 15 weeks, 30 weeks, and 40 weeks. Naturally, the anatomical volume data storage unit 4k is configured at intervals of shorter weeks. May be.

  In this specification, the number of gestational weeks is used as a measure of fetal growth, but it can also be used in terms of the number of fetal weeks. Further, when it is difficult to determine the number of gestation weeks, the anatomy volume data close to the actual measurement value is selected based on the actual measurement value of the fetus stored in the measurement data storage unit 4h, for example, the value of the head circumference. Also good.

  Next, the anatomy image formed by the anatomy image configuration unit 4m will be described with reference to FIG. FIG. 5 is a schematic diagram illustrating an example of a anatomical tomographic image.

  The anatomical structure forming unit 4m has a function of simultaneously generating and displaying a anatomical tomographic image and three-dimensional anatomical images in three orthogonal sections based on the anatomical volume data. More specifically, the XY plane anatomical tomographic image 51, the YZ plane anatomical tomographic image 52, and the ZX plane anatomical tomographic image 53 are reconstructed as three orthogonal cross sections. Furthermore, the anatomical three-dimensional image 54 is also reconstructed.

  In addition, the anatomical image forming unit 4m has a function of displaying on the anatomical structure three-dimensional image 54 a slice plane for designating the positions of the three orthogonal cross sections. The slice plane 55 on the three-dimensional image 54 determines the cutout position of the XY plane anatomical tomographic image 51, the slice plane 56 determines the cutout position of the YZ plane anatomical tomographic image 52, and the slice plane 57 is the ZX plane anatomical structure. The cut-out position of the tomographic image 53 is determined.

  Further, the viewpoint for the anatomical structure three-dimensional image 54 can be set in an arbitrary direction via the operation unit 4b. The anatomical structure image construction unit 4m reconstructs and displays the anatomical structure three-dimensional image 54 viewed from the input viewpoint. Furthermore, the positions of the slice surfaces 55, 56, and 57 with respect to the three-dimensional anatomical image 54 can be arbitrarily set via the operation unit 4b. Then, the anatomical image constructing unit 4m reconstructs the XY plane anatomical tomographic image 51, the YZ plane anatomical tomographic image 52, and the ZX plane anatomical tomographic image 53 that are cut out at the positions input from the operation unit 4b.

  Broken lines 58, 59, and 510 are scan ROI marks indicating the scanning range of the ultrasonic image, and are displayed superimposed on the anatomical tomographic image for comparison with the ultrasonic image. This superimposing display process is performed by the anatomy image constructing unit 4m by acquiring the scanning range information of the ultrasound image from the ultrasound transmitting / receiving unit 4c.

  In the first embodiment, the ultrasonic tomographic image and ultrasonic three-dimensional image formed by the ultrasonic image constructing unit 4f and the anatomical tomographic image and biological structure three-dimensional image constructed by the anatomical image forming unit 4m are simultaneously used. For this purpose, it is desirable to match the display magnification and the line-of-sight direction of the subject ultrasound image and the anatomical structure image.

  Therefore, the alignment unit 4n has a position adjustment function for matching the line-of-sight direction and display magnification of the ultrasonic volume data and the anatomy volume data. Next, this position adjustment function will be described with reference to FIG. FIG. 6 is an explanatory diagram for explaining the concept of the position adjustment processing.

  As shown in FIG. 6, the operator sets at least two ultrasonic image side reference points A and B and one ultrasonic image side reference point C in the ultrasonic volume data 61. Next, based on the anatomical knowledge of the operator, the operator places the anatomical image side reference point in the portion indicated by each of the ultrasonic image side reference points A, B, and C in the anatomical volume data 62. A ′, B ′, and the anatomical structure image side reference point C ′ are set.

  The ratio of the length of the line segment A-B in the ultrasonic volume data 61 and the line segment A′-B ′ in the anatomical volume data 62 is the difference in display magnification of the data. The shift of the vector between the line segment A-B and the line segment A′-B ′ in the anatomical volume data 62 is the image shift (viewpoint shift). Therefore, a rotation amount for correcting the difference between the rotation amount passing through the point C around the line segment A-B and the rotation amount passing through the point C ′ around the line segment A′-B ′ is obtained, and this is used to calculate the ultrasonic wave. The display is performed by matching the viewpoint and display magnification of the volume data with the viewpoint and display magnification of the anatomy volume data. Hereinafter, the alignment processing of the ultrasonic volume data 61 and the anatomy volume data 62 will be described in detail.

  The ultrasonic volume data 61 and the anatomical volume data 62 are data indicating the same area, but are matched in order to predict that the size, display position, and line-of-sight direction at the time of image creation are different. It is desirable to display.

  For this reason, as described above, coordinates corresponding to three points are set for each of the ultrasonic volume data 61 and the anatomical volume data 62, and a transformation matrix between them is derived, so that the size, the display position, and the direction of the line of sight can be determined. It is possible to match.

  However, the ultrasound volume data is an image acquired from a living body, and in most cases, it does not exactly match the body structure volume data due to factors such as respiration and body posture. In such a case, if the volume data is deformed so that the three points of the ultrasonic volume data 61 coincide with the three points on the anatomical volume data 62, the acquired data will be distorted, and the organ or lesion The characteristic shape of the part may be damaged.

  Therefore, in this embodiment, the size, the display position, and the line-of-sight direction at the time of image creation are matched by performing coordinate transformation without deformation of the ultrasonic volume data by limiting the rotation axis to a predetermined order. .

  Specifically, drawing of the same cross section for volume data is performed using two reference points among the three points set by the operator, and the magnification, display position, and rotation axis are determined, and the amount of rotation is set to the remaining reference points. Is determined by one point. The “remaining reference points” are hereinafter referred to as “reference points” in order to distinguish them from the two reference points used for determining the magnification, display position, and rotation axis.

  Specifically, the three points A, B, and C in the ultrasonic volume data 61 and the points A ′, B ′, and C ′ in the anatomical volume data 62 are set as corresponding identical points, and the ultrasonic volume data is set. When two points in 61, for example, A and B are set as the ultrasonic image side reference points, and points A ′ and B ′ in the anatomical volume data 62 are set as the corresponding anatomical image side reference points, the ultrasonic volume data A point C in 61 is an ultrasound image side reference point, and a point C ′ in the body structure volume data 62 is a body structure image side reference point.

  At the beginning of the alignment process, first, the sizes of both volume data are matched. The ratio of the sizes of the ultrasonic volume data 61 and the anatomical volume data 62 is obtained by the ratio of the length of the line segment AB and the length of the line segment A′-B ′. When the size of the ultrasonic volume data 61 is adjusted to the size of the anatomical volume data 62, the unit matrix is multiplied by a coefficient obtained by dividing the length of the line segment A′-B ′ by the length of the line segment AB. Thus, the enlargement / reduction matrix Mscale can be created. By applying this enlargement / reduction matrix Mscale to the ultrasonic volume data 61, the sizes of both volume data can be matched.

  Next, the display positions of both volume data are matched. When the display positions of the ultrasonic volume data 61 and the anatomical volume data 62 are matched, a parallel movement matrix may be created so that one point on the cross section matches, but here, the anatomical image side reference point A A translation matrix Mpan is generated by subtracting the coordinates of the ultrasonic image side reference point A from the coordinates of '. By applying this translation matrix Mpan to the ultrasound volume data 61, the positions of the ultrasound image side reference point A and the anatomy image side reference point A 'can be matched. At this time, the reference point used for position adjustment is set as the center point of the next rotation process.

  Finally, the display directions of both volume data are matched. When the ultrasonic volume data 61 is made to coincide with the direction of the anatomical volume data 62, the normal vector at the ultrasonic reference point A is orthogonal to the three-point ABC plane in the ultrasonic volume data 61, The rotation amount may be obtained so that the direction from the reference point A to B in the ultrasonic volume data 61 matches the direction from the reference point A ′ to B ′ in the anatomy volume data 62.

  In this embodiment, since the coordinates of the ultrasound image side reference point A and the anatomy image side reference point A ′ are already the same, the normal vector of the ABC plane at the ultrasound image side reference point A is used as the rotation axis, A rotation matrix Mrot-z having a rotation amount at an angle formed by the vector AB and the vector A′B ′ is created. By applying this rotation matrix Mrot-z to the ultrasonic volume data 61, the display directions of the ultrasonic volume data 61 and the anatomical volume data 62 coincide.

  As described above, when the enlargement / reduction matrix Mscale, the translation matrix Mpan, and the rotation matrix Mrot-z are applied to the ultrasound volume data 61, the ultrasound volume data 61 is converted into the ultrasound volume data 63. The converted ultrasonic volume data 63 and the anatomical volume data 62 have the same size, display position, and display direction. As a result, in the converted ultrasonic volume data 63 and anatomical volume data 62, the images cut out from the corresponding same cross-sectional positions have the same display position, orientation, and size.

  The above-described position adjustment process is merely an example, and the selection of the reference point and the reference point can be performed interchangeably as long as the final result does not change. It is also possible to change the order. Further, the above correction may be performed on the ultrasonic volume data 61 so as to match the anatomical volume data 62, or may be performed on the anatomical volume data 62 so as to match the ultrasonic volume data 61. May be. Further, the correction of the display position and the orientation of the viewpoint and the correction of the display magnification may be performed independently on the ultrasonic volume data 61 or the anatomy volume data 62.

  Next, an operation procedure in the first embodiment will be described with reference to FIG. FIG. 7 is a flowchart showing a processing procedure in the first embodiment. In the following, description will be given in the order of steps in FIG.

(Steps S701 to S704)
After the examination is started (S701), the operator inputs the number of weeks and sex of the fetus as fetal information, and the input fetal information is stored in the fetal information storage unit 4j (S702). Subsequently, the operator sets a region of interest (observation site), and the anatomical volume data selection unit 4l acquires site information of the region of interest (S703). The anatomical volume data selection unit 41 selects and reads out the most matching anatomical volume data from the anatomical volume data storage unit 4k based on the fetal information and the region information of the region of interest (S704).

(Step S705)
Based on the scanning conditions set via the operation unit 4b, the ultrasonic volume data is collected by bringing the ultrasonic probe 3 into contact with the subject 2 (S705).

(Step S706)
When the collection of the ultrasonic data is completed, the alignment unit 4n starts alignment processing between the ultrasonic volume data and the anatomical volume data (S706). First, the ultrasound image construction unit 4f constructs an ultrasound image based on the ultrasound volume data, and the body structure image construction unit 4m constructs a body structure image based on the selected body structure volume data. An ultrasound image and a anatomy image are displayed on the display unit 4p.

(Steps S707 to S712)
The operator sets the first anatomical image side reference point A ′ on the anatomical image (S707), and sets the first ultrasonic image side reference point A on the ultrasonic image (S708). The order of steps S707 and S708 may change. Subsequently, a second anatomical image side reference point B ′ is set on the anatomical structure image (S709), and a second ultrasonic image side reference point B is set on the ultrasonic image (S710). A third anatomical image side reference point C ′ is set on the anatomical structure image (S711), and a third ultrasonic image side reference point C is set on the ultrasonic image (S712).

  The reference point setting method will be described with reference to FIGS. FIG. 8 is an explanatory diagram illustrating an example of setting the first reference point. FIG. 9 is an explanatory diagram illustrating an example of setting the second reference point. FIG. 10 is an explanatory diagram illustrating a setting example of the third reference point.

  As shown in FIG. 8, on the screen of the display unit 4p, an ultrasonic tomographic image 81 and an ultrasonic three-dimensional image 82 are displayed side by side along the vertical direction of the screen on the left half of the screen, and a living body is displayed on the right half of the screen. The structural tomographic image 83 and the anatomical three-dimensional image 84 are displayed side by side in the vertical direction of the screen.

  When the operator moves the slice surface 85 on the ultrasonic three-dimensional image 82 using the operation unit 4b, the ultrasonic tomographic image 81 on the moved slice surface is updated and displayed. When the operator moves the slice surface 86 on the three-dimensional anatomical image 84 using the operation unit 4b, the anatomical tomographic image 83 on the slice surface after the movement is updated and displayed.

  The operator moves at least one of the slice plane 85 composed of the XY plane on the Z axis of the ultrasonic three-dimensional image 82 and the slice plane 86 composed of the XY plane on the Z axis of the anatomical structure three-dimensional image 84. On each image, a point where the same part in the subject is imaged is searched. Then, the ultrasonic tomographic image 81 and the anatomical tomographic image 83 in which the same part is imaged are displayed, and the point where the same part is imaged on each image is designated by the operation unit 4b and set as a reference point. To do. In FIG. 8, the ultrasound image side reference point 87 is set on the ultrasound tomographic image 81, and the anatomy side reference point 88 is set on the anatomy tomographic image 83.

  Next, processing for setting the second reference point will be described. When the operator moves the positions of the slice planes 85 and 86 in FIG. 8 on the Y axis (the slice plane changes to the YZ plane), the screen transitions from the screen in FIG. 8 to the screen in FIG.

  In the screen shown in FIG. 9, on the screen of the display unit 4p, the ultrasonic tomographic image 91 and the ultrasonic three-dimensional image 92 are displayed side by side along the vertical direction of the screen on the left half of the screen, and the living body is displayed on the right half of the screen. The structural tomographic image 93 and the anatomical three-dimensional image 94 are displayed side by side along the vertical direction of the screen. Further, a slice plane 95 composed of a YZ plane is superimposed on the X axis of the ultrasonic three-dimensional image 92, and a slice plane 96 composed of a YZ plane is superimposed on the X axis of the anatomical structure three-dimensional image 94. . The operator operates the operation unit 4 b to set the second ultrasonic image side reference point 97 on the ultrasonic tomographic image 91, and the second anatomical image side reference point 98 on the anatomical tomographic image 83. Set.

  Next, processing for setting the third reference point will be described. When the operator moves the positions of the slice planes 95 and 96 in FIG. 9 to a position parallel to the ZX plane, the screen transitions from the screen in FIG. 9 to the screen in FIG.

  In the screen shown in FIG. 10, on the screen of the display unit 4p, the ultrasonic tomographic image 101 and the ultrasonic three-dimensional image 102 are displayed side by side along the vertical direction of the screen on the left half of the screen, and the living body is displayed on the right half of the screen. The structural tomographic image 103 and the anatomical three-dimensional image 104 are displayed side by side along the vertical direction of the screen. In addition, the slice plane 105 is superimposed at a position parallel to the ZX plane of the ultrasonic three-dimensional image 102, and the slice plane 106 is superimposed at a position parallel to the ZX plane of the anatomy three-dimensional image 1004. The operator operates the operation unit 4 b to set the third ultrasonic image side reference point 107 on the ultrasonic tomographic image 101, and the third anatomical image side reference point 108 on the anatomical tomographic image 103. Set.

  In steps S707 to S712, the first to third reference points are set on the ultrasonic tomographic image and the anatomical tomographic image on the three-axis cross sections that are orthogonal to each other. , YZ plane, or ZX plane, or may be set on any two planes. In addition, first to third anatomical image side reference points are set in advance on a structure serving as a mark in the anatomical volume data, and a portion indicated by the first to third anatomical image side reference points You may set the point on the ultrasonic tomographic image by which the same site | part was imaged as a 1st-3rd ultrasonic image side reference point. In this case, steps S707, S709, and S711 can be omitted.

(Step S713)
In step S713, the alignment process shown in FIG. 6 is performed (S713). As a result, the viewpoint and display magnification of the ultrasound volume data and the body structure volume data match, and simultaneous display of the ultrasound tomographic image and the body structure cross-sectional image at the same viewpoint, the same section, and the same display magnification becomes possible.

(Step S714)
In step S714, a screen using the ultrasonic volume data and anatomical volume data after the alignment processing is displayed (S714).

(Step S715)
The presence / absence of fine adjustment is determined. If “Yes”, the process proceeds to step S716, and if “No”, the process proceeds to step S717. When the operator finely adjusts the position of the slice plane and the viewpoint direction of the ultrasonic tomographic image on the screen using the operation unit 4b, that is, inputs a new slice plane position and viewpoint, the process proceeds to step S716. If there is no fine adjustment input, the process proceeds to step S717 (S715).

(Step S716)
The ultrasonic tomographic image and the anatomical image are reconstructed according to the newly input slice position and viewpoint orientation, and are updated and displayed (S716).

(Step S717)
It is determined whether or not the examination is finished. If “No”, the process returns to step S715 to wait for fine adjustment of the ultrasonic tomographic image and the anatomical tomographic image. If “Yes”, the inspection is terminated (S717).

  Next, a display screen example in the first embodiment, that is, a screen displayed in S714 will be described.

  FIG. 11 is a schematic diagram illustrating an example of a display screen according to the first embodiment. In the display screen of FIG. 11, an ultrasonic tomographic image having three cross sections and a three-dimensional anatomical image are displayed simultaneously. The XY plane ultrasonic tomographic image 111, the YZ plane ultrasonic tomographic image 112, and the ZX plane ultrasonic tomographic image 113 on the display screen are set by slice planes 115, 116, and 117 set on the anatomical structure three-dimensional image 114. It is an ultrasonic tomographic image on the obtained plane. When at least one position of the slice planes 115, 116, 117 is changed, the XY plane ultrasonic tomographic image 111, the YZ plane ultrasonic tomographic image 112, and the ZX plane ultrasonic tomographic image 113 are also updated and displayed accordingly.

  FIG. 12 is a schematic diagram illustrating another example of the display screen according to the first embodiment. On the display screen of FIG. 12, an ultrasonic tomographic image and a anatomical tomographic image having the same cross section and a anatomical three-dimensional image are displayed simultaneously. In FIG. 12, the XY plane ultrasonic tomographic image 121 and the XY plane anatomical tomographic image 122 are an ultrasonic tomographic image on a plane defined by the slice plane 124 set on the anatomical structure three-dimensional image 123 and its standard. It is an XY plane anatomical tomographic image which shows an anatomical structure.

  Although the XY plane ultrasonic tomographic image 121 and the XY plane anatomical tomographic image 122 are displayed side by side in FIG. 12, the YZ plane ultrasonic tomographic image and the YZ plane anatomical tomographic image may be displayed side by side. The plane ultrasonic tomographic image and the ZX plane anatomical tomographic image may be displayed side by side. Furthermore, a plurality of cross-sectional images, for example, an XY plane ultrasonic tomographic image and an XY plane anatomical tomographic image, and a YZ plane ultrasonic tomographic image and a YZ plane anatomical tomographic image may be displayed simultaneously. The number of cross sections can be set arbitrarily.

  Still, the type of the cross section is not limited to the three-axis orthogonal cross section of the XY plane, the YZ plane, and the ZX plane, but a slice plane with an arbitrary inclination is set on the three-dimensional image of the anatomy, and the plane defined by the slice plane The ultrasonic tomographic image and the anatomical tomographic image that is the standard anatomical structure may be displayed side by side. Switching between the slices of the ultrasonic tomographic image and the anatomical tomographic image to be displayed may be performed using a dedicated switching button provided in the operation unit 4b, or the slice plane shown on the anatomical three-dimensional image is displayed on the operation unit 4b. It may be switched by moving it using a pointing device included in.

  Further, the display form is not limited to the side-by-side display, and may be selectively switched between the ultrasonic tomographic image and the anatomical tomographic image, or one of the ultrasonic tomographic image and the anatomical tomographic image. May be enlarged and displayed, while the other image may be reduced and displayed.

  Further, another display screen according to the first embodiment will be described with reference to FIG. FIG. 13 is a schematic diagram illustrating another example of the display screen according to the first embodiment. In the screen example shown in FIG. 13, the ultrasonic three-dimensional image 131 and the anatomical structure three-dimensional image 132, and the ultrasonic tomographic images 133a, 133b, and 133c on the XY plane, the YZ plane, and the ZX plane, the XY plane, the YZ plane, and the ZX plane. Anatomical tomographic images 134a, 134b, and 134c are simultaneously displayed, and the ultrasonic three-dimensional image 131 and the anatomical three-dimensional image 132 are converted into ultrasonic tomographic images 133a, 133b, and 133c and anatomical tomographic images 134a, 134b, and 134c. It is characterized by relatively large display. Then, a relatively large ultrasonic three-dimensional image 131 is displayed on the upper left half of the screen, and relatively small ultrasonic tomographic images 133a, 133b, and 133c are displayed side by side below. In addition, a relatively large anatomical three-dimensional image 132 is displayed at the top of the right half of the screen, and relatively small anatomical tomographic images 134a, 134b, and 134c are displayed side by side below.

  When the positions of slice planes 135a (XY plane) 135b (YZ plane) and 135c (ZX plane) are designated on the ultrasonic three-dimensional image 131, ultrasonic tomographic images 133a, 133b, and 133c corresponding to these positions are displayed. The Further, in conjunction with the above designation, the slice plane 135a (XY plane) 135b (YZ) is located at the same position as the slice plane 136a (XY plane) 136b (YZ plane), 136c (ZX plane) on the three-dimensional anatomical image 132. Surface), 135c (ZX surface). Then, the anatomical tomographic images 134a, 134b, and 134c in the slice planes 135a (XY plane) 135b (YZ plane) and 135c (ZX plane) are displayed on one screen.

  Further, another screen display example of the first embodiment will be described with reference to FIG. FIG. 14 is a schematic diagram illustrating another example of the display screen according to the first embodiment.

  When the reference lines 143a to 143g are set on the reference cross section 140, the ultrasound image construction unit 4f is orthogonal to the reference lines 143a to 143g based on the ultrasound volume data stored in the ultrasound volume data storage unit 4e. The ultrasonic tomographic images 141a to 141g are displayed side by side in the display screen. In addition, the anatomical image forming unit 4m forms a anatomical tomographic image 142 having the same cross section as the reference image 140, generates anatomical tomographic images 142a to 142g orthogonal to the reference lines 143a to 143g, and an ultrasonic tomographic image 141a. Displayed side by side in correspondence with each of ~ 141g. The anatomical image constructing unit 4m may superimpose and display the reference lines 143a to 143g on the anatomical tomographic image 142.

  According to this display form, an ultrasonic tomographic image whose spatial position is relatively difficult to grasp due to ultrasonic artifacts and attenuation, etc., and an anatomically easy-to-understand anatomical tomographic image consisting of the same cross section By simultaneously displaying the two, it is possible to contribute to the improvement of diagnostic ability by making a diagnosis while comparing the two. In particular, it becomes easier to grasp the anatomical structure of the observation object that changes from day to day, such as a fetus.

  In the above embodiment, the alignment unit 4n matches the viewpoints and display magnifications of the ultrasonic volume data and the anatomy volume data. However, the anatomy is measured using the fetal measurement data stored in the measurement data storage unit 4h. You may make the measurement object part in volume data correspond with the scale of measurement data. As a result, it is possible to convert the anatomical volume data to the same scale as the subject 2.

<Second embodiment>
In the second embodiment, volume data is captured at different time phases during periodic motion, and a set of volume data of a plurality of time phases is stored as volume data of one site. The simultaneous phase ultrasonic tomographic image and the anatomical tomographic image and / or the simultaneous phase ultrasonic tomographic image and anatomical structure three-dimensional image are displayed. As used herein, “a part that performs periodic exercise” corresponds to a beating heart, for example. A plurality of volume data acquired in different cardiac time phases among the movements in one cycle of the heart are handled as volume data of a certain number of heart images.

  Hereinafter, the second embodiment will be described with reference to FIGS. 15 and 16. FIG. 15 is a flowchart illustrating a processing procedure according to the second embodiment. FIG. 16 is a schematic diagram illustrating an example of a display screen according to the second embodiment. Hereinafter, it demonstrates along each step of FIG.

  Prior to the start of the examination, a plurality of volume data with different time phases of the periodic motion is stored as one anatomy volume data in the anatomy volume data storage unit 4k. In the anatomical volume data, a waveform of a periodic motion, for example, simulated electrocardiogram waveform data may be stored in association with this.

(Steps S701 to S704)
Steps S701 to S704 are performed. Since the processing contents of S702 to S704 are the same as those in the first embodiment, description thereof will be omitted.

(Step S1501)
An operator wears a device that acquires periodic motion data of the subject, such as an electrocardiograph, on the subject 2, acquires the periodic motion data and the ultrasound volume data in synchronization, and obtains an ultrasound volume data storage unit. 4e (S1501). In addition, by generating periodic motion data from acquired ultrasound data, and collecting volume data for multiple time phases by collecting only simultaneous phase data from the acquired ultrasound volume data, Alternatively, volume data for periodic motion may be configured.

(Step S1502)
The time phase designation unit 4o displays a time phase designation bar (see time phase designation bar 165 and slider 165s in FIG. 16 described later) for designating the time phase of the periodic motion on the screen of the display unit 4p. The time phase designation bar has the same number of scales as the number of volume data composing the ultrasonic volume image. When the slider is set to an arbitrary scale, the time phase volume data indicated by the position is used. An ultrasonic tomographic image is reconstructed and displayed. For example, in FIG. 16, one heartbeat is divided into nine time phases, and nine volume data imaged in each time phase are combined to form one ultrasonic volume data, of which periodic motion This shows a state in which the third volume data counted from the beginning, that is, 3/9 time phase volume data is designated. Also displayed is a counter 167 that displays the specified time phase “3” in the numerator and the total number of time phase divisions “9” in the denominator. The time phase may be specified by changing the number of molecules in the counter 167.

  The operator moves the slider 165s to a scale indicating the desired time phase and designates the reference time phase of the ultrasonic volume data (S1502). The ultrasonic image construction unit 4f selects volume data of a specified time phase.

(Step S1503)
The anatomical volume data selection unit 4l selects volume data of the time phase closest to the time phase specified in step S1502 from the anatomy volume data storage unit 4k (S1503).

(Steps S706 to S716)
For the selected ultrasonic volume data and anatomical volume data, the alignment process (steps S706 to S713) in steps S706 to S713 and the initial screen display (S714) are performed.

  FIG. 16 shows a display example of this initial screen. On the left half of the screen, an ultrasonic tomographic image 161, a time phase designation bar 165, a slider 165s, and a counter 167 are displayed below. In the right half of the screen, the tomographic image 162 is displayed, and a time phase designation bar indicating the total number of time divisions “18” and the selected time phase “9” of the body structure volume data arranged below it. 166, a slider 166s, and a counter 168 are displayed. When the simulated electrocardiogram waveform data is stored in association with the anatomy volume data, the anatomy image configuration unit 4m simultaneously displays the electrocardiogram waveform 169 corresponding to the time phase bar 168.

  In the screen of FIG. 16, a three-dimensional anatomical image 163 and a slice plane 164 are displayed on the right upper side of the anatomical tomographic image 162. When the slice plane 164 on the three-dimensional anatomical image 163 is moved, the displayed ultrasonic tomographic image and anatomical tomographic image are moved and rotated, or the viewpoint is finely adjusted (S715). The ultrasonic tomographic image 161 and the anatomical tomographic image 162 are updated and displayed according to the position of the slice plane and the angle of the viewpoint reset by the adjustment (S716). If fine adjustment is not performed, the process advances to step S1504.

(Step S1504)
If the operator respecifies the time phase on the time phase designation bar 165 or 166, the process proceeds to step S1505, and if not redesignated, the process proceeds to step S1506 (S1504).

(Step S1505)
The anatomical volume data selection unit 4l performs reselection of the redesignated time phase volume data, and the anatomical structure image construction unit 4m constructs the anatomical tomographic image using the reselected volume data, and updates it. indicate. The ultrasonic image construction unit 4f also reselects the redesignated time phase volume data, constructs an ultrasonic tomographic image using the reselected volume data, and updates and displays it (S1505). The anatomical tomographic image and ultrasonic tomographic image reconstructed in this step are tomographic images of the slice plane 164 on the anatomical structure three-dimensional image 163.

(Step S1506)
When the inspection is continued, the process returns to step S715 to enter a standby state in which the slice plane 164 is moved, rotated, and time phase is specified again. If the inspection is not continued, the inspection ends (S1506).

  In the above description, in S1502, the time phase desired by the operator is designated using the time phase designation bar 165 and the slider 165S having the same number of scales as the volume data number of the ultrasonic volume image. In step S1502, the time phase designation unit 4o displays a time phase designation bar 166 and a slider 166s having the same number of scales as the volume data of different time phases constituting the anatomical volume data, and when the operator desires A phase may be designated, and in step S1503, the ultrasonic image construction unit 4f may select volume data of a time phase closest to the designated time phase from the ultrasonic volume data.

  In the above description, the ultrasonic tomographic image and the anatomical tomographic image are configured and displayed. However, the ultrasonic tomographic image and the anatomical structure three-dimensional image may be configured and displayed.

  According to the present embodiment, the anatomical structure image is configured and displayed based on the anatomical volume data having the same phase or the closest time phase even for the part that periodically moves. Therefore, it is possible to refer to the anatomical image having more anatomical information when diagnosing the ultrasonic tomographic image, and to improve the diagnostic ability.

  In the above embodiment, a tomographic image generally referred to as a B-mode image is shown as an example, but it is naturally possible to simultaneously use a blood flow display function and a hardness display function that are currently standard functions at the same time. Is possible. In the above embodiment, the fetal diagnosis is described as an example, but the present invention can naturally be applied to children and adults. Further, in the above description, the case where the ultrasonic diagnostic image of the subject imaged using the ultrasonic diagnostic apparatus and the anatomical structure image are displayed simultaneously has been described as an example. An object image based on the volume data of an object obtained by an image pickup apparatus such as an MRI apparatus, an X-ray CT apparatus, or a PET apparatus, and a anatomical structure volume in which the internal structure (anatomical structure) of the object is known You may display the anatomy image based on data simultaneously. The anatomical volume data described above is data that accompanies collection work, but may be data that does not involve collection work, for example, volume data of a numerical model obtained by converting a standard anatomical structure into a scalar value. Good.

1: Ultrasonic diagnostic apparatus, 2: Subject, 3: Ultrasonic probe, 4: Main body

Claims (14)

An ultrasonic probe that emits ultrasonic waves to the subject and receives the reflected waves of the ultrasonic waves; and
An ultrasonic volume data generation unit that generates ultrasonic volume data of the subject using a reflected echo signal based on the reflected wave;
A anatomical volume data storage unit that stores a plurality of anatomical volume data indicating an anatomical structure corresponding to the same part as the imaging part of the subject imaged by the ultrasound;
Based on the ultrasound volume data, an ultrasound image construction unit that constructs an ultrasound image of the subject;
A anatomical volume data selection unit that selects one anatomical volume data among a plurality of anatomical volume data stored in the anatomical volume data storage unit;
Based on the selected anatomical volume data, a anatomical image constructing unit that constitutes a anatomical image in a predetermined cross section;
A display unit for displaying the ultrasound image of the subject and the anatomy image;
An ultrasonic diagnostic apparatus comprising: A subject information acquisition unit for acquiring subject information including at least one of the gestational age, age, observation site, or sex of the subject;
The anatomical volume data storage unit stores at least two or more anatomical volume data in which at least one of gestational age, age, observation site, or gender is different,
The anatomical volume data selection unit selects anatomical volume data most similar to the subject from the anatomical volume data storage unit based on the subject information.
The ultrasonic diagnostic apparatus according to claim 1. The ultrasonic volume data and the anatomical volume data are constituted by a collection of a plurality of volume data at different time phases of a part that performs periodic motion of the subject,
The ultrasonic diagnostic apparatus further includes a time phase designating unit that designates a desired time phase,
The anatomical volume data selection unit selects anatomical volume data of a time phase closest to the designated time phase,
The anatomical image forming unit composes the anatomical image using the selected anatomical volume data,
The ultrasonic image constructing unit generates the ultrasonic image by selecting volume data of a time phase closest to a specified time phase from the ultrasonic volume data;
The ultrasonic diagnostic apparatus according to claim 1 or 2. A positioning unit that performs a positioning process for matching at least one of the size, position, and orientation of the ultrasonic volume data and the size, position, and orientation of the anatomy volume data; ,
The ultrasonic image configuration unit and the anatomy image configuration unit configure the ultrasonic image and the anatomy image using the ultrasonic volume data and the anatomy volume data subjected to the alignment process,
The display unit simultaneously displays the ultrasonic image and the anatomy image configured using the ultrasonic volume data and the anatomy volume data subjected to the alignment process.
The ultrasonic diagnostic apparatus according to any one of claims 1 to 3, wherein: A first operation unit that receives an operation of setting at least three ultrasonic image side reference points on the ultrasonic image displayed on the display unit;
The alignment unit is configured so that each of the set ultrasonic image side reference points matches a portion indicated by each of the set ultrasonic image side reference points in the anatomy image. Moving and rotating at least one of the ultrasonic volume data and the anatomical volume data to match the position and orientation of the ultrasonic volume data and the anatomical volume data;
The ultrasonic diagnostic apparatus according to claim 4. The first operation unit further receives an operation of setting a part corresponding to each of the ultrasonic image side reference points on the anatomical image displayed on the display unit as a anatomical image side reference point.
The ultrasonic diagnostic apparatus according to claim 5. In the anatomy volume data, an anatomy image side reference point indicating a structure that is a mark of the alignment process is set in advance,
The anatomical structure image constituting unit constitutes the anatomical structure image including the anatomical structure image side reference point,
The display unit displays the configured anatomy image and an ultrasound image for setting the ultrasound image reference point.
The ultrasonic diagnostic apparatus according to claim 5. The first operation unit accepts the setting of the at least three ultrasonic image side reference points on one ultrasonic tomographic image, or the at least three ultrasonic tomographic images on the at least three ultrasonic tomographic images. Accept the setting of the sound image side reference point,
The ultrasonic diagnostic apparatus according to any one of claims 5 to 7, wherein The alignment unit uses a distance between the two ultrasonic image side reference points and a distance between parts indicated by the two ultrasonic image side reference points on the anatomy image. And matching the sizes of the ultrasonic volume data and the anatomical volume data,
The ultrasonic diagnostic apparatus according to claim 4. A measuring unit that measures an actual measurement value of the part of the subject imaged in the ultrasonic image;
The alignment unit matches the sizes of the ultrasonic volume data and the anatomical volume data based on the actual measurement value.
The ultrasonic diagnostic apparatus according to claim 4. The ultrasonic image construction unit has a biaxial orthogonal cross section orthogonal to the ultrasonic radiation surface provided in the ultrasonic probe and a triaxial orthogonal cross section including a cross section parallel to the ultrasonic radiation surface. Constituting the ultrasonic tomographic image consisting of any two of the cross sections,
The ultrasonic diagnostic apparatus according to claim 1. The ultrasonic image construction unit composes an ultrasonic tomographic image using the ultrasonic volume data,
The anatomical image constructing unit constitutes a anatomical tomographic image having the same cross section as the ultrasonic tomographic image and a three-dimensional image based on the anatomical volume data, and the ultrasonic tomographic image is included in the three-dimensional image. Superimposing a slice plane indicating the cross-sectional position of the image and the anatomical tomographic image,
The display unit displays the ultrasonic tomographic image, the anatomical tomographic image, and the three-dimensional image,
The ultrasonic diagnostic apparatus further includes a second operation unit that receives a movement operation of the position of the slice surface,
The ultrasound image constructing unit and the anatomical structure image constructing unit constitute an ultrasound tomographic image and a anatomical tomographic image on the slice plane after movement,
The ultrasonic diagnostic apparatus according to any one of claims 1 to 3, wherein: The ultrasonic diagnostic apparatus further includes a third operation unit configured to set a position of at least one reference line indicating a cross-sectional position on the reference image displayed on the display unit,
The ultrasound image construction unit and the anatomy image construction unit constitute an ultrasound tomographic image and a anatomy tomographic image of a cross section orthogonal to the reference line,
The display unit displays the ultrasonic tomographic image and the anatomical tomographic image configured at the same reference line side by side,
The ultrasonic diagnostic apparatus according to any one of claims 1 to 3, wherein: Reading the volume data of the subject obtained by imaging the subject with a medical imaging device;
Configuring a subject image based on the subject volume data; and
Selecting one anatomical volume data among a plurality of anatomical structure volume data indicating an anatomical structure corresponding to the same part as the imaging part of the subject imaged by the medical imaging device stored in advance When,
Constructing a anatomy image in a predetermined cross section based on the selected anatomy volume data;
Displaying the subject image and the anatomy image;
An image display method comprising: