JP2012040207A - Ultrasonic diagnostic apparatus, control program for the same, and image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily set display sections of tomographic images to be multiview-displayed.SOLUTION: This ultrasonic diagnostic apparatus includes: a probe transmitting/receiving an ultrasonic wave; a volume data generation means generating three-dimensional volume data based on the ultrasonic wave received by the probe; a fly-through image generation means generating a fly-through image wherein the volume data are projected from a viewpoint set inside a luminal structure included in the volume data; an input means inputting an interest point based on the fly-through image; a tomographic image generation means generating a first tomographic image in a first section corresponding to the interest point and a second tomographic image in a second section separate from the first section at a prescribed distance, based on the volume data; and a display means displaying the first tomographic image and the second tomographic image.

Description

  The present disclosure relates to an ultrasonic diagnostic apparatus that performs diagnosis using an ultrasonic image, an ultrasonic diagnostic program, and an image processing apparatus.

  The ultrasonic diagnostic apparatus transmits ultrasonic waves from an ultrasonic transducer built in an ultrasonic probe to a subject, and reflects reflected waves (hereinafter simply referred to as echo signals) generated in the subject. It is an apparatus that generates an ultrasonic image based on an echo signal received by a vibrator.

  2. Description of the Related Art In recent years, scanning a three-dimensional space by arranging ultrasonic transducers built in an ultrasonic probe in a two-dimensional manner or by oscillating ultrasonic transducers arranged in a row by a motor. An ultrasonic diagnostic apparatus capable of performing the above has been put into practical use. In such an ultrasonic diagnostic apparatus, it is possible to reconstruct and display a tomographic image of a cross-section at a desired position using volume data obtained by scanning a three-dimensional space.

JP 2010-94224 A

  Consider a case in which a specific site such as a tumor in a subject is diagnosed using the ultrasonic diagnostic apparatus as described above. In order to check the situation around a specific part using a tomographic image, a so-called multi-view that reconstructs a tomographic image of a plurality of cross sections arranged at a predetermined interval around the specific part and displays the tomographic images of a plurality of cross sections side by side. Display is useful.

  By the way, when performing multi-view display, it is necessary to specify the position and direction of a central cross section (hereinafter simply referred to as a reference cross section) among a plurality of tomographic images displayed. In order to specify the position and direction of the reference cross section, for example, a method of reconstructing a tomographic image of an arbitrary cross section as a reference plane and setting a straight line region in the reference image is conceivable. In this case, the ultrasonic diagnostic apparatus performs multi-view display using a cross section that passes through the set straight region and is orthogonal to the reference image as a reference cross section. However, there may be a case where the specific part is distributed along the inner wall surface of the lumen structure or the like. Since the lumen has a three-dimensionally complicated shape, the positional relationship between the lumen and the specific part is grasped, and the cross section of the reference surface is set so that the specific part can be captured in the reference plane and the tomographic image of the multi-view display. To do was complicated operations.

  Therefore, an object of the present disclosure is to easily set a display cross section of a tomographic image to be displayed in multi-view.

  In order to solve the above problems, an ultrasonic diagnostic apparatus according to an embodiment includes a probe that transmits and receives ultrasonic waves, volume data generation means that generates three-dimensional volume data based on ultrasonic waves received by the probe, and Fly-through image generating means for generating a fly-through image in which the volume data is projected from a viewpoint set inside a lumen structure included in the volume data; and input means for inputting a point of interest based on the fly-through image; Based on the volume data, a first tomographic image in a first cross section corresponding to the point of interest and a second tomographic image in a second cross section separated from the first cross section by a predetermined distance are generated. It comprises a tomographic image generating means and a display means for displaying the first tomographic image and the second tomographic image.

  Further, in order to solve the above-described problem, the control program for the ultrasonic diagnostic apparatus according to the embodiment generates a fly-through image obtained by projecting the volume data from the viewpoint arranged inside the lumen structure included in the three-dimensional volume data. Generating a step of setting a point of interest based on the fly-through image, generating a first tomographic image in a first cross section corresponding to the point of interest in the volume data, and the first Generating a second tomographic image in a second cross section at a predetermined distance from the cross section.

  In order to solve the above problem, the image processing apparatus according to the embodiment generates a fly-through image in which the volume data is projected from a viewpoint set inside a lumen structure included in the three-dimensional volume data. Generating means; interest point setting means for setting a point of interest based on the fly-through image; first tomographic image at a first section corresponding to the point of interest in the volume data; and the first section. And a tomographic image generating means for generating a second tomographic image in a second cross section at a predetermined distance from the first tomographic image.

The block diagram which shows the internal structure of the ultrasound diagnosing device which concerns on embodiment. The figure which shows the relationship between the fly-through image and volume data which concern on embodiment. The figure which shows the relationship between the tomogram and volume data which concern on embodiment. The figure which shows the relationship between the multi view display which concerns on embodiment, and volume data. 6 is a flowchart showing a processing flow during multi-view display according to the embodiment. The figure which shows the example of a screen display of the fly-through image which concerns on embodiment. The figure which shows the example of a screen display at the time of interest point setting which concerns on embodiment. The figure which shows the example of a screen display at the time of the reference | standard cross section setting which concerns on embodiment. The figure which shows the example of a screen display at the time of the multi view display which concerns on embodiment. The figure which shows the positional relationship of each cross section of the multi view which concerns on embodiment. The figure which shows the example of a screen display at the time of the multi view display in another display cross section concerning embodiment. The figure which shows the example of a screen display at the time of the reference | standard cross section movement which concerns on embodiment. The figure which shows the example of a screen display at the time of another reference | standard cross-section movement which concerns on embodiment. FIG. 6 is a view showing a screen display example of a reference image at the time of multi-view display according to the embodiment. The figure which shows the example of a screen display of another reference image at the time of the multi view display which concerns on embodiment. The figure which shows the example of a screen display of another fly-through image which concerns on embodiment.

(Configuration of the ultrasonic diagnostic apparatus 1)
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. FIG. 1 is a block diagram illustrating an internal configuration of an ultrasonic diagnostic apparatus 1 according to each embodiment. The ultrasonic diagnostic apparatus 1 is configured by combining the system control unit 10 and the probe 20.

  The system control unit 10 includes an operation unit 11, a storage unit 12, a display unit 13, a projection image generation unit 14, a tomographic image generation unit 15, a volume data generation unit 16, a transmission / reception unit 17, a B mode processing unit 18, and a Doppler processing unit 19. Consists of The system control unit 10 outputs a control command to each component, and comprehensively controls the ultrasonic diagnostic apparatus 1. Note that the configuration of the system control unit 10 in the present invention is not limited to this, and an appropriate component may be added, or a processing device connected to the outside of the ultrasonic diagnostic apparatus 1 is some of the components. It does not matter if it plays the role of

  The probe 20 is a member connected to the system control unit 10. The probe 20 incorporates an ultrasonic transducer 21 and controls the ultrasonic transducer 21 to be driven based on the drive signal output from the transmission / reception unit 17.

  The ultrasonic transducer 21 is a member that generates an ultrasonic wave based on a drive signal input through the probe 20 and receives the ultrasonic wave reflected from the subject and converts it into an electric signal. The ultrasonic transducer 21 outputs an electrical signal (hereinafter simply referred to as an echo signal) generated by receiving the ultrasonic wave to the transmission / reception unit 17.

  Note that the probe 20 in this embodiment is configured by, for example, a mechanical 4D probe (mechanical three-dimensional probe) or a 2D array probe (matrix array probe), and has a directivity of ultrasonic waves transmitted and received by the ultrasonic transducer 21 of 2. It is configured to control with respect to the dimension direction. In the mechanical 4D probe, first, the ultrasonic transducers 21 are arranged in a one-dimensional direction, and a motor that swings the ultrasonic transducers 21 in a direction orthogonal to the arrangement direction is attached. And it is a probe which controls the directivity of an ultrasonic wave to a two-dimensional direction by driving the ultrasonic vibrator 21 while driving a motor. On the other hand, the 2D array probe arranges the ultrasonic transducers 21 in, for example, a grid pattern along two directions. It is a probe that controls the directivity of ultrasonic waves in a two-dimensional direction by controlling the drive timing of each ultrasonic transducer 21. Note that the configuration of the present embodiment is not limited to this, and the probe 20 may scan the three-dimensional space by an arbitrary method different from the mechanical 4D probe or the 2D array probe. For example, in the probe 20 that scans a two-dimensional plane by arranging the ultrasonic transducers 21 in a one-dimensional direction, the three-dimensional space may be scanned by performing scanning while moving the probe 20 manually.

  The transmission / reception unit 17 includes an amplifier circuit that processes an echo signal received by the probe 20, an A / D converter, an adder, and the like. The amplifier circuit amplifies the echo signal received by the probe 20 and outputs it to the A / D converter. The A / D converter gives a delay time necessary for determining the reception directivity of the amplified echo signal to the echo signal and outputs it to the adder. The adder adds echo signals given a delay time to obtain an echo signal corresponding to the scan line for transmitting the ultrasonic wave. The transmission / reception unit 21 outputs an echo signal corresponding to the scan line to the B-mode processing unit 18 or the Doppler processing unit 19. The transmission / reception unit 17 outputs a drive signal for driving the ultrasonic transducer 21 and transmitting ultrasonic waves to the ultrasonic probe 20.

  The B-mode processing unit 18 generates a B-mode signal that changes according to the amplitude intensity of the echo signal output from the transmission / reception unit 17. The B mode processing unit 18 outputs the generated B mode signal to the volume data generating unit 16.

  The Doppler processing unit 19 detects the frequency transition of the echo signal and generates a Doppler signal obtained by extracting the moving speed of the tissue or blood flow. The Doppler processing unit 19 outputs a Doppler signal to the volume data generation unit 16.

  The volume data generation unit 16 generates three-dimensional volume data based on the B mode signal and the Doppler signal output from the B mode processing unit 18 or the Doppler processing unit 19. Volume data is data configured by combining three-dimensional unit areas called voxels. When the probe 20 is a mechanical 4D probe, the volume data generation unit 16 determines the position of the voxel according to the swing angle of the motor at the time when the echo signal is received and the distance in the depth direction corresponding to the echo signal. The B-mode signal or the Doppler signal is mapped to the specified voxel. On the other hand, when the probe 20 is a 2D array probe, the volume data generation unit 16 determines the voxel in accordance with the array position of the ultrasonic transducers 21 that has received the echo signal and the distance in the depth direction corresponding to the echo signal. The position is specified, and the B-mode signal or the Doppler signal is mapped to the specified voxel. When the volume data generation unit 16 generates the volume data, the volume data generation unit 16 outputs the volume data to the projection image generation unit 14 and the tomographic image generation unit 15.

  The projection image generation unit 14 is a processing unit that generates a projection image obtained by rendering volume data. The projection image is generated by the following procedure, for example. First, the projection image generation unit 14 sets a viewpoint, a line-of-sight direction, and a display direction in a three-dimensional space of volume data. Next, the projection image generation unit 14 calculates a projection plane of the projection image based on the viewpoint and the line-of-sight direction, and sets it in the three-dimensional space of the volume data. Next, the projection image generation unit 14 examines the voxel value of each voxel on the straight line connecting the viewpoint and the projection plane, and extracts the voxel value of the voxel closest to the viewpoint among the voxels exceeding the predetermined transmission threshold value. Map to the projection plane. By performing the extraction and mapping of the voxel values for each pixel on the projection plane, the projection image generation unit 14 generates a projection image. Through the above processing, the projected image is obtained as an image viewed along the line-of-sight direction from the set viewpoint, in the three-dimensional space of the volume data.

  In addition, the projection image generation unit 14 has a function of generating a projection image in which a viewpoint is set inside the lumen in a tubular structure as one aspect of the projection image. Hereinafter, projection images with the viewpoint set inside the lumen are collectively referred to as fly-through images. In the following embodiments, the projection image generation unit 14 is described as generating a fly-through image as a projection image. The type of projection image generated by the projection image generation unit 14 is not limited to this, and a projection image obtained by projecting volume data from an arbitrary viewpoint may be used instead of the fly-through image. FIG. 2 is a diagram showing the relationship between the fly-through image and the volume data. It is assumed that a tubular structure 100 exists in the three-dimensional space of the volume data, and the structure 100 reflects an echo signal having an intensity exceeding the transmission threshold based on the acoustic impedance at the time of scanning. For example, the projected image generation unit 14 sets the viewpoint inside the structure 100 and sets the line-of-sight direction along the structure 100, thereby inserting the endoscope into the tube of the structure 100 and shooting the image. A fly-through image obtained by projecting the inner wall surface of the structure 100, such as an image, is obtained. By using the fly-through image that projects the inner wall surface of the structure 100, for example, when the specific part 101 such as a tumor exists on the inner wall surface of the structure 100, the user of the ultrasonic diagnostic apparatus 1 can identify the specific part 101. It can be easily confirmed that it exists along the inner wall surface.

  In addition, the projection image generation unit 14 has a function of extracting the contour of the lumen in order to easily set the viewpoint and line-of-sight direction necessary for generating the fly-through image. Extraction of the lumen contour, for example, in the three-dimensional space of volume data, the voxel existing at the boundary between the voxel value exceeding the predetermined transmission threshold and the voxel value below the transmission threshold is extracted as the contour. Is done. For example, when the structure 100 as shown in FIG. 2 exists in the three-dimensional space of the volume data, the projection image generation unit 14 extracts the inner wall surface and the outer wall surface of the structure 100 as contours. The projection image generation unit 14 recognizes the area surrounded by the outline as being inside the lumen, and sets the viewpoint at a predetermined position inside the area surrounded by the outline. Furthermore, the projection image generation unit 14 has a function of calculating the center line of the lumen based on the extracted lumen contour. For example, the lumen center line is extracted by calculating the distance between a point of interest set inside the lumen and each point of the inner wall surface within a predetermined range from the point of interest, and the distance to each point is evenly distributed. Use the position as the center point. The center point is calculated for each coordinate inside the lumen to calculate a set of center points, and the center point set is set as a center line. The calculation of the center line is not limited to the method described here. When a circular contour is detected in a predetermined section, the center coordinates of the ring are calculated as the center point, and the same center point is obtained for each section. It is possible to use various methods such as setting a set of center points as a center line. After calculating the center line, the projection image generation unit 14 sets the line-of-sight direction to a direction along the center line.

  Through the operations described above, the projection image generation unit 14 detects the contour of the structure 100, sets the viewpoint inside the structure 100, and sets the line-of-sight direction along the center line of the tube of the structure 100. To generate a fly-through image. When the projection image generation unit 14 generates a fly-through image, the projection image generation unit 14 outputs the fly-through image to the storage unit 12 and the display unit 13.

  The tomographic image generation unit 15 is a processing unit that generates a tomographic image obtained by rendering volume data. The generation of the tomographic image is performed by the following procedure, for example. First, the tomogram generation unit 15 sets the position and direction of a cross section for generating a tomogram in the three-dimensional space of volume data. Next, the tomographic image generation unit 15 extracts voxel values of voxels existing at coordinates corresponding to the cross section in the volume data based on the position and direction of the cross section. Next, the tomographic image generation unit 15 maps the extracted voxel values to the tomographic image. By performing the extraction and mapping of the voxel values for each coordinate on the cross section, the tomographic image generation unit 15 generates a tomographic image. FIG. 3 is a diagram showing a relationship between a tomogram and volume data. The tomographic image generation unit 15 arbitrarily sets a cross section for generating a tomographic image together with a region to be observed. For example, when the probe 20 is constituted by a mechanical 4D probe, the tomographic image generation unit 15 has a cross section along the direction in which the ultrasonic transducers 21 are arranged (the x direction in FIG. 2) as the A plane, and the ultrasonic transducer 21. A tomogram is generated on each plane, with the cross section along the direction in which the oscillates (y direction in FIG. 2) being the B plane and the cross section orthogonal to the A plane and the B plane being the C plane. As shown in FIG. 3, by using a plurality of tomographic images whose cross sections are changed, the user of the ultrasonic diagnostic apparatus 1 can easily grasp the three-dimensional positional relationship. When the tomographic image generation unit 15 generates a tomographic image, it outputs this to the storage unit 12 and the display unit 13.

  Further, the tomographic image generation unit 15 has a function of performing multi-view display in which tomographic images are generated for a plurality of cross sections and the generated tomographic images are displayed side by side on the display unit 13 as one aspect of tomographic image generation. FIG. 4 is a diagram showing the relationship between each cross section of the multi-view display on the A plane and the volume data. For example, the tomographic image generation unit 15 generates a tomographic image for a plurality of cross sections parallel to the reference cross section and separated from the reference cross section by a predetermined interval, using the cross section designated by the input unit 11 as a reference cross section. The tomographic image generator 15 generates a plurality of tomographic images and outputs them to the display unit 13. By displaying a plurality of tomographic images separated by a predetermined interval at a time, the user of the ultrasonic diagnostic apparatus 1 can easily grasp the three-dimensional positional relationship.

  The display unit 13 is configured by an arbitrary display such as an LCD (Lucid Crystal Display) display, an organic EL (Electro Luminescence) display, or a cathode ray tube display. The display unit 13 displays various images output from the image processing unit 15. Alternatively, display parameters when the ultrasonic image generation unit 15 displays an image, parameters when the probe 20 transmits and receives ultrasonic waves, and the like are displayed.

  The storage unit 12 is a storage medium including, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, an HDD (Hard Disk Drive), and the like. The storage unit 12 stores volume data generated by the volume data generation unit 16 or various images generated by the tomographic image generation unit 15.

  The operation unit 11 is configured by using various operation devices such as mechanical buttons, dials, trackballs, sliders, and wheels, for example, and converts the input performed by the user into an electric signal and outputs it to the system control unit 10. It is a member to do. In response to the input, for example, the operation unit 11 instructs the transmission / reception unit 17 to start / stop transmission / reception of ultrasonic waves, an instruction signal for switching the mode in which the image processing unit 15 generates an image, and a fly-through image described later. Various instruction signals such as an instruction signal for operating display coordinates and display direction in the display, and an instruction signal for moving or selecting a reference cross section in multi-view display are output.

(Flow of multi-view display)
Based on the components described above, the ultrasound diagnostic apparatus 1 performs display of a fly-through image and multi-view display. FIG. 5 is a flowchart showing the flow of processing of the ultrasonic diagnostic apparatus 1 when performing fly-through image display and multi-view display. The processing flow will be described below with reference to FIG.

  First, when the user of the ultrasonic diagnostic apparatus 1 starts diagnosis (step 2000), the control unit 10 scans with the ultrasonic probe 20 and collects volume data of the subject (step 2001). The volume data of the subject is collected by causing the transmitting / receiving unit 17 to transmit ultrasonic waves to the ultrasonic transducer 21 in a state where the ultrasonic transmission / reception direction of the ultrasonic transducer 21 and the diagnosis site of the subject are matched. Collect echo signals. Then, the B-mode processing unit 18 or the Doppler processing unit 19 performs signal processing on the echo signal, and the volume data generation unit 16 generates volume data based on the echo signal subjected to the signal processing. In this embodiment, it is assumed that the tubular structure 100 and the specific portion 101 exist on the inner wall surface of the structure 100 in the scan range, as shown in FIG. In the present embodiment, the case where volume data is generated based on an echo signal that has been subjected to signal processing by the B-mode processing unit 18 will be described. However, signal processing by the Doppler processing unit 19 and other arbitrary processing are described. The volume data may be generated based on the echo signal subjected to the signal processing. In the present embodiment, the description will be made assuming that the volume data generation unit 16 generates volume data over the entire scan range of the ultrasonic transducer 21. However, the generation range of the volume data is not limited to this. For example, in order to improve the processing speed, the input unit 11 specifies a part of the scan range and the volume data generation unit 16 is in the specified area. The volume data may be collected.

  When the volume data generating unit 16 generates volume data, the tomographic image generating unit 15 generates, for example, A, B, and C plane tomographic images passing through the center of the volume data, and displays them on the display unit 13 (step 2002). ). When the tomographic image generation unit 15 displays each tomographic image on the display unit 13, the projection image generation unit 14 extracts the contour of the structure 100 included in the volume data (step 2003). If the projection image generation unit 14 cannot extract the contour because the luminal structure is not included in the scan range, the display unit 13 indicates that the contour cannot be extracted. You may perform the operation | movement which displays an error message and complete | finishes a process.

  When the contour extraction of the structure 100 is performed, the projection image generation unit 14 waits for the setting of the viewpoint, line-of-sight direction, and display direction of the fly-through image by the input unit 11 (step 2004). FIG. 6 is a diagram illustrating a screen display example on the display unit 13 when setting the viewpoint, the line-of-sight direction, and the display direction. The projection image generation unit 14 sets initial values of the viewpoint, the line-of-sight direction, and the display direction based on the lumen contour and the center line extracted in step 2003. For example, the projection image generation unit 14 sets the viewpoint at a predetermined point on the center line, sets the viewing direction as the direction along the center line, and the display direction is the depth direction of the volume data (z direction in FIG. 2). Set the initial value so that it is upward. When the projection image generation unit 14 sets the initial values of the viewpoint, the line-of-sight direction, and the display direction, the projection image generation unit 14 generates a fly-through image based on these initial values, and displays the fly-by images along with the tomographic images displayed on the display unit 13. Display a through image. The display unit 13 displays a fly-through image, and displays a marker 200 indicating a viewpoint, a line-of-sight direction, and a display direction in each tomographic image. The marker 200 is represented, for example, by superimposing and displaying an arrow indicating the viewing direction and the display direction on a sphere representing the viewpoint. The shape of the marker 200 is not limited to this. For example, the marker 200 represents the viewpoint, the line-of-sight direction, and the display direction using a quadrangular pyramid with the viewpoint as the center and the line-of-sight direction as the apex, or any other display method. It does not matter. The user uses the input unit 11 to move the marker 200 displayed in each tomographic image of the display unit 13 or the cross section for generating each tomographic image, and changes the viewpoint, the line-of-sight direction, and the display direction from the initial values. To do. The projection image generation unit 14 regenerates the fly-through image and displays it on the display unit 13 in accordance with the change of the viewpoint, the line-of-sight direction, and the display direction.

  When the marker 200 or the cross section is moved using the input unit 11, the projection image generation unit 14 controls the movement of the marker 200 and the cross section so as to move the viewpoint along the center line of the structure 100. When the projection image generation unit 14 moves the viewpoint along the center line, the displayed fly-through image moves along the tube constituting the structure 100. Accordingly, the user can observe the entire inner wall surface from the start point to the end point of the lumen, and can easily find the specific portion 101 distributed on the inner wall surface. The user sets a viewpoint, a line-of-sight direction, and a display direction at a position where the specific part 101 is displayed in the fly-through image.

  When the viewpoint, line-of-sight direction, and display direction are set by the input unit 11, the input unit 11 waits for the user to set the point of interest 201 (step 2005). FIG. 7 is a diagram illustrating a screen display example in the display unit 13 when the interest point 201 is set. The user uses the input unit 11 to set the point of interest 201 on the specific part 101 displayed in the fly-through image. The interest point 201 is displayed, for example, by a cross-shaped figure. Note that the shape of the point of interest 201 is not limited to this, and may be represented by an arbitrary display method such as a circular figure.

  When the point of interest 201 is set by the input unit 11, the projection image generation unit 14 calculates which coordinate in the three-dimensional space of the volume data is the set point of interest 201. The calculation of the coordinates of the point of interest 201 is performed, for example, by the projection image generation unit 14 calculating the coordinates of the voxel that projects the pixel in which the point of interest 201 is set. When the projection image generation unit 14 calculates the coordinates of the point of interest 201, the tomographic image generation unit 15 sets the positions and directions of the three cross sections corresponding to the calculated coordinates, generates a tomographic image for each cross section, The tomographic images are displayed side by side on the display unit 13 (step 2006). FIG. 8 is a diagram illustrating a screen display example on the display unit 13 of each generated tomographic image. Specifically, the three cross sections are set as follows. The first cross section (hereinafter simply referred to as the D plane) includes the point of interest 201 and is set as a cross section in a direction parallel to the fly-through image projection plane. Note that the direction of the D plane is not limited to this, and for example, a cross section that passes through the point of interest 201 and one center line closest to the point of interest 201 may be used as the direction of the D plane. The second cross section (hereinafter simply referred to as the E plane) includes any point of the interest point 201 and the center line, and is orthogonal to the inner wall surface of the structure 100 at the coordinates where the interest point 201 is set. Set as a cross-section in the direction. The third cross section (hereinafter simply referred to as the F plane) includes any point of the center line and is set as a cross section in a direction orthogonal to the first cross section and the second cross section. When the position and direction of the three cross sections are set, the tomographic image generation unit 15 displays the guidelines 210, 211, and 212 indicating the position and direction of the cross section on the fly-through image displayed on the display unit 13. The guide lines 210, 211, and 212 are displayed as lines along the inner wall surface of the structure 100, for example, as shown in FIG.

  When the tomographic image generation unit 15 generates and displays the tomographic images on the D, E, and F planes, the input unit 11 waits for selection of the position and direction of the reference cross section in the multi-view display (step 2007). For the selection of the position and direction of the reference cross section, specifically, the user selects one of the displayed tomographic images of the D, E, and F planes using the input unit 11, or a fly-through image. This is performed by selecting any of the guideline 210, 211, 212 displayed above.

  When any one of the tomographic images or any of the guide lines 210, 211, and 212 is selected by the input unit 11, the tomographic image generation unit 15 selects the cross-section corresponding to the selected tomographic image or the guide lines 210, 211, and 212. Set as reference section. When the tomographic image generation unit 15 sets the reference cross section, the tomographic image generation unit 15 sets a plurality of cross sections separated by a predetermined distance from the reference cross section. When the tomographic image generation unit 15 sets a plurality of cross sections, it generates a tomographic image for each cross section, and performs multi-view display in which the generated tomographic images are arranged and displayed on the display unit 13 (step 2008). FIG. 9 is a diagram illustrating a screen display example of the display unit 13 in the multi-view display when the tomographic image on the D plane in FIG. 8 or the guideline 210 is selected. The tomographic image generation unit 15 displays a plurality of tomographic images side by side on the display unit 13, and the projection image generation unit 14 displays a fly-through image on, for example, the upper part of the arranged tomographic images, and further guideline in the fly-through image. 210, 211, 212, and a guideline 220 indicating the position of each cross section of the multi-view display are superimposed and displayed. The projected image generation unit 14 highlights an area in which the guideline 210, 211, 212 and the guideline 220 are overlapped and displayed by increasing the thickness of the line of the guideline 210, 211, 212, or the like. In addition to the fly-through image, the tomographic image generation unit 15 displays the E-plane and F-plane tomographic images that were not selected in step 2007, and displays the guideline 220 superimposed on the E-plane and F-plane tomographic images. It doesn't matter. By displaying the multi-view tomographic image and the fly-through image displayed by superimposing the guideline 220 side by side, the user can confirm the position of the specific part 101 by the fly-through image and display each cross-section displayed in the multi-view. The specific part 101 can be observed. Further, by displaying the guideline 220 in a superimposed manner in the fly-through image, the user can easily grasp the positional relationship between each cross-section displayed in the multi-view and the specific portion 101 in the fly-through image.

  FIG. 10 shows the positional relationship between the structure 100, the point of interest 201, and a plurality of cross-sections displayed in multiview. In the description of step 2008, it has been described that the tomographic image generation unit 15 sets the cross section at a position separated by a predetermined distance with the reference cross section as the center. More specifically, the setting of the cross section will be described. As shown in FIG. 10A, when the position of the reference cross section is set by the point of interest 201, the tomographic image generator 15 passes through the point of interest 201 and projects the fly-through image. A cross section in a direction parallel to the surface is set as a reference cross section. When the tomographic image generation unit 15 sets the reference cross section, the tomographic image generation unit 15 sets another cross section in a direction parallel to the reference cross section and at a predetermined distance from the reference cross section. Further, the tomographic image generation unit 15 sets a plurality of cross sections at positions at different distances from the reference cross section. As a result, the tomographic image generation unit 15 sets a plurality of cross sections in a direction parallel to the reference cross section.

  In addition, the setting method of the several cross section in a present Example is not restricted to this. FIG. 10B shows another method for setting a plurality of cross sections. FIG. 10B illustrates an example in which the tomographic image generation unit 15 sets a plurality of cross sections along the center line of the structure 100. When the reference cross section is set, the tomographic image generation unit 15 sets a cross section including a position on the center line of the structure 100 that is separated from the reference cross section by a predetermined distance and perpendicular to the direction of the center line of the position. . Further, the tomographic image generation unit 15 sets a plurality of cross sections at positions where the distance on the center line is different from the reference cross section. Thereby, the tomographic image generation unit 15 can set a plurality of cross sections along the structure 100.

  FIG. 11 is a diagram illustrating a screen display example of the display unit 13 in the multi-view display when the tomographic image of the E plane or the guideline 211 is selected in step 2008. The tomographic image generation unit 15 displays a plurality of tomographic images side by side on the display unit 13, and the projection image generation unit 14 superimposes a plurality of guide lines 220 and guidelines 210, 211, and 212 along the E plane in the fly-through image. And display. The tomographic image generation unit 15 displays the tomographic images of the D plane and the F plane that have not been selected as the cross section of the multi-view display separately from the fly-through image, and the guideline 220 is displayed in the tomographic images of the D plane and the F plane. You may superimpose and display.

  When the projection image generation unit 14 and the tomographic image generation unit 15 perform multi-view display, the input unit 11 waits for resetting of the reference cross section (step 2009). FIG. 12 is a diagram illustrating a screen display example of the display unit 13 when the depth of the reference cross section is moved along the center line of the structure 100 when the D plane is set as the reference cross section for multi-view display. In FIG. 12, the multi-view tomographic image displayed side by side in the fly-through image for convenience of drawing, and the E plane and F plane on which the guideline 220 is superimposed are omitted. In the multi-view display described with reference to step 2008 and FIG. 9, the input unit 11 waits for an input for changing the reference cross section (step 2010). The input for changing the reference cross section is performed, for example, by selecting guide lines 210, 211, and 212 superimposed on the fly-through image and moving the positions of the guide lines 210, 211, and 212. For example, as shown in FIG. 12, by moving the guideline 210 to the near side, the position of the reference cross section also moves to the near side. When the reference cross section is changed (YES in step 2010), the tomographic image generation unit 15 resets the position of each cross section to be displayed in multi view, generates the tomographic image again, and performs multi view display (step 2008). ). The projection image generation unit 14 and the tomographic image generation unit 15 update and display the position of the guideline 220 superimposed and displayed in the fly-through image and the tomographic images on the E and F planes in accordance with the generation of the tomographic image. With the above operation, the user can easily reset the position of the reference cross section using the fly-through image even when the specific portion 101 is not displayed in the multi-view tomographic image. .

  FIG. 13 is a diagram illustrating a screen display example of the display unit 13 when the reference section is rotated about the center line of the structure 100 when the E plane is set as the reference section for multi-view display. By rotating the reference cross section around the center line, the reference cross section can be easily set along the inner wall surface. Although FIG. 13 shows an example in which the E plane is the reference cross section, the reference cross section may be changed by the same method for the F plane. In addition, the operation of resetting the reference cross section using the guide lines 210, 211, and 212 displayed in the fly-through image has been described. However, with respect to the tomographic image displayed in a superimposed manner on the guide line 220 displayed together with the fly-through image. Control of moving the position of each cross section of the multi-view display by moving the guideline 220 using the input unit 11 may be performed.

  When the user confirms each cross-section and fly-through image displayed in multi-view and diagnoses the structure 100 and the specific part 101, the process ends (step 2009). Through the series of processes described above, the user can confirm the position of the specific part 101 using the fly-through image, and can easily set the point of interest 201 at a position including the specific part 101. Further, based on the point of interest 201, the tomographic image generation unit 15 displays the tomographic images of the D plane, the E plane, and the F plane, and the user sets the direction of the cross section for performing the multi-view display based on these cross sections. Thus, it is possible to confirm and set the direction of the cross-section displayed in multi-view in advance.

(Display of tomographic image generation range in multi-view display)
In the previous embodiment, the guideline 220 for displaying a plurality of lines corresponding to the tomographic image in the fly-through image or the tomographic image is superimposed and displayed to indicate the position of each cross section of the tomographic image displayed in multi-view. Stated. However, the method of indicating the position of each cross section is not limited to this.

  FIG. 14 is a diagram showing another screen display example of the display unit 13 showing the distribution of the cross section of the tomographic image displayed in multi-view. In FIG. 14, the guide lines 211 and 212 are not shown for easy understanding. When the reference section is set by the input unit 11 in step 2007, the tomographic image generation unit 15 sets the positions of a plurality of sections on which multi-view display is performed based on the reference section. When the tomographic image generation unit 15 sets the positions of a plurality of cross sections, the cross sectional positions at both ends are output to the projection image generation unit 14. Based on the cross sections at both ends, the projection image generation unit 14 displays a guideline 230 indicating the distribution of the cross sections of the tomographic images displayed in multiview. Specifically, the guideline 230 is configured by a figure that displays the colored inner wall surface of the structure 100 sandwiched between the cross sections at both ends. By visually recognizing the guideline 230, the user can easily visually recognize the distribution of the cross-section of the tomographic image displayed in multi-view.

  FIG. 15 is a diagram illustrating another screen display example of the display unit 13 that indicates a position corresponding to the number of tomographic images in the tomographic image displayed in multi-view on the D plane. . In FIG. 15, the guide lines 211 and 212 are not shown for easy understanding. When the reference section is set by the input unit 11 in step 2007, the tomographic image generation unit 15 sets the positions of a plurality of sections on which multi-view display is performed based on the reference section. The tomographic image generation unit 15 performs multi-view display, and the projection image generation unit 14 superimposes the guideline 210 indicating the position of the reference cross section and the guideline 220 indicating the positions of the plurality of cross sections displayed in the multi-view display in the fly-through image. indicate. Then, in addition to the guidelines, the projection image generation unit 14 displays an indicator 240 indicating the number of cross sections among the cross sections displayed in the multi-view display. The indicator 240 is displayed, for example, as a straight line displayed on the upper left side of the fly-through image so as to make the images appear to overlap. For example, in the display example shown in FIG. 15, the indicator 240 is displayed, so that the user can visually recognize as if four fly-through images are overlapped. With this indicator 240, the user can easily visually recognize that the displayed reference cross section corresponds to the position of the fourth of the plurality of cross sections.

  FIG. 16 is a diagram illustrating another screen display example of the display unit 13 that displays a tomographic image at the display position of the reference cross section as a background of the fly-through image among the tomographic images displayed in multi-view on the D plane. In FIG. 16, the guide lines 211 and 212 are not shown for easy understanding. When the reference section is set by the input unit 11 in step 2007, the tomographic image generation unit 15 sets the positions of a plurality of sections on which multi-view display is performed based on the reference section. When the tomographic image generation unit 15 sets the position of each cross section, the tomographic image generation unit 15 performs multi-view display and outputs the tomographic image at the reference cross section to the projection image generation unit 14. The projection image generation unit 14 superimposes and displays the tomographic image on the reference cross section as the background of the structure 100 displayed in the fly-through image. The user can easily grasp the position of the reference cross section within the scan range by confirming the tomographic image superimposed and displayed.

  According to the above embodiment, the ultrasound diagnostic apparatus 1 sets the position and direction of each cross section of the multi-view display by setting the interest point 201 in the fly-through image. Thereby, the position of the specific part 101 distributed on the inner wall surface of the structure 100 can be grasped, and the position of each cross section can be easily set so that the specific part 101 is included in the cross section of the multi-view display.

  Further, according to the above embodiment, the ultrasonic diagnostic apparatus 1 displays the guide lines 210, 211, and 212 in the fly-through image, and displays the tomographic images having the D plane, the E plane, and the F plane as cross sections. By selecting the guidelines 210, 211, and 212 and each tomographic image, the direction of the cross section in the multi-view display is set. Accordingly, it is possible to confirm in advance that the specific portion 101 is distributed on the cross-section displayed in the multi-view, and to set the direction of the cross-section that is easy for diagnosis.

  Further, according to the above embodiment, the ultrasonic diagnostic apparatus 1 displays the guideline 220 indicating the position of each cross-section displayed in a multi-view manner so as to be superimposed on the fly-through image. Thereby, it is possible to easily grasp how each cross section is located in the fly-through image in which the position of the specific part 101 is easily grasped.

Although several embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Ultrasonic diagnostic apparatus 10 System control part 11 Input part 12 Storage part 13 Display part 14 Projection image generation part 15 Tomographic image generation part 16 Volume data generation part 17 Transmission / reception part 18 B mode processing part 19 Doppler processing part 20 Ultrasonic probe 21 Ultrasonic vibrator 100 Structure 101 Specific site 200 Marker 201 Interest point 210 Guideline 211 Guideline 212 Guideline 220 Guideline 230 Indicator

Claims (5)

A probe that transmits and receives ultrasonic waves;
Volume data generating means for generating three-dimensional volume data based on ultrasonic waves received by the probe;
Fly-through image generating means for generating a fly-through image in which the volume data is projected from a viewpoint set inside a lumen structure included in the volume data;
Input means for inputting a point of interest based on the fly-through image;
A tomogram that generates a first tomogram in a first section corresponding to the point of interest and a second tomogram in a second section that is a predetermined distance away from the first section based on the volume data. Image generating means;
An ultrasonic diagnostic apparatus comprising: display means for displaying the first tomographic image and the second tomographic image. The display means displays the fly-through image in addition to the first tomographic image and the second tomographic image,
The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit displays a guideline indicating a position of the first cross section and the second cross section in the fly-through image. The input means inputs a point of interest to the surface of the luminal structure displayed on the fly-through image,
The tomographic image generation means sets the first cross section in a direction corresponding to the point of interest and orthogonal to the surface of the lumen structure at a position where the point of interest is input. Item 3. The ultrasonic diagnostic apparatus according to Item 2. Generating a fly-through image in which the volume data is projected from a viewpoint arranged inside a lumen structure included in the three-dimensional volume data;
Setting a point of interest based on the fly-through image;
Generating a first tomogram in a first cross section corresponding to the point of interest in the volume data;
Generating a second tomographic image in a second cross section at a predetermined distance from the first cross section; and a control program for an ultrasonic diagnostic apparatus. Projection image generating means for generating a fly-through image obtained by projecting the volume data from a viewpoint set inside a lumen structure included in the three-dimensional volume data;
Interest point setting means for setting an interest point based on the fly-through image;
A tomographic image for generating a first tomographic image at a first cross section corresponding to the point of interest and a second tomographic image at a second cross section separated from the first cross section by a predetermined distance in the volume data. And an image processing apparatus.

Images