JP2011083490A - Ultrasonic diagnostic system, image data forming device, and image data forming control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To form a single image stereogram on the basis of depth texture. <P>SOLUTION: When rendering image data is formed on the basis of volume data collected by the ultrasonic three-dimensional scanning to the observation region of a subject, the image quality adjusting unit 63 of an image data forming unit 6 adjusts the image quality of the two-dimensional depth texture of a Z-buffer 612, which is obtained in the process for forming the rendering image data by a rendering image data forming unit 61, on the basis of the suitable transmission function selected from various transmission functions of a transmission function storage unit 62 to form a depth map and a stereogram forming unit 64 forms the single image stereogram on the basis of the depth map. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an ultrasonic diagnostic apparatus, an image data generation apparatus, and an image data generation control program, and more particularly to an ultrasonic diagnostic apparatus and image data for generating a single image stereogram based on volume data collected from a subject. The present invention relates to a generation device and an image data generation control program.

  The ultrasonic diagnostic apparatus radiates an ultrasonic wave generated from a vibration element provided in an ultrasonic probe into a subject, receives a reflected wave caused by a difference in acoustic impedance of a subject tissue, and receives biological information by the vibration element. Since ultrasonic image data can be displayed in real time with a simple operation by simply bringing an ultrasonic probe into contact with the body surface, it is widely used for morphological diagnosis and functional diagnosis of various organs.

  In particular, in recent years, three-dimensional data of a subject (by a method of mechanically moving an ultrasonic probe in which a plurality of vibration elements are arranged one-dimensionally or a method using an ultrasonic probe in which a plurality of vibration elements are arranged in two dimensions ( A method for collecting volume data) has been developed, and two-dimensional MPR (Multi Planar) obtained by extracting pixels of a desired slice section in the volume data and 3D image data obtained by rendering the volume data. Reconstruction) More advanced diagnosis and treatment are possible by observing image data.

  There has already been a method for obtaining three-dimensional image data such as volume rendering image data and surface rendering image data inside a living body having a three-dimensional effect by rendering volume data collected by ultrasonic three-dimensional scanning of an observation site of a subject. Although widely used in the clinical field, these image data are projected onto a two-dimensional plane with a predetermined viewpoint and line-of-sight direction as a reference, so that these viewpoints are used for these once generated image data. New biological information cannot be obtained even if observation is performed while changing the direction of the line of sight.

  In order to solve such a problem, the right eye generated by generating image data in each of a plurality of adjacent slice cross sections set in the observation site, and synthesizing these image data by shifting each other. A method of generating a stereogram capable of true stereoscopic viewing by displaying image data and left-eye image data on a display unit in a time-sharing manner has been proposed (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 11-155861

  According to the method described in Patent Document 1 described above, the right-eye image data and the left-eye image data generated with respect to the observation site of the subject are displayed alternately so that the three-dimensional structure in the living body is stereoscopically displayed. High-performance image data composition that generates right-eye image data and left-eye image data by combining multiple image data in a short time while updating the amount of deviation between image data And special display means for displaying the right eye image data and the left eye image data obtained by the image data synthesizing means in a time-sharing manner are newly required.

  The present invention has been made in view of such conventional problems, and its purpose is to generate a single-image stereogram based on a depth texture of volume data collected from a subject, thereby generating an in vivo image. An object of the present invention is to provide an ultrasonic diagnostic apparatus, an image data generation apparatus, and an image data generation control program capable of easily performing three-dimensional observation.

  In order to solve the above problems, an ultrasonic diagnostic apparatus according to the present invention according to claim 1 is an ultrasonic diagnostic apparatus that generates rendering image data based on volume data collected by ultrasonic three-dimensional scanning of a subject. A Z-buffer that generates a two-dimensional depth texture based on three-dimensional depth information of the volume data necessary for generating the rendered image data, and the depth texture or the depth texture and the depth based on the rendered image data. A depth map generating means for generating a map, a stereogram generating means for generating a single image stereogram based on the depth map, and a display means for displaying the generated single image stereogram. Yes.

  According to a tenth aspect of the present invention, there is provided an image data generation apparatus according to the present invention, wherein the image data generation apparatus generates rendering image data based on volume data collected in advance from a subject, and the image data generation apparatus is necessary for generating the rendering image data. A Z buffer that generates a two-dimensional depth texture based on three-dimensional depth information of volume data, and a depth map generation means that generates a depth map based on the depth texture or the depth texture and the rendered image data; A stereogram generating means for generating a single image stereogram based on the depth map and a display means for displaying the generated single image stereogram are provided.

  On the other hand, the control program for image data generation of the present invention according to claim 13 provides the rendering image data to an ultrasonic diagnostic apparatus or an image data generation apparatus that generates rendering image data based on volume data collected from a subject. A depth texture generation function for generating a two-dimensional depth texture based on the three-dimensional depth information of the volume data necessary for generating the depth data, and a depth map based on the depth texture or the depth texture and the rendering image data. It has a depth map generation function to be generated, a stereogram generation function to generate a single image stereogram based on the depth map, and a display function to display the generated single image stereogram.

  According to the present invention, in-vivo stereoscopic observation can be easily performed by generating a single image stereogram based on the depth texture of volume data collected from a subject. Further, since it can be stored in paper or a general image file, a stereoscopic image of a fetus or the like can be easily provided.

1 is a block diagram showing the overall configuration of an ultrasonic diagnostic apparatus according to a first embodiment of the present invention. The block diagram which shows the specific structure of the transmission / reception part and reception signal processing part with which the ultrasonic diagnosing device of the Example is provided. The figure for demonstrating the ultrasonic transmission / reception direction in the three-dimensional scanning of the Example. The figure which shows the specific calculation method of the rendering process in the Example. The figure which shows the specific example of the transfer function used for the image quality adjustment of a depth texture in the Example. The figure for demonstrating the production | generation method of the single image stereogram in the Example. The flowchart which shows the production | generation / display procedure of the single image stereogram in the Example. The block diagram which shows the whole structure of the ultrasound diagnosing device in the modification of the Example. The flowchart which shows the production | generation / display procedure of the single image stereogram in the modification. The block diagram which shows the whole structure of the image data generation apparatus in 2nd Example of this invention. The block diagram which shows the whole structure of the image data generation apparatus in the modification of the Example.

  Embodiments of the present invention will be described below with reference to the drawings.

  In the ultrasonic diagnostic apparatus according to the first embodiment of the present invention, when rendering image data is generated based on volume data collected from a three-dimensional region including an observation site such as a fetus of the subject, the process A desired depth map is generated by adjusting the image quality of the depth texture obtained in step (b) based on a predetermined transfer function, and a single image stereogram is generated using the depth map.

  In the following embodiments, a case where a three-dimensional scan is performed on the observation site of the subject using an ultrasonic probe in which a plurality of vibration elements are two-dimensionally arranged will be described. A three-dimensional scan may be performed on the observation site by mechanically moving the ultrasonic probe. Also, a case will be described in which reception signals obtained from a subject are processed to generate B-mode data as ultrasound data, and volume data is generated based on the B-mode data. However, the present invention is not limited to this. The volume data may be generated based on other ultrasonic data such as color Doppler data.

(Device configuration and functions)
The configuration and functions of the ultrasonic diagnostic apparatus according to this embodiment will be described with reference to FIGS. FIG. 1 is a block diagram showing an overall configuration of the ultrasonic diagnostic apparatus, and FIG. 2 is a block diagram showing a specific configuration of a transmission / reception unit and a received signal processing unit included in the ultrasonic diagnostic apparatus.

  The ultrasonic diagnostic apparatus 100 shown in FIG. 1 transmits an ultrasonic pulse (transmitted ultrasonic wave) to a three-dimensional region including an observation site of a subject, and an ultrasonic reflected wave (received ultrasonic wave) obtained by this transmission. ) Is converted into an electric signal (received signal), and an ultrasonic probe 3 in which a plurality of vibration elements are two-dimensionally arranged, and a drive signal for transmitting an ultrasonic pulse in a predetermined direction of the subject are vibrated. A transmission / reception unit 2 that supplies to the elements and performs phased addition of the reception signals of a plurality of channels obtained from these vibration elements, and a reception signal processing unit 4 that generates the B-mode data by processing the reception signals after phased addition And a volume data generation unit 5 that generates volume data by arranging the B-mode data obtained by the above-described three-dimensional scanning with ultrasonic waves in correspondence with the ultrasonic transmission / reception direction.

  The ultrasonic diagnostic apparatus 100 also processes the volume data described above to generate rendering image data and a single image stereogram, a display unit 7 for displaying these image data, and subject information. Input, volume data generation conditions, image data generation conditions and image data display conditions, setting of viewpoints for volume data, selection of transfer functions suitable for adjusting the image quality of depth texture described later, and input of various command signals And a system control unit 9 that performs overall control of the above-described units to generate and display rendering image data and single image stereograms.

  The ultrasonic probe 3 has a plurality (M) of vibration elements (not shown) arranged two-dimensionally at its tip, and transmits and receives ultrasonic waves by bringing the tip into contact with the body surface of the subject. The vibration element is an electroacoustic transducer that converts electrical pulses (driving signals) into ultrasonic pulses (transmitting ultrasonic waves) during transmission, and converts ultrasonic reflected waves (receiving ultrasonic waves) into electrical reception signals during reception. It has a function to do. Each of these vibration elements is connected to the transmission / reception unit 2 via an M channel multi-core cable (not shown). In this embodiment, an ultrasonic diagnostic apparatus 100 using the ultrasonic scanning probe 3 for sector scanning in which M vibration elements are two-dimensionally arranged will be described. However, an ultrasonic probe corresponding to linear scanning, convex scanning, or the like is described. May be used.

  Next, the transmission / reception unit 2 illustrated in FIG. 2 includes a transmission unit 21 that supplies a drive signal to the vibration element of the ultrasonic probe 3 and a phasing addition (phase matching) to the reception signal obtained from the vibration element. And a receiver 22 for performing addition synthesis.

  The transmission unit 21 includes a rate pulse generator 211, a transmission delay circuit 212, and a drive circuit 213. The rate pulse generator 211 generates a rate pulse that determines the repetition period of the transmission ultrasonic wave and supplies the generated rate pulse to the transmission delay circuit 212. To do. The transmission delay circuit 212 is composed of the same number of independent delay circuits as the Mt number of vibration elements used for transmission. The transmission delay circuit 212 has a focusing delay time and a predetermined delay time for focusing the transmission ultrasonic wave to a predetermined depth in the imaging region. A deflection delay time for transmitting in the direction (θp, φq) is given to the rate pulse and supplied to the drive circuit 213. The drive circuit 213 has the same number of independent drive circuits as the transmission delay circuit 212, and Mt pieces of Mt elements selected for transmission from the M vibration elements arranged two-dimensionally by the ultrasonic probe 3. The vibration element is driven to transmit transmission ultrasonic waves into the body of the subject.

  On the other hand, the reception unit 22 includes an A / D converter 221 and a reception delay circuit for the Mr channel corresponding to the Mr vibration elements selected for reception among the M vibration elements incorporated in the ultrasonic probe 3. 222 and an adder 223. The Mr channel reception signal supplied from the receiving vibration element is converted into a digital signal by the A / D converter 221 and sent to the reception delay circuit 222.

  The reception delay circuit 222 has a focusing delay time for focusing the received ultrasonic wave reflected at a predetermined depth in the imaging region and a deflection for setting the reception directivity with respect to a predetermined direction (θp, φq). The delay time is provided to each of the Mr channel reception signals output from the A / D converter 221, and the adder 223 adds the reception signals from the reception delay circuit 222. That is, the reception delay circuit 222 and the adder 223 perform phasing addition on the reception signal obtained from a predetermined direction. In addition, the reception delay circuit 222 and the adder 223 of the reception unit 22 enable so-called parallel simultaneous reception in which reception directivities in a plurality of directions are simultaneously formed by controlling the delay time, and three-dimensional scanning can be performed by applying parallel simultaneous reception. The time required is greatly reduced. A part of the transmission unit 21 and the reception unit 22 included in the transmission / reception unit 2 may be provided inside the ultrasonic probe 3.

  FIG. 3 shows the ultrasonic transmission / reception direction (θp, φq) in orthogonal coordinates (xyz) with the central axis of the ultrasonic probe 3 as the z axis. Arranged two-dimensionally in the axial direction, θp and φq indicate angles with respect to the z-axis in the ultrasonic transmission / reception direction projected on the xz plane and the yz plane. Then, the delay times in the transmission delay circuit 212 of the transmission unit 21 and the reception delay circuit 222 of the reception unit 22 are controlled in accordance with the scanning control signal supplied from the system control unit 9, and ultrasonic scanning is performed on the three-dimensional region in the subject. Done.

  Returning to FIG. 2, the reception signal processing unit 4 has a function of generating B-mode data as ultrasonic data, and includes an envelope detector 41 and a logarithmic converter 42. The envelope detector 41 envelope-detects the reception signal after the phasing addition supplied from the adder 223 of the receiving unit 22, and the logarithmic converter 42 logarithmically converts the amplitude of the reception signal subjected to the envelope detection. To generate B-mode data. Note that the envelope detector 41 and the logarithmic converter 42 may be configured by changing the order.

  Next, the volume data generation unit 5 illustrated in FIG. 1 includes, for example, an ultrasonic data storage unit, an interpolation processing unit, and a volume data storage unit that are not illustrated. In the ultrasonic data storage unit, the B-mode data generated by the reception signal processing unit 4 based on the reception signal obtained by the three-dimensional scanning on the subject includes the ultrasonic transmission / reception direction (θp, φq). Are stored sequentially.

  On the other hand, the interpolation processing unit forms the three-dimensional B-mode data by arranging the B-mode data read from the ultrasonic data storage unit in correspondence with the ultrasonic transmission / reception direction (θp, φq). Volume data is generated by interpolating the three-dimensional B-mode data. The obtained volume data is stored in the volume data storage unit.

  On the other hand, the image data generation unit 6 renders the volume data of the subject stored in the volume data storage unit of the volume data generation unit 5 to perform volume rendering image data or surface rendering image data (hereinafter, these are collected together). Rendering image data generating unit 61 for generating image data), a transfer function storing unit 62 for storing various transfer functions used for image quality adjustment of a depth map, which will be described later, and the rendering image data An image quality adjustment unit 63 that generates a depth map by adjusting the image quality of a two-dimensional depth texture obtained in the generation process using a suitable transfer function selected from the plurality of transfer functions; A single image stereogram based on a depth map And a stereogram generator 64.

  The rendering image data generation unit 61 stores a three-dimensional luminance distribution data generated by performing coordinate conversion on the voxels of the volume data with reference to a viewpoint set by the input unit 8 to be described later with respect to the volume data. The buffer 611 and the three-dimensional position information (depth information) of the voxel of the volume data based on the above viewpoint are stored, and a two-dimensional depth texture having brightness corresponding to the depth information is generated. And a rendering processing unit 613 that processes the volume data based on the three-dimensional luminance information and depth information to generate rendering image data.

In this case, the rendering processing by the rendering processing unit 613 is performed by a cumulative operation from the deep part to the shallow part along the visual line direction Vd with the viewpoint Vp as a reference, as shown in FIG. If the brightness and opacity of the adjacent n-th voxel Qn are Bn and An, and the cumulative brightness and opacity from the deep part to the (n + 1) -th voxel Qn + 1 are [B] n + 1 and [A] n + 1, the voxel Qn The cumulative luminance [B] n and the cumulative opacity [A] n at are calculated based on the following equation (1).

  Returning to FIG. 1, the image quality adjustment unit 63 observes a desired observation site indicated by the two-dimensional depth texture supplied from the Z buffer 612 of the rendering image data generation unit 61 with high contrast resolution or spatial resolution. Therefore, the pixels of the depth texture are converted based on the transfer function supplied from the transfer function storage unit 62. FIG. 5 shows the specific characteristics of the transfer function supplied from the transfer function storage unit 62. By converting the pixel value of the depth texture based on this transfer function (image quality adjustment), The gradation property (gray level) and γ characteristic of the depth map are determined.

  That is, when the depth map is generated by adjusting the image quality of the above-described depth texture using a transfer function as shown in FIG. 5, the lower limit value Pmin and the upper limit value Pmax of the pixel values that can be displayed on the display unit 7 are the transfer function. Γ characteristics are determined by the shape of the transfer function. Note that Imin and Imax shown on the horizontal axis in FIG. 5 are the minimum pixel value and maximum pixel value of the depth texture, and Omin and Omax shown on the vertical axis are the depth maps generated by the image quality adjustment described above. The minimum pixel value and the maximum pixel value are shown.

  When a transfer function suitable for generating a depth map of the subject is selected from various transfer functions stored in advance in the transfer function storage unit 62 as a lookup table or a function, the image quality adjustment unit 63 The transfer function stored in the storage unit 62 is sequentially read, and the depth map generated by converting the pixel value of the depth texture supplied from the Z buffer 612 based on the transfer function is supplied to the display unit 7. Then, the operator observes the depth maps sequentially displayed on the display unit 7 as the transfer function is updated, and designates a suitable depth map from these depth maps by using the input unit 8. Is selected.

  On the other hand, the stereogram generation unit 64 temporarily stores the depth map supplied from the image quality adjustment unit 63, and the pixel of the tile image previously selected as the expression texture based on the pixel value of the depth map. An arithmetic map (not shown) having an arithmetic function for generating a single image stereogram by shifting is provided.

  Next, a method of generating a single image stereogram performed in the stereogram generation unit 64 will be described with reference to FIG. 6A shows, for example, the depth map Dm formed for the observation site indicating the shape of the sphere and stored in the above-described depth map storage unit, and FIG. 6B shows the depth map Dm and the tile image. FIG. 2 schematically shows a calculation map Cm for generating a single image stereogram based on the above, and a case where the depth map Dm is divided into four in the horizontal direction (x direction) will be described in order to simplify the description. The division method and the number of divisions are not limited to the above.

  That is, the depth map Dm shown in FIG. 6A is composed of four sub-depth maps Dm1 to Dm4 having a lateral width Δd, and the calculation map Cm shown in FIG. 6B is the sub-depth maps Dm1 to Dm4 described above. And four sub-calculation maps Cm1 to Cm4 having a horizontal width Δd and four tile images Tg01 to Tg04 adjacent to the sub-calculation map Cm1 and arranged in the vertical direction (y direction). Has been.

  When generating the stereogram, first, the tile images Tg01 to Tg04 and the sub-depth map Dm1 of the sub-operation map Cm0 are supplied to the sub-operation map Cm1, and each of the pixels constituting the tile images Tg01 to Tg04 corresponds to this pixel. New tile images Tg11 to Tg14 are generated by shifting in the x direction based on the pixel values of the pixels of the sub-depth map Dm1.

  Next, the tile images Tg11 to Tg14 and the sub-depth map Dm2 obtained by the above-described procedure are supplied to the sub-calculation map Cm2, and each of the pixels constituting the tile images Tg11 to Tg14 is assigned to the sub-depth map Dm2. The tile images Tg21 to Tg24 are generated by shifting in the x direction based on the pixel values of the pixels. Hereinafter, similarly, tile images Tg31 to Tg34 are generated based on the tile images Tg21 to Tg24 and the sub-depth map Dm3, and tile images Tg41 to Tg44 are generated based on the tile images Tg31 to Tg34 and the sub-depth map Dm4. Then, a single image stereogram is generated by synthesizing the tile images Tgp1 to Tgp4 (p = 1 to 4) generated in the sub-operation maps Cm1 to Cm4.

  Returning to FIG. 1, the display unit 7 includes a display data generation unit 71, a monitor 72, and a printer 73. In the rendering image data generated by the rendering image data generation unit 61 of the image data generation unit 6 and the image quality adjustment unit 63. The generated depth map and the single image stereogram generated by the stereogram generating unit 64 are displayed.

  For example, when a transfer function suitable for generation of the depth map is selected from the various transfer functions stored in the transfer function storage unit 62, the depth map generated based on the various transfer functions is displayed from the image quality adjustment unit 63. The display data generation unit 71 supplies the data to the data generation unit 71 and performs a conversion process such as display format conversion and D / A conversion on the supplied depth map and displays it on the monitor 72.

  When displaying the single image stereogram, the single image stereogram generated by the stereogram generation unit 64 and the rendering image data generated by the rendering image data generation unit 61 are supplied to the display data generation unit 71, and display data is displayed. The generating unit 71 generates display data by combining these image data based on preset image data display conditions. The obtained display data is converted and displayed on the monitor 72, and further output to the printer 73 as necessary.

  Next, the input unit 8 includes an input device such as a display panel, a keyboard, a trackball, a mouse, a selection button, and an input button on the operation panel, and a viewpoint setting function 81 for setting a viewpoint for volume data and a depth texture. A transfer function selection function 82 for selecting a transfer function suitable for image quality adjustment. In addition, input of subject information, selection of tile images, volume data generation conditions, rendering image data generation conditions and single image stereogram generation conditions, image data display conditions, and input of various command signals, etc. This is performed using the display panel or the input device described above.

  The system control unit 9 includes a CPU and a storage circuit (not shown), and the above-described various information input / set / selected by the input unit 8 is stored in the storage circuit. The CPU collects volume data of the subject by comprehensively controlling each unit of the ultrasonic diagnostic apparatus 100 based on the input information, setting information, and selection information described above, and further obtained. Based on the volume data, rendering image data and single image stereogram are generated and displayed.

(Single image stereogram generation / display procedure)
Next, a single image stereogram generation / display procedure in this embodiment will be described with reference to the flowchart of FIG. In the following, the case of generating volume data based on B-mode data will be described, but the present invention is not limited to this.

  Prior to the collection of volume data, the operator of the ultrasonic diagnostic apparatus 100 inputs subject information at the input unit 8 and then sets volume data generation conditions, rendering image data generation conditions, and single image stereogram generation conditions. Then, setting of image data display conditions, selection of tile images, etc. are performed. These input information, setting information, and selection information are stored in a storage circuit included in the system control unit 9 (step S1 in FIG. 7).

  When the above initial setting is completed, the operator inputs a volume data generation start command at the input unit 8 (step S2 in FIG. 7), and this command signal is supplied to the system control unit 9 to Collection of volume data in a three-dimensional region centered on the observation site of the subject is started.

  Upon collecting the volume data, the system control unit 9 that has received the above-described volume data generation start command sets the volume data generation conditions set in advance for the transmission delay circuit 212 of the transmission unit 21 and the reception delay circuit 222 of the reception unit 22. A corresponding scan control signal is supplied.

  On the other hand, the rate pulse generator 211 of the transmission unit 21 generates a rate pulse and supplies it to the transmission delay circuit 212. The transmission delay circuit 212 is based on the scanning control signal supplied from the system control unit 9, and A focusing delay time for focusing the ultrasonic wave to a predetermined depth in the region and a deflection delay time for transmitting the ultrasonic wave in the first ultrasonic transmission / reception direction (θ1, φ1) are given to the rate pulse. This is supplied to the channel drive circuit 213. Next, the drive circuit 213 generates a drive signal based on the rate pulse supplied from the transmission delay circuit 212, and supplies this drive signal to the Mt transmitting vibration elements provided in the ultrasonic probe 3 to be covered. Transmit ultrasonic waves into the specimen.

  A part of the transmitted ultrasonic wave is reflected by the organ boundary surface or tissue of the subject having different acoustic impedance, and is received by the Mr receiving vibration elements provided in the ultrasonic probe 3 to be used in the Mr channel. It is converted into an electrical reception signal. Next, the received signal is converted into a digital signal by the A / D converter 221 of the receiving unit 22, and is further used for focusing for converging received ultrasonic waves from a predetermined depth in the Mr channel reception delay circuit 222. The delay time and the deflection delay time for setting a strong reception directivity with respect to the received ultrasonic wave from the ultrasonic transmission / reception direction (θ1, φ1) are given based on the above-described scanning control signal supplied from the system control unit 9. Then, the adder 223 performs phasing addition. Then, the envelope detector 41 and the logarithmic converter 42 of the received signal processing unit 4 to which the received signal after the phasing addition is supplied perform envelope detection and logarithmic conversion on the received signal to obtain B-mode data. The generated B-mode data is stored in the ultrasonic data storage unit of the volume data generation unit 5 with the ultrasonic transmission / reception direction (θ1, φ1) as supplementary information.

  Next, the system control unit 9 controls the delay time in the transmission delay circuit 212 of the transmission unit 21 and the reception delay circuit 222 of the reception unit 22 to sequentially update the ultrasonic transmission / reception direction by Δθ in the θ direction and Δφ in the φ direction. (Θp, φq) (θp = θ1 + (p−1) Δθ (p = 1 to P), φq = φ1 + (q−1) Δφ (q = 1 to Q), provided that the ultrasonic transmission / reception direction (θ1, φ1 Except for), three-dimensional scanning is performed by transmitting and receiving ultrasonic waves in the same procedure. The B-mode data obtained in each transmission / reception direction is also stored in the ultrasonic data storage unit of the volume data generation unit 5 with the above-described ultrasonic transmission / reception direction as supplementary information.

  When the generation and storage of the B-mode data in the predetermined three-dimensional region is completed, the interpolation processing unit of the volume data generation unit 5 transmits the plurality of B-mode data read from the ultrasonic data storage unit to the ultrasonic transmission / reception direction (θp , [Phi] q) ([theta] p = [theta] 1+ (p-1) [Delta] [theta] (p = 1 to P), [phi] q = [phi] 1+ (q-1) [Delta] [phi] (q = 1 to Q)). Data is formed, and further, interpolation processing is performed on the pixels constituting the three-dimensional B-mode data to generate volume data. The obtained volume data is stored in a volume data storage unit provided in the volume data generation unit 5 (step S3 in FIG. 7).

  Next, the viewpoint setting function 81 of the input unit 8 sets the viewpoint and line-of-sight direction for the volume data generated at this time, and the frame buffer 611 provided in the rendering image data generation unit 61 of the image data generation unit 6 Then, three-dimensional luminance distribution data is generated by performing coordinate conversion on the voxels of the volume data with reference to the set viewpoint, and the obtained luminance distribution data is stored in its own storage circuit.

  On the other hand, the Z buffer 612 of the rendering image data generation unit 61 calculates the three-dimensional depth information of the voxel of the volume data based on the viewpoint described above, and stores the obtained depth information in its own storage circuit. At the same time, a two-dimensional depth texture having brightness corresponding to these depth information is generated. Then, the obtained depth texture is supplied to the image quality adjustment unit 63 of the image data generation unit 6 (step S4 in FIG. 7).

  The image quality adjustment unit 63 that has received the depth texture from the Z buffer 612 reads a predetermined transfer function from various transfer functions stored in advance in the transfer function storage unit 62, and based on this transfer function, A depth map is generated by converting the pixel value of the depth texture (step S5 in FIG. 7). Then, the obtained depth map is displayed on the monitor 72 of the display unit 7 (step S6 in FIG. 7).

  At this time, the operator of the ultrasonic diagnostic apparatus 100 observing the depth map displayed on the display unit 7 provides an instruction signal for selecting a new transfer function when the image quality of the obtained depth map is insufficient. Input is performed using the transfer function selection function 82 of the input unit 8. The image quality adjustment unit 63 that has received the above instruction signal via the system control unit 9 reads another transfer function from the transfer function storage unit 62 (step S7 in FIG. 7), and the depth based on this transfer function is read out. A new depth map is generated by the texture conversion process and displayed on the display unit 7 (steps S5 and S6 in FIG. 7).

  When the operator confirms that a desired depth map has been generated by observing the depth map displayed on the display unit 7, the operator uses the transfer function selection function 82 of the input unit 8 as a selection end instruction signal. The stereogram generation unit 64 that receives the above-described instruction signal via the system control unit 9 processes the depth map supplied from the image quality adjustment unit 63 to generate a single image stereogram (FIG. 7). Step S8).

  On the other hand, the rendering processing unit 613 of the rendering image data generation unit 61 processes the luminance distribution data read from the frame buffer 611 and the depth information read from the Z buffer 612 to generate rendering image data (step S9 in FIG. 7). . Then, the rendering image data obtained at this time and the single image stereogram generated in the above-described step S8 are supplied to the display data generation unit 71 of the display unit 7, and the display data generation unit 71 stores the image data in a predetermined manner. Are combined and displayed on the monitor 72, and output to the printer 73 as necessary (step S10 in FIG. 7).

(Modification)
Next, a modification of the present embodiment will be described. In the ultrasonic diagnostic apparatus in this modification, each of the rendering image data generated based on the volume data of the three-dimensional region including the observation site of the subject and the depth texture obtained in the generation process of the rendering image data is determined in advance. The image quality is adjusted based on the transfer function. Then, a depth map is generated by synthesizing the rendered image data and the depth texture after image quality adjustment, and a single image stereogram is generated using this depth map.

(Device configuration and functions)
The configuration and functions of the ultrasonic diagnostic apparatus according to this modification will be described with reference to FIG. FIG. 8 is a block diagram showing the overall configuration of the ultrasonic diagnostic apparatus according to this modification. In FIG. 8, units having the same configuration and function as the unit of the ultrasonic diagnostic apparatus 100 shown in FIG. 1 are the same. The detailed description will be omitted.

  That is, the ultrasonic diagnostic apparatus 150 of this modification shown in FIG. 8 is similar to the above-described ultrasonic diagnostic apparatus 100 in that an ultrasonic pulse (transmission ultrasonic wave) is applied to a three-dimensional region including the observation site of the subject. And an ultrasonic probe 3 in which a plurality of vibration elements for converting an ultrasonic reflected wave (received ultrasonic wave) obtained by this transmission into an electric signal (received signal) are two-dimensionally arranged, A transmission / reception unit 2 for supplying a driving signal for transmitting an ultrasonic pulse in a predetermined direction to the vibration element, and phasing and adding reception signals of a plurality of channels obtained from these vibration elements, and after phasing addition Volume data by arranging the received signal processing unit 4 that processes the received signal and generating the B-mode data and the B-mode data obtained by the above-described three-dimensional scanning by the ultrasonic wave in correspondence with the ultrasonic transmission / reception direction. And a volume data generation unit 5 for generating.

  Further, the ultrasonic diagnostic apparatus 150 processes the volume data to generate rendering image data and single image stereogram, a display unit 7 for displaying these image data, and object information. Input, setting of volume data generation conditions, image data generation conditions and image data display conditions, setting of viewpoints for volume data, selection of transfer functions suitable for image quality adjustment of depth texture, and input of various command signals, etc. The system includes an input unit 8 and a system control unit 9 that performs overall control of the above-described units and generates and displays rendering image data and single image stereograms.

  The image data generation unit 6a includes a rendering image data generation unit 61 that generates rendering image data by rendering the volume data of the subject stored in the volume data storage unit 53 of the volume data generation unit 5, and a depth described later. A transfer function storage unit 62a in which various transfer functions necessary for adjusting the image quality of the map and the image quality of the rendered image data are stored in advance, and a two-dimensional depth texture obtained in the process of generating the rendered image data. A first image quality adjustment unit 63a that adjusts the image quality using the transfer function for depth texture supplied from the storage unit 62a, and a first image quality adjustment that adjusts the image quality using the transfer function for rendering image data supplied from the transfer function storage unit 62a. 2 image quality adjustment unit 63b and image quality adjustment A data combining unit 65 for generating a depth map by combining the depth texture and rendered image data, and a stereogram generator 64a for generating a single image stereogram based on the obtained depth maps.

  The transfer function storage unit 62a includes a first transfer function storage area in which various depth texture transfer functions used for adjusting the image quality of the depth texture and various renderings used for adjusting the image quality of the rendered image data. It has a second transfer function storage area where image data transfer functions are stored in advance.

  In order to observe the desired observation site indicated by the two-dimensional depth texture supplied from the Z buffer 612 of the rendering image data generation unit 61 with high contrast resolution or spatial resolution, the first image quality adjustment unit 63a The pixels of the depth texture are converted (image quality adjustment) based on a suitable depth texture transfer function supplied from the transfer function storage unit 62a. Similarly, the second image quality adjustment unit 63b transmits the pixels of the rendering image data supplied from the rendering processing unit 613 of the rendering image data generation unit 61 to a suitable transmission for rendering image data supplied from the transfer function storage unit 62a. Perform conversion processing based on the function.

  On the other hand, the data synthesizing unit 65 adds, for example, the image quality adjusted depth texture supplied from the first image quality adjusting unit 63a and the image quality adjusted rendered image data supplied from the second image quality adjusting unit 63b. A depth map is generated by performing combining processing such as combining and weighted addition combining, and the stereogram generating unit 64a generates a single image stereogram based on the depth map supplied from the data combining unit 65.

(Single image stereogram generation / display procedure)
Next, a procedure for generating / displaying a single image stereogram in this modification will be described with reference to the flowchart of FIG. However, in FIG. 9, the same steps as those of the first embodiment shown in FIG.

  That is, in the same manner as in the first embodiment, after initial setting of volume data generation conditions, rendering image data generation conditions, single image stereogram generation conditions, image data display conditions, etc. in step S1, volume data is set in step S2. A generation start command is input at the input unit 8, and volume data is collected and stored at the observation site of the subject in step S3.

  Next, the viewpoint setting function 81 of the input unit 8 sets the viewpoint and line-of-sight direction for the volume data generated at this time, and the frame buffer 611 provided in the rendering image data generation unit 61 of the image data generation unit 6a Then, the voxel of the volume data is coordinate-transformed with the set viewpoint as a reference, thereby generating three-dimensional luminance distribution data and storing it in its own storage circuit.

  On the other hand, the Z buffer 612 of the rendering image data generation unit 61 calculates the three-dimensional depth information of the voxel of the volume data based on the viewpoint described above, and stores the obtained depth information in its own storage circuit. . Further, a two-dimensional depth texture having a brightness corresponding to the obtained depth information is generated and supplied to the first image quality adjustment unit 63a of the image data generation unit 6a (step S21 in FIG. 9).

  The first image quality adjustment unit 63a that has received the depth texture from the Z buffer 612 described above is selected from various depth texture transfer functions stored in advance in the first transfer function storage area of the transfer function storage unit 62a. A suitable transfer function for depth texture is read out, and the image quality of the depth texture is adjusted based on the transfer function for depth texture (step S22 in FIG. 9).

  On the other hand, the rendering processing unit 613 of the rendering image data generation unit 61 processes the luminance distribution data read from the frame buffer 611 and the depth information read from the Z buffer 612 to generate rendering image data (step S23 in FIG. 9). , And supplied to the second image quality adjustment unit 63b. Then, the second image quality adjustment unit 63b that has received the rendering image data supplied from the rendering processing unit 613 transfers various rendering image data transfer functions stored in advance in the second transfer function storage area of the transfer function storage unit 62a. A suitable transfer function for rendering image data is read out from the image data, and the image quality of the rendering image data is adjusted based on the transfer function for rendering image data (step S24 in FIG. 9).

  Next, the data synthesizing unit 65 synthesizes the depth texture after image quality adjustment supplied from the first image quality adjusting unit 63a and the rendered image data after image quality adjustment supplied from the second image quality adjusting unit 63b to combine the depth map. Is generated (step S25 in FIG. 9), and the obtained depth map is displayed on the monitor 72 of the display unit 7 (step S26 in FIG. 9).

  At this time, when the image quality of the obtained depth map is insufficient, the operator of the ultrasonic diagnostic apparatus 150 observing the depth map displayed on the display unit 7 uses a new transfer function for depth texture or rendering image data. An instruction signal for selecting a transfer function is input using the transfer function selection function 82 of the input unit 8. Then, the first image quality adjustment unit 63a or the second image quality adjustment unit 63b that has received the instruction signal via the system control unit 9 transmits another depth texture transfer function or rendered image data from the transfer function storage unit 62a. The transfer function is read (step S27 in FIG. 9), and a new depth map is generated based on these transfer functions and displayed on the display unit 7 (steps S22, S24 to S26 in FIG. 9).

  When the operator confirms that a desired depth map has been generated by observing the depth map displayed on the display unit 7, the operator uses the transfer function selection function 82 of the input unit 8 as a selection end instruction signal. The stereogram generation unit 64a that receives the above-described instruction signal via the system control unit 9 processes the depth map supplied from the data synthesis unit 65 to generate a single image stereogram (FIG. 9). Step S28).

  Then, the single image stereogram obtained at this time and the rendering image data generated in the above-described step S23 are supplied to the display data generation unit 71 of the display unit 7, and the display data generation unit 71 supplies the image data to the predetermined data. Are combined and displayed on the monitor 72, and output to the printer 73 as necessary (step S29 in FIG. 9).

  According to the first embodiment of the present invention and the modification thereof described above, the depth map is generated by adjusting the image quality of the depth texture of the volume data collected by the ultrasonic three-dimensional scanning on the subject, By generating a single image stereogram based on the depth map, the three-dimensional structure of the observation site can be observed in a three-dimensional manner.

  In particular, the generation of a single image stereogram eliminates the need for special hardware and display devices that have been used when observing a conventional stereogram. For this reason, the configuration of the apparatus is simplified, and the three-dimensional structure of the observation site can be observed in substantially real time.

  Furthermore, since a stereoscopic view of the same three-dimensional structure is possible even using a printed single image stereogram, it can be performed at a desired timing even in hospitals and other medical facilities where an ultrasonic diagnostic apparatus is not installed. It can be observed and stored easily. Further, when the observation site is a fetus, it is possible to provide a high-quality medical service by lending a printed single image stereogram to pregnant women.

  In addition, according to the above-described modification, the depth texture is generated by combining the depth texture after the image quality adjustment and the rendering image data, and the single image stereogram is generated based on the depth map. Compared with the method of the first embodiment in which a depth texture is used as a depth map, a more detailed stereoscopic view of a three-dimensional structure is possible.

  Next, a second embodiment of the present invention will be described. The image data generation apparatus according to the second embodiment performs rendering based on volume data of a three-dimensional region including an observation site of the subject collected in advance by a medical image diagnosis apparatus such as an ultrasonic diagnosis apparatus installed separately. When generating image data, a desired depth map is generated by adjusting the image quality of the Z buffer depth texture obtained in the process based on a predetermined transfer function, and a single image stereogram is generated using this depth map. To do.

(Device configuration)
The configuration of the image data generation apparatus of this embodiment will be described with reference to FIG. FIG. 10 is a block diagram showing the overall configuration of the image data generation apparatus according to the present embodiment. In FIG. 10, units having the same configuration and functions as the unit of the ultrasonic diagnostic apparatus 100 shown in FIG. 1 are the same. The detailed description will be omitted.

  That is, the ultrasonic image generating apparatus 200 of the present embodiment stores volume data of the subject that is collected in advance by a medical image diagnostic apparatus (not shown) that is separately installed and supplied via a network or a large-capacity storage medium. Volume data storage unit 10, an image data generation unit 6 that processes the volume data read from the volume data storage unit 10 to generate rendered image data and a single image stereogram, and a display unit that displays these image data 7. Selection of transfer function suitable for input of object information, selection of tile image, volume data generation condition, setting of image data generation condition and image data display condition, setting of viewpoint for volume data, adjustment of image quality of depth texture Furthermore, an input unit 8 for inputting various command signals and the like, Overall controlling each unit of, a system control unit 9 to perform the generation and display of the rendered image data or a single image stereogram.

  A single image stereogram is generated and displayed using each of these units. The procedure is the same as steps S4 to S10 in the first embodiment shown in FIG.

(Modification)
Next, a modification of the present embodiment will be described. In the image data generation device according to this modification, when rendering image data is generated based on volume data of a three-dimensional region including an observation site of the subject collected in advance by a medical image diagnostic device installed separately, a rendering image is generated. The image quality of the depth texture and the rendered image data obtained in the data generation process is adjusted based on a predetermined transfer function. Then, a depth map is generated by synthesizing the depth texture after the image quality adjustment and the rendering image data, and a single image stereogram is generated using the obtained depth map.

(Device configuration and functions)
The configuration of the image data generation apparatus according to this modification will be described with reference to FIG. FIG. 11 is a block diagram showing the overall configuration of the image data generation apparatus in this modification. In FIG. 11, the unit of the ultrasonic diagnostic apparatus 100 shown in FIG. 1 or the ultrasonic diagnostic apparatus 150 shown in FIG. Units having the same configuration and function are denoted by the same reference numerals, and detailed description thereof is omitted.

  That is, the image data generation apparatus 250 of this modification shown in FIG. 11 is collected in advance by an image diagnosis apparatus such as an ultrasonic diagnosis apparatus (not shown) installed separately and supplied via a network or a large-capacity storage medium. A volume data storage unit 10 in which the volume data of the subject is stored, an image data generation unit 6a that processes the volume data read from the volume data storage unit 10 to generate rendering image data and a single image stereogram, Display unit 7 for displaying these image data, input of object information, selection of tile images, volume data generation conditions, image data generation conditions and image data display conditions, setting of viewpoints for volume data, depth texture, and Selection of transfer function suitable for image quality adjustment of rendered image data Furthermore, an input unit 8 for inputting various command signals and the like, and a system control unit 9 for controlling the above-mentioned units in an integrated manner and generating and displaying rendering image data and single image stereograms are provided. Yes. A single image stereogram is generated and displayed using each of these units, and the procedure is the same as steps S21 to S29 in the modification of the first embodiment shown in FIG. Omitted.

  According to the second embodiment of the present invention and the modification thereof described above, the depth map is obtained by adjusting the image quality of the depth texture based on the volume data of the subject collected in advance by the separately installed medical image diagnostic apparatus. And a single image stereogram is generated based on the depth map, so that the three-dimensional structure of the observation site can be observed stereoscopically.

  In particular, the generation of a single image stereogram eliminates the need for special hardware and display devices that have been used when observing a conventional stereogram. For this reason, the configuration of the apparatus is simplified, and the three-dimensional structure of the observation site can be observed in substantially real time.

  Furthermore, since a stereoscopic view of the same three-dimensional structure is possible using a printed single-image stereogram, it can be performed at a desired timing in hospitals and other medical facilities where no medical image diagnostic apparatus is installed. It can be observed and stored easily. Further, when the observation site is a fetus, it is possible to provide a high-quality medical service by lending a printed single image stereogram to pregnant women.

  In addition, according to the above-described modification, the depth texture is generated by combining the depth texture after the image quality adjustment and the rendering image data, and the single image stereogram is generated based on the depth map. Compared with the method of the second embodiment in which the depth texture is a depth map, a more detailed three-dimensional structure can be viewed.

  Furthermore, since the single image stereogram is generated by using volume data supplied from a separately installed medical image diagnostic apparatus via a network or the like, the operator is not greatly limited by time and place. Diagnosis of the subject can be performed efficiently.

  As mentioned above, although the Example of this invention and its modification were described, this invention is not limited to the above-mentioned Example and its modification, It can change and implement further. For example, in the above-described first embodiment and its modifications, the case has been described in which three-dimensional scanning is performed on the observation site of the subject using the ultrasonic probe 3 in which a plurality of vibration elements are two-dimensionally arranged. The observation site may be three-dimensionally scanned by mechanically moving an ultrasonic probe in which a plurality of vibration elements are one-dimensionally arranged. Also, the case where the reception signal obtained from the subject is processed to generate B-mode data as ultrasonic data and volume data is generated based on this B-mode data has been described. Volume data may be generated based on ultrasonic data.

  On the other hand, in the second embodiment and its modification, the case where the single image stereogram and the rendering image data are simultaneously displayed or printed has been described. However, only the single image stereogram may be displayed or printed out. . In the image quality adjustment for the depth texture and the rendering image data, the case where the image quality adjustment is repeatedly performed while the depth map generated by the synthesis of the depth texture and the rendering image data after the image quality adjustment is displayed on the display unit 7 has been described. Depth texture and rendered image data before or after image quality adjustment may be displayed together with the depth map.

  Furthermore, the case where the depth map is generated by synthesizing the depth texture and the rendering image data whose image quality has been adjusted has been described, but the image quality adjustment may be performed on either the depth texture or the rendering image data.

  In the first and second embodiments described above and the modifications thereof, the case where a single image stereogram is generated using the depth texture obtained in the Z buffer 612 in the generation process of rendering image data has been described. However, volume data may be collected for the purpose of generating a single image stereogram, and a single image stereogram may be generated using the depth texture of the volume data.

  Further, although the tile image is used as the expression texture in the generation of the single image stereogram, another image such as a random dot image may be used as the expression texture. Note that the shift amount of the tile image or random dot image in the generation of the single image stereogram is set in proportion to the pixel value of the depth map, for example, but the proportionality coefficient depends on the state of the display unit 7 and the operator. Therefore, it is desirable to provide the input unit 8 with a proportional coefficient adjustment function.

  Further, a suitable transfer function is selected from various transfer functions stored in advance by a look-up table or a function in the transfer function storage unit 62 (62a), and the image quality of the depth texture or the rendered image data is selected using this transfer function. Although the case where adjustment is performed has been described, the operator may perform the above-described image quality adjustment using a transfer function arbitrarily set in the input unit 8 or the like.

2. Transmission / reception unit 21 ... Transmission unit 22 ... Reception unit 3 ... Ultrasonic probe 4 ... Reception signal processing unit 5 ... Volume data generation unit 6, 6a ... Image data generation unit 61 ... Rendering image data generation unit 611 ... Frame buffer 612 ... Z buffer 613 ... rendering processing units 62 and 62a ... transfer function storage units 63, 63a and 63b ... image quality adjustment units 64 and 64a ... stereogram generation unit 65 ... data synthesis unit 7 ... display unit 71 ... display data generation unit 72 ... monitor 73 ... Printer 8 ... Input unit 81 ... Viewpoint setting function 82 ... Transfer function selection function 9 ... System control unit 10 ... Volume data storage unit 100, 150 ... Ultrasound diagnostic device 200, 250 ... Image data generation device

Claims (13)

In an ultrasonic diagnostic apparatus that generates rendering image data based on volume data collected by ultrasonic three-dimensional scanning of a subject,
A Z buffer that generates a two-dimensional depth texture based on three-dimensional depth information of the volume data necessary for generating the rendered image data;
A depth map generating means for generating a depth map based on the depth texture or the depth texture and the rendered image data;
Stereogram generating means for generating a single image stereogram based on the depth map;
An ultrasonic diagnostic apparatus comprising: display means for displaying the generated single image stereogram.   The ultrasonic diagnostic apparatus according to claim 1, wherein the depth map generation unit includes an image quality adjustment unit that generates the depth map by adjusting an image quality of the depth texture.   The depth map generation unit generates an image depth map by combining an image quality adjustment unit that performs image quality adjustment on at least one of the depth texture and the rendered image data, and the depth texture and the rendered image data after the image quality adjustment. The ultrasonic diagnostic apparatus according to claim 1, further comprising a data synthesizing unit.   A transfer function storing means for storing a plurality of transfer functions in advance; and a transfer function selecting means for selecting a desired transfer function from the plurality of transfer functions, wherein the image quality adjusting means is controlled by the transfer function selecting means. The ultrasonic diagnostic apparatus according to claim 2, wherein image quality adjustment is performed on at least one of the depth texture and the rendered image data based on the selected desired transfer function.   The transfer function selecting means selects the desired transfer function based on the depth map newly displayed on the display means in accordance with the update of the transfer function used for generating the depth map. The ultrasonic diagnostic apparatus according to claim 4.   Viewpoint setting means is provided for setting a viewpoint for the volume data, and the Z buffer generates the depth texture based on three-dimensional depth information based on the viewpoint of the voxel constituting the volume data. The ultrasonic diagnostic apparatus according to claim 1.   The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit includes at least one of a monitor that displays the single image stereogram and a printer that prints out the single image stereogram.   The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit displays the single image stereogram and the rendering image data in parallel or in a superimposed manner.   The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit displays the single image stereogram in substantially real time. In an image data generation device that generates rendering image data based on volume data collected in advance from a subject,
A Z buffer that generates a two-dimensional depth texture based on three-dimensional depth information of the volume data necessary for generating the rendered image data;
A depth map generating means for generating a depth map based on the depth texture or the depth texture and the rendered image data;
Stereogram generating means for generating a single image stereogram based on the depth map;
An image data generation apparatus comprising: display means for displaying the generated single image stereogram.   The image data generation apparatus according to claim 10, wherein the depth map generation unit includes an image quality adjustment unit that generates the depth map by adjusting an image quality of the depth texture.   The depth map generation unit generates an image depth map by combining an image quality adjustment unit that performs image quality adjustment on at least one of the depth texture and the rendered image data, and the depth texture and the rendered image data after the image quality adjustment. 11. The image data generating apparatus according to claim 10, further comprising a data synthesizing unit. For an ultrasonic diagnostic apparatus or image data generation apparatus that generates rendering image data based on volume data collected from a subject,
A depth texture generation function for generating a two-dimensional depth texture based on three-dimensional depth information of the volume data necessary for generating the rendering image data;
A depth map generation function for generating a depth map based on the depth texture or the depth texture and the rendered image data;
A stereogram generation function for generating a single image stereogram based on the depth map;
An image data generation control program for executing a display function for displaying the generated single image stereogram.

Images