JP2006075216A - Medical image processing system, program and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a medical image processing system, program and method allowing a user to easily set a curved section and grasp the position and the shape of the curved section by appropriately displaying an image such as a three-dimensional image. <P>SOLUTION: This medical image processing system is provided with an operation screen information creation means 7b creating operation screen information for displaying an operation screen using a three-dimensional image capable of changing the sight line direction as a reference image for creating a curved section image along a prescribed curve based on medical image database 4 storing medical image data collected in a medical diagnosis device and the three-dimensional image data created from the medical image data stored in the medical image database 4; and a curved section image creation means 7c creating the curved section image data for displaying the position of the curved section image on the reference image into a belt shape and displaying the curved section image on the operation screen based on the information received from an input means 5 and the three-dimensional image data. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a medical image processing system, a medical image processing program, and a medical image processing method for performing image processing of medical image data collected in an image diagnostic apparatus such as an X-ray CT apparatus, a nuclear magnetic imaging apparatus, and an ultrasonic diagnostic apparatus. In particular, the present invention relates to a medical image processing system, a medical image processing program, and a medical image processing method capable of reconstructing three-dimensional image data such as a cross-sectional transformation (MPR) image and displaying the curved surface.

  Conventionally, medical image data such as a two-dimensional tomographic image collected in an image diagnostic apparatus such as an X-ray CT apparatus, a nuclear magnetic imaging apparatus, or an ultrasonic diagnostic apparatus is subjected to image processing, and the medical image data is converted into three-dimensional image data. Is reconstructed.

  As one of such three-dimensional image data reconstruction processing techniques, when a plurality of viewpoints are set inside the observation target included in the three-dimensional original image, the original image with the curved surfaces passing through the set viewpoints as cut planes is used. There is an image processing system that reconstructs and displays a cross-sectional image of an original image by cutting (see, for example, Patent Document 1).

  This image processing system has a function to display in parallel a pseudo three-dimensional image obtained by parallel projection of an original image on a certain projection surface and shading processing by a surface method or volume rendering method together with a cross-sectional image such as a blood vessel cross-section. is doing.

  In addition, an image processing system having various functions in addition to a display function of a three-dimensional image and a curved tomographic image is proposed. This image processing system has a function of drawing a curve on a display screen by input means such as a mouse and creating a cross-sectional image along the curve. For this reason, curved MPR (Curved MPR), which is a technique for creating a cross-sectional image along a curve, is used. Such a curved MPR (Curved MPR) is particularly effective when observing a curved section of a human body such as a dentition, a spine, or a blood vessel in medical image processing.

  FIG. 12 is a diagram illustrating a screen configuration example when a curved MPR image is displayed by a conventional image processing system.

  As shown in FIG. 12, MPR cross-sectional images (P1, P2, P3) with three orthogonal planes (axial cross-section, sagittal cross-section, coronal cross-section) are displayed on the screen of the conventional image processing system. Each MPR cross-sectional image can be set and displayed as an operation screen by setting a curved cross-section by operating an input means such as a mouse.

  First, when a plurality of points on the curve B to be drawn by clicking with the mouse are plotted on an arbitrary MPR cross-sectional image, for example, the MPR cross-sectional image A among the three MPR cross-sectional images displayed on the screen, a spline function or the like is plotted. A curve B is automatically created and drawn by interpolating between the points by any function of. At this time, the spatial coordinates of the plotted points are the clicked points on the displayed surface.

  When the curve B is drawn, a curved cross-sectional image D that passes through the created curve B and is orthogonal to the MPR cross-sectional image A is generated and displayed. That is, the length in the longitudinal direction of the curved slice image D is the length of the curve B, and the position of the center line G of the curved slice image D is determined by the position of the curve B. The width F in the direction perpendicular to the longitudinal direction of the curved cross-sectional image D is displayed, for example, as a dotted line on the MPR cross-sectional image other than the MPR cross-sectional image A depicting the curve B, and the width F of the curved cross-sectional image D is set by the mouse. can do.

  The curved cross-sectional image D created in this way can be changed by dragging and moving the points plotted on the curve B with the mouse. Further, the curve B can be moved vertically and horizontally on the MPR cross-sectional image A while maintaining the shape of the curve B.

  Further, it is possible to display a vertical cross-sectional image E that vertically crosses the curved cross-sectional image D, and the position C of the vertical cross-sectional image E is displayed as a straight line on the curved cross-sectional image D and the MPR cross-sectional image A, for example. The The position C of the vertical cross-sectional image E can be moved with the mouse.

  And even if the position and shape of the curve B are changed, the curved cross-sectional image D at the position of the curve B is always displayed. Similarly, the vertical cross-sectional image E is configured so that the vertical cross-sectional image E at the position C is always displayed.

In other words, in the conventional curved MPR curved surface display technology, the position of the curved surface is drawn with a curve on the MPR image or the volume rendering image, and the range of the curved surface is displayed as the sectional width on the MPR image or the volume rendering image. Is.
Japanese Patent Laid-Open No. 11-318884

  In an image processing system using the curved section display technology by the conventional Curved MPR, the curve B can be set only for one fixed MPR section image A (axial section, sagittal section, coronal section). However, if the curve B is set while changing the depth of the MPR cross-sectional image A, there is a problem that the position of the curve B cannot be expressed with only one MPR cross-sectional image A. In other words, when the curved cross-sectional image D is set in a three-dimensional direction, that is, while changing the depth as well as the top, bottom, left, and right of the MPR cross-sectional image A, the position of the curved cross-sectional image D in the depth direction is expressed. Is difficult to display for the user.

  Further, as a problem of the same type, if the curve B is set while rotating the MPR cross-sectional image A, the direction of the MPR cross-sectional image A cannot be expressed. In other words, when creating a twisted curved cross-sectional image D in which the direction of the curved cross-sectional image D changes midway, the curved cross-sectional image D cannot be expressed.

  In addition, when there is a change in the depth or twist in the curved cross-sectional image D, it is difficult to determine which direction the width F of the image of the curved cross-sectional image D is relative to the object, and the vertical cross-sectional image E is set. When the curved cross-sectional image D cannot be confirmed from the arbitrary line-of-sight direction and the curved cross-sectional image D is rotated, there are various display problems such that it is difficult to grasp the orientation of the curved cross-sectional image D.

  The present invention has been made in order to cope with such a conventional situation, and by displaying an image such as a three-dimensional image more appropriately, the user can more easily set the curved section and set the position of the curved section. Another object of the present invention is to provide a medical image processing system, a medical image processing program, and a medical image processing method capable of grasping the shape and shape.

  In order to achieve the above object, a medical image processing system according to the present invention includes a medical image database for storing medical image data collected in an image diagnostic apparatus, and the medical image database as described in claim 1. In order to create a curved cross-sectional image along a specified curve based on the three-dimensional image data created from the medical image data stored in the reference image, the reference image is a three-dimensional image whose gaze direction can be changed. Operation screen information creation means for creating operation screen information for displaying the operation screen, and the curved slice image based on the information received from the input means and the three-dimensional image data created from the medical image data A curved section image data for displaying the curved section image on the reference image and displaying the curved section image on the operation screen. It is characterized in that it has an image generation unit.

  In order to achieve the above object, a medical image processing system according to the present invention includes a medical image database for storing medical image data collected in an image diagnostic apparatus, and the medical Based on the 3D image data created from the medical image data stored in the image database, a volume rendering image is used as a reference image and a cross-section conversion image An operation screen information creating means for creating operation screen information for displaying an operation screen having a display unit, the music based on the information received from the input means and the three-dimensional image data created from the medical image data. The position of the cross-sectional image is displayed in a band shape on the reference image, and the curved cross-sectional image is displayed as a cross-sectional conversion image on the operation screen. It is characterized in that it has a curved cross-section image generating means for generating a curved cross-section image data for.

  According to another aspect of the present invention, there is provided a medical image processing program for storing a medical image data collected in an image diagnostic apparatus by a computer. 3D capable of changing the line-of-sight direction to create a curved cross-sectional image along a specified curve based on 3D image data created from the medical image data stored in the medical image database Based on the operation screen information creating means for creating the operation screen information for displaying the operation screen with the image as the reference image, the information received from the input means, and the 3D image data created from the medical image data A curved section for displaying a position of a curved section image on the reference image in a band shape and displaying the curved section image on the operation screen It is characterized in that the function as curved cross-section image generation means for generating image data.

  According to another aspect of the present invention, there is provided a medical image processing method for generating three-dimensional image data from medical image data collected in an image diagnostic apparatus, as described in claim 7, In order to create a curved cross-sectional image along a specified curve based on the three-dimensional image data, an operation for displaying an operation screen using a three-dimensional image whose reference line can be changed as a reference image The step of creating screen information, the position of the curved cross-sectional image is displayed on the reference image in a strip shape based on the information received from the input means and the three-dimensional image data generated from the medical image data, and Creating curved section image data for displaying a curved section image on the operation screen.

  In the medical image processing system, the medical image processing program, and the medical image processing method according to the present invention, by displaying an image such as a three-dimensional image more appropriately, the user can more easily set and set the curved section. The position and shape of the cross section can be grasped.

  Embodiments of a medical image processing system, a medical image processing program, and a medical image processing method according to the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is a functional block diagram showing an embodiment of a medical image processing system according to the present invention.

  The medical image processing system 1 includes a CPU 2, an image display unit 3, a medical image database 4, a pointing device 5 as input means, an image storage unit 6, and an image processing unit 7. Then, the CPU 2 performs input / output management of information between the components.

  The medical image database 4 stores a plurality of medical image data (tomographic images) collected by an image diagnostic apparatus such as an X-ray CT apparatus, a nuclear magnetic imaging apparatus, and an ultrasonic diagnostic apparatus. The medical image data stored in the medical image database 4 is two-dimensional image data.

  The pointing device 5 includes input means such as a mouse and a keyboard, and has a function of giving necessary information to the medical image processing system 1.

  The image processing unit 7 has a function of generating target image data by performing various image processing in accordance with instructions received from the pointing device 5 using two-dimensional medical image data stored in the medical image database 4 as original data. Have For this purpose, the image processing unit 7 includes an image data input unit 7a, an operation screen information creation unit 7b, a curved section image generation unit 7c, a vertical section image generation unit 7d, a curved section editing unit 7e, a vertical section editing unit 7f, a display condition. It has a function as the changing means 7g. The image processing unit 7 can be constructed by causing a computer to read a medical image processing program, but may be configured by a specific circuit.

  The image data input means 7a reads the two-dimensional medical image data stored in the medical image database 4 and creates a three-dimensional image data such as an MPR image, and the created three-dimensional image data such as an MPR image. The operation screen information creating means 7b, the curved cross-section image generating means 7c, the vertical cross-sectional image generating means 7d, the curved cross-section editing means 7e, the vertical cross-section editing means 7f, and the display condition changing means 7g are provided.

  The operation screen information creation means 7b has a function of creating operation screen information for creating a curved section image using the 3D image data received from the image data input means 7a, and the created operation screen information as the image display section 3. It has the function to give and display. In particular, the operation screen information creating means 7b has a function of creating 3D image data that can change the line-of-sight direction, such as 3D image data (volume rendering image) by volume rendering as operation screen information. Provided.

  The curved cross-section image generation means 7c has a function of creating a curved cross-section image data for displaying a curved cross-section image and its position from the three-dimensional image data received from the image data input means 7a based on the information received from the pointing device 5. Then, the created curved section image data is given to the image display unit 3 to display the curved section image and its position. In addition, the curved section image generating means 7c, if necessary, has a function of creating information for informing the user of the direction of the curved section image as direction display information, and direction display information of the created curved section image. 3 is provided.

  Based on the information received from the pointing device 5, the vertical slice image generating means 7 d obtains the vertical slice image from the curved slice image data generated by the curved slice image generating means 7 c and the three-dimensional image data received from the image data input means 7 a. And a function of creating vertical cross-sectional image data for displaying the position thereof, and a function of displaying the vertical cross-sectional image and its position by giving the created vertical cross-sectional image data to the image display unit 3. Further, if necessary, the vertical section image generating means 7d has a function of generating information for informing the user of the direction of the vertical section image as direction display information, and the direction display information of the generated vertical section image as an image display section. 3 is provided.

  The curved section editing means 7e has a function of editing the curved section image data generated by the curved section image generating means 7c based on the information received from the pointing device 5 and creating new curved section image data. At this time, the creation of new curved slice image data refers to the three-dimensional image data received from the image data input means 7a, and the created new curved slice image data is given to the image display unit 3.

  The vertical section editing means 7f has a function of editing the vertical section image data generated by the vertical section image generating means 7d based on the information received from the pointing device 5 and creating new vertical section image data. At this time, the three-dimensional image data received from the image data input means 7 a is referred to in creating new vertical slice image data, and the created new vertical slice image data is given to the image display unit 3.

  Based on the information received from the pointing device 5, the display condition changing unit 7 g is used for the 3D image data that can change the line-of-sight direction of the volume rendering image or the like created and displayed by the operation screen information creating unit 7 b. It has a function to change display conditions. When changing the display conditions of the 3D image data, the 3D image data received from the image data input means 7a is referred to as appropriate.

  The image storage unit 6 stores image data generated by the image processing unit 7.

  The image display unit 3 has a function of displaying medical image data stored in the medical image database 4 and image data generated by the image processing unit 7.

  Next, the operation of the medical image processing system 1 will be described.

  FIG. 2 is a flowchart showing a procedure for creating and displaying a curved cross-section image from medical image data obtained in the image diagnostic apparatus by the medical image processing system 1 shown in FIG. Reference numerals attached indicate steps in the flowchart.

  First, medical image data is collected in advance and stored in the medical image database 4 in an image diagnostic apparatus such as an X-ray CT apparatus, a nuclear magnetic imaging apparatus, or an ultrasonic diagnostic apparatus.

  Next, in step S <b> 1, medical image data is selected by inputting selection information of medical image data for which a curved section is to be created by the pointing device 5.

  Next, in step S2, the image data input unit 7a of the image processing unit 7 reads the medical image data stored in the medical image database 4 based on the selection information of the medical image data input from the pointing device 5, MPR image data is created, and the created MPR image data is operated screen information creating means 7b, curved section image generating means 7c, curved section image generating means 7c, curved section editing means 7e, vertical section editing means 7f, display condition changing means. Give to 7g.

  In step S3, the operation screen information creation means 7b creates operation screen information for creating a curved section using the MPR image data received from the image data input means 7a, and displays the created operation screen information as an image. Give to part 3 to display. That is, the operation screen information creating unit 7b creates, for example, MPR cross-sectional image data and volume rendering image data in three cross sections (axial cross section, sagittal cross section, coronal cross section) as the operation screen information. An image is displayed.

  FIG. 3 is a diagram showing a screen configuration example of the operation screen displayed on the image display unit 3 of the image processing system shown in FIG.

  The operation screen displayed on the image display unit 3 of the image processing system includes, for example, an MPR image display unit and a reference image display unit as shown in FIG. The MPR image display unit displays the MPR cross-sectional images P1, P2, and P3 in the axial cross-section, sagittal cross-section, and coronal cross-section, and the reference image display unit displays the volume rendering image P4 of the subject as a reference image. . That is, the MPR cross-sectional images P1, P2, P3 and the volume rendering image P4 are displayed in parallel on the image display unit 3. Therefore, the user can intuitively grasp the shape of the subject and various organs and organ positions.

  Then, while referring to the operation screen created by the operation screen information creation means 7b and displayed on the image display unit 3, the operation of the pointing device 5 composed of input means such as a mouse and a keyboard can be used to create a section of music. Various image processing such as changing the display state can be performed.

  For this reason, for example, in step S4, the creation of the curved section is started by the operation of the pointing device 5. That is, information indicating that a curved section is to be created is input from the pointing device 5, and the curved section image generating means 7c creates a curved section display window W1 and displays it on the image display section 3 as shown in FIG. .

  Next, in step S5, by clicking on the pointing device 5, selection information for an arbitrary image among the three MPR cross-sectional images P1, P2, P3 or the volume rendering image P4 displayed on the operation screen is input. At this time, the click position by the pointing device 5 is also used as information for defining a curved section. The image selection information and the click position are given to the curved cross-section image generating means 7c.

  In step S6, an image for creating a curved section is selected by the curved section image generation means 7c based on the image selection information input from the pointing device 5. For example, the MPR cross-sectional image A is selected.

  Next, in step S7, in order to define a curved section via the MPR sectional image A, the coordinates at the click position of the pointing device 5 are acquired by the curved section image generating means 7c.

  Next, in step S8, the curved cross-section image generating means 7c plots the click position by the pointing device 5 by displaying the marking symbol at the coordinate position on the MPR cross-section image A.

  FIG. 4 is an enlarged view of an MPR cross-sectional image for creating a curved cross-section displayed on the operation screen of the image processing system shown in FIG.

  As shown in FIG. 4, the click position of the pointing device 5 on the MPR cross-sectional image A is marked with a mark x, for example, as a plot point PT. That is, the spatial coordinates of the plotted point PT are points clicked by the pointing device 5 in the MPR cross-sectional image A.

  Next, in step S9, the curved cross-section image generating means 7c determines whether or not the plotted point PT is the first point. If it is determined that the plotted point PT is the first point, the click operation by the pointing device 5 is performed again in step S5, and the new point PT is placed on the MPR cross-sectional image A. Plotted.

  When at least two points are plotted on the MPR cross-sectional image A, it is determined in step S9 that the plotted point PT is not the first point.

  In step S10, each point PT plotted on the MPR slice image A by the curved slice image generation means 7c is interpolated by an arbitrary function such as a spline function, and a curve B is automatically created. The created curve B is displayed on the MPR cross-sectional image A by, for example, a solid line.

  Next, in step S11, the curved cross-section image generating means 7c displays a curved cross-section image D having a certain width in the line-of-sight direction (vertical direction) of the MPR cross-sectional image A through the curve B based on the MPR image data. Create curved cross-section image data. The created curved slice image data is given to the image display unit 3, and the curved slice image D is developed and displayed in the curved slice display window information W1 provided on the operation screen.

  That is, the length in the longitudinal direction of the curved slice image D is the length of the curve B, and the position of the center line G of the curved slice image D is determined by the position of the curve B. The width F in the direction perpendicular to the longitudinal direction of the curved cross-sectional image D is displayed, for example, as a dotted line on the MPR cross-sectional image other than the MPR cross-sectional image A depicting the curve B, and the curved cross-sectional image D is operated by the pointing device 5. The width F can be set. That is, the position of the curved slice image D is displayed as the width F on the MPR slice images other than the MPR slice image A depicting the curve B.

  In step S12, the curved slice image generation means 7c creates curved slice image data for displaying the position of the curved slice image D on the volume rendering image P4 in a band shape based on the MPR image data. The created curved slice image data is given to the image display unit 3, and the position of the curved slice image D is displayed in a band shape on the volume rendering image P4.

  Here, the position information of the curved slice image D composed of a plurality of line segments in the volume rendering image P4 changes its display state depending on whether the position of the curved slice image D is in front of or behind the object. be able to. For example, when the position of the curved cross-section image D is behind the object, it can be hidden so as to be hidden, or can be displayed with a dotted line or the like. FIG. 3 is an example in which when the position of the curved cross-section image D is behind the object, the line segment of that portion is displayed with a dotted line.

  A function of switching the display state of a part of the position information of the curved slice image D is provided in the curved slice image generating means 7c.

  Next, in step S13, the curved slice image generating means 7c displays a direction for informing the user of the orientation of the curved slice image D from the generated curved slice image data and the MPR image data received from the image data input means 7a. Create information. Then, the curved slice image generation means 7 c gives the created direction display information to the image display unit 3.

  For example, the curved cross-section image generation means 7c creates color information for displaying the four corner line segments of the curved cross-section image D in different colors (c1, c2, c3, c4) as direction display information. As shown in FIG. 3, the line information at the four corners of the window information W1 for displaying the curved section and the curved section image D displayed in a strip shape in the volume rendering image P4 have a common color (c1, c2, c3, c4). ) Is displayed. The color of this line segment can be arbitrarily set and changed by operating the pointing device 5.

  For this reason, the user determines the direction of the position of the curved slice image D displayed in the belt-like shape in the volume rendering image P4 and the direction of the curved slice image D displayed in the window information W1 for displaying the curved slice, as colors (c1, c2). , C3, c4) can be easily grasped.

  However, the direction display information is not limited to the color of the line segment, and may be information such as a symbol or a sign.

  Next, in step S14, the window W2 is displayed on the image display unit 3 to display the vertical cross-sectional image E in the cross section perpendicular to the curved cross-sectional image D as shown in FIG. The Based on the information received from the pointing device 5, the vertical slice image generating means 7 d then obtains a vertical slice from the curved slice image data generated by the curved slice image generating means 7 c and the MPR image data received from the image data input means 7 a. Image data is created, and the created vertical slice image data is given to the image display unit 3 to display the vertical slice image E in the window W2. At this time, a line segment G indicating the position of the curved slice image D is appropriately displayed in the vertical slice image E displayed in the window W2.

  Next, in step S15, the vertical slice image generating means 7d creates information for displaying the position of the vertical slice image E on the MPR slice image A and gives it to the image display unit 3. For this reason, the position C of the vertical cross-sectional image E is displayed on the MPR cross-sectional image A by, for example, a straight line.

  Next, in step S <b> 16, the vertical slice image generation unit 7 d creates information for displaying the position of the vertical slice image E on the volume rendering image P <b> 4 and gives it to the image display unit 3. Therefore, the edge of the vertical slice image E is displayed on the volume rendering image P4 so that the position and shape of the vertical slice image E can be easily grasped.

  Next, in step S17, the vertical slice image generating means 7d creates information for displaying the position of the vertical slice image E on the curved slice image D shown in the window W1 and gives it to the image display unit 3. Therefore, the position C of the vertical cross-sectional image E is displayed on the curved cross-sectional image D as a straight line, for example.

  Next, in step S18, the vertical slice image generation means 7d creates direction display information for informing the user of the orientation of the vertical slice image E as with the curved slice image D. For this reason, for example, the line segments at the four corners of the vertical slice image E are displayed in different colors in the window information W2 and the volume rendering image P4, and the user can easily grasp the orientation and position of the vertical slice image E. It becomes possible.

  Further, if necessary, a plot point PT for determining the curve B for the definition of the curved cross-sectional image D is repeatedly added in the same procedure from step S5, and the final curved cross-sectional image D and vertical cross-sectional image E are added. Is displayed on the image display unit 3. However, for example, in step S10, all the plot points PT may be added before the curve B is created, and the addition timing of the plot points PT is arbitrary.

  The plot point PT may be set not only through the MPR cross-sectional images (P1, P2, P3) but also through the volume rendering image P4. When the plot point PT is set on the volume rendering image P4, for example, the point at the coordinates on the surface of the object closest to the point clicked by the pointing device 5 can be set as the plot point PT.

  Further, the curved slice image D and the vertical slice image E created in this way and the positional information on the volume rendering image P4 are stored in the image storage unit 6, and can be recalled and edited as necessary. It is. For example, the curved slice image D can be edited such as bending, twisting, rotating, or moving the curved slice image D, the position of the vertical slice image E can be changed, and the display condition of the volume rendering image P4 can be changed.

  First, the procedure for editing the curved slice image D will be described.

  FIG. 5 is a flowchart showing a procedure for editing the curved slice image D created by the medical image processing system 1 shown in FIG. Moreover, the code | symbol which attached | subjected the number to S in the figure shows each step of a flowchart, attaches | subjects the same code | symbol about the step equivalent to FIG. 2, and abbreviate | omits description.

  When editing the music section image D, in step S20, the instruction information of the editing content is input together with the selection information of the music section editing mode by the pointing device 5 such as a mouse or a keyboard.

  Next, when the curved section editing means 7e receives the selection information of the curved section editing mode from the pointing device 5 in step S21, the curved section editing mode is entered, and the curved section image D can be edited by the pointing device 5. Then, the curved section editing means 7e performs the editing process of the curved section image data in accordance with the editing content instruction information received from the pointing device 5.

  For example, when the instruction of the editing content is the entire movement of the curve B for determining the curved slice image D, the direction in which the curved slice editing means 7e is directed to the curve B on the MPR sectional image A in step S22. Move to.

  In step S11, the curved section editing means 7e creates curved section image data using the new curve B after the movement. Further, the curved section editing means 7e gives the created curved section image data to the image display unit 3. For this reason, the curved slice image D after the curve B is moved is developed and displayed in the window information W1.

  Next, processing is performed from step S12 in the same procedure as in FIG. 2, and the position of the belt-like curved cross-sectional image D, the vertical cross-sectional image E, and the position C after moving the curve B are displayed on the image display unit 3. Is done.

  On the other hand, in step S21, when the direction of editing changes the direction of formation of the curved slice image D while maintaining the curve B for determining the curved slice image D, that is, the curved content image D is rotated about the curve B as an axis. In the case of movement, in step S11, the curved section editing means 7e creates curved section image data so as to be in the formation direction of the curved section image D designated using the curve B. That is, the curved cross-sectional image D is usually created so as to be perpendicular to the MPR cross-sectional image A in which the curve B is generated, but can be rotated to an arbitrary angle with the position of the curve B as the center.

  Further, the curved section editing means 7e gives the created curved section image data to the image display unit 3. For this reason, the curved slice image D after being rotationally moved about the curve B is developed and displayed in the window information W1.

  Next, processing from step S12 is performed in the same procedure as in FIG. 2, and the position of the band-shaped curved cross-sectional image D, the vertical cross-sectional image E, and the position C after the rotational movement about the curve B are the image display unit. 3 is displayed.

  In step S21, if the instruction of the editing content is an instruction to “bend” or “twist” the curved slice image D, a bending process or a twisting process of the curved slice image D is performed in step S23.

  FIG. 6 is a flowchart showing a detailed procedure of the bending process or the twisting process of the curved slice image D shown in FIG. Moreover, the code | symbol which attached | subjected the number to S in the figure shows each step of a flowchart, and attaches | subjects the same code | symbol about the step equivalent to FIG. 2 and FIG. 6, and abbreviate | omits description.

  First, in step S30, information indicating that a certain position of the curved section image D is to be pressed (bent or twisted) is input to the curved section editing means 7e by operating the pointing device 5. Information indicating that the curved cross-sectional image D should be pressed can be input via the MPR cross-sectional image A or can be input via the volume rendering image P4.

  When inputting information indicating that the curved slice image D should be pressed via the MPR slice image A, the plot point PT on the curve B is dragged by the mouse, for example. Further, when inputting information indicating that the curved slice image D should be pressed via the volume rendering image P4, the direction of the curved slice image D is indicated together with the position of the curved slice image D displayed in a strip shape, and the press A line segment is displayed.

  FIG. 7 is a diagram showing position information of the band-shaped curved slice image D displayed on the volume rendering image P4 when the curved slice image D created by the medical image processing system 1 shown in FIG. 1 is edited.

  As shown in FIG. 7, when the curved section editing mode is selected, the position information of the band-shaped curved section image D displayed on the volume rendering image P4 includes the plane perpendicular to the curved section image D and the curved section image D. A line segment LN that intersects is displayed, and the curved slice image D can be edited. Then, by dragging the line segment LN displayed with the mouse on the position information of the band-shaped curved section image D, information indicating that the curved section image D should be pressed can be input, and the curved section image D can be pressed. .

  Further, even in a mode other than the curved section edit mode, the line segment LN where the plane perpendicular to the curved section image D intersects with the curved section image D is displayed on the volume rendering image P4, so that the method of the curved section image D is displayed. The direction of the line etc. can be confirmed.

  FIG. 8 is a diagram illustrating an example of instruction input when twisting the curved cross-sectional image D via the band-shaped curved cross-sectional image D displayed on the volume rendering image P4 illustrated in FIG.

  As shown in FIG. 8, when twisting the curved cross-sectional image D, the edge of the curved cross-sectional image D is dragged by the operation of the pointing device 5 such as a mouse, and the line segment LN of the curved cross-sectional image D at the dragged position is included therein. An instruction can be input to rotate around the point.

  FIG. 9 is a diagram illustrating an example of instruction input when the curved cross-sectional image D is bent through the band-shaped curved cross-sectional image D displayed on the volume rendering image P4 illustrated in FIG.

  As shown in FIG. 9, when bending the curved cross-section image D, the segment LN indicating the direction of the curved cross-section image D is dragged and moved by operating the pointing device 5 such as a mouse. An instruction can be input to include the line segment LN. At this time, a bending instruction can be input with a plurality of line segments LN to be moved. When a plurality of line segments LN are to be moved, bending deformation such that the curved cross-section image D includes each line segment LN in the order before the original movement is input as instruction information. Further, when inputting an instruction to bend the curved slice image D, the position of the line segment LN in the line-of-sight direction (depth) is determined depending on the line-of-sight direction of the volume rendering image P4.

  However, “bending” and “twisting” can be defined by an arbitrary method without being limited to the “bending” and “twisting” pressing methods of the curved cross-sectional image D described above. For example, “bending” may be defined so as to change the curvature of the edge of the curved slice image D by dragging.

  Then, an instruction for bending or twisting the curved cross-sectional image D is input via the curved cross-sectional image D displayed on the MPR cross-sectional image A or the band-shaped curved cross-sectional image D displayed on the volume rendering image P4. Then, regeneration processing of the curved cross-section image data for displaying the curved cross-section image D and its position in accordance with the bending instruction and the twist instruction of the input curved cross-section image D is started.

  That is, in step S31, the curved section editing means 7e acquires the position of the pressed curved section image D.

  Next, in step S32, the curved section editing means 7e receives whether the information to be pressed has been input via the MPR sectional image (MPR) by the operation of the pointing device 5, or via the volume rendering image (VR). It is determined whether it was input.

  When the information indicating that pressing is to be performed is input via the MPR cross-sectional image A by the operation of the pointing device 5, the curved cross-section editing means 7e sends the information on the MPR cross-sectional image A from the pointing device 5 in step S33. Movement information obtained by dragging the curve B is acquired.

  Next, in step S34, the curved section editing means 7e moves the plot point PT to the position of the cursor to be moved by dragging.

  Next, in step S35, the curved section editing means 7e obtains a curve B that passes through the position of the cursor that is the movement destination of the plot point PT by interpolation.

  Next, in step S11, curved section image data is created based on the new pressed curve B, and the curved section image D is developed and displayed in the window information W1. Then, processing is performed from step S12 in the same procedure as in FIG. 2, and the belt-like curved cross-sectional image D, vertical cross-sectional image E, and position C after the press are displayed on the image display unit 3.

  On the other hand, if it is determined in step S32 that the information to be pressed has been input via the volume rendering image P4 by the operation of the pointing device 5, the information to be pressed is the curved cross-sectional image in step S36. The curved section editing means 7e determines whether it is an instruction to “bend” D or “twist”. That is, when the line segment LN indicating the direction of the curved cross-sectional image D is dragged, it is determined that the information to be pressed is an instruction to “bend” the curved cross-sectional image D, and the edge of the curved cross-sectional image D Is dragged, it is determined that the information to be pressed is an instruction to “twist” the curved slice image D.

  In step S36, if the information to be pressed is an instruction to "bend" the curved section image D, the amount of movement of the curved section image D by dragging the line segment LN is determined in step S37. 7e.

  Next, in step S38, according to the amount of movement of the curved segment image D by dragging the line segment LN, the curved sectional image editing means is displayed so that the curved sectional image D including the line segments LN after movement can be displayed. The curved section data is regenerated by 7e. The regenerated curved section data is given to the image display unit 3, and the position of the curved section image D after the bending process after the regeneration is displayed on the volume rendering image P4.

  Next, in step S39, the curved section image D regenerated by the operation of the image display unit 3 is displayed in the curved section image D display window W1.

  Next, in step S <b> 40, the curve B on the curved slice image D regenerated by the action of the image display unit 3 is shown on the MPR slice image A. That is, the data relating to the curve B is also regenerated by the curved section editing means 7e and given to the image display unit 3.

  Next, processing is performed from step S13 in the same procedure as in FIG. 2, and color information for the four corner lines indicating the orientation of the curved slice image D is created, and the vertical slice image E and its position C are displayed. .

  In step S36, if the information to be pressed is an instruction to "twist" the curved section image D, the amount of movement by dragging the edge of the curved section image D is set to the curved section editing means 7e in step S41. Obtained by

  Next, in step S42, the line segment LN is rotated around its midpoint according to the amount of movement of the edge of the curved section image D by dragging, and the curved section image D including the rotated line segment LN is obtained. The curved section data that can be displayed is regenerated by the curved section editing means 7e. The regenerated curved section data is given to the image display unit 3, and the position of the curved section image D after the torsion processing after the regeneration is displayed on the volume rendering image P4.

  And the process similar to the case where the curved-section image D is bent from step S39 is performed.

  It is also possible to further edit the curved section image D after the press thus generated. For example, when the curved slice image D after the twisting process is rotated or translated, the curved slice image D is rotated or translated while maintaining the width and twist of the curved slice image D.

  Next, the procedure for editing the vertical slice image E will be described. Examples of the editing content for the vertical cross-sectional image E include changing the position C of the vertical cross-sectional image E and rotating the vertical cross-sectional image E.

  FIG. 10 is a flowchart showing a procedure for editing the vertical cross-sectional image E created by the medical image processing system 1 shown in FIG. Moreover, the code | symbol which attached | subjected the number to S in the figure shows each step of a flowchart, attaches | subjects the same code | symbol about the step equivalent to FIG. 2, and abbreviate | omits description.

  First, in step S50, editing information of the vertical section image E is input to the vertical section editing means 7f by the pointing device 5 such as a mouse or a keyboard.

  Next, in step S51, the input mode is selected depending on whether the editing information of the vertical slice image E is a change of the position C of the vertical slice image E or the rotation of the vertical slice image E.

  In step S52, when the editing information of the vertical cross-sectional image E is a change of the position C of the vertical cross-sectional image E, new position information of the vertical cross-sectional image E is input. That is, for example, the position of the vertical slice image E on the curve B is plotted by the pointing device 5 in either the MPR slice image or the volume rendering image P4. That is, by dragging the position of the vertical cross-sectional image E by the pointing device 5, the position of the vertical cross-sectional image E can be arbitrarily moved along the curve B on the curved cross-sectional image D displayed in a band shape.

  On the other hand, when the editing information of the vertical slice image E is rotation of the vertical slice image E in step S53, display angle information of the vertical slice image E is input. That is, for example, in the window W2 on which the vertical cross-sectional image E is displayed, the pointing device 5 causes the line segment G indicating the position of the curved cross-sectional image D to be rotated about its midpoint. That is, the vertical slice image E shown in the window W2 can be rotated on a plane perpendicular to the line-of-sight direction.

  When the editing information of the vertical slice image E is input in this way, the vertical section editing is performed according to the input editing information such as the position information of the vertical slice image E and the display angle information of the vertical slice image E in step S54. The means 7f regenerates the vertical cross-sectional image data for displaying the vertical cross-sectional image E and its position.

  Then, from step S15, processing is performed in the same procedure as in FIG. 2, and display of the position C of the vertical cross-sectional image E and color setting of the four corner line segments are performed. As a result, if the position of the vertical slice image E is moved via the volume rendering image P4, the moved vertical slice image E is displayed in the window W2, while the vertical slice image E is rotated in the window W2. The rectangular position display of the vertical cross-sectional image E displayed on the volume rendering image P4 is also the position after rotation.

  Next, a procedure for changing the display condition of the volume rendering image P4 will be described. Items that can change the display condition of the volume rendering image P4 include, for example, items such as changing the viewing direction (rotating around an arbitrary line), changing the enlargement factor, and moving the display position in parallel. It is done.

  FIG. 11 is a flowchart showing a procedure for changing the display condition of the volume rendering image P4 created by the medical image processing system 1 shown in FIG. Moreover, the code | symbol which attached | subjected the number to S in the figure shows each step of a flowchart.

  First, in step S60, the change information of the display condition of the volume rendering image P4 is input to the display condition changing means 7g by the pointing device 5 such as a mouse or a keyboard.

  Next, in step S61, whether the display condition change information of the volume rendering image P4 is, for example, rotation about an arbitrary line of the volume rendering image P4, change of the enlargement ratio, or parallel display position. The input mode is selected depending on whether it is movement.

  If the display condition change information of the volume rendering image P4 is rotation about an arbitrary line of the volume rendering image P4, in step S62, the display condition changing means 7g displays the rotation axis designation information and Get the rotation angle. That is, for example, a line segment on the volume rendering image P4 is selected by the pointing device 5 as a rotation axis, and the rotation angle is designated by dragging or numerical input of the rotation angle. Then, from these pieces of information, rotation axis designation information and rotation angle are acquired as display condition change information by the display condition changing means 7g.

  If the change information of the display condition of the volume rendering image P4 is a change of the enlargement ratio, the display condition changing means 7g acquires new enlargement ratio setting information in step S63. That is, for example, the center coordinate of enlargement is selected by the pointing device 5, and a new enlargement is designated by dragging or numerical input of the enlargement ratio. These pieces of information are acquired as display condition change information by the display condition changing means 7g.

  When the change information of the display condition of the volume rendering image P4 is the parallel movement of the display position, the display condition changing unit 7g acquires the direction and distance of the parallel movement in step S64. That is, for example, two points before and after the movement are selected by the pointing device 5, and the direction and distance of the parallel movement are determined by the selected two points. These pieces of information are acquired as display condition change information by the display condition changing means 7g.

  Next, when the display condition change information of the volume rendering image P4 is acquired by the display condition change means 7g as described above, in step S65, the display condition change means 7g displays the volume rendering image according to the acquired display condition change information. Volume rendering image data is created so that P4 is displayed. Then, the created volume rendering image data is given to the image display unit 3, so that the volume rendering image P4 after changing the display conditions is displayed.

  Next, in step S66, the curved section image data is created by the display condition changing means 7g so that the position of the curved section image D is displayed in a band shape in the volume rendering image P4 displayed under the new display conditions. Then, the created curved slice image data is given to the image display unit 3, whereby the position of the curved slice image D is displayed in a band shape on the volume rendering image P4 after the change of the display condition.

  Next, in step S67, vertical slice image data is created by the display condition changing means 7g so that the position of the vertical slice image E is displayed as a rectangle in the volume rendering image P4 displayed under the new display conditions. Then, the created vertical slice image data is given to the image display unit 3, whereby the position of the vertical slice image E is displayed as a rectangle on the volume rendering image P4 after the display condition is changed.

  In addition, the user can arbitrarily set and change display conditions such as transparency and color settings of the volume rendering image P4.

  That is, the medical image processing system 1 as described above displays a volume rendering image that can be observed from an arbitrary line-of-sight direction as a reference image in parallel with an MPR image, and displays a curved cross-sectional image in a band shape in the volume rendering image. This makes it easy to grasp the position and orientation of the curved cross-section image relative to the human body and facilitate the editing of the curved cross-section image. Therefore, according to the medical image processing system 1, it is possible to create and check a curved cross-sectional image while changing the line-of-sight direction via the volume rendering image.

  In addition, by displaying the curved cross-section image in a band shape, it is possible to display the change in the width direction (depth) perpendicular to the longitudinal direction and the state of twist, and the user can easily grasp these intuitively. It becomes. Furthermore, the volume rendering image can be rotated to check the curved cross-sectional image from an arbitrary line-of-sight direction, and the twisted, curved, and width elements of the curved cross-sectional image can be edited while displaying in the arbitrary line-of-sight direction. Become.

  Furthermore, the direction of the curved cross-sectional image can be confirmed by displaying an intersection line between the plane perpendicular to the curved cross-sectional image and the curved cross-sectional image.

  The above-described effects are the same for the vertical cross section perpendicular to the curved cross section image, and the vertical cross section can be further rotated on the same plane. At this time, the orientation of the vertical section can be easily grasped by the rectangular position display of the vertical section displayed in the volume rendering image.

  Therefore, according to the medical image processing system 1, it is particularly effective when creating a curved cross-section image that is difficult to express in two dimensions, such as a cross-section that runs in a complicated direction along a blood vessel. It is. Furthermore, the set curved cross-sectional image of a blood vessel or the like can be easily grasped visually, and the set curved cross-sectional image can be easily corrected.

1 is a functional block diagram showing an embodiment of a medical image processing system according to the present invention. 3 is a flowchart showing a procedure for creating and displaying a curved cross-sectional image from medical image data obtained in an image diagnostic apparatus by the medical image processing system 1 shown in FIG. 1. The figure which shows the example of a screen structure of the operation screen displayed on the image display part of the image processing system shown in FIG. FIG. 4 is an enlarged view of an MPR cross-sectional image for creating a curved cross-section displayed on the operation screen of the image processing system shown in FIG. 3. The flowchart which shows the procedure at the time of editing the curved cross-section image produced by the medical image processing system shown in FIG. The flowchart which shows the detailed procedure of the bending process or the twist process of a curved cross-section image shown in FIG. The figure which shows the positional information on the strip | belt-shaped curved cross-section image displayed on a volume rendering image, when editing the curved cross-section image produced by the medical image processing system shown in FIG. The figure which shows the example of instruction | indication input in the case of twisting a curved cross-section image via the strip | belt-shaped curved cross-section image displayed on the volume rendering image shown in FIG. The figure which shows the example of instruction | indication input in the case of bending a curved cross-section image via the strip | belt-shaped curved cross-section image displayed on the volume rendering image shown in FIG. The flowchart which shows the procedure at the time of editing the vertical cross-section image produced by the medical image processing system shown in FIG. The flowchart which shows the procedure in changing the display conditions of the volume rendering image produced by the medical image processing system shown in FIG. The figure which shows the example of a screen structure at the time of displaying a curved surface MPR image by the conventional image processing system.

Explanation of symbols

1 Medical Image Processing System 2 CPU
3 Image display unit 4 Medical image database 5 Pointing device 6 Image storage unit 7 Image processing unit 7a Image data input unit 7b Operation screen information creation unit 7c Curved section image generation unit 7d Vertical section image generation unit 7e Curved section editing unit 7f Vertical section Editing means 7g Display condition changing means

Claims (7)

A medical image database storing medical image data collected in an image diagnostic apparatus, and a curved section along a specified curve based on three-dimensional image data created from the medical image data stored in the medical image database Operation screen information creation means for creating operation screen information for displaying an operation screen using a 3D image whose reference line can be changed as a reference image in order to create an image, and information received from the input means And a curved cross section for displaying the position of the curved slice image on the reference image in a strip shape based on the three-dimensional image data created from the medical image data and the operation screen. A medical image processing system comprising: a curved cross-section image generating means for creating image data. A medical image database for storing medical image data collected in an image diagnostic apparatus, and a curved section along a specified curve based on three-dimensional image data created from the medical image data stored in the medical image database Operation screen information creation means for creating operation screen information for displaying an operation screen having a volume rendering image as a reference image and having a display section of a cross-section conversion image for creating an image, and information received from an input means And the three-dimensional image data created from the medical image data, the position of the curved cross-sectional image is displayed on the reference image in a band shape, and the curved cross-sectional image is displayed on the operation screen as a cross-sectional converted image. And a curved cross-sectional image generating means for generating curved cross-sectional image data for the medical image processing system. Temu. The curved surface image generation means creates the curved surface image data so that a line segment indicating the direction of the curved surface image is displayed on the reference image. The medical image processing system described. The curved cross-section image generating means is configured to create the curved cross-section image data such that a line segment indicating the direction of the curved cross-section image is displayed on the reference image, and the curved section image data is generated using the line segment. 3. The medical image processing system according to claim 1, further comprising curved section editing means for changing the shape of the section image. 3. The curved section image generation means is configured to switch a display state of a part of position information of the curved section image displayed in a band shape on the reference image. The medical image processing system described. A medical image database for storing medical image data collected in an image diagnostic apparatus, and a computer along a specified curve based on three-dimensional image data created from the medical image data stored in the medical image database Received from the operation screen information creating means and the input means for creating operation screen information for displaying an operation screen with a three-dimensional image whose reference direction can be changed as a reference image in order to create a curved section image Based on the information and the three-dimensional image data created from the medical image data, a curve for displaying the position of the curved slice image on the reference image in a strip shape and displaying the curved slice image on the operation screen A medical image processing program that functions as curved slice image generation means for creating slice image data. Generating three-dimensional image data from medical image data collected in the diagnostic imaging apparatus, and changing a line-of-sight direction in order to create a curved cross-sectional image along a specified curve based on the three-dimensional image data Creating operation screen information for displaying an operation screen using a 3D image as a reference image, and information received from the input means and the 3D image data generated from the medical image data. And generating a curved cross-sectional image data for displaying the curved cross-sectional image in a band shape on the reference image and displaying the curved cross-sectional image on the operation screen based on the medical image. Processing method.

Images