JP2006092282A - Image processor and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide technology for performing the imaging of volume data at high speed. <P>SOLUTION: When a projection face on which a three-dimensional object is projected is set, one voxel is projected to the projection face, so that a reference image position corresponding to the reference position of the voxel and the projection distance (reference projection distance value) of the reference position can be detected. Data obtained by expressing the set of the projection distance value corresponding to each pixel corresponding point of the projection face and a pixel value with a reference projection distance value are imparted to each pixel, and a basic image with data clearly expressing the reference image position imparted thereto is generated. When the three-dimensional object is projected onto the projection face, each reference projection position where the reference position of each voxel is projected and the reference projection distance of each reference position are detected respectively. Then, the respective adjusted basic images generated by adjusting the basic image according to each reference projection position and each reference projection distance are mutually combined, so that an image for display can be generated. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for generating a display image based on three-dimensional data.

  As a technique for visualizing (imaging) and displaying data (volume data) indicating a three-dimensional object, a technique called volume rendering is known.

  In this volume rendering, there is a method called Ray Casting method. In this method, every time a projection plane is set, for example, a map showing the distribution of the distance between the projection plane and a three-dimensional object. Volume data is imaged by generating (depth map) and sampling along the line of sight.

  Then, when various calculations are performed by hardware, if the volume data is imaged at high speed, there is a problem that the hardware becomes large. In order to solve this problem, a technique has been proposed in which larger volume data can be imaged at high speed with limited-size hardware (for example, Patent Document 1).

  Prior art documents relating to such technology include the following.

JP 2000-348195 A

  However, in the volume rendering described above, every time the line-of-sight direction, that is, the projection plane changes, for example, a depth map is generated again, or it is necessary to form an image again. For this reason, a certain amount of time is required for switching the visible image according to the change in the line-of-sight direction. In particular, when the amount of volume data is large, it is difficult to smoothly switch images.

  The present invention has been made in view of the above problems, and provides a technique capable of reducing the amount of calculation required for imaging volume data, that is, capable of imaging volume data at high speed. Objective.

  In order to solve the above problems, the invention of claim 1 is an image processing apparatus that generates a display image based on three-dimensional data, and is a virtual structure configured by a set of specific structures facing a predetermined direction. Reading means for reading the three-dimensional data indicating the structure of the three-dimensional object into a predetermined storage means, and a projection plane for setting a relative direction relation between the virtual projection plane for projecting the virtual three-dimensional object and the virtual three-dimensional object A basic image by projecting a setting unit, a reference position setting unit for setting a reference position for the specific structure, and one specific structure facing the predetermined direction onto the virtual projection plane according to the direction relation Generating basic image generating means for recognizing a reference image position corresponding to the reference position in the basic image, and converting the virtual three-dimensional object into the virtual projection plane Detection means for detecting each reference projection position at which the reference position of each specific structure is projected onto the virtual projection plane, and relative to the virtual projection plane on the basis of the basic image. The adjusted positional relationship is generated according to each reference projection position detected by the detecting means, and the adjusted image generating means for generating the adjusted basic images, respectively, and the adjusted image generating means. A display image generating unit that generates a display image by synthesizing the adjusted basic images with each other is provided.

  The invention of claim 2 is an image processing apparatus for generating a display image based on three-dimensional data, and shows a structure of a virtual three-dimensional object configured by a set of specific structures facing a predetermined direction. Reading means for reading three-dimensional data into a predetermined storage means; a projection plane setting means for setting a relative direction relationship between a virtual projection plane for projecting the virtual three-dimensional object and the virtual three-dimensional object; and the predetermined direction A basic structure setting means for setting a plurality of basic structures each configured by an array pattern of at least one specific structure in a unit processing target region in which a predetermined number of specific structures facing the surface can be arranged; The reference position setting means for setting the reference position of the basic structure of the plurality of patterns, and the basic structure of the plurality of patterns in accordance with the direction relationship. While generating a plurality of patterns of basic images by projecting each on a virtual projection plane, for each of the basic images of the plurality of patterns, each reference image position corresponding to the reference position of the basic structure of the plurality of patterns is recognized. An area for designating unit processing target areas to be projected among time-sequential out of three-dimensional areas to be processed when projecting the virtual three-dimensional object onto the virtual projection plane. A first detection unit that detects a matching basic structure from the plurality of basic structures in the unit processing target region specified by the region specification unit; and the first detection unit A basic image corresponding to the basic structure detected by the extraction means for extracting the basic image from the plurality of patterns of basic images, and a detection by the first detection means. A second detection unit that detects a reference projection position at which the reference position of the basic structure is projected onto the virtual projection plane; and a basic image extracted by the extraction unit, with respect to the virtual projection plane An adjusted image generating unit that generates an adjusted basic image by adjusting a relative position according to the reference projection position, and an adjusted image generated by the adjusted image generating unit for each unit processing target area And display image generation means for generating a display image by synthesizing the basic images with each other.

  According to a third aspect of the present invention, there is provided an image processing apparatus that generates a distance map based on three-dimensional data, and shows a structure of a virtual three-dimensional object configured by a set of specific structures facing a predetermined direction. Reading means for reading dimensional data into a predetermined storage means; a virtual projection plane for projecting the virtual three-dimensional object; and a projection plane setting means for setting a relative position and direction relationship between the virtual three-dimensional object; Reference position setting means for setting a reference position for the structure, and a reference projection position at which the reference position of one specific structure facing the predetermined direction is projected onto the virtual projection plane according to the position and direction relationship , And a reference projection distance corresponding to a distance between the reference position and the reference projection position, and each predetermined point on the virtual projection plane and the one specific structure A basic distance map generating means for generating a basic distance map indicating a distribution of distances between the virtual projection plane and the one specific structure based on the reference projection distance by detecting each projection distance corresponding to a distance of Detection means for detecting each reference projection position and each reference projection distance corresponding to each specific structure on the virtual projection plane for each specific structure constituting the virtual three-dimensional object, and the basic distance Based on the map, each adjustment is performed by adjusting the relative positional relationship and each projection distance with respect to the virtual projection plane according to each reference projection position and each reference projection distance detected by the detection unit. The adjustment map generation means for generating the rear basic distance map and the adjusted basic distance map generated by the adjustment map generation means An overall distance map that indicates the distribution of the distance between the virtual three-dimensional object and the virtual projection plane by adopting the minimum projection distance for projection positions where a plurality of adjusted basic distance maps overlap in the virtual projection plane. And a distance map generating means for generating.

  According to a fourth aspect of the present invention, there is provided an image processing apparatus that generates a distance map based on three-dimensional data, and shows a structure of a virtual three-dimensional object configured by a set of specific structures facing a predetermined direction. Reading means for reading the three-dimensional data into a predetermined storage means; a projection plane setting means for setting a relative position and direction relationship between the virtual projection plane for projecting the virtual three-dimensional object and the virtual three-dimensional object; Basic structure setting means for setting a plurality of basic structures each configured by an array pattern of at least one specific structure in a unit processing target region in which a predetermined number of specific structures facing the direction can be arranged; , Reference position setting means for setting a reference position of the basic structure of the plurality of patterns, and the position of the basic structure of the plurality of patterns And a reference projection position at which a reference position is projected onto the virtual projection plane according to a direction relationship and a reference projection distance corresponding to a distance between the reference position and the reference projection position, and a predetermined projection on the virtual projection plane By detecting each projection distance corresponding to the distance between each point and each basic structure, a plurality of patterns each indicating a distribution of distances between the virtual projection plane and each basic structure based on the reference projection distance Basic map generating means for generating a basic distance map, area specifying means for sequentially specifying unit processing target areas to be projected among three-dimensional areas to be processed, and units specified by the area specifying means A processing target region is detected by a first detection unit that detects a matching basic structure from the plurality of patterns of basic structures, and the first detection unit. An extraction means for extracting a basic distance map corresponding to the basic structure formed from the plurality of patterns of basic distance maps, and a reference position of the basic structure detected by the first detection means is relative to the virtual projection plane. Based on the basic distance map extracted by the extraction means, the second detection means for detecting the projected reference projection position and the reference projection distance corresponding to the reference projection position, respectively, the second detection means An adjustment map generating means for generating an adjusted basic distance map by adjusting a relative position with respect to the virtual projection plane and each projection distance, respectively, according to the reference projection position and the reference projection distance detected by And a plurality of adjusted basic distances among the virtual projection planes while combining the adjusted basic distance maps generated by the adjustment map generating means with each other. A distance map generating unit that generates a total distance map indicating a distribution of distances between the virtual three-dimensional object and the virtual projection plane by adopting a minimum projection distance for the projection positions where the separation maps overlap. It is characterized by that.

  The invention of claim 5 is a program that, when executed on a computer, causes the computer to function as an image processing device that generates a display image based on three-dimensional data. Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing the direction, a virtual projection plane for projecting the virtual three-dimensional object, and the virtual 3 A projection plane setting means for setting a relative direction relationship with a three-dimensional object, a reference position setting means for setting a reference position for the specific structure, and one specific structure facing the predetermined direction as the direction relationship. Corresponding to the reference position in the basic image while generating a basic image by projecting onto the virtual projection plane according to Basic image generating means for recognizing a quasi-image position, and when projecting the virtual three-dimensional object onto the virtual projection plane, each reference position of each specific structure is projected onto the virtual projection plane. By adjusting the relative positional relationship with respect to the virtual projection plane based on the basic image based on the detection means for detecting the reference projection position and the reference projection position detected by the detection means, An adjusted image generating means for generating an adjusted basic image, and a display image generating means for generating a display image by mutually synthesizing the adjusted basic images generated by the adjusted image generating means, It is characterized by providing.

  The invention according to claim 6 is the program according to claim 5, wherein the basic image generation means includes a reference projection position corresponding to a reference position of the one specific structure, and the reference position and the reference. A reference projection distance corresponding to a distance from the projection position is detected, each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and the one specific structure is detected, and the reference projection distance is used as a reference. By providing each projection distance value indicating each projection distance and each pixel value corresponding to each projection distance as a set to each pixel of the basic image, the basic image is generated, The detection means further detects each reference projection distance corresponding to each reference projection position, and the adjusted image generation means uses each reference projection position and each reference projection detected by the detection means based on the basic image. distance And adjusting the relative positional relationship with respect to the virtual projection plane, each projection distance value, and each pixel value to generate an adjusted basic image, and the display image generation means When combining a plurality of post-adjustment basic images in the virtual projection plane when synthesizing the subsequent basic images with each other, a projection distance value indicating the minimum projection distance and a pixel value corresponding to the projection distance It is characterized by adopting a set of

  The invention according to claim 7 is a program for causing a computer to function as an image processing device that generates a display image based on three-dimensional data by being executed in the computer. Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing the direction, a virtual projection plane for projecting the virtual three-dimensional object, and the virtual 3 An arrangement pattern of at least one or more specific structures in a unit processing target area in which a projection plane setting means for setting a relative direction relationship with a three-dimensional object and a predetermined number of specific structures facing the predetermined direction can be arranged Basic structure setting means for setting a plurality of patterns of basic structures respectively configured by the plurality of patterns, and the plurality of patterns While generating a basic image of a plurality of patterns by projecting the basic structure of the plurality of patterns on the virtual projection plane according to the directional relationship, a reference position setting unit that sets a reference position of the basic structure, For each basic image of the plurality of patterns, basic image generation means for recognizing each reference image position corresponding to a reference position of the basic structure of the plurality of patterns, and projecting the virtual three-dimensional object onto the virtual projection plane When performing, among the three-dimensional regions to be processed, an area designating unit for designating unit processing target regions to be projected in time sequence, and the unit processing target region designated by the region designating unit, the plurality of patterns First detecting means for detecting a matching basic structure from the basic structures, and a group detected by the first detecting means. Extraction means for extracting a basic image corresponding to a structure from the basic images of the plurality of patterns, and reference projection in which a reference position of the basic structure detected by the first detection means is projected onto the virtual projection plane Based on the second detection means for detecting the position and the basic image extracted by the extraction means, the relative position with respect to the virtual projection plane is adjusted according to the reference projection position, thereby adjusting the adjusted basic image. An adjustment image generation unit that generates a display image by synthesizing the adjusted basic images generated by the adjustment image generation unit with respect to each unit processing target region. It is characterized by providing.

  The invention according to claim 8 is the program according to claim 7, wherein the basic image generation unit, for each of the basic structures, a reference projection position corresponding to a reference position, the reference position, and the reference A reference projection distance corresponding to a distance from the projection position is detected, each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and each basic structure is detected, and the reference projection distance is used as a reference. The basic image is generated by giving each projection distance value indicating each projection distance and each pixel value corresponding to each projection distance as a set to each pixel of the basic image, and generating the basic image The second detection means further detects a reference projection distance corresponding to the reference projection position, and the adjustment image generation means uses the reference projection position and the reference projection based on the basic image extracted by the extraction means. In accordance with the distance, by adjusting the relative positional relationship with respect to the virtual projection plane, each projection distance value, and each pixel value, respectively, an adjusted basic image is generated. When the adjusted basic images are combined with each other, a projection distance value indicating a minimum projection distance and a pixel corresponding to the projection distance for a projection position where a plurality of adjusted basic images overlap in the virtual projection plane. It is characterized by adopting a pair with a value.

  The invention according to claim 9 is a program for causing a computer to function as an image processing device that generates a distance map based on three-dimensional data by being executed in the computer, wherein the image processing device has a predetermined direction. Reading means for reading the three-dimensional data indicating the structure of the virtual three-dimensional object constituted by a set of specific structures facing to the predetermined storage means, a virtual projection plane for projecting the virtual three-dimensional object, and the virtual three-dimensional A projection plane setting unit that sets a relative position and direction relationship with an object, a reference position setting unit that sets a reference position for the specific structure, and one that faces the predetermined direction according to the position and direction relationship. A reference projection position at which the reference position of the specific structure is projected onto the virtual projection plane, and the reference position and the reference A reference projection distance corresponding to a distance from the projection position is detected, and each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and the one specific structure is detected, thereby making the reference projection distance a reference. The basic distance map generating means for generating a basic distance map indicating the distribution of the distance between the virtual projection plane and the one specific structure, and for each specific structure constituting the virtual three-dimensional object, Detection means for detecting each reference projection position and each reference projection distance corresponding to each specific structure on the virtual projection plane, each reference projection position detected by the detection means based on the basic distance map, and each Each adjusted basic distance map is generated by adjusting the relative positional relationship with respect to the virtual projection plane and each projection distance according to the reference projection distance. An adjustment map generating unit and each adjusted basic distance map generated by the adjustment map generating unit are combined with each other, and a projection position where a plurality of adjusted basic distance maps of the virtual projection plane overlap is minimum. And a distance map generating means for generating an overall distance map indicating a distribution of projection distances between the virtual three-dimensional object and the virtual projection plane.

  According to a tenth aspect of the present invention, there is provided a program for causing a computer to function as an image processing device that generates a distance map based on three-dimensional data by being executed in the computer, wherein the image processing device has a predetermined direction. Reading means for reading the three-dimensional data indicating the structure of the virtual three-dimensional object constituted by a set of specific structures facing to the predetermined storage means, a virtual projection plane for projecting the virtual three-dimensional object, and the virtual three-dimensional Arrangement of at least one or more specific structures in a unit processing target area in which a projection plane setting means for setting a relative position and direction relationship with an object and a predetermined number of specific structures facing the predetermined direction can be arranged Basic structure setting means for setting a basic structure of a plurality of patterns each configured by a pattern; A reference position setting means for setting a reference position of a basic structure of a pattern; a reference projection position at which a reference position is projected onto the virtual projection plane in accordance with the position and direction relation of the basic structures of the plurality of patterns; and Detecting a reference projection distance corresponding to a distance between the reference position and the reference projection position, and detecting each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and each basic structure, A basic map generating means for generating a plurality of patterns of basic distance maps each indicating a distribution of distances between the virtual projection plane and the basic structures based on a reference projection distance; and a three-dimensional region to be processed, An area designating unit that sequentially specifies unit processing target areas to be projected, and a unit processing target area designated by the area designating unit, First detection means for detecting a matching basic structure from among several basic structures, and a basic distance map corresponding to the basic structure detected by the first detection means. Extraction means for extracting from the distance map; reference projection position at which the reference position of the basic structure detected by the first detection means is projected onto the virtual projection plane; and reference projection corresponding to the reference projection position A second detection means for detecting each distance, and a basic projection map extracted by the extraction means, based on the reference projection position and the reference projection distance detected by the second detection means, An adjustment map generating means for generating an adjusted basic distance map by adjusting a relative position with respect to the virtual projection plane and each projection distance, and the adjustment map; By combining the adjusted basic distance maps generated by the image generation means with each other and adopting the minimum projection distance for the projection position where a plurality of adjusted basic distance maps overlap among the virtual projection planes. And distance map generating means for generating an overall distance map showing a distribution of projection distances between the virtual three-dimensional object and the virtual projection plane.

  According to the first aspect of the present invention, when a virtual projection plane for projecting a virtual three-dimensional object configured by a set of specific structures facing a predetermined direction is set, While generating a basic image by projecting a specific structure onto a virtual projection plane, a reference image position corresponding to the reference position of one specific structure in the basic image is recognized, and a virtual three-dimensional object is virtually projected When projecting onto a surface, each reference projection position on which the reference position of each specific structure constituting the virtual three-dimensional object is projected is detected, and the basic image on the virtual projection plane is detected according to each reference projection position. The adjusted basic images generated by adjusting the relative positional relationship are combined with each other to generate a display image after a projection plane is set by a configuration that generates a display image. For up to It is possible to reduce the calculation amount, it is possible to perform imaging of volume data at high speed.

  According to the second aspect of the present invention, when a virtual projection plane for projecting a virtual three-dimensional object configured by a set of specific structures facing a predetermined direction is set, first, the virtual direction is directed to the predetermined direction. A plurality of basic patterns can be projected by projecting a plurality of basic patterns each composed of an array pattern of specific structures in a unit processing target area of a predetermined shape in which a predetermined number of specific structures can be arranged, onto a virtual projection plane. While generating an image, among the basic images, a reference image position corresponding to the reference position of the basic structure is recognized, and when a virtual three-dimensional object is projected onto a virtual projection plane, the target is sequentially projected. For each unit processing target area specified in, a matching basic structure is detected, and relative to the virtual projection plane based on the basic image corresponding to the basic structure. By adjusting the position according to the reference projection position on which the reference position of the basic structure is projected, each adjusted basic image is generated, and the adjusted basic images are combined and displayed. With the configuration for generating the image for use, it is possible to reduce the amount of calculation from the setting of the projection plane to the generation of the image for display, so that the volume data can be imaged at high speed.

  According to the third aspect of the present invention, when a virtual projection plane for projecting a virtual three-dimensional object configured by a set of specific structures facing a predetermined direction is set, first, the virtual direction is directed to the predetermined direction. The reference projection position and the reference projection distance at which the reference position of one specific structure is projected onto the virtual projection plane are detected, and the distribution of the distance between the virtual projection plane and the one specific structure based on the reference projection distance is determined. A basic distance map is generated, a reference projection position and a reference projection distance are detected for each specific structure constituting the virtual three-dimensional object, and the basic distance map is determined according to the reference projection position and the reference projection distance. Each of the adjusted basic distance maps with adjusted values is combined with each other, and the projection position where a plurality of adjusted basic distance maps overlap is adopted as the virtual three-dimensional object and the temporary position by adopting the minimum projection distance. With such a configuration to generate the entire distance map showing the distribution of the distance between the projection plane, it is possible to reduce the amount of calculation to produce an overall distance map from the projection plane is set. As a result, it is possible to reduce the amount of calculation for imaging volume data, so that imaging of volume data can be performed at high speed.

  According to the fourth aspect of the present invention, when a virtual projection plane for projecting a virtual three-dimensional object configured by a set of specific structures facing a predetermined direction is set, first, the virtual direction is directed to the predetermined direction. A reference projection in which the reference positions of a plurality of basic structures each composed of an array pattern of specific structures in a unit processing target area of a predetermined shape in which a predetermined number of specific structures can be arranged are projected on a virtual projection plane A three-dimensional object to be processed is generated by detecting a position and a reference projection distance and generating a plurality of patterns of basic distance maps indicating a distribution of distances between the virtual projection plane and each basic structure based on the reference projection distance. For each unit processing target area that is sequentially specified as a projection target in the area, adjustment is performed according to the reference projection position and the reference projection distance based on the corresponding basic distance map. In this way, each adjusted basic distance map is generated and combined with each other, and for the projection position where a plurality of adjusted basic distance maps overlap, a virtual three-dimensional object and a virtual projection are adopted by adopting the minimum projection distance. With the configuration that generates the entire distance map indicating the distribution of the distance to the surface, it is possible to reduce the amount of calculation from when the projection plane is set until the entire distance map is generated. As a result, it is possible to reduce the amount of calculation for imaging volume data, so that imaging of volume data can be performed at high speed.

  Further, according to the invention described in claim 5, the same effect as that of the invention described in claim 1 can be obtained.

  According to the sixth aspect of the present invention, when generating the basic image, the reference projection position and the reference projection distance at which the reference position of one specific structure is projected onto the virtual projection plane are detected. In addition, each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and one specific structure is detected, each projection distance value indicating each projection distance with reference to the reference projection distance, and each projection distance The basic image is generated by giving each pixel value corresponding to each pixel as a set to each pixel of the basic image, and the reference projection position relating to each specific structure constituting the virtual three-dimensional object Each of the adjusted basic images generated by adjusting the basic image according to the reference projection distance is synthesized with each other, and the projection position where a plurality of adjusted basic images overlap indicates the minimum projection distance. The projection distance value and the projection distance Generates a display image according to the distance between the three-dimensional object and the projection plane, that is, a display image that allows the user to visually recognize the depth, by adopting a configuration that employs a set of pixel values to be used. can do.

  According to the seventh aspect of the invention, the same effect as that of the second aspect of the invention can be obtained.

  According to the eighth aspect of the present invention, when generating the basic image, the reference projection position and the reference projection distance at which the reference position is projected onto the virtual projection plane are detected for each basic structure. In addition, each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and each basic structure is detected, and each projection distance value indicating each projection distance based on the reference projection distance is set to each projection distance. Each set of corresponding pixel values is given to each pixel of the basic image to generate a plurality of patterns of basic images. For each unit processing target area, a reference projection position, a reference projection distance, To extract a basic image that matches each unit processing target area, and based on the extracted basic image, a relative positional relationship with the virtual projection plane according to the reference projection position and the reference projection distance , Each projection distance value, and When adjusting each pixel value to generate an adjusted basic image and combining the adjusted basic images with each other, the projection position where a plurality of adjusted basic images overlap in the virtual projection plane is minimum. By adopting a configuration in which a set of a projection distance value indicating the projection distance and a pixel value corresponding to the projection distance is adopted, a display image corresponding to the distance between the three-dimensional object and the projection plane, that is, the depth is obtained. A display image that can be visually recognized by the user can be generated.

  According to the ninth aspect of the invention, the same effect as that of the third aspect of the invention can be obtained.

  Further, according to the invention described in claim 10, the same effect as that of the invention described in claim 4 can be obtained.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
<Outline of image processing system>
FIG. 1 is a diagram illustrating an overview of an image processing system 1 according to an embodiment of the present invention.

  The image processing system 1 includes a personal computer (hereinafter simply referred to as a “personal computer”) 2, a monitor 3 and a mounting unit 5 that are connected to the personal computer 2 so as to be able to transmit and receive data, and a user who makes various selections on the personal computer 2 And an operation unit 4 for inputting.

  The personal computer 2 includes a control unit 20, an input / output I / F 21, and a storage unit 22.

  The input / output I / F 21 is an interface (I / F) for transmitting and receiving data between the personal computer 2 and the monitor 3, the operation unit 4, and the mounting unit 5. Send and receive.

  The storage unit 22 is composed of, for example, a hard disk or the like, and stores an image processing program PG for realizing visualization (imaging) of volume data described later.

  The control unit 20 mainly includes a CPU, a ROM 20a, a RAM 20b, and the like, and is a part that performs overall control of each unit of the personal computer 2. The control unit 20 reads the image processing program PG stored in the storage unit 22 and executes it by the CPU, thereby generating display image data (also referred to as “display image”) based on the volume data. Then, the display image is output to the monitor 3 via the input / output I / F 21. Thus, the personal computer 2 functions as an image processing device that generates a display image based on the volume data.

  The monitor 3 is configured by a CRT, for example, and visually outputs a display image generated by the control unit 20. That is, a display image based on the display image is displayed.

  The operation unit 4 includes a keyboard, a mouse, and the like, and transmits various electrical signals to the input / output I / F 21 in accordance with various user operations. The mounting unit 5 can detachably mount a storage medium such as the memory card 51. Various data, programs, and the like stored in the memory card 51 attached to the attachment unit 5 can be taken into the control unit 20 and the storage unit 22 via the input / output I / F 21.

<Image of volume data>
Here, a technique called voxel expression is used in which an object is expressed by a set having a very small cube (or rectangular parallelepiped) as an element. And the cube (or rectangular parallelepiped) as this element is called a voxel.

  In general, by using a CT scan (Computed Tomography Scan) using X-rays, it is possible to obtain an image when a human body is cut into circles. Then, by shifting the position of this ring cutting and changing the cutting direction up, down, front, back, left, and right, data storing the X-ray absorption amount for each voxel can be obtained. Data representing the density and density distribution in the three-dimensional space is called “volume data”. This volume data is obtained by dividing a three-dimensional region to be represented by the volume data, that is, a three-dimensional region corresponding to the volume data into a plurality of voxels, and one voxel value (here, X-ray) Is a given data (three-dimensional data). Then, the three-dimensional area corresponding to the volume data is a target of calculation processing in the volume data imaging.

  2 and 3 are flowcharts showing an operation flow for imaging volume data. This operation flow is realized by the control unit 20 reading and executing the image processing program PG stored in the storage unit 22. Here, first, when the user performs various operations on the operation unit 4 to start imaging volume data (generation of a display image) in the image processing system 1, the process proceeds to step S1 in FIG.

  In step S1, the volume data stored in the memory card 51, the storage unit 22, etc. is read and acquired by the control unit 20, and the process proceeds to step S2. Here, the volume data is temporarily stored in the RAM 20b or the like. Here, preprocessing such as noise removal filtering may be performed on the volume data.

  In step S2, the volume data is binarized, and the process proceeds to step S3. Here, the volume data acquired in step S1 is binarized with the voxel values included in the predetermined range and the voxel values that are not, so that the three-dimensional region related to the volume data is imaged. A distinction is made between two regions, a region where a three-dimensional object exists and a region where it does not. By such processing, the structure of the three-dimensional object to be imaged is shown as being constituted by a set of voxels (also referred to as “specific structures”, that is, “specific structures”) oriented in a predetermined direction. Dimension data (also referred to as “three-dimensional object data”) is generated. In other words, a three-dimensional object that is an object of imaging is made manifest. In addition, the three-dimensional object data generated here is read into the RAM 20b and temporarily stored.

  FIG. 4 is a schematic diagram illustrating an example of a three-dimensional object represented by a set of voxels. FIG. 4 shows an XYZ three-dimensional orthogonal coordinate system in order to clarify the direction in which the voxels are arranged. Here, the directions of the sides of the voxels are along the X, Y, and Z axes, respectively. The voxels are arranged adjacent to each other so that their faces completely coincide. 4 and subsequent drawings also show the same XYZ three-dimensional orthogonal coordinate system in order to clarify the direction in which voxels are arranged.

  Here, as shown in FIG. 4, a plurality of voxels, that is, a plurality of specific structures SS, are stacked adjacent to each other on the data, thereby virtually forming a three-dimensional object TB. In the following processing, as an example, a description will be given assuming that the virtual three-dimensional object (also referred to as “virtual three-dimensional object”) illustrated in FIG. 4 is imaged.

  In step S3, a projection plane for projecting a three-dimensional object into an image is virtually set, and the process proceeds to step S4. Here, for example, in response to the operation of the operation unit 4 by the user, as shown in FIG. 5, a virtual projection plane (also referred to as “virtual projection plane”) SC at an arbitrary position around the three-dimensional object TB. Can be set. Here, for example, in the reference coordinate system (three-dimensional orthogonal coordinate system), by determining the posture and position of both the projection surface SC and the three-dimensional object TB, the projection surface SC and the three-dimensional object TB Relative azimuth | direction relationship and positional relationship can be set.

  In step S4, the reference point of the voxel (specific structure) is set, and the process proceeds to step S5. Here, for example, as shown in FIG. 6A, the center point (center of gravity) of the voxel is set as a reference point (also referred to as “reference position”) SP1.

  In step S5, according to the relative orientation relation between the voxels constituting the three-dimensional object and the projection plane SC, one voxel is normally projected on the projection plane SC, whereby image data (image data of one voxel) ( (Also referred to as “basic image”), and the process proceeds to step S6. Here, regarding the projection plane SC, points corresponding to the respective pixels of the basic image and the display image to be described later are hereinafter referred to as “pixel corresponding points”. In step S5, a voxel is projected along a number of lines of sight set at predetermined intervals, thereby generating a basic image SI (FIG. 6B) SI composed of pixels corresponding to the lines of sight.

  Here, first, a distance value (also referred to as a “reference projection distance value”) indicating a distance from the reference point SP1 of one voxel to the projection plane SC, that is, a distance for projecting the reference point SP1 (also referred to as “reference projection distance”). Dst) is detected. The reference projection distance corresponds to the distance between the reference point SP1 and a position on the projection plane SC on which the reference point SP1 is projected (also referred to as “reference projection position”).

  Next, distance values (also referred to as “projection distance values”) Dpa indicating the shortest distance (also referred to as “projection distance”) between the voxel and each pixel corresponding point on which the voxel is normally projected are detected. Further, a difference value (ΔD = Dpa−Dst) between the reference projection distance value Dst and the projection distance value Dpa is calculated for each pixel corresponding point. Then, a projection distance value Dpa corresponding to each pixel and a pixel value Vc corresponding to the projection distance value Dpa corresponding to each pixel are given to each pixel of the basic image.

  For example, the shorter the distance from the projection plane SC to the specific structure (voxel), the higher the luminance, that is, the larger the pixel value is given, while the longer the distance from the projection plane SC to the specific structure TB is. The longer the value, the lower the luminance, that is, a smaller pixel value is given. Specifically, the gradation indicating the luminance is changed at every predetermined distance, for example, the gradation indicating the luminance is changed by 10 with respect to the length of one side of the voxel. Can do.

  However, here, each projection distance value Dpa corresponding to each pixel of the basic image is represented by the sum of the reference projection distance value Dst and the difference value ΔD corresponding to each pixel, that is, the following expression (1). Can do.

    Dpa = Dst + ΔD (1).

  Therefore, here, each pixel of the basic image is provided with the reference projection distance value Dst and the difference value ΔD, thereby indirectly providing the projection distance value Dpa. That is, each projection distance value Dpa indicating each projection distance is given by a function (the above formula (1)) based on the reference projection distance value Dst. Further, the pixel value Vc assigned to each pixel of the basic image is expressed by a function of the projection distance value Dpa, that is, by a function based on the reference projection distance value Dst. It is set so as to change according to the increase / decrease of the projection distance value Dpa according to the change of Dst. This is because the projection distance value Dpa and the pixel value Vc can be appropriately changed according to the change of the reference projection distance value Dst in order to generate a display image to be described later. .

  In this way, in step S5, each projection distance value Dpa indicating each projection distance with reference to the reference projection distance value Dst and each pixel value Vc corresponding to each projection distance value Dpa are taken as a set to form a basic image. A basic image is generated by assigning to each of the pixels.

  Further, in step S5, as shown in FIG. 6B, the position of the image corresponding to the point on the projection plane SC on which the reference point SP1 of the specific structure is projected in the basic image SI (“reference image position”). Also, data for identifying the reference image position SP2 is included in the basic image SI. That is, among all the pixels of the basic image SI, for the pixel corresponding to the reference image position SP2, the pixel value Vc, the projection distance value Dpa (actually, the reference projection distance value Dst and the difference value ΔD), and the reference image position SP2 And information specifying that the pixel corresponds to.

  In step S6, the display image is generated by projecting the three-dimensional object TB onto the projection plane SC, and the process proceeds to step S7. Here, if it progresses from step S5 to step S6, it will progress to step S61 of FIG.

  In step S61, as shown in FIG. 7, one voxel (for example, a voxel hatched in FIG. 7) among all the voxels constituting the three-dimensional region related to the voxel data is designated, and in step S62, move on. Here, every time the process returns from step S64, one voxel among all the voxels is sequentially specified according to a predetermined rule, so that all the voxels are finally specified. Note that, here, not all the voxels constituting the three-dimensional region related to the voxel data are designated in time sequence, but only all the voxels constituting the three-dimensional object may be designated in time sequence.

  In step S62, for the voxel designated in step S61, the position at which the reference point of the voxel is projected onto the projection plane SC (also referred to as “reference projection position”) and the distance between the reference point and the reference projection position ( A distance value (reference projection distance value) Dst1 indicating the reference projection distance) is detected, and the process proceeds to step S63.

  In step S63, the basic image generated in step S5 is adjusted to fit the voxel specified in step S61 and pasted on the projection plane SC, and the process proceeds to step S64. Here, on the basis of the basic image generated in step S5, the reference projection distance value Dst1 detected in step S62 is substituted into Dst in the above equation (1), so that the projection distance value Dpa and the pixel for each pixel are substituted. While the value Vc is adjusted, the basic image (“after adjustment” in which the relative positional relationship with respect to the projection plane SC is adjusted so that the reference projection position detected in step S62 matches the reference image position of the basic image. Also referred to as “basic image”). Then, the adjusted basic image is pasted on the projection surface SC.

  Here, the process flow returns from step S64 described later to step S61, whereby the process of step S63 is repeated a plurality of times. By doing so, a plurality of adjusted basic images are combined with each other, and finally a display image is generated. However, when a plurality of adjusted basic images are combined with each other, a position (specifically, a pixel corresponding point, also referred to as a “projection position”) where the plurality of adjusted basic images overlap in the projection plane SC. appear. FIG. 8 is a diagram visually showing a phenomenon in which a plurality of adjusted basic images overlap with respect to the projection plane SC. In FIG. 8, an area RA where the two adjusted basic images SI1 and SI2 are overlapped with each other and pasted onto the projection plane SC is indicated by hatching. Thus, for a projection position where a plurality of adjusted basic images overlap, a set of the projection distance value Dpa indicating the relatively smallest projection distance and the pixel value Vc corresponding to the projection distance value Dpa is preferential. Adopted.

  In step S64, it is determined whether all the voxels constituting the three-dimensional area related to the voxel data are designated in step S61. Here, if all the voxels have not yet been designated, the process returns to step S61, and the process of steps S61 to S64 is repeated until all the voxels are designated, thereby adjusting the adjusted basic image for each voxel. (Adjusted basic image) is pasted on the projection surface SC. On the other hand, if all the voxels have already been designated, an image generated by combining a plurality of adjusted basic images is adopted as the display image (FIG. 9), and the display image generation processing is terminated. The process proceeds to step S7.

  In step S7, the display image generated in step S6 is output to the monitor 3, and the process proceeds to step S8. Here, the display image is output to the monitor 3, and the display image is visually output on the monitor 3. That is, an image based on the display image is displayed on the monitor 3.

  In step S8, based on the operation of the operation unit 4 by the user, it is determined whether or not an instruction (change instruction) for changing a projection plane for projecting a three-dimensional object into an image has been made. Here, if there is an instruction to change the projection plane, the process returns to step S3, and the processes from step S3 to step S8 are performed. On the other hand, if there is no instruction to change the projection plane, the determination in step S8 is repeated.

  Here, for example, by forcibly terminating the operation flow related to imaging of volume data in accordance with the operation of the operation unit 4 by the user, the operation flow shown in FIGS. It is possible to escape.

  As described above, in the image processing system 1 according to the first embodiment, when performing imaging based on voxel data, first, the projection plane SC on which the three-dimensional object TB is projected is set. Then, by projecting one voxel facing a predetermined direction onto the projection plane SC, the reference image position SP2 corresponding to the reference position SP1 of the voxel and the projection distance (reference projection distance value Dst) of the reference position SP1 are detected. Is done. Then, data expressing a set of the projection distance value Dpa and the pixel value Vc corresponding to each pixel corresponding point on the projection surface SC by the reference projection distance value Dst is given to each pixel, and the reference image position SP2 is set. A basic image with clearly indicated data is generated. Next, when projecting the three-dimensional object TB onto the projection plane SC, each reference projection position at which the reference position of each voxel is projected and the reference projection distance value Dst1 for each reference position are detected. Then, the adjusted basic images generated by adjusting the basic images according to the respective reference projection positions and the respective reference projection distance values Dst1 are combined with each other to generate a display image. However, when synthesizing the adjusted basic image, for a projection position where a plurality of adjusted basic images overlap, a set of a projection distance value indicating the minimum distance and a pixel value corresponding to the projection distance value is given priority. To adopt.

  That is, a basic image corresponding to one voxel is generated in advance, and a basic image adjusted to match each voxel (adjusted basic image) is combined with each other to generate a display image. To do. With such a configuration, the projection plane is compared with the conventional method in which each pixel value of the display image is determined while determining the depth relationship between the voxels while projecting each voxel. It is possible to greatly reduce the amount of calculation from when the is set to when the display image is generated. As a result, volume data can be imaged at high speed.

  Further, since a pixel value corresponding to the projection distance value Dpa is given to each pixel of the display image, a display image corresponding to the distance between the three-dimensional object and the projection plane SC, that is, the depth is given to the user. A display image that can be visually recognized can be generated.

Second Embodiment
In the image processing system 1 according to the first embodiment described above, a three-dimensional object is projected without generating a map (referred to as a distance map or a depth map) indicating the distribution of the distance between the projection plane and the three-dimensional object. An image for display was generated by direct projection onto the surface. In contrast, in the image processing system 1A according to the second embodiment, when a projection plane is set, a distance map is first generated, and then a general ray casting method or the like is used while using the distance map. A display image is generated by volume rendering using.

  The image processing system 1A according to the second embodiment has the same configuration as that of the image processing system 1 according to the first embodiment, and only the operation of converting volume data into an image is different. In the volume data imaging according to the second embodiment, the amount of calculation for generating the distance map is reduced, thereby reducing the amount of calculation in the entire imaging, and thus realizing high-speed imaging. .

  Hereinafter, with respect to the same configuration as that of the image processing system 1 according to the first embodiment, the same reference numerals are given, and the description is omitted, and the operation flow for generating the distance map corresponding to the feature point of the second embodiment is mainly described. explain.

<Distance map generation operation>
FIG. 10 and FIG. 11 are flowcharts showing a distance map generation operation flow in the image processing system 1A. This operation flow is realized by the control unit 20 reading and executing the image processing program PG stored in the storage unit 22. Here, first, when the user performs various operations on the operation unit 4 to start imaging volume data (generation of a display image) in the image processing system 1, the process proceeds to step S11 in FIG.

  In steps S11 to S14, the same processes as in steps S1 to S4 of the first embodiment are performed, respectively, and the process proceeds to step S15.

  In step S15, one voxel (also referred to as “model voxel”) arranged as a model in accordance with the relative orientation relationship between the voxels constituting the three-dimensional object and the projection plane SC, and the projection plane SC set in step S13. A distance map (also referred to as a “basic distance map”) indicating the distribution of the distance is generated, and the process proceeds to step S16. In this step S15, data indicating the distance between the model voxel and the projection plane is given to the pixel corresponding to each line of sight by projecting the model voxel along a number of lines of sight set at predetermined intervals. Thus, a basic distance map is generated.

  Here, first, a distance value (reference projection distance value) Dst indicating the distance (reference projection distance) from the reference point SP1 of the model voxel to the projection surface SC is detected. Next, a distance value (projection distance value) Dpa indicating the shortest distance (projection distance) between the model voxel and each pixel corresponding point on which the model voxel is normally projected is detected. Further, a difference value (ΔD = Dpa−Dst) between the reference projection distance value Dst and the projection distance value Dpa is calculated for each pixel corresponding point. Then, a projection distance value Dpa corresponding to each pixel is assigned to each pixel of the basic distance map.

  However, here, each projection distance value Dpa corresponding to each pixel of the basic distance map is the sum of the reference projection distance value Dst and the difference value ΔD corresponding to each pixel, that is, the above expression (1). be able to.

  Therefore, here, each pixel of the basic distance map is provided with the reference projection distance value Dst and the difference value ΔD, thereby indirectly providing the projection distance value Dpa. That is, each projection distance value Dpa indicating each projection distance is given by a function (the above formula (1)) based on the reference projection distance value Dst. This is because the projection distance value Dpa is used as the reference projection distance in order to generate a distance map (also referred to as “overall distance map”) indicating the distribution of the distance between the entire three-dimensional object and the projection plane SC, which will be described later. This is because it can be appropriately changed according to the change of the value Dst.

  In this way, in step S15, a basic distance map indicating the distribution of the distance between the projection plane SC and the model voxel with the reference projection distance value Dst as a reference is generated.

  In step S15, the position (reference projection position) at which the voxel reference point SP1 is projected onto the projection plane SC is recognized, and data for specifying the reference projection position is also included in the basic distance map. That is, out of all the pixels in the basic distance map, the pixel corresponding to the reference projection position is given the projection distance value Dpa and information specifying that the pixel corresponds to the reference projection position.

  In step S16, an entire distance map relating to the entire three-dimensional object is generated, and the process proceeds to step S17. Here, if it progresses from step S15 to step S16, it will progress to step S161 of FIG.

  In step S161, as in step S61 of the first embodiment, one voxel is designated among all the voxels constituting the three-dimensional region related to the voxel data, and the process proceeds to step S162. Here, every time the process returns from step S164, one voxel of all the voxels is sequentially specified according to a predetermined rule, and finally all the voxels are specified.

  In step S162, for the voxel designated in step S161, the position (reference projection position) at which the reference point of the voxel is projected onto the projection plane SC is detected, and the distance between the reference point and the projection plane SC. (In other words, the reference projection distance value Dst1) is detected, and the process proceeds to step S163.

  In step S163, the basic distance map generated in step S15 is adjusted in accordance with the reference projection position detected in step S162 and the reference projection distance value Dst1, and pasted on the projection plane SC, and the process proceeds to step S164. move on. Here, based on the basic distance map generated in step S15, the projection distance value Dpa for each pixel is adjusted by substituting the reference projection distance value Dst1 detected in step S162 into the above equation (1). In addition, the basic distance map (“adjustment”) in which the relative positional relationship with respect to the projection plane SC is adjusted so that the reference projection position detected in step S162 matches the pixel corresponding to the reference projection position of the basic distance map. Also referred to as “back basic distance map”). Then, the adjusted basic distance map is pasted on the projection plane SC.

  Here, the process flow returns from step S164 to be described later to step S161, so that the process of step S163 is repeated a plurality of times. By doing so, a plurality of adjusted basic distance maps are combined with each other, and finally an overall distance map is generated. However, when a plurality of adjusted basic distance maps are combined with each other, a position (specifically, a pixel corresponding point, in other words, a projection position) on the projection plane SC where the plurality of adjusted basic distance maps overlap. ) Occurs. For such pixel corresponding points, the projection distance value Dpa indicating the relatively smallest projection distance is preferentially adopted.

  In step S164, it is determined whether all the voxels constituting the three-dimensional area related to the voxel data have been designated. Here, if all the voxels have not yet been designated, the process returns to step S161, and the processes of steps S161 to S164 are repeated until all the voxels are designated, thereby adjusting the adjusted basic distance for each voxel. A map (adjusted basic distance map) is pasted on the projection surface SC. On the other hand, if all the voxels have already been designated, the distance map generated by combining a plurality of adjusted distance maps is adopted as the entire distance map, and the generation process of the entire distance map is terminated, and the step of FIG. Proceed to S17.

  In step S17, it is determined whether or not an instruction (change instruction) for changing the projection plane for projecting a three-dimensional object into an image is made based on the operation of the operation unit 4 by the user. Here, if there is an instruction to change the projection plane, the process returns to step S13, and the processing from step S13 to step S17 is performed. On the other hand, if there is no instruction to change the projection plane, the determination in step S17 is repeated.

  Here, for example, the operation flow related to imaging of volume data is forcibly terminated in accordance with the operation of the operation unit 4 by the user or the like, thereby forcibly leaving the operation flow shown in FIGS. 10 and 11. It is possible.

  When the projection plane SC is set and the entire distance map is generated, a display image is generated by volume rendering using a general ray casting method or the like while using the entire distance map.

  As described above, in the image processing system 1A according to the second embodiment, when imaging based on voxel data is performed, when the projection plane SC for projecting the three-dimensional object TB is set, the three-dimensional object TB and the projection plane are set. An overall distance map showing the distribution of distances with the SC is generated. When generating the entire distance map, first, the reference projection position corresponding to the reference position SP1 of one model voxel facing a predetermined direction and the projection distance (reference projection distance) Dst of the reference position SP1 are detected. Then, data expressing each projection distance value Dpa corresponding to each pixel corresponding point by the reference projection distance value Dst is given to each pixel, and data clearly indicating the pixel corresponding to the reference projection position is given. A basic distance map is generated. Next, each reference projection position where the reference position of each voxel for the entire three-dimensional object TB is projected is detected, and a distance (reference projection distance) Dst1 between each reference position and each reference projection position is detected. Then, the adjusted basic distance maps obtained by adjusting the basic distance map according to each reference projection position and each reference projection distance value Dst1 are combined with each other to generate an overall distance map. However, when combining the adjusted basic distance maps, the projection distance value indicating the minimum distance is preferentially adopted for the position where the plurality of adjusted basic distance maps overlap.

  That is, a basic distance map corresponding to one model voxel is generated in advance, and a basic distance map (adjusted basic distance map) adjusted to match each voxel is synthesized with each other. , An overall distance map is generated. By adopting such a configuration, each point of each voxel is orthographically projected and compared with the conventional method in which a distance value is given to each pixel of the entire distance map while determining the depth relationship. The amount of calculation from the setting of the projection plane to the generation of the entire distance map can be greatly reduced. Therefore, the entire distance map can be generated at high speed, and as a result, volume data can be imaged at high speed.

<Third Embodiment>
In the image processing system 1 according to the first embodiment described above, when a projection plane is set when imaging voxel data, a basic image is generated for the specific structure with one voxel as the specific structure. The display image for the entire three-dimensional object is generated using the basic image. That is, when voxel data is imaged, one voxel is an area corresponding to the minimum unit of projection processing.

  In contrast, in the image processing system 1B according to the third embodiment, a region where a total of eight voxels (generally, specific structures) can be arranged in the XYZ directions corresponds to the minimum unit of projection processing. As a region (also referred to as a “unit processing target region”), a basic image is generated for each of the unit processing target regions for a plurality of patterns of structures configured by switching the presence / absence of voxels. Is used to generate a display image for the entire three-dimensional object.

  The image processing system 1B according to the third embodiment has the same configuration as that of the image processing system 1 according to the first embodiment, and only the operation of volume data imaging is different.

  Hereinafter, with respect to the configuration similar to that of the image processing system 1 according to the first embodiment, the same reference numerals are given, and the description is omitted, while the operation flow of imaging volume data corresponding to the feature point of the third embodiment is omitted. Mainly explained.

<Image of volume data>
12 and 13 are flowcharts showing an operation flow for imaging volume data. This operation flow is realized by the control unit 20 reading and executing the image processing program PG stored in the storage unit 22. Here, first, when the user performs various operations on the operation unit 4 to start imaging volume data (generation of a display image) in the image processing system 1, the process proceeds to step S31 in FIG.

  In steps S31 to S33, processes similar to those in steps S1 to S3 of the first embodiment are performed, respectively, and the process proceeds to step S34.

  In step S34, a cubic shape (or a rectangular parallelepiped shape) in which a total of eight voxels indicating three-dimensional objects are arranged in each of two in the XYZ directions, that is, two in the X direction, two in the Y direction, and two in the Z direction. The region is set as a region (unit processing target region) that is the minimum unit of the projection processing. That is, the three-dimensional area related to the voxel data is divided into a plurality of unit processing target areas. Then, the reference point of the unit processing target area is set, and the process proceeds to step S35. Here, for example, as shown in FIG. 14 (a), the center point (center of gravity) of the unit processing target area (area surrounded by a broken line) MA in which a total of 8 voxels of 2 × 2 × 2 can be arranged Is set as a reference point (also referred to as “reference position”) SP11.

  In step S35, if a combination of the presence / absence of voxels at eight positions where voxels can be arranged is created for the unit processing target region, a total of 256 voxel arrangements can be considered. A structure (also referred to as “basic structure”) to be configured is set, and the process proceeds to step S36.

  FIG. 14A shows an example of a basic structure (solid line portion) in which six voxels are arranged in a unit processing target area (area surrounded by a broken line) MA. It is formed by providing data specifying the configuration of the 256-pattern basic structure, for example, data indicating the presence / absence of voxels at eight positions where voxels can be arranged (also referred to as “possible voxel arrangement positions”). Is temporarily stored in the RAM 20b or the like. Here, the reference point of the unit processing target area MA is also handled as a reference point (also referred to as a reference position) of the basic structure.

  In step S36, the 256-pattern basic structure formed by switching the presence / absence of voxels for the unit processing target area is orthographically projected onto the projection plane SC according to the relative orientation relationship with the projection plane SC. Thus, image data (basic image) obtained by imaging 256 basic structures is generated, and the process proceeds to step S36.

  Here, each basic structure of 256 patterns is projected along a number of lines of sight, thereby generating a basic image (FIG. 14B) 2SI composed of pixels corresponding to the lines of sight.

  In the generation of each basic image for each basic structure, first, the reference point of the basic structure, that is, the distance from the reference point SP11 of the unit processing target area MA to the projection plane SC, that is, the distance for projecting the reference point SP11 (reference A distance value (reference projection distance value) Dst indicating the projection distance) is detected. Note that the reference projection distance corresponds to the distance between the reference point SP11 and the position on the projection surface SC on which the reference point SP11 is projected (reference projection position).

  Next, a distance value (projection distance value) Dpa indicating the shortest distance (projection distance) between the basic structure and each pixel corresponding point on which the basic structure is orthographically projected is detected. Further, a difference value (ΔD = Dpa−Dst) between the reference projection distance value Dst and the projection distance value Dpa is calculated for each pixel corresponding point.

  Then, similarly to step S5 of the first embodiment, for each pixel of the basic image, the projection distance value Dpa corresponding to each pixel and the pixel value Vc corresponding to the projection distance value Dpa corresponding to each pixel. And are given.

  That is, in step S36, for each basic structure of a plurality of patterns, each projection distance value Dpa indicating each projection distance based on the reference projection distance value Dst and each pixel value Vc corresponding to each projection distance value Dpa are obtained. By giving to each pixel of the basic image as a set, a basic image for a plurality of patterns of basic structures is generated.

  Further, in step S36, as shown in FIG. 14B, the position of the image corresponding to the point on the projection plane SC on which the reference point SP11 of the basic structure is projected in the basic image 2SI (reference image position). Recognizing SP12, data for specifying the reference image position SP12 is also included in the basic image. That is, among all the pixels of the basic image 2SI, for the pixel corresponding to the reference image position SP12, the pixel value Vc, the projection distance value Dpa (actually, the reference projection distance value Dst and the difference value ΔD) and the reference image position SP12. And information specifying that the pixel corresponds to.

  The 256 patterns of basic images generated here are temporarily stored as a database (also referred to as “basic image DB”) in the RAM 20b or the storage unit 22 or the like.

  In step S37, the display image is generated by projecting the three-dimensional object TB onto the projection plane SC, and the process proceeds to step S38. Here, if it progresses from step S36 to step S37, it will progress to step S371 of FIG.

  In step S371, as shown in FIG. 15, one unit processing target region (for example, unit processing surrounded by a broken line in FIG. 15) among all unit processing target regions constituting the three-dimensional region related to the voxel data. Target area) 2MA is designated, and the process proceeds to step S372. Here, every time the process returns from step S375, one unit processing target area among all the unit processing target areas is sequentially specified according to a predetermined rule. Specify an area. Here, not all the unit processing target areas constituting the three-dimensional area related to the voxel data are specified in time sequential order, but only the unit processing target areas including the voxels constituting the three-dimensional object are specified in time sequential order. You may make it do.

  In step S372, a basic structure corresponding to the unit processing target area specified in step S371 is detected from the 256 patterns of basic structures set in step S35, and a basic image corresponding to the basic structure is displayed. Detect and proceed to step S373.

  Here, by extracting the combinations of the presence / absence of voxels related to the 256-pattern basic structure stored in the RAM 20b that match the combination of the presence / absence of voxels for the unit processing target area specified in step S371. A basic structure corresponding to the unit processing target area designated in step S371 is detected. Further, a basic image corresponding to the basic structure detected here is extracted from the basic image DB stored in the RAM 20b or the storage unit 22.

  In step S373, with respect to the unit processing target area specified in step S371, the position (reference projection position) at which the reference point of the unit processing target area is projected onto the projection plane SC, and the reference point and the reference projection position. The distance (reference projection distance value) Dst1 is detected, and the process proceeds to step S374.

  In step S374, the basic image extracted in step S372 is adjusted to fit the unit processing target area specified in step S371 and pasted on the projection plane SC, and the process proceeds to step S375. Here, based on the basic image extracted in step S372, the reference projection distance value Dst1 detected in step S373 is substituted into Dst in the above equation (1), so that the projection distance value Dpa and the pixel for each pixel are substituted. While the value Vc is adjusted, the basic image (“post-adjustment”) in which the relative positional relationship with respect to the projection plane SC is adjusted so that the reference projection position detected in step S373 matches the reference image position of the basic image. Also referred to as “basic image”). Then, the adjusted basic image is pasted on the projection surface SC.

  Here, the process flow returns from step S375 described later to step S371, so that the process of step S374 is repeated a plurality of times. By doing so, a plurality of adjusted basic images are combined with each other, and finally a display image is generated. At this time, when a plurality of adjusted basic images are combined with each other, a position (specifically, a pixel corresponding point, in other words, a projection position) where a plurality of adjusted basic images overlap in the projection plane SC. Will occur. Thus, for a projection position where a plurality of adjusted basic images overlap, a set of the projection distance value Dpa indicating the relatively smallest projection distance and the pixel value Vc corresponding to the projection distance value Dpa is preferential. Adopted.

  In step S375, it is determined whether all unit processing target areas constituting the three-dimensional area related to the voxel data have been designated in step S371. Here, if all the unit processing target areas have not been specified yet, the process returns to step S371, and the processing from step S371 to step S375 is repeated until all the unit processing target areas are specified. For the target area, the adjusted basic image (adjusted basic image) is pasted on the projection surface SC. On the other hand, if all the unit processing target areas have already been specified, an image generated by combining a plurality of adjusted basic images is adopted as a display image (for example, FIG. 9), and display image generation processing is performed. And the process proceeds to step S38 in FIG.

  In step S38, the display image generated in step S37 is output to the monitor 3, and the process proceeds to step S39. Here, the display image is output to the monitor 3, and the display image is visually output on the monitor 3. That is, an image based on the display image is displayed on the monitor 3.

  In step S39, based on the operation of the operation unit 4 by the user, it is determined whether or not an instruction (change instruction) for changing a projection plane for projecting a three-dimensional object into an image has been issued. Here, when there is an instruction to change the projection plane, the process returns to step S33, and the processing from step S33 to step S39 is performed. On the other hand, when there is no instruction to change the projection plane, the determination in step S39 is repeated.

  Here, for example, the operation flow related to imaging of volume data is forcibly terminated in accordance with the operation of the operation unit 4 by the user, for example, and the operation flow shown in FIGS. It is possible to escape.

  As described above, in the image processing system 1B according to the third embodiment, when imaging based on voxel data is performed, first, the projection plane SC on which the three-dimensional object TB is projected is set. Then, for a unit processing target area in which a total of eight voxels directed in a predetermined direction, two in each of the XYZ directions, can be arranged, the basic of 256 patterns depending on the combination of the presence / absence of voxels at eight positions where voxels can be arranged A structure is set. Then, the reference image position SP12 corresponding to the reference position SP11 of the unit processing target area is detected, and the projection distance (reference projection distance) Dst of the reference position SP11 is detected. Further, for each of the 256 patterns of basic structures, data expressing a set of projection distance value Dpa and pixel value Vc corresponding to each pixel corresponding point by reference projection distance value Dst is given to each pixel. A basic image to which data clearly indicating the reference image position SP12 is given is generated.

  Next, when projecting the three-dimensional object TB onto the projection surface SC, the basic structure and the basic image corresponding to each unit processing target region are detected, and the reference position of each unit processing target region is projected. The reference projection position and the distance (reference projection distance) Dst1 between each reference position and each reference projection position are detected. Then, the adjusted basic images adjusted in accordance with the respective reference projection positions and the respective reference projection distance values Dst1 are combined with each other, thereby generating a display image. However, when combining adjusted basic images, for pixel corresponding points where a plurality of adjusted basic images overlap, priority is given to the set of the projection distance value indicating the minimum distance and the pixel value corresponding to the projection distance value. To adopt.

  That is, for each unit processing target area where eight voxels can be arranged, a 256-pattern basic structure combining the presence or absence of voxels is set, and each basic image for each basic structure is generated. For each unit processing target region, a basic image (adjusted basic image) adjusted according to the reference projection position and the reference projection distance value is combined with each other to generate a display image. With such a configuration, the projection plane is compared with the conventional method in which each pixel value of the display image is determined while determining the depth relationship between the voxels while projecting each voxel. It is possible to greatly reduce the amount of calculation from when the is set to when the display image is generated. As a result, volume data can be imaged at high speed.

  Further, since a pixel value corresponding to the projection distance value Dpa is given to each pixel of the display image, a display image corresponding to the distance between the three-dimensional object and the projection plane SC, that is, the depth is given to the user. A display image that can be visually recognized can be generated.

<Fourth embodiment>
In the image processing system 1B according to the third embodiment described above, a 3D object is projected without generating a map (referred to as a distance map or a depth map) indicating the distribution of distances between the projection plane and the 3D object. An image for display was generated by direct projection onto the surface. In contrast, in the image processing system 1C according to the fourth embodiment, when a projection plane is set, a distance map is generated, and then a general ray casting method is used while using the distance map. The display image is generated by the volume rendering.

  Note that the image processing system 1C according to the fourth embodiment has the same configuration as the image processing system 1B according to the third embodiment, and only the operation of converting volume data into an image is different. In the volume data imaging according to the fourth embodiment, the calculation amount for generating the distance map is reduced, so that the calculation amount for the entire imaging is reduced, and thus imaging at high speed is realized. .

  Hereinafter, with respect to the same configuration as the image processing system 1B according to the third embodiment, the same reference numerals are given, and the description is omitted, and the operation flow for generating the distance map corresponding to the feature point of the fourth embodiment is mainly described. explain.

<Distance map generation operation>
16 and 17 are flowcharts showing a distance map generation operation flow in the image processing system 1C. This operation flow is realized by the control unit 20 reading and executing the image processing program PG stored in the storage unit 22. Here, first, when the user performs various operations on the operation unit 4 and image formation of volume data (generation of a display image) in the image processing system 1 is started, the process proceeds to step S41 in FIG.

  In steps S41 to S45, processes similar to those in steps S31 to S35 of the third embodiment are performed, respectively, and the process proceeds to step S46.

  In step S46, for each of the 256 patterns of basic structures, basic structures (also referred to as “model basic structures”) arranged as a model according to the relative orientation relationship between the voxels constituting the three-dimensional object and the projection plane SC. And a distance map (basic distance map) indicating the distribution of the distance from the projection plane SC set in step S43, and the process proceeds to step S47.

  In this step S46, by projecting the model basic structure along a number of lines of sight set at predetermined intervals, the distance between the model basic structure and the projection plane SC is set for the pixels corresponding to each line of sight. By giving the data to be shown, 256 patterns of basic distance maps respectively corresponding to 256 patterns of basic structures are generated. In this case, the reference point of the unit processing target area MA is also handled as the reference point of the basic structure.

  In the generation processing of each basic distance map here, first, a distance value (reference projection distance value) Dst indicating a distance (reference projection distance) from the reference point SP11 of the model basic structure to the projection plane SC is detected. Next, a distance value (projection distance value) Dpa indicating the shortest distance (projection distance) between the model basic structure and each pixel corresponding point on which the model basic structure is orthographically projected is detected. Further, a difference value (ΔD = Dpa−Dst) between the reference projection distance value Dst and the projection distance value Dpa is calculated for each pixel corresponding point. Then, a projection distance value Dpa corresponding to each pixel is assigned to each pixel of the basic distance map.

  However, here, each projection distance value Dpa corresponding to each pixel of the basic distance map is the sum of the reference projection distance value Dst and the difference value ΔD corresponding to each pixel, that is, the above expression (1). be able to.

  Therefore, here, each pixel of the basic distance map is provided with the reference projection distance value Dst and the difference value ΔD, thereby indirectly providing the projection distance value Dpa. That is, each projection distance value Dpa indicating each projection distance is given by a function (the above formula (1)) based on the reference projection distance value Dst. This is because, in order to generate a distance map (also referred to as “overall distance map”) indicating the distribution of the projection distance between the entire three-dimensional object described later and the projection surface SC, the projection distance value Dpa is used as the reference projection. This is because it can be appropriately changed according to the change of the distance value Dst.

  Further, in step S46, the position (reference projection position) at which the reference point SP11 of the unit processing target area is projected on the projection plane SC in the basic distance map is recognized, and the basic distance map corresponds to the reference projection position. Data specifying the pixel to be included is also included. That is, among all the pixels of the basic distance map, the pixel corresponding to the reference projection position is a pixel corresponding to the projection distance value Dpa (actually, the reference projection distance value Dst and the difference value ΔD) and the reference projection position. And information for specifying is given.

  The 256 patterns of basic distance maps generated here are temporarily stored as a database (also referred to as “basic distance map DB”) in the RAM 20b or the storage unit 22 or the like.

  In step S47, an overall distance map relating to the entire three-dimensional object is generated, and the process proceeds to step S48. Here, if it progresses from step S46 to step S47, it will progress to step S471 of FIG.

  In step S471, as in step S371 of the third embodiment, one unit processing target area is designated out of all unit processing target areas constituting the three-dimensional area related to the voxel data, and the process proceeds to step S472.

  In step S472, a basic structure corresponding to the unit processing target area specified in step S471 is detected from the 256 patterns of basic structures set in step S45, and the basic distance map DB stored in the RAM 20b or the like is stored. The basic distance pattern corresponding to the basic structure is extracted from step S473, and the process proceeds to step S473.

  In step S473, with respect to the unit processing target region specified in step S471, the position (reference projection position) at which the reference point of the unit processing target region is projected onto the projection plane SC, and the reference point and the reference projection position. The distance (reference projection distance value) Dst1 is detected, and the process proceeds to step S474.

  In step S474, the basic distance map determined in step S473 is pasted on the projection plane SC using the reference projection position detected in step S473 as a reference, and the process proceeds to step S475. Here, based on the basic distance map extracted in step S472, the projection distance value Dpa for each pixel is adjusted by substituting the reference projection distance value Dst1 detected in step S473 into the above equation (1). In addition, a basic distance map (after adjustment) in which the relative positional relationship with respect to the projection plane SC is adjusted so that the reference projection position detected in step S473 matches the pixel corresponding to the reference projection position of the basic distance map. Basic distance map) is generated. Then, the adjusted basic distance map is pasted on the projection plane SC.

  Here, the process flow returns from step S475, which will be described later, to step S471, whereby the process of step S474 is repeated a plurality of times. By doing so, a plurality of adjusted basic distance maps are combined with each other, and finally an overall distance map is generated. However, when a plurality of adjusted basic distance maps are combined with each other, a position (specifically, a pixel corresponding point, in other words, a projection position) on the projection plane SC where the plurality of adjusted basic distance maps overlap. ) Occurs. For such pixel corresponding points, the projection distance value Dpa indicating the relatively smallest projection distance is preferentially adopted.

  In step S475, it is determined whether all the unit processing target areas constituting the three-dimensional area related to the voxel data have been designated. Here, if all the unit processing target areas have not been specified yet, the process returns to step S471, and the processes from step S471 to step S475 are repeated until all the unit processing target areas are specified. For the target area, the adjusted basic distance map (adjusted basic distance map) is pasted on the projection plane SC. On the other hand, if all the unit processing target areas have already been specified, the distance map generated by combining a plurality of adjusted basic distance maps is adopted as the entire distance map, and the generation process of the entire distance map is terminated. Proceed to step S48 in FIG.

  In step S48, based on the operation of the operation unit 4 by the user, it is determined whether or not an instruction (change instruction) for changing a projection plane for projecting a three-dimensional object into an image has been issued. Here, if there is an instruction to change the projection plane, the process returns to step S43, and the processing from step S43 to step S48 is performed. On the other hand, if there is no instruction to change the projection plane, the determination in step S48 is repeated.

  Here, for example, by forcibly terminating the operation flow related to imaging of volume data in accordance with the operation of the operation unit 4 by the user, the operation flow shown in FIGS. It is possible to escape. Further, when the projection plane SC is set and the entire distance map is generated, a display image is generated by volume rendering using a general ray casting method or the like while using the entire distance map.

  As described above, in the image processing system 1C according to the fourth embodiment, when imaging based on voxel data is performed, when the projection plane SC for projecting the three-dimensional object TB is set, the three-dimensional object TB and the projection plane are set. An overall distance map showing the distribution of distances with the SC is generated. When generating this entire distance map, first, voxel at eight positions where voxels can be arranged in a unit processing target area in which a total of eight voxels facing two predetermined directions in the XYZ directions can be arranged. A 256-pattern basic structure is set according to the combination of presence and absence. Then, the reference projection position corresponding to the reference position SP11 of the unit processing target area and the projection distance (reference projection distance) Dst of the reference position SP11 are detected. Further, for each basic structure of 256 patterns, data representing the projection distance value Dpa corresponding to each pixel corresponding point by the reference projection distance value Dst is given to each pixel, and the pixel corresponding to the reference projection position A basic distance map to which data clearly indicating is attached is generated.

  Next, a basic structure corresponding to each unit processing target area for the entire three-dimensional object TB is detected, and a basic distance map corresponding to the basic structure is extracted. Then, each reference projection position where the reference position of each unit processing target area is projected is detected, and the distance (reference projection distance) Dst1 between each reference position and each reference projection position is detected. Further, the adjusted basic distance maps in which the basic distance maps are adjusted according to the respective reference projection positions and the reference projection distance value Dst1 are combined with each other to generate an overall distance map. However, when combining the adjusted basic distance maps, the projection distance value indicating the minimum distance is preferentially adopted for the pixel corresponding points where the plurality of adjusted basic distance maps overlap.

  That is, for each unit processing target area where eight voxels can be arranged, a 256-pattern basic structure combining the presence or absence of voxels is set, and a basic distance map for each basic structure is generated. For each unit processing target region, a basic distance map (adjusted basic distance map) adjusted according to the distance and positional relationship with the projection surface SC is synthesized with each other, thereby generating an overall distance map. By adopting such a configuration, each point of each voxel is orthographically projected and compared with the conventional method in which a distance value is given to each pixel of the entire distance map while determining the depth relationship. The amount of calculation from the setting of the projection plane to the generation of the entire distance map can be greatly reduced. Therefore, the entire distance map can be generated at high speed, and as a result, volume data can be imaged at high speed.

<Others>
As mentioned above, although embodiment of this invention was described, this invention is not limited to the thing of the content demonstrated above.

  For example, in the first and third embodiments described above, when pasting the adjusted basic image on the projection surface SC, the projection distance value is set for a portion where a plurality of adjusted basic images overlap. By preferentially adopting the pixel value corresponding to the smallest one, a display image capable of visually recognizing the depth to the user has been generated. When generating the basic image, the standard projection distance value or the projection distance value is not detected, and the pixel corresponding points where the voxels and the basic structure are projected onto the projection plane are given uniform pixel values. In the case where the adjusted basic image is pasted on the projection surface SC, for a portion where a plurality of adjusted basic images overlap, no matter which pixel value related to the adjusted basic image is adopted, The resulting pixel value Identical, and therefore, without considering the projection distance value or the like, simply, may be generated for display image by combining the base image after a plurality of mutually adjusted.

  With such a configuration, the display image does not allow the user to visually recognize the depth. However, each pixel of the display image is projected while projecting each voxel. Compared with the conventional method for determining the value, the amount of calculation from the setting of the projection plane to the generation of the display image can be greatly reduced. That is, volume data can be imaged at high speed.

  In addition, in the first and third embodiments described above, no particular mention was made regarding appropriately giving colors to the basic image, the display image, etc. For example, the voxel value is binarized, When generating a set of voxels indicating a three-dimensional object, each voxel is given an attribute that varies in color according to the range of the voxel value, and the pixel value changes according to the projection distance. The color may be expressed by a change in luminance, and when a voxel is projected onto the projection plane, a pixel value corresponding to the attribute of the color given to each voxel may be given. With such a configuration, when the three-dimensional object includes a plurality of parts, it is possible to generate a display image with a different color according to the kind of the part.

  In the embodiment described above, a basic image and a basic distance map are generated for a voxel and a unit processing target area, and each voxel of the same size and each unit processing target area of the same size including the voxel are obtained for a three-dimensional object. By processing the target image, a display image and an entire distance map were generated. However, the present invention is not limited to this. For example, a three-dimensional object is configured by a specific structure having a different size corresponding to a voxel, or a three-dimensional object is processed by a processing target region having a different size corresponding to a unit processing target region. Even if configured, the size of the basic image or the basic distance map is multiplied by a constant depending on the size ratio between the specific structure and the voxel, or the size ratio between the processing target area and the unit processing target area. Then, a display image and an entire distance map can be generated by pasting on the projection plane.

  In the third and fourth embodiments described above, the unit processing target area can arrange a total of 8 voxels of 2 × 2 × 2, but is not limited thereto. For example, a total of two voxels of 2 × 1 × 1 may be arranged. However, if the number of voxels that can be arranged in the unit processing target area changes, the number of combinations of the presence / absence of voxels, that is, the number of basic structure patterns also changes, so that only the number of basic images corresponding to the number of basic structure patterns Of course, a basic distance map must be generated.

  In the third embodiment described above, 256 patterns of basic images are generated. At this time, the method described in the first embodiment may be used. Specifically, a basic image for one voxel may be generated, and a 256-pattern basic image may be generated using the basic image. With such a configuration, the amount of calculation when generating a 256-pattern basic image is reduced, so that volume data can be imaged at higher speed.

  Similarly, the 256 patterns of basic distance maps are generated in the above-described fourth embodiment. At this time, the method described in the above-described second embodiment may be used. Specifically, a basic distance map for one voxel may be generated, and a 256-pattern basic distance map may be generated using the basic distance map. With such a configuration, it is possible to reduce the amount of calculation when generating a 256-pattern basic distance map. Therefore, the volume data can be imaged at a higher speed.

  In the above-described embodiment, the specific structure is a voxel that is a cube or a rectangular parallelepiped. However, the specific structure is not limited thereto, and may be another shape such as a regular tetrahedron.

It is a block diagram which shows the function structure of an image processing system. It is a flowchart which shows the operation | movement flow of imaging. It is a flowchart which shows the operation | movement flow of imaging. It is a schematic diagram of a three-dimensional object expressed by a set of specific structures. It is a figure for demonstrating the setting of a projection surface. It is a figure for demonstrating the production | generation of a basic image. It is a figure for illustrating designation of one voxel. It is a figure which shows visually the phenomenon in which a plurality of adjusted basic images are pasted in duplicate. It is a figure which shows an example of the image for a display. It is a flowchart which shows the production | generation operation | movement flow of a whole distance map. It is a flowchart which shows the production | generation operation | movement flow of a whole distance map. It is a flowchart which shows the operation | movement flow of imaging. It is a flowchart which shows the operation | movement flow of imaging. It is a figure for demonstrating the production | generation of a basic image. It is a figure for demonstrating designation | designated of one unit process target area. It is a flowchart which shows the production | generation operation | movement flow of a whole distance map. It is a flowchart which shows the production | generation operation | movement flow of a whole distance map.

Explanation of symbols

1, 1A-1C Image processing system 2 Personal computer 3 Monitor 4 Operation unit 5 Mounting unit 20 Control unit 20a ROM
20b RAM
51 Memory Card PG Image Processing Program SC Projection Surface TB 3D Object

Claims (10)

An image processing apparatus that generates a display image based on three-dimensional data,
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
For the specific structure, a reference position setting means for setting a reference position;
Recognizing a reference image position corresponding to the reference position in the basic image while generating a basic image by projecting one specific structure facing the predetermined direction onto the virtual projection plane according to the direction relation Basic image generation means for
Detecting means for detecting each reference projection position at which a reference position of each specific structure is projected onto the virtual projection plane when the virtual three-dimensional object is projected onto the virtual projection plane;
An adjusted image that generates each adjusted basic image by adjusting a relative positional relationship with respect to the virtual projection plane according to each reference projection position detected by the detection unit based on the basic image. Generating means;
Display image generation means for generating a display image by mutually combining the adjusted basic images generated by the adjustment image generation means;
An image processing apparatus comprising: An image processing apparatus that generates a display image based on three-dimensional data,
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
Basic structure setting for setting a plurality of basic structures each configured by an array pattern of at least one specific structure in a unit processing target region in which a predetermined number of specific structures facing the predetermined direction can be arranged Means,
A reference position setting means for setting a reference position of the basic structure of the plurality of patterns;
The basic structure of the plurality of patterns is generated for each basic image of the plurality of patterns while generating the basic image of the plurality of patterns by projecting the basic structure of the plurality of patterns onto the virtual projection plane according to the directional relationship. Basic image generation means for recognizing each reference image position corresponding to the reference position of the body,
A region designating unit that sequentially designates unit processing target regions to be projected among three-dimensional regions to be processed when projecting the virtual three-dimensional object onto the virtual projection plane;
First detection means for detecting a matching basic structure from the plurality of basic structures for the unit processing target area specified by the area specifying means;
Extraction means for extracting a basic image corresponding to the basic structure detected by the first detection means from the basic images of the plurality of patterns;
Second detection means for detecting a reference projection position at which a reference position of the basic structure detected by the first detection means is projected onto the virtual projection plane;
Based on the basic image extracted by the extracting means, an adjusted image generating means for generating an adjusted basic image by adjusting a relative position with respect to the virtual projection plane according to the reference projection position;
For each unit processing target region, display image generation means for generating a display image by mutually synthesizing the adjusted basic images generated by the adjustment image generation means,
An image processing apparatus comprising: An image processing apparatus that generates a distance map based on three-dimensional data,
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative position and direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
For the specific structure, a reference position setting means for setting a reference position;
In accordance with the positional and directional relationship, a reference projection position where a reference position of one specific structure facing the predetermined direction is projected onto the virtual projection plane, and a reference corresponding to a distance between the reference position and the reference projection position Detecting the projection distance, and detecting each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and the one specific structure, thereby the virtual projection plane based on the reference projection distance; Basic distance map generating means for generating a basic distance map indicating a distribution of distances to the one specific structure;
Detection means for detecting each reference projection position and each reference projection distance corresponding to each specific structure on the virtual projection plane for each specific structure constituting the virtual three-dimensional object;
Based on the basic distance map, the relative positional relationship with respect to the virtual projection plane and the projection distances are respectively adjusted according to the reference projection positions and the reference projection distances detected by the detection unit. Adjustment map generation means for generating each adjusted basic distance map,
A minimum projection distance is adopted for a projection position where a plurality of adjusted basic distance maps overlap among the virtual projection planes while combining the adjusted basic distance maps generated by the adjustment map generating unit. A distance map generating means for generating an overall distance map indicating a distribution of distances between the virtual three-dimensional object and the virtual projection plane;
An image processing apparatus comprising: An image processing apparatus that generates a distance map based on three-dimensional data,
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative position and direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
Basic structure setting for setting a plurality of basic structures each configured by an array pattern of at least one specific structure in a unit processing target region in which a predetermined number of specific structures facing the predetermined direction can be arranged Means,
A reference position setting means for setting a reference position of the basic structure of the plurality of patterns;
For the basic structure of the plurality of patterns, a reference projection position at which a reference position is projected onto the virtual projection plane according to the position and direction relationship, and a reference projection distance corresponding to a distance between the reference position and the reference projection position are detected. And detecting each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and each basic structure, so that the virtual projection plane and each basic structure based on the reference projection distance are detected. A basic map generating means for generating a plurality of patterns of basic distance maps respectively indicating the distribution of distances between
An area designating unit for designating a unit process target area to be projected among time-sequential out of three-dimensional areas to be processed;
First detection means for detecting a matching basic structure from the plurality of basic structures for the unit processing target area specified by the area specifying means;
Extraction means for extracting a basic distance map corresponding to the basic structure detected by the first detection means from the basic distance map of the plurality of patterns;
A second reference position for detecting a reference projection position at which the reference position of the basic structure detected by the first detection means is projected onto the virtual projection plane and a reference projection distance corresponding to the reference projection position; Detection means;
Based on the basic distance map extracted by the extracting means, a relative position with respect to the virtual projection plane and each projection distance according to the reference projection position and the reference projection distance detected by the second detection means, Adjusting map generating means for generating the adjusted basic distance map, respectively,
A minimum projection distance is adopted for a projection position where a plurality of adjusted basic distance maps overlap among the virtual projection planes while combining the adjusted basic distance maps generated by the adjustment map generating unit. A distance map generating means for generating an overall distance map indicating a distribution of distances between the virtual three-dimensional object and the virtual projection plane;
An image processing apparatus comprising: A program that causes a computer to function as an image processing device that generates a display image based on three-dimensional data by being executed in a computer,
The image processing apparatus is
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
For the specific structure, a reference position setting means for setting a reference position;
Recognizing a reference image position corresponding to the reference position in the basic image while generating a basic image by projecting one specific structure facing the predetermined direction onto the virtual projection plane according to the direction relation Basic image generation means for
Detecting means for detecting each reference projection position at which a reference position of each specific structure is projected onto the virtual projection plane when the virtual three-dimensional object is projected onto the virtual projection plane;
An adjusted image that generates each adjusted basic image by adjusting a relative positional relationship with respect to the virtual projection plane according to each reference projection position detected by the detection unit based on the basic image. Generating means;
Display image generation means for generating a display image by mutually combining the adjusted basic images generated by the adjustment image generation means;
A program comprising: The program according to claim 5,
Basic image generation means
The reference projection position corresponding to the reference position of the one specific structure and the reference projection distance corresponding to the distance between the reference position and the reference projection position are detected, and each predetermined point on the virtual projection plane is Each projection distance corresponding to a distance from the specific structure is detected, and each projection distance value indicating each projection distance based on the reference projection distance and each pixel value corresponding to each projection distance as a set The basic image is generated by giving to each pixel of the basic image,
The detection means is
Further detecting each reference projection distance corresponding to each reference projection position;
The adjusted image generating means is
Based on the basic image, the relative positional relationship with respect to the virtual projection plane, the respective projection distance values, and the respective pixel values are respectively determined according to the respective reference projection positions and the respective reference projection distances detected by the detecting means. By adjusting, generate an adjusted basic image,
The display image generating means is
When the adjusted basic images are combined with each other, a projection position where a plurality of adjusted basic images overlap in the virtual projection plane corresponds to the projection distance value indicating the minimum projection distance and the projection distance. A program characterized by adopting a pair with a pixel value. A program that causes a computer to function as an image processing device that generates a display image based on three-dimensional data by being executed in a computer,
The image processing apparatus is
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
Basic structure setting for setting a plurality of basic structures each configured by an array pattern of at least one specific structure in a unit processing target region in which a predetermined number of specific structures facing the predetermined direction can be arranged Means,
A reference position setting means for setting a reference position of the basic structure of the plurality of patterns;
The basic structure of the plurality of patterns is generated for each basic image of the plurality of patterns while generating the basic image of the plurality of patterns by projecting the basic structure of the plurality of patterns onto the virtual projection plane according to the directional relationship. Basic image generation means for recognizing each reference image position corresponding to the reference position of the body,
A region designating unit that sequentially designates unit processing target regions to be projected among three-dimensional regions to be processed when projecting the virtual three-dimensional object onto the virtual projection plane;
First detection means for detecting a matching basic structure from the plurality of basic structures for the unit processing target area specified by the area specifying means;
Extraction means for extracting a basic image corresponding to the basic structure detected by the first detection means from the basic images of the plurality of patterns;
Second detection means for detecting a reference projection position at which a reference position of the basic structure detected by the first detection means is projected onto the virtual projection plane;
Based on the basic image extracted by the extracting means, an adjusted image generating means for generating an adjusted basic image by adjusting a relative position with respect to the virtual projection plane according to the reference projection position;
For each unit processing target region, display image generation means for generating a display image by mutually synthesizing the adjusted basic images generated by the adjustment image generation means,
A program comprising: The program according to claim 7,
Basic image generation means
For each basic structure, a reference projection position corresponding to a reference position and a reference projection distance corresponding to a distance between the reference position and the reference projection position are detected, and each predetermined point on the virtual projection plane and each of the basic structures are detected. Each projection distance corresponding to the distance to the basic structure is detected, and each projection distance value indicating each projection distance based on the reference projection distance and each pixel value corresponding to each projection distance as a set, The basic image is generated by giving to each pixel of the basic image,
The second detection means comprises:
Further detecting a reference projection distance corresponding to the reference projection position;
The adjusted image generating means is
Based on the basic image extracted by the extraction means, the relative positional relationship with respect to the virtual projection plane, each projection distance value, and each pixel value are adjusted according to the reference projection position and the reference projection distance, respectively. To generate an adjusted basic image,
The display image generating means is
When the adjusted basic images are combined with each other, a projection position where a plurality of adjusted basic images overlap in the virtual projection plane corresponds to the projection distance value indicating the minimum projection distance and the projection distance. A program characterized by adopting a pair with a pixel value. A program that causes a computer to function as an image processing apparatus that generates a distance map based on three-dimensional data by being executed in a computer,
The image processing apparatus is
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative position and direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
For the specific structure, a reference position setting means for setting a reference position;
In accordance with the positional and directional relationship, a reference projection position where a reference position of one specific structure facing the predetermined direction is projected onto the virtual projection plane, and a reference corresponding to a distance between the reference position and the reference projection position Detecting the projection distance, and detecting each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and the one specific structure, thereby the virtual projection plane based on the reference projection distance; Basic distance map generating means for generating a basic distance map indicating a distribution of distances to the one specific structure;
Detection means for detecting each reference projection position and each reference projection distance corresponding to each specific structure on the virtual projection plane for each specific structure constituting the virtual three-dimensional object;
Based on the basic distance map, the relative positional relationship with respect to the virtual projection plane and the projection distances are respectively adjusted according to the reference projection positions and the reference projection distances detected by the detection unit. Adjustment map generation means for generating each adjusted basic distance map,
A minimum projection distance is adopted for a projection position where a plurality of adjusted basic distance maps overlap among the virtual projection planes while combining the adjusted basic distance maps generated by the adjustment map generating unit. A distance map generating means for generating an overall distance map indicating a distribution of projection distances between the virtual three-dimensional object and the virtual projection plane;
A program comprising: A program that causes a computer to function as an image processing apparatus that generates a distance map based on three-dimensional data by being executed in a computer,
The image processing apparatus is
Reading means for reading, into a predetermined storage means, three-dimensional data indicating the structure of a virtual three-dimensional object constituted by a set of specific structures facing a predetermined direction;
Projection plane setting means for setting a relative position and direction relationship between the virtual projection plane on which the virtual three-dimensional object is projected and the virtual three-dimensional object;
Basic structure setting for setting a plurality of basic structures each configured by an array pattern of at least one specific structure in a unit processing target region in which a predetermined number of specific structures facing the predetermined direction can be arranged Means,
A reference position setting means for setting a reference position of the basic structure of the plurality of patterns;
For the basic structure of the plurality of patterns, a reference projection position at which a reference position is projected onto the virtual projection plane according to the position and direction relationship, and a reference projection distance corresponding to a distance between the reference position and the reference projection position are detected. And detecting each projection distance corresponding to a distance between each predetermined point on the virtual projection plane and each basic structure, so that the virtual projection plane and each basic structure based on the reference projection distance are detected. A basic map generating means for generating a plurality of patterns of basic distance maps respectively indicating the distribution of distances between
An area designating unit for designating a unit process target area to be projected among time-sequential out of three-dimensional areas to be processed;
First detection means for detecting a matching basic structure from the plurality of basic structures for the unit processing target area specified by the area specifying means;
Extraction means for extracting a basic distance map corresponding to the basic structure detected by the first detection means from the basic distance map of the plurality of patterns;
A second reference position for detecting a reference projection position at which the reference position of the basic structure detected by the first detection means is projected onto the virtual projection plane and a reference projection distance corresponding to the reference projection position; Detection means;
Based on the basic distance map extracted by the extracting means, a relative position with respect to the virtual projection plane and each projection distance according to the reference projection position and the reference projection distance detected by the second detection means, Adjusting map generating means for generating the adjusted basic distance map, respectively,
A minimum projection distance is adopted for a projection position where a plurality of adjusted basic distance maps overlap among the virtual projection planes while combining the adjusted basic distance maps generated by the adjustment map generating unit. A distance map generating means for generating an overall distance map indicating a distribution of projection distances between the virtual three-dimensional object and the virtual projection plane;
A program comprising:

Images