WO2016165209A1 - 3d image cropping method - Google Patents

3d image cropping method Download PDF

Info

Publication number
WO2016165209A1
WO2016165209A1 PCT/CN2015/081450 CN2015081450W WO2016165209A1 WO 2016165209 A1 WO2016165209 A1 WO 2016165209A1 CN 2015081450 W CN2015081450 W CN 2015081450W WO 2016165209 A1 WO2016165209 A1 WO 2016165209A1
Authority
WO
WIPO (PCT)
Prior art keywords
dimensional
image
coordinate system
voxel
screen
Prior art date
Application number
PCT/CN2015/081450
Other languages
French (fr)
Chinese (zh)
Inventor
刘静静
陈永健
田广野
Original Assignee
青岛海信医疗设备股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 青岛海信医疗设备股份有限公司 filed Critical 青岛海信医疗设备股份有限公司
Publication of WO2016165209A1 publication Critical patent/WO2016165209A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Definitions

  • the present invention relates to the field of image processing technologies, and in particular, to a method for cropping a three-dimensional image.
  • a method for cropping a three-dimensional image comprising:
  • the method provided by the embodiment of the invention implements cropping of the three-dimensional image. Moreover, since the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen are acquired, the pixel of the three-dimensional display image located in the area to be cropped can be discarded according to the corresponding relationship between the voxel and the two-dimensional coordinates obtained above. The voxel corresponding to the two-dimensional coordinates and its corresponding surface element. Since the positional relationship of the pixels is compared in the two-dimensional coordinate system, the amount of calculation is small, thereby improving the cutting speed and realizing rapid three-dimensional image cropping in real time.
  • FIG. 1 is a flowchart of a method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of a method for performing image rendering according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a method for performing a projection transformation on a voxel according to an embodiment of the present invention
  • FIG. 4 is a flowchart of a method for determining whether a pixel of a three-dimensional display image is in a closed curve according to an embodiment of the present invention
  • FIG. 5 is a flowchart of another method according to an embodiment of the present invention.
  • An object is a three-dimensional object displayed by a three-dimensional image.
  • it refers to a certain organ, such as the liver, heart, and the like.
  • the world coordinate system the coordinate system defined in the space where the three-dimensional object is located, is a three-dimensional coordinate system. It is assumed that for a certain object, there are N slice images to form an image sequence.
  • the upper left corner of the first slice image is defined as the coordinate origin of the world coordinate system
  • the row direction of the slice image is the world coordinate system.
  • the positive direction of the x-axis, the column direction of the slice image is the positive direction of the y-axis of the world coordinate system
  • the direction of the image sequence is the positive direction of the z-axis
  • the unit of length is 1 pixel.
  • the coordinates in the world coordinate system are in one-to-one correspondence with the coordinates in the coordinate system of the three-dimensional display image.
  • the screen two-dimensional coordinate system defines the upper left corner of the screen display area as the origin of the screen two-dimensional coordinate system, the row direction of the screen display area is the x-axis positive direction of the screen two-dimensional coordinate system, and the column direction of the screen display area is the screen two-dimensional
  • the positive direction of the y-axis of the coordinate system is 1 pixel in length.
  • a voxel, a three-dimensional image data can be obtained from a sequence of images of an object.
  • Facet another kind of three-dimensional image data, can be obtained from the image sequence of the object, and there is a correspondence between the voxels and the noodle at the same coordinates in the world coordinate system.
  • 3D display image 3D effect image displayed on the screen.
  • FIG. 1 is a schematic diagram of a method for cropping a three-dimensional image according to an embodiment of the present invention.
  • the specific implementation manner includes the following operations:
  • Step 100 Perform image surface rendering according to the surface element of the object, obtain a three-dimensional display image of the object in a two-dimensional coordinate system of the screen, and obtain a corresponding two-dimensionality of each voxel of the object in the two-dimensional coordinate system of the screen. Coordinates; or, the image volume rendering is performed according to the voxels of the object, and the three-dimensional display image of the object in the two-dimensional coordinate system of the screen is obtained, and each of the voxels of the object corresponds to the two-dimensional coordinate system of the screen.
  • the two-dimensional coordinates Perform image surface rendering according to the surface element of the object, obtain a three-dimensional display image of the object in a two-dimensional coordinate system of the screen, and obtain a corresponding two-dimensionality of each voxel of the object in the two-dimensional coordinate system of the screen.
  • Performing image volume rendering or surface rendering will display the object in three dimensions on the screen.
  • the embodiment of the present invention does not limit the projection transformation mode adopted by the drawing process, and may adopt parallel projection or perspective projection.
  • Step 110 Determine a region to be cropped on the three-dimensional display image.
  • Step 120 Discard the voxels corresponding to the two-dimensional coordinates of the pixels of the three-dimensional display image located in the to-be-cut region, and the voxels corresponding to the voxels.
  • Step 130 Perform image surface rendering again according to the retained voxels or re-image the image according to the retained voxels.
  • This step displays the cropped object of the 3D image on the screen.
  • the method provided by the embodiment of the invention implements cropping of the three-dimensional image. Moreover, since the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen are acquired, the pixel of the three-dimensional display image located in the area to be cropped can be discarded according to the corresponding relationship between the voxel and the two-dimensional coordinates obtained above. The voxel corresponding to the two-dimensional coordinates and its corresponding surface element. Since the positional relationship of the pixels is compared in the two-dimensional coordinate system, the amount of calculation is small, thereby improving the cutting speed and realizing rapid three-dimensional image cropping in real time.
  • the corresponding region to be cropped is not required to be constructed.
  • the three-dimensional region and the positional judgment of the three-dimensional image data and the three-dimensional region are directly performed in the three-dimensional coordinate system.
  • the above three-dimensional area needs to be constructed along the opposite direction of the projection direction of the volume rendering or the surface drawing, which is limited by the system computing capability, and only parallel projection can be adopted when performing volume rendering or surface rendering.
  • the solution provided by the embodiment of the present invention does not need to construct a three-dimensional area corresponding to the area to be cropped, it is not necessary to define a projection mode for performing volume rendering or surface rendering, and either a parallel projection or a perspective projection may be adopted. Therefore, the appropriate projection method can be selected according to actual needs.
  • the perspective projection is used, the visual features of the human eye "nearly large and small" can be simulated, resulting in a better user experience.
  • step 100 The specific implementation of step 100:
  • step 100 specifically includes the following operations:
  • Step 200 constructing a world coordinate system
  • Step 210 Perform model transformation on the three-dimensional image data (voxel or voxel), and record the model transformation matrix used.
  • Step 220 Perform projective transformation on the model-converted three-dimensional image data, and record The projection transformation matrix used.
  • Step 230 Display the data obtained by the model transformation and the projection transformation on a specified area of the screen window, and record the viewport transformation matrix.
  • the model transformation, the projection transformation and the viewport transformation are sequentially performed according to the voxels; if the surface rendering is performed, the model transformation, the projection transformation and the viewport transformation are sequentially performed according to the surface elements.
  • the above steps 200 to 230 may be, but are not limited to, implemented on an existing image rendering platform (eg, OpenGl platform).
  • an existing image rendering platform eg, OpenGl platform.
  • a voxel of the above object is subjected to projection transformation to obtain a corresponding two-dimensional coordinate of each voxel in a two-dimensional coordinate system of the screen. That is, by mapping the process of projection transformation, the mapping relationship between the world coordinate system and the screen two-dimensional coordinate system is established.
  • This implementation can be used regardless of volume rendering or surface rendering. Especially when using surface rendering, the implementation can be adopted because the corresponding two-dimensional coordinates of the voxels in the two-dimensional coordinate system of the screen cannot be obtained during the surface rendering process.
  • the implementation manner is as shown in FIG. 3, and specifically includes the following operations:
  • Step 300 Obtain three-dimensional coordinates of each voxel of the object in the world coordinate system.
  • Step 310 Multiply each of the three-dimensional coordinates by a model transformation matrix, a projection transformation matrix, and a viewport transformation matrix, to obtain two-dimensional coordinates corresponding to each voxel of the object in the two-dimensional coordinate system of the screen.
  • the model transformation matrix, the projection transformation matrix and the viewport transformation matrix are projection parameters.
  • model transformation matrix the projection transformation matrix, and the viewport transformation matrix as projection parameters are merely examples and are not limiting.
  • the manner in which the projection parameters are acquired in the embodiment of the present invention is not limited.
  • the projection parameters used in the image 100 surface rendering or volume rendering process of step 100 can be utilized.
  • Existing image rendering technology can be right It is displayed in a complete and accurate manner as a three-dimensional display image, thanks to the projection parameters used in the process. Therefore, by using the projection parameters used in the image drawing process to simulate projection, each voxel can be accurately mapped to the two-dimensional coordinate system of the screen, ensuring that the coordinates of the voxels and the visual three-dimensional objects are always one-to-one, ensuring The accuracy of the subsequent cutting process.
  • the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the above-mentioned screen can be obtained by using the projection transformation in the volume rendering process.
  • the existing image rendering technology can display the object completely and accurately as a three-dimensional display image, thanks to the projection parameters used in the process. Therefore, the accuracy of the subsequent cropping process is ensured by using the mapping relationship of each voxel obtained in the image drawing process accurately in the two-dimensional coordinate system of the screen.
  • the CUDA acceleration method may be used to acquire the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen.
  • it is implemented by GPU acceleration.
  • step 110 The specific implementation of step 110:
  • the closed curve of the area to be cropped selected by the user on the three-dimensional display image is obtained according to the mouse movement trajectory, and correspondingly, the area to be cropped refers to the area within the closed curve.
  • the closed curve selected by the user on the three-dimensional display image is obtained according to the mouse movement trajectory, and then the inverse selection operation is performed.
  • the area to be cropped is the area outside the closed curve. and many more.
  • the method provided by the embodiment of the present invention further includes the step of determining. That is, it is determined whether the pixel of the three-dimensional display image at each of the above two-dimensional coordinates is within the area to be cropped.
  • the step 110 is specifically to obtain a closed curve of the area to be cropped selected by the user on the three-dimensional display image, or to reverse the closed curve selected by the user, the area to be cropped is determined. Then, in the step of determining, specifically determining whether the pixel of the three-dimensional display image at each of the two-dimensional coordinates is within the closed curve. Taking the example shown in FIG. 4 as an example, a specific implementation manner of the determining step will be described. As shown in FIG. 4, the following operations are specifically included:
  • Step 400 Construct a rectangular image of the same size as the display area of the three-dimensional display image in the two-dimensional coordinate system of the screen.
  • the pixel value of all rectangular image pixel points of the rectangular image is a first pixel value.
  • the pixel value of all matrix image pixel points of the matrix image is set to zero.
  • the matrix image is established in the two-dimensional coordinate system of the screen, the matrix image pixel points of the matrix image are in one-to-one correspondence with the pixels of the three-dimensional display image.
  • the size of the display area of the three-dimensional display image is 100 pixels*100 pixels, and then the size of the matrix image is also 100 pixels*100 pixels.
  • Step 410 The two-dimensional corresponding to the closed curve (ie, the area to be cropped) in the rectangular image.
  • the pixel value of the rectangular image pixel at the coordinate is modified to the second pixel value to obtain a contour curve.
  • the value of the first pixel value is different from the value of the second pixel value.
  • the contour of the closed curve is searched for by the contour detection, and mapped to a corresponding area of the rectangular image, and the pixel value of the corresponding area is changed to a second pixel value, for example, 255, to obtain a contour curve.
  • Step 420 Determine whether each rectangular image pixel in the rectangular image is within the contour curve.
  • the comparison is judged by the ray method. If the number of intersections of the ray and the contour curve drawn by the pixel of one rectangular image is an even number, it means that the pixel of the rectangular image is outside the contour curve. If the number of intersections of the ray and the contour curve drawn by the pixel of one rectangular image is an odd number, then Indicates that the rectangular image pixel is inside the contour curve.
  • the above determining step may be specifically implemented by using a CUDA acceleration method.
  • a CUDA acceleration method For example, it is implemented by GPU acceleration.
  • step 130 The specific implementation of step 130:
  • the projection transformation method used in the drawing process is not limited, and either a parallel projection or a perspective projection can be used.
  • the method before performing image rendering on the three-dimensional image data of the object, the method further includes:
  • the image sequence including the object is segmented to obtain voxels and voxels of the three-dimensional image of the object.
  • the image sequence including the object is segmented to obtain a target image sequence, and the voxel and the voxel of the object are obtained according to the target image sequence.
  • the plurality of objects displayed in the image sequence can be segmented into different object image sequences, and then for different segmentation purposes and application scenarios, simultaneously for a single or Multiple objects are image-cut in parallel to increase processing speed.
  • the scalpel can remove the lesion location of an organ tissue, and at the same time Remove the location of adjacent organ tissue lesions.
  • the cutting object can be carried out according to actual needs, which is a very important step in the simulation surgery, and it is also in line with the actual situation.
  • step 500 the image sequence of the chest cavity obtained by CT scanning is segmented to obtain a liver image sequence, and the liver voxels and surface elements are obtained according to the liver image sequence.
  • the image sequence of the chest can be, but is not limited to, obtained from DICOM.
  • the segmentation can not only obtain the liver image sequence, but also obtain image sequences of other organs, and the image sequences of different organs are separately stored.
  • This embodiment is exemplified only by the cropping of the liver image sequence.
  • Step 510 Construct a world coordinate system.
  • liver image sequences there are N liver image sequences, with the upper left corner of the first liver image as the coordinate origin, the row direction as the positive X-axis direction, the column direction as the positive direction of the Y-axis, and the direction of the image sequence as the positive direction of the Z-axis to construct the world coordinate system. .
  • Step 520 Perform model transformation on the voxel or noodle of the liver, and record the model transformation matrix used.
  • model transformation that is, the rotation, translation and scaling of a three-dimensional object model (constructed by voxels or voxels), similar to the appropriate position of a three-dimensional object placed in the scene.
  • model transformation matrix used for model transformation is called modeMatrix.
  • Step 530 Perform projective transformation on the model transformed data, and record the projection transformation matrix used.
  • the projected view body is a rectangular flat pipe, no matter how far the object is, the size and size of the object after projection are unchanged.
  • the projection transformation matrix used for projection transformation is called projMatrix.
  • the above is exemplified by the parallel projection.
  • the embodiment can also adopt a perspective projection, and the specific implementation manner thereof will not be described again.
  • Step 540 Display the three-dimensional display image of the liver obtained by the model transformation and the projection transformation on a specified area of the screen window, and record the viewport transformation matrix (also referred to as a viewport vector).
  • each voxel or voxel are objcoor[objx, objy, objz, 1.0], multiply the model view matrix modelMatrix, the projection transformation matrix projMatrix, and finally use the viewport transformation matrix to represent the three-dimensional display image pixels in homogeneous order. Limited to the current viewport.
  • steps 510 to 540 are processes for image rendering, and data format conversion (conversion into STL format) is required before image rendering.
  • Step 550 Obtain three-dimensional coordinates of each voxel of the liver in a world coordinate system.
  • Step 560 Multiply the three-dimensional coordinates of each voxel of the liver by the model transformation matrix, the projection transformation matrix, and the viewport transformation matrix to obtain corresponding two-dimensional coordinates of each voxel of the liver in the above-mentioned screen two-dimensional coordinate system.
  • Step 570 Acquire a closed curve of the to-be-cut region selected by the user on the three-dimensional display image of the liver according to the mouse movement track.
  • Step 580 Construct a rectangular image of the same size as the display area of the liver three-dimensional display image in the two-dimensional coordinate system of the screen.
  • Step 590 Modify a pixel value of a rectangular image pixel point at a two-dimensional coordinate corresponding to the closed curve in the rectangular image to a second pixel value to obtain a contour curve.
  • Step 5100 Determine whether each rectangular image pixel in the rectangular image is within the contour curve.
  • Step 5110 Discard the voxels corresponding to the two-dimensional coordinates of the three-dimensional display image pixel located in the closed curve, and the voxels corresponding to the voxels.
  • Step 5120 Re-image the image according to the retained liver voxel or facial layer.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Generation (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)

Abstract

A 3D image cropping method comprises: rendering an image surface according to a surface element of an object, acquiring a 3D display image of the object in a screen 2D coordinate system, acquiring a 2D coordinate in the screen 2D coordinate system corresponding to each of voxels of the object; alternatively, performing volume rendering according to voxels of the object, acquiring the 3D display image of the object in the screen 2D coordinate system and 2D coordinates corresponding to each of the voxels of the object in the screen 2D coordinate system (100); determining a region to be cropped in the 3D display image (110); discarding a voxel corresponding to a 2D coordinate of a pixel point of the 3D display image within the region to be cropped, and the surface element corresponding to the voxel (120); and re-rendering the image surface according to the remaining surface elements, or re-rendering the image volume according to the remaining voxels (130).

Description

一种三维图像的裁剪方法Three-dimensional image cutting method 技术领域Technical field
本发明涉及图像处理技术领域,尤其涉及一种三维图像的裁剪方法。The present invention relates to the field of image processing technologies, and in particular, to a method for cropping a three-dimensional image.
背景技术Background technique
无论是为了获得对象的完美三维(3D)图像,还是需要在对象的3D图像上模拟对该对象的操作,都需要对3D图像进行裁剪。Whether you want to obtain a perfect three-dimensional (3D) image of an object or to simulate the operation of the object on a 3D image of the object, you need to crop the 3D image.
以医疗场景为例,复杂精准的外科手术越来越离不开3D医学影像分析及计算机辅助手术系统。3D医学影像分析系统中很难一次生成完美的3D影像,往往需要从3D影像上对其进行裁剪,以形成完美的3D影像。在计算机辅助手术系统中,如果需要直接在3D影像上进行手术规划和手术模拟,同样需要对3D影像进行裁剪。Taking medical scenes as an example, complex and precise surgical procedures are increasingly inseparable from 3D medical image analysis and computer-assisted surgery systems. It is difficult to generate perfect 3D images at a time in 3D medical image analysis systems, and it is often necessary to crop them from 3D images to form perfect 3D images. In computer-assisted surgery systems, if you need to perform surgical planning and surgical simulation directly on the 3D image, you also need to crop the 3D image.
因此,如何实现对3D图像的裁剪,是目前需要解决的问题。Therefore, how to realize the cropping of 3D images is a problem that needs to be solved at present.
发明内容Summary of the invention
本发明的目的是提供一种三维图像的裁剪方法,以实现对3D图像的裁剪。It is an object of the present invention to provide a method of cropping a three-dimensional image to effect cropping of a 3D image.
本发明的目的是通过以下技术方案实现的:The object of the invention is achieved by the following technical solutions:
一种三维图像的裁剪方法,包括:A method for cropping a three-dimensional image, comprising:
根据对象的面素进行图像面绘制,得到所述对象在屏幕二维坐标系下的三维显示图像,获取所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标;或者,根据对象的体素进行图像体绘制,得到所述对象在屏幕二维坐标系下的三维显示图像和所述对象的每个所述体素在所述屏幕二维坐标系下对应的二维坐标;Obtaining an image surface according to a surface element of the object, obtaining a three-dimensional display image of the object in a two-dimensional coordinate system of the screen, and acquiring a corresponding two-dimensional coordinate of each voxel of the object in the two-dimensional coordinate system of the screen; or And performing image volume rendering according to the voxel of the object, obtaining a three-dimensional display image of the object in a two-dimensional coordinate system of the screen, and corresponding two-dimensional corresponding to each voxel of the object in the two-dimensional coordinate system of the screen. coordinate;
确定所述三维显示图像上的待裁剪区域;Determining a region to be cropped on the three-dimensional display image;
舍弃位于所述待裁剪区域内的三维显示图像像素点所在二维坐标对应的 所述体素,及其对应的面素;Discarding the two-dimensional coordinates of the pixel of the three-dimensional display image located in the area to be cropped The voxel, and its corresponding surface element;
根据保留下来的面素重新进行图像面绘制或根据保留下来的体素重新进行图像体绘制。Re-image the surface based on the remaining voxels or re-image the image based on the retained voxels.
本发明实施例提供的方法,实现了对三维图像进行裁剪。并且,由于获取了对象的每个体素在屏幕二维坐标系下对应的二维坐标,因此可以根据上述得到的体素与二维坐标的对应关系舍弃位于待裁剪区域内的三维显示图像像素点所在二维坐标对应的体素及其对应的面素。由于在二维坐标系下比较像素点位置关系,其运算量较小,从而提高了裁剪速度,实现实时快速的三维图像裁剪。The method provided by the embodiment of the invention implements cropping of the three-dimensional image. Moreover, since the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen are acquired, the pixel of the three-dimensional display image located in the area to be cropped can be discarded according to the corresponding relationship between the voxel and the two-dimensional coordinates obtained above. The voxel corresponding to the two-dimensional coordinates and its corresponding surface element. Since the positional relationship of the pixels is compared in the two-dimensional coordinate system, the amount of calculation is small, thereby improving the cutting speed and realizing rapid three-dimensional image cropping in real time.
附图说明DRAWINGS
图1为本发明实施例提供的一种方法流程图;FIG. 1 is a flowchart of a method according to an embodiment of the present invention;
图2为本发明实施例提供的进行图像绘制的方法流程图;2 is a flowchart of a method for performing image rendering according to an embodiment of the present invention;
图3为本发明实施例提供的对体素进行投影变换的方法流程图;FIG. 3 is a flowchart of a method for performing a projection transformation on a voxel according to an embodiment of the present invention;
图4为本发明实施例提供的三维显示图像像素点是否在闭合曲线内的判断方法流程图;4 is a flowchart of a method for determining whether a pixel of a three-dimensional display image is in a closed curve according to an embodiment of the present invention;
图5为本发明实施例提供的另一种方法流程图。FIG. 5 is a flowchart of another method according to an embodiment of the present invention.
具体实施方式detailed description
在对本发明实施例进行详细说明之前,首先对本发明实施例中涉及到的部分名词进行解释说明。Before describing the embodiments of the present invention in detail, first, some of the nouns involved in the embodiments of the present invention are explained.
对象,是指三维图像所显示的三维物体。以医学领域为例,是指某个组织器官,例如肝脏,心脏等等。An object is a three-dimensional object displayed by a three-dimensional image. In the medical field, for example, it refers to a certain organ, such as the liver, heart, and the like.
世界坐标系,在三维物体所在空间定义的坐标系,是一个三维坐标系。假设针对某对象,有N张切片图像组成图像序列,本发明实施例中,定义第一张切片图像的左上角为世界坐标系的坐标原点,切片图像的行方向为世界坐标系 的x轴正方向,切片图像的列方向为世界坐标系的y轴正方向,图像序列的方向为z轴正方向,长度单位为1个像素点。本发明实施例中,世界坐标系中的坐标与三维显示图像的坐标系中的坐标一一对应。The world coordinate system, the coordinate system defined in the space where the three-dimensional object is located, is a three-dimensional coordinate system. It is assumed that for a certain object, there are N slice images to form an image sequence. In the embodiment of the present invention, the upper left corner of the first slice image is defined as the coordinate origin of the world coordinate system, and the row direction of the slice image is the world coordinate system. The positive direction of the x-axis, the column direction of the slice image is the positive direction of the y-axis of the world coordinate system, the direction of the image sequence is the positive direction of the z-axis, and the unit of length is 1 pixel. In the embodiment of the present invention, the coordinates in the world coordinate system are in one-to-one correspondence with the coordinates in the coordinate system of the three-dimensional display image.
屏幕二维坐标系,定义屏幕显示区域的左上角为屏幕二维坐标系的原点,屏幕显示区域的行方向为屏幕二维坐标系的x轴正方向,屏幕显示区域的列方向为屏幕二维坐标系的y轴正方向,长度单位为1个像素点。The screen two-dimensional coordinate system defines the upper left corner of the screen display area as the origin of the screen two-dimensional coordinate system, the row direction of the screen display area is the x-axis positive direction of the screen two-dimensional coordinate system, and the column direction of the screen display area is the screen two-dimensional The positive direction of the y-axis of the coordinate system is 1 pixel in length.
体素,一种三维图像数据,可以从对象的图像序列中获得。A voxel, a three-dimensional image data, can be obtained from a sequence of images of an object.
面素,另一种三维图像数据,可以从对象的图像序列中获得,在世界坐标系下的相同坐标处的体素和面素之间具有对应关系。Facet, another kind of three-dimensional image data, can be obtained from the image sequence of the object, and there is a correspondence between the voxels and the noodle at the same coordinates in the world coordinate system.
三维显示图像,在屏幕上显示的三维效果的图像。3D display image, 3D effect image displayed on the screen.
图1所示为本发明实施例提供的三维图像的裁剪方法,其具体实现方式包括如下操作:FIG. 1 is a schematic diagram of a method for cropping a three-dimensional image according to an embodiment of the present invention. The specific implementation manner includes the following operations:
步骤100、根据对象的面素进行图像面绘制,得到所述对象在屏幕二维坐标系下的三维显示图像,获取所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标;或者,根据对象的体素进行图像体绘制,得到所述对象在屏幕二维坐标系下的三维显示图像和所述对象的每个所述体素在所述屏幕二维坐标系下对应的二维坐标。Step 100: Perform image surface rendering according to the surface element of the object, obtain a three-dimensional display image of the object in a two-dimensional coordinate system of the screen, and obtain a corresponding two-dimensionality of each voxel of the object in the two-dimensional coordinate system of the screen. Coordinates; or, the image volume rendering is performed according to the voxels of the object, and the three-dimensional display image of the object in the two-dimensional coordinate system of the screen is obtained, and each of the voxels of the object corresponds to the two-dimensional coordinate system of the screen. The two-dimensional coordinates.
进行图像体绘制或面绘制即将对象以三维形式显示在屏幕上。Performing image volume rendering or surface rendering will display the object in three dimensions on the screen.
另外,本发明实施例也不限定绘制过程所采用的投影变换方式,既可以采用平行投影,也可以采用透视投影。In addition, the embodiment of the present invention does not limit the projection transformation mode adopted by the drawing process, and may adopt parallel projection or perspective projection.
步骤110、确定上述三维显示图像上的待裁剪区域。Step 110: Determine a region to be cropped on the three-dimensional display image.
步骤120、舍弃位于该待裁剪区域内的三维显示图像像素点所在二维坐标对应的体素,以及这些体素对应的面素。Step 120: Discard the voxels corresponding to the two-dimensional coordinates of the pixels of the three-dimensional display image located in the to-be-cut region, and the voxels corresponding to the voxels.
步骤130、根据保留下来的面素重新进行图像面绘制或根据保留下来的体素重新进行图像体绘制。Step 130: Perform image surface rendering again according to the retained voxels or re-image the image according to the retained voxels.
该步骤即在屏幕上显示三维图像裁剪后的对象。 This step displays the cropped object of the 3D image on the screen.
本发明实施例提供的方法,实现了对三维图像进行裁剪。并且,由于获取了对象的每个体素在屏幕二维坐标系下对应的二维坐标,因此可以根据上述得到的体素与二维坐标的对应关系舍弃位于待裁剪区域内的三维显示图像像素点所在二维坐标对应的体素及其对应的面素。由于在二维坐标系下比较像素点位置关系,其运算量较小,从而提高了裁减速度,实现实时快速的三维图像裁剪。另外,由于在屏幕二维坐标系下比较位置关系,进而根据对象的每个体素在屏幕二维坐标系下对应的二维坐标舍弃相应的体素和面素,可见不需要构建待裁剪区域对应的三维区域,并在三维坐标系下直接对三维图像数据与三维区域进行位置判断。其中,上述三维区域需要沿着体绘制或面绘制的投影方向的反方向进行构建,受限于系统运算能力,在进行体绘制或面绘制时只能采用平行投影。由于本发明实施例提供的方案不需要构建待裁剪区域对应的三维区域,也就不需要限定进行体绘制或面绘制的投影方式,既可以采用平行投影,也可以采用透视投影。因此可以根据实际需要选择合适的投影方式,另外,如果采用透视投影,还能够模拟人眼“近大远小”的视觉特征,带来更好的用户体验。The method provided by the embodiment of the invention implements cropping of the three-dimensional image. Moreover, since the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen are acquired, the pixel of the three-dimensional display image located in the area to be cropped can be discarded according to the corresponding relationship between the voxel and the two-dimensional coordinates obtained above. The voxel corresponding to the two-dimensional coordinates and its corresponding surface element. Since the positional relationship of the pixels is compared in the two-dimensional coordinate system, the amount of calculation is small, thereby improving the cutting speed and realizing rapid three-dimensional image cropping in real time. In addition, since the positional relationship is compared in the two-dimensional coordinate system of the screen, and the corresponding voxels and voxels are discarded according to the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen, it can be seen that the corresponding region to be cropped is not required to be constructed. The three-dimensional region and the positional judgment of the three-dimensional image data and the three-dimensional region are directly performed in the three-dimensional coordinate system. Wherein, the above three-dimensional area needs to be constructed along the opposite direction of the projection direction of the volume rendering or the surface drawing, which is limited by the system computing capability, and only parallel projection can be adopted when performing volume rendering or surface rendering. Since the solution provided by the embodiment of the present invention does not need to construct a three-dimensional area corresponding to the area to be cropped, it is not necessary to define a projection mode for performing volume rendering or surface rendering, and either a parallel projection or a perspective projection may be adopted. Therefore, the appropriate projection method can be selected according to actual needs. In addition, if the perspective projection is used, the visual features of the human eye "nearly large and small" can be simulated, resulting in a better user experience.
下面分别对本发明实施例的各个步骤进行详细说明。The respective steps of the embodiments of the present invention are described in detail below.
步骤100的具体实现方式:The specific implementation of step 100:
根据对象的面素进行图像面绘制或者根据对象的体素进行图像体绘制的具体实现方式有多种,本发明对此不作限定。仅以图2所示的流程为例进行举例说明,如图2所示,步骤100具体包括如下操作:There are various implementations of the image surface rendering according to the surface of the object or the image volume rendering according to the voxel of the object. The present invention does not limit this. For example, the process shown in FIG. 2 is taken as an example. As shown in FIG. 2, step 100 specifically includes the following operations:
步骤200、构建世界坐标系; Step 200, constructing a world coordinate system;
步骤210、将三维图像数据(体素或面素)进行模型变换,并记录所使用的模型变换矩阵。Step 210: Perform model transformation on the three-dimensional image data (voxel or voxel), and record the model transformation matrix used.
具体的,是进行旋转、平移和缩放,类似于三维物体放在场景中的适当位置。Specifically, it is rotated, translated, and scaled, similar to where a three-dimensional object is placed in the scene.
步骤220、将经过模型变换后的三维图像数据进行投影变换,并记录所使 用的投影变换矩阵。Step 220: Perform projective transformation on the model-converted three-dimensional image data, and record The projection transformation matrix used.
该步骤中,既可以进行平行投影,也可以进行透视投影。In this step, both parallel projection and perspective projection can be performed.
步骤230、将经过模型变换和投影变换后得到的数据显示于屏幕窗口的指定区域,并记录视口变换矩阵。Step 230: Display the data obtained by the model transformation and the projection transformation on a specified area of the screen window, and record the viewport transformation matrix.
应当指出的是,上述处理过程既适用于体绘制,也适用于面绘制。It should be noted that the above process is applicable to both volume rendering and surface rendering.
其中,如果是体绘制,则根据体素依次进行模型变换,投影变换和视口变换;如果是面绘制,则根据面素依次进行模型变换,投影变换和视口变换。Wherein, if the volume is drawn, the model transformation, the projection transformation and the viewport transformation are sequentially performed according to the voxels; if the surface rendering is performed, the model transformation, the projection transformation and the viewport transformation are sequentially performed according to the surface elements.
上述步骤200~步骤230可以但不仅限于在现有的图像绘制平台(例如OpenGl平台)上实现。The above steps 200 to 230 may be, but are not limited to, implemented on an existing image rendering platform (eg, OpenGl platform).
如果进行面绘制,相应的,获取体素在屏幕二维坐标系下对应的二维坐标的实现方式也有多种。If surface rendering is performed, correspondingly, there are various ways to obtain the corresponding two-dimensional coordinates of the voxels in the two-dimensional coordinate system of the screen.
例如,对上述对象的体素进行投影变换,获取每个体素在屏幕二维坐标系下对应的二维坐标。也就是通过模拟投影变换的过程,建立世界坐标系与屏幕二维坐标系的映射关系。无论采用体绘制或面绘制,均可以采用这种实现方式。尤其是采用面绘制时,由于面绘制过程中无法得到体素在屏幕二维坐标系下对应的二维坐标,因此可以采用该实现方式。该实现方式如图3所示,具体包括如下操作:For example, a voxel of the above object is subjected to projection transformation to obtain a corresponding two-dimensional coordinate of each voxel in a two-dimensional coordinate system of the screen. That is, by mapping the process of projection transformation, the mapping relationship between the world coordinate system and the screen two-dimensional coordinate system is established. This implementation can be used regardless of volume rendering or surface rendering. Especially when using surface rendering, the implementation can be adopted because the corresponding two-dimensional coordinates of the voxels in the two-dimensional coordinate system of the screen cannot be obtained during the surface rendering process. The implementation manner is as shown in FIG. 3, and specifically includes the following operations:
步骤300、获取对象的每个体素在世界坐标系中的三维坐标。Step 300: Obtain three-dimensional coordinates of each voxel of the object in the world coordinate system.
步骤310、将每个上述三维坐标依次乘以模型变换矩阵、投影变换矩阵和视口变换矩阵,得到对象的每个体素在上述屏幕二维坐标系下对应的二维坐标。Step 310: Multiply each of the three-dimensional coordinates by a model transformation matrix, a projection transformation matrix, and a viewport transformation matrix, to obtain two-dimensional coordinates corresponding to each voxel of the object in the two-dimensional coordinate system of the screen.
其中,模型变换矩阵、投影变换矩阵和视口变换矩阵即投影参数。Among them, the model transformation matrix, the projection transformation matrix and the viewport transformation matrix are projection parameters.
应当指出的是,将模型变换矩阵、投影变换矩阵和视口变换矩阵作为投影参数只是举例而非限定。It should be noted that the model transformation matrix, the projection transformation matrix, and the viewport transformation matrix as projection parameters are merely examples and are not limiting.
本发明实施例对投影参数的获取方式并不限定。例如,可以利用步骤100图像面绘制或体绘制过程所使用的投影参数。现有的图像绘制技术,能够将对 象完整、精确地显示为三维显示图像,这归功于其过程中所使用的投影参数。因此,利用图像绘制过程中所使用的投影参数进行模拟投影,可以将每个体素精确地映射到屏幕二维坐标系中,保证体素与视觉上的三维对象的坐标始终一一对应,保证了后续裁剪过程的准确性。The manner in which the projection parameters are acquired in the embodiment of the present invention is not limited. For example, the projection parameters used in the image 100 surface rendering or volume rendering process of step 100 can be utilized. Existing image rendering technology, can be right It is displayed in a complete and accurate manner as a three-dimensional display image, thanks to the projection parameters used in the process. Therefore, by using the projection parameters used in the image drawing process to simulate projection, each voxel can be accurately mapped to the two-dimensional coordinate system of the screen, ensuring that the coordinates of the voxels and the visual three-dimensional objects are always one-to-one, ensuring The accuracy of the subsequent cutting process.
如果进行图像体绘制,利用体绘制过程中的投影变换,即可得到对象的每个体素在上述屏幕二维坐标系下对应的二维坐标。现有的图像绘制技术,能够将对象完整、精确地显示为三维显示图像,这归功于其过程中所使用的投影参数。因此,利用图像绘制过程中得到的每个体素精确在屏幕二维坐标系中的映射关系,保证了后续裁剪过程的准确性。If image volume rendering is performed, the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the above-mentioned screen can be obtained by using the projection transformation in the volume rendering process. The existing image rendering technology can display the object completely and accurately as a three-dimensional display image, thanks to the projection parameters used in the process. Therefore, the accuracy of the subsequent cropping process is ensured by using the mapping relationship of each voxel obtained in the image drawing process accurately in the two-dimensional coordinate system of the screen.
为了进一步提高处理速度,上述步骤100中,如果进行图像面绘制,可以利用CUDA加速方式获取获取所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标。例如,通过GPU加速实现。In order to further improve the processing speed, in the above step 100, if the image surface rendering is performed, the CUDA acceleration method may be used to acquire the corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen. For example, it is implemented by GPU acceleration.
步骤110的具体实现方式:The specific implementation of step 110:
确定待裁剪区域的实现方式有多种。例如,根据鼠标移动轨迹获取用户在三维显示图像上选取的待裁剪区域的闭合曲线,相应的,待裁剪区域就是指闭合曲线内的区域。又例如,根据鼠标移动轨迹获取用户在三维显示图像上选取的闭合曲线,然后进行反选操作,相应的,待裁剪区域就是闭合曲线外的区域。等等。There are several ways to determine the area to be cropped. For example, the closed curve of the area to be cropped selected by the user on the three-dimensional display image is obtained according to the mouse movement trajectory, and correspondingly, the area to be cropped refers to the area within the closed curve. For another example, the closed curve selected by the user on the three-dimensional display image is obtained according to the mouse movement trajectory, and then the inverse selection operation is performed. Correspondingly, the area to be cropped is the area outside the closed curve. and many more.
由于鼠标移动轨迹会有不连续点的情况出现,也就是非闭合曲线,需要进行三次样条插值。即使手动选取的区域不是闭合的,也会自动进行插值形成闭合曲线,不会影响之后的判断。例如:Since the mouse movement trajectory has a discontinuous point, that is, a non-closed curve, cubic spline interpolation is required. Even if the manually selected area is not closed, the interpolation will be automatically performed to form a closed curve, which will not affect the subsequent judgment. E.g:
假定有n+1个数据节点(x0,y0),(x1,y1),(x2,y2)……(xn,yn)Suppose there are n+1 data nodes (x 0 , y 0 ), (x 1 , y 1 ), (x 2 , y 2 )...(x n , y n )
计算步长hi=xi+1-xi(i=0,1,……,n-1);Calculating the step size h i =x i+1 -x i (i=0,1,...,n-1);
将数据节点和指定的首位端点条件代入矩阵方程;Substituting the data node and the specified first endpoint condition into the matrix equation;
解矩阵方程,求得二次微分值mi,该矩阵为三对角矩阵;Solving the matrix equation and obtaining a quadratic differential value m i , the matrix being a three-diagonal matrix;
计算样条曲线的系数: Calculate the coefficients of the spline curve:
ai=yi a i =y i
Figure PCTCN2015081450-appb-000001
Figure PCTCN2015081450-appb-000001
Figure PCTCN2015081450-appb-000002
Figure PCTCN2015081450-appb-000002
Figure PCTCN2015081450-appb-000003
Figure PCTCN2015081450-appb-000003
在每个子区间xi≤x≤xi+1中创建方程:Create an equation in each subinterval x i ≤ x ≤ x i+1 :
gi(x)=ai+bi(x-xi)+ci(x-xi)2+di(x-xi)3 g i (x)=a i +b i (xx i )+c i (xx i ) 2 +d i (xx i ) 3
通过三次样条插值形成闭合曲线的具体实现方式可以参照现有实现方式,本发明不再赘述。The specific implementation manner of forming a closed curve by cubic spline interpolation can refer to the existing implementation manner, and the present invention will not be described again.
上述步骤120的具体实现方式:The specific implementation of the above step 120:
在执行步骤120之前,本发明实施例提供的方法还包括判断的步骤。即判断每个上述二维坐标处的三维显示图像像素点是否在上述待裁剪区域内。Before the step 120 is performed, the method provided by the embodiment of the present invention further includes the step of determining. That is, it is determined whether the pixel of the three-dimensional display image at each of the above two-dimensional coordinates is within the area to be cropped.
其中,如果步骤110具体是获取用户在三维显示图像上选取的待裁剪区域的闭合曲线,或对用户选取的闭合曲线进行反转后确定待裁剪区域。那么,判断的步骤中,具体是判断每个上述二维坐标处的三维显示图像像素点是否在该闭合曲线内。以图4所示为例,对判断步骤的具体实现方式进行说明。如图4所示,具体包括如下操作:Wherein, if the step 110 is specifically to obtain a closed curve of the area to be cropped selected by the user on the three-dimensional display image, or to reverse the closed curve selected by the user, the area to be cropped is determined. Then, in the step of determining, specifically determining whether the pixel of the three-dimensional display image at each of the two-dimensional coordinates is within the closed curve. Taking the example shown in FIG. 4 as an example, a specific implementation manner of the determining step will be described. As shown in FIG. 4, the following operations are specifically included:
步骤400、在上述屏幕二维坐标系下构建与上述三维显示图像的显示区域同样大小的矩形图像。Step 400: Construct a rectangular image of the same size as the display area of the three-dimensional display image in the two-dimensional coordinate system of the screen.
其中,该矩形图像的全部矩形图像像素点的像素值为第一像素值。The pixel value of all rectangular image pixel points of the rectangular image is a first pixel value.
举例说明,将该矩阵图象的全部矩阵图象像素点的像素值设置为0。For example, the pixel value of all matrix image pixel points of the matrix image is set to zero.
由于该矩阵图象建立在屏幕二维坐标系中,因此,该矩阵图象的矩阵图像像素点与三维显示图像像素点一一对应。Since the matrix image is established in the two-dimensional coordinate system of the screen, the matrix image pixel points of the matrix image are in one-to-one correspondence with the pixels of the three-dimensional display image.
举例说明,三维显示图像的显示区域大小为100个像素点*100个像素点,那么,上述矩阵图象的大小也为100个像素点*100个像素点。For example, the size of the display area of the three-dimensional display image is 100 pixels*100 pixels, and then the size of the matrix image is also 100 pixels*100 pixels.
步骤410、将上述矩形图像中上述闭合曲线(即待裁剪区域)对应的二维 坐标处的矩形图像像素点的像素值修改为第二像素值,得到轮廓曲线。Step 410: The two-dimensional corresponding to the closed curve (ie, the area to be cropped) in the rectangular image. The pixel value of the rectangular image pixel at the coordinate is modified to the second pixel value to obtain a contour curve.
其中,第一像素值的取值与第二像素值的取值不同。The value of the first pixel value is different from the value of the second pixel value.
具体的,利用轮廓检测查找上述闭合曲线的外轮廓,并映射到矩形图像的对应区域,将该对应区域的像素值改为第二像素值,例如255,得到轮廓曲线。Specifically, the contour of the closed curve is searched for by the contour detection, and mapped to a corresponding area of the rectangular image, and the pixel value of the corresponding area is changed to a second pixel value, for example, 255, to obtain a contour curve.
步骤420、判断上述矩形图像中每个矩形图像像素点是否在该述轮廓曲线内。Step 420: Determine whether each rectangular image pixel in the rectangular image is within the contour curve.
具体的,利用射线法进行比较判断。如果一个矩形图像像素点引出的射线与轮廓曲线的交点数目为偶数,则表示该矩形图像像素点在轮廓曲线的外部,如果一个矩形图像像素点引出的射线与轮廓曲线的交点数目为奇数,则表示该矩形图像像素点在轮廓曲线的内部。Specifically, the comparison is judged by the ray method. If the number of intersections of the ray and the contour curve drawn by the pixel of one rectangular image is an even number, it means that the pixel of the rectangular image is outside the contour curve. If the number of intersections of the ray and the contour curve drawn by the pixel of one rectangular image is an odd number, then Indicates that the rectangular image pixel is inside the contour curve.
为了进一步提高处理速度,上述判断的步骤具体可以利用CUDA加速方式实现。例如,通过GPU加速实现。In order to further improve the processing speed, the above determining step may be specifically implemented by using a CUDA acceleration method. For example, it is implemented by GPU acceleration.
步骤130的具体实现方式:The specific implementation of step 130:
绘制过程中所使用的投影变换方式不做限定,既可以采用平行投影,也可以采用透视投影。The projection transformation method used in the drawing process is not limited, and either a parallel projection or a perspective projection can be used.
应当指出的是,上述各个步骤的具体实现方式之间可以相互配合。It should be noted that the specific implementations of the various steps described above can be coordinated.
基于上述任意方法实施例,在将对象的三维图像数据进行图像绘制之前,该方法还包括:Based on any of the foregoing method embodiments, before performing image rendering on the three-dimensional image data of the object, the method further includes:
对包含所述对象的图像序列进行分割,获得所述对象的三维图像的体素和面素。The image sequence including the object is segmented to obtain voxels and voxels of the three-dimensional image of the object.
具体的,对包含对象的图像序列进行分割,得到对象图像序列,进而根据该对象图像序列得到对象的体素和面素。Specifically, the image sequence including the object is segmented to obtain a target image sequence, and the voxel and the voxel of the object are obtained according to the target image sequence.
通过进行分割,由于多个对象的三维坐标之间互不干扰,因此可以将图像序列中显示的多个对象分割为不同的对象图像序列,进而针对不同的分割目的和应用场景,同时对单个或多个对象并行进行图像裁剪处理,从而提高处理速度。类似于模拟手术过程,手术刀可以切除某一器官组织的病变位置,也同时 切除掉相邻的器官组织病变位置。切割对象可以根据实际需要进行,这在模拟手术过程中是非常关键的一步,也是符合实际情况的。By performing the segmentation, since the three-dimensional coordinates of the plurality of objects do not interfere with each other, the plurality of objects displayed in the image sequence can be segmented into different object image sequences, and then for different segmentation purposes and application scenarios, simultaneously for a single or Multiple objects are image-cut in parallel to increase processing speed. Similar to the simulated surgical procedure, the scalpel can remove the lesion location of an organ tissue, and at the same time Remove the location of adjacent organ tissue lesions. The cutting object can be carried out according to actual needs, which is a very important step in the simulation surgery, and it is also in line with the actual situation.
下面以具体应用场景为例,对本发明实施例提供的方法进行详细说明。如图5所示,具体包括如下操作:The method provided by the embodiment of the present invention is described in detail below by taking a specific application scenario as an example. As shown in FIG. 5, the following operations are specifically included:
步骤500、将采用CT扫描得到的胸腔的图像序列进行分割,得到肝脏图像序列,进而根据肝脏图像序列得到肝脏的体素和面素。In step 500, the image sequence of the chest cavity obtained by CT scanning is segmented to obtain a liver image sequence, and the liver voxels and surface elements are obtained according to the liver image sequence.
其中,胸腔的图像序列可以但不仅限于是从DICOM中获取的。Among them, the image sequence of the chest can be, but is not limited to, obtained from DICOM.
应当指出的是,步骤500中,分割不仅可以得到肝脏图像序列,还可以得到其他器官的图像序列,不同器官的图像序列分别独立保存。本实施例仅以肝脏图像序列的裁剪进行举例说明。It should be noted that, in step 500, the segmentation can not only obtain the liver image sequence, but also obtain image sequences of other organs, and the image sequences of different organs are separately stored. This embodiment is exemplified only by the cropping of the liver image sequence.
如果分割得到多个器官的图像序列,且这些器官均需要进行三维图像裁剪,则可以同时实现对这些器官的三维图像裁剪。If the image sequence of multiple organs is segmented and these organs require three-dimensional image cropping, three-dimensional image cropping of these organs can be simultaneously achieved.
步骤510、构建世界坐标系。Step 510: Construct a world coordinate system.
假设有N张肝脏图像序列,以第一张肝脏图像的左上角为坐标原点,行方向为X轴正方向,列方向为Y轴正方向,图像序列的方向为Z轴正方向构建世界坐标系。Suppose there are N liver image sequences, with the upper left corner of the first liver image as the coordinate origin, the row direction as the positive X-axis direction, the column direction as the positive direction of the Y-axis, and the direction of the image sequence as the positive direction of the Z-axis to construct the world coordinate system. .
步骤520、将肝脏的体素或面素进行模型变换,并记录所使用的模型变换矩阵。Step 520: Perform model transformation on the voxel or noodle of the liver, and record the model transformation matrix used.
所谓模型变换,即对三维物体模型(由体素或面素构建)进行旋转、平移和缩放,类似于三维物体放在场景中的适当位置。模型变换所使用的模型变换矩阵称为modeMatrix。The so-called model transformation, that is, the rotation, translation and scaling of a three-dimensional object model (constructed by voxels or voxels), similar to the appropriate position of a three-dimensional object placed in the scene. The model transformation matrix used for model transformation is called modeMatrix.
步骤530、将经过模型变换后的数据进行投影变换,并记录所使用的投影变换矩阵。Step 530: Perform projective transformation on the model transformed data, and record the projection transformation matrix used.
所谓投影变换,以平行投影为例,投影的视景体是一个矩形的平型管道,无论物体距离多远,投影后的物体大小、尺寸不变。投影变换所使用的投影变换矩阵称为projMatrix。 The so-called projection transformation, taking parallel projection as an example, the projected view body is a rectangular flat pipe, no matter how far the object is, the size and size of the object after projection are unchanged. The projection transformation matrix used for projection transformation is called projMatrix.
以上以平行投影举例,本实施例也可采用透视投影,其具体实现方式不再赘述。The above is exemplified by the parallel projection. The embodiment can also adopt a perspective projection, and the specific implementation manner thereof will not be described again.
步骤540、将经过模型变换和投影变换后得到的肝脏三维显示图像显示于屏幕窗口的指定区域,并记录视口变换矩阵(又称视口向量)。Step 540: Display the three-dimensional display image of the liver obtained by the model transformation and the projection transformation on a specified area of the screen window, and record the viewport transformation matrix (also referred to as a viewport vector).
具体的,经过模型变换和投影变换后,还需要经过裁剪变换,即取景。将取景后的肝脏三维显示图像显示在屏幕窗口的指定区域。假设每个体素或面素的坐标是objcoor[objx,objy,objz,1.0],依次乘以模型视图矩阵modelMatrix、投影变换矩阵projMatrix,最后使用视口变换矩阵将齐次表示的三维显示图像像素点限定在当前的视口内。Specifically, after the model transformation and the projection transformation, it is also necessary to undergo a cropping transformation, that is, framing. The three-dimensional display image of the liver after the framing is displayed in a designated area of the screen window. Suppose the coordinates of each voxel or voxel are objcoor[objx, objy, objz, 1.0], multiply the model view matrix modelMatrix, the projection transformation matrix projMatrix, and finally use the viewport transformation matrix to represent the three-dimensional display image pixels in homogeneous order. Limited to the current viewport.
应当指出的是,步骤510~步骤540是进行图像绘制的过程,在进行图像绘制之前,还需要进行数据格式的转化(转化成STL格式)。It should be noted that steps 510 to 540 are processes for image rendering, and data format conversion (conversion into STL format) is required before image rendering.
步骤550、获取肝脏的每个体素在世界坐标系中的三维坐标。Step 550: Obtain three-dimensional coordinates of each voxel of the liver in a world coordinate system.
步骤560、将肝脏的每个体素的三维坐标依次乘以模型变换矩阵、投影变换矩阵和视口变换矩阵,得到肝脏的每个体素在上述屏幕二维坐标系下对应的二维坐标。Step 560: Multiply the three-dimensional coordinates of each voxel of the liver by the model transformation matrix, the projection transformation matrix, and the viewport transformation matrix to obtain corresponding two-dimensional coordinates of each voxel of the liver in the above-mentioned screen two-dimensional coordinate system.
步骤570、根据鼠标移动轨迹获取用户在肝脏三维显示图像上选取的待裁剪区域的闭合曲线。Step 570: Acquire a closed curve of the to-be-cut region selected by the user on the three-dimensional display image of the liver according to the mouse movement track.
步骤580、在上述屏幕二维坐标系下构建与上述肝脏三维显示图像的显示区域同样大小的矩形图像。Step 580: Construct a rectangular image of the same size as the display area of the liver three-dimensional display image in the two-dimensional coordinate system of the screen.
步骤590、将上述矩形图像中上述闭合曲线对应的二维坐标处的矩形图像像素点的像素值修改为第二像素值,得到轮廓曲线。Step 590: Modify a pixel value of a rectangular image pixel point at a two-dimensional coordinate corresponding to the closed curve in the rectangular image to a second pixel value to obtain a contour curve.
步骤5100、判断上述矩形图像中每个矩形图像像素点是否在该述轮廓曲线内。Step 5100: Determine whether each rectangular image pixel in the rectangular image is within the contour curve.
步骤5110、舍弃位于该闭合曲线内的肝脏三维显示图像像素点所在二维坐标对应的体素,以及这些体素对应的面素。Step 5110: Discard the voxels corresponding to the two-dimensional coordinates of the three-dimensional display image pixel located in the closed curve, and the voxels corresponding to the voxels.
步骤5120、根据保留下来的肝脏体素或面素重新进行图像绘制。 Step 5120: Re-image the image according to the retained liver voxel or facial layer.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
尽管已描述了本发明的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。 It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims (10)

  1. 一种三维图像的裁剪方法,其特征在于,包括:A method for cropping a three-dimensional image, comprising:
    根据对象的面素进行图像面绘制,得到所述对象在屏幕二维坐标系下的三维显示图像,获取所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标;或者,根据对象的体素进行图像体绘制,得到所述对象在屏幕二维坐标系下的三维显示图像和所述对象的每个所述体素在所述屏幕二维坐标系下对应的二维坐标;Obtaining an image surface according to a surface element of the object, obtaining a three-dimensional display image of the object in a two-dimensional coordinate system of the screen, and acquiring a corresponding two-dimensional coordinate of each voxel of the object in the two-dimensional coordinate system of the screen; or And performing image volume rendering according to the voxel of the object, obtaining a three-dimensional display image of the object in a two-dimensional coordinate system of the screen, and corresponding two-dimensional corresponding to each voxel of the object in the two-dimensional coordinate system of the screen. coordinate;
    确定所述三维显示图像上的待裁剪区域;Determining a region to be cropped on the three-dimensional display image;
    舍弃位于所述待裁剪区域内的三维显示图像像素点所在二维坐标对应的所述体素,及其对应的面素;Discarding the voxel corresponding to the two-dimensional coordinate of the pixel of the three-dimensional display image in the area to be cropped, and its corresponding surface element;
    根据保留下来的面素重新进行图像面绘制或根据保留下来的体素重新进行图像体绘制。Re-image the surface based on the remaining voxels or re-image the image based on the retained voxels.
  2. 根据权利要求1所述的方法,其特征在于,如果根据对象的面素进行图像面绘制,得到所述对象在屏幕二维坐标系下的三维显示图像,所述获取每个所述体素在所述屏幕二维坐标系下对应的二维坐标,包括:The method according to claim 1, wherein if the image surface rendering is performed according to a surface element of the object, a three-dimensional display image of the object in a two-dimensional coordinate system of the screen is obtained, and the acquiring each of the voxels is The corresponding two-dimensional coordinates of the two-dimensional coordinate system of the screen include:
    对所述对象的体素进行投影变换,获取所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标。Performing a projection transformation on the voxels of the object, and acquiring corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen.
  3. 根据权利要求2所述的方法,其特征在于,所述对所述对象的体素进行投影变换,获取所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标,包括:The method according to claim 2, wherein the voxel of the object is subjected to projection transformation, and corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen are obtained, including :
    获取每个所述体素在世界坐标系中的三维坐标;Obtaining three-dimensional coordinates of each of the voxels in a world coordinate system;
    将每个所述三维坐标依次乘以模型变换矩阵、投影变换矩阵和视口变换矩阵,得到每个所述体素在所述屏幕二维坐标系下对应的二维坐标。Each of the three-dimensional coordinates is sequentially multiplied by a model transformation matrix, a projection transformation matrix, and a viewport transformation matrix to obtain two-dimensional coordinates corresponding to each voxel in the two-dimensional coordinate system of the screen.
  4. 根据权利要求3所述的方法,其特征在于,所述对所述对象的体素进行投影变换,获取每个所述体素在所述屏幕二维坐标系下对应的二维坐标之前,该方法还包括: The method according to claim 3, wherein the voxel of the object is subjected to projection transformation to obtain a corresponding two-dimensional coordinate of each voxel in the two-dimensional coordinate system of the screen, The method also includes:
    获取根据所述对象的面素进行图像面绘制过程所使用的模型变换矩阵、投影变换矩阵和视口变换矩阵。Obtaining a model transformation matrix, a projection transformation matrix, and a viewport transformation matrix used for the image surface rendering process according to the facet of the object.
  5. 根据权利要求1~4任一项所述的方法,其特征在于,舍弃位于所述待裁剪区域内的三维显示图像像素点所在二维坐标对应的所述体素,及其对应的面素之前;该方法还包括:The method according to any one of claims 1 to 4, wherein the voxel corresponding to the two-dimensional coordinates of the three-dimensional display image pixel located in the area to be cropped is discarded, and the corresponding facet is The method also includes:
    判断每个所述二维坐标处的三维显示图像像素点是否在所述待裁剪区域内。Determining whether the three-dimensional display image pixel point at each of the two-dimensional coordinates is within the to-be-cut region.
  6. 根据权利要求5所述的方法,其特征在于,所述判断每个所述二维坐标处的三维显示图像像素点是否在所述待裁剪区域内,包括:The method according to claim 5, wherein the determining whether the pixel of the three-dimensional display image at each of the two-dimensional coordinates is within the area to be cropped comprises:
    在所述屏幕二维坐标系下构建与所述三维显示图像的显示区域同样大小的矩形图像,所述矩形图像的全部矩形图像像素点的像素值为第一像素值;Constructing a rectangular image of the same size as the display area of the three-dimensional display image in the two-dimensional coordinate system of the screen, wherein the pixel values of all rectangular image pixel points of the rectangular image are the first pixel value;
    将所述矩形图像中所述待裁剪区域对应的二维坐标处的矩形图像像素点的像素值修改为第二像素值,得到轮廓曲线;Modifying a pixel value of a rectangular image pixel point at a two-dimensional coordinate corresponding to the to-be-cut region in the rectangular image to a second pixel value, to obtain a contour curve;
    判断所述矩形图像中每个矩形图像像素点是否在所述轮廓曲线内。Determining whether each rectangular image pixel in the rectangular image is within the contour curve.
  7. 根据权利要求2所述的方法,其特征在于,所述对所述对象的体素进行投影变换,获取所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标,包括:The method according to claim 2, wherein the voxel of the object is subjected to projection transformation, and corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen are obtained, including :
    利用CUDA加速方式对所述对象的体素进行投影变换,得到所述对象的每个体素在所述屏幕二维坐标系下对应的二维坐标。The voxels of the object are subjected to projection transformation using a CUDA acceleration method to obtain corresponding two-dimensional coordinates of each voxel of the object in the two-dimensional coordinate system of the screen.
  8. 根据权利要求5所述的方法,其特征在于,判断每个所述二维坐标处的三维显示图像像素点是否在所述待裁剪区域内,包括:The method of claim 5, wherein determining whether the pixel of the three-dimensional display image at each of the two-dimensional coordinates is within the area to be cropped comprises:
    利用CUDA加速方式判断每个所述二维坐标处的三维显示图像像素点是否在所述待裁剪区域内。The CUDA acceleration mode is used to determine whether the pixel of the three-dimensional display image at each of the two-dimensional coordinates is within the area to be cropped.
  9. 根据权利要求1~4任一项所述的方法,其特征在于,根据对象的面素进行图像面绘制之前或者根据所述对象的体素进行图像体绘制之前,该方法还包括: The method according to any one of claims 1 to 4, wherein before the image surface rendering according to the facet of the object or before the image volume rendering according to the voxel of the object, the method further comprises:
    对包含所述对象的图像序列进行分割,获得所述对象的体素和面素。A sequence of images containing the object is segmented to obtain voxels and venopes of the object.
  10. 根据权利要求1~4任一项所述的方法,其特征在于,所述确定所述三维显示图像上的待裁剪区域,包括:The method according to any one of claims 1 to 4, wherein the determining the area to be cropped on the three-dimensional display image comprises:
    确定用户在所述三维显示图像上选取的待裁剪区域的闭合曲线。 A closed curve of the region to be cropped selected by the user on the three-dimensional display image is determined.
PCT/CN2015/081450 2015-04-17 2015-06-15 3d image cropping method WO2016165209A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510185590.4 2015-04-17
CN201510185590.4A CN104794758B (en) 2015-04-17 2015-04-17 A kind of method of cutting out of 3-D view

Publications (1)

Publication Number Publication Date
WO2016165209A1 true WO2016165209A1 (en) 2016-10-20

Family

ID=53559535

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/081450 WO2016165209A1 (en) 2015-04-17 2015-06-15 3d image cropping method

Country Status (2)

Country Link
CN (1) CN104794758B (en)
WO (1) WO2016165209A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107424211A (en) * 2017-06-15 2017-12-01 彭志勇 WebGL volume reconstruction methods
CN108830936A (en) * 2018-05-24 2018-11-16 讯飞幻境(北京)科技有限公司 3D model shakes prevention method and device
CN111325826A (en) * 2020-01-10 2020-06-23 郑州航空工业管理学院 Engineering drawing model projection system and method
CN111681315A (en) * 2020-06-10 2020-09-18 中国电子科技集团公司第二十八研究所 High altitude and profile plotting positioning method based on three-dimensional GIS map
CN112765706A (en) * 2020-12-31 2021-05-07 杭州群核信息技术有限公司 Home decoration material moving method and device, computer equipment and storage medium
CN113656954A (en) * 2021-08-10 2021-11-16 北京首钢自动化信息技术有限公司 Cutting map generation method and device
CN113706658A (en) * 2021-08-18 2021-11-26 江苏红豆工业互联网有限公司 Discretization parameter drawing method based on clothing arc curve
CN115131371A (en) * 2022-07-12 2022-09-30 中国建筑西南设计研究院有限公司 Two-three-dimensional mixed cutting method and terminal for building structural member based on surface area
CN115147440A (en) * 2022-07-12 2022-10-04 中国建筑西南设计研究院有限公司 Automatic basic slope-making line generation method based on surface area cutting method

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107092430B (en) * 2016-02-18 2020-03-24 纬创资通(中山)有限公司 Space drawing scoring method, device and system for scoring space drawing
CN105976394B (en) * 2016-05-31 2019-01-29 深圳市恩普电子技术有限公司 A kind of method of cutting out of adaptive adjustment fetus three-D ultrasound data
WO2018218478A1 (en) 2017-05-31 2018-12-06 上海联影医疗科技有限公司 Method and system for image processing
CN107194925A (en) * 2017-05-31 2017-09-22 上海联影医疗科技有限公司 Image processing method and system
CN108492299B (en) * 2018-03-06 2022-09-16 天津天堰科技股份有限公司 Cutting method of three-dimensional image
CN108984262B (en) * 2018-07-12 2021-04-13 宁波视睿迪光电有限公司 Three-dimensional pointer creating method and device and electronic equipment
CN109147061B (en) * 2018-07-20 2022-04-01 清华大学 Method for carrying out human-computer interaction editing on segmentation result of volume data
CN111899351A (en) * 2019-05-05 2020-11-06 中国石油化工股份有限公司 Screening method for objects of three-dimensional visual scene
CN110703963B (en) * 2019-09-09 2021-07-06 稿定(厦门)科技有限公司 3D character display method, medium, equipment and device
CN111784823B (en) * 2020-07-03 2023-10-03 江苏徐工工程机械研究院有限公司 Light-weight three-dimensional model mapping-prevention display method and device and storage medium
CN113409333B (en) * 2021-06-16 2022-07-22 青岛海信医疗设备股份有限公司 Three-dimensional image cutting method and electronic equipment
CN114459397B (en) * 2022-03-01 2024-02-20 公安部第一研究所 CT image size measuring method
CN116228949B (en) * 2023-02-28 2024-03-08 如你所视(北京)科技有限公司 Three-dimensional model processing method, device and storage medium
CN116431095B (en) * 2023-03-23 2024-04-30 北京凯视达科技股份有限公司 Panoramic display method, panoramic display device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101593357A (en) * 2008-05-28 2009-12-02 中国科学院自动化研究所 A kind of interactive body cutting method based on the three-dimensional planar control
US20120177258A1 (en) * 2010-11-26 2012-07-12 Kevin Scott Hakl Methods and apparatus for generating a modified intensity projection image
CN103810752A (en) * 2014-02-18 2014-05-21 海信集团有限公司 Liver segmenting method based on medical image and liver segmenting system thereof
CN104050689A (en) * 2014-06-10 2014-09-17 黄淮学院 Visual object two-dimensional cutting generation method in virtual scene
CN104463942A (en) * 2014-10-31 2015-03-25 上海联影医疗科技有限公司 Three-dimensional image cropping method and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102074039B (en) * 2010-09-29 2012-12-19 深圳市蓝韵网络有限公司 Method for drawing volume rendering cutting surface
US8817076B2 (en) * 2011-08-03 2014-08-26 General Electric Company Method and system for cropping a 3-dimensional medical dataset
CN103049930B (en) * 2012-12-06 2016-07-06 南方医科大学 The dynamic Gauss body Model method for drafting of 3 d medical images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101593357A (en) * 2008-05-28 2009-12-02 中国科学院自动化研究所 A kind of interactive body cutting method based on the three-dimensional planar control
US20120177258A1 (en) * 2010-11-26 2012-07-12 Kevin Scott Hakl Methods and apparatus for generating a modified intensity projection image
CN103810752A (en) * 2014-02-18 2014-05-21 海信集团有限公司 Liver segmenting method based on medical image and liver segmenting system thereof
CN104050689A (en) * 2014-06-10 2014-09-17 黄淮学院 Visual object two-dimensional cutting generation method in virtual scene
CN104463942A (en) * 2014-10-31 2015-03-25 上海联影医疗科技有限公司 Three-dimensional image cropping method and device

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107424211B (en) * 2017-06-15 2021-01-05 彭志勇 WebGL volume reconstruction method
CN107424211A (en) * 2017-06-15 2017-12-01 彭志勇 WebGL volume reconstruction methods
CN108830936B (en) * 2018-05-24 2022-07-05 讯飞幻境(北京)科技有限公司 3D model jitter prevention method and device
CN108830936A (en) * 2018-05-24 2018-11-16 讯飞幻境(北京)科技有限公司 3D model shakes prevention method and device
CN111325826A (en) * 2020-01-10 2020-06-23 郑州航空工业管理学院 Engineering drawing model projection system and method
CN111681315B (en) * 2020-06-10 2022-10-04 中国电子科技集团公司第二十八研究所 High altitude and profile plotting positioning method based on three-dimensional GIS map
CN111681315A (en) * 2020-06-10 2020-09-18 中国电子科技集团公司第二十八研究所 High altitude and profile plotting positioning method based on three-dimensional GIS map
CN112765706A (en) * 2020-12-31 2021-05-07 杭州群核信息技术有限公司 Home decoration material moving method and device, computer equipment and storage medium
CN112765706B (en) * 2020-12-31 2024-02-20 杭州群核信息技术有限公司 Home decoration material moving method and device, computer equipment and storage medium
CN113656954A (en) * 2021-08-10 2021-11-16 北京首钢自动化信息技术有限公司 Cutting map generation method and device
CN113706658B (en) * 2021-08-18 2023-09-05 江苏红豆工业互联网有限公司 Discretization parameter drawing method based on clothing circular arc curve
CN113706658A (en) * 2021-08-18 2021-11-26 江苏红豆工业互联网有限公司 Discretization parameter drawing method based on clothing arc curve
CN115147440A (en) * 2022-07-12 2022-10-04 中国建筑西南设计研究院有限公司 Automatic basic slope-making line generation method based on surface area cutting method
CN115131371A (en) * 2022-07-12 2022-09-30 中国建筑西南设计研究院有限公司 Two-three-dimensional mixed cutting method and terminal for building structural member based on surface area
CN115131371B (en) * 2022-07-12 2024-02-09 中国建筑西南设计研究院有限公司 Two-dimensional and three-dimensional hybrid cutting method and terminal for building structural member based on area
CN115147440B (en) * 2022-07-12 2024-04-19 中国建筑西南设计研究院有限公司 Automatic generation method of basic slope line based on surface area clipping method

Also Published As

Publication number Publication date
CN104794758A (en) 2015-07-22
CN104794758B (en) 2017-10-03

Similar Documents

Publication Publication Date Title
WO2016165209A1 (en) 3d image cropping method
Chen et al. SLAM-based dense surface reconstruction in monocular minimally invasive surgery and its application to augmented reality
JP4245353B2 (en) Object order volume rendering occlusion culling
US8149236B2 (en) Information processing apparatus and program
EP3340185B1 (en) Fast rendering of quadrics and marking of silhouettes thereof
ES2908588T3 (en) Method for controlling a mixed reality display screen, computer program, and display device
US8149237B2 (en) Information processing apparatus and program
JP2005531352A5 (en)
CN114445431B (en) Method and device for arbitrarily cutting medical three-dimensional image
US20060253021A1 (en) Rendering anatomical structures with their nearby surrounding area
CN102968791A (en) Interactive method for three-dimensional (3D) medical image/graphic display and system thereof
US20220346888A1 (en) Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality environment
Macedo et al. A semi-automatic markerless augmented reality approach for on-patient volumetric medical data visualization
Hachaj et al. Visualization of perfusion abnormalities with GPU-based volume rendering
Petkov et al. Interactive visibility retargeting in vr using conformal visualization
CN108492299B (en) Cutting method of three-dimensional image
Amara et al. Enhancing brain tumour aid diagnosis with augmented reality rendering-based 6 dof object pose estimation
Harders et al. New paradigms for interactive 3D volume segmentation
EP4322111A1 (en) Volumetric peeling method for monte carlo path tracing
EP4231246A1 (en) Technique for optical guidance during a surgical procedure
JP2002150311A (en) Image processing device
EP4258216A1 (en) Method for displaying a 3d model of a patient
US20240087218A1 (en) Systems and methods for automated rendering
TW202206030A (en) System and method for four-dimensional angiography
JP2024028133A (en) Computer-implemented method for rendering medical volume data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15888913

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15888913

Country of ref document: EP

Kind code of ref document: A1