WO2018094688A1

WO2018094688A1 - Fluoroscopy method and system for fluoroscopy of internal structure of object

Info

Publication number: WO2018094688A1
Application number: PCT/CN2016/107253
Authority: WO
Inventors: 付楠; 朱艳春; 余绍德; 陈昳丽; 张志成; 刘舒婷; 谢耀钦
Original assignee: 中国科学院深圳先进技术研究院
Priority date: 2016-11-25
Filing date: 2016-11-25
Publication date: 2018-05-31

Abstract

A fluoroscopy method and system for fluoroscopy of an internal structure of an object, the method comprising: acquiring a 3D model of an object to undergo fluoroscopy, and determining an outer layer structure and an internal structure of the 3D model, the outer layer structure representing a casing of the object to undergo fluoroscopy and the internal structure representing the internal composition of the object to undergo fluoroscopy; and using the 3D model to carry out imaging, and carrying out transparency processing on the outer layer structure of the 3D model during the imaging process. Said solution may carry out transparency processing of the casing of an object to undergo fluoroscopy, so that the casing will not block the object to undergo fluoroscopy and an image of the internal structure may be directly displayed without confusion.

Description

Perspective method and system for seeing the internal structure of an object

Technical field

The invention relates to the technical field of object perspective, in particular to a see-through method and system for seeing the internal structure of an object.

Background technique

When a device such as smart glasses is used to see through the internal structure of the object, the internal structure of the object to be seen is first obtained, and a 3D model is established according to the internal structure, and then the 3D model is imaged on the surface of the object to be seen, thereby producing a see-through effect.

At present, the way to establish a 3D model is to model the model by known technical parameters or by scanning equipment such as CT nuclear. However, the obtained internal structure of the object to be seen generally includes the outer shell of the object to be seen, and the outer shell is reconstructed together when the 3D model is built in the above manner, and the outer shell has no practical meaning for the perspective, but instead blocks the perspective, resulting in The image of the internal structure of the displayed object is not confusing, and it is difficult to see the actual situation of the specific internal structure.

Summary of the invention

The embodiment of the invention provides a perspective method for seeing the internal structure of the object, so as to solve the technical problem that the internal structure of the object is confusing and the internal structure image is disordered when the inner structure of the object is viewed in the prior art. The method includes: acquiring a 3D model of an object to be seen, determining an outer layer structure and an inner structure of the 3D model, the outer layer structure representing an outer shell of the object to be seen, the inner structure representing the object to be seen Internal configuration; imaging is performed using the 3D model, and the outer structure of the 3D model is transparently processed during the imaging process.

The embodiment of the present invention further provides a see-through system for seeing the internal structure of the object, so as to solve the technical problem that the internal structure of the object is confusing and the internal structure image is disordered when the inner structure of the object is viewed in the prior art. The system includes: a 3D model processing device for acquiring a 3D model of an object to be seen, determining an outer layer structure and an inner structure of the 3D model, the outer layer structure representing an outer shell of the object to be seen, the inner structure Representing an internal configuration of the object to be seen; an imaging device for imaging with the 3D model, and transparent processing of the outer structure of the 3D model during imaging.

In the embodiment of the present invention, after obtaining the 3D model of the object to be seen, the outer structure and the internal structure of the 3D model are first determined, that is, the outer shell and the inner structure of the object to be seen are distinguished in the 3D model, and then reused. 3D The model is imaged, and the outer structure of the 3D model is transparently processed during the imaging process, that is, the outer layer structure is not displayed, so that the outer shell of the object to be seen does not obscure the perspective, so that the image of the internal structure can be confused and intuitive. Show it out.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work. In the drawing:

1 is a flow chart of a perspective method for seeing an internal structure of an object according to an embodiment of the present invention;

2 is a schematic diagram 1 of a label display according to an embodiment of the present invention;

FIG. 3 is a schematic diagram 2 showing a label display according to an embodiment of the present invention; FIG.

4 is a schematic diagram of rendering different colors in different regions according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a display state change of a label according to an embodiment of the present invention; FIG.

6 is a structural block diagram of a perspective system for seeing an internal structure of an object according to an embodiment of the present invention;

FIG. 7 is a structural diagram of an apparatus according to an embodiment of the present invention.

detailed description

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. The illustrative embodiments of the present invention and the description thereof are intended to explain the present invention, but are not intended to limit the invention.

1 is a flow chart showing a perspective method of seeing an internal structure of an object in an embodiment of the present invention. As shown in FIG. 1 , a perspective method for seeing an internal structure of an object in an embodiment of the present invention may include:

Step 101: Acquire a 3D model of an object to be seen, determine an outer layer structure and an inner structure of the 3D model, the outer layer structure representing an outer shell of the object to be seen, the inner structure representing an interior of the object to be seen structure;

Step 102: Perform imaging using the 3D model, and transparently process the outer structure of the 3D model during the imaging process.

It can be seen from the flow shown in FIG. 1 that, in the embodiment of the present invention, after acquiring the 3D model of the object to be seen, the outer structure and the internal structure of the 3D model are first determined, that is, the object to be seen is distinguished in the 3D model. Outer casing and inside The structure is then, and then the 3D model is used for imaging. During the imaging process, the outer structure of the 3D model is transparent, that is, the outer structure is not displayed, so that the outer shell of the object to be seen does not obscure the perspective, so that the interior The image of the structure can be displayed without confusion or intuition.

In a specific implementation, the acquired 3D model is consistent with the shape of the object to be seen and corresponds to the internal structure, and is used when the internal structure of the object is viewed. Specifically, the above 3D model can be established by using the prior art, for example, using an existing structural diagram as a basis for establishing a 3D model, or using CT (Computed Tomography) and MRI (Magnetic Resonance Imaging). ) and other devices to image and model the perspective object.

In a specific implementation, in order to accurately distinguish the outer structure of the 3D model, in the embodiment, determining the outer structure of the 3D model includes: determining the same coordinate axis in each coordinate axis direction of the three-dimensional coordinates a maximum value and a minimum value of an intersection of a straight line parallel to the direction of the object to be seen, and a structure between the maximum value and the intersection point adjacent to the maximum value is determined as an outer layer structure The structure between the small value and the intersection adjacent to the minimum value is determined as the outer structure.

Specifically, in order to ensure that the internal structure can be seen in perspective without being obscured by the outer structure of the 3D model, it is necessary to define the outer structure in a 3D model without an explicit outer structure, and the outer structure is obtained as follows. The x, -x, y, -y, z, -z directions of the three-dimensional coordinate system (that is, the so-called six directions of front, back, left, and right, we will define the direction of the user as x, y, left) The side is z), respectively determining the maximum value and the minimum value of the intersection of the ray parallel to the direction of the coordinate axis and the boundary of the object to be seen, and the maximum value is the intersection of the ray entering the object to be seen and the boundary of the object to be seen The minimum value is the intersection of the boundary of the object to be seen through the object to be seen through the object, and the structure between the maximum value and the intersection point adjacent to the maximum value is determined as the outer structure, and the minimum value and The structure between the adjacent intersections of the minimum values is determined as the outer structure. Here, the boundary of the object to be seen refers to the outer shell object of the same material, that is, if the inner structure may closely fit the outer shell, in this case, as long as the inner structure and the outer shell material are different, it is considered not the outer shell but Internal structure. The strength or reflected signals of different materials on CT or MRI are often different, so we can distinguish between the material of the outer shell and the inner structure. The six directions in the three-dimensional coordinate system follow this operation to obtain the outer casing.

In the specific implementation, it is usually only necessary to see through the x-direction outer casing, that is, the direction of the user, to achieve the effect of seeing the internal structure. If it is necessary to include the model of the internal structure without the outer casing, it is necessary to All casings are removed. In order to get the effect of the object perspective, for example, we will transparently process the object shell in the x direction, that is, the imaging device, in the line of sight direction, that is, the imaging device sets the pixel color of the material to 0 (each channel is 0). ), so that the internal color can be shielded from the front side of the shell, achieving perspective effect fruit. As the target object moves, the perspective 3D model also moves and rotates together, while the forward (eg, x-direction) shell is always in perspective, ensuring that the perspective is visible at all times.

In practical applications, it is necessary to determine the position and angle of the object according to the appearance of the object observed by the camera (ie, the object to be seen above), thereby performing imaging of the 3D model according to the corresponding position and angle. This can ensure the correspondence between the 3D model and the actual object, thus ensuring the accuracy of the internal structure corresponding thereto. This function can be implemented by using the prior art, as long as the correspondence between the 3D model and the actual object is ensured, which is not specifically limited in this application.

In a specific implementation, when the display object in the internal structure forms a multi-layer superposition structure in the positional relationship, in order to avoid occlusion and nesting when the internal structure is displayed, in the embodiment, in the internal structure of the 3D model When the display object forms a multi-layered nested structure in the positional relationship, in the imaging process, all structures occluding the display object to be seen are transparent in the direction of the line of sight of the perspective. For example, in the imaging process, after the outer layer structure is made transparent, the user directly sees the first layer structure in the inner structure. If you want to further see the inner layer structure, then the inner part is in the imaging process. The structure of the first layer in the structure is transparent, so that the inner structure can be directly displayed. If there are more layers, the structure of each layer can be seen layer by layer, and only the structure before the layer structure is to be seen in the imaging process. Make it transparent. The way to transparentize the inner layer structure is the same as the way to transparently treat the outer layer structure. That is to say, when the inner layer structure needs to be seen through, the inner structure is considered to be transparent after the inner structure is considered as an object. The overall structure, and then the division of the outer structure, to regain the new outer casing and internal structure, the new casing is transparent. If it is necessary to continue to see through the more internal structure, the new internal structure as a whole is regarded as the overall structure of the object, and the outer structure (ie, the outer structure) is judged for the new internal structure, and then the determined outer casing is transparent. By analogy, the outer structure determined from the internal structure is transparently layer by layer until it is seen through to the internal structure requiring perspective.

In a specific implementation, in order to further clearly and intuitively display the internal structure, in the embodiment, after determining the outer structure and the internal structure of the 3D model, the method further includes: dividing the internal structure of the 3D model into multiple An area containing display objects, each rendered with a different color than the other areas. Specifically, the internal structure of the 3D model may be divided into a plurality of regions including the display object according to the material type or the positional relationship of the display object in the internal structure.

For example, according to different materials of the display object in the internal structure, the internal structure of the 3D model is divided into a plurality of regions including display objects, and each region is distinguished by using different colors, giving a feeling of different internal unit structures. In the case where the materials of the display objects in the internal structure are the same, the color of the internal structure of the model is unified, and the positional relationship between the structures is not easy to see. In this case, the technique of block rendering can be adopted, according to the internal structure. In the difference in the positional relationship of the displayed object, the internal structure of the 3D model is divided into a plurality of regions including the display object, and different regions are rendered by different colors, and the regions of the same material display object are rendered in different colors. To achieve the role of distinguishing the position relationship before and after, clear internal structure.

In the specific implementation, if the label information of the display object is randomly placed by itself, the labels are easily stacked on each other to affect the displayed content, as shown in FIG. 2 . In order to further ensure the clarity of the internal structure of the display, the label information is displayed completely. In the embodiment, after dividing the internal structure of the 3D model into multiple regions, the method further includes: setting a label threshold and a display threshold, and using the display area ( For each area, the available display area refers to the display area of the label information of the display object contained in the area when the internal structure of the object to be seen is seen from the direction of the line of sight of each perspective, the available display The image size of the occlusion relationship of the size, the distance, and the internal structure of the object to be seen is uncertain. It is necessary to judge according to the display result in actual use to know the size of the available display area. The area larger than the display threshold is a display area, where an available display area is smaller than the display threshold, and a display area having a display area larger than the label threshold is used to display a label of the display object included in the display area, and the available display area is smaller than the display area. The display area of the label threshold is displayed by means of a guide line. A label containing the display object, or a label extending the display object of the display object outside the display area and having no display object; in the direction of the line of sight of each perspective, according to the available display area and the label The relationship between the threshold and the display threshold determines the manner in which the label of the display object in each display area is displayed. For example, as shown in FIG. 3, when the display area is smaller than the display threshold, the object is considered to be completely occluded and cannot be observed, and the area is not displayed, and the color of the area and the label information are deleted; if the available display area If it is greater than the display threshold and greater than the label threshold, the label is displayed within the area. For example, the display mode of the cube; if the display area is larger than the display threshold and less than the label threshold, the label is displayed by means of an arrow, for example, the manner in which the sphere is displayed; or the label is extended outside the area and displayed in a space without the display object. ,E.g. The display of the cylinder.

In order to realize that the labels are not occluded and clearly displayed, specifically, the colored areas in the internal structure are calculated from the angle of view. If the color of a certain area is consistent with the colored color, the area is unoccluded, if the color of an area If there is a change, it indicates that the area is occluded. In this case, it is necessary to determine which area is occluded and remove the occluded color from the overlapping area. This way we can get a partition of a different color. As shown in Figure 4, the area consisting of 1-6 renders the color of the cube, the area consisting of 7-12 renders the color of the cylinder, and the area consisting of 13-14 renders the color of the sphere.

According to the results in Figure 4, we can display the label of the cube in the area of 1-6, the cylinder label is displayed in the area of 7-12, and the sphere label is displayed in the area of 13-14. There are 2 thresholds, one is the label Threshold, one is the display threshold. If the available display area of the area where the display object is located is smaller than the display threshold, the area is not displayed, that is, the display object in the non-display area is completely occluded and cannot be observed, and the display object in the non-display area is not labeled. Displaying, simultaneously deleting the color in the non-display area and the label information of the display object; if the available display area of the area where the display object is located is greater than the display threshold, the area is the display area, and if the display area is available for the display area, If it is smaller than the label threshold, the label of the display object included in the display object is displayed by using an arrow lead indication manner, or the label of the display object included in the display object is extended to the outside of the display area and displayed in a space without other display objects, for example, a cylinder. The display mode of the body and the sphere label; if the available display area of the display area is greater than the label threshold, the label of the display object contained in the display area is displayed in the display area, for example, the label display mode of the cube. Specifically, as shown in FIGS. 3 and 4, the label of the cube can be displayed in the area of 1-6. If the cylinder's label is displayed at 11-12, it will enter 4-5 or 13. This part is not a cylinder. Therefore, the best choice is that the cylinder's label is displayed in the area of 7-10. If the display area of 13-14 is smaller than the label threshold, the label is displayed in the manner indicated by the arrow, for example, the label display mode of the sphere.

The overall specific rules for displaying the label for the first time are as follows: It is judged that the marked area needs to be displayed, that is, the area where the available display area is larger than the display threshold. Then perform a label-by-region label addition display. When adding, first determine whether the label can be completely placed in the area (ie, whether the display area is larger than the above label threshold), if possible, add the display directly, for example, the display of the cube label; if it cannot be completely placed in the area, it is required Extend beyond the area, then you need to continue to determine whether the extended area has been occupied by other colors (ie, whether there are other display objects), if not occupied, the label is displayed, for example, the label of the cylinder is displayed; if the extended area It has been occupied by other colors, that is, it is not possible to display a label within the range of the area and the extended area adjacent to the color, and the guide line is used for display, for example, the display of the sphere.

In a specific implementation, the font size of the display label information is also variable. In the embodiment, after the internal structure of the 3D model is divided into multiple areas, the method further includes: displaying an available display area according to each display area. The size determines the font size of the display label, and the size of the available display area is proportional to the font size of the display label. Specifically, the font size of the display label is adjusted according to the size of the actual displayable area, and the larger the display area, the larger the label can be, thereby providing a clearer display.

In the specific implementation, since the movement or the observation angle of the object changes, the displayed area and the display of the label are not changed, but are changed. In order to realize the perspective of different angles, the present application adopts the above label display manner. In the direction of the line of sight of each perspective, according to the size relationship between the available display area and the label threshold and the display threshold, the manner of displaying the label is determined for each display area, specifically, according to the change of the angle, The change of the label display state of the area is as follows: as shown in FIG. 5, for the case where the label is displayed in the area, when the available display area of the area becomes large, the label display is substantially unchanged, and the available display area in the area becomes small, The display of the label will be extended beyond the area or displayed using the guide line depending on the result of the change in the available display area. For the case where the label is displayed outside the area, when the available display area of the area increases, the label display may not change or be displayed in the area. When the available display area of the area decreases, the label display does not change or turns into a guide line. display. When the sub-label is displayed as the guide line display, when the available display area of the area becomes large, the label display can be changed to the internal display of the area or the extended display may not change. When the available display area of the area is reduced, the label display may not occur. Change or become undisplayed. When the available display area of the area is increased for the case where the label is not displayed, the label display may be in a state of extended display or guide line display.

Based on the same inventive concept, an embodiment of the present invention also provides a see-through system for seeing the internal structure of an object, as described in the following embodiments. Since the principle of solving the problem of the perspective system of the internal structure of the perspective object is similar to the perspective method of the internal structure of the perspective object, the implementation of the perspective system of the internal structure of the perspective object can be referred to the implementation of the perspective method of the internal structure of the perspective object, and the repetition will not be repeated. . As used hereinafter, the term "unit" or "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

6 is a structural block diagram of a perspective system for seeing an internal structure of an object according to an embodiment of the present invention. As shown in FIG. 6, the system includes:

a 3D model processing device 601 for acquiring a 3D model of an object to be seen, determining an outer layer structure and an inner structure of the 3D model, the outer layer structure representing an outer shell of the object to be seen, the inner structure representing the The internal structure of the object to be seen;

The imaging device 602 is configured to perform imaging by using the 3D model, and the outer structure of the 3D model is transparently processed during the imaging process.

In one embodiment, the 3D model processing device is specifically configured to determine, in each coordinate axis direction of the three-dimensional coordinates, a maximum value of an intersection of a line parallel to the coordinate axis direction and a boundary of the object to be seen a minimum value, the structure between the maximum value and the intersection point adjacent to the maximum value is determined as an outer layer structure, and the structure between the minimum value and the intersection point adjacent to the minimum value is determined as Outer structure.

In one embodiment, the imaging device is further configured to: when the display object in the internal structure of the 3D model forms a multi-layered nested structure in a positional relationship, in the imaging process, in a line of sight direction of the perspective, All structures that are occluded before the display object to be seen are transparent.

In one embodiment, the 3D model processing device includes: a region dividing module, configured to divide an internal structure of the 3D model into a plurality of included after determining an outer structure and an internal structure of the 3D model The area where the object is displayed; the color rendering module is used to render each area with a different color than the other areas.

In an embodiment, the area dividing module is specifically configured to divide the internal structure of the 3D model into multiple areas including the display object according to different material types or positional relationships of the display objects in the internal structure. .

In one embodiment, the 3D model processing device further includes: a threshold setting module, configured to set a label threshold and a display threshold, wherein an available display area is greater than the display threshold, and the available display area is smaller than the display area. The display area of the display threshold is a non-display area, and the display area whose display area is larger than the label threshold displays a label of the display object included in the display area, and the display area whose display area is smaller than the label threshold is a guide line. The method displays the label of the display object contained in the display, or extends the label of the display object contained by itself to the space outside the display area and has no display object; for each area, the available display area refers to each perspective When the line of sight fluoresces the internal structure of the object to be seen, the display area of the label information of the display object included in the area may be displayed in the area; the display mode determining module is configured to display the line of sight in each perspective according to the display The relationship between the area and the label threshold and the display threshold is determined A Tag display object display area.

In one embodiment, the display mode determining module is further configured to determine a font size of the display label according to a size of an available display area of each display area, where the size of the available display area is proportional to the font size of the display label.

Specifically, the area dividing module, the color rendering module, the threshold setting module, and the display mode determining module may be software, hardware, or a combination of the two. For example, the processing chip and the like may be components that perform corresponding functions of the respective modules.

Embodiments of the present invention also provide a computer readable storage medium comprising computer readable instructions, when executed, causing a processor to perform at least: acquiring a 3D model of an object to be seen, determining the 3D An outer layer structure and an inner structure of the model, the outer layer structure representing an outer shell of the object to be seen, the inner structure representing an inner structure of the object to be seen; imaging using the 3D model, during the imaging process, The outer structure of the 3D model is made transparent.

In one embodiment, the computer readable instructions cause the processor to determine a maximum value and a minimum of an intersection of a line parallel to the direction of the coordinate axis and a boundary of the object to be seen in each coordinate axis direction of the three-dimensional coordinates. Value The structure between the large value and the intersection adjacent to the maximum value is determined as an outer layer structure, and the structure between the minimum value and the intersection point adjacent to the minimum value is determined as the outer layer structure.

In one embodiment, after the computer readable instructions cause the processor to determine the outer and inner structures of the 3D model, the display objects in the internal structure of the 3D model form a multi-level nested structure in a positional relationship. At the time of the imaging process, all structures that occlude the display object to be seen are transparent in the direction of the line of sight of the perspective.

In one embodiment, the computer readable instructions cause the processor to divide the internal structure of the 3D model into a plurality of regions including display objects after determining the outer structure and the internal structure of the 3D model, each Areas are rendered in one color that is different from other areas.

In one embodiment, the computer readable instructions cause the processor to divide the internal structure of the 3D model into a plurality of regions including the display object according to different material types or positional relationships of the display objects in the internal structure.

In one embodiment, the computer readable instructions cause the processor to set a label threshold and a display threshold after dividing the internal structure of the 3D model into a plurality of regions, wherein an available display area is greater than the display threshold a display area, where an available display area is smaller than the display threshold, and a display area having a display area larger than the label threshold is used to display a label of the display object included in the display area, and the available display area is smaller than the display area. The display area of the label threshold displays the label of the display object contained in the display by means of a guide line, or extends the label of the display object contained in the display area to the outside of the display area and displays the space without the display object; for each area, available The display area refers to the display area of the label information of the display object contained in the area when the internal structure of the object to be seen is seen from the direction of the line of sight of each perspective; in the direction of the line of sight of each perspective, Depending on the available display area and the label threshold and the display threshold System, it is determined to display the labels for each display object in the display area.

In one embodiment, the computer readable instructions cause the processor to determine the font size of the display label according to the size of the available display area of each display area after dividing the internal structure of the 3D model into a plurality of regions, and the available display The size of the area is proportional to the font size of the display label.

The embodiment of the present invention further provides an apparatus. As shown in FIG. 7, the apparatus includes: a processor 701; and a memory 702 including computer readable instructions that, when executed, cause the processor to perform the following operations: Obtaining a 3D model of the object to be seen, determining an outer layer structure and an inner structure of the 3D model, the outer layer structure representing an outer shell of the object to be seen, the inner structure representing an inner structure of the object to be seen; The 3D model performs imaging, and during the imaging process, the outer structure of the 3D model is transparent.

In one embodiment, the computer readable instructions cause the processor to determine a maximum value and a minimum of an intersection of a line parallel to the direction of the coordinate axis and a boundary of the object to be seen in each coordinate axis direction of the three-dimensional coordinates. a value, the structure between the maximum value and the intersection point adjacent to the maximum value is determined as an outer layer structure, and the structure between the minimum value and the intersection point adjacent to the minimum value is determined as an outer layer structure.

In one embodiment, the computer readable instructions cause the processor to form a plurality of nested positions in the positional relationship in the internal structure of the 3D model after determining the outer structure and the internal structure of the 3D model. In the structure, in the imaging process, in the direction of the line of sight of the perspective, all structures occluding the display object to be seen are transparent.

In a specific implementation, the processor and the memory including computer readable instructions may be embedded in the smart glasses.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above described specific embodiments of the present invention are further described in detail, and are intended to be illustrative of the embodiments of the present invention. All modifications, equivalent substitutions, improvements, etc., made within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims

A perspective method for seeing an internal structure of an object, comprising:

Obtaining a 3D model of the object to be seen, determining an outer layer structure and an inner structure of the 3D model, the outer layer structure representing an outer shell of the object to be seen, the inner structure representing an inner structure of the object to be seen;

Imaging is performed using the 3D model, and the outer structure of the 3D model is transparently processed during the imaging process.
The perspective method of seeing the internal structure of the object according to claim 1, wherein determining the outer structure of the 3D model comprises:

Determining a maximum value and a minimum value of an intersection of a line parallel to the direction of the coordinate axis and a boundary of the object to be seen in each coordinate axis direction of the three-dimensional coordinates, and maximizing the value and the maximum value The structure between the intersections of the neighbors is determined as an outer layer structure, and the structure between the minimum value and the intersection point adjacent to the minimum value is determined as the outer layer structure.
The perspective method of the inner structure of the perspective object according to claim 1, wherein after determining the outer layer structure and the inner structure of the 3D model, the method further comprises:

When the display object in the internal structure of the 3D model forms a multi-layered nested structure in the positional relationship, in the imaging process, in the direction of the line of sight of the perspective, all structures that are occluded before the display object to be seen are transparent. Processing.
The perspective method of the inner structure of the perspective object according to any one of claims 1 to 3, further comprising: after determining the outer layer structure and the inner structure of the 3D model,

The internal structure of the 3D model is divided into a plurality of regions including display objects, and each region is rendered with a color different from other regions.
The perspective method of the internal structure of the perspective object according to claim 4, wherein dividing the internal structure of the 3D model into a plurality of regions comprises:

The internal structure of the 3D model is divided into a plurality of regions including display objects, depending on the material type or positional relationship of the display object in the internal structure.
The perspective method of the internal structure of the perspective object according to claim 4, further comprising: after dividing the internal structure of the 3D model into a plurality of regions, further comprising:

The label threshold and the display threshold are set, wherein an area in which the display area is larger than the display threshold is a display area, and an area in which the display area is smaller than the display threshold is a non-display area, and the display area in which the display area is larger than the label threshold is used. Displaying a label of a display object included in the display area, and displaying a label of the display object included in the display area by using a guide line with a display area smaller than the label threshold, or The label containing the display object is extended into the space outside the display area and has no display object; for each area, the available display area refers to the internal structure of the object to be seen through from the line of sight direction of each perspective, The display area of the label information that can be used to display the display object contained in the area;

In the direction of the line of sight of each perspective, the manner in which the labels of the display objects in each display area are displayed is determined according to the magnitude relationship of the available display area to the label threshold and the display threshold.
The perspective method of the internal structure of the perspective object according to claim 6, further comprising: after dividing the internal structure of the 3D model into a plurality of regions, further comprising:

The font size of the display label is determined according to the size of the available display area of each display area, and the size of the available display area is proportional to the font size of the display label.
A see-through system for seeing an internal structure of an object, comprising:

a 3D model processing device for acquiring a 3D model of an object to be seen, determining an outer layer structure and an inner structure of the 3D model, the outer layer structure representing an outer shell of the object to be seen, the inner structure indicating the waiting The internal structure of the see-through object;

An imaging device for imaging with the 3D model, wherein an outer layer structure of the 3D model is transparent during the imaging process.
The perspective system of the internal structure of the perspective object according to claim 8, wherein the 3D model processing device is specifically configured to determine a straight line parallel to the direction of the coordinate axis in each coordinate axis direction of the three-dimensional coordinates. Determining the maximum value and the minimum value of the intersection of the boundary of the see-through object, and determining the structure between the maximum value and the intersection point adjacent to the maximum value as the outer layer structure, and the minimum value and the The structure between the adjacent intersections of the minimum values is determined as the outer structure.
The perspective system of the internal structure of the perspective object according to claim 8, wherein the image forming apparatus is further configured to: when the display object in the internal structure of the 3D model forms a multi-layer nested structure in a positional relationship During the imaging process, all structures that occlude the display object to be seen are transparent in the direction of the line of sight of the perspective.