WO2023109567A1 - Method for denoising triangular mesh based on dual graph neural network - Google Patents

Method for denoising triangular mesh based on dual graph neural network Download PDF

Info

Publication number
WO2023109567A1
WO2023109567A1 PCT/CN2022/136755 CN2022136755W WO2023109567A1 WO 2023109567 A1 WO2023109567 A1 WO 2023109567A1 CN 2022136755 W CN2022136755 W CN 2022136755W WO 2023109567 A1 WO2023109567 A1 WO 2023109567A1
Authority
WO
WIPO (PCT)
Prior art keywords
graph
vertices
patch
neural network
denoising
Prior art date
Application number
PCT/CN2022/136755
Other languages
French (fr)
Chinese (zh)
Inventor
张英奎
王琼
赵保亮
孙寅紫
王平安
Original Assignee
深圳先进技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳先进技术研究院 filed Critical 深圳先进技术研究院
Publication of WO2023109567A1 publication Critical patent/WO2023109567A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • G06T17/205Re-meshing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]

Definitions

  • the invention relates to computer software, in particular to a method, device, equipment and storage medium for denoising triangular grids based on a dual graph neural network.
  • Triangular mesh is one of the most common representation forms of 3D geometry, which includes a set of 3D point sets and a set of facets, each triangular facet consists of three point indices. Due to the noise triangular mesh generated by various reasons, the three-dimensional vertices are shifted, resulting in the inability to accurately represent the local geometric structure and forming noise. Triangular mesh denoising aims to correct the offset of vertices while preserving the original patch topology, and preserve the underlying geometric details while accurately removing noise.
  • the existing triangular mesh denoising methods can be mainly divided into traditional filtering or optimization-based methods and learning-based methods.
  • Traditional filtering and its derivative methods can achieve good denoising effects, but it is difficult to preserve fine geometric details, while optimization-based methods, such as L0 minimization, low-rank restoration, etc., usually do not remove noise completely and are less efficient .
  • learning-based methods have achieved outstanding denoising results. For example, according to the existing normal filter descriptor, and then use a single-layer neural network for patch normal regression.
  • An iterative denoising algorithm is realized by combining 3D voxelization and 3D convolutional neural network. By constructing a normal matrix block of non-local similarity, and learning it with a convolutional neural network to output the denoised patch normal.
  • the above method is a two-step method: first, perform normal regression on the triangular patch to obtain the denoised surface normal, and then update the noise vertex coordinates according to the normal to output the final denoised mesh.
  • these methods ignore two points: (1) Since the vertices of the noisy grid itself contain noise, it is difficult to perform normal regression directly from these noisy attributes. (2) After obtaining the denoised surface Backward of the slice normal, it is also difficult to directly update the original noise vertices to preserve their underlying geometric properties.
  • the embodiment of the present application provides a method for denoising triangular meshes based on a dual graph neural network, the method comprising:
  • the graph structure based on the vertices is used in the neural network to pre-denoise the noise vertices, and the graph structure based on the patch is used in the neural network to denoise the normal direction of the patch;
  • the pre-denoised vertices are updated according to the denoised patch normals to output the final triangle mesh.
  • the vertices in the triangular mesh are the nodes of the vertex graph in the dual graph
  • the edges between the vertices are the edges of the vertex graph in the dual graph
  • the edges in the dual graph are
  • the adjacency matrix of the vertex graph is N v *N v , where N v is the number of vertices in the triangular mesh.
  • the triangular patch construction graph data structure in the triangular mesh forms the patch graph in the dual graph, including: calculating the centroid and normal direction of each triangular patch through the vertices in the triangular mesh ;Determine whether each triangle patch has shared vertices with the surrounding patches, if so, retrieve the neighborhood patch set of the triangle patch; use each triangle patch as a node in the patch graph, and pass the triangle surface A patch and every patch in its neighborhood form an edge in the dual graph.
  • the method before constructing the graph data structure for the vertices and triangle faces in the triangular meshes to form a dual graph, the method also includes: translating all the triangular meshes to the grid centroid as the origin, according to The average length of the sides in the triangular mesh is normalized, and the three-dimensional coordinates of the triangular mesh are scaled to an average side length of 1.
  • the method further includes: calculating the new centroid coordinates and method of the patch according to the pre-denoised vertices Towards.
  • the vertex graph and the patch graph adopt the same network structure, and the graph convolution unit in the network structure adopts a convolution module:
  • b is a bias item
  • x i and x j are the characteristics of node i and j respectively
  • N(i) is the set of adjacent nodes of node i in the corresponding graph structure
  • W m represents m learnable feature transformations
  • q m is an assignment function, which is used to assign weights to different adjacent nodes.
  • the method further includes:
  • v′ i is the result of vertex pre-denoising
  • N f (i) is all adjacent patches of vertex i
  • c k and n k ′ are the centroid and denoised normal of patch k, respectively.
  • the embodiment of the present application also provides a device for denoising triangular meshes based on a dual graph neural network, the device comprising:
  • the construction unit is used to simultaneously construct a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then input the vertex graph and the face graph into the corresponding graph neural network;
  • the denoising unit the graph structure established based on the vertices is used in the neural network to pre-denoise the noise vertices, and the graph structure established based on the patch is used in the neural network to denoise the normal direction of the patch;
  • the output unit is used to update the pre-denoised vertices according to the denoised patch normal to output the final triangular mesh.
  • the embodiment of the present application also provides a computer device, including a memory, a processor, and a computer program stored in the memory and operable on the processor.
  • the processor executes the program, it implements the The method described in any one of the descriptions of the examples.
  • the embodiment of the present application also provides a computer device, a computer-readable storage medium, on which a computer program is stored, and the computer program is used for: when the computer program is executed by a processor, the computer program according to the present application is implemented.
  • a computer device a computer-readable storage medium, on which a computer program is stored, and the computer program is used for: when the computer program is executed by a processor, the computer program according to the present application is implemented.
  • the method for denoising triangular meshes based on the dual graph neural network makes better use of the topological structure of triangular meshes, has better denoising effects, better retention of geometric details, and less quantization errors than meshes. Both the normal angle average error and the vertex distance average error are smaller.
  • FIG. 1 shows a schematic flowchart of a method for denoising triangular meshes based on a dual graph neural network provided by an embodiment of the present application
  • FIG. 2 shows an exemplary structural block diagram of a device 200 for denoising triangular meshes based on a dual graph neural network according to an embodiment of the present application
  • FIG. 3 shows a schematic structural diagram of a computer system suitable for implementing a terminal device according to an embodiment of the present application
  • Fig. 4 shows the grid denoising flow chart provided by the embodiment of the present application
  • Fig. 5 shows the U-Net formal graph neural network structure provided by the embodiment of the present application.
  • first and second are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features.
  • the features defined as “first” and “second” may explicitly or implicitly include at least one of these features.
  • “plurality” means at least two, such as two, three, etc., unless otherwise specifically defined.
  • the first feature may be in direct contact with the first feature or the first and second feature may be in direct contact with the second feature through an intermediary. touch.
  • “above”, “above” and “above” the first feature on the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature.
  • “Below”, “beneath” and “beneath” the first feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is less horizontally than the second feature.
  • FIG. 1 shows a schematic flowchart of a method for denoising triangular meshes based on a dual graph neural network provided by an embodiment of the present application.
  • the method includes:
  • Step 110 simultaneously constructing a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then inputting the vertex graph and the face graph into the corresponding graph neural network;
  • Step 120 the graph structure established based on the vertices is used in the neural network to pre-denoise the noisy vertices, and the graph structure established based on the patch is used in the neural network to denoise the normal direction of the patch;
  • Step 130 update the pre-denoised vertices according to the denoised patch normal to output the final triangular mesh.
  • the topology of the triangular mesh is better utilized, the denoising effect is better, the geometric details are better maintained, and the quantization error, the average error of the normal angle of the patch and the average error of the vertex distance are smaller.
  • the vertices in the triangular mesh are the nodes of the vertex graph in the dual graph
  • the edges between the vertices are the edges of the vertex graph in the dual graph
  • the vertices in the dual graph are
  • the adjacency matrix of the graph is N v *N v , where N v is the number of vertices in the triangular mesh.
  • the element with a value of 0, in the i-th row and j-th column means that the i-th vertex and the j-th vertex in the grid are not connected, otherwise, the value of 1 means that the i-th vertex and the j-th vertex j vertices are connected by an edge.
  • the constructing graph data structure for the triangular patches in the triangular mesh to form a patch graph in the dual graph includes: calculating the centroid and normal direction of each triangular patch through the vertices in the triangular mesh ;Determine whether each triangle patch has shared vertices with the surrounding patches, if so, retrieve the neighborhood patch set of the triangle patch; use each triangle patch as a node in the patch graph, and pass the triangle surface A patch and every patch in its neighborhood form an edge in the dual graph.
  • a neighborhood patch set of the patch can be retrieved according to whether it shares vertices with surrounding patches.
  • each triangular patch can be used as a node in the patch graph, and the patch and each patch in its neighborhood can form an edge in a graph structure, and a corresponding patch graph structure can be constructed.
  • the size of the adjacency matrix is N f * N f , where N f is the number of patches in the grid.
  • the element with a value of 0, the i-th row and the j-th column represent the i-th in the grid
  • the i-th patch and the j-th patch are not in their respective neighborhoods. On the contrary, if the value is 1, the i-th patch and the j-th patch are adjacent to each other.
  • the method before constructing the graph data structure for the vertices and triangle patches in the triangular meshes to form a dual graph, the method further includes: translating all the triangular meshes to the grid centroid as the origin, according to the triangle The average length of the edges in the grid is normalized, and the three-dimensional coordinates of the triangular mesh are scaled to an average edge length of 1.
  • the node attributes of the vertex graph are the initial coordinates and normal directions of the vertices
  • the node attributes of the patch graph are the patch centroids.
  • the coordinates and patch normal of Since the coordinate system and spatial scale of each triangular mesh are different, all meshes need to be normalized before network training. Specifically, all the grids are first translated to the grid centroid as the origin, and then normalized according to the average length of the edges in the grid, that is, the three-dimensional coordinates of the grid are scaled to an average edge length of 1.
  • the method further includes: calculating the new centroid coordinates and normal of the patch according to the pre-denoised vertices .
  • this design further calculates the new centroid coordinates and normal of the patch from the corresponding output of the vertex map, that is, the pre-denoising vertex (that is, the pre-denoising The final patch centroid coordinates and normal direction) to enhance the features of the patch map input into the network:
  • F f represents the initial feature of the patch, Indicates the new patch feature calculated based on the pre-denoised vertices,
  • the pre-denoising result of the vertex map in the present invention can be used as the initial position of the vertex update stage. Since the pre-denoised vertices have more accurate geometry than the original noise vertices, more geometric details can be preserved after vertex updating.
  • the vertex graph and the patch graph adopt the same network structure, and the graph convolution unit in the network structure adopts a convolution module:
  • b is a bias item
  • x i and x j are the characteristics of node i and j respectively
  • N(i) is the set of adjacent nodes of node i in the corresponding graph structure
  • W m represents m learnable feature transformations
  • q m is an assignment function, which is used to assign weights to different adjacent nodes.
  • the graph pooling method adopts the edge shrinkage algorithm of the graph structure proposed in , by maximizing:
  • di and dj represent the degrees of nodes i and j in a graph, respectively, and wij represents the edge weight between nodes i and j.
  • the algorithm shrinks and merges a pair of nodes with larger edge weights into one node by iteratively executing the above maximization process.
  • the calculation of edge weight is obtained by calculating the distance and normal error of nodes:
  • is a small positive value to avoid the negative value of the first item
  • v i and v j are the three-dimensional coordinates of nodes i and j respectively or the centroid of the patch
  • le is the average side length of the entire grid.
  • the pre-denoised vertex coordinates and the patch normal are output at the same time. Therefore, during the training process of this network, the complete loss function needs to include the vertex coordinates and the patch normal.
  • Loss ⁇ v Loss v + ⁇ f Loss f
  • v' is the pre-denoised vertex coordinates
  • n' is the denoised patch normal direction corresponding to the output of the patch image
  • v g and n g are the corresponding vertex reference value and patch normal reference value respectively.
  • ⁇ v and ⁇ f are the weights of the two losses respectively.
  • the method further includes: updating the pre-denoised vertices to optimize the final vertex position, the algorithm of the update process is :
  • v′ i is the result of vertex pre-denoising
  • N f (i) is all adjacent patches of vertex i
  • c k and n k ′ are the centroid and denoised normal of patch k, respectively.
  • a dual graph structure is constructed for the tested noise network, and then input into a fixed network, which can directly output the pre-denoised vertex coordinates and the denoised face normal. It is necessary to further update the pre-denoised vertices to optimize the final vertex position.
  • the algorithm for this update process is:
  • v′ i are the initial noise vertices, but in this design, the dual graph learning has more accurate vertex pre-denoising results, so v′ i is the result of vertex pre-denoising, N f (i) is all adjacent patches of vertex i, c k and nk ′ are the centroid of patch k (calculated from the pre-denoised vertex) and the normal after denoising, respectively. The process is iterated many times to get the ideal vertex update result.
  • FIG. 2 shows an exemplary structural block diagram of an apparatus 200 for denoising triangular meshes based on a dual graph neural network according to an embodiment of the present application.
  • the device includes:
  • the construction unit 210 is used to simultaneously construct a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then input the vertex graph and the face graph into the corresponding graph neural network;
  • Denoising unit 220 the graph structure established based on the vertices is used in the neural network to pre-denoise the noisy vertices, and the graph structure established based on the patch is used in the neural network to denoise the normal direction of the patch;
  • the output unit 230 is configured to update the pre-denoised vertices according to the denoised facet normal to output the final triangular mesh.
  • the units or modules recorded in the device 200 correspond to the steps in the method described with reference to FIG. 1 . Therefore, the operations and features described above for the method are also applicable to the device 200 and the units contained therein, and will not be repeated here.
  • the apparatus 200 may be pre-implemented in the browser of the electronic device or other security applications, and may also be loaded into the browser of the electronic device or its security applications by downloading or other means.
  • the corresponding units in the apparatus 200 may cooperate with the units in the electronic device to implement the solutions of the embodiments of the present application.
  • FIG. 3 shows a schematic structural diagram of a computer system 300 suitable for implementing a terminal device or a server according to an embodiment of the present application.
  • a computer system 300 includes a central processing unit (CPU) 301 that can operate according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage section 308 into a random-access memory (RAM) 303 Instead, various appropriate actions and processes are performed.
  • ROM read-only memory
  • RAM random-access memory
  • various programs and data required for the operation of the system 300 are also stored.
  • the CPU 301, ROM 302, and RAM 303 are connected to each other through a bus 304.
  • An input/output (I/O) interface 305 is also connected to the bus 304 .
  • the following components are connected to the I/O interface 305: an input section 306 including a keyboard, a mouse, etc.; an output section 307 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 308 including a hard disk, etc. and a communication section 309 including a network interface card such as a LAN card, a modem, or the like.
  • the communication section 309 performs communication processing via a network such as the Internet.
  • a drive 310 is also connected to the I/O interface 305 as needed.
  • a removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 310 as necessary so that a computer program read therefrom is installed into the storage section 308 as necessary.
  • the process described above with reference to FIG. 1 may be implemented as a computer software program.
  • embodiments of the present disclosure include a method for denoising triangular meshes based on a dual graph neural network, which includes a computer program tangibly embodied on a machine-readable medium, the computer program including a method for executing the The program code of the method.
  • the computer program may be downloaded and installed from a network via communication portion 309 and/or installed from removable media 311 .
  • each block in a flowchart or block diagram may represent a module, program segment, or part of code that includes one or more logical functions for implementing specified executable instructions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
  • the units or modules involved in the embodiments described in the present application may be implemented by means of software or by means of hardware.
  • the described units or modules may also be set in a processor.
  • a processor includes a first sub-region generating unit, a second sub-region generating unit, and a display region generating unit.
  • the names of these units or modules do not constitute limitations on the units or modules themselves in some cases, for example, the display area generation unit can also be described as "used to generate The cell of the display area of the text".
  • the present application also provides a computer-readable storage medium, which may be the computer-readable storage medium contained in the aforementioned devices in the above-mentioned embodiments; computer-readable storage media stored in the device.
  • the computer-readable storage medium stores one or more programs, and the aforementioned programs are used by one or more processors to execute the text generation method applied to transparent window envelopes described in this application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Image Generation (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present application discloses a method and apparatus for denoising a triangular mesh based on a dual graph neural network, a device, and a storage medium. The method comprises: constructing a graph data structure for vertexes and triangular patches in a triangular mesh at the same time to form a dual graph, and then inputting a vertex graph and a patch graph into a corresponding graph neural network; the graph structure established based on the vertexes being used for pre-denoising noise vertexes in the neural network, and the graph structure established based on the patches being used for denoising the normal direction of the patches in the neural network; and updating the pre-denoised vertexes according to the denoised normal direction of the patches so as to output a final triangular mesh. According to the solution provided by the present application, the topological structure of the triangular mesh is better utilized, the denoising effect is better, geometric details are better kept, and in quantization errors, the average error of the normal angles of the patches and the average error of the vertex distances are smaller.

Description

基于对偶图神经网络对三角网格进行去噪的方法Method of Denoising Triangular Meshes Based on Dual Graph Neural Network 技术领域technical field
本发明涉及计算机软件,具体涉及一种基于对偶图神经网络对三角网格进行去噪的方法、装置、设备及其存储介质。The invention relates to computer software, in particular to a method, device, equipment and storage medium for denoising triangular grids based on a dual graph neural network.
背景技术Background technique
在三维重建、增强现实、医学等领域,对物体或人体进行扫描重建网格模型是必不可少的一步。然而由于扫描传感器等设备的精度、环境光线等原因,会造成重建的网格不可避免的含有噪声,从而极大的影响后面可视化等的效果。In the fields of 3D reconstruction, augmented reality, medicine, etc., it is an essential step to scan and reconstruct the mesh model of an object or human body. However, due to the accuracy of scanning sensors and other equipment, ambient light and other reasons, the reconstructed grid will inevitably contain noise, which will greatly affect the subsequent visualization effects.
三角网格是三维几何最常见的表征形式之一,其包括一组三维点集和一组面片集合,每个三角面片由三个点的索引构成。由于各种原因产生的噪声三角网格,使得三维顶点发生了偏移,导致无法准确的表示局部的几何结构,形成噪声。三角网格去噪旨在纠正顶点的偏移,同时保留原有的面片拓扑结构,在准确去除噪声的同时,保留潜在的几何细节。Triangular mesh is one of the most common representation forms of 3D geometry, which includes a set of 3D point sets and a set of facets, each triangular facet consists of three point indices. Due to the noise triangular mesh generated by various reasons, the three-dimensional vertices are shifted, resulting in the inability to accurately represent the local geometric structure and forming noise. Triangular mesh denoising aims to correct the offset of vertices while preserving the original patch topology, and preserve the underlying geometric details while accurately removing noise.
现有的三角网格去噪方法,主要可分为传统的基于滤波或优化的方法和基于学习的方法。传统的滤波及其衍生的方法可以获得不错的去噪效果,但难以保留细小的几何细节,而基于优化的方法,例如L0最小化、低秩恢复等方法,通常噪声去除不彻底也效率较低。近来,基于学习的方法获得了比较突出的去噪效果。例如,依据现有的法向 滤波描述符,然后用单层神经网络进行面片法向回归。而结合三维体素化和3D卷积神经网络实现了一个迭代的去噪算法。通过构建非局部相似性的法向矩阵块,并用卷积神经网络进行学习以输出去噪后的面片法向。The existing triangular mesh denoising methods can be mainly divided into traditional filtering or optimization-based methods and learning-based methods. Traditional filtering and its derivative methods can achieve good denoising effects, but it is difficult to preserve fine geometric details, while optimization-based methods, such as L0 minimization, low-rank restoration, etc., usually do not remove noise completely and are less efficient . Recently, learning-based methods have achieved outstanding denoising results. For example, according to the existing normal filter descriptor, and then use a single-layer neural network for patch normal regression. An iterative denoising algorithm is realized by combining 3D voxelization and 3D convolutional neural network. By constructing a normal matrix block of non-local similarity, and learning it with a convolutional neural network to output the denoised patch normal.
由于噪声的偏移会造成三角面片法向的不准确,从而影响三角网格的局部平滑属性。以上方法,都是一种两步法:首先对三角面片进行法向回归得到去噪后的面片法向,然后根据该法向更新噪声顶点坐标来输出最终的去噪后的网格。但这些方法都忽略两点:(1)由于噪声网格的顶点本身含有噪声,因此直接从这些带噪声的属性中进行法向回归本身有一定的难度,(2)在得到去噪后的面片法向后,直接更新原始的噪声顶点也难以保留其潜在的几何属性。Due to the offset of noise, the normal direction of the triangular patch will be inaccurate, which will affect the local smoothness of the triangular mesh. The above method is a two-step method: first, perform normal regression on the triangular patch to obtain the denoised surface normal, and then update the noise vertex coordinates according to the normal to output the final denoised mesh. However, these methods ignore two points: (1) Since the vertices of the noisy grid itself contain noise, it is difficult to perform normal regression directly from these noisy attributes. (2) After obtaining the denoised surface Backward of the slice normal, it is also difficult to directly update the original noise vertices to preserve their underlying geometric properties.
发明内容Contents of the invention
鉴于现有技术中的上述缺陷或不足,期望提供一种基于对偶图神经网络对三角网格进行去噪的方法、装置、设备及其存储介质。In view of the above-mentioned defects or deficiencies in the prior art, it is desired to provide a method, device, device and storage medium for denoising triangular meshes based on a dual graph neural network.
第一方面,本申请实施例提供了一种基于对偶图神经网络对三角网格进行去噪的方法,该方法包括:In the first aspect, the embodiment of the present application provides a method for denoising triangular meshes based on a dual graph neural network, the method comprising:
对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图,然后将顶点图和面片图输入到对应的图神经网络中;Simultaneously build a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then input the vertex graph and the face graph into the corresponding graph neural network;
基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪,基于面片建立的图结构在神经网络中用于对面片法向进行去噪;The graph structure based on the vertices is used in the neural network to pre-denoise the noise vertices, and the graph structure based on the patch is used in the neural network to denoise the normal direction of the patch;
根据去噪后的面片法向来更新预去噪后的顶点以输出最终的三角网格。The pre-denoised vertices are updated according to the denoised patch normals to output the final triangle mesh.
在其中一个实施例中,所述三角网格中的顶点为所述对偶图中顶点图的节点,所述顶点之间的边为所述对偶图中顶点图的边,所述对偶图中的顶点图的邻接矩阵为N v*N v,其中,N v为三角网格中的顶点 数量。 In one of the embodiments, the vertices in the triangular mesh are the nodes of the vertex graph in the dual graph, the edges between the vertices are the edges of the vertex graph in the dual graph, and the edges in the dual graph are The adjacency matrix of the vertex graph is N v *N v , where N v is the number of vertices in the triangular mesh.
在其中一个实施例中,所述对三角网格中三角面片构建图数据结构形成对偶图中的面片图,包括:通过三角网格中的顶点计算每个三角面片的质心和法向;判断每个三角面片和周围面片是否有共享的顶点,若有,则检索得到三角面片的邻域面片集合;将每个三角面片作为面片图中的节点,通过三角面片和其邻域中的每个面片构成对偶图中的边。In one of the embodiments, the triangular patch construction graph data structure in the triangular mesh forms the patch graph in the dual graph, including: calculating the centroid and normal direction of each triangular patch through the vertices in the triangular mesh ;Determine whether each triangle patch has shared vertices with the surrounding patches, if so, retrieve the neighborhood patch set of the triangle patch; use each triangle patch as a node in the patch graph, and pass the triangle surface A patch and every patch in its neighborhood form an edge in the dual graph.
在其中一个实施例中,所述对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图之前,该方法还包括:将所有三角网格平移到以网格质心为原点,根据三角网格中边的平均长度进行归一化处理,将三角网格的三维坐标缩放到平均边长为1。In one of the embodiments, before constructing the graph data structure for the vertices and triangle faces in the triangular meshes to form a dual graph, the method also includes: translating all the triangular meshes to the grid centroid as the origin, according to The average length of the sides in the triangular mesh is normalized, and the three-dimensional coordinates of the triangular mesh are scaled to an average side length of 1.
在其中一个实施例中,所述基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪之后,该方法还包括:根据预去噪的顶点计算面片新的质心坐标和法向。In one of the embodiments, after the graph structure established based on the vertices is used in the neural network to pre-denoise the noisy vertices, the method further includes: calculating the new centroid coordinates and method of the patch according to the pre-denoised vertices Towards.
在其中一个实施例中,所述顶点图和所述面片图采用相同的网络结构,所述网络结构中的图卷积单元采用卷积模块:In one of the embodiments, the vertex graph and the patch graph adopt the same network structure, and the graph convolution unit in the network structure adopts a convolution module:
Figure PCTCN2022136755-appb-000001
Figure PCTCN2022136755-appb-000001
其中,b为偏置项,x i和x j分别为节点i和j的特征,N(i)为对应的图结构中节点i的邻接节点集合,W m表示m个可学习的特征变换,q m为分配函数,用于为不同的邻接节点分配权重。 Among them, b is a bias item, x i and x j are the characteristics of node i and j respectively, N(i) is the set of adjacent nodes of node i in the corresponding graph structure, W m represents m learnable feature transformations, q m is an assignment function, which is used to assign weights to different adjacent nodes.
在其中一个实施例中,所述根据去噪后的面片法向来更新预去噪后的顶点之后,该方法还包括:In one of the embodiments, after updating the pre-denoised vertices according to the denoised patch normal, the method further includes:
更新预去噪的顶点来优化最终的顶点位置,该更新过程的算法为:Update the pre-denoised vertices to optimize the final vertex position. The algorithm of the update process is:
Figure PCTCN2022136755-appb-000002
Figure PCTCN2022136755-appb-000002
其中,v′ i为顶点预去噪的结果,N f(i)是顶点i的所有邻接面片,c k和n k′分别为面片k的质心和去噪后的法向。 Among them, v′ i is the result of vertex pre-denoising, N f (i) is all adjacent patches of vertex i, c k and n k ′ are the centroid and denoised normal of patch k, respectively.
第二方面,本申请实施例还提供了一种基于对偶图神经网络对三角网格进行去噪的装置,该装置包括:In the second aspect, the embodiment of the present application also provides a device for denoising triangular meshes based on a dual graph neural network, the device comprising:
构建单元,用于对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图,然后将顶点图和面片图输入到对应的图神经网络中;The construction unit is used to simultaneously construct a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then input the vertex graph and the face graph into the corresponding graph neural network;
去噪单元,基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪,基于面片建立的图结构在神经网络中用于对面片法向进行去噪;The denoising unit, the graph structure established based on the vertices is used in the neural network to pre-denoise the noise vertices, and the graph structure established based on the patch is used in the neural network to denoise the normal direction of the patch;
输出单元,用于根据去噪后的面片法向来更新预去噪后的顶点以输出最终的三角网格。The output unit is used to update the pre-denoised vertices according to the denoised patch normal to output the final triangular mesh.
第三方面,本申请实施例还提供了一种计算机设备,包括存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如本申请实施例描述中任一所述的方法。In the third aspect, the embodiment of the present application also provides a computer device, including a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the program, it implements the The method described in any one of the descriptions of the examples.
第四方面,本申请实施例还提供了一种计算机设备一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序用于:所述计算机程序被处理器执行时实现如本申请实施例描述中任一所述的方法。In a fourth aspect, the embodiment of the present application also provides a computer device, a computer-readable storage medium, on which a computer program is stored, and the computer program is used for: when the computer program is executed by a processor, the computer program according to the present application is implemented. The method described in any one of the descriptions of the examples.
本发明的有益效果:Beneficial effects of the present invention:
本发明提供的基于对偶图神经网络对三角网格进行去噪的方法,更好的利用了三角网格的拓扑结构,去噪效果更好,几何细节的保持更好,量化误差中,面片法向角平均误差和顶点距离平均误差都更小。The method for denoising triangular meshes based on the dual graph neural network provided by the present invention makes better use of the topological structure of triangular meshes, has better denoising effects, better retention of geometric details, and less quantization errors than meshes. Both the normal angle average error and the vertex distance average error are smaller.
附图说明Description of drawings
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本申请的其它特征、目的和优点将会变得更明显:Other characteristics, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:
图1示出了本申请实施例提供的基于对偶图神经网络对三角网格进行去噪的方法的流程示意图;FIG. 1 shows a schematic flowchart of a method for denoising triangular meshes based on a dual graph neural network provided by an embodiment of the present application;
图2示出了根据本申请一个实施例的基于对偶图神经网络对三角网格进行去噪的装置200的示例性结构框图;FIG. 2 shows an exemplary structural block diagram of a device 200 for denoising triangular meshes based on a dual graph neural network according to an embodiment of the present application;
图3示出了适于用来实现本申请实施例的终端设备的计算机系统的结构示意图;FIG. 3 shows a schematic structural diagram of a computer system suitable for implementing a terminal device according to an embodiment of the present application;
图4示出了本申请实施例提供的网格去噪流程图;Fig. 4 shows the grid denoising flow chart provided by the embodiment of the present application;
图5示出了本申请实施例提供的U-Net形式图神经网络结构。Fig. 5 shows the U-Net formal graph neural network structure provided by the embodiment of the present application.
具体实施方式Detailed ways
为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合附图对本发明的具体实施方式做详细的说明。在下面的描述中阐述了很多具体细节以便于充分理解本发明。但是本发明能够以很多不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本发明内涵的情况下做类似改进,因此本发明不受下面公开的具体实施例的限制。In order to make the above objects, features and advantages of the present invention more comprehensible, specific implementations of the present invention will be described in detail below in conjunction with the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, the present invention can be implemented in many other ways different from those described here, and those skilled in the art can make similar improvements without departing from the connotation of the present invention, so the present invention is not limited by the specific embodiments disclosed below.
在本发明的描述中,需要理解的是,术语“中心”、“纵向”、“横向”、“长度”、“宽度”、“厚度”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”、“内”、“外”、“顺时针”、“逆时针”、“轴向”、“径向”、“周向”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。In describing the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", " Back", "Left", "Right", "Vertical", "Horizontal", "Top", "Bottom", "Inner", "Outer", "Clockwise", "Counterclockwise", "Axial" , "radial", "circumferential" and other indicated orientations or positional relationships are based on the orientations or positional relationships shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying the referred device or Elements must have certain orientations, be constructed and operate in certain orientations, and therefore should not be construed as limitations on the invention.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此, 限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.
在本发明中,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”、“固定”等术语应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或成一体;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系,除非另有明确的限定。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本发明中的具体含义。In the present invention, unless otherwise clearly specified and limited, terms such as "installation", "connection", "connection" and "fixation" should be understood in a broad sense, for example, it can be a fixed connection or a detachable connection , or integrated; it may be mechanically connected or electrically connected; it may be directly connected or indirectly connected through an intermediary, and it may be the internal communication of two components or the interaction relationship between two components, unless otherwise specified limit. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present invention according to specific situations.
在本发明中,除非另有明确的规定和限定,第一特征在第二特征“上”或“下”可以是第一和第二特征直接接触,或第一和第二特征通过中间媒介间接接触。而且,第一特征在第二特征“之上”、“上方”和“上面”可是第一特征在第二特征正上方或斜上方,或仅仅表示第一特征水平高度高于第二特征。第一特征在第二特征“之下”、“下方”和“下面”可以是第一特征在第二特征正下方或斜下方,或仅仅表示第一特征水平高度小于第二特征。In the present invention, unless otherwise clearly specified and limited, the first feature may be in direct contact with the first feature or the first and second feature may be in direct contact with the second feature through an intermediary. touch. Moreover, "above", "above" and "above" the first feature on the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. "Below", "beneath" and "beneath" the first feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is less horizontally than the second feature.
需要说明的是,当元件被称为“固定于”或“设置于”另一个元件,它可以直接在另一个元件上或者也可以存在居中的元件。当一个元件被认为是“连接”另一个元件,它可以是直接连接到另一个元件或者可能同时存在居中元件。本文所使用的术语“垂直的”、“水平的”、“上”、“下”、“左”、“右”以及类似的表述只是为了说明的目的,并不表示是唯一的实施方式。It should be noted that when an element is referred to as being “fixed on” or “disposed on” another element, it may be directly on the other element or there may be an intervening element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or intervening elements may also be present. As used herein, the terms "vertical", "horizontal", "upper", "lower", "left", "right" and similar expressions are for the purpose of illustration only and are not intended to represent the only embodiments.
请参考图1并结合图4所示,图1示出了本申请实施例提供的基于对偶图神经网络对三角网格进行去噪的方法的流程示意图。Please refer to FIG. 1 in conjunction with FIG. 4 . FIG. 1 shows a schematic flowchart of a method for denoising triangular meshes based on a dual graph neural network provided by an embodiment of the present application.
如图1所示,该方法包括:As shown in Figure 1, the method includes:
步骤110,对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图,然后将顶点图和面片图输入到对应的图神经网络中; Step 110, simultaneously constructing a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then inputting the vertex graph and the face graph into the corresponding graph neural network;
步骤120,基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪,基于面片建立的图结构在神经网络中用于对面片法向进行去噪; Step 120, the graph structure established based on the vertices is used in the neural network to pre-denoise the noisy vertices, and the graph structure established based on the patch is used in the neural network to denoise the normal direction of the patch;
步骤130,根据去噪后的面片法向来更新预去噪后的顶点以输出最终的三角网格。 Step 130, update the pre-denoised vertices according to the denoised patch normal to output the final triangular mesh.
采用上述技术方案,更好的利用了三角网格的拓扑结构,去噪效果更好,几何细节的保持更好,量化误差中,面片法向角平均误差和顶点距离平均误差都更小。Using the above technical solution, the topology of the triangular mesh is better utilized, the denoising effect is better, the geometric details are better maintained, and the quantization error, the average error of the normal angle of the patch and the average error of the vertex distance are smaller.
在一些实施例中,所述三角网格中的顶点为所述对偶图中顶点图的节点,所述顶点之间的边为所述对偶图中顶点图的边,所述对偶图中的顶点图的邻接矩阵为N v*N v,其中,N v为三角网格中的顶点数量。该邻接矩阵中,值为0的元素,所在第i行和第j列即表示网格中的第i个顶点和第j个顶点不相连,反之,值为1则为第i个顶点和第j个顶点有边相连。 In some embodiments, the vertices in the triangular mesh are the nodes of the vertex graph in the dual graph, the edges between the vertices are the edges of the vertex graph in the dual graph, and the vertices in the dual graph are The adjacency matrix of the graph is N v *N v , where N v is the number of vertices in the triangular mesh. In the adjacency matrix, the element with a value of 0, in the i-th row and j-th column, means that the i-th vertex and the j-th vertex in the grid are not connected, otherwise, the value of 1 means that the i-th vertex and the j-th vertex j vertices are connected by an edge.
在一些实施例中,所述对三角网格中的三角面片构建图数据结构形成对偶图中的面片图,包括:通过三角网格中的顶点计算每个三角面片的质心和法向;判断每个三角面片和周围面片是否有共享的顶点,若有,则检索得到三角面片的邻域面片集合;将每个三角面片作为面片图中的节点,通过三角面片和其邻域中的每个面片构成对偶图中的边。In some embodiments, the constructing graph data structure for the triangular patches in the triangular mesh to form a patch graph in the dual graph includes: calculating the centroid and normal direction of each triangular patch through the vertices in the triangular mesh ;Determine whether each triangle patch has shared vertices with the surrounding patches, if so, retrieve the neighborhood patch set of the triangle patch; use each triangle patch as a node in the patch graph, and pass the triangle surface A patch and every patch in its neighborhood form an edge in the dual graph.
具体地,三角网格中由顶点构成的每个三角面片,可以根据其和周围面片是否有共享的顶点来检索得到面片的邻域面片集合。如此,每个三角面片可作为面片图中的节点,面片和其邻域中的每个面片即可构成一个图结构中的边,即可构建对应的面片图结构。该邻接矩阵 大小为N f*N f,其中N f为网格中的面片的数量,邻接矩阵中,值为0的元素,所在第i行和第j列即表示网格中的第i个面片和第j个面片互相不在各自的邻域中,反之,值为1则为第i个面片和第j个面片互为邻域。 Specifically, for each triangular patch composed of vertices in the triangular mesh, a neighborhood patch set of the patch can be retrieved according to whether it shares vertices with surrounding patches. In this way, each triangular patch can be used as a node in the patch graph, and the patch and each patch in its neighborhood can form an edge in a graph structure, and a corresponding patch graph structure can be constructed. The size of the adjacency matrix is N f * N f , where N f is the number of patches in the grid. In the adjacency matrix, the element with a value of 0, the i-th row and the j-th column represent the i-th in the grid The i-th patch and the j-th patch are not in their respective neighborhoods. On the contrary, if the value is 1, the i-th patch and the j-th patch are adjacent to each other.
在一些实施例中,所述对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图之前,该方法还包括:将所有三角网格平移到以网格质心为原点,根据三角网格中边的平均长度进行归一化处理,将三角网格的三维坐标缩放到平均边长为1。In some embodiments, before constructing the graph data structure for the vertices and triangle patches in the triangular meshes to form a dual graph, the method further includes: translating all the triangular meshes to the grid centroid as the origin, according to the triangle The average length of the edges in the grid is normalized, and the three-dimensional coordinates of the triangular mesh are scaled to an average edge length of 1.
在网格中构建对偶图结构后,分别将顶点图和面片图输入各自的图神经网络中,顶点图的节点属性为顶点的初始坐标和法向,面片图的节点属性为面片质心的坐标和面片法向。由于每个三角网格的坐标系和空间尺度不同,在网络训练之前需要对所有网格进行标准化处理。具体的,将所有网格首先平移到以网格质心为原点,然后根据网格中边的平均长度进行归一化处理,即将网格的三维坐标缩放到平均边长为1。After constructing the dual graph structure in the grid, input the vertex graph and the patch graph into their respective graph neural networks. The node attributes of the vertex graph are the initial coordinates and normal directions of the vertices, and the node attributes of the patch graph are the patch centroids. The coordinates and patch normal of . Since the coordinate system and spatial scale of each triangular mesh are different, all meshes need to be normalized before network training. Specifically, all the grids are first translated to the grid centroid as the origin, and then normalized according to the average length of the edges in the grid, that is, the three-dimensional coordinates of the grid are scaled to an average edge length of 1.
在一些实施例中,所述基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪之后,该方法还包括:根据预去噪的顶点计算面片新的质心坐标和法向。In some embodiments, after the graph structure established based on the vertices is used in the neural network to pre-denoise the noisy vertices, the method further includes: calculating the new centroid coordinates and normal of the patch according to the pre-denoised vertices .
针对复杂噪声会增大噪声面片直接进行法向回归的难度的问题,本设计将顶点图对应的输出,即预去噪的顶点进一步计算面片新的质心坐标和法向(即预去噪后的面片质心坐标和法向),来增强面片图输入到网络中的特征:
Figure PCTCN2022136755-appb-000003
(F f表示面片的初始特征,
Figure PCTCN2022136755-appb-000004
表示根据预去去噪后的顶点计算得到的新的面片特征,||表示在特征维度的串联操作,见V’到G f的虚线连接)。由于预去噪的顶点相比较输入噪声顶点有更准确的空间位置,因此可以显著提高面片法向回归的效果,从而为后续的顶点更新提供更准确的去噪法向。
Aiming at the problem that complex noise will increase the difficulty of directly performing normal regression on the noise patch, this design further calculates the new centroid coordinates and normal of the patch from the corresponding output of the vertex map, that is, the pre-denoising vertex (that is, the pre-denoising The final patch centroid coordinates and normal direction) to enhance the features of the patch map input into the network:
Figure PCTCN2022136755-appb-000003
(F f represents the initial feature of the patch,
Figure PCTCN2022136755-appb-000004
Indicates the new patch feature calculated based on the pre-denoised vertices, || indicates the concatenation operation in the feature dimension, see the dotted line connection between V' and G f ). Since the pre-denoised vertices have more accurate spatial positions than the input noise vertices, the effect of patch normal regression can be significantly improved, thereby providing more accurate denoising normals for subsequent vertex updates.
此外,针对顶点更新阶段直接更新原始噪声顶点容易平滑几何细节的问题,本发明中对顶点图的预去噪结果即可作为顶点更新阶段的初始位置。由于预去噪的顶点相比较原始噪声顶点有更准确的几何结构,可以在顶点更新后保留更多的几何细节。In addition, in view of the problem that directly updating the original noisy vertices in the vertex update stage is easy to smooth geometric details, the pre-denoising result of the vertex map in the present invention can be used as the initial position of the vertex update stage. Since the pre-denoised vertices have more accurate geometry than the original noise vertices, more geometric details can be preserved after vertex updating.
在一些实施例中,参考图5所示,所述顶点图和所述面片图采用相同的网络结构,所述网络结构中的图卷积单元采用卷积模块:In some embodiments, as shown in FIG. 5, the vertex graph and the patch graph adopt the same network structure, and the graph convolution unit in the network structure adopts a convolution module:
Figure PCTCN2022136755-appb-000005
Figure PCTCN2022136755-appb-000005
其中,b为偏置项,x i和x j分别为节点i和j的特征,N(i)为对应的图结构中节点i的邻接节点集合,W m表示m个可学习的特征变换,q m为分配函数,用于为不同的邻接节点分配权重。 Among them, b is a bias item, x i and x j are the characteristics of node i and j respectively, N(i) is the set of adjacent nodes of node i in the corresponding graph structure, W m represents m learnable feature transformations, q m is an assignment function, which is used to assign weights to different adjacent nodes.
图池化方法采用中提出的图结构的边收缩算法,通过最大化:The graph pooling method adopts the edge shrinkage algorithm of the graph structure proposed in , by maximizing:
Figure PCTCN2022136755-appb-000006
Figure PCTCN2022136755-appb-000006
其中,di和dj分别表示一个图中节点i和j的度,wij表示节点i和j之间的边权重。该算法通过迭代执行以上最大化过程,来将边权重较大的一对节点进行收缩合并为1个节点。在本网格去噪中,边权重的计算通过计算节点的距离和法向误差来得到:Among them, di and dj represent the degrees of nodes i and j in a graph, respectively, and wij represents the edge weight between nodes i and j. The algorithm shrinks and merges a pair of nodes with larger edge weights into one node by iteratively executing the above maximization process. In this grid denoising, the calculation of edge weight is obtained by calculating the distance and normal error of nodes:
Figure PCTCN2022136755-appb-000007
Figure PCTCN2022136755-appb-000007
其中,ε为一个较小的正值来避免第一项为负值,v i和v j分别为节点i和j的三维坐标或者面片质心,le为整个网格的平均边长。该方法已在[11]中网格去噪的图池化得到验证。图的上采样(反池化)部分,直接将对应的池化操作中收缩的点或面的特征复制来恢复到对应大小的图结构。 Among them, ε is a small positive value to avoid the negative value of the first item, v i and v j are the three-dimensional coordinates of nodes i and j respectively or the centroid of the patch, and le is the average side length of the entire grid. This approach has been validated in [11] for graph pooling for mesh denoising. The upsampling (unpooling) part of the graph directly copies the features of the points or surfaces that have shrunk in the corresponding pooling operation to restore the graph structure of the corresponding size.
通过将顶点图和面片图输入到图神经网络中,来同时输出预去噪的顶点坐标和面片法向,因此本网络训练过程中,完整的损失函数需 要包含顶点坐标和面片法向:By inputting the vertex map and the patch map into the graph neural network, the pre-denoised vertex coordinates and the patch normal are output at the same time. Therefore, during the training process of this network, the complete loss function needs to include the vertex coordinates and the patch normal. :
Loss=α vLoss vfLoss f Loss = α v Loss v + α f Loss f
其中
Figure PCTCN2022136755-appb-000008
v’为预去噪的顶点坐标,n’为面片图对应输出的去噪后的面片法向,v g和n g分别为对应的顶点参考值和面片法向参考值。α v和α f分别为两项损失的权重。
in
Figure PCTCN2022136755-appb-000008
v' is the pre-denoised vertex coordinates, n' is the denoised patch normal direction corresponding to the output of the patch image, v g and n g are the corresponding vertex reference value and patch normal reference value respectively. α v and α f are the weights of the two losses respectively.
在一些实施例中,所述根据去噪后的面片法向来更新预去噪后的顶点之后,该方法还包括:更新预去噪的顶点来优化最终的顶点位置,该更新过程的算法为:In some embodiments, after updating the pre-denoised vertices according to the denoised patch normal, the method further includes: updating the pre-denoised vertices to optimize the final vertex position, the algorithm of the update process is :
Figure PCTCN2022136755-appb-000009
Figure PCTCN2022136755-appb-000009
其中,v′ i为顶点预去噪的结果,N f(i)是顶点i的所有邻接面片,c k和n k′分别为面片k的质心和去噪后的法向。 Among them, v′ i is the result of vertex pre-denoising, N f (i) is all adjacent patches of vertex i, c k and n k ′ are the centroid and denoised normal of patch k, respectively.
具体地,在图神经网络训练完成后,对测试的噪声网络构建对偶图结构,然后输入到固定的网络中,可以直接输出预去噪后的顶点坐标和去噪后的面片法向,此时需要进一步更新该预去噪的顶点来优化最终的顶点位置。该更新过程的算法为:Specifically, after the training of the graph neural network is completed, a dual graph structure is constructed for the tested noise network, and then input into a fixed network, which can directly output the pre-denoised vertex coordinates and the denoised face normal. It is necessary to further update the pre-denoised vertices to optimize the final vertex position. The algorithm for this update process is:
Figure PCTCN2022136755-appb-000010
Figure PCTCN2022136755-appb-000010
其他网格去噪算法中,v′ i都是初始的噪声顶点,而本设计中对偶图的学习已有更为准确的顶点预去噪结果,因此v′ i为顶点预去噪的结果,N f(i)是顶点i的所有邻接面片,c k和n k′分别为面片k的质心(由预去噪后的顶点计算得到)和去噪后的法向。该过程通过迭代多次来得到理想的顶点更新结果。 In other grid denoising algorithms, v′ i are the initial noise vertices, but in this design, the dual graph learning has more accurate vertex pre-denoising results, so v′ i is the result of vertex pre-denoising, N f (i) is all adjacent patches of vertex i, c k and nk are the centroid of patch k (calculated from the pre-denoised vertex) and the normal after denoising, respectively. The process is iterated many times to get the ideal vertex update result.
进一步地,参考图2,图2示出了根据本申请一个实施例的基于对偶图神经网络对三角网格进行去噪的装置200的示例性结构框图。Further, referring to FIG. 2 , FIG. 2 shows an exemplary structural block diagram of an apparatus 200 for denoising triangular meshes based on a dual graph neural network according to an embodiment of the present application.
如图2所示,该装置包括:As shown in Figure 2, the device includes:
构建单元210,用于对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图,然后将顶点图和面片图输入到对应的图神经网络中;The construction unit 210 is used to simultaneously construct a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then input the vertex graph and the face graph into the corresponding graph neural network;
去噪单元220,基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪,基于面片建立的图结构在神经网络中用于对面片法向进行去噪; Denoising unit 220, the graph structure established based on the vertices is used in the neural network to pre-denoise the noisy vertices, and the graph structure established based on the patch is used in the neural network to denoise the normal direction of the patch;
输出单元230,用于根据去噪后的面片法向来更新预去噪后的顶点以输出最终的三角网格。The output unit 230 is configured to update the pre-denoised vertices according to the denoised facet normal to output the final triangular mesh.
应当理解,装置200中记载的诸单元或模块与参考图1描述的方法中的各个步骤相对应。由此,上文针对方法描述的操作和特征同样适用于装置200及其中包含的单元,在此不再赘述。装置200可以预先实现在电子设备的浏览器或其他安全应用中,也可以通过下载等方式而加载到电子设备的浏览器或其安全应用中。装置200中的相应单元可以与电子设备中的单元相互配合以实现本申请实施例的方案。It should be understood that the units or modules recorded in the device 200 correspond to the steps in the method described with reference to FIG. 1 . Therefore, the operations and features described above for the method are also applicable to the device 200 and the units contained therein, and will not be repeated here. The apparatus 200 may be pre-implemented in the browser of the electronic device or other security applications, and may also be loaded into the browser of the electronic device or its security applications by downloading or other means. The corresponding units in the apparatus 200 may cooperate with the units in the electronic device to implement the solutions of the embodiments of the present application.
下面参考图3,其示出了适于用来实现本申请实施例的终端设备或服务器的计算机系统300的结构示意图。Referring now to FIG. 3 , it shows a schematic structural diagram of a computer system 300 suitable for implementing a terminal device or a server according to an embodiment of the present application.
如图3所示,计算机系统300包括中央处理单元(CPU)301,其可以根据存储在只读存储器(ROM)302中的程序或者从存储部分308加载到随机访问存储器(RAM)303中的程序而执行各种适当的动作和处理。在RAM 303中,还存储有系统300操作所需的各种程序和数据。CPU 301、ROM 302以及RAM 303通过总线304彼此相连。输入/输出(I/O)接口305也连接至总线304。As shown in FIG. 3 , a computer system 300 includes a central processing unit (CPU) 301 that can operate according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage section 308 into a random-access memory (RAM) 303 Instead, various appropriate actions and processes are performed. In the RAM 303, various programs and data required for the operation of the system 300 are also stored. The CPU 301, ROM 302, and RAM 303 are connected to each other through a bus 304. An input/output (I/O) interface 305 is also connected to the bus 304 .
以下部件连接至I/O接口305:包括键盘、鼠标等的输入部分306;包括诸如阴极射线管(CRT)、液晶显示器(LCD)等以及扬声器等的输出部分307;包括硬盘等的存储部分308;以及包括诸如LAN卡、 调制解调器等的网络接口卡的通信部分309。通信部分309经由诸如因特网的网络执行通信处理。驱动器310也根据需要连接至I/O接口305。可拆卸介质311,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器310上,以便于从其上读出的计算机程序根据需要被安装入存储部分308。The following components are connected to the I/O interface 305: an input section 306 including a keyboard, a mouse, etc.; an output section 307 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 308 including a hard disk, etc. and a communication section 309 including a network interface card such as a LAN card, a modem, or the like. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I/O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 310 as necessary so that a computer program read therefrom is installed into the storage section 308 as necessary.
特别地,根据本公开的实施例,上文参考图1描述的过程可以被实现为计算机软件程序。例如,本公开的实施例包括一种基于对偶图神经网络对三角网格进行去噪的方法,其包括有形地包含在机器可读介质上的计算机程序,所述计算机程序包含用于执行图1的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信部分309从网络上被下载和安装,和/或从可拆卸介质311被安装。In particular, according to an embodiment of the present disclosure, the process described above with reference to FIG. 1 may be implemented as a computer software program. For example, embodiments of the present disclosure include a method for denoising triangular meshes based on a dual graph neural network, which includes a computer program tangibly embodied on a machine-readable medium, the computer program including a method for executing the The program code of the method. In such an embodiment, the computer program may be downloaded and installed from a network via communication portion 309 and/or installed from removable media 311 .
附图中的流程图和框图,图示了按照本发明各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,前述模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or part of code that includes one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
描述于本申请实施例中所涉及到的单元或模块可以通过软件的方式实现,也可以通过硬件的方式来实现。所描述的单元或模块也可以设置在处理器中,例如,可以描述为:一种处理器包括第一子区域生成单元、第二子区域生成单元以及显示区域生成单元。其中,这些单 元或模块的名称在某种情况下并不构成对该单元或模块本身的限定,例如,显示区域生成单元还可以被描述为“用于根据第一子区域和第二子区域生成文本的显示区域的单元”。The units or modules involved in the embodiments described in the present application may be implemented by means of software or by means of hardware. The described units or modules may also be set in a processor. For example, it may be described as: a processor includes a first sub-region generating unit, a second sub-region generating unit, and a display region generating unit. Wherein, the names of these units or modules do not constitute limitations on the units or modules themselves in some cases, for example, the display area generation unit can also be described as "used to generate The cell of the display area of the text".
作为另一方面,本申请还提供了一种计算机可读存储介质,该计算机可读存储介质可以是上述实施例中前述装置中所包含的计算机可读存储介质;也可以是单独存在,未装配入设备中的计算机可读存储介质。计算机可读存储介质存储有一个或者一个以上程序,前述程序被一个或者一个以上的处理器用来执行描述于本申请的应用于透明窗口信封的文本生成方法。As another aspect, the present application also provides a computer-readable storage medium, which may be the computer-readable storage medium contained in the aforementioned devices in the above-mentioned embodiments; computer-readable storage media stored in the device. The computer-readable storage medium stores one or more programs, and the aforementioned programs are used by one or more processors to execute the text generation method applied to transparent window envelopes described in this application.
以上描述仅为本申请的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解,本申请中所涉及的发明范围,并不限于上述技术特征的特定组合而成的技术方案,同时也应涵盖在不脱离前述发明构思的情况下,由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本申请中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。The above description is only a preferred embodiment of the present application and an illustration of the applied technical principle. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, and should also cover the technical solutions formed by the above-mentioned technical features or without departing from the aforementioned inventive concept. Other technical solutions formed by any combination of equivalent features. For example, a technical solution formed by replacing the above-mentioned features with technical features with similar functions disclosed in (but not limited to) this application.

Claims (10)

  1. 一种基于对偶图神经网络对三角网格进行去噪的方法,其特征在于,该方法包括:A method for denoising triangular grids based on a dual graph neural network, characterized in that the method comprises:
    对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图,然后将顶点图和面片图输入到对应的图神经网络中;Simultaneously build a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then input the vertex graph and the face graph into the corresponding graph neural network;
    基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪,基于面片建立的图结构在神经网络中用于对面片法向进行去噪;The graph structure based on the vertices is used in the neural network to pre-denoise the noise vertices, and the graph structure based on the patch is used in the neural network to denoise the normal direction of the patch;
    根据去噪后的面片法向来更新预去噪后的顶点以输出最终的三角网格。The pre-denoised vertices are updated according to the denoised patch normals to output the final triangle mesh.
  2. 根据权利要求1所述的基于对偶图神经网络对三角网格进行去噪的方法,其特征在于,所述三角网格中的顶点为所述对偶图中顶点图的节点,所述顶点之间的边为所述对偶图中顶点图的边,所述对偶图中的顶点图的邻接矩阵为N v*N v,其中,N v为三角网格中的顶点数量。 The method for denoising a triangular mesh based on a dual graph neural network according to claim 1, wherein the vertices in the triangular mesh are nodes of the vertex graph in the dual graph, and between the vertices The edges of are the edges of the vertex graph in the dual graph, and the adjacency matrix of the vertex graph in the dual graph is N v *N v , where N v is the number of vertices in the triangular mesh.
  3. 根据权利要求2所述的基于对偶图神经网络对三角网格进行去噪的方法,其特征在于,所述对三角网格中的三角面片构建图数据结构形成对偶图中的面片图,包括:The method for denoising triangular mesh based on dual graph neural network according to claim 2, characterized in that, the triangular patch in the triangular mesh constructs a graph data structure to form a patch graph in the dual graph, include:
    通过三角网格中的顶点计算每个三角面片的质心和法向;Calculate the centroid and normal of each triangle patch from the vertices in the triangle mesh;
    判断每个三角面片和周围面片是否有共享的顶点,若有,则检索得到三角面片的邻域面片集合;Determine whether each triangle facet has shared vertices with the surrounding facets, and if so, retrieve the neighborhood facet set of the triangle facet;
    将每个三角面片作为面片图中的节点,通过三角面片和其邻域中的每个面片构成对偶图中的边。Each triangular facet is regarded as a node in the facet graph, and an edge in the dual graph is formed by the triangular facet and each facet in its neighborhood.
  4. 根据权利要求1所述的基于对偶图神经网络对三角网格进行去噪的方法,其特征在于,所述对三角网格中的顶点和三角面片同时构建图数据结构形成对偶图之前,该方法还包括:The method for denoising a triangular mesh based on a dual graph neural network according to claim 1, characterized in that, before the vertices and triangle faces in the triangular mesh are simultaneously constructed a graph data structure to form a dual graph, the Methods also include:
    将所有三角网格平移到以网格质心为原点,根据三角网格中边的平均长度进行归一化处理,将三角网格的三维坐标缩放到平均边长为1。Translate all the triangular meshes to the grid centroid as the origin, perform normalization according to the average length of the sides in the triangular meshes, and scale the three-dimensional coordinates of the triangular meshes to an average side length of 1.
  5. 根据权利要求1所述的基于对偶图神经网络对三角网格进行去噪的方法,其特征在于,所述基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪之后,该方法还包括:The method for denoising a triangular mesh based on a dual graph neural network according to claim 1, characterized in that, after the graph structure established based on vertices is used in the neural network to pre-denoise noise vertices, the Methods also include:
    根据预去噪的顶点计算面片新的质心坐标和法向。Compute the new centroid coordinates and normals of the patch based on the pre-denoised vertices.
  6. 根据权利要求1所述的基于对偶图神经网络对三角网格进行去噪的方法,其特征在于,所述顶点图和所述面片图采用相同的网络结构,所述网络结构中的图卷积单元采用卷积模块:The method for denoising a triangular mesh based on a dual graph neural network according to claim 1, wherein the vertex graph and the patch graph adopt the same network structure, and the graph volume in the network structure The product unit uses a convolution module:
    Figure PCTCN2022136755-appb-100001
    Figure PCTCN2022136755-appb-100001
    其中,b为偏置项,x i和x j分别为节点i和j的特征,N(i)为对应的图结构中节点i的邻接节点集合,W m表示m个可学习的特征变换,q m为分配函数,用于为不同的邻接节点分配权重。 Among them, b is a bias item, x i and x j are the characteristics of node i and j respectively, N(i) is the set of adjacent nodes of node i in the corresponding graph structure, W m represents m learnable feature transformations, q m is an assignment function, which is used to assign weights to different adjacent nodes.
  7. 根据权利要求1所述的基于对偶图神经网络对三角网格进行去噪的方法,其特征在于,所述根据去噪后的面片法向来更新预去噪后的顶点之后,该方法还包括:The method for denoising triangular meshes based on dual graph neural network according to claim 1, characterized in that, after updating the pre-denoised vertices according to the denoised patch normal, the method also includes :
    更新预去噪的顶点来优化最终的顶点位置,该更新过程的算法为:Update the pre-denoised vertices to optimize the final vertex position. The algorithm of the update process is:
    Figure PCTCN2022136755-appb-100002
    Figure PCTCN2022136755-appb-100002
    其中,v′ i为顶点预去噪的结果,N f(i)是顶点i的所有邻接面片,c k和n k′分别为面片k的质心和去噪后的法向。 Among them, v′ i is the result of vertex pre-denoising, N f (i) is all adjacent patches of vertex i, c k and n k ′ are the centroid and denoised normal of patch k, respectively.
  8. 一种基于对偶图神经网络对三角网格进行去噪的装置,其特征在于,该装置包括:A device for denoising triangular grids based on a dual graph neural network, characterized in that the device includes:
    构建单元,用于对三角网格中的顶点和三角面片同时构建图数据 结构形成对偶图,然后将顶点图和面片图输入到对应的图神经网络中;The construction unit is used to simultaneously construct a graph data structure for the vertices and triangle faces in the triangular mesh to form a dual graph, and then input the vertex graph and the face graph into the corresponding graph neural network;
    去噪单元,基于顶点建立的图结构在神经网络中用于对噪声顶点进行预去噪,基于面片建立的图结构在神经网络中用于对面片法向进行去噪;The denoising unit, the graph structure established based on the vertices is used in the neural network to pre-denoise the noise vertices, and the graph structure established based on the patch is used in the neural network to denoise the normal direction of the patch;
    输出单元,用于根据去噪后的面片法向来更新预去噪后的顶点以输出最终的三角网格。The output unit is used to update the pre-denoised vertices according to the denoised patch normal to output the final triangular mesh.
  9. 一种计算机设备,包括存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现如权利要求1-7中任一所述的方法。A computer device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, characterized in that, when the processor executes the program, it implements any of claims 1-7 described method.
  10. 一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序用于:A computer-readable storage medium having stored thereon a computer program for:
    所述计算机程序被处理器执行时实现如权利要求1-7中任一所述的方法。When the computer program is executed by the processor, the method according to any one of claims 1-7 is implemented.
PCT/CN2022/136755 2021-12-13 2022-12-06 Method for denoising triangular mesh based on dual graph neural network WO2023109567A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111521604.7A CN114419275A (en) 2021-12-13 2021-12-13 Method for denoising triangular mesh based on dual-graph neural network
CN202111521604.7 2021-12-13

Publications (1)

Publication Number Publication Date
WO2023109567A1 true WO2023109567A1 (en) 2023-06-22

Family

ID=81266609

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/136755 WO2023109567A1 (en) 2021-12-13 2022-12-06 Method for denoising triangular mesh based on dual graph neural network

Country Status (2)

Country Link
CN (1) CN114419275A (en)
WO (1) WO2023109567A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116977598A (en) * 2023-09-22 2023-10-31 芯瑞微(上海)电子科技有限公司 Triangular mesh numerical simulation smoothing method

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114419275A (en) * 2021-12-13 2022-04-29 深圳先进技术研究院 Method for denoising triangular mesh based on dual-graph neural network
CN115661379B (en) * 2022-12-28 2023-04-07 北京智拓视界科技有限责任公司 Method, apparatus and storage medium for denoising three-dimensional image data
CN117315194B (en) * 2023-09-27 2024-05-28 南京航空航天大学 Triangular mesh representation learning method for large aircraft appearance

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190139248A1 (en) * 2016-04-29 2019-05-09 Microsoft Technology Licensing, Llc Mesh denoising
CN110930334A (en) * 2019-11-26 2020-03-27 浙江大学 Grid denoising method based on neural network
CN114419275A (en) * 2021-12-13 2022-04-29 深圳先进技术研究院 Method for denoising triangular mesh based on dual-graph neural network

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190139248A1 (en) * 2016-04-29 2019-05-09 Microsoft Technology Licensing, Llc Mesh denoising
CN110930334A (en) * 2019-11-26 2020-03-27 浙江大学 Grid denoising method based on neural network
CN114419275A (en) * 2021-12-13 2022-04-29 深圳先进技术研究院 Method for denoising triangular mesh based on dual-graph neural network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Master's Thesis", 1 June 2021, UNIVERSITY OF CHINESE ACADEMY OF SCIENCES (SHENZHEN INSTITUTE OF ADVANCED TECHNOLOGY, CHINESE ACADEMY OF SCIENCES), CN, article ZHANG, YINGKUI: "3D Data Denoising Based on Deep Learning", pages: 1 - 46, XP009546181, DOI: 10.27822/d.cnki.gszxj.2021.000110 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116977598A (en) * 2023-09-22 2023-10-31 芯瑞微(上海)电子科技有限公司 Triangular mesh numerical simulation smoothing method
CN116977598B (en) * 2023-09-22 2023-12-15 芯瑞微(上海)电子科技有限公司 Triangular mesh numerical simulation smoothing method

Also Published As

Publication number Publication date
CN114419275A (en) 2022-04-29

Similar Documents

Publication Publication Date Title
WO2023109567A1 (en) Method for denoising triangular mesh based on dual graph neural network
Berger et al. A survey of surface reconstruction from point clouds
CN112862972B (en) Surface structure grid generation method
Hu et al. Centroidal Voronoi tessellation based polycube construction for adaptive all-hexahedral mesh generation
US11380061B2 (en) Method and apparatus for three-dimensional (3D) object and surface reconstruction
Du et al. New iterative closest point algorithm for isotropic scaling registration of point sets with noise
Cui et al. High-precision 3D reconstruction for small-to-medium-sized objects utilizing line-structured light scanning: A review
CN111553985B (en) O-graph pairing European three-dimensional reconstruction method and device
Tajdari et al. Feature preserving non-rigid iterative weighted closest point and semi-curvature registration
Leal et al. Sparse regularization-based approach for point cloud denoising and sharp features enhancement
Zhu et al. Multisource point clouds, point simplification and surface reconstruction
Dinesh et al. Fast 3D point cloud denoising via bipartite graph approximation & total variation
CN113450396A (en) Three-dimensional/two-dimensional image registration method and device based on bone features
CN114219890A (en) Three-dimensional reconstruction method, device and equipment and computer storage medium
Zhou et al. Improvement of normal estimation for point clouds via simplifying surface fitting
CN113421331B (en) Object appearance detection method based on curved surface reconstruction method and application method
CN114202632A (en) Grid linear structure recovery method and device, electronic equipment and storage medium
Cheng et al. Image alignment for tomography reconstruction from synchrotron x-ray microscopic images
He et al. Real-time 3D reconstruction of thin surface based on laser line scanner
Campos et al. Splat-based surface reconstruction from defect-laden point sets
Xu et al. Robust resistance to noise and outliers: Screened Poisson Surface Reconstruction using adaptive kernel density estimation
Choi et al. Iterative K-closest point algorithms for colored point cloud registration
Zhang et al. Rapid texture optimization of three-dimensional urban model based on oblique images
Huang et al. Adaptive hexahedral mesh generation and regeneration using an improved grid-based method
CN112036498A (en) Feature selection method and device based on convex-non-negative matrix factorization and adaptive graph

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22906317

Country of ref document: EP

Kind code of ref document: A1