CN117333636A - Model conversion method and device - Google Patents

Model conversion method and device Download PDF

Info

Publication number
CN117333636A
CN117333636A CN202311458987.7A CN202311458987A CN117333636A CN 117333636 A CN117333636 A CN 117333636A CN 202311458987 A CN202311458987 A CN 202311458987A CN 117333636 A CN117333636 A CN 117333636A
Authority
CN
China
Prior art keywords
model
real
time rendering
conversion
rendering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311458987.7A
Other languages
Chinese (zh)
Inventor
杨超
张磊
刘享军
王海新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Wodong Tianjun Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN202311458987.7A priority Critical patent/CN117333636A/en
Publication of CN117333636A publication Critical patent/CN117333636A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • G06T17/205Re-meshing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Image Generation (AREA)

Abstract

The invention discloses a method and a device for model conversion, and relates to the technical field of computers. One embodiment of the method comprises the following steps: in response to receiving a model conversion instruction, performing geometry conversion on an offline rendering model to be converted into a real-time rendering model to obtain a first model comprising a plurality of polygonal meshes; performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model; and performing material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain a real-time rendering model. According to the embodiment, the model rendering efficiency is improved, the off-line rendering model is suitable for the rendering performance in the real-time rendering scheme, and the model conversion cost is reduced because the model conversion is not needed to be carried out manually.

Description

Model conversion method and device
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for model conversion.
Background
Offline rendering refers to the process of generating images or animations without the need for real-time interaction. In contrast to offline rendering, real-time rendering is the process of generating images or animations for interactive applications where real-time interaction is required. Real-time rendering and offline rendering are two different rendering modes, and their application scenes and implementation modes are also different. Because of the performance requirements, differences in the renderers, the three-dimensional model data, which is typically rendered offline, cannot be directly used in real-time rendering. However, to save modeling fabrication costs, it is often necessary to apply an offline rendering model to a real-time rendering scheme to accommodate more traffic scenes.
In the process of implementing the present invention, the inventor finds that at least the following problems exist in the prior art:
currently, when an offline rendering model is applied to a scheme of real-time rendering, a designer needs to manually convert the offline rendering model into a format supported by the real-time rendering engine, and the model conversion workload is large, the efficiency is low, and the cost is high.
Disclosure of Invention
In view of this, the embodiment of the invention provides a method and a device for model conversion, which can process an offline rendering model to be used in an online rendering scheme, improve the rendering efficiency of the model and adapt the offline rendering model to the rendering performance in a real-time rendering scheme, and reduce the model conversion cost because no manual model conversion is needed.
To achieve the above object, according to an aspect of an embodiment of the present invention, there is provided a method of model conversion, including:
in response to receiving a model conversion instruction, performing geometry conversion on an offline rendering model to be converted into a real-time rendering model to obtain a first model comprising a plurality of polygonal meshes;
performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model;
And performing material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain a real-time rendering model.
Optionally, performing geometry conversion on an offline rendering model to be converted into a real-time rendering model, including: and collapse of the offline rendering model to be converted into the real-time rendering model is converted into a plurality of polygonal grids by means of curve fitting triangle grid curvature calculation, so that geometric shape conversion is carried out.
Optionally, performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model, including: obtaining an error matrix of each vertex of a polygonal grid included in the first model by calculating the average curvature of the vertex; calculating a contraction position corresponding to the vertex according to the error matrix of the vertex; calculating error matrixes of all adjacent vertexes of the vertexes based on the contraction positions of the vertexes, and determining removed vertexes according to the error matrixes of all the adjacent vertexes; removing the removed vertexes, and updating the connection relation between adjacent vertexes of the vertexes and the polygonal grid to obtain a simplified model; repeating the above operation until reaching the set simplification degree index, and taking the simplification model reaching the simplification degree index as the second model.
Optionally, the texture parameters include texture attribute parameters and texture map parameters; according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine, performing material conversion processing on the second model to obtain a real-time rendering model, including: and performing material attribute conversion processing on the second model according to the material attribute parameters of the offline rendering engine and the material attribute parameters of the real-time rendering engine, and performing material mapping conversion processing on the second model according to the material mapping parameters of the offline rendering engine and the material mapping parameters of the real-time rendering engine to obtain the real-time rendering model.
Optionally, after performing material conversion processing on the second model to obtain a real-time rendering model, the method further includes: performing a canonical rectification process on the real-time rendering model, the canonical rectification process including: triangularization inspection process, edge normal flip inspection repair, redundant vertex inspection and surface unwrapping process, mesh inspection repair, and map size compression.
Optionally, triangulating the real-time rendering model includes: and performing polygon triangularization processing on the polygon meshes with the edge number larger than three in the polygon meshes included in the real-time rendering model so as to convert the polygon meshes included in the real-time rendering model into triangle meshes.
Optionally, performing grid check repair on the real-time rendering model includes: judging a missing triangle patch in a triangle mesh included in the real-time rendering template by analyzing a topological structure and boundary edges of the real-time rendering model and combining the vertex number of a closed boundary; and constructing triangles of the missing triangle patches to carry out grid check repair on the real-time rendering model.
Optionally, performing edge normal roll-over inspection repair on the real-time rendering model includes: calculating a normal vector of each polygonal mesh included by the real-time rendering model; obtaining the normal vector of each vertex of the polygon mesh included in the real-time rendering model by calculating the average value of the normal vector of the polygon mesh sharing the vertex; and according to the normal vector of each vertex of the polygonal mesh included by the real-time rendering model, performing edge normal overturning inspection and repair on the real-time rendering model.
Optionally, performing redundant vertex inspection and surface expansion processing on the real-time rendering model includes: obtaining overlapped vertexes according to coordinates of each vertex of the real-time rendering model, and deleting redundant vertexes according to the overlapped vertexes so as to perform redundant vertex check processing on the real-time rendering model; and expanding the surface of the real-time rendering model with the redundant vertexes deleted into a two-dimensional plane so as to perform surface expansion processing on the real-time rendering model.
Optionally, performing the map size compression on the real-time rendering model includes: acquiring the original size of a map in the real-time rendering model; determining the size to be scaled according to the original size of the map; scaling the map in the real-time rendering model from the original size to the size to be scaled by using a bilinear interpolation algorithm to perform map size compression on the real-time rendering model.
According to another aspect of an embodiment of the present invention, there is provided an apparatus for model conversion, including:
the shape conversion module is used for responding to the received model conversion instruction, and performing geometric shape conversion on an offline rendering model to be converted into a real-time rendering model to obtain a first model comprising a plurality of polygonal grids;
the model face reduction module is used for carrying out polygon mesh removal processing on the first model by using a model face reduction algorithm to obtain a second model;
and the material conversion module is used for carrying out material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain a real-time rendering model.
According to still another aspect of an embodiment of the present invention, there is provided an electronic apparatus including: one or more processors; and the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are enabled to realize the model conversion method provided by the embodiment of the invention.
According to yet another aspect of the embodiments of the present invention, there is provided a computer readable medium having stored thereon a computer program which, when executed by a processor, implements a method of model transformation provided by the embodiments of the present invention.
One embodiment of the above invention has the following advantages or benefits: performing geometry transformation on an offline rendering model to be transformed into a real-time rendering model in response to receiving a model transformation instruction to obtain a first model comprising a plurality of polygonal meshes; performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model; according to the technical scheme that the second model is subjected to material conversion processing to obtain the real-time rendering model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine, the surface reduction processing and the material parameter conversion of the offline rendering model can be realized, so that the offline rendering model can be processed to be used for an online rendering scheme, the rendering efficiency of the model is improved, the offline rendering model is suitable for the rendering performance in the real-time rendering scheme, and the model conversion cost is reduced because the model conversion is not required to be performed manually. The number of polygons in the model data is reduced through the face reduction process, so that the rendering performance of using the offline rendering model in a real-time rendering scheme is improved; the rendering performance of using the offline rendering model in a real-time rendering scheme is improved by reducing the number of textures and reducing the resolution through texture parameter conversion.
Further effects of the above-described non-conventional alternatives are described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
FIG. 1 is a schematic diagram of the main steps of a method of model conversion according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of the main blocks of an apparatus for model conversion according to an embodiment of the present invention;
FIG. 3 is an exemplary system architecture diagram in which embodiments of the present invention may be applied;
fig. 4 is a schematic diagram of a computer system suitable for use in implementing an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
In the technical scheme disclosed by the invention, the aspects of acquisition, collection, updating, analysis, processing, use, transmission, storage and the like of the related user personal information all conform to the rules of related laws and regulations, are used for legal purposes, and do not violate the popular public order. Necessary measures are taken for the personal information of the user, illegal access to the personal information data of the user is prevented, and the personal information security, network security and national security of the user are maintained.
In order to solve the technical problems in the prior art, the invention provides a method and a device for model conversion, which take the problems of optimization and performance of model data existing when an offline training model is converted into a real-time training model into consideration. Since offline rendering generally does not need to take performance into consideration, and real-time rendering needs to take performance into consideration, when model data of offline rendering is applied to a real-time rendering scheme, optimization of the model data is required to improve rendering performance, and a corresponding real-time rendering engine needs to be docked.
Specifically, the inventors found that the larger the number of polygons in the model data, the larger the calculation amount required for rendering, so that the rendering performance can be improved by reducing the number of polygons in the model data; the higher the number of textures and the resolution in the model data, the larger the calculation amount required for rendering, so that the rendering performance can be improved by reducing the number of textures and the resolution; in order to adapt the real-time rendering engine, the material parameters of the offline rendering model may be converted according to the material settings of the real-time rendering engine. Through the processing of the aspects, the automatic optimization of the offline rendering model can be realized, the rendering efficiency of the model is improved, the offline rendering model is suitable for the rendering performance in a real-time rendering scheme, and the model conversion cost is reduced because the model conversion is not needed to be performed manually.
FIG. 1 is a schematic diagram of the main steps of a method of model conversion according to an embodiment of the present invention. As shown in fig. 1, the method for model conversion according to the embodiment of the present invention mainly includes the following steps S101 to S103.
Step S101: and in response to receiving the model conversion instruction, performing geometry conversion on the offline rendering model to be converted into the real-time rendering model to obtain a first model comprising a plurality of polygonal grids. In order to meet the frame rate requirements of real-time rendering, model simplification processing is required to be performed on an offline rendering model. When model simplification processing is performed, geometric transformation can be performed on the offline rendering model.
According to one embodiment of the present invention, performing geometry transformation on an offline rendering model to be transformed into a real-time rendering model may specifically include: and collapse of the offline rendering model to be converted into the real-time rendering model is converted into a plurality of polygonal grids by means of curve fitting triangle grid curvature calculation, so that geometric shape conversion is carried out. Offline rendering models typically use high complexity geometries such as curved surfaces, NURBS (Non-Uniform Rational B-splies, non-uniform rational B-splines), and the like. While real-time rendering requires the use of low complexity geometries such as polygons like triangles, quadrilaterals etc. Specifically, in embodiments of the present invention, complex geometric collapse in an offline rendering model may be converted into a polygonal mesh by way of surface-fitted triangle mesh curvature computation. Firstly, creating a topological structure of a curved surface grid by using discretized vertexes; the vertices are then connected into triangles using a triangulation algorithm, such as Delaunay triangulation or other suitable algorithm, to convert the complex geometry in the offline rendering model into a polygonal mesh, here a triangle mesh.
Step S102: and performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model. The more the number of faces (i.e., polygons) of the model, the greater the amount of computation required for rendering, and the lower the rendering performance, the need for a face-subtracting process for the offline rendering model arises. In particular, model face reduction may be performed using a 3D face reduction algorithm Quadric Error Metrics algorithm (Quadric Error Metrics is a classical mesh reduction algorithm based on greedy algorithm ideas, also called edge collapse mesh reduction algorithm) that achieves model face reduction by calculating the error between the original model and the reduced model and then minimizing the error by removing polygons. Model face reduction algorithms are machine learning algorithm techniques for reducing model complexity.
According to one embodiment of the present invention, the polygon mesh removing process is performed on the first model by using a model face subtracting algorithm to obtain a second model, which specifically may include: obtaining an error matrix of each vertex of a polygonal grid included in the first model by calculating the average curvature of the vertex; calculating a contraction position corresponding to the vertex according to the error matrix of the vertex; calculating error matrixes of all adjacent vertexes of the vertexes based on the contraction positions of the vertexes, and determining removed vertexes according to the error matrixes of all the adjacent vertexes; removing the removed vertexes, and updating the connection relation between adjacent vertexes of the vertexes and the polygonal grid to obtain a simplified model; repeating the above operation until reaching the set simplification degree index, and taking the simplification model reaching the simplification degree index as the second model.
In an embodiment of the present invention, the process of the face reduction process is approximately as follows:
(1) First, it is assumed that there is a curved surface in which each vertex is represented as V in 3D (three-dimensional) coordinates;
(2) For each vertex, its average curvature is calculated. The average curvature may be estimated using triangular patches around the control vertices. The specific mean curvature calculation method may be discrete or numerical based;
(3) These average curvature values are stored as a 4x4 error matrix Qbar as the surface geometry of the vertices. Wherein the values of elements qij in the matrix represent the average curvature value of the vertex, i and j being subscripts of the elements in the matrix;
(4) For each vertex, the contracted position of the vertex V is obtained by solving the following equation:
wherein,namely the error matrix Qbar of the vertex, +.>The contracted position of the vertex;
(5) Calculating an error matrix of adjacent vertexes of the vertexes, selecting vertexes with smaller error matrix for removing, and updating the connection relation between the adjacent vertexes and the polygon to obtain a simplified model;
(6) Repeating the above steps, updating the simplified model until reaching a required degree of simplification index, wherein the degree of simplification index is, for example: the number of remaining polygons, the proportion of reduced polygons or the number of remaining vertices, etc.
Step S103: and performing material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain a real-time rendering model. Through the step S102, the off-line rendering model may be subjected to surface subtraction processing to obtain a second model, and then, the second model may be subjected to material conversion, which mainly includes material attribute parameter conversion and material map parameter conversion, so as to reduce the number of textures and reduce the resolution to improve the rendering performance.
According to one embodiment of the invention, the texture parameters include texture attribute parameters and texture map parameters. According to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine, performing material conversion processing on the second model to obtain a real-time rendering model, which specifically may include: and performing material attribute conversion processing on the second model according to the material attribute parameters of the offline rendering engine and the material attribute parameters of the real-time rendering engine, and performing material mapping conversion processing on the second model according to the material mapping parameters of the offline rendering engine and the material mapping parameters of the real-time rendering engine to obtain the real-time rendering model.
In one embodiment of the present invention, the offline rendering engine takes Vray (Vray is a high quality rendering software manufactured by chaosgroup and asgvis corporation, vray is the most popular rendering engine in industry) as an example, the real-time rendering frame takes abs (Physically Based Shading, based on physical rendering technology) as an example, and uses PBS rendering material types based on physical descriptions, and the material attribute parameter part of the numerical type mainly includes: imitation rate color albedoColor, metallic and smooth. Corresponding to this are also texture map parameters: imitation rate map albedoTexture, metallicity map metallicity texture, and smoothness map smoothnessTexture, and texture map parameters may also include ambient light shading map AOTexture. Wherein, albedoColor: the base color, the color used to designate the surface of the object in the texture system, is typically used to represent the diffuse reflectance color of the object, i.e., the object surface's ability to reflect light; metallic: the material system is used for specifying the metal degree of the surface of the object, and is generally used for representing the metal texture of the surface of the object, namely the reflection mode of the surface of the object to light; smoothness: the smoothness of the surface of the object is designated in the material system, which is generally used for representing the roughness of the surface of the object, namely the reflection mode of the surface of the object to light; AOTexture: an ambient light shading map, which is used to specify the degree of shading of an object surface under ambient light, is generally used to represent the effect of shading of the object surface, i.e. the degree of shading of the object surface under ambient light.
In the embodiment of the invention, when the material attribute parameter conversion is performed, the material attribute conversion processing can be performed on the second model based on the material attribute parameter of the offline rendering engine and the material attribute parameter of the real-time rendering engine and the experience value. When the texture mapping parameter conversion is performed, the texture mapping conversion process may be performed on the second model based on the texture mapping parameter of the offline rendering engine and the texture mapping parameter of the real-time rendering engine. When the environment light shielding mapping AOTexture parameter is converted, the mapping parameter obtained by detecting the intersection condition of the object surface and the surrounding geometry body through a Ray Tracing algorithm (Ray Tracing-based AO) can be calculated, and the realization process is as follows:
(1) Emitting rays: for each point on the second model surface, emitting a plurality of rays around in a semicircle in the normal direction;
(2) And (3) ray detection: for each ray, detecting its intersection with surrounding geometry (e.g., other models, planes, or edges of the geometry);
(3) And (5) shielding calculation: according to the intersection condition, calculating the shielding degree of each ray and surrounding geometry, and simulating the shielding effect by using distance attenuation;
(4) And (5) shielding weighting: weighting and averaging the shielding degrees of all rays to obtain an AO value of each point;
(5) Integration results: finally, the resulting AO value is mapped to the range of 0 to 1 and saved as the map parameters of the texture map.
According to the steps S101 to S103, the surface reduction processing and the material parameter conversion can be performed on the offline rendering model, so that the offline rendering model can be used for an online rendering scheme, the rendering efficiency of the model is improved, and the offline rendering model is suitable for the rendering performance in a real-time rendering scheme.
According to still another embodiment of the present invention, after performing a material conversion process on the second model to obtain a real-time rendering model, the method may further include: performing a canonical rectification process on the real-time rendering model, the canonical rectification process including: triangularization inspection process, edge normal flip inspection repair, redundant vertex inspection and surface unwrapping process, mesh inspection repair, and map size compression. Through standard correction processing on the real-time rendering model obtained through conversion, the model effect is better, and abnormal conditions such as model distortion and deformation cannot occur.
According to one embodiment of the invention, triangulating the real-time rendering model comprises: and performing polygon triangularization processing on the polygon meshes with the edge number larger than three in the polygon meshes included in the real-time rendering model so as to convert the polygon meshes included in the real-time rendering model into triangle meshes. According to the technical scheme, the complexity of the model can be reduced by converting the complex aggregate shape of the offline rendering model into the simple triangle. However, in the conversion process, polygon meshes other than triangles may appear, so triangularization check processing is required to convert polygon meshes with sides greater than three in the real-time rendering model into triangle meshes for rendering and processing. Specifically, the triangularization processing operation of the embodiment of the present invention includes: firstly traversing all grids in a real-time rendering model to obtain polygonal grids with the edge number greater than three; for the polygon meshes with the number of each edge being more than three, starting searching from the first vertex of the polygon mesh, checking the previous vertex and the next vertex of the current vertex, and judging whether the formed edges are all inside the polygon; adding the triangle formed to the triangulated result and removing the vertex from the polygon; updating the vertex indexes of the rest polygons, and continuing to perform the triangulation processing operation until the polygon mesh is a triangle with three vertices.
According to another embodiment of the present invention, grid check repair of the real-time rendering model includes: judging a missing triangle patch in a triangle mesh included in the real-time rendering template by analyzing a topological structure and boundary edges of the real-time rendering model and combining the vertex number of a closed boundary; and constructing triangles of the missing triangle patches to carry out grid check repair on the real-time rendering model. In the embodiment of the invention, grid inspection and repair mainly repair holes, gaps and other geometric problems in a model, and the specific operations comprise: firstly, detecting and identifying holes and gaps in a model, analyzing the topological structure and boundary edges of the model, and judging the missing triangle patches in the grid by closing the top points of the boundary; then, the missing triangle patch is subjected to triangle construction, and the gap is filled.
According to yet another embodiment of the present invention, performing edge normal roll-over inspection repair on the real-time rendering model includes: calculating a normal vector of each polygonal mesh included by the real-time rendering model; obtaining the normal vector of each vertex of the polygon mesh included in the real-time rendering model by calculating the average value of the normal vector of the polygon mesh sharing the vertex; and according to the normal vector of each vertex of the polygonal mesh included by the real-time rendering model, performing edge normal overturning inspection and repair on the real-time rendering model. In computer graphics, a normal is a vector perpendicular to a surface at a vertex. In most cases, the normal is calculated by taking the cross product of two vectors lying on the model surface. These vectors are typically the edges of the triangles that make up the model. The normal vector of the current vertex is calculated by the average value of the normal vector of the triangle sharing the vertex.
According to yet another embodiment of the present invention, performing redundant vertex inspection and surface expansion processing on the real-time rendering model includes: obtaining overlapped vertexes according to coordinates of each vertex of the real-time rendering model, and deleting redundant vertexes according to the overlapped vertexes so as to perform redundant vertex check processing on the real-time rendering model; and expanding the surface of the real-time rendering model with the redundant vertexes deleted into a two-dimensional plane so as to perform surface expansion processing on the real-time rendering model. In the embodiment of the invention, the complexity of the model can be reduced by carrying out redundant vertex checking processing; texture mapping may be facilitated by expanding the surface of the real-time rendering model into a two-dimensional plane. The surface expansion processing process for the real-time rendering model mainly comprises the following steps:
(1) Creating an initial UV map: each vertex of the model is assigned one UV coordinate (two-dimensional coordinate). The initial UV coordinates may be set as the position of the vertex in 3D space;
(2) Determining a boundary: and determining the Boundary of the unfolded UV plane according to the Boundary edge (Boundary edge) of the model. The boundary edge is an edge connecting only one adjacent triangle on the surface of the model;
(3) Iterative optimization: gradually adjusting UV coordinates of the vertexes in an iterative optimization mode so that the unfolded UV planes are more compact and have no overlapping;
(4) An uneptimized vertex is selected and the UV coordinates of its neighboring vertices are considered. And calculating the optimal UV position of the current vertex according to the UV coordinates of the adjacent vertices. Updating the UV coordinates of the current vertex using Angle-based Mapping, laplace smoothing (Laplacian Smoothing), etc.;
(5) Repeating the steps until the UV coordinates of all the vertexes converge or reach a certain iteration number;
(6) Solving the overlapping: if overlap of UV coordinates occurs during the optimization process, stretching, rotation, or Scaling (Scaling) techniques may be used to account for the overlap.
According to yet another embodiment of the present invention, performing map size compression on the real-time rendering model includes: acquiring the original size of a map in the real-time rendering model; determining the size to be scaled according to the original size of the map; scaling the map in the real-time rendering model from the original size to the size to be scaled by using a bilinear interpolation algorithm to perform map size compression on the real-time rendering model. According to an embodiment of the present invention, in determining the size to be scaled, the determination may be made in power of 2. Specifically, the process of performing map size compression on the real-time rendering model is mainly as follows:
(1) Determining the original size of the map: acquiring the original width and the original height of the map;
(2) Calculating the power of 2 size of the nearest neighbor: the smallest power of 2 value greater than the original width and height is found. The following formula may be used: pow (2, ceil (log 2 (size))) to calculate the power of 2 size, where size is the original width or height;
(3) Scaling the map: the original map is scaled to the calculated power of 2 of the nearest neighbor size using a bilinear interpolation algorithm. Bilinear interpolation, also known as bilinear interpolation. Mathematically, bilinear interpolation is a linear interpolation extension of an interpolation function with two variables, the core idea of which is to perform linear interpolation once in two directions, respectively. Bilinear interpolation is widely applied to aspects such as signal processing, digital image processing, video processing and the like as an interpolation algorithm in numerical analysis.
Through the embodiments, the real-time rendering model can be subjected to standard correction processing, so that the real-time rendering model obtained after conversion is more standard, convenient to render and process, lower in complexity, convenient to texture map, smaller in size and higher in rendering efficiency.
Finally, the generated real-time rendering model or the real-time rendering model after the standard rectification processing can be saved and exported in a gltf (a 3D model file format) format. gltf is an open standard format for 3D scenes and models. The invention adopts the gltf format to store the processed data, converts the material information into a Json (JavaScript Object Notation, JS object numbered musical notation, which is a lightweight data exchange format) data structure, and stores the grid data in the gltf format in a binary mode.
Fig. 2 is a schematic diagram of main modules of an apparatus for model conversion according to an embodiment of the present invention. As shown in fig. 2, the apparatus 200 for model transformation according to the embodiment of the present invention mainly includes a shape transformation module 201, a model face reduction module 202, and a material transformation module 203.
The shape conversion module 201 is configured to perform geometry conversion on an offline rendering model to be converted into a real-time rendering model in response to receiving a model conversion instruction, so as to obtain a first model including a plurality of polygonal meshes;
a model face subtracting module 202, configured to perform polygon mesh removal processing on the first model by using a model face subtracting algorithm, so as to obtain a second model;
and the material conversion module 203 is configured to perform material conversion processing on the second model according to the material parameter of the offline rendering engine and the material parameter of the real-time rendering engine to obtain a real-time rendering model.
According to one embodiment of the invention, the shape conversion module 201 may also be used to: and collapse of the offline rendering model to be converted into the real-time rendering model is converted into a plurality of polygonal grids by means of curve fitting triangle grid curvature calculation, so that geometric shape conversion is carried out.
According to another embodiment of the invention, the model subtraction module 202 may also be used to: obtaining an error matrix of each vertex of a polygonal grid included in the first model by calculating the average curvature of the vertex; calculating a contraction position corresponding to the vertex according to the error matrix of the vertex; calculating error matrixes of all adjacent vertexes of the vertexes based on the contraction positions of the vertexes, and determining removed vertexes according to the error matrixes of all the adjacent vertexes; removing the removed vertexes, and updating the connection relation between adjacent vertexes of the vertexes and the polygonal grid to obtain a simplified model; repeating the above operation until reaching the set simplification degree index, and taking the simplification model reaching the simplification degree index as the second model.
According to yet another embodiment of the present invention, the texture parameters include texture attribute parameters and texture map parameters; the texture conversion module 203 may also be configured to: and performing material attribute conversion processing on the second model according to the material attribute parameters of the offline rendering engine and the material attribute parameters of the real-time rendering engine, and performing material mapping conversion processing on the second model according to the material mapping parameters of the offline rendering engine and the material mapping parameters of the real-time rendering engine to obtain the real-time rendering model.
According to yet another embodiment of the present invention, the apparatus 200 for model transformation may further include a canonical rectification processing module (not shown in the figure) for: after performing material conversion processing on the second model to obtain a real-time rendering model, performing standard correction processing on the real-time rendering model, wherein the standard correction processing comprises: triangularization inspection process, edge normal flip inspection repair, redundant vertex inspection and surface unwrapping process, mesh inspection repair, and map size compression.
According to yet another embodiment of the present invention, a normalization correction processing module (not shown in the figure) may be specifically configured to, when performing a triangularization check processing on the real-time rendering model: and performing polygon triangularization processing on the polygon meshes with the edge number larger than three in the polygon meshes included in the real-time rendering model so as to convert the polygon meshes included in the real-time rendering model into triangle meshes.
According to yet another embodiment of the present invention, a canonical rectification processing module (not shown in the figure) may be specifically configured to, when performing grid check repair on the real-time rendering model: judging a missing triangle patch in a triangle mesh included in the real-time rendering template by analyzing a topological structure and boundary edges of the real-time rendering model and combining the vertex number of a closed boundary; and constructing triangles of the missing triangle patches to carry out grid check repair on the real-time rendering model.
According to yet another embodiment of the present invention, a normalization correction processing module (not shown in the figure) may be specifically configured to, when performing edge normal rollover check repair on the real-time rendering model: calculating a normal vector of each polygonal mesh included by the real-time rendering model; obtaining the normal vector of each vertex of the polygon mesh included in the real-time rendering model by calculating the average value of the normal vector of the polygon mesh sharing the vertex; and according to the normal vector of each vertex of the polygonal mesh included by the real-time rendering model, performing edge normal overturning inspection and repair on the real-time rendering model.
According to yet another embodiment of the present invention, a normalization correction processing module (not shown in the figure) may be specifically configured to, when performing redundant vertex inspection and surface expansion processing on the real-time rendering model: obtaining overlapped vertexes according to coordinates of each vertex of the real-time rendering model, and deleting redundant vertexes according to the overlapped vertexes so as to perform redundant vertex check processing on the real-time rendering model; and expanding the surface of the real-time rendering model with the redundant vertexes deleted into a two-dimensional plane so as to perform surface expansion processing on the real-time rendering model.
According to yet another embodiment of the present invention, a canonical rectification processing module (not shown in the figure) may be specifically configured to, when performing the map size compression on the real-time rendering model: acquiring the original size of a map in the real-time rendering model; determining the size to be scaled according to the original size of the map; scaling the map in the real-time rendering model from the original size to the size to be scaled by using a bilinear interpolation algorithm to perform map size compression on the real-time rendering model.
According to the technical scheme of the embodiment of the invention, the geometric shape of the offline rendering model to be converted into the real-time rendering model is converted by responding to the received model conversion instruction, so that a first model comprising a plurality of polygonal grids is obtained; performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model; according to the technical scheme that the second model is subjected to material conversion processing to obtain the real-time rendering model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine, the surface reduction processing and the material parameter conversion of the offline rendering model can be realized, so that the offline rendering model can be processed to be used for an online rendering scheme, the rendering efficiency of the model is improved, the offline rendering model is suitable for the rendering performance in the real-time rendering scheme, and the model conversion cost is reduced because the model conversion is not required to be performed manually. The number of polygons in the model data is reduced through the face reduction process, so that the rendering performance of using the offline rendering model in a real-time rendering scheme is improved; the rendering performance of using the offline rendering model in a real-time rendering scheme is improved by reducing the number of textures and reducing the resolution through texture parameter conversion.
Fig. 3 illustrates an exemplary system architecture 300 of a method of model conversion or an apparatus of model conversion to which embodiments of the present invention may be applied.
As shown in fig. 3, the system architecture 300 may include terminal devices 301, 302, 303, a network 304, and a server 305. The network 304 is used as a medium to provide communication links between the terminal devices 301, 302, 303 and the server 305. The network 304 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
A user may interact with the server 305 via the network 304 using the terminal devices 301, 302, 303 to receive or send messages or the like. Various communication client applications may be installed on the terminal devices 301, 302, 303, such as shopping class applications, web browser applications, search class applications, social platform software, etc. (by way of example only).
The terminal devices 301, 302, 303 may be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.
The server 305 may be a server providing various services, such as a background management server (by way of example only) providing support for a photo website browsed by a user using the terminal devices 301, 302, 303. The background management server can respond to the received data such as the model conversion instruction request and the like and perform geometric shape conversion on an offline rendering model to be converted into a real-time rendering model to obtain a first model comprising a plurality of polygonal grids; performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model; and according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine, performing material conversion processing on the second model to obtain a real-time rendering model and other processing, and feeding back a processing result (such as the real-time rendering model-only an example) to the terminal equipment.
It should be noted that, the method for model conversion provided in the embodiment of the present invention is generally executed by the server 305, and accordingly, the device for model conversion is generally disposed in the server 305.
It should be understood that the number of terminal devices, networks and servers in fig. 3 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 4, there is illustrated a schematic diagram of a computer system 400 suitable for use in implementing a terminal device or server in accordance with an embodiment of the present invention. The terminal device or server shown in fig. 4 is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present invention.
As shown in fig. 4, the computer system 400 includes a Central Processing Unit (CPU) 401, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 402 or a program loaded from a storage section 408 into a Random Access Memory (RAM) 403. In RAM 403, various programs and data required for the operation of system 400 are also stored. The CPU 401, ROM 402, and RAM 403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
The following components are connected to the I/O interface 405: an input section 406 including a keyboard, a mouse, and the like; an output portion 407 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker, and the like; a storage section 408 including a hard disk or the like; and a communication section 409 including a network interface card such as a LAN card, a modem, or the like. The communication section 409 performs communication processing via a network such as the internet. The drive 410 is also connected to the I/O interface 405 as needed. A removable medium 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed on the drive 410 as needed, so that a computer program read therefrom is installed into the storage section 408 as needed.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 409 and/or installed from the removable medium 411. The above-described functions defined in the system of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 401.
The computer readable medium shown in the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units or modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described units or modules may also be provided in a processor, for example, as: a processor includes a shape conversion module, a model face reduction module, and a material conversion module. The names of these units or modules do not limit the units or modules, for example, the material conversion module may be further described as "a module for performing material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain the real-time rendering model".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be present alone without being fitted into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to include: in response to receiving a model conversion instruction, performing geometry conversion on an offline rendering model to be converted into a real-time rendering model to obtain a first model comprising a plurality of polygonal meshes; performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model; and performing material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain a real-time rendering model.
According to the technical scheme of the embodiment of the invention, the geometric shape of the offline rendering model to be converted into the real-time rendering model is converted by responding to the received model conversion instruction, so that a first model comprising a plurality of polygonal grids is obtained; performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model; according to the technical scheme that the second model is subjected to material conversion processing to obtain the real-time rendering model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine, the surface reduction processing and the material parameter conversion of the offline rendering model can be realized, so that the offline rendering model can be processed to be used for an online rendering scheme, the rendering efficiency of the model is improved, the offline rendering model is suitable for the rendering performance in the real-time rendering scheme, and the model conversion cost is reduced because the model conversion is not required to be performed manually. The number of polygons in the model data is reduced through the face reduction process, so that the rendering performance of using the offline rendering model in a real-time rendering scheme is improved; the rendering performance of using the offline rendering model in a real-time rendering scheme is improved by reducing the number of textures and reducing the resolution through texture parameter conversion.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives can occur depending upon design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (13)

1. A method of model conversion, comprising:
in response to receiving a model conversion instruction, performing geometry conversion on an offline rendering model to be converted into a real-time rendering model to obtain a first model comprising a plurality of polygonal meshes;
performing polygon mesh removal processing on the first model by using a model face-subtracting algorithm to obtain a second model;
and performing material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain a real-time rendering model.
2. The method of claim 1, wherein geometrically transforming an offline rendering model to be transformed into a real-time rendering model comprises:
and collapse of the offline rendering model to be converted into the real-time rendering model is converted into a plurality of polygonal grids by means of curve fitting triangle grid curvature calculation, so that geometric shape conversion is carried out.
3. The method of claim 1, wherein performing a polygon mesh removal process on the first model using a model face-down algorithm to obtain a second model comprises:
obtaining an error matrix of each vertex of a polygonal grid included in the first model by calculating the average curvature of the vertex;
calculating a contraction position corresponding to the vertex according to the error matrix of the vertex;
calculating error matrixes of all adjacent vertexes of the vertexes based on the contraction positions of the vertexes, and determining removed vertexes according to the error matrixes of all the adjacent vertexes;
removing the removed vertexes, and updating the connection relation between adjacent vertexes of the vertexes and the polygonal grid to obtain a simplified model;
repeating the steps until the set simplification degree index is reached, and taking the simplification model reaching the simplification degree index as the second model.
4. The method of claim 1, wherein the texture parameters include texture attribute parameters and texture map parameters;
according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine, performing material conversion processing on the second model to obtain a real-time rendering model, including:
And performing material attribute conversion processing on the second model according to the material attribute parameters of the offline rendering engine and the material attribute parameters of the real-time rendering engine, and performing material mapping conversion processing on the second model according to the material mapping parameters of the offline rendering engine and the material mapping parameters of the real-time rendering engine to obtain the real-time rendering model.
5. The method of claim 1, further comprising, after performing a material conversion process on the second model to obtain a real-time rendering model:
performing a canonical rectification process on the real-time rendering model, the canonical rectification process including: triangularization inspection process, edge normal flip inspection repair, redundant vertex inspection and surface unwrapping process, mesh inspection repair, and map size compression.
6. The method of claim 5, wherein triangulating the real-time rendering model comprises:
and performing polygon triangularization processing on the polygon meshes with the edge number larger than three in the polygon meshes included in the real-time rendering model so as to convert the polygon meshes included in the real-time rendering model into triangle meshes.
7. The method of claim 6, wherein grid check repair of the real-time rendering model comprises:
judging a missing triangle patch in a triangle mesh included in the real-time rendering template by analyzing a topological structure and boundary edges of the real-time rendering model and combining the vertex number of a closed boundary;
and constructing triangles of the missing triangle patches to carry out grid check repair on the real-time rendering model.
8. The method of claim 5, wherein performing edge normal roll-over inspection repair on the real-time rendering model comprises:
calculating a normal vector of each polygonal mesh included by the real-time rendering model;
obtaining the normal vector of each vertex of the polygon mesh included in the real-time rendering model by calculating the average value of the normal vector of the polygon mesh sharing the vertex;
and according to the normal vector of each vertex of the polygonal mesh included by the real-time rendering model, performing edge normal overturning inspection and repair on the real-time rendering model.
9. The method of claim 5, wherein performing redundant vertex inspection and surface expansion processing on the real-time rendering model comprises:
Obtaining overlapped vertexes according to coordinates of each vertex of the real-time rendering model, and deleting redundant vertexes according to the overlapped vertexes so as to perform redundant vertex check processing on the real-time rendering model;
and expanding the surface of the real-time rendering model with the redundant vertexes deleted into a two-dimensional plane so as to perform surface expansion processing on the real-time rendering model.
10. The method of claim 5, wherein performing map size compression on the real-time rendering model comprises:
acquiring the original size of a map in the real-time rendering model;
determining the size to be scaled according to the original size of the map;
scaling the map in the real-time rendering model from the original size to the size to be scaled by using a bilinear interpolation algorithm to perform map size compression on the real-time rendering model.
11. An apparatus for model conversion, comprising:
the shape conversion module is used for responding to the received model conversion instruction, and performing geometric shape conversion on an offline rendering model to be converted into a real-time rendering model to obtain a first model comprising a plurality of polygonal grids;
the model face reduction module is used for carrying out polygon mesh removal processing on the first model by using a model face reduction algorithm to obtain a second model;
And the material conversion module is used for carrying out material conversion processing on the second model according to the material parameters of the offline rendering engine and the material parameters of the real-time rendering engine to obtain a real-time rendering model.
12. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs,
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-10.
13. A computer readable medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-10.
CN202311458987.7A 2023-11-03 2023-11-03 Model conversion method and device Pending CN117333636A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311458987.7A CN117333636A (en) 2023-11-03 2023-11-03 Model conversion method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311458987.7A CN117333636A (en) 2023-11-03 2023-11-03 Model conversion method and device

Publications (1)

Publication Number Publication Date
CN117333636A true CN117333636A (en) 2024-01-02

Family

ID=89293272

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311458987.7A Pending CN117333636A (en) 2023-11-03 2023-11-03 Model conversion method and device

Country Status (1)

Country Link
CN (1) CN117333636A (en)

Similar Documents

Publication Publication Date Title
US9767598B2 (en) Smoothing and robust normal estimation for 3D point clouds
US11263356B2 (en) Scalable and precise fitting of NURBS surfaces to large-size mesh representations
Chen et al. Automatic sizing functions for unstructured surface mesh generation
CN109697748B (en) Model compression processing method, model mapping processing method, model compression processing device, and storage medium
WO2013123636A1 (en) Method and apparatus for mesh simplification
US9965893B2 (en) Curvature-driven normal interpolation for shading applications
WO2024067209A1 (en) Three-dimensional model unfolding method and apparatus, device, computer-readable storage medium, and computer program product
CN114373056A (en) Three-dimensional reconstruction method and device, terminal equipment and storage medium
JP2006053929A (en) Approach based on perception for planar shape morphing
Daniels et al. Semi‐regular quadrilateral‐only remeshing from simplified base domains
US20030206178A1 (en) Systems and methods for providing signal-specialized parametrization
EP4094231A1 (en) Mesh optimization for computer graphics
CN115546371A (en) Point cloud optimization method and system, electronic device and storage medium
CN114708374A (en) Virtual image generation method and device, electronic equipment and storage medium
Wei et al. Field‐aligned Quadrangulation for Image Vectorization
CN110502305B (en) Method and device for realizing dynamic interface and related equipment
CN117333636A (en) Model conversion method and device
CN115375847A (en) Material recovery method, three-dimensional model generation method and model training method
CN112509108B (en) GPU-based vertex ambient light shielding generation method and image rendering method
CN114820908B (en) Virtual image generation method and device, electronic equipment and storage medium
CN116402975B (en) Method and device for loading and rendering three-dimensional model in WEB platform environment
CN116402984B (en) Three-dimensional model processing method and device and electronic equipment
EP4227904A2 (en) Method and apparatus for determining image depth information, electronic device, and media
Zhang et al. An improved method for progressive animation models generation
CN117058282A (en) Expression model generation method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination