CN110689603B - Conversion method, device and system of PBR real-time rendering material and rendering method - Google Patents

Conversion method, device and system of PBR real-time rendering material and rendering method Download PDF

Info

Publication number
CN110689603B
CN110689603B CN201910796552.0A CN201910796552A CN110689603B CN 110689603 B CN110689603 B CN 110689603B CN 201910796552 A CN201910796552 A CN 201910796552A CN 110689603 B CN110689603 B CN 110689603B
Authority
CN
China
Prior art keywords
rendering
real
rendering material
pbr
offline
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910796552.0A
Other languages
Chinese (zh)
Other versions
CN110689603A (en
Inventor
黄俊荣
郑家祥
唐睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Qunhe Information Technology Co Ltd
Original Assignee
Hangzhou Qunhe Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Qunhe Information Technology Co Ltd filed Critical Hangzhou Qunhe Information Technology Co Ltd
Priority to CN201910796552.0A priority Critical patent/CN110689603B/en
Publication of CN110689603A publication Critical patent/CN110689603A/en
Priority to PCT/CN2020/094761 priority patent/WO2021036395A1/en
Application granted granted Critical
Publication of CN110689603B publication Critical patent/CN110689603B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering

Abstract

The invention discloses a conversion method, a conversion device and a replacement system for PBR real-time rendering materials, which comprise the following steps: constructing a first rendering material conversion relation according to the corresponding relation between the off-line rendering material parameter channel and the PBR real-time rendering material parameter channel, or/and constructing a second rendering material conversion relation according to the similarity between the off-line rendering graph and the PBR real-time rendering graph; performing offline rendering material analysis on the offline rendering material system file to obtain offline rendering material parameters; and converting the offline rendering material parameters into PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation. The disclosure is a real-time rendering method. According to the established first rendering material conversion relation and/or the established second rendering material conversion relation, the offline rendering material can be converted into the PBR real-time rendering material, so that the real-time rendering effect is closer to the offline rendering result.

Description

Conversion method, device and system of PBR real-time rendering material and rendering method
Technical Field
The invention belongs to the field of graphic rendering, and particularly relates to a conversion method of PBR real-time rendering materials, a conversion device of the PBR real-time rendering materials, a conversion system of the PBR real-time rendering materials and a rendering method.
Background
Over the last thirty years. 3D computer graphics has been rapidly developed, and particularly, in recent years, real-time graphics, which is an important branch of graphics, is rapidly developed under the push of GPU semiconductor process and various 3D applications. Therefore, real-time Rendering technology is widely used, wherein a Physical Based Rendering (PBR) is a real-time Rendering method widely used in recent years, and a material system corresponding to the PBR is called a PBR material system, and the PBR material system includes parameters such as basecolor, metallic, roughnesss, and specula.
In practical situations, designers mainly use a modeling tool such as 3d max at present, and use a VRay rendering engine to create a VrayMtl material, where the VrayMtl material belongs to an offline rendering material, the principle of the offline rendering is different from that of the real-time rendering, and the material system adopted is also different, for example, the VrayMtl material uses parameters such as vector, reflect, repeat, and gloss, and the rendering parameters used by the PBR metallic/rough workflow, which are widely accepted in the industry, are parameters such as color, rough, metallic, and specula, so the offline rendering material cannot directly correspond to the material parameters used in the real-time rendering.
In order to implement real-time rendering by using an offline rendering material, the existing scheme includes:
(1) Some fields in the offline rendering material parameters are directly multiplexed to some fields which can reflect the material characteristics most in real-time rendering, so that the expression form of the material in the offline rendering is expressed in a rough effect.
(2) The method for rendering the image has the problems that the operation is complex, a large amount of manual operation is needed, and the obtained rendering result can not completely correspond to the offline rendering result in effect.
(3) And (3) using a baking method to bake the illumination information received by the object to a fixed position in advance, thereby skipping the limitation of material parameters required by real-time rendering, directly pre-calculating the final result, storing the pre-calculated result on a baking chartlet, and finally directly reading required data from the baking chartlet for displaying when the display is rendered in real time. The baking method has the defects that the use cost is high, the time is consumed, the generated baking map is limited by the illumination condition of a scene and the position of an object, once the position, the direction or the intensity of the light of the scene, the position of the object moves or rotates, or the material property changes, the baking map loses the physical and real significance, and the rendering result with the physical significance can be shown by baking again.
Disclosure of Invention
The invention aims to provide a PBR real-time rendering material conversion method, which comprises the following steps:
constructing a first rendering material conversion relation according to the corresponding relation between the off-line rendering material parameter channel and the PBR real-time rendering material parameter channel, or/and constructing a second rendering material conversion relation according to the similarity between the off-line rendering graph and the PBR real-time rendering graph;
performing offline rendering material analysis on the offline rendering material system file to obtain offline rendering material parameters;
and converting the offline rendering material parameters into PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
According to the conversion method of the PBR real-time rendering material, the offline rendering material can be converted into the PBR real-time rendering material according to the established first rendering material conversion relation and/or the established second rendering material conversion relation, so that the real-time rendering effect is closer to the offline rendering result.
Another object of the present invention is to provide a device for converting PBR real-time rendering material, comprising:
the material conversion relation construction module is used for constructing a first rendering material conversion relation according to the corresponding relation between the offline rendering material parameter channel and the PBR real-time rendering material parameter channel; the system is also used for constructing a second rendering material conversion relation according to the similarity of the offline rendering graph and the PBR real-time rendering graph;
the off-line rendering material parameter acquisition module is used for carrying out off-line rendering material analysis on the off-line rendering material system file to obtain off-line rendering material parameters;
and the conversion module is used for converting the offline rendering material parameters into the PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
The conversion device for the PBR real-time rendering material can convert the offline rendering material into the PBR real-time rendering material according to the established first rendering material conversion relation and/or the established second rendering material conversion relation so as to ensure that the real-time rendering effect is closer to the offline rendering result.
It is a further object of the present invention to provide a conversion system for PBR real-time rendering of textures comprising a computer memory, a computer processor and a computer program stored in the computer memory and executable on the computer processor,
the computer memory is stored with a first rendering material conversion relation or/and a second rendering material conversion relation which are constructed by the conversion method;
the computer processor, when executing the computer program, performs the steps of:
performing offline rendering material analysis on the offline rendering material system file to obtain offline rendering material parameters;
and converting the offline rendering material parameters into PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
The conversion system for the PBR real-time rendering material can convert the offline rendering material into the PBR real-time rendering material according to the stored first rendering material conversion relation and/or the stored second rendering material conversion relation so as to ensure that the real-time rendering effect is closer to the offline rendering result.
The present invention further provides a real-time rendering method, which performs real-time rendering by using the PBR real-time rendering material parameter obtained by the above conversion method, conversion apparatus or conversion system.
According to the real-time rendering method, the off-line rendering material is converted into the PBR real-time rendering material, so that the real-time rendering effect is closer to the off-line rendering result, namely the real-time rendering effect is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart illustrating an embodiment of a method for converting PBR real-time rendering textures provided in the present invention;
FIG. 2 is a schematic diagram of tiling of one embodiment of offline rendering parameter data;
FIG. 3 is a corresponding result of finding the closest metallic value after matching the offline rendering parameter data with the PBR real-time rendering parameters;
FIG. 4 is a schematic diagram of a fitted surface obtained by fitting according to the corresponding result of FIG. 3;
FIG. 5 is a schematic diagram of a fitted surface obtained by fitting offline rendering parameters to PBR real-time rendering parameters;
FIG. 6 is a block diagram of an embodiment of a PBR real-time rendering texture conversion apparatus provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the detailed description and specific examples, while indicating the scope of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
The material data (PBR material system) required by real-time rendering is greatly different from the material data of off-line rendering, and in order to make the real-time rendering effect and the off-line rendering result closer, the invention provides a set of conversion method, conversion device, changing system and real-time rendering method from off-line rendering material parameters to real-time rendering material parameters.
As shown in fig. 1, an embodiment of the method for converting a PBR real-time rendering material provided by the present invention includes the following steps:
s101, constructing a first rendering material conversion relation according to the corresponding relation between the offline rendering material parameter channel and the PBR real-time rendering material parameter channel, or/and constructing a second rendering material conversion relation according to the similarity between the offline rendering graph and the PBR real-time rendering graph.
When the rendering material conversion relation is constructed, the output result of the offline rendering engine is used as a distinguishing object, and the first rendering material conversion relation and the second rendering material conversion relation are constructed respectively.
In one case, the output result of the offline rendering engine is a rendering material parameter channel result (Render Elements), such as a result of a difference channel and a specific channel, and at this time, if the rendering material parameter channel can completely correspond to the PBR real-time rendering material parameter channel, the offline rendering result and the PBR real-time rendering result must be completely matched, that is, the rendering effect is the same, so that the first rendering material conversion relationship can be established according to the corresponding relationship between the offline rendering material parameter channel and the PBR real-time rendering material parameter channel.
Specifically, the step of constructing the first rendering material conversion relationship according to the corresponding relationship between the offline rendering material parameter channel and the PBR real-time rendering material parameter channel includes:
when the output result of the offline rendering engine comprises a rendering material parameter channel, sampling rendering points in an offline rendering material parameter space to generate an offline rendering material parameter channel result; traversing rendering points on a PBR real-time rendering material parameter space under the same rendering camera parameter setting condition to generate a PBR real-time rendering material parameter channel result;
selecting PBR real-time rendering material parameters completely corresponding to the offline rendering material parameter channel as corresponding results according to the offline rendering material parameter channel result and the PBR real-time rendering material parameter channel result, and constructing a first corresponding relation data set;
and fitting a conversion formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the first corresponding relation data set, and taking the conversion formula as a first rendering material conversion relation.
When the first rendering material conversion relation is fitted, 2 offline rendering material parameters are used as independent variables, 1 PBR real-time rendering material parameter is used as a dependent variable, a ternary equation is adopted for fitting, and a conic equation can be fitted.
Fig. 5 is a fitting surface obtained by fitting the parameters reflect, difference and Metallic on the basis of constructing a corresponding relation data set of the offline rendering material parameters reflect, difference and the PBR real-time rendering material parameter Metallic, where a fitting formula corresponding to the fitting surface is a conversion formula from the parameters reflect, difference to the parameter Metallic.
In another case, some of the offline rendering engines do not support the output of the rendering material parameter channel, that is, only the final offline rendering graph can be generated and output, and at this time, the second rendering material conversion relationship can be constructed only by directly comparing the similarities between the offline rendering graph and the PBR real-time rendering graph.
Specifically, the constructing of the second rendering material conversion relation according to the similarity between the offline rendering graph and the PBR real-time rendering graph includes:
when the output result of the offline rendering engine is an offline rendering graph, similarity matching is carried out on the offline rendering graph and the PBR real-time rendering graph by adopting an SSIM algorithm, and a PBR real-time rendering material parameter combination which is closest to an offline rendering material system is searched, so that a second corresponding relation data set is constructed;
and fitting a conversion formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the second corresponding relation data set, and taking the conversion formula as a second rendering material conversion relation.
When a second corresponding relation data set is constructed, firstly, under the condition of determining environmental illumination and camera parameters, an offline rendering engine is adopted to render a graph as a ground route (which is understood as a correct mark); then, in the PBR real-time rendering, the same ambient light and camera parameters are used, and the PBR real-time rendering material parameters are combined for real-time rendering, so that a large number of real-time rendering graphs are generated; and finally, searching a real-time rendering graph with the minimum SSIM difference with the ground route in the real-time rendering graph by adopting an SSIM algorithm to serve as a target rendering graph, and taking the PBR real-time rendering material parameter combination corresponding to the target rendering graph as the PBR real-time rendering material parameter combination closest to the offline rendering material system. The closest PBR real-time rendering material parameter combination and the offline rendering material system form a second corresponding relation data set.
The offline rendering graph and the PBR real-time rendering graph may be two-dimensional graphs obtained by rendering. When the second rendering material conversion relation is fitted, 2 offline rendering material parameters are used as independent variables, 1 PBR real-time rendering material parameter is used as a dependent variable, a ternary equation is adopted for fitting, and a conic equation can be fitted.
For example, fig. 2 shows the offline rendering parameter data, in which the horizontal arrangement is a refresh gray value and the vertical arrangement is a dispersion gray value, and fig. 3 shows the corresponding result of finding the nearest metallic value after the offline rendering parameter data is matched with the PBR real-time rendering parameter. Fitting the reflex gray value, the dispersion gray value and the metallic value by adopting a ternary equation, wherein the fitting curve is a conical curve as shown in FIG. 4, and the conversion formula under the condition of obtaining the gray value by fitting is as follows:
Figure BDA0002181113280000071
s102, performing offline rendering material analysis on the offline rendering material system file to obtain important offline rendering material parameters.
And obtaining the basis of the rendering material conversion after obtaining the first rendering material conversion relation and the second rendering material conversion relation. When the method is applied, the conversion of the PBR real-time rendering material can be carried out according to the conversion relation of the two rendering materials.
When the method is applied, in order to realize normalization of input parameters, offline rendering material analysis needs to be performed on an offline rendering material system file, and the obtained important offline rendering material parameters are diffuse (diffuse reflection color), reflection (refraction color), gloss (surface gloss) and the like.
Specifically, off-line rendering material analysis is performed on the off-line rendering material system file, and obtaining important off-line rendering material parameters includes:
and after the offline rendering material system file is directly analyzed, preprocessing the image level of the offline rendering material parameters obtained by analysis so as to standardize the offline rendering material parameters and obtain important offline rendering material parameters.
For example, a material parameter system VRayMtl used by the VRay offline rendering engine may be used as an input of the offline rendering material parameters, and during parsing, several important offline rendering material parameters are extracted from the vracmtl-containing material parameter system vrrcene file.
When the vrscene file is analyzed to extract the offline rendering material parameters, considering that the configuration of the material parameters is complex, for example, a difference is usually constructed by difference Color and difference Texture weighting, and therefore, the data needs to be preprocessed on an image level to generate normalized material parameters difference, reflection, refresh, fresh ior, gloss, and the like.
Specifically, the image-level preprocessing includes: for the material parameter to be processed, the material parameter is multiplied by the corresponding multiple, and the result after the pretreatment can be obtained. Taking the reflex as an example, assuming that a material has a reflex map, the reflex color value of the material is (0.5,0.5,0.5) which respectively corresponds to three RGB channel values, and the multiplier is 0.37, and on each pixel, the RGB value of the reflex map is multiplied by the multiplier (i.e., 0.37), and then the RGB value of the reflex color is multiplied by (1-multiplier) (i.e., 0.63) to serve as the value of the pixel of the reflex map of the preprocessing result.
All the normalized material parameters obtained finally are presented in the form of a map or a numerical type.
In another embodiment, the text containing the offline rendering material parameters is too complex to be analyzed by the underlying algorithm, and another way to obtain important offline rendering material parameters is required. Namely, the conversion method further comprises:
and when the important offline rendering material parameters cannot be obtained from the offline rendering material system file analysis, directly using an offline rendering engine to generate and output the important offline rendering material parameters.
For the VRay rendering engine, the VRay rendering engine may be utilized to directly output important offline rendering material parameters, such as dispersion, reflection, refrac, gloss, and fresnelIor.
S103, converting the offline rendering material parameters into PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
According to the real-time rendering material conversion method, the off-line rendering material can be converted into the PBR real-time rendering material according to the established first rendering material conversion relation and/or the established second rendering material conversion relation, so that the real-time rendering effect is closer to the off-line rendering result.
As shown in fig. 6, the apparatus for converting PBR real-time rendering material provided by the present invention includes:
a material conversion relation establishing module 601, configured to establish a first rendering material conversion relation according to a correspondence between the offline rendering material parameter channel and the PBR real-time rendering material parameter channel; the system is also used for constructing a second rendering material conversion relation according to the similarity of the offline rendering graph and the PBR real-time rendering graph;
an offline rendering material parameter obtaining module 602, configured to perform offline rendering material analysis on the offline rendering material system file to obtain an offline rendering material parameter;
the conversion module 603 is configured to convert the offline rendering material parameter into the PBR real-time rendering material parameter according to the first rendering material conversion relationship or/and the second rendering material conversion relationship.
When the output result of the offline rendering engine includes a rendering material parameter channel, the material transformation relation building module 601 includes:
a first corresponding relation data set constructing module 6011, configured to sample rendering points in an offline rendering material parameter space, and generate an offline rendering material parameter channel result; traversing rendering points on a PBR real-time rendering material parameter space under the same rendering camera parameter setting condition to generate a PBR real-time rendering material parameter channel result; selecting PBR real-time rendering material parameters completely corresponding to the offline rendering material parameter channel as corresponding results according to the offline rendering material parameter channel result and the PBR real-time rendering material parameter channel result, and constructing a first corresponding relation data set;
a first rendering material conversion relation establishing module 6012, configured to fit a conversion formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the first corresponding relation data set, and use the conversion formula as the first rendering material conversion relation.
In the first rendering material conversion relationship building module 6012, the 2 offline rendering material parameters may be used as independent variables, the 1 PBR real-time rendering material parameters may be used as dependent variables, and a ternary equation may be used for fitting to form a conic equation.
When the result output by the offline rendering engine is an offline rendering graph, the material transformation relationship building module 601 includes:
a second corresponding relation data set constructing module 6013, configured to perform similarity matching on the offline rendering map and the PBR real-time rendering map by using an SSIM algorithm, and search for a PBR real-time rendering material parameter combination closest to the offline rendering material system, so as to construct a second corresponding relation data set;
a second rendering material transformation relation constructing module 6014, configured to fit a transformation formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the second corresponding relation data set, and use the transformation formula as the second rendering material transformation relation.
In the second rendering material conversion relationship building module 6014, the 2 offline rendering material parameters may be used as independent variables, the 1 PBR real-time rendering material parameters may be used as dependent variables, and a ternary equation may be used for fitting to form a conic equation.
The process of implementing material conversion in the PBR real-time rendering material conversion apparatus is the same as the above conversion method, and is not described again.
The conversion device for the PBR real-time rendering material can convert the offline rendering material into the PBR real-time rendering material according to the established first rendering material conversion relation and/or the established second rendering material conversion relation so as to ensure that the real-time rendering effect is closer to the offline rendering result.
In another embodiment, there is provided a conversion system for PBR real-time rendering of textures, comprising a computer memory, a computer processor, and a computer program stored in the computer memory and executable on the computer processor,
the computer memory is stored with a first rendering material conversion relation or/and a second rendering material conversion relation constructed by the conversion method;
the computer processor when executing the computer program implements the steps of:
performing offline rendering material analysis on the offline rendering material system file to obtain offline rendering material parameters;
and converting the offline rendering material parameters into PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
In practical application, the conversion method is utilized to construct a first rendering material conversion relation or/and a second rendering material conversion relation, and the first rendering material conversion relation and/or the second rendering material conversion relation are/is stored in a computer memory, so that when the conversion method is applied, a computer processor directly calls the first rendering material conversion relation and/or the second rendering material conversion relation which are/is stored in advance to perform conversion from an offline rendering material to a PBR real-time rendering material, and the conversion speed can be improved.
In practical applications, the computer memory may be volatile memory at the near end, such as RAM, or volatile memory, such as ROM, FLASH, floppy disk, mechanical hard disk, etc., or may be a remote storage cloud. The computer processor may be a Central Processing Unit (CPU), a microprocessor unit (MPU), a Digital Signal Processor (DSP), or a Field Programmable Gate Array (FPGA), that is, the steps of obtaining the offline rendering material parameters and converting the offline rendering material parameters into the PBR real-time rendering material parameters may be implemented by these processors.
In the PBR real-time rendering material conversion system, the steps of constructing the first rendering material conversion relationship or/and the second rendering material conversion relationship are the same as those of the conversion method, and are not repeated here. In addition, the steps of obtaining the offline rendering material parameters and converting the offline rendering material parameters into the PBR real-time rendering material parameters, which are executed by the computer processor, are also the same as the steps of the above conversion method, and are not described herein again.
Certainly, the above-mentioned computer program executable on the computer processor implements offline rendering material analysis on the offline rendering material system file to obtain offline rendering material parameters; computer instructions for converting the offline rendering material parameters to PBR real-time rendering material parameters according to the first rendering material conversion relationship or/and the second rendering material conversion relationship may also be stored in a readable medium, such as disk storage and optical storage.
According to the conversion system for the PBR real-time rendering material, the off-line rendering material can be converted into the PBR real-time rendering material according to the stored first rendering material conversion relation and/or the stored second rendering material conversion relation, so that the real-time rendering effect is closer to the off-line rendering result.
In another embodiment, a real-time rendering method is provided, and the PBR real-time rendering material parameters obtained by the conversion method, the conversion device, and the conversion system are used for real-time rendering.
According to the real-time rendering method, the offline rendering material is converted into the PBR real-time rendering material, so that the real-time rendering effect is closer to the offline rendering result, namely, the real-time rendering effect is improved.
The above-mentioned embodiments are intended to illustrate the technical solutions and advantages of the present invention, and it should be understood that the above-mentioned embodiments are only the most preferred embodiments of the present invention, and are not intended to limit the present invention, and any modifications, additions, equivalents, etc. made within the scope of the principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A conversion method of PBR real-time rendering material comprises the following steps:
constructing a first rendering material conversion relation according to the corresponding relation between the off-line rendering material parameter channel and the PBR real-time rendering material parameter channel, or/and constructing a second rendering material conversion relation according to the similarity between the off-line rendering graph and the PBR real-time rendering graph;
performing offline rendering material analysis on the offline rendering material system file to obtain offline rendering material parameters;
and converting the offline rendering material parameters into PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
2. The method for converting PBR real-time rendering materials according to claim 1, wherein the constructing a first rendering material conversion relationship according to a correspondence between the offline rendering material parameter channel and the PBR real-time rendering material parameter channel comprises:
when the output result of the offline rendering engine comprises a rendering material parameter channel, sampling rendering points in an offline rendering material parameter space to generate an offline rendering material parameter channel result; traversing rendering points on a PBR real-time rendering material parameter space under the same rendering camera parameter setting condition to generate a PBR real-time rendering material parameter channel result;
selecting PBR real-time rendering material parameters completely corresponding to the offline rendering material parameter channel as corresponding results according to the offline rendering material parameter channel result and the PBR real-time rendering material parameter channel result, and constructing a first corresponding relation data set;
and fitting a conversion formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the first corresponding relation data set, and taking the conversion formula as a first rendering material conversion relation.
3. The method for converting the PBR real-time rendering material according to claim 1, wherein the constructing the second rendering material conversion relation according to the similarity between the offline rendering graph and the PBR real-time rendering graph comprises:
when the output result of the offline rendering engine is an offline rendering graph, similarity matching is carried out on the offline rendering graph and the PBR real-time rendering graph by adopting an SSIM algorithm, and a PBR real-time rendering material parameter combination which is closest to an offline rendering material system is searched for so as to construct a second corresponding relation data set;
and fitting a conversion formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the second corresponding relation data set, and taking the conversion formula as a second rendering material conversion relation.
4. The method of claim 2 or 3, wherein when fitting the first rendering material transformation relation or the second rendering material transformation relation, fitting is performed by using a ternary equation with 2 offline rendering material parameters as independent variables and 1 PBR real-time rendering material parameter as dependent variables.
5. The method for converting PBR real-time rendering material of claim 1, wherein the method further comprises:
and when the offline rendering material parameters cannot be obtained from the offline rendering material system file analysis, directly using an offline rendering engine to generate and output the offline rendering material parameters.
6. A device for converting PBR real-time rendering material is characterized by comprising:
the material conversion relation construction module is used for constructing a first rendering material conversion relation according to the corresponding relation between the offline rendering material parameter channel and the PBR real-time rendering material parameter channel; the system is also used for constructing a second rendering material conversion relation according to the similarity of the offline rendering graph and the PBR real-time rendering graph;
the off-line rendering material parameter acquisition module is used for carrying out off-line rendering material analysis on the off-line rendering material system file to obtain off-line rendering material parameters;
and the conversion module is used for converting the offline rendering material parameters into the PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
7. The apparatus for converting a material for PBR real-time rendering according to claim 6, wherein the material conversion relation constructing module comprises:
the first corresponding relation data set construction module is used for sampling rendering points in an offline rendering material parameter space and generating an offline rendering material parameter channel result; traversing rendering points on a PBR real-time rendering material parameter space under the same rendering camera parameter setting condition to generate a PBR real-time rendering material parameter channel result; selecting PBR real-time rendering material parameters completely corresponding to the offline rendering material parameter channel as corresponding results according to the offline rendering material parameter channel result and the PBR real-time rendering material parameter channel result, and constructing a first corresponding relation data set;
and the first rendering material conversion relation building module is used for fitting a conversion formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the first corresponding relation data set, and taking the conversion formula as the first rendering material conversion relation.
8. The apparatus for converting a material for PBR real-time rendering according to claim 6, wherein the material conversion relation constructing module comprises:
the second corresponding relation data set construction module is used for matching the similarity of the offline rendering map and the PBR real-time rendering map by adopting an SSIM algorithm, searching the PBR real-time rendering material parameter combination which is most similar to the offline rendering material system, and constructing a second corresponding relation data set;
and the second rendering material conversion relation building module is used for fitting a conversion formula from the offline rendering material parameters to the PBR real-time rendering material parameters according to the second corresponding relation data set, and taking the conversion formula as a second rendering material conversion relation.
9. A conversion system for PBR real-time rendering of textures comprising a computer memory, a computer processor, and a computer program stored in the computer memory and executable on the computer processor,
the computer memory is stored with a first rendering material conversion relation or/and a second rendering material conversion relation which is constructed by the conversion method of any one of claims 1 to 5;
the computer processor, when executing the computer program, performs the steps of:
performing offline rendering material analysis on the offline rendering material system file to obtain offline rendering material parameters;
and converting the offline rendering material parameters into the PBR real-time rendering material parameters according to the first rendering material conversion relation or/and the second rendering material conversion relation.
10. A real-time rendering method, characterized in that the real-time rendering is performed by using the PBR real-time rendering material parameters obtained by the conversion method of any one of claims 1 to 5, the conversion apparatus of any one of claims 6 to 8, or the conversion system of claim 9.
CN201910796552.0A 2019-08-27 2019-08-27 Conversion method, device and system of PBR real-time rendering material and rendering method Active CN110689603B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910796552.0A CN110689603B (en) 2019-08-27 2019-08-27 Conversion method, device and system of PBR real-time rendering material and rendering method
PCT/CN2020/094761 WO2021036395A1 (en) 2019-08-27 2020-06-05 Pbr real-time rendering material conversion method, device, and system, and rendering method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910796552.0A CN110689603B (en) 2019-08-27 2019-08-27 Conversion method, device and system of PBR real-time rendering material and rendering method

Publications (2)

Publication Number Publication Date
CN110689603A CN110689603A (en) 2020-01-14
CN110689603B true CN110689603B (en) 2023-03-17

Family

ID=69108519

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910796552.0A Active CN110689603B (en) 2019-08-27 2019-08-27 Conversion method, device and system of PBR real-time rendering material and rendering method

Country Status (2)

Country Link
CN (1) CN110689603B (en)
WO (1) WO2021036395A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110689603B (en) * 2019-08-27 2023-03-17 杭州群核信息技术有限公司 Conversion method, device and system of PBR real-time rendering material and rendering method
CN111275802B (en) * 2020-01-19 2023-04-21 杭州群核信息技术有限公司 PBR material rendering method and system based on VRAY
CN111583378B (en) * 2020-06-11 2023-11-17 网易(杭州)网络有限公司 Virtual asset processing method and device, electronic equipment and storage medium
CN112733461B (en) * 2021-01-21 2021-07-27 广东工业大学 Digital twin driven real-time rendering method, system and computer readable medium
CN113144611A (en) * 2021-03-16 2021-07-23 网易(杭州)网络有限公司 Scene rendering method and device, computer storage medium and electronic equipment
CN113626902B (en) * 2021-08-18 2024-02-20 杭州群核信息技术有限公司 Material modeling system based on PBR material

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB201621280D0 (en) * 2016-12-14 2017-01-25 Samsung Electronics Co Ltd Mipmap rendering
CN107330962A (en) * 2017-06-19 2017-11-07 杭州群核信息技术有限公司 A kind of scene generating method and device
CN109377543A (en) * 2018-10-29 2019-02-22 广东明星创意动画有限公司 A kind of method of quick creation material connection
CN110152291A (en) * 2018-12-13 2019-08-23 腾讯科技(深圳)有限公司 Rendering method, device, terminal and the storage medium of game picture

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106547744B (en) * 2015-09-16 2020-11-06 杭州海康威视数字技术股份有限公司 Image retrieval method and system
CN106067185A (en) * 2016-05-27 2016-11-02 美屋三六五(天津)科技有限公司 A kind of threedimensional model processing method and processing device
CN106067184A (en) * 2016-05-27 2016-11-02 美屋三六五(天津)科技有限公司 A kind of threedimensional model processing method and processing device
CN106447725B (en) * 2016-06-29 2018-02-09 北京航空航天大学 Spatial target posture method of estimation based on the matching of profile point composite character
CN108335367B (en) * 2018-02-06 2021-09-28 杭州群核信息技术有限公司 Three-dimensional model processing method for terminal display
CN110689603B (en) * 2019-08-27 2023-03-17 杭州群核信息技术有限公司 Conversion method, device and system of PBR real-time rendering material and rendering method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB201621280D0 (en) * 2016-12-14 2017-01-25 Samsung Electronics Co Ltd Mipmap rendering
CN107330962A (en) * 2017-06-19 2017-11-07 杭州群核信息技术有限公司 A kind of scene generating method and device
CN109377543A (en) * 2018-10-29 2019-02-22 广东明星创意动画有限公司 A kind of method of quick creation material connection
CN110152291A (en) * 2018-12-13 2019-08-23 腾讯科技(深圳)有限公司 Rendering method, device, terminal and the storage medium of game picture

Also Published As

Publication number Publication date
WO2021036395A1 (en) 2021-03-04
CN110689603A (en) 2020-01-14

Similar Documents

Publication Publication Date Title
CN110689603B (en) Conversion method, device and system of PBR real-time rendering material and rendering method
US9990706B2 (en) Global contrast correction
RU2680765C1 (en) Automated determination and cutting of non-singular contour of a picture on an image
JP7292979B2 (en) Image processing device and image processing method
CN109345601B (en) Pathological image color standardization method based on low-rank embedding non-negative matrix decomposition
Yoo et al. Local color transfer between images using dominant colors
CN112634125B (en) Automatic face replacement method based on off-line face database
CN114719966A (en) Light source determination method and device, electronic equipment and storage medium
Mahmoudabadi et al. Efficient terrestrial laser scan segmentation exploiting data structure
KR101981284B1 (en) Apparatus Processing Image and Method thereof
CN110390724B (en) SLAM method with instance segmentation
CN113807364A (en) Power equipment defect detection method and system based on three-light fusion imaging
Salih et al. Adaptive local exposure based region determination for non-uniform illumination and low contrast images
Si et al. A novel method for single nighttime image haze removal based on gray space
CN111985471A (en) License plate positioning method and device and storage medium
US11430130B2 (en) Image processing method and computer-readable recording medium having recorded thereon image processing program
US9672299B2 (en) Visualization credibility score
CN110675463A (en) Local color pencil drawing generation method and device
CN113284158B (en) Image edge extraction method and system based on structural constraint clustering
Sapkota Segmentation of coloured point cloud data
Liu et al. Multispectral LiDAR point cloud highlight removal based on color information
CN112232125A (en) Key point detection method and key point detection model training method
Zheng et al. An improved NAMLab image segmentation algorithm based on the earth moving distance and the CIEDE2000 color difference formula
Motayyeb et al. Enhancing contrast of images to improve geometric accuracy of a UAV photogrammetry project
JP2014067129A (en) Program, device and method for color conversion processing with consideration for relationship between feature quantity and color distribution for every scale

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant