CN116824089A - Image generation method based on 3D rendering engine - Google Patents
Image generation method based on 3D rendering engine Download PDFInfo
- Publication number
- CN116824089A CN116824089A CN202310895455.3A CN202310895455A CN116824089A CN 116824089 A CN116824089 A CN 116824089A CN 202310895455 A CN202310895455 A CN 202310895455A CN 116824089 A CN116824089 A CN 116824089A
- Authority
- CN
- China
- Prior art keywords
- rendering engine
- information
- graphic
- image generation
- rendering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 67
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 34
- 238000005286 illumination Methods 0.000 claims abstract description 8
- 239000000463 material Substances 0.000 claims abstract description 8
- 239000000284 extract Substances 0.000 claims abstract description 5
- 238000004891 communication Methods 0.000 claims description 10
- 230000004927 fusion Effects 0.000 claims description 10
- 238000013507 mapping Methods 0.000 claims description 9
- 238000000605 extraction Methods 0.000 claims description 5
- 230000010365 information processing Effects 0.000 claims description 4
- 238000003672 processing method Methods 0.000 claims description 4
- 238000010276 construction Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 239000008186 active pharmaceutical agent Substances 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
- G06V10/806—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of extracted features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Computer Graphics (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- Image Generation (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses an image generation method based on a 3D rendering engine, which comprises the following steps: the method comprises the steps of obtaining graphic information through an obtaining module; step two: processing the acquired graphic information through a processing module; step three: generating 3D graphics data by a 3D rendering engine; the beneficial effects of the invention are as follows: after the graphics are processed, the generated images are more accurate, and the user experience is improved; the 3D rendering engine extracts triangle structures, materials and illumination information of the 3D model from the graph by utilizing a reverse pipeline rendering principle, modeling is carried out through triangle grids, the more the number of triangle faces is, the finer the model is, and the more natural the curved surface is formed; the scheduler determines a corresponding scheduling queue according to the received graphic information instruction, calls the corresponding scheduling queue to send the graphic information instruction to the processing module, and sends the graphic information processed by the processing module to the 3D rendering engine, so that the efficiency of image generation is further improved.
Description
Technical Field
The invention belongs to the technical field of image generation, and particularly relates to an image generation method based on a 3D rendering engine.
Background
3D rendering refers to a process of generating a 2D image from a digital 3D scene using a computer; the method is very popular in daily life, from building design and indoor design to preview of large-sized action movies, automobile advertisements or product designs, a communication bridge is constructed between a brand party and a user, and user experience is effectively improved; although 3D visualization has become ubiquitous, the rendering techniques behind it are extremely complex, involving knowledge in mathematics, physics, and computers.
With the development of digital technology, the demand for real-time interactive rendering creation of 3D is increased, and a rendering engine is developed through continuous technology to provide high-speed, stable and immersive 3D virtual scene optimization, including images, special effects, animations and sound effects.
An image generation method and device based on a 3D rendering engine with the publication number of CN109064537A, wherein the patent discloses that a client acquires a 2D custom graph drawn by a user and graph information; the client sends the 2D custom graphics and the graphics information to a 3D rendering engine; the client acquires 3D graphic data fed back by the 3D rendering engine based on the 2D custom graphic and the graphic information; the client generates an image based on the 3D graphics data.
The existing image based on the 3D rendering engine is inaccurate in image generation and is unfavorable for improving user experience.
Disclosure of Invention
The invention aims to provide an image generation method based on a 3D rendering engine, which further improves the accuracy of generated images.
In order to achieve the above purpose, the present invention provides the following technical solutions: an image generation method based on a 3D rendering engine comprises the following steps of
The acquisition module is used for acquiring the graphic information;
the processing module is in communication connection with the acquisition module and is used for processing the acquired graphic information;
the 3D rendering engine is in communication connection with the processing module and generates 3D graphic data through the 3D rendering engine;
the renderer is used for mapping the 3D graphic data from the feature space to the image space to obtain a final generated image;
the method comprises the following steps:
step one: the method comprises the steps of obtaining graphic information through an obtaining module;
step two: processing the acquired graphic information through a processing module;
step three: generating 3D graphics data by a 3D rendering engine;
step four: and mapping the 3D graphic data from the feature space to the image space by a renderer to obtain a final generated image.
As a preferable technical scheme of the invention, the graphic information processing method comprises the following steps: obtaining a first multi-angle graphic set of a user target area; obtaining a second multi-angle graph set of a user target area, and carrying out feature extraction on the first multi-angle graph set and the second multi-angle graph set according to a preset convolution feature set to obtain first target feature information and second target feature information; and carrying out feature fusion on the first target feature information and the second target feature information to obtain target feature fusion information.
As a preferable technical scheme of the invention, the collection areas of the graphics in the first multi-angle graphics set and the second multi-angle graphics set are different from each other.
As a preferred embodiment of the present invention, the renderer includes
Hardware renderer: for real-time rendering;
a software renderer: based on the construction of the bottom graphic API, rendering is performed by adopting a rasterization method suitable for a hardware architecture.
As a preferable technical scheme of the invention, the invention further comprises a display terminal, and the generated image is displayed by the display terminal.
As a preferable technical scheme of the invention, the display terminal comprises a mobile phone and a computer.
As a preferable technical scheme of the invention, the system further comprises a scheduler, wherein the scheduler determines a corresponding scheduling queue according to the received graphic information instruction, calls the corresponding scheduling queue to send the graphic information instruction to the processing module, and sends the graphic information processed by the processing module to the 3D rendering engine.
As a preferable technical scheme of the invention, the 3D rendering engine utilizes a reverse pipeline rendering principle to extract triangle structures, materials and illumination information of the 3D model from the graph.
Compared with the prior art, the invention has the beneficial effects that:
obtaining a first multi-angle graphic set of a user target area; obtaining a second multi-angle graph set of a user target area, wherein the acquisition areas of graphs in the first multi-angle graph set and the second multi-angle graph set are different from each other, and performing feature extraction on the first multi-angle graph set and the second multi-angle graph set according to a preset convolution feature set to obtain first target feature information and second target feature information; the first target feature information and the second target feature information are subjected to feature fusion to obtain target feature fusion information, and after the graphics are processed, the generated image is more accurate, so that the user experience is improved;
the 3D rendering engine extracts triangle structures, materials and illumination information of the 3D model from the graph by utilizing a reverse pipeline rendering principle, modeling is carried out through triangle grids, the more the number of triangle faces is, the finer the model is, and the more natural the curved surface is formed;
the scheduler determines a corresponding scheduling queue according to the received graphic information instruction, calls the corresponding scheduling queue to send the graphic information instruction to the processing module, and sends the graphic information processed by the processing module to the 3D rendering engine, so that the efficiency of image generation is further improved;
and the generated image is displayed through the display terminal, so that the user experience is further improved.
Drawings
FIG. 1 is a flow chart of a method of generating the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Referring to fig. 1, a first embodiment of the present invention provides an image generating method based on a 3D rendering engine, including
The acquisition module is used for acquiring the graphic information;
the processing module is in communication connection with the acquisition module and is used for processing the acquired graphic information;
the 3D rendering engine is in communication connection with the processing module and generates 3D graphic data through the 3D rendering engine;
the renderer is used for mapping the 3D graphic data from the feature space to the image space to obtain a final generated image;
the method comprises the following steps:
step one: the method comprises the steps of obtaining graphic information through an obtaining module;
step two: processing the acquired graphic information through a processing module;
step three: generating 3D graphics data by a 3D rendering engine;
step four: and mapping the 3D graphic data from the feature space to the image space by a renderer to obtain a final generated image.
In this embodiment, preferably, the graphic information processing method includes: obtaining a first multi-angle graphic set of a user target area; obtaining a second multi-angle graph set of a user target area, wherein the acquisition areas of graphs in the first multi-angle graph set and the second multi-angle graph set are different from each other, and performing feature extraction on the first multi-angle graph set and the second multi-angle graph set according to a preset convolution feature set to obtain first target feature information and second target feature information; and carrying out feature fusion on the first target feature information and the second target feature information to obtain target feature fusion information.
In this embodiment, preferably, the renderer includes a hardware renderer: for real-time rendering; a software renderer: based on the construction of the bottom graphic API, rendering is performed by adopting a rasterization method suitable for a hardware architecture.
In this embodiment, preferably, the display device further includes a display terminal, and the generated image is displayed by the display terminal; the display terminal is a mobile phone.
In this embodiment, preferably, the method further includes a scheduler, where the scheduler determines a corresponding scheduling queue according to the received graphics information instruction, invokes the corresponding scheduling queue to send the graphics information instruction to the processing module, and sends the graphics information processed by the processing module to the 3D rendering engine.
In this embodiment, preferably, the 3D rendering engine extracts triangle structures, materials and illumination information of the 3D model from the graphics by using a reverse pipeline rendering principle, and models the triangle structures, materials and illumination information by using triangle meshes, so that the more the number of triangle faces is, the finer the model is, and the more natural the curved surface is formed.
Example 2
Referring to fig. 1, a first embodiment of the present invention provides an image generating method based on a 3D rendering engine, including
The acquisition module is used for acquiring the graphic information;
the processing module is in communication connection with the acquisition module and is used for processing the acquired graphic information;
the 3D rendering engine is in communication connection with the processing module and generates 3D graphic data through the 3D rendering engine;
the renderer is used for mapping the 3D graphic data from the feature space to the image space to obtain a final generated image;
the method comprises the following steps:
step one: the method comprises the steps of obtaining graphic information through an obtaining module;
step two: processing the acquired graphic information through a processing module;
step three: generating 3D graphics data by a 3D rendering engine;
step four: and mapping the 3D graphic data from the feature space to the image space by a renderer to obtain a final generated image.
In this embodiment, preferably, the graphic information processing method includes: obtaining a first multi-angle graphic set of a user target area; obtaining a second multi-angle graph set of a user target area, wherein the acquisition areas of graphs in the first multi-angle graph set and the second multi-angle graph set are different from each other, and performing feature extraction on the first multi-angle graph set and the second multi-angle graph set according to a preset convolution feature set to obtain first target feature information and second target feature information; and carrying out feature fusion on the first target feature information and the second target feature information to obtain target feature fusion information.
In this embodiment, preferably, the renderer includes a hardware renderer and a software renderer; the software renderer is constructed based on a bottom graphic API, adopts a rasterization method suitable for a hardware architecture to render, the graphic API is responsible for communication with hardware, and common graphic APIs comprise DirectX and openGL; openGLAPI uses 3D hardware through openGL graphics library, most 3D cards support this approach; the DirectX API uses Microsoft DirectX library-merge into Windows operating system; on the old 3D card, openGL generally draws faster, while on the modern 3D card, directX performs more excellently; there are only one OpenGL version and many DirectX versions; directX expands functions by providing updated versions, while openGL expands functions by a generic expansion OpenGLExt; the software renderer performs calculation by purely utilizing the capability of the CPU, performs rendering by adopting a ray tracing method, has no unified application standard, but has a plurality of general rendering algorithms such as photon mapping, monte Carlo and radiance; the application fields of the hardware renderer and the software renderer are different: the hardware renderer is mainly used for real-time rendering, such as games and virtual reality; the software renderer is mainly used for off-line rendering, such as effect graph, video level and product level rendering, mainly because the hardware renderer has high speed but insufficient flexibility, and the software renderer has ideal speed but can use a very complex rendering algorithm to achieve the realism and effect of the photo level.
In this embodiment, preferably, the display device further includes a display terminal, and the generated image is displayed by the display terminal; the display terminal is a mobile phone and computer combination.
In this embodiment, preferably, the method further includes a scheduler, where the scheduler determines a corresponding scheduling queue according to the received graphics information instruction, invokes the corresponding scheduling queue to send the graphics information instruction to the processing module, and sends the graphics information processed by the processing module to the 3D rendering engine.
In this embodiment, preferably, the 3D rendering engine extracts triangle structures, materials and illumination information of the 3D model from the graphics by using a reverse pipeline rendering principle, and models the triangle structures, materials and illumination information by using triangle meshes, so that the more the number of triangle faces is, the finer the model is, and the more natural the curved surface is formed.
While embodiments of the present invention have been shown and described in detail with reference to the foregoing detailed description, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations may be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (8)
1. An image generation method based on a 3D rendering engine is characterized in that: comprising
The acquisition module is used for acquiring the graphic information;
the processing module is in communication connection with the acquisition module and is used for processing the acquired graphic information;
the 3D rendering engine is in communication connection with the processing module and generates 3D graphic data through the 3D rendering engine;
the renderer is used for mapping the 3D graphic data from the feature space to the image space to obtain a final generated image;
the method comprises the following steps:
step one: the method comprises the steps of obtaining graphic information through an obtaining module;
step two: processing the acquired graphic information through a processing module;
step three: generating 3D graphics data by a 3D rendering engine;
step four: and mapping the 3D graphic data from the feature space to the image space by a renderer to obtain a final generated image.
2. The 3D rendering engine based image generation method of claim 1, wherein: the graphic information processing method comprises the following steps: obtaining a first multi-angle graphic set of a user target area; obtaining a second multi-angle graph set of a user target area, and carrying out feature extraction on the first multi-angle graph set and the second multi-angle graph set according to a preset convolution feature set to obtain first target feature information and second target feature information; and carrying out feature fusion on the first target feature information and the second target feature information to obtain target feature fusion information.
3. The 3D rendering engine based image generation method of claim 2, wherein: the collection areas of the graphics in the first multi-angle graphics set and the second multi-angle graphics set are different from each other.
4. The 3D rendering engine based image generation method of claim 1, wherein: the renderer includes
Hardware renderer: for real-time rendering;
a software renderer: based on the construction of the bottom graphic API, rendering is performed by adopting a rasterization method suitable for a hardware architecture.
5. The 3D rendering engine based image generation method of claim 1, wherein: the display terminal is also included, and the generated image is displayed through the display terminal.
6. The 3D rendering engine based image generation method of claim 5, wherein: the display terminal comprises a mobile phone and a computer.
7. The 3D rendering engine based image generation method of claim 1, wherein: the system also comprises a scheduler, wherein the scheduler determines a corresponding scheduling queue according to the received graphic information instruction, calls the corresponding scheduling queue to send the graphic information instruction to the processing module, and sends the graphic information processed by the processing module to the 3D rendering engine.
8. The 3D rendering engine based image generation method of claim 1, wherein: the 3D rendering engine extracts triangle structures, materials and illumination information of the 3D model from the graph by utilizing a reverse pipeline rendering principle.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310895455.3A CN116824089A (en) | 2023-07-20 | 2023-07-20 | Image generation method based on 3D rendering engine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310895455.3A CN116824089A (en) | 2023-07-20 | 2023-07-20 | Image generation method based on 3D rendering engine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116824089A true CN116824089A (en) | 2023-09-29 |
Family
ID=88116731
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310895455.3A Pending CN116824089A (en) | 2023-07-20 | 2023-07-20 | Image generation method based on 3D rendering engine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116824089A (en) |
-
2023
- 2023-07-20 CN CN202310895455.3A patent/CN116824089A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9652880B2 (en) | 2D animation from a 3D mesh | |
| KR101145260B1 (en) | Apparatus and method for mapping textures to object model | |
| JP2006506744A (en) | Visible surface determination system and method for computer graphics using interval analysis | |
| EP3211601B1 (en) | Rendering the global illumination of a 3d scene | |
| Nadalutti et al. | Rendering of X3D content on mobile devices with OpenGL ES | |
| WO2022143367A1 (en) | Image rendering method and related device therefor | |
| EP3422709A1 (en) | Stereo rendering | |
| TW202141418A (en) | Methods and apparatus for handling occlusions in split rendering | |
| WO2018140223A1 (en) | Stereo rendering | |
| CN114742931A (en) | Method and device for rendering image, electronic equipment and storage medium | |
| US20240177394A1 (en) | Motion vector optimization for multiple refractive and reflective interfaces | |
| CN115965735B (en) | Texture map generation method and device | |
| US10754498B2 (en) | Hybrid image rendering system | |
| Döllner | Geovisualization and real-time 3D computer graphics | |
| CN116824089A (en) | Image generation method based on 3D rendering engine | |
| Mortensen et al. | Real-time global illumination for vr applications | |
| US20230206567A1 (en) | Geometry-aware augmented reality effects with real-time depth map | |
| CN111652807B (en) | Eye adjusting and live broadcasting method and device, electronic equipment and storage medium | |
| CN115311395A (en) | Three-dimensional scene rendering method, device and equipment | |
| CN117671110B (en) | Real-time rendering system and method based on artificial intelligence | |
| Chen et al. | A quality controllable multi-view object reconstruction method for 3D imaging systems | |
| Kolivand et al. | Shadow mapping or shadow volume? | |
| WO2022135050A1 (en) | Rendering method, device, and system | |
| Hsieh et al. | A straightforward and intuitive approach on generation and display of crack-like patterns on 3D objects | |
| EP4386682A1 (en) | Image rendering method and related device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |