WO2024087021A1

WO2024087021A1 - Rendering method and system, and electronic device and computer medium

Info

Publication number: WO2024087021A1
Application number: PCT/CN2022/127424
Authority: WO
Inventors: 沈轶轩; 徐蔚峰; 孙天瑞; 李婧
Original assignee: 西门子股份公司; 西门子（中国）有限公司
Priority date: 2022-10-25
Filing date: 2022-10-25
Publication date: 2024-05-02

Abstract

The embodiments of the present application mainly relate to the field of image processing, and in particular to a rendering method and system, and an electronic device and a computer medium. The method comprises: parsing a first simulation model, so as to obtain a first group of objects in a first scenario and attributes of the first group of objects, CAD models respectively corresponding to the first group of objects, an object tree and an operation tree, wherein the object tree comprises a subordination relationship between all the objects, and the operation tree comprises respective preset motions of a plurality of objects among all the objects; converting, into a format which can be operated by a first renderer, the CAD models respectively corresponding to the first group of objects; respectively mapping the first group of objects to a second group of objects; each object in the second group of objects respectively calling a CAD model which has been subjected to format conversion, so as to obtain instances of the second group of objects, and a second scenario including the instances of the second group of objects; and when a simulator performs real-time simulation on the first simulation model, the first renderer performing rendering for the second scenario.

Description

Rendering method, system, electronic device and computer medium

Technical Field

The embodiments of the present application mainly relate to the field of image processing, and in particular to a rendering method, system, electronic device and computer medium.

Background technique

As the foundation of virtual reality, 3D motion simulation is gaining more and more attention and has been widely used. Whether in the field of manufacturing, education, service industry, public transportation, etc., 3D motion simulation is promoting the development of technology in related fields. As the most important part of 3D motion simulation, 3D simulators include not only computing systems but also rendering systems, and these two systems are usually closely integrated. However, this situation is not only not flexible enough, but also the rendering effects that can be achieved by almost all 3D simulators are limited, and may not be able to apply the rendering effects required for specific scenes.

Summary of the invention

The embodiments of the present application provide a rendering method, system and electronic device for conveniently and quickly implementing a distributed simulation process and a rendering process.

In a first aspect, a rendering method is provided, comprising: parsing a first simulation model to obtain a first group of objects and their attributes in a first scene, CAD models corresponding to the first group of objects, an object tree and operands; wherein the object tree comprises: subordinate relationships between all objects; the operation tree comprises: preset actions for multiple objects among all objects; converting the CAD models corresponding to the first group of objects into a format executable by a first renderer; mapping the first group of objects to a second group of objects; each object in the second group of objects calls the CAD model after format conversion to obtain instances of the second group of objects and a second scene containing instances of the second group of objects; when the simulator performs real-time simulation on the first simulation model, the first renderer renders the second scene.

In a second aspect, a rendering system is provided, comprising components for executing each step in the method provided in the first aspect.

According to a third aspect, an electronic device is provided, comprising: at least one memory configured to store computer-readable code; and at least one processor configured to call the computer-readable code to execute each step of the method provided in the first aspect.

According to a fourth aspect, a computer-readable medium is provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor, the processor executes the steps in the method provided in the first aspect.

BRIEF DESCRIPTION OF THE DRAWINGS

The following drawings are only intended to illustrate and explain the embodiments of the present application, and do not limit the scope of the embodiments of the present application.

FIG1 is a flow chart of a rendering method according to an embodiment of the present application;

FIG2 is a schematic diagram of a rendering system according to an embodiment of the present application;

FIG. 3 is a schematic diagram of an electronic device according to an embodiment of the present application.

Description of Reference Numerals

100: Rendering method 101-105: Method steps

20: Rendering System 21: Emulator 22: Server

23: First renderer 300: Electronic device 301: Memory

302: Processor

Detailed ways

The subject matter described herein will now be discussed with reference to example embodiments. It should be understood that discussing these embodiments is only to enable those skilled in the art to better understand and realize the subject matter described herein, and is not a limitation of the protection scope, applicability or examples set forth in the claims. The function and arrangement of the elements discussed can be changed without departing from the protection scope of the content of the embodiments of the present application. Each example can omit, replace or add various processes or components as needed. For example, the described method can be performed in an order different from the described order, and each step can be added, omitted or combined. In addition, the features described relative to some examples can also be combined in other examples.

As used herein, the term "including" and its variations represent open terms, meaning "including but not limited to". The term "based on" means "based at least in part on". The terms "one embodiment" and "an embodiment" mean "at least one embodiment". The term "another embodiment" means "at least one other embodiment". The terms "first", "second", etc. may refer to different or the same objects. Other definitions may be included below, whether explicit or implicit. Unless the context clearly indicates otherwise, the definition of a term is consistent throughout the specification.

The embodiments of the present application are described in detail below with reference to the accompanying drawings.

FIG. 1 is a flow chart of a rendering method according to an embodiment of the present application. As shown in FIG. 1 , the rendering method 100 includes:

Step 101, parse the first simulation model to obtain the first group of objects in the first scene and their attributes, the CAD models corresponding to the first group of objects, the object tree and the operands. The object tree includes: the subordinate relationship between all objects. The operation tree includes: the preset actions of multiple objects in all objects.

Object attributes include: identity document (ID), name, location, etc. The first group of objects includes all objects in the first scene.

Optionally, the preset actions may be related actions in multiple situations, for example, when producing product A, object a performs a first set of actions; when producing product B, object b performs a second set of actions. The preset actions include specific actions, speeds, directions, and the like.

Step 102: Convert the CAD models corresponding to the first group of objects into a format executable by the first renderer.

The formats that can be run by the first renderer include: USD format, FBX format or OBJ format.

Optionally, before step 102, the first group of objects is divided into static objects and dynamic objects. Optionally, the first group of objects can be divided into static objects and dynamic objects according to the preset actions of multiple objects in all objects. For example, when the first object, the second object, and the third object in the first group of objects have preset actions respectively and the other objects do not have preset actions, the objects that have a subordinate relationship with the first object/the second object/the third object are divided into dynamic objects, and the remaining objects are divided into static objects.

Step 103: Map the first group of objects to the second group of objects respectively.

Optionally, the method further includes mapping the ID and name of each object in the first group of objects to a corresponding object in the second group of objects, thereby allowing each object in the second group of objects to be quickly located at the corresponding object in the first group of objects.

Optionally, the position information of each object in the first group of objects is sent to a corresponding object in the second group of objects to initialize the position of the related objects.

Optionally, after the first group of objects is divided into static objects and dynamic objects, the object type of each object in the first group of objects is also mapped to a corresponding object in the second group of objects.

Step 104 : each object in the second group of objects respectively calls the CAD model after format conversion to obtain instances of the second group of objects and a second scene containing the instances of the second group of objects.

The CAD model in the embodiment of the present application refers to a CAD model file. One object instance corresponds to one CAD model. If there are multiple identical objects in the second group of objects, these identical objects can correspond to one CAD model.

Step 105: When the simulator performs real-time simulation on the first simulation model, the first renderer performs rendering on the second scene.

The embodiment of the present application parses the first simulation model containing the first scene, converts the CAD models corresponding to all the objects therein into a format that can be run by the first renderer, and then calls the converted CAD model for each object in the second group of objects obtained by mapping the first group of objects, so as to instantiate and obtain the second scene that can be run by the first renderer. When real-time simulation is performed on one end of the simulator, the first renderer can perform synchronous rendering for the second scene. The embodiment of the present application realizes the separation of the rendering stage from the simulator side, that is, the simulation work of the model is completed by the simulator side, and the synchronous rendering work is completed by the renderer side. Users can conveniently and quickly select a renderer with better visualization quality according to their own needs, and the distributed structure can meet a wider range of application scenarios.

Optionally, after step 105, the rendered second scene is displayed. When an abnormal object appears in the rendered second scene, the abnormal object is marked.

In one embodiment, when the simulator performs real-time simulation on the first simulation model, the dynamic rendering engine in the first renderer renders dynamic objects in the second scene in real time, and the static rendering engine in the first renderer renders static objects in the second scene.

In one embodiment, when the simulator performs real-time simulation on the first simulation model, the first renderer performs real-time rendering on the dynamic objects in the second scene according to the position information of the dynamic objects in the first simulation model. In addition, if the first renderer has completed the rendering of static objects, when the simulator performs real-time simulation on the first simulation model, the first renderer only needs to perform real-time update rendering on the dynamic objects. The computing power required in the rendering process is greatly reduced by the embodiments of the present application. In addition, compared with the prior art, the first renderer only needs to synchronize the position information of the dynamic objects in the first simulation model in real time to achieve synchronous rendering of the real-time simulation process, which is also conducive to reducing the communication load between devices and further improving the synchronization frequency.

FIG. 2 is a schematic diagram of a rendering system 20 according to an embodiment of the present application. As shown in FIG. 2 , the rendering system 20 includes:

The simulator 21 is configured to: parse the first simulation model to obtain the first group of objects and their attributes in the first scene, the CAD models corresponding to the first group of objects, an object tree and operands. The object tree includes: the subordinate relationship between all objects. The operation tree includes: the preset actions of multiple objects in all objects. The CAD models corresponding to the first group of objects are converted into a format executable by the first renderer. The CAD models after format conversion are sent to the server 22. The first group of objects are mapped to the second group of objects in the server 22. Optionally, the object attributes include: ID, name and position.

The server 22 is configured to: store the first simulation model, and send the first simulation model to the simulator 21. Each object in the second group of objects respectively calls the CAD model after format conversion to obtain instances of the second group of objects and a second scene containing the instances of the second group of objects. The second scene is sent to the first renderer.

The first renderer 23 is configured to render the second scene when the simulator 21 performs real-time simulation on the first simulation model, and optionally display the rendered second scene.

A distributed system is proposed through the embodiment of the present application, which not only separates the rendering stage from the simulator side, that is, while the simulator side completes the model simulation, the renderer side completes the real-time synchronous rendering work, but also proposes to use the database for data storage in the distributed system, thereby further saving related resources.

In one embodiment, the simulator 21 is further configured to: divide the first group of objects into static objects and dynamic objects before converting the CAD models corresponding to the first group of objects into a format executable by the first renderer.

The server 22 includes a dynamic sublayer and a static sublayer. The dynamic sublayer is configured to store dynamic objects in the second group of objects. The static sublayer is configured to store static objects in the second group of objects. By dividing into different sublayers, the problem of slow update speed caused by all being in one layer can be avoided.

The first renderer 23 includes a dynamic rendering engine and a static rendering engine. The dynamic rendering engine is configured to render dynamic objects in the second group of objects when the simulator 21 performs real-time simulation on the first simulation model. The static rendering engine is configured to render static objects in the second group of objects when the simulator 21 performs real-time simulation on the first simulation model.

Optionally, the simulator 21 is further configured to: when the simulator 21 performs real-time simulation on the first simulation model, synchronize the position information of the dynamic objects in the first simulation model to the properties of the corresponding objects in the dynamic sublayer in the server 22. The first renderer 23 also includes a synchronization module, which is configured to: synchronize the position information of the dynamic objects in the first simulation model through the dynamic sublayer in the server 22.

In one embodiment, the first renderer 23 is further configured to: when the simulator performs real-time simulation on the first simulation model, perform real-time rendering on the dynamic objects in the second scene according to the position information of the dynamic objects in the first simulation model.

By dividing the dynamic objects in the embodiment of the present application, the computing power required in the rendering process is greatly reduced. In addition, compared with the prior art, the first renderer only needs to synchronize the position information of the dynamic objects in the first simulation model in real time to achieve synchronous rendering of the real-time simulation process, which is also conducive to reducing the communication load between devices and further improving the synchronization frequency.

The embodiment of the present application also provides an electronic device 300. Figure 3 is a schematic diagram of an electronic device 300 according to an embodiment of the present application. As shown in Figure 3, the electronic device 300 includes a processor 302 and a memory 301, and the memory 301 stores instructions, wherein the instructions are executed by the processor 302 to implement the method 100 described above.

Among them, at least one processor 302 may include a microprocessor, an application specific integrated circuit (ASIC), a digital signal processor (DSP), a central processing unit (CPU), a graphics processing unit (GPU), a state machine, etc. Embodiments of computer-readable media include, but are not limited to, floppy disks, CD-ROMs, disks, memory chips, ROMs, RAMs, ASICs, configured processors, all-optical media, all tapes or other magnetic media, or any other medium from which a computer processor can read instructions. In addition, various other forms of computer-readable media can send or carry instructions to a computer, including routers, private or public networks, or other wired and wireless transmission devices or channels. Instructions may include code in any computer programming language, including C, C++, C language, Visual Basic, java, and JavaScript.

In addition, the embodiments of the present application also provide a computer-readable medium having computer-readable instructions stored thereon, and the computer-readable instructions, when executed by the processor, cause the processor to execute the aforementioned rendering method. Embodiments of computer-readable media include floppy disks, hard disks, magneto-optical disks, optical disks (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), magnetic tapes, non-volatile memory cards, and ROMs. Optionally, computer-readable instructions can be downloaded from a server computer or a cloud by a communication network.

It should be noted that not all steps and modules in the above-mentioned processes and system structure diagrams are necessary, and some steps or modules can be ignored according to actual needs. The execution order of each step is not fixed and can be adjusted as needed. The system structure described in the above-mentioned embodiments can be a physical structure or a logical structure, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by multiple physical entities, or some components in multiple independent devices may be implemented together.

Claims

A rendering method, comprising:

- parsing (101) the first simulation model to obtain a first group of objects in the first scene and their attributes, CAD models corresponding to the first group of objects, an object tree and operands; wherein the object tree includes: subordinate relationships between all objects; the operation tree includes: preset actions of multiple objects in all objects;

- converting (102) the CAD models corresponding to the first group of objects into a format executable by a first renderer;

- mapping (103) the first group of objects to the second group of objects respectively;

- Each object in the second group of objects respectively calls (104) the CAD model after format conversion to obtain an instance of the second group of objects and a second scene containing the instance of the second group of objects;

- When the simulator performs real-time simulation on the first simulation model, the first renderer performs rendering on the second scene (105).
The method according to claim 1, characterized in that

- Before converting (102) the CAD models corresponding to the first group of objects into a format executable by the first renderer, the method further comprises:

- dividing the first group of objects into static objects and dynamic objects;

-When the simulator performs real-time simulation on the first simulation model, the first renderer performs rendering on the second scene (105), including:

-When the simulator performs real-time simulation on the first simulation model, the dynamic rendering engine in the first renderer renders the dynamic objects in the second scene in real time, and the static rendering engine in the first renderer renders the static objects in the second scene.
The method according to claim 2, characterized in that dividing the first group of objects into static objects and dynamic objects comprises:

- According to respective preset actions of a plurality of objects among all objects, the first group of objects is divided into static objects and dynamic objects.
The method according to claim 1, characterized in that when the simulator performs real-time simulation on the first simulation model, the first renderer performs rendering (105) on the second scene, comprising:

-When the simulator performs real-time simulation on the first simulation model, the first renderer performs real-time rendering on the dynamic objects in the second scene according to the position information of the dynamic objects in the first simulation model.
The method according to claim 1, characterized in that after the first renderer renders (105) the second scene, the method further comprises:

- Display the rendered second scene;

-When an abnormal object appears in the rendered second scene, marking the abnormal object.
A rendering system, comprising:

- Emulator 21, configured to:

- Parse the first simulation model to obtain a first group of objects in the first scene and their attributes, CAD models corresponding to the first group of objects, an object tree, and operands; wherein the object tree includes: subordinate relationships between all objects; and the operation tree includes: preset actions of multiple objects in all objects;

-Converting the CAD models corresponding to the first group of objects into a format executable by the first renderer 23;

- Sending the format-converted CAD model to the server 22;

- mapping the first group of objects to the second group of objects in the server 22 respectively;

- The server 22 is configured to:

- storing the first simulation model, and sending the first simulation model to the simulator 21;

- each object in the second group of objects respectively calls the CAD model after format conversion to obtain an instance of the second group of objects and a second scene containing the instance of the second group of objects;

- sending the second scene to the first renderer 23;

The first renderer 23 is configured to:

-When the simulator 21 performs real-time simulation on the first simulation model, rendering is performed on the second scene.
The system according to claim 6, characterized in that

- The simulator 21 is further configured to:

- before converting the CAD models respectively corresponding to the first group of objects into a format executable by the first renderer 23, dividing the first group of objects into static objects and dynamic objects;

- The server 22 includes a dynamic sublayer and a static sublayer;

- the dynamic sublayer is configured to: store dynamic objects in the second group of objects;

- the static sublayer is configured to: store static objects in the second group of objects;

-The first renderer 23 includes a dynamic rendering engine and a static rendering engine;

- the dynamic rendering engine is configured to: render the dynamic objects in the second group of objects when the simulator 21 performs real-time simulation on the first simulation model;

- the static rendering engine is configured to render static objects in the second group of objects when the simulator 21 performs real-time simulation on the first simulation model.
The system according to claim 6, characterized in that

- The simulator 21 is further configured to:

- When the simulator 21 performs real-time simulation on the first simulation model, the position information of the dynamic objects in the first simulation model is synchronized to the attributes of the corresponding objects in the dynamic sublayer in the server 22;

The first renderer 23 further includes a synchronization module, which is configured to:

- Synchronizing the position information of the dynamic objects in the first simulation model through the dynamic sublayer in the server 22.
An electronic device, comprising:

at least one memory (301) configured to store computer readable code;

At least one processor (302) is configured to call the computer-readable code to execute the steps in the method according to any one of claims 1 to 5.
A computer-readable medium, characterized in that computer-readable instructions are stored on the computer-readable medium, and when the computer-readable instructions are executed by a processor, the processor is caused to execute the steps in the method according to any one of claims 1 to 5.