CN115033137A - Virtual reality interaction method based on digital twins - Google Patents
Virtual reality interaction method based on digital twins Download PDFInfo
- Publication number
- CN115033137A CN115033137A CN202210654073.7A CN202210654073A CN115033137A CN 115033137 A CN115033137 A CN 115033137A CN 202210654073 A CN202210654073 A CN 202210654073A CN 115033137 A CN115033137 A CN 115033137A
- Authority
- CN
- China
- Prior art keywords
- scene
- virtual
- virtual reality
- rendering
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention belongs to the technical field of virtual reality interaction, and discloses a virtual reality interaction method based on a digital twin. The method for building the virtual test environment can interact with a real physical application scene in real time through the control system and map the real physical application scene to a digital twin model of the corresponding application scene to output the working state of the application scene, so that the debugging time is shortened; meanwhile, the method for loading the virtual reality scene can enable the loading of the virtual reality scene not to be limited by the version of the scene development platform, so that the problem of loading failure of the virtual reality scene caused by incompatibility of the versions of the scene development platform is avoided, and the virtual reality experience of a user is improved.
Description
Technical Field
The invention belongs to the technical field of virtual reality interaction, and particularly relates to a digital twin-based virtual reality interaction method.
Background
Virtual Reality (abbreviated as VR) is a new practical technology developed in the 20 th century. Virtual reality technology encompasses computer, electronic information, simulation technology, the basic implementation of which is that a computer simulates a virtual environment to give a person a sense of environmental immersion. With the continuous development of social productivity and scientific technology, VR technology is increasingly in great demand in various industries. The VR technology has made great progress and gradually becomes a new scientific and technical field. However, the existing virtual reality interaction method based on the digital twin has long test period for the virtual scene; meanwhile, because the versions cannot be compatible, the problem of rendering errors during scene loading occurs, so that the virtual reality scene loading fails, and the user experience is influenced.
In summary, the problems of the prior art are: the existing virtual reality interaction method based on digital twinning has long test period for virtual scenes; meanwhile, because the versions cannot be compatible, the problem of rendering errors during scene loading occurs, so that the virtual reality scene loading fails, and the user experience is influenced.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a virtual reality interaction method based on a digital twin.
The invention is realized in such a way that a virtual reality interaction method based on digital twins comprises the following steps:
firstly, constructing a physical entity picture by a real virtual technology; constructing a scene model according to the physical structure characteristics through a scene construction program, ensuring that a virtual object in the scene model is consistent with a physical entity, constructing a virtual scene based on sensor data and the physical model, and rendering the constructed virtual scene in a simulator; a virtual test environment is set up, and a virtual scene is tested;
loading a virtual reality scene, and acquiring a first image in real time by using an image collector of a first interaction end, wherein the angle of view of the first image acquired by the image collector of the first interaction end corresponds to a first virtual angle of view in the virtual scene;
after the first interactive end acquires the image, acquiring a second image in real time by using an image collector of a second interactive end, wherein the visual angle of the second image corresponds to a second virtual visual angle in the virtual scene;
step four, updating the second interactive end and/or the object associated with the second interactive end into the virtual scene under the first virtual visual angle; updating the first interactive end and/or the object associated with the first interactive end into the virtual scene under the second virtual visual angle;
and fifthly, completely and comprehensively mapping physical entities in the real scene in the virtual scene by using a digital twinning technology, and realizing accurate interaction of virtual reality by using a model optimization and rendering method.
Further, the method for building the virtual test environment comprises the following steps:
(1) constructing a digital twin model of an application scene through a model construction program; monitoring a command sent by a user side or a command sent by a control system;
(2) acquiring application scene data from the control system in response to the command or the instruction; inputting the application scene data to the digital twin model to obtain output simulation data;
(3) according to the simulation data, displaying the working state of the application scene after responding to the command or the instruction; establishing a three-dimensional display model of a working surface; binding and mapping the three-dimensional display model and the digital twin model; importing the three-dimensional display model into a three-dimensional engine; sending a three-dimensional display instruction to the user side; and inputting the simulation data into the three-dimensional engine so that the working state of the working surface responding to the command or the command is displayed by the user end according to the three-dimensional display command.
Further, the building the digital twin model of the application scene by the model building program includes:
and receiving model information configured by a user side, and constructing a digital twin model of the application scene according to the model information.
Further, the method for loading the virtual scene comprises the following steps:
(1) collecting control input data of a target virtual reality scene;
(2) acquiring key control data according to the control input data;
the key control data comprise trigger starting time, trigger duration, trigger input coordinates and trigger keys;
(3) generating a loading control script of the target virtual reality scene according to the key control data;
wherein, the loading control script at least comprises a designated rendering time sequence and rendering execution information corresponding to the rendering time sequence;
(4) responding to a loading request of a target virtual reality scene, and acquiring the loading control script;
(5) executing the loading control script according to a preset execution priority, and executing rendering on a scene object contained in the target virtual reality scene according to the rendering time sequence so as to load the target virtual reality scene;
the rendering time sequence at least comprises the rendering time sequence of a scene camera, the designated rendering time sequence of the scene camera is set according to different depth values of the scene camera, and the scene camera comprises a left-eye camera and a right-eye camera.
Further, the load control script includes a control sub-script and a render sub-script,
wherein the control sub-script at least comprises the rendering timing sequence, and the rendering sub-script at least comprises the rendering execution information;
the step of executing the load control script comprises:
and executing the control sub-script to execute the rendering sub-script according to the rendering time sequence, and executing rendering on a scene object contained in the target virtual reality scene according to the rendering time sequence to load the target virtual reality scene.
Further, the preset execution priority is the highest execution priority.
The invention has the advantages and positive effects that: the method comprises the steps of constructing a digital twin model of an application scene by adopting a method of constructing a virtual test environment, monitoring a command sent by a user side or a command sent by a control system, responding to the command or the command, acquiring application scene data from the control system, inputting the application scene data to the digital twin model to acquire output simulation data, and displaying a working state of the application scene after responding to the command or the command according to the simulation data; the method can interact with a real physical application scene in real time through a control system, and outputs the working state of the application scene by a digital twin model mapped to the corresponding application scene, thereby shortening the debugging time; meanwhile, the loading of the virtual reality scene is not limited by the version of the scene development platform through the method for loading the virtual scene, so that the problem of loading failure of the virtual reality scene caused by incompatibility of the versions of the scene development platform is solved, and the virtual reality experience of a user is improved.
Drawings
FIG. 1 is a flow chart of a digital twin-based virtual reality interaction method provided by the implementation of the invention.
FIG. 2 is a flowchart of a method for building a virtual test environment according to an embodiment of the present invention.
Fig. 3 is a flowchart of a method for loading virtual scenes according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The application of the principles of the present invention will now be described in further detail with reference to the accompanying drawings.
As shown in fig. 1, the invention provides a virtual reality interaction method based on digital twins, which comprises the following steps:
s101, constructing a physical entity picture by a real virtual technology; constructing a scene model according to the physical structure characteristics through a scene construction program, ensuring that a virtual object in the scene model is consistent with a physical entity, constructing a virtual scene based on sensor data and the physical model, and rendering the constructed virtual scene in a simulator; a virtual test environment is set up, and the virtual scene is tested;
s102, loading a virtual reality scene, and acquiring a first image in real time by using an image collector of a first interaction end, wherein the visual angle of the first image acquired by the image collector of the first interaction end corresponds to a first virtual visual angle in the virtual scene;
s103, after the first interactive end acquires the image, acquiring a second image in real time by using an image collector of a second interactive end, wherein the visual angle of the second image corresponds to a second virtual visual angle in the virtual scene;
s104, updating the second interactive end and/or the object associated with the second interactive end into the virtual scene under the first virtual visual angle; updating the first interactive end and/or the object associated with the first interactive end into the virtual scene under the second virtual visual angle;
s105, completely and comprehensively mapping physical entities in a real scene in the virtual scene by using a digital twinning technology and realizing accurate interaction of virtual reality by using a model optimization and rendering method.
As shown in fig. 2, the method for building a virtual test environment provided by the present invention is as follows:
s201, constructing a digital twin model of an application scene through a model construction program; monitoring a command sent by a user side or a command sent by a control system;
s202, responding to the command or the instruction, and acquiring application scene data from the control system; inputting the application scene data to the digital twin model to obtain output simulation data;
s203, according to the simulation data, displaying the working state of the application scene after responding to the command or the instruction; establishing a three-dimensional display model of a working surface; binding and mapping the three-dimensional display model and the digital twin model; importing the three-dimensional display model into a three-dimensional engine; sending a three-dimensional display instruction to the user side; and inputting the simulation data into the three-dimensional engine so that the working state of the working surface responding to the command or the command is displayed by the user end according to the three-dimensional display command.
The invention provides a digital twin model for constructing the application scene through a model construction program, which comprises the following steps:
and receiving model information configured by a user side, and constructing a digital twin model of the application scene according to the model information.
As shown in fig. 3, the method for loading virtual live-action provided by the present invention is as follows:
s301, collecting control input data of a target virtual reality scene;
s302, obtaining key control data according to the control input data;
the key control data comprise trigger starting time, trigger duration, trigger input coordinates and trigger keys;
s303, generating a loading control script of the target virtual reality scene according to the key control data;
wherein, the loading control script at least comprises a designated rendering time sequence and rendering execution information corresponding to the rendering time sequence;
s304, responding to a loading request of a target virtual reality scene, and acquiring the loading control script;
s305, executing the loading control script according to a preset execution priority, and executing rendering on a scene object contained in the target virtual reality scene according to the rendering time sequence so as to load the target virtual reality scene;
the rendering time sequence at least comprises the rendering time sequence of a scene camera, the designated rendering time sequence of the scene camera is set according to different depth values of the scene camera, and the scene camera comprises a left-eye camera and a right-eye camera.
The load control script provided by the invention comprises a control sub-script and a rendering sub-script,
wherein the control sub-script at least comprises the rendering timing sequence, and the rendering sub-script at least comprises the rendering execution information;
the step of executing the load control script comprises:
and executing the control sub-script to execute the rendering sub-script according to the rendering time sequence, and executing rendering on a scene object contained in the target virtual reality scene according to the rendering time sequence to load the target virtual reality scene.
The execution priority provided by the present invention is the highest execution priority.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (6)
1. A virtual reality interaction method based on digital twinning is characterized by comprising the following steps:
firstly, constructing a physical entity picture by a real virtual technology; constructing a scene model according to the physical structure characteristics through a scene construction program, ensuring that a virtual object in the scene model is consistent with a physical entity, constructing a virtual scene based on sensor data and the physical model, and rendering the constructed virtual scene in a simulator; a virtual test environment is set up, and a virtual scene is tested;
loading a virtual reality scene, and acquiring a first image in real time by using an image collector of a first interaction end, wherein the visual angle of the first image acquired by the image collector of the first interaction end corresponds to a first virtual visual angle in the virtual scene;
after the first interactive end acquires the image, acquiring a second image in real time by using an image collector of a second interactive end, wherein the visual angle of the second image corresponds to a second virtual visual angle in the virtual scene;
step four, the second interactive end and/or the object associated with the second interactive end are/is updated to the virtual scene under the first virtual visual angle; updating the first interactive end and/or the object associated with the first interactive end into the virtual scene under the second virtual visual angle;
and fifthly, completely and comprehensively mapping physical entities in the real scene in the virtual scene by using a digital twinning technology, and realizing accurate interaction of virtual reality by using a model optimization and rendering method.
2. The digital twin-based virtual reality interaction method as claimed in claim 1, wherein the method of setting up a virtual test environment is as follows:
(1) constructing a digital twin model of an application scene through a model construction program; monitoring a command sent by a user side or a command sent by a control system;
(2) acquiring application scene data from the control system in response to the command or the instruction; inputting the application scene data to the digital twin model to obtain output simulation data;
(3) according to the simulation data, the working state of the application scene after responding to the command or the instruction is displayed; establishing a three-dimensional display model of a working surface; binding and mapping the three-dimensional display model and the digital twin model; importing the three-dimensional display model into a three-dimensional engine; sending a three-dimensional display instruction to the user side; and inputting the simulation data into the three-dimensional engine so that a user end can show the working state of a working surface responding to the command or the command according to the three-dimensional display command.
3. The digital twin-based virtual reality interaction method of claim 2, wherein the building of the digital twin model of the application scene by a model building program comprises:
and receiving model information configured by a user side, and constructing a digital twin model of the application scene according to the model information.
4. A digital twin based virtual reality interaction method as claimed in claim 1, wherein the load virtual scene method is as follows:
(1) collecting control input data of a target virtual reality scene;
(2) acquiring key control data according to the control input data;
the key control data comprise trigger starting time, trigger duration, trigger input coordinates and trigger keys;
(3) generating a loading control script of the target virtual reality scene according to the key control data;
wherein, the loading control script at least comprises a designated rendering time sequence and rendering execution information corresponding to the rendering time sequence;
(4) responding to a loading request of a target virtual reality scene, and acquiring the loading control script;
(5) executing the loading control script according to a preset execution priority, and executing rendering on a scene object contained in the target virtual reality scene according to the rendering time sequence so as to load the target virtual reality scene;
the rendering time sequence at least comprises the rendering time sequence of a scene camera, the designated rendering time sequence of the scene camera is set according to different depth values of the scene camera, and the scene camera comprises a left-eye camera and a right-eye camera.
5. A digital twin based virtual reality interaction method according to claim 4, wherein the load control script comprises a control sub-script and a render sub-script,
wherein the control sub-script at least comprises the rendering timing sequence, and the rendering sub-script at least comprises the rendering execution information;
the step of executing the load control script comprises:
and executing the control sub-script to execute the rendering sub-script according to the rendering time sequence, and executing rendering on a scene object contained in the target virtual reality scene according to the rendering time sequence to load the target virtual reality scene.
6. A digital twin based virtual reality interaction method according to claim 4, wherein the preset execution priority is the highest execution priority.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210654073.7A CN115033137A (en) | 2022-06-10 | 2022-06-10 | Virtual reality interaction method based on digital twins |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210654073.7A CN115033137A (en) | 2022-06-10 | 2022-06-10 | Virtual reality interaction method based on digital twins |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115033137A true CN115033137A (en) | 2022-09-09 |
Family
ID=83122291
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210654073.7A Withdrawn CN115033137A (en) | 2022-06-10 | 2022-06-10 | Virtual reality interaction method based on digital twins |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115033137A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117555426A (en) * | 2024-01-11 | 2024-02-13 | 深圳时空数字科技有限公司 | Virtual reality interaction system based on digital twin technology |
| WO2024055397A1 (en) * | 2022-09-14 | 2024-03-21 | 上海智能制造功能平台有限公司 | Observation viewing angle traceable method and system based on digital twin, and terminal |
-
2022
- 2022-06-10 CN CN202210654073.7A patent/CN115033137A/en not_active Withdrawn
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024055397A1 (en) * | 2022-09-14 | 2024-03-21 | 上海智能制造功能平台有限公司 | Observation viewing angle traceable method and system based on digital twin, and terminal |
| CN117555426A (en) * | 2024-01-11 | 2024-02-13 | 深圳时空数字科技有限公司 | Virtual reality interaction system based on digital twin technology |
| CN117555426B (en) * | 2024-01-11 | 2024-03-12 | 深圳时空数字科技有限公司 | Virtual reality interaction system based on digital twin technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115033137A (en) | Virtual reality interaction method based on digital twins | |
| CN106846497B (en) | Method and device for presenting three-dimensional map applied to terminal | |
| JP2021524094A (en) | Application virtual scene recognition and interaction key matching method, and arithmetic unit | |
| CN113741698A (en) | Method and equipment for determining and presenting target mark information | |
| CN111125808B (en) | Intelligent construction site management model construction method and device | |
| CN110766775A (en) | BIM model dynamic display method and device | |
| CN104157011A (en) | Modeling method for three-dimensional terrain | |
| CN110909439A (en) | AR-based assembly method and device and terminal | |
| US20240144576A1 (en) | 3d object management data, computer program, and distributed management method for 3d object | |
| CN111915712A (en) | Illumination rendering method and device, computer readable medium and electronic equipment | |
| CN111881051A (en) | Test case generation method and device, terminal and storage medium | |
| CN111429553B (en) | Animation preview method, device, computer equipment and storage medium | |
| US20230419561A1 (en) | Three-dimensional model rendering method and apparatus, device, storage medium, and program product | |
| CN116610881A (en) | WebGL browsing interaction method based on low-code software | |
| CN115578433A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN110163972B (en) | OpenGL-based three-dimensional finite element model and response cloud image display method | |
| CN114692383A (en) | Modeling method and device for full-range analog machine simulation object and computer equipment | |
| CN112017304B (en) | Method, apparatus, electronic device and medium for presenting augmented reality data | |
| CN116244778B (en) | Hydropower engineering simulation cloud picture display method and device, electronic equipment and storage medium | |
| CN112807695A (en) | Game scene generation method and device, readable storage medium and electronic equipment | |
| CN111008934B (en) | Scene construction method, device, equipment and storage medium | |
| CN110378948B (en) | 3D model reconstruction method and device and electronic equipment | |
| CN109816791B (en) | Method and apparatus for generating information | |
| CN111968210A (en) | Object simplified model creating method, object simplified model displaying method, object simplified model creating device, object simplified model displaying equipment and storage medium | |
| CN108597025B (en) | Artificial intelligence-based virtual reality-oriented rapid model construction method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20220909 |
|
| WW01 | Invention patent application withdrawn after publication |