CN116449956A - Virtual simulation display system and platform based on multiple information fusion technology - Google Patents
Virtual simulation display system and platform based on multiple information fusion technology Download PDFInfo
- Publication number
- CN116449956A CN116449956A CN202310433690.9A CN202310433690A CN116449956A CN 116449956 A CN116449956 A CN 116449956A CN 202310433690 A CN202310433690 A CN 202310433690A CN 116449956 A CN116449956 A CN 116449956A
- Authority
- CN
- China
- Prior art keywords
- display
- module
- unit
- personnel
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 20
- 230000004927 fusion Effects 0.000 title claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 62
- 230000003993 interaction Effects 0.000 claims abstract description 61
- 230000009471 action Effects 0.000 claims abstract description 42
- 238000004088 simulation Methods 0.000 claims abstract description 37
- 238000012544 monitoring process Methods 0.000 claims abstract description 16
- 238000009877 rendering Methods 0.000 claims abstract description 15
- 230000002452 interceptive effect Effects 0.000 claims abstract description 13
- 238000004891 communication Methods 0.000 claims description 41
- 230000033001 locomotion Effects 0.000 claims description 36
- 230000000007 visual effect Effects 0.000 claims description 14
- 238000012795 verification Methods 0.000 claims description 12
- 230000002457 bidirectional effect Effects 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 5
- 239000000463 material Substances 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 6
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 239000000203 mixture Substances 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a virtual simulation display system and a platform based on a multiple information fusion technology, wherein the virtual simulation display system comprises a display video input unit, a display audio input unit, a display product input unit, a display point scanning unit, a display positioning unit, a rendering module, a simulation scene simulation space, a display interaction unit, a language interaction unit, an action interaction unit and a personnel action judging module, and the virtual simulation display system has the beneficial effects that: through the processing of typeeing to show video, audio frequency and product three-dimensional model, better with the product blend into video and audio in, make the people throw into more when the show, promote the bandwagon effect, through show positioning unit, realized the acquisition to the show position to adjust the processing to the multidimensional display parameter that is fit for the show position, make the show more stable, through having added the interactive unit of show, realized monitoring interactive personnel when showing, verify personnel information.
Description
Technical Field
The invention relates to the technical field of virtual simulation display, in particular to a virtual simulation display system and a platform based on a multi-element information fusion technology.
Background
Information diversification refers to the variety of information, the source channel of the information is multiple, and multidimensional space refers to space composed of 4 or more dimensions. The multi-dimensional space definition dimension is a measure, and on three-dimensional space coordinates, time and space are mutually connected to form four-dimensional space, the information age takes information transmission as a medium, so that the information transmission speed is greatly improved, the introduction of products is enriched, the recognition degree of customers to the products can be greatly improved by means of convenience of the Internet in order to more prominently display the functionality of the products, in the existing product display system, the products are always three-dimensional displayed through videos, but the display cannot be subjected to image interaction through limb actions of the customers, the display is too monotonous when the products are displayed, and the collaborative modification processing is inconvenient for the space environment during the image display.
Disclosure of Invention
The invention aims to provide a virtual simulation display system and a platform based on a multi-element information fusion technology, so as to solve the problems in the background technology.
In order to achieve the above purpose, the present invention provides the following technical solutions: the virtual simulation display system based on the multiple information fusion technology comprises a display video input unit, a display audio input unit, a display product input unit, a display point scanning unit, a display positioning unit, a rendering module, a simulation scene simulation space, a display interaction unit, a language interaction unit, an action interaction unit and a personnel action judging module, wherein the output end of the display video input unit is in communication connection with the input end of the display audio input unit, the output end of the display audio input unit is in communication connection with the input end of the display product input unit, the output end of the display product input unit is in communication connection with the input end of the display point scanning unit, the output end of the display positioning unit is in communication connection with the input end of the rendering module, the output end of the rendering module is in communication connection with the input end of the simulation scene simulation space, the output end of the simulation scene simulation space is in communication connection with the input end of the display interaction unit, the display interaction unit is in bidirectional connection with the language interaction unit, the output end of the display interaction unit is in communication connection with the input end of the action interaction unit, and the output end of the display interaction unit is in communication connection with the input end of the personnel action judging module;
the display video input unit is used for inputting video materials to be displayed;
the display audio recording unit is used for recording the audio paired with the video material;
the display product input unit is used for inputting a product three-dimensional model to be displayed;
the display point scanning unit is used for scanning the multidimensional holographic display space;
the display positioning unit is used for positioning the position to be displayed;
the rendering module is used for performing image rendering processing on the position according to the display image;
the simulation scene simulation space is used for carrying out multidimensional holographic display processing on the selected space;
the display interaction unit is used for identifying personnel participating in display image interaction;
the language interaction unit is used for carrying out language interaction processing with personnel;
the action interaction unit is used for carrying out recognition and capture processing on actions made by the personnel;
the personnel action judging module is used for judging the response of actions made by personnel to the display image.
Preferably, the display point scanning unit comprises a space scanning module, a space model building module and a display position frame selection module, wherein the output end of the space scanning module is in communication connection with the input end of the space model building module, and the output end of the space model building module is in communication connection with the input end of the display position frame selection module;
the space scanning module is used for scanning the displayed space position;
the space model building module is used for performing space model building processing on the scanned image;
the display position frame selection module is used for selecting a range to be displayed in the space model.
Preferably, the display positioning unit comprises a position filling module, a three-dimensional display parameter adjusting module and a multidimensional display parameter adjusting module, wherein the output end of the position filling module is in communication connection with the input end of the three-dimensional display parameter adjusting module, and the three-dimensional display parameter adjusting module is in bidirectional connection with the multidimensional display parameter adjusting module;
the position filling module is used for carrying out selected filling processing on the projection display position;
the three-dimensional display parameter adjusting module is used for adjusting the displayed three-dimensional image parameters;
the multi-dimensional display parameter adjusting module is used for adjusting and processing the displayed multi-dimensional image parameters.
Preferably, the display positioning unit is bidirectionally connected with a display adjusting unit, the display adjusting unit is used for adjusting and processing the displayed image, the display adjusting unit comprises an image stretching module and a display adjusting module, and the image stretching module is bidirectionally connected with the display adjusting module;
the image stretching module is used for carrying out position stretching adjustment treatment on the displayed image;
the display adjusting module is used for adjusting the brightness and the color saturation of the display image.
Preferably, the simulation scene simulation space is bidirectionally connected with a multi-dimensional projection module, and the multi-dimensional projection module is used for carrying out multi-dimensional projection display processing on the image.
Preferably, the display interaction unit comprises an interaction personnel monitoring module, a personnel information verification module and a user visual angle acquisition module, wherein the output end of the interaction personnel monitoring module is in communication connection with the input end of the personnel information verification module, and the output end of the personnel information verification module is in communication connection with the input end of the user visual angle acquisition module;
the interactive personnel monitoring module is used for monitoring and processing personnel appearing during display;
the personnel information verification module is used for verifying and processing personnel information of personnel when interaction occurs;
the user visual angle acquisition module is used for carrying out simulated image acquisition processing on the visual angle of personnel interaction.
Preferably, the motion interaction unit comprises a human motion recognition module and a motion capture module, and the human motion recognition module is connected with the motion capture module in a bidirectional manner;
the human body action recognition module is used for recognizing and processing the human body actions when the human body actions are performed on the human body;
the motion capture module is used for carrying out real-time dynamic capture processing on limb motions made by personnel and carrying out display image change processing according to the personnel motions.
Preferably, the personnel action judging module is bidirectionally connected with a linkage display unit, and the linkage display unit is used for carrying out linkage change processing on the multidimensional holographic display according to limb actions made by personnel.
Preferably, the linkage display unit is bidirectionally connected with a video linkage module, the linkage display unit is bidirectionally connected with an audio linkage module, and the linkage display unit is bidirectionally connected with a product linkage module;
the video linkage module is used for carrying out linkage processing on the display video according to the limb movements of the personnel;
the audio linkage module is used for carrying out linkage processing on the audio according to the limb movements of the personnel;
the product linkage module is used for carrying out linkage treatment on the display products according to the limb movements of the personnel.
A virtual simulation display platform based on a multi-element information fusion technology, comprising a display server and at least one multi-dimensional holographic display system according to any one of claims 1-9, wherein the multi-dimensional holographic display system is in communication connection with the display server.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Compared with the prior art, the invention has the beneficial effects that: through the processing of typeeing to show video, audio frequency and product three-dimensional model, better with the product blend into video and audio in, make the people throw into more when the show, promote the bandwagon effect, through show positioning unit, realized the acquisition to the show position, and adjust the processing to the multidimensional display parameter that is fit for the show position, make the show more stable, through having added the interactive unit of show, realized monitoring interactive personnel when showing, verify personnel's information, and carry out simulation acquisition processing to the image according to personnel's observation visual angle, promote the bandwagon effect.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It will be apparent to those skilled in the art from this disclosure that the drawings described below are merely exemplary and that other embodiments may be derived from the drawings provided without undue effort.
FIG. 1 is a block diagram of a system of the present invention;
FIG. 2 is a block diagram of a system showing a point scanning unit in accordance with the present invention;
FIG. 3 is a block diagram of a system showing a positioning-unit of the present invention;
FIG. 4 is a block diagram of a system showing a conditioning unit according to the present invention.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus consistent with some aspects of the disclosure as detailed in the accompanying claims.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1:
referring to fig. 1 to fig. 4, a virtual simulation display system based on a multiple information fusion technology according to an embodiment of the present invention includes a display video input unit, a display audio input unit, a display product input unit, a display point scanning unit, a display positioning unit, a rendering module, a simulation scene simulation space, a display interaction unit, a language interaction unit, an action interaction unit and a personnel action judging module, wherein an output end of the display video input unit is in communication connection with an input end of the display audio input unit, an output end of the display audio input unit is in communication connection with an input end of the display product input unit, an output end of the display product input unit is in communication connection with an input end of the display point scanning unit, an output end of the display positioning unit is in communication connection with an input end of the rendering module, an output end of the rendering module is in communication connection with an input end of the simulation scene simulation space, an output end of the simulation scene simulation space is in communication connection with an input end of the display interaction unit, the display interaction unit is in bidirectional connection with the language interaction unit, an output end of the display interaction unit is in communication connection with an input end of the action interaction unit, and an output end of the action interaction unit is in communication connection with an input end of the personnel judging module;
the display video input unit is used for inputting the video materials to be displayed;
the display audio recording unit is used for recording the audio paired with the video material;
the display product input unit is used for inputting the three-dimensional model of the product to be displayed, and better integrating the product into the video and the audio through inputting the display video, the audio and the three-dimensional model of the product, so that people are more invested during display, and the display effect is improved;
the display point scanning unit is used for scanning the multidimensional holographic display space, scanning the space to be displayed, establishing a space model and selecting a range of the position to be displayed;
the display positioning unit is used for positioning the position to be displayed, acquiring the display position through the display positioning unit, and adjusting the multidimensional display parameters suitable for the display position, so that the display is more stable;
the rendering module is used for performing image rendering processing according to the position of the display image;
the simulation scene simulation space is used for carrying out multidimensional holographic display processing on the selected space;
the display interaction unit is used for identifying personnel participating in the interaction of the display images, monitoring of the interactive personnel during display is realized by adding the display interaction unit, personnel information is verified, the images are simulated and acquired according to the observation view angles of the personnel, and the display effect is improved;
the language interaction unit is used for carrying out language interaction processing with personnel;
the action interaction unit is used for identifying and capturing actions made by the personnel;
the personnel action judging module is used for judging the response of actions made by personnel to the display image.
Example 2:
the display point scanning unit comprises a space scanning module, a space model building module and a display position frame selection module, wherein the output end of the space scanning module is in communication connection with the input end of the space model building module, and the output end of the space model building module is in communication connection with the input end of the display position frame selection module;
the space scanning module is used for scanning the displayed space position;
the space model building module is used for performing space model building processing on the scanned image;
the display position frame selection module is used for selecting a range to be displayed in the space model, scanning the space to be displayed, establishing the space model and selecting the range to be displayed.
The display positioning unit comprises a position filling module, a three-dimensional display parameter adjusting module and a multi-dimensional display parameter adjusting module, wherein the output end of the position filling module is in communication connection with the input end of the three-dimensional display parameter adjusting module, and the three-dimensional display parameter adjusting module is in bidirectional connection with the multi-dimensional display parameter adjusting module;
the position filling module is used for carrying out selected filling processing on the projection display position;
the three-dimensional display parameter adjusting module is used for adjusting the displayed three-dimensional image parameters;
the multidimensional display parameter adjusting module is used for adjusting and processing the displayed multidimensional image parameters, the display position is obtained through the display positioning unit, and the multidimensional display parameters suitable for the display position are adjusted and processed, so that the display is more stable.
The display positioning unit is bidirectionally connected with a display adjusting unit, the display adjusting unit is used for adjusting and processing displayed images, the display adjusting unit comprises an image stretching module and a display adjusting module, and the image stretching module is bidirectionally connected with the display adjusting module;
the image stretching module is used for carrying out position stretching adjustment treatment on the displayed image;
the display adjusting module is used for adjusting the brightness and the color saturation of the display image, stretching and adjusting the displayed video image, and adjusting the display brightness and the color saturation.
The simulation scene simulation space is connected with a multidimensional projection module in a bidirectional mode, and the multidimensional projection module is used for carrying out multidimensional projection display processing on the image.
The display interaction unit comprises an interaction personnel monitoring module, a personnel information verification module and a user visual angle acquisition module, wherein the output end of the interaction personnel monitoring module is in communication connection with the input end of the personnel information verification module, and the output end of the personnel information verification module is in communication connection with the input end of the user visual angle acquisition module;
the interactive personnel monitoring module is used for monitoring and processing personnel appearing during display;
the personnel information verification module is used for verifying personal information of personnel when interaction occurs;
the user visual angle acquisition module is used for carrying out simulated image acquisition processing on the interactive visual angle of personnel, through having added the interactive unit of show, interactive personnel are monitored when having realized showing, verify personnel information to carry out simulated acquisition processing to the image according to the observation visual angle of personnel, promote the bandwagon effect, monitor personnel's action in the simulation space, verify personnel's identity information during the control.
The motion interaction unit comprises a human motion recognition module and a motion capture module, and the human motion recognition module is connected with the motion capture module in a bidirectional manner;
the human body action recognition module is used for recognizing and processing the limb actions of the personnel;
the motion capture module is used for carrying out real-time dynamic capture processing on limb motions made by personnel, carrying out display image changing processing according to the personnel motions, and carrying out linkage processing on the display images according to the captured human limb motions.
The linkage display unit is used for carrying out linkage change processing on the multidimensional holographic display according to limb movements made by the personnel.
The linkage display unit is bidirectionally connected with a video linkage module, the linkage display unit is bidirectionally connected with an audio linkage module, and the linkage display unit is bidirectionally connected with a product linkage module;
the video linkage module is used for carrying out linkage processing on the display video according to the limb movements of the personnel;
the audio linkage module is used for carrying out linkage processing on the audio according to the limb movements of the personnel;
the product linkage module is used for carrying out linkage processing on the displayed products according to the limb movements of the personnel and carrying out linkage processing on the displayed video, audio and three-dimensional models of the products according to the captured human body limb movements.
Example 3:
a virtual simulation display platform based on a multi-element information fusion technology, comprising a display server and at least one multi-dimensional holographic display system according to any one of claims 1-9, wherein the multi-dimensional holographic display system is in communication connection with the display server.
Example 4:
video, audio and products to be displayed are recorded, a space to be displayed is scanned, a space model is established, the position to be displayed is subjected to range frame selection, the video, audio and products and the space model are filled, three-dimensional display parameters and multidimensional display parameters are adjusted, a displayed video image is stretched and adjusted, display brightness and color saturation are adjusted, a simulation scene simulation space is established, actions of personnel are monitored in the simulation space, identity information of the personnel is verified during monitoring, and linkage processing is performed on the displayed video, audio and product three-dimensional model according to captured human body limb actions.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope of the disclosure being indicated by the following claims.
Claims (10)
1. The virtual simulation display system based on the multiple information fusion technology is characterized by comprising a display video input unit, a display audio input unit, a display product input unit, a display point scanning unit, a display positioning unit, a rendering module, a simulation scene simulation space, a display interaction unit, a language interaction unit, an action interaction unit and a personnel action judging module, wherein the output end of the display video input unit is in communication connection with the input end of the display audio input unit, the output end of the display audio input unit is in communication connection with the input end of the display product input unit, the output end of the display product input unit is in communication connection with the input end of the display point scanning unit, the output end of the display positioning unit is in communication connection with the input end of the rendering module, the output end of the simulation scene simulation space is in communication connection with the input end of the display interaction unit, the display interaction unit is in bidirectional connection with the language interaction unit, the output end of the display interaction unit is in communication connection with the input end of the action interaction unit, and the output end of the simulation scene simulation space is in communication connection with the input end of the personnel action judging module;
the display video input unit is used for inputting video materials to be displayed;
the display audio recording unit is used for recording the audio paired with the video material;
the display product input unit is used for inputting a product three-dimensional model to be displayed;
the display point scanning unit is used for scanning the multidimensional holographic display space;
the display positioning unit is used for positioning the position to be displayed;
the rendering module is used for performing image rendering processing on the position according to the display image;
the simulation scene simulation space is used for carrying out multidimensional holographic display processing on the selected space;
the display interaction unit is used for identifying personnel participating in display image interaction;
the language interaction unit is used for carrying out language interaction processing with personnel;
the action interaction unit is used for carrying out recognition and capture processing on actions made by the personnel;
the personnel action judging module is used for judging the response of actions made by personnel to the display image.
2. The virtual simulation display system based on the multiple information fusion technology according to claim 1, wherein the display point scanning unit comprises a space scanning module, a space model building module and a display position frame selection module, the output end of the space scanning module is in communication connection with the input end of the space model building module, and the output end of the space model building module is in communication connection with the input end of the display position frame selection module;
the space scanning module is used for scanning the displayed space position;
the space model building module is used for performing space model building processing on the scanned image;
the display position frame selection module is used for selecting a range to be displayed in the space model.
3. The virtual simulation display system based on the multi-element information fusion technology according to claim 2, wherein the display positioning unit comprises a position filling module, a three-dimensional display parameter adjusting module and a multi-dimensional display parameter adjusting module, the output end of the position filling module is in communication connection with the input end of the three-dimensional display parameter adjusting module, and the three-dimensional display parameter adjusting module is in bidirectional connection with the multi-dimensional display parameter adjusting module;
the position filling module is used for carrying out selected filling processing on the projection display position;
the three-dimensional display parameter adjusting module is used for adjusting the displayed three-dimensional image parameters;
the multi-dimensional display parameter adjusting module is used for adjusting and processing the displayed multi-dimensional image parameters.
4. The virtual simulation display system based on the multi-element information fusion technology according to claim 3, wherein the display positioning unit is bidirectionally connected with a display adjusting unit, the display adjusting unit is used for adjusting displayed images, the display adjusting unit comprises an image stretching module and a display adjusting module, and the image stretching module is bidirectionally connected with the display adjusting module;
the image stretching module is used for carrying out position stretching adjustment treatment on the displayed image;
the display adjusting module is used for adjusting the brightness and the color saturation of the display image.
5. The virtual simulation display system based on the multi-element information fusion technology according to claim 4, wherein the simulation scene simulation space is bidirectionally connected with a multi-dimensional projection module, and the multi-dimensional projection module is used for performing multi-dimensional projection display processing on an image.
6. The virtual simulation display system based on the multi-element information fusion technology according to claim 5, wherein the display interaction unit comprises an interactive personnel monitoring module, a personnel information verification module and a user visual angle acquisition module, the output end of the interactive personnel monitoring module is in communication connection with the input end of the personnel information verification module, and the output end of the personnel information verification module is in communication connection with the input end of the user visual angle acquisition module;
the interactive personnel monitoring module is used for monitoring and processing personnel appearing during display;
the personnel information verification module is used for verifying and processing personnel information of personnel when interaction occurs;
the user visual angle acquisition module is used for carrying out simulated image acquisition processing on the visual angle of personnel interaction.
7. The virtual simulation display system based on the multi-element information fusion technology according to claim 6, wherein the motion interaction unit comprises a human motion recognition module and a motion capture module, and the human motion recognition module is in bidirectional connection with the motion capture module;
the human body action recognition module is used for recognizing and processing the human body actions when the human body actions are performed on the human body;
the motion capture module is used for carrying out real-time dynamic capture processing on limb motions made by personnel and carrying out display image change processing according to the personnel motions.
8. The virtual simulation display system based on the multi-element information fusion technology according to claim 7, wherein the personnel action judging module is bidirectionally connected with a linkage display unit, and the linkage display unit is used for carrying out linkage change processing on the multi-dimensional holographic display according to limb actions made by personnel.
9. The virtual simulation display system based on the multi-information fusion technology according to claim 8, wherein the linkage display unit is bidirectionally connected with a video linkage module, the linkage display unit is bidirectionally connected with an audio linkage module, and the linkage display unit is bidirectionally connected with a product linkage module;
the video linkage module is used for carrying out linkage processing on the display video according to the limb movements of the personnel;
the audio linkage module is used for carrying out linkage processing on the audio according to the limb movements of the personnel;
the product linkage module is used for carrying out linkage treatment on the display products according to the limb movements of the personnel.
10. A virtual simulation display platform based on a multi-element information fusion technology, which comprises a display server and at least one multi-dimensional holographic display system as claimed in any one of claims 1 to 9, wherein the multi-dimensional holographic display system is in communication connection with the display server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310433690.9A CN116449956A (en) | 2023-04-21 | 2023-04-21 | Virtual simulation display system and platform based on multiple information fusion technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310433690.9A CN116449956A (en) | 2023-04-21 | 2023-04-21 | Virtual simulation display system and platform based on multiple information fusion technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116449956A true CN116449956A (en) | 2023-07-18 |
Family
ID=87119965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310433690.9A Pending CN116449956A (en) | 2023-04-21 | 2023-04-21 | Virtual simulation display system and platform based on multiple information fusion technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116449956A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117492688A (en) * | 2023-12-06 | 2024-02-02 | 北京瑞迪欧文化传播有限责任公司 | Cross-platform multi-screen interaction method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107632700A (en) * | 2017-08-01 | 2018-01-26 | 中国农业大学 | A kind of farm implements museum experiencing system and method based on virtual reality |
| CN109144275A (en) * | 2018-09-25 | 2019-01-04 | 咸阳师范学院 | A kind of non-material cultural heritage Digital Display system and method |
| KR102505666B1 (en) * | 2021-12-30 | 2023-03-03 | 주식회사 닷밀 | A device that performs rendering optimized for the viewer's point of view in a specific location to provide ultra-realistic content |
-
2023
- 2023-04-21 CN CN202310433690.9A patent/CN116449956A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107632700A (en) * | 2017-08-01 | 2018-01-26 | 中国农业大学 | A kind of farm implements museum experiencing system and method based on virtual reality |
| CN109144275A (en) * | 2018-09-25 | 2019-01-04 | 咸阳师范学院 | A kind of non-material cultural heritage Digital Display system and method |
| KR102505666B1 (en) * | 2021-12-30 | 2023-03-03 | 주식회사 닷밀 | A device that performs rendering optimized for the viewer's point of view in a specific location to provide ultra-realistic content |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117492688A (en) * | 2023-12-06 | 2024-02-02 | 北京瑞迪欧文化传播有限责任公司 | Cross-platform multi-screen interaction method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Kim et al. | Vrsa net: Vr sickness assessment considering exceptional motion for 360 vr video | |
| US20200023157A1 (en) | Dynamic digital content delivery in a virtual environment | |
| US9030486B2 (en) | System and method for low bandwidth image transmission | |
| WO2021229415A1 (en) | Method and system for virtual 3d communications | |
| WO2019041351A1 (en) | Real-time aliasing rendering method for 3d vr video and virtual three-dimensional scene | |
| CN110418095B (en) | Virtual scene processing method and device, electronic equipment and storage medium | |
| US20220005249A1 (en) | Generating an Animation Rig for Use in Animating a Computer-Generated Character Based on Facial Scans of an Actor and a Muscle Model | |
| CN110175534A (en) | Teaching assisting system based on multitask concatenated convolutional neural network | |
| CN116449956A (en) | Virtual simulation display system and platform based on multiple information fusion technology | |
| CN107481067B (en) | Intelligent advertisement system and interaction method thereof | |
| EP3718086A1 (en) | Avatar animation | |
| CN115272570A (en) | Virtual expression generation method and device, electronic equipment and storage medium | |
| CN114821675B (en) | Object processing method and system and processor | |
| CN109246412A (en) | A kind of operating room record system and method, operating room | |
| CN115442658B (en) | Live broadcast method, live broadcast device, storage medium, electronic equipment and product | |
| KR20240111732A (en) | Method and system for generating emotional interactive digital human tutor | |
| Chen et al. | Sound to visual: Hierarchical cross-modal talking face video generation | |
| CN111399662B (en) | Human-robot interaction simulation device and method based on high-reality virtual avatar | |
| US11875504B2 (en) | Systems and methods for building a muscle-to-skin transformation in computer animation | |
| Ladwig et al. | Unmasking Communication Partners: A Low-Cost AI Solution for Digitally Removing Head-Mounted Displays in VR-Based Telepresence | |
| Wolff et al. | Communicating eye gaze across a distance without rooting participants to the spot | |
| US20220076409A1 (en) | Systems and Methods for Building a Skin-to-Muscle Transformation in Computer Animation | |
| US20230139989A1 (en) | Videoconference method and videoconference system | |
| CN205486164U (en) | Novel people's face 3D expression action identification system | |
| Mehrubeoglu et al. | Capturing reading patterns through a real-time smart camera iris tracking system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20230718 |