CN115984437A - Interactive three-dimensional stage simulation system and method - Google Patents
Interactive three-dimensional stage simulation system and method Download PDFInfo
- Publication number
- CN115984437A CN115984437A CN202211252953.8A CN202211252953A CN115984437A CN 115984437 A CN115984437 A CN 115984437A CN 202211252953 A CN202211252953 A CN 202211252953A CN 115984437 A CN115984437 A CN 115984437A
- Authority
- CN
- China
- Prior art keywords
- stage
- control unit
- interactive
- actor
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention relates to the technical field of augmented reality, in particular to an interactive three-dimensional stage simulation system and method. The method specifically comprises the steps of controlling a stage scene through a stage lighting control unit and a stage sound effect control unit, establishing a 3D holographic projection image through a 3D holographic projection rendering unit in the stage scene, transmitting the 3D holographic projection image to a data interaction control unit, and acquiring actor deduction data collected by an identification equipment control unit to perform real-time interaction between the 3D holographic projection image and actors, so that the stage display effect is improved. The traditional deduction local action and characteristic point identification of the invention is improved into integral deduction action identification, the identification precision of the actor deduction characteristic is improved, and the matching of the light data and the sound effect data is added to further improve the switching response speed of the virtual scene in the interactive process and improve the instantaneity of the interaction.
Description
Technical Field
The invention relates to the technical field of Augmented Reality (AR), and IPC classification numbers are as follows: G03B35/20, in particular to an interactive three-dimensional stage simulation system and method.
Background
At the present stage, along with the development of virtual reality and augmented reality, the construction and the design mode of the scene are gradually changed from the direction development of the entity design to the combination of virtual reality and real reality, and compared with the traditional projection mode which needs to bear the background, the 3D holographic projection technology has the advantages of more flexible use scene, stronger created effect immersion, and further deepening the experience depth of visitors. However, the traditional 3D holographic projection method is only the release of images and the combination of images and the environment, and the interactivity with visitors is not strong in the actual use process, and meanwhile, because the data volume of 3D projection is large in the early modeling, the switching response speed of a virtual scene in the interactive process is poor and the interaction instantaneity is low in the actual display interactive process, so that the method cannot be combined with the deduction action in the stage scene in a large stage or a specific display scene.
The patent CN201811488432 provides an augmented reality operation method of the yellow plum drama, and the method is used for further improving the reality degree of the yellow plum drama by modeling and projecting the real scene information in the patent. However, in the merged video operation in the real environment described in this patent, the overall scene data amount is too large, and the requirement of the scene projection on the light and shadow is high, so that there may be problems that the projected scene image is not meditation and the modeling cost is high.
Patent CN201510834854 provides an augmented reality technology-based stage performance aided training method and system, the augmented reality in this patent is mainly used for performing motion correction on stage performers, but in this patent, because left and right eye cameras are respectively arranged for acquiring real scenes, on the contrary, deviation may occur in the process of aligning scenes by two cameras, thereby affecting scene fusion accuracy.
The invention provides an interactive three-dimensional stage simulation system and method, aiming at the problems in the stage simulation fusion process in the existing three-dimensional virtual scene.
Disclosure of Invention
Aiming at the existing problems, the invention provides an interactive three-dimensional stage simulation system and method, which comprises a data interaction control unit, an identification device control unit, a 3D holographic projection rendering unit, a stage lighting control unit and a stage sound effect control unit, and specifically comprises the steps of controlling a stage scene through the stage lighting control unit and the stage sound effect control unit, establishing a 3D holographic projection image through the 3D holographic projection rendering unit in the stage scene, transmitting the 3D holographic projection image to the data interaction control unit, and acquiring actor deduction data collected by the identification device control unit for real-time interaction of the 3D holographic projection image and actors, thereby improving the stage display effect.
Preferably, the data interaction control unit comprises a data information input unit, a data information processing unit and a data information output unit.
Preferably, an interactive three-dimensional stage simulation method is established in the interactive three-dimensional stage simulation system and method; and establishing a three-dimensional environment map and carrying out rasterization processing on the three-dimensional environment map in the stage scene.
Preferably, the identification device control unit comprises a binocular vision sensor, an infrared sensor and an acceleration sensor.
Preferably, after the position data of the actor is positioned in the three-dimensional environment map, the binocular vision sensor respectively identifies the body characteristics of the actor in the stage scene.
Preferably, the actor movement action characteristics in the stage scene are generated by integrating the actor body characteristics.
Specifically, the control transformation of the 3D holographic projection image is carried out by transmitting the motion and action characteristics of the actor to a data interaction control unit.
Preferably, the 3D holographic projection image obtains actor movement characteristics through a binocular vision sensor, and generates a corresponding 3D holographic projection image.
Preferably, in the actor movement features, by extracting designated feature points under actor movement motion features, position coordinates of the designated feature points are marked in the three-dimensional environment map.
Preferably, a distance constraint relationship is established between the position coordinates and the generated 3D holographic projection image, so that the 3D holographic projection image is controlled to change along with the change of the specified feature points.
Preferably, stage lighting control unit be used for exporting light data, stage audio effect control unit be used for exporting audio data, light data and audio data carry out auxiliary control to 3D holographically projected image's image transformation.
Specifically, the audio data presets 3D holographic projection images corresponding to the audio data under different amplitudes in the data interaction control unit, and in an actual stage scene, the 3D holographic projection images perform corresponding image transformation according to the transformation of the collected audio amplitude.
Compared with the prior art, the invention has the beneficial effects that:
in the interactive three-dimensional stage simulation system and the interactive three-dimensional stage simulation method, the stage lighting control unit and the stage sound effect control unit are added, so that the interactive relevance between the 3D holographic projection rendering and the actors in the stage environment is improved, and in a large stage or a specific display scene, a plurality of control elements such as actor movement action characteristics, audio data and light data are combined with the 3D holographic projection image to be better combined with deduction actions in the stage scene, so that the stage scene display interactive effect is improved; the actor motion characteristics improve the traditional deduction local action and characteristic point identification into integral deduction action identification, improve the identification precision of the actor deduction characteristics, and are matched with the light data and the sound effect data to further improve the switching response speed of the virtual scene in the interaction process and improve the instantaneity of interaction.
Drawings
Fig. 1 is a block diagram of an interactive three-dimensional stage simulation system and method.
Detailed Description
Example 1:
in this embodiment, the interactive three-dimensional stage simulation system and method, as shown in fig. 1, include a data interaction control unit, an identification device control unit, a 3D holographic projection rendering unit, a stage lighting control unit, and a stage sound effect control unit, and specifically include controlling a stage scene by the stage lighting control unit and the stage sound effect control unit, establishing a 3D holographic projection image by the 3D holographic projection rendering unit in the stage scene, transmitting the 3D holographic projection image to the data interaction control unit, and acquiring actor performance data collected by the identification device control unit, so as to perform real-time interaction between the 3D holographic projection image and an actor, thereby improving a stage display effect.
The data interaction control unit is used for integrating and controlling the acquired stage information and the acquired projection image information; the identification equipment control unit is used for collecting stage information and identifying stage characteristics by controlling the system use of relevant devices in the stage scene; the 3D holographic projection rendering unit is used for constructing a three-dimensional environment map and modeling and rendering a 3D holographic projection image; the stage lighting control unit is used for controlling light, outputting light control data, acquiring light projection position data of light falling in a three-dimensional environment map according to the light control data, and interacting with the 3D holographic projection image through the light projection position data; stage audio effect control unit for the background audio of preset stage to carry out the key point to the background audio data of stage and draw, be drawed through discernment the key point amplitude for carry out the interact with 3D holographically projected image.
The data interaction control unit comprises a data information input unit, a data information processing unit and a data information output unit.
The data information input unit is used for acquiring stage information collected in the identification equipment control unit, the data information processing unit is used for decoding and registering the stage information and transmitting the processed stage information to the 3D holographic projection rendering unit, the 3D holographic projection rendering unit is used for acquiring the processed stage information, calling a corresponding 3D holographic projection image model for dynamic control, transmitting dynamic control data to the data information output unit for output and displaying in the stage environment.
And in the stage scene, establishing a three-dimensional environment map and carrying out rasterization processing on the three-dimensional environment map.
The rasterization processing is used for marking the height information of the movement action characteristics of actors by establishing a three-dimensional environment grid, and fusing the height information and the plane position information with each other to improve the positioning precision of the 3D holographic projection image in a stage scene; after modeling of the three-dimensional environment grid in the appointed stage scene is completed, repeated calling can be carried out, and model reconstruction is not required to be carried out again.
The identification equipment control unit comprises a binocular vision sensor, an infrared sensor and an acceleration sensor.
The infrared sensor is used for performing auxiliary compensation on actor pose information identified by the binocular vision sensor by identifying dynamic position data of actors in a stage scene; the acceleration sensor is a motion recognition sensor fixed in an appointed point of the actor body and used for acquiring the motion speed, the acceleration and the angular acceleration data of each limb of the actor in the deduction process in real time, and the acceleration sensor is used for dynamically controlling the linkage speed of the 3D holographic projection image by establishing a speed constraint relation with the 3D holographic projection image so as to generate the effect of flexible transformation.
The 3D holographic projection image acquires actor movement action characteristics through a binocular vision sensor, and generates a corresponding 3D holographic projection image.
The 3D holographic projection image can also be subjected to audience interaction control based on the outside of a stage scene; the actor movement action characteristics are overall structure characteristics in the actor deduction process, the overall structure characteristics are compared with local characteristic identification and local joint point transformation identification, the characteristic identification effect is better, and meanwhile, when multiple repeated actions exist in the actor deduction process, the actor movement action characteristics are combined with audio data and light data at specific moments to distinguish different 3D holographic projection images, and meanwhile, different distance constraint relations and speed constraint relations are established on the basis.
Claims (10)
1. The utility model provides an interactive three-dimensional stage analog system, including the data interaction the control unit, identification equipment the control unit, 3D holographically projected renders up the unit, stage lighting control unit, stage audio the control unit, a serial communication port, specifically include through stage lighting control unit and stage audio the control unit control stage scene, render up the unit through 3D holographically projected and establish 3D holographically projected image in the stage scene, convey 3D holographically projected image to the data interaction the control unit in, and acquire the actor deduction data that identification equipment the control unit gathered, be used for carrying out the real-time interaction of 3D holographically projected image and actor, thereby improve stage show effect.
2. An interactive three-dimensional stage simulation system according to claim 1, wherein the data interaction control unit comprises a data information input unit, a data information processing unit and a data information output unit.
3. An interactive three-dimensional stage simulation system according to claim 1, wherein the recognition device control unit comprises a binocular vision sensor, an infrared sensor and an acceleration sensor.
4. An interactive three-dimensional stage simulation system according to claim 3, wherein an interactive three-dimensional stage simulation method is established in the interactive three-dimensional stage simulation system; and establishing a three-dimensional environment map and carrying out rasterization processing on the three-dimensional environment map in the stage scene.
5. An interactive three-dimensional stage simulation method according to claim 4, wherein the binocular vision sensor is used for identifying the body characteristics of the actor in the stage scene after positioning the position data of the actor in the three-dimensional environment map.
6. An interactive three-dimensional stage simulation method according to claim 5, wherein the actor body characteristics are integrated to generate actor movement characteristics in the stage scene.
7. An interactive three-dimensional stage simulation method according to claim 4, wherein the 3D holographic projection images are generated by acquiring actor movement characteristics through a binocular vision sensor and generating corresponding 3D holographic projection images.
8. An interactive three-dimensional stage simulation method according to claim 6, wherein the actor moving motion characteristics are extracted from designated feature points under the actor moving motion characteristics, and position coordinates of the designated feature points are marked in the three-dimensional environment map.
9. An interactive three-dimensional stage simulation method according to claim 8, wherein the actor movement characteristics are characterized in that the position coordinates and the generated 3D holographically projected image are in a distance constraint relationship, so as to control the 3D holographically projected image to change with the change of the designated characteristic points.
10. An interactive three-dimensional stage simulation method according to claim 4, wherein the stage lighting control unit is configured to output lighting data, the stage sound effect control unit is configured to output audio data, and the lighting data and the audio data assist in controlling image transformation of the 3D holographically projected image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211252953.8A CN115984437A (en) | 2022-10-13 | 2022-10-13 | Interactive three-dimensional stage simulation system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211252953.8A CN115984437A (en) | 2022-10-13 | 2022-10-13 | Interactive three-dimensional stage simulation system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115984437A true CN115984437A (en) | 2023-04-18 |
Family
ID=85957059
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211252953.8A Pending CN115984437A (en) | 2022-10-13 | 2022-10-13 | Interactive three-dimensional stage simulation system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115984437A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117794030A (en) * | 2024-02-27 | 2024-03-29 | 深圳市金鼎胜照明有限公司 | Concert scene lamp group coordination control method, device, equipment and medium |
-
2022
- 2022-10-13 CN CN202211252953.8A patent/CN115984437A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117794030A (en) * | 2024-02-27 | 2024-03-29 | 深圳市金鼎胜照明有限公司 | Concert scene lamp group coordination control method, device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106363637B (en) | A kind of quick teaching method of robot and device | |
| WO2020228644A1 (en) | Ar scenario-based gesture interaction method and apparatus, storage medium, and communication terminal | |
| US11538229B2 (en) | Image processing method and apparatus, electronic device, and computer-readable storage medium | |
| CN106157359B (en) | Design method of virtual scene experience system | |
| US20150301596A1 (en) | Method, System, and Computer for Identifying Object in Augmented Reality | |
| US20140176607A1 (en) | Simulation system for mixed reality content | |
| CN105528082A (en) | Three-dimensional space and hand gesture recognition tracing interactive method, device and system | |
| CN103578135A (en) | Virtual image and real scene combined stage interaction integrating system and realizing method thereof | |
| CN103258338A (en) | Method and system for driving simulated virtual environments with real data | |
| CN102508363A (en) | Wireless display glasses based on augmented-reality technology and implementation method for wireless display glasses | |
| CN110211222B (en) | AR immersion type tour guide method and device, storage medium and terminal equipment | |
| CN203746012U (en) | Three-dimensional virtual scene human-computer interaction stereo display system | |
| CN206105869U (en) | Quick teaching apparatus of robot | |
| CN110568923A (en) | unity 3D-based virtual reality interaction method, device, equipment and storage medium | |
| KR20200134575A (en) | System and method for ballet performance via augumented reality | |
| CN203630822U (en) | Virtual image and real scene combined stage interaction integrating system | |
| CN115984437A (en) | Interactive three-dimensional stage simulation system and method | |
| KR101641672B1 (en) | The system for Augmented Reality of architecture model tracing using mobile terminal | |
| Soares et al. | Designing a highly immersive interactive environment: The virtual mine | |
| CN112927355A (en) | VR virtual building system and bidirectional real-time synchronization method thereof | |
| CN111881807A (en) | VR conference control system and method based on face modeling and expression tracking | |
| CN117333644A (en) | Virtual reality display picture generation method, device, equipment and medium | |
| CN112288876A (en) | Long-distance AR identification server and system | |
| CN110298918A (en) | One kind is based on GPU real-time three-dimensional modeling display device and three-dimensional modeling display methods | |
| CN214959905U (en) | Multi-camera combined imaging technology applied to VR (virtual reality), AR (augmented reality) or MR (magnetic resonance) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |