CN114510150A - Experience system of virtual digital world - Google Patents
Experience system of virtual digital world Download PDFInfo
- Publication number
- CN114510150A CN114510150A CN202210146958.6A CN202210146958A CN114510150A CN 114510150 A CN114510150 A CN 114510150A CN 202210146958 A CN202210146958 A CN 202210146958A CN 114510150 A CN114510150 A CN 114510150A
- Authority
- CN
- China
- Prior art keywords
- user
- world
- equipment
- virtual
- cloud server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000009471 action Effects 0.000 claims description 28
- 230000003993 interaction Effects 0.000 claims description 12
- 210000004556 brain Anatomy 0.000 claims description 10
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 7
- 238000004088 simulation Methods 0.000 claims description 6
- 230000035790 physiological processes and functions Effects 0.000 claims description 5
- 206010027476 Metastases Diseases 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 5
- 238000007654 immersion Methods 0.000 abstract description 4
- 230000007547 defect Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000000034 method Methods 0.000 description 7
- 238000011161 development Methods 0.000 description 4
- 230000010365 information processing Effects 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 230000035807 sensation Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 230000005484 gravity Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 206010012335 Dependence Diseases 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 230000004962 physiological condition Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- G01D21/00—Measuring or testing not otherwise provided for
- G01D21/02—Measuring two or more variables by means not covered by a single other subclass
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/225—Feedback of the input speech
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Neurology (AREA)
- Dermatology (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Biomedical Technology (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses an experience system of a virtual digital world, which comprises a panoramic shooting terminal, an experience bin and a cloud server, wherein the panoramic shooting terminal and the experience bin are connected with the cloud server through a network. The experience system of the virtual digital world provided by the invention enables the metacavity digital world and the real world to be better fused, the user experience sense is better, the immersion sense and the reality sense are stronger, and the clumsy sense and the unrealistic sense brought to the user by the traditional VR/AR technology are eliminated; the problems that various information of a user cannot be acquired simultaneously in real time, the environment condition of the metauniverse virtual world cannot be reproduced really and a shot and acquired real scene cannot be reproduced really in the traditional technical scheme are solved; the technical scheme constructs an interconnected and intercommunicated meta universe, really arouses ultrahigh market potential and provides assistance for the progress of the social productivity in China.
Description
Technical Field
The invention relates to the technical field of meta universe, in particular to an experience system of a virtual digital world.
Background
The metasystem is a digital world that clones or mimics elements of the physical real world. Currently, a user in reality wants to enter the metauniverse virtual digital world, and the method is generally realized by wearing a VR helmet or wearing intelligent glasses. The prior art has the following defects:
defect one: the image display is only limited to the glasses part, and the immersion and reality are seriously insufficient;
and defect two: the user experience is seriously influenced by the heavy and heavy wearing of the helmet or the glasses, and the cervical vertebra fatigue is easily caused;
and a third defect: the whole model data of people or objects cannot be captured in real time;
and a fourth defect: the relative information of the motion, the expression and the like of people or objects cannot be acquired in real time;
and defect five: environmental conditions of the virtual world of the Yuanzhou cannot be better simulated, such as sound, temperature, smell, wind power, gravity, vibration and the like;
and a sixth defect: the collected and shot real world scene cannot be better restored;
and a seventh defect: the current metastic technology has no unified standard and platform, can not be interconnected and communicated, and can not realize market value and application value.
Disclosure of Invention
In view of the defects in the prior art, the present invention provides an experience system of a virtual digital world to solve at least one of the technical problems mentioned in the background above.
An experience system of a virtual digital world comprises a panoramic shooting terminal, an experience bin and a cloud server; wherein,
the panoramic shooting terminal is connected with the cloud server through a network and is used for shooting and collecting preset scene data in the real world and uploading the collected preset scene data to the cloud server;
the experience bin comprises a bin body, wherein a wrapping type display device, a virtual world environment reproduction device, a user action expression and model acquisition device, a user physiological data acquisition device, a sound acquisition device and a brain-computer interface device are arranged in the bin body; the packaged display equipment, the virtual world environment reproduction equipment, the user action expression and model acquisition equipment, the user physiological data acquisition equipment, the sound acquisition equipment and the brain-computer interface equipment are all connected with the cloud server through a network; the packaged display equipment is used for displaying the images of the meta-universe virtual world at 720 degrees; the virtual world environment reproduction device is used for simulating and reproducing the situation of the meta-universe environment; the user action expression and model acquisition equipment is used for acquiring user action expression and model data and uploading the user action expression and model data to the cloud server; the user physiological data acquisition equipment is used for acquiring physiological data of a user and uploading the physiological data of the user to the cloud server; the sound collection equipment is used for receiving voice input of a user and uploading the voice input of the user to the cloud server; the brain-computer interface equipment is used for acquiring the human brain signals of the user and uploading the human brain signals of the user to the cloud server;
the cloud server is used for fusing the preset scene data and the virtual world to generate a holographic image signal, and sending the holographic image signal to the wrapped display equipment for display; the environment data of the virtual world of the meta universe or the environment data of the real world collected by the panoramic shooting terminal are sent to the virtual world environment reproduction equipment for simulation reproduction; the system is also used for fusing the user action expression and the model data with the metauniverse virtual world according to a preset mode; the physiological state monitoring module is also used for monitoring the physiological state of the user according to the physiological data of the user; the voice interaction module is also used for carrying out voice interaction with the user according to the voice input of the user; the device is also used for generating a control instruction according to the human brain signal simulation of the user;
and a metastic connection platform for connecting the user with a plurality of different metastases is operated in the cloud server.
Further, the panorama shooting terminal includes base, vibrations sensor, wireless communication module, temperature sensor and the installed part that from the bottom up set gradually, be provided with sound collector, camera, smell sensor, wind sensor and radar sensor on the installed part.
Further, the camera is super wide angle panorama camera.
Further, the wrapping type display equipment comprises a surrounding type curved surface display screen arranged in the middle of the bin body, a top display screen arranged at the top of the bin body and a bottom display screen arranged at the bottom of the bin body.
Further, the virtual world environment reproduction device comprises a loudspeaker, a pinhole-type air outlet, a pinhole-type air conditioner outlet and a vibrator;
the loudspeaker and the vibrator are arranged on the back of the surrounding type curved surface display screen, the back of the top display screen and the back of the bottom display screen;
the pinhole type air outlet and the pinhole type air conditioner opening are arranged on the back of the top display screen and the back of the bottom display screen.
Further, user action expression and model acquisition equipment includes camera and radar sensor under the screen, camera and radar sensor all set up under the screen on the surrounding type curved surface display screen.
Further, user physiological data collection equipment includes wearing formula intelligence bracelet.
Further, the top display screen back is provided with wireless signal receiving and dispatching antenna, wireless signal receiving and dispatching antenna with wearing formula intelligence bracelet and other wearing auxiliary assembly communication connection.
Further, sound collection equipment includes the microphone, the microphone is installed surround formula curved surface display screen back.
Further, an equipment cabin is arranged on the back face of the bottom display screen, and control equipment is installed in the equipment cabin.
The invention has the beneficial effects that:
the experience system of the virtual digital world provided by the invention enables the metacavity digital world and the real world to be better fused, the user experience sense is better, the immersion sense and the reality sense are stronger, and the clumsy sense and the unrealistic sense brought to the user by the traditional VR/AR technology are eliminated; the problems that various information of a user cannot be acquired simultaneously in real time, the environment condition of the metauniverse virtual world cannot be reproduced really and a shot and acquired real scene cannot be reproduced really in the traditional technical scheme are solved; the technical scheme constructs an interconnected and intercommunicated meta universe, really arouses ultrahigh market potential and provides assistance for the progress of the social productivity in China.
Drawings
In order to more clearly illustrate the detailed description of the invention or the technical solutions in the prior art, the drawings that are needed in the detailed description of the invention or the prior art will be briefly described below. Throughout the drawings, like elements or portions are generally identified by like reference numerals. In the drawings, elements or portions are not necessarily drawn to scale.
FIG. 1 is an architecture diagram of an experience system of a virtual digital world according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a panoramic shooting terminal of an experience system of a virtual digital world according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of an experience cabin of an experience system of a virtual digital world according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a back structure of a top display screen of an experience system of a virtual digital world according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a virtual digital world experience system according to an embodiment of the present invention after a display screen with a surrounding curved surface is unfolded;
FIG. 6 is a schematic back structural diagram of a bottom display screen of an experience system of a virtual digital world according to an embodiment of the present invention;
fig. 7 is a block diagram of a virtual module structure of a cloud server of an experience system of a virtual digital world according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby.
It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which the invention pertains.
As shown in fig. 1, an experience system of a virtual digital world provided by an embodiment of the present invention includes a panorama shooting terminal, an experience bin, and a cloud server. The panoramic shooting terminal is connected with the cloud server through a network and used for shooting and collecting preset scene data in the real world and uploading the collected preset scene data to the cloud server. The panoramic photographing terminal has a function of photographing and collecting data of a certain scene of the real world in an all-round manner, such as a conference site, a concert site, a sports match site, a tourist landscape site, an emergency site, and the like.
Specifically, in this embodiment, as shown in fig. 2, the panorama shooting terminal includes base 1, shock sensor 2, wireless communication module 3, temperature sensor 4 and installed part 5 that from the bottom up set gradually, be provided with sound collector 6, camera 7, odor sensor 8, wind sensor 9 and radar sensor 10 on the installed part 5.
And related control equipment is installed in the base 1. The vibration sensor 2 is used for acquiring a vibration signal of a site. The wireless communication module 3 is used for receiving and transmitting signals of auxiliary equipment and wearing equipment on site. The temperature sensor 4 is used for collecting field temperature information.
Installation part 5 is the cuboid form that longitudinal extension set up, sound collector 6 has 8, sets up respectively the lateral wall bottom and the lateral wall top of installation part 5 for gather the sound signal of equidirectional not. Camera 7 is super wide angle panorama camera 7, and in order to reach the requirement of resolution ratio, camera 7 is provided with 9, and 1 is installed at installation part 5 top, and all be provided with 2 on every lateral wall of installation part 5. The smell sensor 8 is used for gathering on-the-spot smell signal, and the smell sensor 8 is provided with 4, distributes respectively on four lateral walls of installed part 5. The wind sensor 9 is used for collecting field wind signals, and the wind sensors 9 are provided with 4 wind sensors which are respectively distributed on four side walls of the mounting part 5. The radar sensor 10 is used for assisting the collection of model data, and the radar sensor 10 is provided with 4, distributes respectively on four lateral walls of installed part 5.
The experience bin comprises a bin body 11, and a wrapping type display device, a virtual world environment reproduction device, a user action expression and model acquisition device, a user physiological data acquisition device, a sound acquisition device and a brain-computer interface device are arranged in the bin body 11; the packaged display equipment, the virtual world environment reproduction equipment, the user action expression and model acquisition equipment, the user physiological data acquisition equipment, the sound acquisition equipment and the brain-computer interface equipment are all connected with the cloud server through a network.
The packaged display equipment is used for displaying the images of the meta-universe virtual world at 720 degrees; the virtual world environment reproduction device is used for simulating and reproducing the situation of the meta-universe environment; the user action expression and model acquisition equipment is used for acquiring user action expression and model data and uploading the user action expression and model data to the cloud server; the user physiological data acquisition equipment is used for acquiring physiological data of a user and uploading the physiological data of the user to the cloud server; the voice acquisition equipment is used for receiving voice input of a user and uploading the voice input of the user to the cloud server; the brain-computer interface equipment is used for collecting brain signals of the user and uploading the brain signals of the user to the cloud server.
Specifically, in this embodiment, as shown in fig. 3, the wrapping display device includes a surrounding curved display screen 12 disposed in the middle of the cabin 11, a top display screen 13 disposed on the top of the cabin 11, and a bottom display screen 14 disposed on the bottom of the cabin 11.
The virtual world environment reproduction device is used for reproduction of the metauniverse environment conditions, including factors such as sound, temperature, smell, wind power, gravity, vibration and the like. The virtual world environment reproduction device comprises a loudspeaker 15, a pinhole-type air outlet, a pinhole-type air conditioner outlet and a vibrator 17. The speaker 15 is used for reproducing sound, the pinhole type air outlet is used for reproducing wind sensation and smell, the pinhole type air conditioner outlet is used for adjusting temperature and ventilating, and the vibrator 17 is used for reproducing vibration sensation in all directions. The pinhole type air outlet and the pinhole type air conditioning outlet are integrally arranged on an air outlet module 16.
As shown in fig. 4-6, the speaker 15 and the vibrator 17 are disposed on the back of the wrap around curved display 12, the top display 13 and the bottom display 14. The tuyere module 16 is disposed at the back of the top display 13 and the back of the bottom display 14.
The user action, expression and model acquisition equipment comprises a lower screen camera 18 and a radar sensor, wherein the lower screen camera 18 and the radar sensor are arranged on the surrounding type curved surface display screen 12. And scanning data such as action expression models of users in the cabin through equipment such as the under-screen camera 18 and the radar sensor. On one hand, the method is used for making a virtual human which has the same action expression as the user in the meta universe, on the other hand, the method is used for collecting information such as the action expression of the user and the like to finish interaction with the meta universe, for example, various actions of a game figure are controlled when a game is played, or new interaction needs are generated by other related application software in an experience bin display mode in the future.
The user physiological data acquisition equipment comprises a wearable intelligent bracelet. Top display screen 13 back is provided with wireless signal receiving and dispatching antenna 19, wireless signal receiving and dispatching antenna 19 with wearing formula intelligence bracelet communication connection receives the user physiological data that wearing formula intelligence bracelet was gathered through wireless signal receiving and dispatching antenna 19, and user physiological data includes data such as user's rhythm of the heart, body temperature, mood.
Sound collection device 20 includes a microphone mounted on the back of wrap-around curved display screen 12. Sound collection device 20 enables intelligent voice interaction of the user with the experience cabin. The back of the bottom display screen 14 is also provided with an equipment cabin 21 and a wireless signal transceiving antenna 19, and control equipment is installed in the equipment cabin 21. The back of the bottom display screen 14 is also provided with an air suction opening for sucking air in the bin body 11 to complete air circulation.
As shown in fig. 7, the cloud server includes a panoramic image display and splicing processing module, an environmental factor control feedback module, a user data acquisition and processing module, a life monitoring module, a voice interaction module, a brain-computer information processing module, a virtual-real combination enhanced information processing module, and an upgrade interface processing module.
The panoramic image display and splicing processing module splices images acquired by the panoramic shooting terminal and images of the meta-space virtual scene according to the display requirements of the packaged display equipment to generate holographic image signals, and the holographic image signals are sent to the packaged display equipment to be displayed. And the environment factor control feedback module is used for sending environment data of a metauniverse virtual world or environment data of a real world collected by the panoramic shooting terminal to the virtual world environment reproduction equipment for simulation reproduction.
The user data acquisition and processing module is used for fusing the user action expression and the model data with the meta-universe virtual world according to a preset mode, for example: on one hand, the method is used for making a virtual human with the same action and expression as the user in the meta universe, on the other hand, the method is used for collecting information such as the action of the user and the like to finish interaction with the meta universe, for example, various actions of a game figure are controlled when a game is played, or new interaction needs are generated by other related application software in an experience cabin display mode in the future. The life monitoring module is used for monitoring the physiological state of the user according to the physiological data of the user, monitoring the physiological condition of the user, preventing danger from happening and excessive addiction, and ensuring the life health of the user in the Yuanzhou world. The voice interaction module is used for performing voice interaction with the user according to the voice input of the user. The brain-computer information processing module is also used for generating a control instruction according to the human brain signal simulation of the user and processing simple human brain reflection information. The upgrading interface processing module is used for upgrading more functions after the technology of the subsequent brain-computer interface is mature. The virtual-real combined augmented information processing module is mainly used for processing the fusion augmentation of the acquired real environment information and the virtual world.
Further, a metastic connection platform for connecting the user with a plurality of different metastases is operated in the cloud server. In the future, there will be a variety of metastables, such as metastables games, metastables office, metastables social, metastables shopping, and so on. In order to achieve interconnection and intercommunication, a user can conveniently and quickly enter a certain meta universe, or the user can quickly find a needed meta universe, a unified meta universe connection platform is needed, and the unified meta universe connection platform is a bridge and a door of a real world and a meta universe virtual world, wherein one end of the unified meta universe connection platform is connected with the user, and the other end of the unified meta universe connection platform is connected with the meta universe virtual world.
The main functional design of the meta-universe connection platform provided by the embodiment is as follows: the user unified identity system authentication, namely the user shuttles to each meta space, does not need to perform identity registration authentication of each meta space, and only needs to use unified identity authentication. For example, the "face and body biometric ID" identification may be used as an account key for entering the universe of elements, and as a payment key. The method is beneficial to development of the metas of each enterprise, does not need to rebuild an identity system, saves the cost and improves the efficiency. The method is beneficial to the user to quickly and conveniently use various application scenes of the metauniverse. And secondly, user model data are shared, and a user can use the system in each meta universe immediately after scanning and modeling without scanning and other work. And establishing unified development and access standard of the meta-space. Taking the development of the metachronic game as an example, compared with the traditional game, the development of the metachronic game needs to expand more game data, the traditional game is flat two-dimensional display, the metachronic game is 720-degree immersive display, and for example, the wind sensation, the earthquake sensation, the smell, the gravity and the surround sound effect parameters which are not available in the traditional game can become unified industrial standards.
In conclusion, the virtual digital world experience system provided by the invention enables the metauniverse digital world to be better fused with the real world, so that the user experience sense is better, the immersion sense and the sense of reality are stronger, and the sense of awkwardness and the sense of unreality brought to the user by the traditional VR/AR technology are eliminated; the problems that various information of a user cannot be acquired simultaneously in real time, the environment condition of the metauniverse virtual world cannot be reproduced really and a shot and acquired real scene cannot be reproduced really in the traditional technical scheme are solved; the technical scheme constructs an interconnected and intercommunicated meta universe, really arouses ultrahigh market potential and provides assistance for the progress of the social productivity in China.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.
Claims (10)
1. A virtual digital world experience system, comprising: the system comprises a panoramic shooting terminal, an experience bin and a cloud server; wherein,
the panoramic shooting terminal is connected with the cloud server through a network and is used for shooting and collecting preset scene data in the real world and uploading the collected preset scene data to the cloud server;
the experience bin comprises a bin body, wherein a wrapping type display device, a virtual world environment reproduction device, a user action expression and model acquisition device, a user physiological data acquisition device, a sound acquisition device and a brain-computer interface device are arranged in the bin body; the packaged display equipment, the virtual world environment reproduction equipment, the user action expression and model acquisition equipment, the user physiological data acquisition equipment, the sound acquisition equipment and the brain-computer interface equipment are all connected with the cloud server through a network; the packaged display equipment is used for displaying the images of the meta-universe virtual world at 720 degrees; the virtual world environment reproduction device is used for simulating and reproducing the situation of the meta-universe environment; the user action expression and model acquisition equipment is used for acquiring user action expression and model data and uploading the user action expression and model data to the cloud server; the user physiological data acquisition equipment is used for acquiring physiological data of a user and uploading the physiological data of the user to the cloud server; the voice acquisition equipment is used for receiving voice input of a user and uploading the voice input of the user to the cloud server; the brain-computer interface equipment is used for acquiring a brain signal of a user and uploading the brain signal of the user to the cloud server;
the cloud server is used for fusing the preset scene data and the virtual world to generate a holographic image signal, and sending the holographic image signal to the wrapped display equipment for display; the environment data of the virtual world of the meta universe or the environment data of the real world collected by the panoramic shooting terminal are sent to the virtual world environment reproduction equipment for simulation reproduction; the system is also used for fusing the user action expression and the model data with the metauniverse virtual world according to a preset mode; the physiological state monitoring module is also used for monitoring the physiological state of the user according to the physiological data of the user; the voice interaction module is also used for carrying out voice interaction with the user according to the voice input of the user; the device is also used for generating a control instruction according to the human brain signal simulation of the user;
and a metastic connection platform for connecting the user with a plurality of different metastases is operated in the cloud server.
2. The experience system of the virtual digital world as claimed in claim 1, wherein: panorama shooting terminal includes base, vibrations sensor, wireless communication module, temperature sensor and the installed part that from the bottom up set gradually, be provided with sound collector, camera, smell sensor, wind sensor and radar sensor on the installed part.
3. The experience system of the virtual digital world as claimed in claim 2, wherein: the camera is super wide angle panorama camera.
4. The experience system of the virtual digital world as claimed in claim 1, wherein: the wrapping type display equipment comprises a surrounding type curved surface display screen arranged in the middle of the bin body, a top display screen arranged at the top of the bin body and a bottom display screen arranged at the bottom of the bin body.
5. The experience system of the virtual digital world as claimed in claim 4, wherein: the virtual world environment reproducing device comprises a loudspeaker, a pinhole type air outlet, a pinhole type air conditioner opening and a vibrator;
the loudspeaker and the vibrator are arranged on the back of the surrounding type curved surface display screen, the back of the top display screen and the back of the bottom display screen;
the pinhole type air outlet and the pinhole type air conditioner opening are arranged on the back of the top display screen and the back of the bottom display screen.
6. The experience system of the virtual digital world as claimed in claim 4, wherein: the user action expression and model acquisition equipment comprises a camera and a radar sensor under the screen, wherein the camera and the radar sensor are arranged on the surrounding type curved surface display screen.
7. The experience system of the virtual digital world as claimed in claim 4, wherein: the user physiological data acquisition equipment comprises a wearable intelligent bracelet.
8. The experience system of the virtual digital world as claimed in claim 7, wherein: the top display screen back is provided with wireless signal receiving and dispatching antenna, wireless signal receiving and dispatching antenna with wearing formula intelligence bracelet communication connection.
9. The experience system of the virtual digital world as claimed in claim 4, wherein: the sound collection equipment comprises a microphone, and the microphone is installed on the back of the surrounding type curved surface display screen.
10. The experience system of the virtual digital world as claimed in claim 4, wherein: the back of the bottom display screen is provided with an equipment cabin, and control equipment is installed in the equipment cabin.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210146958.6A CN114510150A (en) | 2022-02-17 | 2022-02-17 | Experience system of virtual digital world |
| PCT/CN2023/073838 WO2023155675A1 (en) | 2022-02-17 | 2023-01-30 | Virtual digital world experience system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210146958.6A CN114510150A (en) | 2022-02-17 | 2022-02-17 | Experience system of virtual digital world |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114510150A true CN114510150A (en) | 2022-05-17 |
Family
ID=81550912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210146958.6A Pending CN114510150A (en) | 2022-02-17 | 2022-02-17 | Experience system of virtual digital world |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114510150A (en) |
| WO (1) | WO2023155675A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114861211A (en) * | 2022-06-06 | 2022-08-05 | 广东工业大学 | Meta-universe scene-oriented data privacy protection method, system and storage medium |
| CN115239435A (en) * | 2022-08-08 | 2022-10-25 | 深圳市柔灵科技有限公司 | Supply chain management system and method for flexible wearable equipment based on metauniverse |
| CN116301386A (en) * | 2023-03-27 | 2023-06-23 | 深圳星火互娱数字科技有限公司 | Meta universe immersion type experience method and system |
| WO2023155675A1 (en) * | 2022-02-17 | 2023-08-24 | 李双江 | Virtual digital world experience system |
| CN116912444A (en) * | 2023-08-04 | 2023-10-20 | 深圳市固有色数码技术有限公司 | Meta-universe model generation system and method based on artificial intelligence |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105184622A (en) * | 2014-06-20 | 2015-12-23 | 南京大五教育科技有限公司 | Network shopping for consumer by utilization of virtual technology |
| CN106157359A (en) * | 2015-04-23 | 2016-11-23 | 中国科学院宁波材料技术与工程研究所 | A kind of method for designing of virtual scene experiencing system |
| CN107667331A (en) * | 2015-05-28 | 2018-02-06 | 微软技术许可有限责任公司 | Shared haptic interaction and user safety in shared space multi-person immersive virtual reality |
| US20180286134A1 (en) * | 2017-04-04 | 2018-10-04 | David Peter Warhol | System and method for creating an augmented reality interactive environment in theatrical structure |
| US20210263585A1 (en) * | 2018-06-29 | 2021-08-26 | Rama Krishna Aravind BOTTA | A system and a method to create extended reality using wearables and virtual environment set |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205210819U (en) * | 2015-11-06 | 2016-05-04 | 深圳信息职业技术学院 | Virtual reality human -computer interaction terminal |
| CN107340720A (en) * | 2017-07-19 | 2017-11-10 | 宋彦震 | Virtually with real world environments simulation system |
| CN108014490A (en) * | 2017-12-29 | 2018-05-11 | 安徽创视纪科技有限公司 | A kind of outdoor scene secret room based on MR mixed reality technologies |
| CN112905015B (en) * | 2021-03-08 | 2023-06-06 | 华南理工大学 | Meditation training method based on brain-computer interface |
| CN113946211A (en) * | 2021-10-14 | 2022-01-18 | 网易有道信息技术(江苏)有限公司 | Method for interacting multiple objects based on metauniverse and related equipment |
| CN114510150A (en) * | 2022-02-17 | 2022-05-17 | 李双江 | Experience system of virtual digital world |
-
2022
- 2022-02-17 CN CN202210146958.6A patent/CN114510150A/en active Pending
-
2023
- 2023-01-30 WO PCT/CN2023/073838 patent/WO2023155675A1/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105184622A (en) * | 2014-06-20 | 2015-12-23 | 南京大五教育科技有限公司 | Network shopping for consumer by utilization of virtual technology |
| CN106157359A (en) * | 2015-04-23 | 2016-11-23 | 中国科学院宁波材料技术与工程研究所 | A kind of method for designing of virtual scene experiencing system |
| CN107667331A (en) * | 2015-05-28 | 2018-02-06 | 微软技术许可有限责任公司 | Shared haptic interaction and user safety in shared space multi-person immersive virtual reality |
| US20180286134A1 (en) * | 2017-04-04 | 2018-10-04 | David Peter Warhol | System and method for creating an augmented reality interactive environment in theatrical structure |
| US20210263585A1 (en) * | 2018-06-29 | 2021-08-26 | Rama Krishna Aravind BOTTA | A system and a method to create extended reality using wearables and virtual environment set |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023155675A1 (en) * | 2022-02-17 | 2023-08-24 | 李双江 | Virtual digital world experience system |
| CN114861211A (en) * | 2022-06-06 | 2022-08-05 | 广东工业大学 | Meta-universe scene-oriented data privacy protection method, system and storage medium |
| CN114861211B (en) * | 2022-06-06 | 2024-06-07 | 广东工业大学 | Metadata scene-oriented data privacy protection method, system and storage medium |
| CN115239435A (en) * | 2022-08-08 | 2022-10-25 | 深圳市柔灵科技有限公司 | Supply chain management system and method for flexible wearable equipment based on metauniverse |
| CN115239435B (en) * | 2022-08-08 | 2024-02-02 | 深圳市柔灵科技有限公司 | Flexible wearable equipment supply chain management system and method based on meta universe |
| CN116301386A (en) * | 2023-03-27 | 2023-06-23 | 深圳星火互娱数字科技有限公司 | Meta universe immersion type experience method and system |
| CN116912444A (en) * | 2023-08-04 | 2023-10-20 | 深圳市固有色数码技术有限公司 | Meta-universe model generation system and method based on artificial intelligence |
| CN116912444B (en) * | 2023-08-04 | 2024-02-23 | 深圳市固有色数码技术有限公司 | Meta-universe model generation system and method based on artificial intelligence |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023155675A1 (en) | 2023-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114510150A (en) | Experience system of virtual digital world | |
| CN105704501B (en) | Virtual reality live broadcast system based on unmanned aerial vehicle panoramic video | |
| CN105931288A (en) | Construction method and system of digital exhibition hall | |
| CN106572344A (en) | Virtual reality live broadcast method and system and cloud server | |
| CN101174332A (en) | Method, device and system for interactively combining real-time scene in real world with virtual reality scene | |
| CN108234276A (en) | Interactive method, terminal and system between a kind of virtual image | |
| CN110136236B (en) | Personalized face display method, device and equipment for three-dimensional character and storage medium | |
| CN104536579A (en) | Interactive three-dimensional scenery and digital image high-speed fusing processing system and method | |
| WO2021098338A1 (en) | Model training method, media information synthesizing method, and related apparatus | |
| CN108983982A (en) | AR aobvious equipment and terminal device combined system | |
| CN109426343B (en) | Collaborative training method and system based on virtual reality | |
| CN105653020A (en) | Time traveling method and apparatus and glasses or helmet using same | |
| CN108416832A (en) | Display methods, device and the storage medium of media information | |
| CN107818595A (en) | Wearable Instant Interaction System | |
| CN108983974A (en) | AR scene process method, apparatus, equipment and computer readable storage medium | |
| JPWO2018216355A1 (en) | Information processing apparatus, information processing method, and program | |
| CN108322474A (en) | Virtual reality system, relevant apparatus based on share desktop and method | |
| CN108563327A (en) | Augmented reality method, apparatus, storage medium and electronic equipment | |
| CN112354185A (en) | Cloud game control system and cloud game control method | |
| WO2022209129A1 (en) | Information processing device, information processing method and program | |
| CN117095096A (en) | Personalized human body digital twin model creation method, online driving method and device | |
| CN107967053A (en) | A kind of AR scenery controls device and its control method based on eeg signal | |
| CN110312144B (en) | Live broadcast method, device, terminal and storage medium | |
| CN203825856U (en) | Power distribution simulation training system | |
| CN109816795A (en) | A kind of system and method for the augmented reality AR of distributed scene target identification |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |