CN116661596A - Man-machine virtual interaction system for exhibition hall construction - Google Patents
Man-machine virtual interaction system for exhibition hall construction Download PDFInfo
- Publication number
- CN116661596A CN116661596A CN202310561977.XA CN202310561977A CN116661596A CN 116661596 A CN116661596 A CN 116661596A CN 202310561977 A CN202310561977 A CN 202310561977A CN 116661596 A CN116661596 A CN 116661596A
- Authority
- CN
- China
- Prior art keywords
- exhibition hall
- interaction
- man
- module
- dimensional model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 123
- 238000010276 construction Methods 0.000 title claims abstract description 19
- 230000003238 somatosensory effect Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims abstract description 3
- 230000033001 locomotion Effects 0.000 claims description 13
- 230000002452 interceptive effect Effects 0.000 claims description 10
- 230000001133 acceleration Effects 0.000 claims description 8
- 230000000694 effects Effects 0.000 claims description 5
- 230000003287 optical effect Effects 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 description 5
- 238000000034 method Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000000875 corresponding effect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003153 chemical reaction reagent Substances 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
Abstract
The invention discloses a man-machine virtual interaction system for exhibition hall construction, which comprises: the data input module is used for inputting various data of the exhibition hall; the 3D modeling module is used for creating a three-dimensional model of the exhibition hall and a three-dimensional model of each exhibition area and the display object in the exhibition hall; the human-computer interaction module is used for carrying out interaction operation on interaction personnel and a three-dimensional model in a virtual scene through interaction equipment and comprises a touch interaction unit, a voice interaction unit and a somatosensory interaction unit; the display module is used for displaying the exhibition hall, all areas in the exhibition hall and the three-dimensional model of the display object in the exhibition hall; the camera module uses an unmanned aerial vehicle and a 4K camera and is used for assisting 3D modeling; the storage module is used for storing all data and three-dimensional model data of all exhibition halls; and the host module is used for processing the data.
Description
Technical Field
The invention relates to the technical field of man-machine interaction, in particular to a man-machine virtual interaction system for exhibition hall construction.
Background
VRHCI (virtual reality human-computer interaction) is mainly based on computer technology, network technology, sociology, behaviours and other subjects to study interaction of people and content (based on content generated by a computer and a network and content generated by a relative computer and network reality), so as to realize a social space of virtual reality integration, and then based on the social space, study the development trend of the future Internet and the social morphological structure of our lives.
Along with the development of economic science and technology, more and more exhibition halls are opened and introduced into the technology, and the technology is utilized to perform three-dimensional modeling of the exhibition halls for visitors. When the man-machine virtual interaction is carried out, the playability of the virtual interaction can influence the interests of tourists, and further influence the number of visiting tourists in the exhibition hall. The man-machine virtual interaction in the existing exhibition hall is single in interaction mode, the playability of attracting tourists is low, and the construction of the exhibition hall is influenced.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides the man-machine virtual interaction system for the construction of the exhibition hall, and through the man-machine interaction module, interaction personnel can perform man-machine interaction through a touch screen, and through a plurality of methods of voice communication and dynamic gestures of the intelligent robot, the playability and the multifunction of the man-machine virtual interaction are improved, the attraction of tourists to visit the exhibition hall is facilitated, and the construction of the exhibition hall is facilitated. .
In order to solve the technical problems, the invention provides the following technical scheme: a human-machine virtual interaction system for exhibition hall construction, the human-machine virtual interaction system comprising: the data input module is used for inputting various data of the exhibition hall; the 3D modeling module is used for creating a three-dimensional model of the exhibition hall and a three-dimensional model of each exhibition area and the exhibited object in the exhibition hall, and 3D MAX or other software can be used for modeling; the human-computer interaction module is used for carrying out interaction operation on interaction personnel and a three-dimensional model in a virtual scene through interaction equipment and comprises a touch interaction unit, a voice interaction unit and a somatosensory interaction unit; the display module is used for displaying the exhibition hall, all areas in the exhibition hall and the three-dimensional model of the display object in the exhibition hall;
further, the various items of data of the exhibition hall comprise the basic size of the exhibition hall body, the three-dimensional size of each display area in the exhibition hall and the size of the three-dimensional display object in the exhibition hall;
still further, the man-machine virtual interaction system further comprises a camera module, wherein the camera module uses an unmanned aerial vehicle and a 4K camera and is used for assisting 3D modeling, aiming at modeling of a exhibition hall body, a large number of two-dimensional images of the exhibition hall are quickly acquired by using a high-definition cloud deck carried by the unmanned aerial vehicle, and a three-dimensional model of the exhibition hall is restored through three-dimensional reconstruction; aiming at the size of the display objects in the exhibition hall, a large number of two-dimensional images of the display objects in the exhibition hall are rapidly acquired by utilizing a tripod, a camera sliding rail and a 4K camera, and a three-dimensional model of the exhibition hall is restored through three-dimensional reconstruction;
still further, the touch interaction unit installs customized interaction software on multimedia devices such as an intelligent display screen, a tablet, an intelligent machine and the like, wherein a reduced version of three-dimensional model is displayed in the interaction software, and an interacted person can rotate the model to a required visual angle or enlarge and reduce the model and the like only by operating with hands; the voice interaction unit realizes interaction through an intelligent robot, an AI voice interaction system is installed in the intelligent robot, an interactor only needs to say the content which the interactor wants to watch and know, the intelligent robot can automatically adjust a model and position to a required position, and the interactor begins to explain the content displayed at the position; the motion interaction unit senses the motion acceleration of the hands of the interactors through the optical sensing of the positions of the hands of the interactors, and utilizes the acceleration sensor to judge the actions of the hands of the interactors, the interactors can interact with the displayed three-dimensional model only by making corresponding actions or gestures, the model is subjected to operations such as zooming in, zooming out, rotating and the like, and the content which is wanted to be watched is easily and conveniently controlled;
still further, the display module uses the bore hole 3D display, and interdynamic personnel can directly watch 3D effect.
As a preferable technical scheme of the invention, the man-machine virtual interaction system further comprises a storage module, wherein the storage module is used for storing all data of all exhibition halls and three-dimensional model data.
As a preferred technical scheme of the invention, the man-machine virtual interaction system further comprises a host module, wherein the host module is used for processing data.
Compared with the prior art, the invention has the following beneficial effects:
according to the invention, through the set man-machine interaction module, the man-machine interaction module comprises the touch interaction unit, the voice interaction unit and the somatosensory interaction unit, and interaction personnel can perform man-machine interaction through a touch screen, and through a plurality of methods of voice communication and dynamic gestures of the intelligent robot, the playability and the multifunction of man-machine virtual interaction are improved, the attraction of tourists to visit an exhibition hall is facilitated, and the construction of the exhibition hall is facilitated.
Detailed Description
In order that the manner in which the above recited features, objects and advantages of the present invention are obtained will become readily apparent, a more particular description of the invention will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. Based on the examples in the embodiments, those skilled in the art can obtain other examples without making any inventive effort, which fall within the scope of the invention. The experimental methods in the following examples are conventional methods unless otherwise specified, and materials, reagents, etc. used in the following examples are commercially available unless otherwise specified.
Example 1
The invention provides a man-machine virtual interaction system for exhibition hall construction, which comprises: the data input module is used for inputting various items of data of the exhibition hall, wherein the various items of data of the exhibition hall comprise the basic size of the exhibition hall body, the three-dimensional size of various display areas in the exhibition hall and the size of three-dimensional display objects in the exhibition hall; the 3D modeling module is used for creating a three-dimensional model of the exhibition hall and a three-dimensional model of each exhibition area and the exhibited object in the exhibition hall, and 3D MAX or other software can be used for modeling; the human-computer interaction module is used for carrying out interaction operation on interaction personnel and a three-dimensional model in a virtual scene through interaction equipment and comprises a touch interaction unit, a voice interaction unit and a somatosensory interaction unit, wherein the touch interaction unit is used for installing customized interaction software on multimedia equipment such as an intelligent display screen, a tablet, an intelligent machine and the like, the three-dimensional model of a reduced version is displayed in the interaction software, and the interaction personnel can rotate the model to a required visual angle only by operating the interaction personnel by hands, or enlarge and reduce the model and the like; the voice interaction unit realizes interaction through an intelligent robot, an AI voice interaction system is installed in the intelligent robot, an interactor only needs to say the content which the interactor wants to watch and know, the intelligent robot can automatically adjust a model and position to a required position, and the interactor begins to explain the content displayed at the position; the motion interaction unit senses the motion acceleration of the hands of the interactors through the optical sensing of the positions of the hands of the interactors, and utilizes the acceleration sensor to judge the actions of the hands of the interactors, the interactors can interact with the displayed three-dimensional model only by making corresponding actions or gestures, the model is subjected to operations such as zooming in, zooming out, rotating and the like, and the content which is wanted to be watched is easily and conveniently controlled; the display module is used for displaying the exhibition hall, all areas in the exhibition hall and three-dimensional models of the display objects in the exhibition hall, and the display module uses a naked eye 3D display, so that interacted personnel can directly watch the 3D effect; the man-machine virtual interaction system further comprises a camera module, wherein the camera module uses an unmanned aerial vehicle and a 4K camera and is used for assisting in 3D modeling, aiming at modeling of a exhibition hall body, a large number of two-dimensional images of the exhibition hall are rapidly acquired by using the unmanned aerial vehicle to carry a high-definition cloud deck, and a three-dimensional model of the exhibition hall is restored through three-dimensional reconstruction; aiming at the size of the display objects in the exhibition hall, a large number of two-dimensional images of the display objects in the exhibition hall are rapidly acquired by utilizing a tripod, a camera sliding rail and a 4K camera, and a three-dimensional model of the exhibition hall is restored through three-dimensional reconstruction;
in the specific embodiment of the invention, when the man-machine virtual interactive system is used, firstly, various data of an exhibition hall are input through a data input module, the basic size of an exhibition hall body, the three-dimensional size of each exhibition area in the exhibition hall and the size of a three-dimensional exhibition object in the exhibition hall are specifically included, then, through a camera module, including an unmanned plane and a 4K camera, the three-dimensional modeling is assisted, a series of photos are shot for the exhibition hall body by utilizing an unmanned plane to carry a high-definition pan, a large number of two-dimensional images of the exhibition hall are quickly obtained, then, characteristic points of the same object in the shot photos are analyzed and are matched, the higher the coincidence degree of adjacent photos is, the matching of the characteristic points is easier, the shooting directions and the shooting angles of different photos are different, the three-dimensional characteristics of the shot objects are calculated through analyzing the similar characteristic points in the different photos, so that the three-dimensional reconstruction is performed, the higher the photo resolution is, the more the shooting angles are obtained, the quality of the synthesized three-dimensional model is good, and the three-dimensional topographic map of the exhibition hall is restored through three-dimensional reconstruction, and the advantages of the operation, the measurement range is large, the measurement efficiency is low, and the cost is high; aiming at the size of the display objects in the exhibition hall, a large number of two-dimensional images of the display objects in the exhibition hall are obtained by using a tripod, a camera sliding rail and a 4K camera in the same way, and a three-dimensional model of the exhibition hall is restored through three-dimensional reconstruction; finally, interactive operation is carried out between an interactive person and the three-dimensional model in the virtual scene through a man-machine interaction module, wherein the man-machine interaction module comprises a touch interaction unit, a voice interaction unit and a somatosensory interaction unit, the touch interaction unit is used for installing customized interactive software on multimedia equipment such as an intelligent display screen, a tablet, an intelligent machine and the like, the interactive software is provided with a reduced version of the three-dimensional model, and the interactive person can rotate the model to a required visual angle only by operating the interactive person by hands, or zoom in and out the model and the like; the voice interaction unit realizes interaction through an intelligent robot, an AI voice interaction system is installed in the intelligent robot, an interactor only needs to say the content which the interactor wants to watch and know, the intelligent robot can automatically adjust a model and position to a required position, and the interactor begins to explain the content displayed at the position; the motion interaction unit senses the motion acceleration of the hands of the interacted person through the optical sensing, and utilizes the acceleration sensor to sense the motion acceleration of the hands of the interacted person, so that the motion of the hands of the interacted person is judged, the interacted person can interact with the displayed three-dimensional model only by making corresponding motions or gestures, the model is subjected to operations such as zooming in, zooming out, rotating and the like, and the content which is wanted to be watched is easily and conveniently controlled; and through display module, display module is used for showing the exhibition hall, each region in the exhibition hall and the three-dimensional model of show article in the exhibition hall, display module uses bore hole 3D display, interactive personnel can directly watch the 3D effect of model when carrying out man-machine interaction, through the man-machine interaction module that sets up, man-machine interaction module includes touch interaction unit, voice interaction unit and somatosensory interaction unit, interactive personnel can carry out man-machine interaction through touch screen, with intelligent robot voice communication and the multiple method of dynamic gesture, the playability of man-machine virtual interaction has been promoted, the multifunctionality is favorable to attracting the visitor and visit the exhibition hall, construction to the exhibition hall has the promotion nature, be favorable to the construction of exhibition hall.
Example two
The embodiment is an improvement made above embodiment 1, and the human-computer virtual interaction system further includes a storage module, where the storage module is configured to store all data of all exhibition halls and three-dimensional model data, and the human-computer virtual interaction system further includes a host module, where the host module is configured to process the data;
in this embodiment: when the man-machine virtual interaction system is used, data are input through the data input module, modeling is carried out through the 3D modeling model, and the storage module can be used for storing the basic size of the exhibition hall body, the three-dimensional size of each exhibition area in the exhibition hall, the size of the three-dimensional exhibition object in the exhibition hall and the three-dimensional model data; and through the host computer module, can handle the exhibition hall data of input to control man-machine interaction module.
Working principle: when the man-machine virtual interaction system is used, data of each item of exhibition hall are input through the data input module, the camera shooting module comprises an unmanned aerial vehicle and a 4K camera and is used for assisting 3D modeling, the basic size of an exhibition hall body, the three-dimensional size of each exhibition area in the exhibition hall and the size and three-dimensional model data of three-dimensional exhibition objects in the exhibition hall can be stored through the storage module, the input exhibition hall data can be processed through the host module, the man-machine interaction module is controlled, finally interaction operation is carried out between interaction personnel and the three-dimensional model in a virtual scene through the man-machine interaction module, the three-dimensional model of each area in the exhibition hall and the three-dimensional model of the exhibition hall can be displayed through the display module, the display module uses a naked eye 3D display, and the interaction personnel can directly watch the 3D effect of the model when carrying out man-machine interaction.
Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (7)
1. A man-machine virtual interaction system for exhibition hall construction is characterized in that: the man-machine virtual interaction system comprises:
the data input module is used for inputting various data of the exhibition hall;
the 3D modeling module is used for creating a three-dimensional model of the exhibition hall and a three-dimensional model of each exhibition area and the exhibited object in the exhibition hall, and 3D MAX or other software can be used for modeling;
the human-computer interaction module is used for carrying out interaction operation on interaction personnel and a three-dimensional model in a virtual scene through interaction equipment and comprises a touch interaction unit, a voice interaction unit and a somatosensory interaction unit;
the display module is used for displaying the exhibition hall, all areas in the exhibition hall and the three-dimensional model of the display object in the exhibition hall.
2. The virtual man-machine interaction system for exhibition hall construction according to claim 1, wherein: the various items of data of the exhibition hall include the basic dimensions of the exhibition hall body, the three-dimensional dimensions of the various display areas within the exhibition hall and the dimensions of the three-dimensional display objects within the exhibition hall.
3. The virtual man-machine interaction system for exhibition hall construction according to claim 2, wherein: the man-machine virtual interaction system further comprises a camera module, wherein the camera module uses an unmanned aerial vehicle and a 4K camera and is used for assisting in 3D modeling, aiming at modeling of a exhibition hall body, a large number of two-dimensional images of the exhibition hall are rapidly acquired by using the unmanned aerial vehicle to carry a high-definition cloud deck, and a three-dimensional model of the exhibition hall is restored through three-dimensional reconstruction; aiming at the size of the display object in the exhibition hall, a large number of two-dimensional images of the display object in the exhibition hall are rapidly acquired by utilizing the tripod, the camera sliding rail and the 4K camera, and the three-dimensional model of the exhibition hall is restored through three-dimensional reconstruction.
4. The virtual man-machine interaction system for exhibition hall construction according to claim 1, wherein: the touch interaction unit installs customized interaction software on multimedia equipment such as an intelligent display screen, a tablet, an intelligent machine and the like, wherein a reduced three-dimensional model is displayed in the interaction software, and an interacted person can rotate the model to a required visual angle or enlarge and reduce the model by only operating with hands; the voice interaction unit realizes interaction through an intelligent robot, an AI voice interaction system is installed in the intelligent robot, an interactor only needs to say the content which the interactor wants to watch and know, the intelligent robot can automatically adjust a model and position to a required position, and the interactor begins to explain the content displayed at the position; the motion acceleration of the hands of the interactors is sensed by the motion sensing interaction unit through the optical sensing interaction unit, so that the motions of the hands of the interactors are judged, the interactors can interact with the displayed three-dimensional model only by making corresponding motions or gestures, the model is subjected to operations such as enlarging, reducing, rotating and the like, and the content which is wanted to be seen is easily and conveniently controlled.
5. The virtual man-machine interaction system for exhibition hall construction according to claim 1, wherein: the display module uses a naked eye 3D display, and an interactive person can directly watch the 3D effect.
6. The virtual man-machine interaction system for exhibition hall construction according to claim 1, wherein: the man-machine virtual interaction system further comprises a storage module, wherein the storage module is used for storing all data of all exhibition halls and three-dimensional model data.
7. The virtual man-machine interaction system for exhibition hall construction according to claim 1, wherein: the man-machine virtual interaction system further comprises a host module, wherein the host module is used for processing data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310561977.XA CN116661596A (en) | 2023-05-18 | 2023-05-18 | Man-machine virtual interaction system for exhibition hall construction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310561977.XA CN116661596A (en) | 2023-05-18 | 2023-05-18 | Man-machine virtual interaction system for exhibition hall construction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116661596A true CN116661596A (en) | 2023-08-29 |
Family
ID=87711038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310561977.XA Pending CN116661596A (en) | 2023-05-18 | 2023-05-18 | Man-machine virtual interaction system for exhibition hall construction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116661596A (en) |
-
2023
- 2023-05-18 CN CN202310561977.XA patent/CN116661596A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110073313B (en) | Interacting with an environment using a parent device and at least one companion device | |
| US9591295B2 (en) | Approaches for simulating three-dimensional views | |
| US9224237B2 (en) | Simulating three-dimensional views using planes of content | |
| US10438262B1 (en) | Method and device for implementing a virtual browsing experience | |
| US9965895B1 (en) | Augmented reality Camera Lucida | |
| EP2814000B1 (en) | Image processing apparatus, image processing method, and program | |
| US11842514B1 (en) | Determining a pose of an object from rgb-d images | |
| US11430192B2 (en) | Placement and manipulation of objects in augmented reality environment | |
| EP3172721B1 (en) | Method and system for augmenting television watching experience | |
| Adhikarla et al. | Freehand interaction with large-scale 3D map data | |
| US20210327160A1 (en) | Authoring device, authoring method, and storage medium storing authoring program | |
| CN113168228A (en) | Systems and/or methods for parallax correction in large area transparent touch interfaces | |
| US11562538B2 (en) | Method and system for providing a user interface for a 3D environment | |
| JP2020509505A (en) | Method, apparatus and computer program for providing augmented reality | |
| US20210407185A1 (en) | Generating a Semantic Construction of a Physical Setting | |
| CN116661596A (en) | Man-machine virtual interaction system for exhibition hall construction | |
| US20220206669A1 (en) | Information processing apparatus, information processing method, and program | |
| CN111176427B (en) | Three-dimensional space drawing method based on handheld intelligent device and handheld intelligent device | |
| Liarokapis et al. | Design experiences of multimodal mixed reality interfaces | |
| Asiminidis | Augmented and Virtual Reality: Extensive Review | |
| CN112862976B (en) | Data processing method and device and electronic equipment | |
| Maier et al. | Advanced human machine interaction for an image interpretation workstation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |