CN115494963A - Interactive model display device and method for mixing multiple projection devices - Google Patents
Interactive model display device and method for mixing multiple projection devices Download PDFInfo
- Publication number
- CN115494963A CN115494963A CN202211451596.8A CN202211451596A CN115494963A CN 115494963 A CN115494963 A CN 115494963A CN 202211451596 A CN202211451596 A CN 202211451596A CN 115494963 A CN115494963 A CN 115494963A
- Authority
- CN
- China
- Prior art keywords
- image
- terminal
- water mist
- interactive
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application relates to the field of intelligent showing devices, and discloses an interactive model display device and method for mixing multiple showing devices, wherein the interactive model display device comprises a terminal wearable module, an information interaction module, a first water mist projection module, a virtual image display module, an indication rod moving module, an image analysis module, an interactive operation instruction receiving module, a virtual 3D image display module and a continuous execution module, so that interactive model display of mixed multiple showing devices is realized, the interactive 3D image display effect can be improved, and the occurrence of a die penetrating phenomenon can be avoided.
Description
Technical Field
The present application relates to the field of intelligent projection devices, and more particularly, to an interactive model display device and method for a hybrid multi-projection device.
Background
Conventional 3D projection devices, such as water mist projection devices, VR projection devices, etc., do not have interactive functions (or have poor interactive effects), one of the big reasons being that precise positioning is difficult. As for the water mist projection device, which is mainly used for projecting a pre-made 3D model on site, generally, no interactive function exists (at most, only common playing options such as projection, pause and the like exist, and are not regarded as having an interactive function); for the VR projection apparatus, since it is difficult to determine the exact position that the user intends to determine in the conventional scheme, it is difficult to perform interactive operations such as splitting, rotating, enlarging, etc. of the model based on the exact position finely, which the user wants to perform (e.g. it is easy to cause phenomena such as die-through, etc. when interacting).
The method is reflected in a specific application scene, for example, in a 3D model display scene in a science and technology museum, if a water mist projection device is used for displaying, an interaction function is lacked; if all visitors wear VR projection devices such as VR glasses, the interactive function is poor, and thus the interactive 3d image display effect of the conventional scheme needs to be improved.
Disclosure of Invention
The application provides a mix multiple projection device's interactive model display device, multiple projection device include an AR terminal, a plurality of VR terminal and water smoke projection equipment, interactive model display device includes:
the terminal wearing module 10 is used for indicating that a first user wears the AR terminal and a second user to an nth user respectively wear corresponding VR terminals in a first time period;
the information interaction module 20 is configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through a preset server, so that the AR terminal and the multiple VR terminals both obtain a preset initial virtual 3D model image and virtual images corresponding to users of other terminals;
the primary water mist projection module 30 is used for indicating the AR terminal to control a preset water mist projection device, projecting an initial 3D water mist image in a real space according to the initial virtual 3D model image, and displaying virtual images of users corresponding to other VR terminals to a first user;
the virtual image display module 40 is configured to instruct the multiple VR terminals to display an initial virtual 3D model image and multiple virtual images other than the virtual image corresponding to the terminating end to the corresponding users, respectively;
the indication rod moving module 50 is used for indicating that in the second time period, the first user holds a preset indication rod in a hand and extends into the initial 3D water mist image until the rod head of the indication rod reaches the first user intention indication position; the indication rod is composed of a rod head and a rod body which are directly connected, the rod head is made of hydrophilic materials, and the rod body is made of hydrophobic materials;
the image analysis module 60 is configured to instruct the AR terminal to employ a preset binocular camera to perform image acquisition processing on a space where the initial 3D water mist image is located so as to obtain two space images, and then analyze the two space images according to a preset image analysis method so as to obtain a relative position of the rod head of the indication rod with respect to the initial 3D water mist image;
the interactive operation module 70 is used for indicating the AR terminal to acquire an interactive operation instruction input by a first user through the indication rod, and controlling a preset water mist projection device to perform interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so as to project the interacted 3D water mist image;
an interactive operation instruction receiving module 80, configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through the server, so that the multiple VR terminals all acquire the relative position and the interactive operation instruction sent by the AR terminal;
the virtual 3D image display module 90 is configured to instruct a plurality of VR terminals, perform an interactive operation on the initial virtual 3D model image according to the relative positions and the interactive operation instruction to form an post-interactive virtual 3D image, and display the post-interactive virtual 3D image to corresponding users respectively;
and the continuous execution module 100 is configured to instruct, at the third time stage and other subsequent time stages, to continuously perform a step of indicating a position, a step of analyzing a relative position, a step of projecting the post-interaction 3D water mist image operation, a step of performing information interaction operation on the relative position and an interaction operation instruction, and a step of displaying the post-interaction virtual 3D image until the whole interactive model display process is completed.
Further, the water mist projection device comprises a water mist generator and a projector, wherein the water mist generator is used for generating a water mist screen, and the projector is used for projecting a 3D water mist image on the water mist screen;
the AR terminal and the VR terminals form communication connection through the server;
and the AR terminal and the water mist projection equipment form communication connection.
Further, the AR terminal adopts preset binocular camera, carries out image acquisition processing to the space that initial 3D water smoke image is located to obtain two space image, and then carries out analysis to two space image according to preset image analysis method to obtain the relative position of the rod head of the indicator rod relative to initial 3D water smoke image, includes:
the AR terminal adopts a preset binocular camera to acquire and process images of a space where the initial 3D water mist image is located so as to obtain two space images;
the method comprises the steps that an AR terminal is indicated to construct a space coordinate system, and according to the parallax positioning principle, the club heads of the indicating sticks in two space images are subjected to first-step positioning processing, so that first insulation space coordinates of the club heads of the indicating sticks in the space coordinate system are obtained; wherein, the club head of the indicating stick is covered with a water film due to the hydrophilic property;
the AR terminal carries out second-step positioning processing on the initial 3D water mist image in the two space images according to a parallax positioning principle to obtain a second absolute space coordinate of the center of the initial 3D water mist image in a space coordinate system;
and the AR terminal generates the relative position of the club head of the indication rod relative to the center of the initial 3D water mist image based on the first absolute space coordinate and the second absolute space coordinate.
Further, the head and the barrel of the indicator stick are transparent.
Further, the bar still includes the handle, the handle embeds there is the vibrations generator, at third time stage and other time stages afterwards, continue to carry out the step of instructing the position, the step of relative position analysis, the step of projection interaction back 3D water smoke image operation, the step of relative position and the information interactive operation of interactive operation instruction and the step of the virtual 3D image after the demonstration interaction, until accomplishing whole interactive model show flow before, include:
in a third time phase, the first user draws the indicator stick out of the water mist area and waves the indicator stick;
the AR terminal adopts a preset camera to acquire and process images of the indicating rod so as to obtain an image of the indicating rod, and judges whether the rod head and the rod body of the indicating rod are covered by a water film or not according to the image of the indicating rod;
if the club head and the club body of the indicating rod are not covered by the water film, the vibration generator arranged in the control handle vibrates to indicate a first user to stretch the indicating rod into the interactive 3D water mist image again until the club head of the indicating rod reaches the intention indicating position of the first user again.
Further, the AR terminal obtains an interactive operation instruction input by a first user through an indication rod, and controls a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so that the interactive operation instruction in the 3D water mist image after the interaction is projected comprises a model splitting instruction, a rotating instruction, an amplifying instruction or an explosion diagram display instruction.
Further, the step of continuously performing, at the third time stage and other time stages thereafter, the step of indicating a position, the step of analyzing a relative position, the step of projecting the post-interaction 3D water mist image operation, the step of performing information interaction operation on the relative position and the interaction operation instruction, and the step of displaying the post-interaction virtual 3D image until the whole interactive model display process is completed includes:
one VR terminal in the multiple VR terminals sends an interactive authority application to the AR terminal through the server;
the AR terminal marks the application for sending the interaction authority as an appointed VR terminal and sends a signal allowing interaction to the appointed VR terminal through the server so as to endow the appointed VR terminal with the authority for interacting the virtual 3D image;
appointing a user corresponding to the VR terminal, performing interactive processing on the virtual 3D image through a preset VR interactive method, and sending the interactive processed result to other VR terminals and AR terminals through a server;
the other VR terminals except the designated VR terminal adjust the virtual 3D image according to the received interactive processing result;
and the AR terminal adjusts the 3D water mist image according to the received result after the interactive processing.
The application provides an interactive model display method for mixing various projection devices, wherein the various projection devices comprise an AR terminal, a plurality of VR terminals and water mist projection equipment, and the method comprises the following steps:
s1, in a first time period, a first user wears an AR terminal, and second to nth users wear corresponding VR terminals respectively;
s2, information interaction is carried out between the AR terminal and the VR terminals through a preset server, so that the AR terminal and the VR terminals acquire a preset initial virtual 3D model image and virtual images corresponding to users of other terminals;
s3, the AR terminal controls a preset water mist projection device, projects an initial 3D water mist image in a real space according to the initial virtual 3D model image, and displays virtual images of users corresponding to other VR terminals to a first user;
s4, the VR terminals respectively display an initial virtual 3D model image and a plurality of other virtual images except the virtual image corresponding to the end to corresponding users;
s5, in a second time stage, a first user holds a preset indicating rod by hand and stretches into the initial 3D water mist image until the rod head of the indicating rod reaches an intention indicating position of the first user; the indication rod is composed of a rod head and a rod body which are directly connected, the rod head is made of hydrophilic materials, and the rod body is made of hydrophobic materials;
s6, the AR terminal adopts a preset binocular camera to acquire and process the space where the initial 3D water mist image is located so as to obtain two space images, and then the two space images are analyzed according to a preset image analysis method so as to obtain the relative position of the rod head of the indicating rod relative to the initial 3D water mist image;
s7, the AR terminal acquires an interactive operation instruction input by a first user through an indicating rod, and controls a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so that the interacted 3D water mist image is projected;
s8, information interaction is carried out between the AR terminal and the VR terminals through a server, and therefore the VR terminals obtain the relative positions and the interactive operation instructions sent by the AR terminal;
s9, carrying out interactive operation on the initial virtual 3D model image according to the relative position and the interactive operation instruction by a plurality of VR terminals to form an interactive virtual 3D image, and respectively displaying the interactive virtual 3D image to corresponding users;
and S10, continuously performing the step of indicating the position, the step of analyzing the relative position, the step of projecting the interacted 3D water mist image operation, the step of performing information interaction operation of the relative position and an interaction operation instruction and the step of displaying the interacted virtual 3D image at the third time stage and other subsequent time stages until the whole interactive model display process is completed.
The present application provides a computer device comprising a memory storing a computer program and a processor implementing the steps of any of the above methods when the processor executes the computer program.
The present application provides a computer-readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of any of the above.
The application discloses interactive model display device, method, computer equipment and storage medium of mixing multiple projection device, wherein interactive model display device includes that the terminal dresses the module, the information interaction module, first water smoke projection module, virtual image display module, instruct stick removal module, the image analysis module, the interoperation module, interoperation instruction receiving module, virtual 3D image display module, last execution module, the interactive model show of mixing multiple projection device based on accurate position has been realized, interactive 3D image show effect can be improved, can avoid wearing the appearance of mould phenomenon.
The application has the advantages that:
the 3D model can be displayed on site, and people who watch the model remotely can be displayed at the same time, so that the method is particularly suitable for controlling the number of people entering a science and technology museum and displaying the model in the science and technology museum in a scene;
on-spot show personnel can wear AR terminal (for example AR glasses), realize being favorable to improving the model bandwagon effect to the accurate interaction of 3D image, especially are fit for scenes such as model show in the science and technology center (for example comet model), the model show in the long-range teaching, skeleton model show, long-range interaction.
It should be mentioned in particular that the present application is applicable to model exhibition scenarios in science and technology museums, especially scenarios of online and offline simultaneous exhibition. In this scene, the AR terminal is dressed by the staff of guide, and the VR terminal is dressed by the visitor who is not at the scene, and the visitor at the scene need not to dress arbitrary body equipment, only need watch the 3D water smoke image that water smoke projection equipment generated can. At the moment, a worker wearing the AR terminal can see off-line visitors, virtual images corresponding to on-line visitors and 3D water mist images; the on-site visitors can see the 3D water mist image and the working personnel wearing the AR terminal; wearing VR terminal on-line visitor can see the virtual image that corresponds to AR terminal, the virtual image that corresponds to other VR terminals, the virtual 3D image that corresponds to 3D water smoke image.
Drawings
FIG. 1 is a block diagram of an interactive model display apparatus incorporating a multiple projection apparatus according to an embodiment of the present application;
FIG. 2 is a flow chart of an interactive model display method of a hybrid multiple projection device according to an embodiment of the present application;
fig. 3 is a block diagram illustrating a structure of a computer device according to an embodiment of the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Referring to fig. 1, an interactive model display apparatus for mixing multiple projection apparatuses is provided in an embodiment of the present application, the multiple projection apparatuses include an AR terminal, multiple VR terminals and a water mist projection device, the interactive model display apparatus includes:
the terminal wearing module 10 is used for indicating that a first user wears the AR terminal and a second user to an nth user respectively wear corresponding VR terminals in a first time period;
the information interaction module 20 is configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through a preset server, so that the AR terminal and the multiple VR terminals both obtain a preset initial virtual 3D model image and virtual images corresponding to users of other terminals;
the primary water mist projection module 30 is used for indicating the AR terminal to control a preset water mist projection device, projecting an initial 3D water mist image in a real space according to the initial virtual 3D model image, and displaying virtual images of users corresponding to other VR terminals to a first user;
the virtual image display module 40 is configured to instruct the multiple VR terminals to display an initial virtual 3D model image and multiple virtual images other than the virtual image corresponding to the terminating end to the corresponding users, respectively;
the indication rod moving module 50 is used for indicating that in the second time period, the first user holds a preset indication rod in a hand and extends into the initial 3D water mist image until the rod head of the indication rod reaches the first user intention indication position; the indication rod is composed of a rod head and a rod body which are directly connected, the rod head is made of hydrophilic materials, and the rod body is made of hydrophobic materials;
the image analysis module 60 is configured to instruct the AR terminal to employ a preset binocular camera to perform image acquisition processing on a space where the initial 3D water mist image is located so as to obtain two space images, and analyze the two space images according to a preset image analysis method so as to obtain a relative position of the rod head of the indication rod with respect to the initial 3D water mist image;
the interactive operation module 70 is used for indicating the AR terminal to acquire an interactive operation instruction input by a first user through an indicating rod, and controlling a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so as to project the interacted 3D water mist image;
an interactive operation instruction receiving module 80, configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through the server, so that the multiple VR terminals all acquire the relative position and the interactive operation instruction sent by the AR terminal;
the virtual 3D image display module 90 is configured to instruct multiple VR terminals, perform an interactive operation on the initial virtual 3D model image according to the relative positions and the interactive operation instruction to form an post-interactive virtual 3D image, and display the post-interactive virtual 3D image to corresponding users respectively;
and the continuous execution module 100 is used for indicating that the step of indicating the position, the step of analyzing the relative position, the step of projecting the interacted 3D water mist image, the step of performing information interaction operation of the relative position and the interaction operation instruction and the step of displaying the interacted virtual 3D image are continuously performed at the third time stage and other subsequent time stages until the whole interactive model display process is completed.
The interactive model display scheme of the mixed multi-type projection device is implemented under the condition that a plurality of terminals are cooperated, wherein the interaction has multiple meanings; firstly, a user of the AR terminal can interact with the 3D water mist image; secondly, the users between the AR and the VR can interact; thirdly, after the user of the AR terminal authorizes, the authorized VR terminal can interact with the virtual 3D image (because only the AR terminal can interact with the virtual 3D image by means of the 3D water mist image in the default state).
The expression form of the AR terminal is, for example, an AR helmet, AR glasses, etc., which is not limited in this application; the expression form of the VR terminal is, for example, VR helmet, VR glasses, etc., which is not limited in this application. In addition, the AR terminal can control, for example, a preset water mist projection device, a preset binocular camera, and possibly a sensor on an indication rod, etc., which indicate that there is a signal connection between the AR terminal and the devices or sensors, and the devices or sensors may be built into the AR terminal or pre-arranged in a room (i.e., pre-arranged in a space where the first user is located).
This application is implemented according to principles and features including:
this application regards as the intermediary with 3D water smoke image, has realized the interaction between user and the 3D image (including 3D water smoke image and virtual 3D image), and adopts this kind of intermediary that comparatively speaking has the space entity for the purpose of this application's interactive model show based on the multiple projection means of mixture of accurate position can be realized, and the phenomenon such as mould is worn to appear in the interaction between user and the 3D image in the traditional scheme can not appear.
This application adopts special mode to carry out the accurate positioning to 3D water smoke image, and it has utilized purpose-made pointer stick. The special indicating rod is composed of a head and a body which are directly connected, the head is made of hydrophilic materials, the body is made of hydrophobic materials, and therefore specific effects can be achieved:
there is no need to paint the pointer stick in a special color (i.e., the pointer stick of the present application may be transparent), which may improve the user experience (since if painted in a special pattern, although it is advantageous to locate the position of the stick head using computer vision techniques, there may be unnecessary colors in the user's field of view), because the influence of the pointer stick on the image seen by the first user through the AR terminal is minimized;
on the premise of the former point, the accuracy of obtaining the relative position of the club head of the indication rod relative to the initial 3D water mist image is not influenced (because the club head is made of hydrophilic material and the club body is made of hydrophobic material, the club head is easily covered by a complete or incomplete water film after a certain time in the water mist area, and the club body is not, which is beneficial to positioning the position of the club head by adopting the computer vision technology);
more important point, this kind of mode that utilizes the pointer stick to fix a position can used repeatedly, only need fix a position the back once, takes out from the water smoke region, gets rid of once again and gets rid of the water film (mainly the water film on the club head) in order to get rid of on the pointer stick, can reuse.
As described in the above modules 10-40, the terminal wearing module 10 is configured to instruct a first user to wear the AR terminal at a first time period, and a second user to an nth user to wear corresponding VR terminals respectively; the information interaction module 20 is configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through a preset server, so that the AR terminal and the multiple VR terminals both obtain a preset initial virtual 3D model image and virtual images corresponding to users of other terminals; the primary water mist projection module 30 is used for instructing the AR terminal to control a preset water mist projection device, projecting an initial 3D water mist image in a real space according to the initial virtual 3D model image, and displaying virtual images of users corresponding to other VR terminals to a first user; and the virtual image display module 40 is configured to instruct the multiple VR terminals to display an initial virtual 3D model image and multiple virtual images other than the virtual image corresponding to the terminating end to the corresponding users, respectively.
The implementation of the application is divided in time phase, and the data acquisition, data processing and signal transmission among a plurality of terminals and servers are also divided in time phase, so that the data updating of the 3D image is also divided in time phase. The first time period is an initial period, and the second time period and other time periods after the second time period are repeated for the second time period.
Wherein, at the first time stage, the AR terminal is worn by the first user, and the corresponding VR terminals are worn by the second user to the nth user respectively. Under this condition, adopt traditional virtual reality communication technology, can realize the virtual reality communication between first user, second user to the nth user, of course, because first user adopts the AR terminal, so it can also observe a part of reality scene, and this is the special setting of this application, because needs first user can also observe 3D water smoke image. Wherein n is an integer greater than 2;
and then, information interaction is carried out between the AR terminal and the VR terminals through a preset server, so that the AR terminal and the VR terminals acquire preset initial virtual 3D model images and virtual images corresponding to users of other terminals. On this basis, each terminal (including the AR terminal and the VR terminal) can display the virtual image corresponding to the user of the other terminal to the corresponding user, and the display method may be an existing virtual image display method, for example, a virtual image display method implemented based on an optical waveguide technology, which is not described herein again. At this time, a plurality of virtual images can be displayed, and the initial virtual 3D model video is an un-interacted 3D video, so each VR terminal can also display the initial virtual 3D model video.
AR terminal control preset water smoke projection equipment, according to initial virtual 3D model image, initial 3D water smoke image is projected in real space to show other VR terminal user's virtual image to first user, thereby first user can see real initial 3D water smoke image and a plurality of virtual image simultaneously. It should be noted that, at this time, the initial 3D water mist image is projected based on the initial virtual 3D model image, and therefore, the initial virtual 3D model image should be the same as the initial virtual 3D model image in the view of the first user. That is, if the first user uses the VR terminal in the first time period, the observed image should be the same as the image observed by the AR terminal (of course, the description is made by ignoring other real objects in the real space where the first user is located).
And the VR terminals respectively show an initial virtual 3D model image and a plurality of other virtual images except the virtual image corresponding to the end to corresponding users. Thus, the first time period ends, and the basis of the interactive model display scheme for implementing the hybrid multiple projection device is constructed. Similarly, the VR terminal may also adopt, for example, a virtual image display method implemented based on an optical waveguide technology, which is also not described herein again.
Further, the water mist projection device comprises a water mist generator and a projector, wherein the water mist generator is used for generating a water mist screen, and the projector is used for projecting a 3D water mist image on the water mist screen;
the AR terminal and the VR terminals form communication connection through the server;
and the AR terminal and the water mist projection equipment form communication connection.
As described in the above modules 50-90, the indication rod moving module 50 is configured to indicate that, in the second time period, the first user holds the preset indication rod by hand, and extends into the initial 3D water mist image until the rod head of the indication rod reaches the first user intention indication position; the indication rod is composed of a rod head and a rod body which are directly connected, the rod head is made of hydrophilic materials, and the rod body is made of hydrophobic materials; the image analysis module 60 is configured to instruct the AR terminal to employ a preset binocular camera to perform image acquisition processing on a space where the initial 3D water mist image is located so as to obtain two space images, and analyze the two space images according to a preset image analysis method so as to obtain a relative position of the rod head of the indication rod with respect to the initial 3D water mist image; the interactive operation module 70 is used for indicating the AR terminal to acquire an interactive operation instruction input by a first user through an indicating rod, and controlling a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so as to project the interacted 3D water mist image; an interactive operation instruction receiving module 80, configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through the server, so that the multiple VR terminals all acquire the relative position and the interactive operation instruction sent by the AR terminal; and the virtual 3D image display module 90 is used for indicating a plurality of VR terminals, carrying out interactive operation on the initial virtual 3D model image according to the relative positions and the interactive operation instruction to form an interactive virtual 3D image, and displaying the interactive virtual 3D image to corresponding users respectively.
In the present application, the interaction with the 3D image formally starts at the second time stage, and for the first user, the user only needs to hold the pointing stick with the hand to extend into the target position in the initial 3D water mist image. The indication rod is special in that the rod head is made of a hydrophilic material, the rod body is made of a hydrophobic material, and the hydrophilic material and the hydrophobic material can be prepared in any feasible mode, such as a mode of coating a hydrophilic coating or a hydrophobic coating. Further, the indication rod is preferably transparent, so as to improve the visual perception of the user, and the user can determine the position of the rod head due to the hydrophilic material of the rod head and position the rod head by using the computer vision technology.
Further, as an alternative, the head and the body of the indicating rod are both made of hydrophobic materials, and the surface of the head of the indicating rod is coated with a material capable of absorbing ultraviolet light and emitting visible light; correspondingly, in step S6, a preset ultraviolet generator should be started to irradiate the space where the initial 3D water mist image is located, a preset binocular camera is used to perform image acquisition processing on the space where the initial 3D water mist image is located to obtain two space images, and the two space images are analyzed according to a preset image analysis method to obtain the relative position of the rod head of the indicator rod with respect to the initial 3D water mist image. At this time, since the club head emits light of a particular color by absorbing ultraviolet rays, it is easily recognized by the computer. The material capable of absorbing ultraviolet light and emitting visible light can be any feasible material, such as a rare earth-based doped material, which is realized based on the band theory and is not described herein again.
Further, as an alternative, the club head is made of a hydrophilic material, the club body is made of a hydrophobic material, and the club head surface of the indication rod is further coated with a material capable of absorbing ultraviolet light and emitting visible light, and in step S6, a preset ultraviolet generator should be started to irradiate the space where the initial 3D water mist image is located, and then image acquisition is performed.
Different from the interaction mode of the traditional virtual 3D influence, the initial 3D water mist image in the real space is interacted, so that the phenomena such as mold penetration and the like can not occur. And for the determination of the position of the rod head, the preset binocular camera is adopted and is obtained by analysis based on the parallax principle, and the binocular positioning technology is the prior art, so that the details are not repeated. Further, there may be a plurality of binocular cameras.
The AR terminal acquires an interactive operation instruction input by a first user through the indicating rod, and controls a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so that the interactive 3D water mist image is projected. The interactive operation instruction includes a model splitting instruction, a rotation instruction, an enlargement instruction or an explosion diagram display instruction, but is not limited to these instructions. In addition, the interactive operation instruction input through the indication stick means that the indication stick is provided with a module capable of human-computer interaction, which is not shown and described in the present application because the same is the same as the traditional VR interactive handle or AR interactive handle (or bracelet), for example, a vibrator (which feeds back a signal to a user in a vibrating manner) and a touch button (for the user to input an instruction) are built in the indication stick, and such an interactive handle and a bracelet are common in the market and are not further described.
The advantage of the present application is that it enables accurate positioning and accurate interaction, and is therefore particularly suitable for remote display of, for example, a fine bone model, for example, a first user intends to interactively display a specific location in the bone model, and then the interactive result can be displayed to other users by the solution of the present application, which cannot be achieved by conventional VR or AR technology. Accordingly, information interaction is carried out between the AR terminal and the VR terminals through the server, and therefore the VR terminals all acquire the relative positions and the interactive operation instructions sent by the AR terminal; and the VR terminals carry out interactive operation on the initial virtual 3D model image according to the relative positions and the interactive operation instruction to form an interactive virtual 3D image, and respectively display the interactive virtual 3D image to corresponding users.
As described in the above module 10, the continuous execution module 100 is configured to instruct, at the third time stage and other time stages thereafter, to continuously perform the step of indicating the position, the step of analyzing the relative position, the step of projecting the post-interaction 3D water mist image operation, the step of performing information interaction operation on the relative position and the interaction operation instruction, and the step of displaying the post-interaction virtual 3D image until the whole interactive model display process is completed.
The interaction stage is sequentially realized by the second time stage, the third time stage and other subsequent time stages, and the third time stage and other subsequent time stages are respectively repeated for the second time stage, so that the steps of continuously indicating the position, analyzing the relative position, projecting the post-interaction 3D water mist image operation, interactively operating the relative position and the information of the interactive operation instruction, and displaying the post-interaction virtual 3D image are actually repeated for each specific step in the second time stage, wherein the interacted 3D image is not the initial 3D image any more, but the 3D image obtained by interaction after the previous time stage. The instruction for finishing the whole interactive model display process can be realized by the way that the first user inputs through the indicating rod (for example, the indicating rod is also provided with an input device such as a key), and the like.
Further, the interactive operation command may be input in any feasible manner, for example, by waving the indication rod according to a predetermined motion, and this manner may be preset to set the designated motion corresponding to the designated interactive operation, for example, to set a motion of waving a circle, a manner of displaying an explosion diagram (referring to the explosion diagram corresponding to the position where the current indication rod head is located), and the detection of the waving motion may be implemented by capturing an image by a camera or by a sensor built in the indication rod.
In one embodiment, the AR terminal uses a preset binocular camera to perform image acquisition processing on a space where the initial 3D water mist image is located to obtain two space images, and then analyzes the two space images according to a preset image analysis method to obtain a relative position of a rod head of the indicator rod with respect to the initial 3D water mist image, including:
the AR terminal adopts a preset binocular camera to acquire and process images of a space where the initial 3D water mist image is located so as to obtain two space images;
the method comprises the steps that an AR terminal is indicated to construct a space coordinate system, and according to the parallax positioning principle, the club heads of the indicating sticks in two space images are subjected to first-step positioning processing, so that first insulation space coordinates of the club heads of the indicating sticks in the space coordinate system are obtained; wherein, the club head of the indicating rod is covered with a water film due to the hydrophilic property;
the AR terminal carries out second-step positioning processing on the initial 3D water mist image in the two space images according to a parallax positioning principle to obtain a second absolute space coordinate of the center of the initial 3D water mist image in a space coordinate system;
and the AR terminal generates the relative position of the club head of the indication rod relative to the center of the initial 3D water mist image based on the first absolute space coordinate and the second absolute space coordinate.
Thereby determining the relative position of the club head of the indicating stick relative to the center of the initial 3D water mist image according to the parallax positioning principle. The parallax positioning principle is a principle that two eyes of a person can determine the three-dimensional space position of an object, only one plane image can be obtained if only one eye or one camera is used for observation, and the plane image can only obtain plane coordinates at most and cannot obtain coordinates of a third dimension. The absolute in the first absolute spatial coordinate and the second absolute spatial coordinate is relative to the subsequent relative position because the absolute spatial coordinate is generated with an origin of a spatial coordinate system, which may be set as the center of one of the binocular cameras.
Moreover, in the scheme of this application, because the club head of instruction stick covers the water film because hydrophilic characteristic, consequently there is certain difference for the shaft of instruction stick, and this difference can be distinguished by the image recognition technology based on machine identification fast, and people's eye has great tolerance to this difference, and this is this application also adopts the characteristics of this kind of design to place: on the premise of not influencing the watching effect of human eyes as much as possible, the accurate positioning of the rod head of the indicating rod is ensured. It should be mentioned that this design is adopted in the present application, rather than the first color of the club head and the second color of the club body, so that the image recognition technology can accurately position the club head of the indication stick, because the latter positioning obviously affects the human eye's viewing effect, which the present application wants to avoid.
Further, the head and the barrel of the indicator stick are transparent. Thereby further reducing the negative effect of the projection scheme of the application on the viewing effect of human eyes.
Further, the bar still includes the handle, the handle embeds there is the vibrations generator, at third time stage and other time stages afterwards, continue to carry out the step of instructing the position, the step of relative position analysis, the step of projection interaction back 3D water smoke image operation, the step of relative position and the information interactive operation of interactive operation instruction and the step of the virtual 3D image after the demonstration interaction, until accomplishing whole interactive model show flow before, include:
in a third time phase, the first user draws the indicator stick out of the water mist area and waves the indicator stick;
the AR terminal adopts a preset camera to acquire and process images of the indicating rod so as to obtain an image of the indicating rod, and judges whether the rod head and the rod body of the indicating rod are covered by a water film or not according to the image of the indicating rod;
if the club head and the club body of the indicating rod are not covered by the water film, the vibration generator arranged in the control handle vibrates to indicate a first user to stretch the indicating rod into the interactive 3D water mist image again until the club head of the indicating rod reaches the intention indicating position of the first user again.
Thereby make the pointer stick can used repeatedly to in order to guarantee the accuracy of pointer stick when using again, this application adopts the camera to carry out image acquisition to the pointer stick, and with the pointer stick before using again because the effect of waving will get rid of the characteristic of water film, and the built-in vibrations generator of reunion handle, with definite pointer stick is not covered by the water film before using again.
Further, the AR terminal obtains an interactive operation instruction input by a first user through an indication rod, and controls a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so that the interactive operation instruction in the 3D water mist image after the interaction is projected comprises a model splitting instruction, a rotating instruction, an amplifying instruction or an explosion diagram display instruction.
In one embodiment, the step of continuously performing, at the third time stage and other time stages thereafter, the step of indicating a position, the step of analyzing a relative position, the step of projecting the post-interaction 3D water mist image, the step of performing information interaction operation on the relative position and the interaction operation instruction, and the step of displaying the post-interaction virtual 3D image until the whole interactive model display process is completed includes:
one VR terminal in the multiple VR terminals sends an interactive authority application to the AR terminal through the server;
the AR terminal marks the application for sending the interaction authority as an appointed VR terminal and sends a signal allowing interaction to the appointed VR terminal through the server so as to endow the appointed VR terminal with the authority for interacting the virtual 3D image;
appointing a user corresponding to the VR terminal, performing interactive processing on the virtual 3D image through a preset VR interactive method, and sending the interactive processed result to other VR terminals and AR terminals through a server;
the other VR terminals except the designated VR terminal adjust the virtual 3D image according to the received interactive processing result;
and the AR terminal adjusts the 3D water mist image according to the received result after the interactive processing.
Therefore, the interaction function of the VR terminal is realized. The application has the main characteristics that in the default state, the VR terminal cannot interact with the virtual 3D image, and only the AR terminal which is located at the same geographical position with the water mist projection image can interact with the virtual 3D image, so that the traditional interaction between the VR terminal and the virtual 3D image lacks accuracy, the phenomenon of die penetration and the like easily occurs, and the VR terminal cannot be allowed to interact in the default state. However, after the AR terminal performs accurate interaction, other VR terminals are allowed, and preferably only one designated VR terminal performs interaction processing on the virtual 3D image, so as to ensure the integrity of function implementation.
The application discloses mix multiple projection device's interactive model display device includes that the module is dressed to the terminal, the information interaction module, first water smoke projection module, virtual image display module, instruct stick to remove the module, the image analysis module, the interoperation module, interoperation instruction receiving module, virtual 3D image display module lasts the execution module, realized the interactive model show of mixing multiple projection device based on accurate position, can improve interactive 3D image show effect, avoid wearing the appearance of mould phenomenon.
Referring to fig. 2, an interactive model display method for a hybrid multiple projection apparatus is provided in an embodiment of the present application, the multiple projection apparatus includes an AR terminal, multiple VR terminals and a water mist projection device, the method includes:
s1, in a first time period, a first user wears an AR terminal, and second to nth users wear corresponding VR terminals respectively;
s2, information interaction is carried out between the AR terminal and the VR terminals through a preset server, so that the AR terminal and the VR terminals acquire a preset initial virtual 3D model image and virtual images corresponding to users of other terminals;
s3, the AR terminal controls a preset water mist projection device, projects an initial 3D water mist image in a real space according to the initial virtual 3D model image, and displays virtual images of users corresponding to other VR terminals to a first user;
s4, the VR terminals respectively display an initial virtual 3D model image and a plurality of other virtual images except the virtual image corresponding to the end to corresponding users;
s5, in a second time stage, a first user holds a preset indicating rod in a hand and stretches into the initial 3D water mist image until the rod head of the indicating rod reaches the intention indicating position of the first user; the indication rod is composed of a rod head and a rod body which are directly connected, the rod head is made of hydrophilic materials, and the rod body is made of hydrophobic materials;
s6, the AR terminal adopts a preset binocular camera to acquire and process the space where the initial 3D water mist image is located so as to obtain two space images, and then the two space images are analyzed according to a preset image analysis method so as to obtain the relative position of the rod head of the indicating rod relative to the initial 3D water mist image;
s7, the AR terminal acquires an interactive operation instruction input by a first user through an indicating rod, and controls a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so that the interacted 3D water mist image is projected;
s8, information interaction is carried out between the AR terminal and the VR terminals through a server, and therefore the VR terminals obtain the relative positions and the interactive operation instructions sent by the AR terminal;
s9, carrying out interactive operation on the initial virtual 3D model image according to the relative position and the interactive operation instruction by a plurality of VR terminals to form an interactive virtual 3D image, and respectively displaying the interactive virtual 3D image to corresponding users;
and S10, continuously performing the step of indicating the position, the step of analyzing the relative position, the step of projecting the interacted 3D water mist image operation, the step of performing information interaction operation of the relative position and an interaction operation instruction and the step of displaying the interacted virtual 3D image at the third time stage and other subsequent time stages until the whole interactive model display process is completed.
The steps in the method correspond to the operations of the interactive model display device of the mixed multiple display device of the foregoing embodiment, which are respectively used for execution, and are not described herein again.
Referring to fig. 3, an embodiment of the present invention further provides a computer device, where the computer device may be a server, and an internal structure of the computer device may be as shown in the figure. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the computer designed processor is used to provide computational and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used for storing data for an interactive model presentation method that mixes a plurality of presentation apparatuses. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of interactive model presentation for a hybrid multiple projection device. The computer device further comprises a display screen and an input device for displaying the human interactive interface and for receiving input data, respectively.
The processor executes the interactive model display method of the mixed multiple projection device, wherein the steps of the method are respectively in one-to-one correspondence with the steps of the interactive model display method of the mixed multiple projection device of the foregoing embodiment, and are not described herein again.
It will be understood by those skilled in the art that the structures shown in the drawings are only block diagrams of some of the structures associated with the embodiments of the present application and do not constitute a limitation on the computer apparatus to which the embodiments of the present application may be applied.
An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method for displaying an interactive model of a mixed multiple projection apparatus is implemented, where the steps included in the method are respectively in one-to-one correspondence with the steps of the method for displaying an interactive model of a mixed multiple projection apparatus implemented in the foregoing embodiment, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by a computer program or hardware related to instructions, and the computer program may be stored in a non-volatile computer readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium provided herein and used in the examples may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct bused dynamic RAM (DRDRAM), and bused dynamic RAM (RDRAM).
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, apparatus, article, or method that comprises the element.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all the equivalent structures or equivalent processes that can be directly or indirectly applied to other related technical fields by using the contents of the specification and the drawings of the present application are also included in the scope of the present application.
Claims (10)
1. The interactive model display device is characterized in that the multiple projection devices comprise an AR terminal, a plurality of VR terminals and water mist projection equipment, and the interactive model display device comprises:
the terminal wearing module 10 is used for indicating that a first user wears the AR terminal and a second user to an nth user respectively wear corresponding VR terminals in a first time period;
the information interaction module 20 is configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through a preset server, so that the AR terminal and the multiple VR terminals both obtain a preset initial virtual 3D model image and virtual images corresponding to users of other terminals;
the primary water mist projection module 30 is used for indicating the AR terminal to control a preset water mist projection device, projecting an initial 3D water mist image in a real space according to the initial virtual 3D model image, and displaying virtual images of users corresponding to other VR terminals to a first user;
the virtual image display module 40 is configured to instruct the multiple VR terminals to display an initial virtual 3D model image and multiple virtual images other than the virtual image corresponding to the terminating end to the corresponding users, respectively;
the indication rod moving module 50 is used for indicating that in the second time period, the first user holds a preset indication rod in a hand and extends into the initial 3D water mist image until the rod head of the indication rod reaches the first user intention indication position; the indication rod is composed of a rod head and a rod body which are directly connected, the rod head is made of hydrophilic materials, and the rod body is made of hydrophobic materials;
the image analysis module 60 is configured to instruct the AR terminal to employ a preset binocular camera to perform image acquisition processing on a space where the initial 3D water mist image is located so as to obtain two space images, and analyze the two space images according to a preset image analysis method so as to obtain a relative position of the rod head of the indication rod with respect to the initial 3D water mist image;
the interactive operation module 70 is used for indicating the AR terminal to acquire an interactive operation instruction input by a first user through an indicating rod, and controlling a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so as to project the interacted 3D water mist image;
an interactive operation instruction receiving module 80, configured to instruct the AR terminal and the multiple VR terminals to perform information interaction through the server, so that the multiple VR terminals all obtain the relative position and the interactive operation instruction sent by the AR terminal;
the virtual 3D image display module 90 is configured to instruct a plurality of VR terminals, perform an interactive operation on the initial virtual 3D model image according to the relative positions and the interactive operation instruction to form an post-interactive virtual 3D image, and display the post-interactive virtual 3D image to corresponding users respectively;
and the continuous execution module 100 is configured to instruct, at the third time stage and other subsequent time stages, to continuously perform a step of indicating a position, a step of analyzing a relative position, a step of projecting the post-interaction 3D water mist image operation, a step of performing information interaction operation on the relative position and an interaction operation instruction, and a step of displaying the post-interaction virtual 3D image until the whole interactive model display process is completed.
2. The interactive model display device with a hybrid multiple projection device as claimed in claim 1, wherein the water mist projection apparatus comprises a water mist generator for generating a water mist screen and a projector for projecting a 3D water mist image on the water mist screen;
the AR terminal and the plurality of VR terminals form communication connection through the server;
and the AR terminal and the water mist projection equipment form communication connection.
3. The interactive model display device with multiple mixed projection devices according to claim 1, wherein the AR terminal employs a preset binocular camera to perform image acquisition processing on a space where the initial 3D water mist image is located to obtain two space images, and then analyzes the two space images according to a preset image analysis method to obtain a relative position of a rod head of the indication rod with respect to the initial 3D water mist image, comprising:
the AR terminal adopts a preset binocular camera to acquire and process images of a space where the initial 3D water mist image is located so as to obtain two space images;
the method comprises the steps that an AR terminal is indicated to construct a space coordinate system, and according to the parallax positioning principle, the club heads of the indicating sticks in two space images are subjected to first-step positioning processing, so that first insulation space coordinates of the club heads of the indicating sticks in the space coordinate system are obtained; wherein, the club head of the indicating rod is covered with a water film due to the hydrophilic property;
the AR terminal carries out second-step positioning processing on the initial 3D water mist image in the two space images according to a parallax positioning principle to obtain a second absolute space coordinate of the center of the initial 3D water mist image in a space coordinate system;
and the AR terminal generates the relative position of the club head of the indication rod relative to the center of the initial 3D water mist image based on the first absolute space coordinate and the second absolute space coordinate.
4. The interactive model display of claim 3, wherein the head and body of the pointer wand are transparent.
5. The interactive model display device with a combination of multiple projection devices as claimed in claim 4, wherein the pointing stick further comprises a handle, a vibration generator is disposed in the handle, and the step of continuously performing the steps of pointing, analyzing the relative position, projecting the interacted 3D water mist image, interacting the information of the relative position and the interaction instruction, and displaying the interacted virtual 3D image at the third time stage and later until the interactive model display process is completed comprises:
in a third time phase, the first user draws the indicator stick out of the water mist area and waves the indicator stick;
the AR terminal adopts a preset camera to acquire and process images of the indicating rod so as to obtain an image of the indicating rod, and judges whether the rod head and the rod body of the indicating rod are covered by a water film or not according to the image of the indicating rod;
if the club head and the club body of the indicating rod are not covered by the water film, the vibration generator arranged in the control handle vibrates to indicate a first user to stretch the indicating rod into the interactive 3D water mist image again until the club head of the indicating rod reaches the intention indicating position of the first user again.
6. The interactive model display device of claim 1, wherein the AR terminal obtains an interactive operation command input by the first user through the pointing stick, and controls the preset water mist projection apparatus to perform an interactive operation on the initial 3D water mist image according to the interactive operation command with the relative position as a reference, so that the interactive operation command projected in the interacted 3D water mist image includes a model splitting command, a rotation command, an enlargement command or an explosion diagram display command.
7. The interactive model display device with a combination of multiple projection devices as claimed in claim 1, wherein the step of indicating the position, the step of analyzing the relative position, the step of projecting the post-interaction 3D water mist image, the step of performing information interactive operation of the relative position and the interactive operation command, and the step of displaying the post-interaction virtual 3D image are continuously performed at the third time stage and other time stages thereafter until the whole interactive model display process is completed, and the method comprises:
one VR terminal in the multiple VR terminals sends an interactive authority application to the AR terminal through the server;
the AR terminal records the application for sending the interaction authority as an appointed VR terminal and sends a signal allowing interaction to the appointed VR terminal through the server so as to endow the appointed VR terminal with the authority for interacting the virtual 3D image;
appointing a user corresponding to the VR terminal, performing interactive processing on the virtual 3D image through a preset VR interactive method, and sending the interactive processed result to other VR terminals and AR terminals through a server;
the other VR terminals except the designated VR terminal adjust the virtual 3D image according to the received interactive processing result;
and the AR terminal adjusts the 3D water mist image according to the received result after the interactive processing.
8. An interactive model display method for mixing multiple projection devices, which is characterized in that the multiple projection devices comprise an AR terminal, multiple VR terminals and water mist projection equipment, and the method comprises the following steps:
s1, in a first time period, a first user wears an AR terminal, and second to nth users wear corresponding VR terminals respectively;
s2, information interaction is carried out between the AR terminal and the VR terminals through a preset server, so that the AR terminal and the VR terminals acquire a preset initial virtual 3D model image and virtual images corresponding to users of other terminals;
s3, the AR terminal controls a preset water mist projection device, projects an initial 3D water mist image in a real space according to the initial virtual 3D model image, and displays virtual images of users corresponding to other VR terminals to a first user;
s4, the VR terminals respectively display an initial virtual 3D model image and a plurality of other virtual images except the virtual image corresponding to the end to corresponding users;
s5, in a second time stage, a first user holds a preset indicating rod in a hand and stretches into the initial 3D water mist image until the rod head of the indicating rod reaches the intention indicating position of the first user; the indication rod is composed of a rod head and a rod body which are directly connected, the rod head is made of hydrophilic materials, and the rod body is made of hydrophobic materials;
s6, the AR terminal adopts a preset binocular camera to acquire and process the space where the initial 3D water mist image is located so as to obtain two space images, and then the two space images are analyzed according to a preset image analysis method so as to obtain the relative position of the rod head of the indicating rod relative to the initial 3D water mist image;
s7, the AR terminal acquires an interactive operation instruction input by a first user through an indicating rod, and controls a preset water mist projection device to carry out interactive operation on the initial 3D water mist image according to the interactive operation instruction by taking the relative position as a reference, so that the interacted 3D water mist image is projected;
s8, information interaction is carried out between the AR terminal and the VR terminals through a server, so that the VR terminals acquire the relative positions and the interactive operation instructions sent by the AR terminal;
s9, carrying out interactive operation on the initial virtual 3D model image according to the relative position and the interactive operation instruction by a plurality of VR terminals to form an interactive virtual 3D image, and respectively displaying the interactive virtual 3D image to corresponding users;
and S10, continuously performing the step of indicating the position, the step of analyzing the relative position, the step of projecting the interacted 3D water mist image operation, the step of performing information interaction operation of the relative position and an interaction operation instruction and the step of displaying the interacted virtual 3D image at the third time stage and other subsequent time stages until the whole interactive model display process is completed.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of claim 8 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method as claimed in claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211451596.8A CN115494963B (en) | 2022-11-21 | 2022-11-21 | Interactive model display device and method for mixing multiple projection devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211451596.8A CN115494963B (en) | 2022-11-21 | 2022-11-21 | Interactive model display device and method for mixing multiple projection devices |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115494963A true CN115494963A (en) | 2022-12-20 |
| CN115494963B CN115494963B (en) | 2023-03-24 |
Family
ID=85116202
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211451596.8A Active CN115494963B (en) | 2022-11-21 | 2022-11-21 | Interactive model display device and method for mixing multiple projection devices |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115494963B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106950693A (en) * | 2017-03-24 | 2017-07-14 | 厦门轻游信息科技有限公司 | A kind of the interaction helmet and its application based on MR mixed reality technologies |
| US10065113B1 (en) * | 2015-02-06 | 2018-09-04 | Gary Mostovoy | Virtual reality system with enhanced sensory effects |
| CN109923512A (en) * | 2016-09-09 | 2019-06-21 | 上海海知智能科技有限公司 | The system and method for human-computer interaction |
| US20210096656A1 (en) * | 2018-11-20 | 2021-04-01 | Matthew Ryan Gilg | System and Method for an End-Device Modulation Based on a Hybrid Trigger |
| CN113640995A (en) * | 2021-09-10 | 2021-11-12 | 江西恒必达实业有限公司 | VR somatosensory equipment for personally submitting to natural environment |
-
2022
- 2022-11-21 CN CN202211451596.8A patent/CN115494963B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10065113B1 (en) * | 2015-02-06 | 2018-09-04 | Gary Mostovoy | Virtual reality system with enhanced sensory effects |
| CN109923512A (en) * | 2016-09-09 | 2019-06-21 | 上海海知智能科技有限公司 | The system and method for human-computer interaction |
| US20190204907A1 (en) * | 2016-09-09 | 2019-07-04 | Shanghai Guang Hui Zhi Fu Intellectual Property Co Nsulting Co., Ltd. | System and method for human-machine interaction |
| CN106950693A (en) * | 2017-03-24 | 2017-07-14 | 厦门轻游信息科技有限公司 | A kind of the interaction helmet and its application based on MR mixed reality technologies |
| US20210096656A1 (en) * | 2018-11-20 | 2021-04-01 | Matthew Ryan Gilg | System and Method for an End-Device Modulation Based on a Hybrid Trigger |
| CN113640995A (en) * | 2021-09-10 | 2021-11-12 | 江西恒必达实业有限公司 | VR somatosensory equipment for personally submitting to natural environment |
Non-Patent Citations (1)
| Title |
|---|
| 张钟霖: "用虚拟现实及影像重建技术实现大明宫含元殿原址重现", 《电子技术与软件工程》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115494963B (en) | 2023-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220139051A1 (en) | Creating a viewport in a hybrid-reality system | |
| CN106875493B (en) | The stacking method of virtual target thing in AR glasses | |
| CN109584295A (en) | The method, apparatus and system of automatic marking are carried out to target object in image | |
| US9449394B2 (en) | Image synthesis device, image synthesis system, image synthesis method and program | |
| CN110971678B (en) | Immersive visual campus system based on 5G network | |
| EP0969418A2 (en) | Image processing apparatus for displaying three-dimensional image | |
| US20040109009A1 (en) | Image processing apparatus and image processing method | |
| US11609345B2 (en) | System and method to determine positioning in a virtual coordinate system | |
| EP2175636A1 (en) | Method and system for integrating virtual entities within live video | |
| CN109961520B (en) | VR/MR classroom based on third view angle technology and construction method thereof | |
| US20200137815A1 (en) | Communication connection method, terminal device and wireless communication system | |
| EP3330928A1 (en) | Image generation device, image generation system, and image generation method | |
| CN110568923A (en) | unity 3D-based virtual reality interaction method, device, equipment and storage medium | |
| CN109246414B (en) | Projection type augmented reality image generation method and system | |
| CN113412479A (en) | Mixed reality display device and mixed reality display method | |
| CN108830944B (en) | Optical perspective three-dimensional near-to-eye display system and display method | |
| CN117333644A (en) | Virtual reality display picture generation method, device, equipment and medium | |
| CN108510541B (en) | Information adjusting method, electronic equipment and computer readable storage medium | |
| CN115562474A (en) | Virtual environment and real scene fusion display system | |
| CN115494963B (en) | Interactive model display device and method for mixing multiple projection devices | |
| KR20180097088A (en) | Sightseeing Guide Apparatus for Using Augmented Reality Technology and Method Thereof | |
| WO2021237952A1 (en) | Augmented reality display system and method | |
| CN116205980A (en) | Method and device for positioning and tracking virtual reality in mobile space | |
| CN110298918A (en) | One kind is based on GPU real-time three-dimensional modeling display device and three-dimensional modeling display methods | |
| WO2022176450A1 (en) | Information processing device, information processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |