CN114219923B - AR, VR and MR fusion method and system applied to vestige reproduction - Google Patents
AR, VR and MR fusion method and system applied to vestige reproduction Download PDFInfo
- Publication number
- CN114219923B CN114219923B CN202111531070.6A CN202111531070A CN114219923B CN 114219923 B CN114219923 B CN 114219923B CN 202111531070 A CN202111531070 A CN 202111531070A CN 114219923 B CN114219923 B CN 114219923B
- Authority
- CN
- China
- Prior art keywords
- building
- scene
- vestige
- historical
- buildings
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/04—Architectural design, interior design
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a method and a system for fusing AR, VR and MR, which are applied to vestige reproduction. Scanning all vestiges and historical buildings in the scenic spot, and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot; calling historical data related to the vestige and the historical building in a database, and acquiring historical original appearance image information corresponding to the current vestige and the historical building; combining historical original appearance image information with actual images and video information, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to a data storage device; when a user wears the virtual realization equipment to watch ancient historic buildings, VR, AR and MR scene images are switched according to the position of the user and the trails and building information presented in the virtual realization equipment worn by the user. The system comprises modules corresponding to the method steps.
Description
Technical Field
The invention provides a method and a system for fusing AR, VR and MR, which are applied to vestige reproduction, and belongs to the technical field of virtual implementation.
Background
Along with the improvement of the living standard of people, more and more people utilize the vacation to go out and visit ancient historical relics or historical buildings, often because historical relics have the incomplete or incomplete and lead to can't watch historical relic original appearance, make the visitor can't really realize the true original appearance of ancient historical relic.
Disclosure of Invention
The invention provides a method and a system for fusing AR, VR and MR, which are applied to the reproduction of a historical relic, and are used for solving the problem that the conventional historical relic and ancient buildings cannot restore and show the original appearance of the ancient historical buildings, and the adopted technical scheme is as follows:
a method for AR and VR, MR fusion for use in reconstruction of a vestige, the method comprising:
scanning all vestiges and historical buildings in the scenic spot to obtain current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
calling file data such as historical data related to the vestige and the historical building in a database, and acquiring historical original appearance image information corresponding to the current vestige and the historical building through the historical data;
building grade division is carried out according to the building completion degree, AR, VR and MR scene images are respectively formed by combining historical original appearance image information and actual image and video information of the vestige and the historical building in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device;
when a user wears the virtual realization equipment to watch ancient historic buildings, VR, AR and MR scene images are switched according to the position of the user and the vestige and building information presented in the virtual realization equipment worn by the user.
Further, combining the historical original image information of the vestige and the historical buildings, the actual image and the video information, and respectively forming AR, VR and MR scene images in an image fusion mode, wherein the method comprises the following steps:
judging the completion degree of the vestige and the historical buildings through actual images and video information, and classifying the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
aiming at the trails and buildings of a first-level integrity building, establishing a virtual scene corresponding to a historical original image through the trails and the historical original image information of the historical building, establishing a real scene corresponding to the trails and the building by utilizing the actual image and video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
aiming at the vestige and the building of a second-level integrity building, establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the vestige and the historical building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building.
Aiming at the trails and buildings of the buildings with three-level integrity, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
Further, the historic site and the historical buildings are classified into the following grades:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
Further, when the user wears the virtual realization equipment and watches ancient heritage historical building, according to the position of the user and the heritage and building information that appear in the virtual realization equipment of wearing of user, carry out VR, AR and MR scene image switching, include:
when a user wears virtual implementation equipment to watch historic buildings of ancient heritage, judging scene images corresponding to the current heritage and buildings according to the heritage and building information corresponding to the position of the user;
when the vestige and the building watched by the user wearing the virtual realization equipment are the first-level integrity building, the virtual realization equipment automatically calls the MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reproduction;
when the vestige watched by a user wearing the virtual realization equipment and the building are the second-level integrity building, the virtual realization equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reappearance;
when the vestige and the building watched by the user wearing the virtual realization equipment are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction.
Further, the performing VR, AR and MR scene image switching further includes:
before switching the MR scene image, the AR scene image and the VR scene image, prejudging the next watching scene of the user through the motion trail of the user, comprising the following steps:
monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to be used as a building of a prepared imaging scheme;
calling a scene image corresponding to the building with the imaging preparation scheme to a cache area from the data storage device, and performing scene switching preparation according to the type of the scene image of the building with the imaging preparation scheme;
when the user reaches the building position corresponding to the building of the preliminary imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
A system for AR and VR, MR fusion for use in genetic reconstruction, the system comprising:
the information acquisition module is used for scanning all vestiges and historical buildings in the scenic spot and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
the original appearance information acquisition module is used for calling file data such as historical data related to the historical relics and the historical buildings in a database and acquiring historical original appearance image information corresponding to the current relics and the historical buildings through the historical data;
the fusion imaging module is used for carrying out building grade division according to the building completion degree, combining historical original appearance image information, actual images and video information of the trails and the historical buildings, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to the data storage device;
and the scene switching module is used for switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building.
Further, the fusion imaging module includes:
the level classification module is used for judging the completion degree of the vestige and the historical buildings according to the actual image and video information and performing level classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the level classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
the MR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the historic building and the historical original appearance image information of the historic building aiming at the vestige and the building of the primary integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the AR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the second-level integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building.
The VR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the building with three-level integrity, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
Further, the historic site and the historical buildings are classified into the following grades:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige with the integrity degree ranging from 48% to 83% and the historical buildings into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
Further, the scene switching module includes:
the judging module is used for judging a current vestige and a scene image corresponding to a building according to the vestige and the building information corresponding to the position of the user when the user wears the virtual realization equipment to watch the historic ancient relic building;
the MR scene display module is used for automatically calling an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual implementation equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual implementation equipment are the first-level integrity building;
the AR scene display module is used for automatically calling the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual realization equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building;
and the VR scene display module is used for automatically calling the VR scene images corresponding to the vestige and the building of the three-level integrity building in the data storage device by the virtual realization equipment to reproduce the historic site when the vestige and the building which are watched by the user wearing the virtual realization equipment are the three-level integrity building.
Further, the scene switching module further includes:
the pre-judging switching module is used for pre-judging the next watching scene of the user through the motion trail of the user before the MR scene image, the AR scene image and the VR scene image are switched, and comprises the following steps:
the track monitoring module is used for monitoring the motion track of the user in real time, and acquiring three vestiges and buildings which are closest to the motion track direction of the user according to the motion track direction of the user to be used as a building of a prepared imaging scheme;
the calling module is used for calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and the switching module is used for directly calling the vestige and the building scene image from the cache area for scene switching when the user reaches the building position corresponding to the building with the preparation imaging scheme.
The invention has the beneficial effects that:
the method and the system for fusing the AR, the VR and the MR, which are applied to the remnants, provided by the invention, can visually reproduce the remnants with different integrity degrees in a mode of combining the AR, the VR and the MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode. Meanwhile, the method and the system for fusing the AR, the VR and the MR, which are applied to the vestige reproduction, can realize the quick switching of the AR, the VR and the MR imaging modes, can effectively reduce the switching image quality change delay in the imaging switching process of different scenes, and effectively improve the scene switching efficiency, the flexibility and the visual experience.
Drawings
FIG. 1 is a first flow chart of the method of the present invention;
FIG. 2 is a second flow chart of the method of the present invention;
fig. 3 is a system block diagram of the system of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The embodiment of the invention provides a method for fusing AR, VR and MR, which is applied to the reproduction of a genetic trail, and as shown in FIG. 1, the method comprises the following steps:
s1, scanning all vestiges and historical buildings in the scenic spot, and acquiring current actual images and video information of all vestiges and historical buildings in the scenic spot;
s2, retrieving file data such as historical data related to the historical relics and the historical buildings in the database, and acquiring historical original appearance image information corresponding to the current relics and the historical buildings through the historical data;
s3, building grade division is carried out according to building completion degrees, AR, VR and MR scene images are respectively formed by combining historical original appearance image information and actual image and video information of the vestige and the historical building in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device;
and S4, when the user wears the virtual realization equipment to watch the ancient historic building, switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual realization equipment worn by the user.
The working principle of the technical scheme is as follows: firstly, scanning all vestiges and historical buildings in a scenic spot, and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot; then, calling file data such as historical data related to the historical relics and the historical buildings in a database, and acquiring historical original image information corresponding to the current relics and the historical buildings through the historical data; then, building grade division is carried out according to building completion degree, AR, VR and MR scene images are respectively formed by combining historical original image information, actual images and video information of the vestige and the historical buildings in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device; and finally, when the user wears the virtual realization equipment to watch the ancient historic building, switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual realization equipment worn by the user.
The effect of the above technical scheme is as follows: the method for fusing AR, VR and MR for genetic reconstruction provided by this embodiment can visually reconstruct the genetic with different degrees of completeness by combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode. Meanwhile, the method for fusing the AR, the VR and the MR, which is applied to the vestige reproduction, can realize the rapid switching of the AR, the VR and the MR imaging modes, can effectively reduce the switching image quality change delay in the imaging switching process of different types of scenes, and effectively improve the scene switching efficiency, flexibility and visual experience.
In an embodiment of the present invention, the historical original image information of the historic site and the historical building, the actual image and the video information are combined to form AR, VR and MR scene images respectively in an image fusion manner, including:
s301, judging the completion degree of the vestige and the historical buildings through actual images and video information, and carrying out grade classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the grade classification comprises a first-grade integrity building, a second-grade integrity building and a third-grade integrity building; the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
s302, aiming at the vestige and the building of a first-level integrity building, establishing a virtual scene corresponding to the historical original appearance image through the historic original appearance image information of the vestige and the historical building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise vestiges, appearance structures and interior trim structures of buildings;
s303, aiming at the trails and buildings of the second-level integrity building, establishing a virtual scene corresponding to the historical primitive image through the trails and the historical primitive image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building.
S304, aiming at the trails and buildings of the three-level integrity building, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical building, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure of a building and an interior decoration structure.
The historic site and the historic building are classified into the following grades:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
and dividing the vestige with the integrity degree lower than 48 percent and the historical buildings into three-level integrity buildings.
The working principle of the technical scheme is as follows: firstly, judging the completion degree of the vestige and the historical buildings through actual images and video information, and classifying the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building; then, aiming at the trails and buildings of the first-level integrity buildings, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise vestiges, appearance structures and interior trim structures of buildings; then, aiming at the vestige and the building of the building with the second-level integrity, establishing a virtual scene corresponding to the historical original appearance image through the historic original appearance image information of the vestige and the historical building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building. Finally, aiming at the trails and buildings of the buildings with three-level integrity, establishing a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
The effect of the above technical scheme is: by means of the method, the integrity degree of the historic site and the ancient building can be highly matched with the scene presenting mode, and authenticity and visual experience of each scene imaging mode are improved. Meanwhile, the building is graded according to the integrity ratio, the degree of fit between the building and each type of imaging mode can be effectively improved, and the authenticity of each scene imaging mode is improved. The problem that reality is reduced due to the fact that a virtual scene and a real scene cannot be completely fused due to the fact that the building integrity degree is not high is solved. Meanwhile, the building grade division is carried out according to the proportion, so that the buildings can be greatly divided into high-grade scene image presenting modes such as AR and MR, the number and the range of buildings reproduced by utilizing AR and MR traces are improved as much as possible on the premise that high fusion and high reality of a virtual scene and a real scene are ensured, and the visual experience of the trace reproduction is improved.
In an embodiment of the present invention, when a user wears a virtual implementation device to watch an ancient historic building, switching VR, AR and MR scene images according to a location of the user and the historic site and building information presented in the virtual implementation device worn by the user includes:
s401, when a user wears virtual implementation equipment to watch historic buildings, judging the current vestige and the scene image corresponding to the buildings according to the vestige and the building information corresponding to the position where the user is located;
s402, when the vestige and the building watched by a user wearing the virtual realization equipment are a first-level integrity building, the virtual realization equipment automatically calls an MR scene image corresponding to the vestige and the building of the first-level integrity building in a data storage device to reproduce the historic site;
s403, when the vestige watched by the user wearing the virtual implementation equipment and the building are a second-level integrity building, the virtual implementation equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site;
s404, when the vestige watched by the user wearing the virtual realization equipment and the building are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the vestige and the building of the three-level integrity building in the data storage device to reproduce the historic site.
The working principle of the technical scheme is as follows: firstly, when a user wears virtual implementation equipment to watch historic buildings of ancient heritage, judging scene images corresponding to the current heritage and buildings according to the heritage and building information corresponding to the position of the user; then, when the vestige and the building watched by the user wearing the virtual realization equipment are a first-level integrity building, the virtual realization equipment automatically calls an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site; then, when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building, the virtual realization equipment automatically calls the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device to reproduce the historic site; and finally, when the trails watched by the user wearing the virtual implementation equipment and the buildings are the buildings with three levels of integrity, the virtual implementation equipment automatically calls VR scene images corresponding to the trails and the buildings with three levels of integrity in the data storage device to reproduce the trails.
The effect of the above technical scheme is as follows: the method can be used for visually reproducing the vestige with different integrity degrees in a mode of combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode.
In an embodiment of the present invention, the performing VR, AR and MR scene image switching further includes:
before switching the MR scene image, the AR scene image and the VR scene image, prejudging the next watching scene of the user through the motion trail of the user, comprising the following steps:
step 1, monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to serve as a building of a prepared imaging scheme;
step 2, calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and 3, when the user reaches the building position corresponding to the building with the preparation imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
Meanwhile, the running track of the tourist is changed in real time, so that the cache scene in the cache region is also changed continuously, and in order to ensure that the cache region can not only have enough space for temporarily storing the scene images, but also ensure that the scene images stored in the maximum cache region can contain landscape buildings near the tourist, the reserved time of each scene in the cache region is set as follows:
wherein, T represents the length of the cache storage time of each of the three preliminary imaging scheme buildings in the cache area when the tourist runs to one position; d represents the path distance between the tourist and the corresponding scenic spot building when three preliminary imaging scheme buildings are stored; d 1 Representing the real-time distances between the tourist and buildings corresponding to the stored buildings of the three prepared imaging schemes in the running process of the tourist; when (D-D) 1 )/(D+D 0 )<1/3, indicating that the visitor is moving away from the corresponding building, then the preliminary imaging scheme building whose distance from the visitor meets the condition is deleted in the buffer area. T is 0 Represents a storage time reference, wherein T 0 Is in the range of 15-20 minutes, and T is associated with D 1 Is changed; d 0 Indicating a base standard extension distance for properly extending the buffer time of the preliminary imaging plan building, D 0 The value range of (a) is 5m to 10m, preferably 7 m. Meanwhile, the basic standard is prolonged by the distance, the set up method can guarantee that the cache time of the preliminary imaging scheme building is sufficient, the deleting efficiency can not be influenced, and the problem that the cache space is excessively occupied due to the fact that the cache time of the preliminary imaging scheme building is too long is solved.
The working principle of the technical scheme is as follows: firstly, monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to serve as a building of a prepared imaging scheme; then, calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme; and finally, when the user reaches the building position corresponding to the building with the preliminary imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
The effect of the above technical scheme is: by the method, the vestige building which is probably visited next by the user can be judged in advance according to the action track of the user, the three vestige buildings which are probably visited by the user on the path in advance are determined through the track path of the user, the vestige and the scene corresponding to the buildings are called from the data storage device in advance, and data parameter preparation is carried out on the next switching scene of the virtual implementation equipment in advance according to the type of the scene, so that the scene switching efficiency and speed can be effectively improved, the switching image quality change delay in the imaging switching process of different kinds of scenes can be effectively reduced, and the scene switching flexibility and the visual experience are effectively improved.
An embodiment of the present invention provides a system for fusing AR, VR, and MR for genetic reconstruction, as shown in fig. 3, the system includes:
the information acquisition module is used for scanning all the vestiges and historical buildings in the scenic spot and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
the original appearance information acquisition module is used for calling file data such as historical data related to the historical relics and the historical buildings in a database and acquiring historical original appearance image information corresponding to the current relics and the historical buildings through the historical data;
the fusion imaging module is used for carrying out building grade division according to the building completion degree, combining historical original appearance image information, actual images and video information of the trails and the historical buildings, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to the data storage device;
and the scene switching module is used for switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building.
The working principle of the technical scheme is as follows: firstly, scanning all vestiges and historical buildings in a scenic spot through an information acquisition module to acquire current actual images and video information of all the vestiges and the historical buildings in the scenic spot; then, using original appearance information acquisition module to call file data such as historical data related to the historic site and the historic building in the database, and acquiring historic original appearance image information corresponding to the current historic site and the historic building through the historical data; then, building grade division is carried out according to building completion degrees by utilizing a fusion imaging module, AR, VR and MR scene images are respectively formed in an image fusion mode by combining historical original appearance image information, actual images and video information of the vestige and the historical buildings, and the AR, VR and MR scene images are sent to a data storage device; and finally, switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building through the scene switching module.
The effect of the above technical scheme is as follows: the method for fusing AR, VR and MR for genetic reconstruction provided by this embodiment can visually reconstruct the genetic with different degrees of completeness by combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode. Meanwhile, the method for fusing the AR, the VR and the MR, which is applied to the vestige reproduction, can realize the rapid switching of the AR, the VR and the MR imaging modes, can effectively reduce the switching image quality change delay in the imaging switching process of different types of scenes, and effectively improve the scene switching efficiency, flexibility and visual experience.
In one embodiment of the present invention, the fusion imaging module comprises:
the level classification module is used for judging the completion degree of the vestige and the historical buildings according to the actual image and video information and performing level classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the level classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
the MR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the historic building and the historical original appearance image information of the historic building aiming at the vestige and the building of the primary integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the AR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the second-level integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; and the virtual scene and the real scene both comprise the vestige, the appearance structure and the interior trim structure of the building.
The VR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the building with three-level integrity, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
The historic site and the historic building are classified into the following grades:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige with the integrity degree ranging from 48% to 83% and the historical buildings into two-level integrity buildings;
and dividing the trails with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings.
The working principle of the technical scheme is as follows: firstly, judging the completion degree of the vestige and the historical buildings by adopting a grade division module through actual images and video information, and carrying out grade classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the grade classification comprises a first-grade integrity building, a second-grade integrity building and a third-grade integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building; then, aiming at the trails and buildings of the first-level integrity building through an MR scene module, establishing a virtual scene corresponding to the historical primitive image through the trails and the historical primitive image information of the historical building, establishing a real scene corresponding to the trails and the building by utilizing the actual image and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building; then, aiming at the vestige and the building of a two-level integrity building through an AR scene module, establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the vestige and the historical building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building. Finally, aiming at the trails and buildings of the buildings with three-level integrity, a VR scene module is adopted to establish a virtual scene corresponding to the historical original image through the trails and the historical original image information of the historical buildings, and the virtual scene is utilized to form a VR scene image; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
The effect of the above technical scheme is as follows: by means of the method, the integrity of the historic building and the integrity of the ancient building can be highly matched with the scene presenting mode, and authenticity and visual experience of each scene imaging mode are improved. Meanwhile, the building is graded according to the integrity ratio, the degree of fit between the building and each type of imaging mode can be effectively improved, and the authenticity of each scene imaging mode is improved. The problem that reality is reduced due to the fact that a virtual scene and a real scene cannot be completely fused due to the fact that the building integrity degree is not high is solved. Meanwhile, the buildings can be divided into high-grade scene image presentation modes such as AR and MR as much as possible by carrying out building grade division according to the proportion, the number and the range of buildings reproduced by utilizing the AR and MR traces are increased as much as possible on the premise of ensuring high fusion and high reality of a virtual scene and a real scene, and the visual experience of the trace reproduction is improved.
In an embodiment of the present invention, the scene switching module includes:
the judging module is used for judging a current vestige and a scene image corresponding to a building according to the vestige and the building information corresponding to the position of the user when the user wears the virtual realization equipment to watch the historic ancient relic building;
the MR scene display module is used for automatically calling an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual implementation equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual implementation equipment are the first-level integrity building;
the AR scene display module is used for automatically calling the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual realization equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual realization equipment are the second-level integrity building;
and the VR scene display module is used for automatically calling the VR scene images corresponding to the vestige and the building of the three-level integrity building in the data storage device by the virtual realization equipment to reproduce the historic site when the vestige and the building which are watched by the user wearing the virtual realization equipment are the three-level integrity building.
The working principle of the technical scheme is as follows: firstly, when a user wears a virtual implementation device to watch an ancient historic building, a judgment module judges a current vestige and a scene image corresponding to the building according to the vestige and building information corresponding to the position of the user; then, when the vestige and the building which are watched by a user wearing the virtual realization equipment are a first-level integrity building, the virtual realization equipment automatically calls an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reappearance by utilizing an MR scene display module; then, when the vestige watched by the user wearing the virtual realization equipment and the building are a second-level integrity building, the virtual realization equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reproduction through the AR scene display module; and finally, when the trails watched by the user wearing the virtual realization equipment and the building are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the trails of the three-level integrity building and the building in the data storage device for historic site reproduction by adopting the VR scene display module.
The effect of the above technical scheme is as follows: the method can be used for visually reproducing the vestige with different integrity degrees in a mode of combining AR, VR and MR. Particularly, for the trails with low integrity, the trails can be displayed in front of the eyes of the user in a virtual implementation mode.
In an embodiment of the present invention, the scene switching module further includes:
the pre-judging switching module is used for pre-judging the next watching scene of the user through the motion trail of the user before the MR scene image, the AR scene image and the VR scene image are switched, and comprises the following steps:
the track monitoring module is used for monitoring the motion track of the user in real time, and acquiring three trails and buildings which are closest to the motion track direction of the user according to the motion track direction of the user to serve as the building of the prepared imaging scheme;
the calling module is used for calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and the switching module is used for directly calling the vestige and the building scene image from the cache area for scene switching when the user reaches the building position corresponding to the building with the preparation imaging scheme.
The working principle of the technical scheme is as follows: during the switching operation of each scene display module, a prejudgment switching module prejudges the next watching scene of a user through the motion track of the user before switching an MR scene image, an AR scene image and a VR scene image, and the operation process of the prejudgment switching module comprises the following steps:
monitoring the motion trail of a user in real time through a trail monitoring module, and acquiring three trails and buildings which are closest to each other in the motion trail direction of the user according to the motion trail direction of the user to serve as a building of a prepared imaging scheme; then, calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device through a calling module, and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme; and then, directly calling the vestige and the building scene image from the cache area for scene switching by adopting a switching module when the user reaches the building position corresponding to the building with the preparation imaging scheme.
The effect of the above technical scheme is as follows: by the method, the vestige building which is probably visited next by the user can be judged in advance according to the action track of the user, the three vestige buildings which are probably visited by the user on the path in advance are determined through the track path of the user, the vestige and the scene corresponding to the buildings are called from the data storage device in advance, and data parameter preparation is carried out on the next switching scene of the virtual implementation equipment in advance according to the type of the scene, so that the scene switching efficiency and speed can be effectively improved, the switching image quality change delay in the imaging switching process of different kinds of scenes can be effectively reduced, and the scene switching flexibility and the visual experience are effectively improved.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. A method for AR and VR, MR fusion for use in genetic reconstruction, the method comprising:
scanning all vestiges and historical buildings in the scenic spot to obtain current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
calling historical data related to the historical relics and the historical buildings in a database, and acquiring historical original image information corresponding to the current relics and the historical buildings through the historical data;
building grade division is carried out according to building completion degree, AR, VR and MR scene images are respectively formed by combining historical original appearance image information and actual image and video information of the vestige and the historical building in an image fusion mode, and the AR, VR and MR scene images are sent to a data storage device;
when a user wears virtual implementation equipment to watch ancient historic buildings, VR, AR and MR scene images are switched according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user;
wherein, the grade of the historical architecture and the historical architecture is divided as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige with the integrity degree ranging from 48% to 83% and the historical buildings into two-level integrity buildings;
dividing the vestige with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings;
in the process of switching VR, AR and MR scene images, the reserved time of each scene in the buffer area is set as follows:
wherein, T represents the length of the cache storage time of each of the three preliminary imaging scheme buildings in the cache area when the tourist runs to one position; d represents the path distance between the tourist and the corresponding sight spot building when the three preliminary imaging scheme buildings are stored; d 1 Representing the real-time distances between the tourist and buildings corresponding to the stored buildings of the three prepared imaging schemes in the running process of the tourist; when (D-D) 1 )/(D+D 0 )<1/3, when the visitor is gradually far away from the corresponding building, then the building of the preliminary imaging scheme with the distance between the visitor and the current building meeting the condition is deleted in the buffer area; t is 0 Represents a storage time reference, wherein T 0 Is in the range of 15-20 minutes, and T is associated with D 1 Is changed; d 0 Indicating a base standard extension distance for properly extending the buffer time of the preliminary imaging plan building, D 0 The value range of (A) is 5 m-10 m.
2. The method of claim 1, wherein the steps of combining the historical original image information and the actual image and video information of the historic buildings to form the images of the AR, VR and MR scenes respectively by means of image fusion comprise:
judging the completion degree of the vestige and the historical buildings through the actual images and the video information, and classifying the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
aiming at the trails and buildings of a first-level integrity building, establishing a virtual scene corresponding to a historical original image through the trails and the historical original image information of the historical building, establishing a real scene corresponding to the trails and the building by utilizing the actual image and video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
aiming at the trails and buildings of the second-level integrity buildings, establishing a virtual scene corresponding to the historical primitive appearance images through the trails and the historical primitive appearance image information of the historical buildings, establishing a real scene corresponding to the trails and the buildings by utilizing the actual images and the video information of the trails and the buildings, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
aiming at the vestige and the building of the building with three-level integrity, establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the vestige and the historical building, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure of a building and an interior decoration structure.
3. The method of claim 1, wherein when the user wears the virtual implementation device to watch the historic legacy buildings, switching between VR, AR and MR scene images according to the position of the user and the vestige and building information displayed in the virtual implementation device worn by the user comprises:
when a user wears virtual implementation equipment to watch historic buildings of ancient heritage, judging the current heritage and scene images corresponding to the buildings according to the heritage and the building information corresponding to the position where the user is located;
when the vestige and the building watched by a user wearing the virtual realization equipment are a first-level integrity building, the virtual realization equipment automatically calls an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reappearance;
when the vestige watched by a user wearing the virtual realization equipment and the building are the second-level integrity building, the virtual realization equipment automatically calls an AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reappearance;
when the vestige and the building watched by the user wearing the virtual realization equipment are the three-level integrity building, the virtual realization equipment automatically calls the VR scene image corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction.
4. The method of claim 1 or 3, wherein the performing VR, AR and MR scene image switching further comprises:
before switching the MR scene image, the AR scene image and the VR scene image, prejudging the next watching scene of the user through the motion trail of the user, comprising the following steps:
monitoring the motion trail of a user in real time, and acquiring three trails and buildings which are closest to the motion trail direction of the user according to the motion trail direction of the user to be used as a building of a prepared imaging scheme;
calling a scene image corresponding to the building with the imaging preparation scheme to a cache area from the data storage device, and performing scene switching preparation according to the type of the scene image of the building with the imaging preparation scheme;
when the user reaches the building position corresponding to the building of the preliminary imaging scheme, directly calling the vestige and the building scene image from the cache area for scene switching.
5. A system for AR and VR, MR fusion for use in genetic reconstruction, the system comprising:
the information acquisition module is used for scanning all the vestiges and historical buildings in the scenic spot and acquiring current actual images and video information of all the vestiges and the historical buildings in the scenic spot;
the original appearance information acquisition module is used for calling historical data related to the vestige and the historical buildings in a database and acquiring historical original appearance image information corresponding to the current vestige and the historical buildings through the historical data;
the fusion imaging module is used for carrying out building grade division according to the building completion degree, combining historical original appearance image information and actual image and video information of the vestige and the historical building, respectively forming AR, VR and MR scene images in an image fusion mode, and sending the AR, VR and MR scene images to the data storage device;
the scene switching module is used for switching VR, AR and MR scene images according to the position of the user and the vestige and building information presented in the virtual implementation equipment worn by the user when the user wears the virtual implementation equipment to watch the ancient historic building;
wherein, the grade of the historical architecture and the historical architecture is divided as follows:
dividing the vestige with the integrity degree higher than 83% and the historical buildings into first-level integrity buildings;
dividing the vestige and the historical buildings with the integrity degree in the range of 48% -83% into two-level integrity buildings;
dividing the vestige with the integrity degree lower than 48% and the historical buildings into three-level integrity buildings;
in the process of switching VR, AR and MR scene images, the reserved time of each scene in the buffer area is set as follows:
wherein, T represents the length of the cache storage time of each of the three preliminary imaging scheme buildings in the cache area when the tourist runs to one position; d represents the path distance between the tourist and the corresponding scenic spot building when three preliminary imaging scheme buildings are stored; d 1 Representing the real-time distances between the tourist and buildings corresponding to the stored buildings of the three prepared imaging schemes in the running process of the tourist; when (D-D) 1 )/(D+D 0 )<1/3, indicating that the guest is gradually moving away from the corresponding building, the distance between the guest and the current guest is deleted in the buffer areaPreparing imaging scheme building of the condition; t is a unit of 0 Represents a storage time reference, wherein T 0 Is in the range of 15-20 minutes, and T is associated with D 1 Is changed; d 0 Indicating a base standard extension distance for properly extending the buffer time of the preliminary imaging plan building, D 0 The value range of (A) is 5 m-10 m.
6. The system of claim 5, wherein the fusion imaging module comprises:
the level classification module is used for judging the completion degree of the vestige and the historical buildings according to the actual image and video information and performing level classification on the vestige and the historical buildings according to the completion degree of the vestige and the historical buildings, wherein the level classification comprises a first-level integrity building, a second-level integrity building and a third-level integrity building; besides, the vestige and the building integrity degree of the first-level integrity building are higher than those of the second-level integrity building, and the vestige and the building integrity degree of the second-level integrity building are higher than those of the third-level integrity building;
the MR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the first-level integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an MR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the AR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through the historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the second-level integrity building, establishing a real scene corresponding to the vestige and the building by utilizing the actual image and the video information of the vestige and the building, and carrying out image visual fusion on the virtual scene and the real scene to form an AR scene image; the virtual scene and the real scene both comprise a vestige, an appearance structure and an interior decoration structure of a building;
the VR scene module is used for establishing a virtual scene corresponding to the historical original appearance image through historical original appearance image information of the vestige and the historical building aiming at the vestige and the building of the building with three-level integrity, and forming a VR scene image by using the virtual scene; the virtual scene comprises a vestige, an appearance structure and an interior decoration structure of a building.
7. The system of claim 5, wherein the scene switching module comprises:
the judging module is used for judging a current vestige and a scene image corresponding to a building according to the vestige and the building information corresponding to the position of the user when the user wears the virtual realization equipment to watch the historic ancient relic building;
the MR scene display module is used for automatically calling an MR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device by the virtual implementation equipment to reproduce the historic site when the vestige and the building watched by the user wearing the virtual implementation equipment are the first-level integrity building;
the AR scene display module is used for automatically calling the AR scene image corresponding to the vestige and the building of the first-level integrity building in the data storage device for historic site reappearance when the vestige and the building watched by the user wearing the virtual realization device are the second-level integrity building;
and the VR scene display module is used for automatically calling the VR scene images corresponding to the vestige and the building of the three-level integrity building in the data storage device for historic site reproduction when the vestige and the building watched by the virtual realization equipment worn by the user are the three-level integrity building.
8. The system of claim 5 or 7, wherein the scene switching module further comprises:
the pre-judging switching module is used for pre-judging the next watching scene of the user through the motion trail of the user before the MR scene image, the AR scene image and the VR scene image are switched, and comprises the following steps:
the track monitoring module is used for monitoring the motion track of the user in real time, and acquiring three trails and buildings which are closest to the motion track direction of the user according to the motion track direction of the user to serve as the building of the prepared imaging scheme;
the calling module is used for calling a scene image corresponding to the building of the preliminary imaging scheme to a cache region from the data storage device and carrying out scene switching preparation according to the type of the scene image of the building of the preliminary imaging scheme;
and the switching module is used for directly calling the vestige and the building scene image from the cache area for scene switching when the user reaches the building position corresponding to the building with the preliminary imaging scheme.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111531070.6A CN114219923B (en) | 2021-12-14 | 2021-12-14 | AR, VR and MR fusion method and system applied to vestige reproduction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111531070.6A CN114219923B (en) | 2021-12-14 | 2021-12-14 | AR, VR and MR fusion method and system applied to vestige reproduction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114219923A CN114219923A (en) | 2022-03-22 |
| CN114219923B true CN114219923B (en) | 2022-09-23 |
Family
ID=80702095
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111531070.6A Active CN114219923B (en) | 2021-12-14 | 2021-12-14 | AR, VR and MR fusion method and system applied to vestige reproduction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114219923B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961400A (en) * | 2018-10-22 | 2018-12-07 | 湖南六新智能科技有限公司 | A kind of historical relic is intelligent to assist bootstrap technique and guidance system |
| CN110275617A (en) * | 2019-06-21 | 2019-09-24 | 姚自栋 | Switching method and system, the storage medium and terminal of mixed reality scene |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105677021A (en) * | 2015-12-31 | 2016-06-15 | 周岩 | New method based on fusion of AR system and VR system and applying new method to recurrence of relics |
| US20180206069A1 (en) * | 2017-01-18 | 2018-07-19 | Alexis Santos | Interactive tour system |
| CN110444133A (en) * | 2019-08-13 | 2019-11-12 | 上饶市中科院云计算中心大数据研究院 | A kind of method and apparatus of tourist attraction intelligent guide |
| CN111640184A (en) * | 2020-06-05 | 2020-09-08 | 上海商汤智能科技有限公司 | Ancient building reproduction method, ancient building reproduction device, electronic equipment and storage medium |
-
2021
- 2021-12-14 CN CN202111531070.6A patent/CN114219923B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961400A (en) * | 2018-10-22 | 2018-12-07 | 湖南六新智能科技有限公司 | A kind of historical relic is intelligent to assist bootstrap technique and guidance system |
| CN110275617A (en) * | 2019-06-21 | 2019-09-24 | 姚自栋 | Switching method and system, the storage medium and terminal of mixed reality scene |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114219923A (en) | 2022-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11790779B2 (en) | Three-dimensional information processing method and three-dimensional information processing device | |
| US10778951B2 (en) | Camerawork generating method and video processing device | |
| US11223821B2 (en) | Video display method and video display device including a selection of a viewpoint from a plurality of viewpoints | |
| US10944955B2 (en) | Multiple viewpoint image capturing system, three-dimensional space reconstructing system, and three-dimensional space recognition system | |
| US20210027496A1 (en) | Calibration apparatus and calibration method | |
| DE102009049849B4 (en) | Method for determining the pose of a camera, method for recognizing an object in a real environment and method for creating a data model | |
| CN101479765B (en) | Methods and systems for converting 2d motion pictures for stereoscopic 3d exhibition | |
| EP2234067A1 (en) | Method and system for transitioning between views in a traffic report | |
| US20070061076A1 (en) | Navigation and inspection system | |
| CN108108698A (en) | Method for tracking target and system based on recognition of face and panoramic video | |
| CN110659385B (en) | Fusion method of multi-channel video and three-dimensional GIS scene | |
| JP6126271B1 (en) | Method, program, and recording medium for providing virtual space | |
| Veas et al. | Techniques for view transition in multi-camera outdoor environments | |
| JP6292658B2 (en) | Head-mounted video display system and method, head-mounted video display program | |
| US20080043040A1 (en) | System and method for combining satellite imagery with virtual imagery | |
| CN103533313A (en) | Geographical position based panoramic electronic map video synthesis display method and system | |
| CN103888768A (en) | Video image frame sequence concentration method and device | |
| CN114219923B (en) | AR, VR and MR fusion method and system applied to vestige reproduction | |
| CN112182286B (en) | Intelligent video management and control method based on three-dimensional live-action map | |
| JPH1166350A (en) | Retrieval type scene labeling device and system | |
| JP3156645B2 (en) | Information transmission type landscape labeling device and system | |
| JP3053169B2 (en) | Communication device and system using landscape label | |
| CN111696200A (en) | Method, system, device and storage medium for displaying alarm situation | |
| JPH1145047A (en) | Mutual utilization type view labeling system | |
| US8896608B2 (en) | Method for providing an animation from a prerecorded series of still pictures |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |