CN116630584B - AR interaction digital sand table system and method based on VR panorama - Google Patents

AR interaction digital sand table system and method based on VR panorama Download PDF

Info

Publication number
CN116630584B
CN116630584B CN202310917736.4A CN202310917736A CN116630584B CN 116630584 B CN116630584 B CN 116630584B CN 202310917736 A CN202310917736 A CN 202310917736A CN 116630584 B CN116630584 B CN 116630584B
Authority
CN
China
Prior art keywords
scene
visit
sand table
positions
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310917736.4A
Other languages
Chinese (zh)
Other versions
CN116630584A (en
Inventor
熊宗明
王雯婷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Yingshang Technology Co ltd
Original Assignee
Jiangxi Yingshang Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangxi Yingshang Technology Co ltd filed Critical Jiangxi Yingshang Technology Co ltd
Priority to CN202310917736.4A priority Critical patent/CN116630584B/en
Publication of CN116630584A publication Critical patent/CN116630584A/en
Application granted granted Critical
Publication of CN116630584B publication Critical patent/CN116630584B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • Navigation (AREA)

Abstract

The embodiment of the invention relates to the technical field of digital sand tables, and particularly discloses a VR panorama-based AR interactive digital sand table system and method. According to the embodiment of the invention, the VR panoramic scene of the digital sand table is constructed; receiving the visit requirement of the digital sand table, and planning a VR visit route; marking a plurality of key scene positions; when digital visiting is carried out, a first person scene is generated in real time according to the VR panoramic scene; and at a plurality of key scene positions, carrying out interactive guidance on a first person scene of the user based on the AR technology. According to the method, a VR visit route can be planned according to visit requirements, a first-person scene is generated in real time, VR visit display is carried out, interactive guidance is carried out at a plurality of key scene positions based on the AR technology, so that users can visit the scene and the content of the key visit display, the visit display efficiency is improved, the visit freedom of the users can be guaranteed, and novel and free visit display experience is provided for the users.

Description

AR interaction digital sand table system and method based on VR panorama
Technical Field
The invention belongs to the technical field of digital sand tables, and particularly relates to a VR panorama-based AR interactive digital sand table system and method.
Background
The digital sand table is realized by using digital projection through sound, light, electricity, images, three-dimensional animation and computer program control technology. The digital sand table can fully embody the regional characteristics and achieve a dynamic visual effect of wonderful figures and various postures. The sand table model is brand new experience for visitors, can generate strong resonance, and is more visual than the traditional sand table model. The digital sand table has the characteristics of wide display content, exquisite design technique, advanced display means and high technological content.
The existing visit display of the digital sand table generally adopts a free visit and fixed route visit mode, and has the following defects: 1. when freely visiting, a user can easily ignore scenes and contents which need to be visited and displayed with emphasis, so that the efficiency of visiting and displaying is low; 2. when the fixed route is visited, the visiting freedom of the user is not high, and novel and free visiting display experience cannot be provided for the user.
Disclosure of Invention
The embodiment of the invention aims to provide a VR panorama-based AR interactive digital sand table system and a VR panorama-based AR interactive digital sand table method, and aims to solve the problems in the background art.
In order to achieve the above object, the embodiment of the present invention provides the following technical solutions:
the AR interactive digital sand table method based on VR panorama specifically comprises the following steps:
acquiring sand table scene data of a digital sand table, and constructing a VR panoramic scene of the digital sand table;
receiving a visit requirement of a digital sand table, and planning a VR visit route in the VR panorama scene;
marking a plurality of key scene positions in the VR panorama scene based on the VR visiting route;
when a user performs digital visit according to the VR visit route, a first person scene is generated in real time according to the VR panoramic scene;
and at a plurality of key scene positions, carrying out interactive guidance on a first person scene of the user based on the AR technology.
As further defined by the technical solution of the embodiment of the present invention, the obtaining the sand table scene data of the digital sand table, and constructing the VR panorama scene of the digital sand table specifically includes the following steps:
acquiring sand table scene data of a digital sand table;
extracting basic three-dimensional data and scene rendering data in the sand table scene data;
constructing a VR three-dimensional basic scene according to the basic three-dimensional data;
and performing scene rendering on the VR three-dimensional basic scene according to the scene rendering data to obtain a VR panoramic scene.
As a further limitation of the technical solution of the embodiment of the present invention, the receiving the visit requirement of the digital sand table, and planning the VR visit route in the VR panoramic scene specifically includes the following steps:
receiving the visit requirement of the digital sand table;
marking a plurality of requirement scene positions in the VR panorama scene according to the visit requirement;
and carrying out visit planning on the digital sand table according to the plurality of required scene positions to generate a VR visit route.
As a further limitation of the technical solution of the embodiment of the present invention, marking a plurality of key scene positions in a VR panoramic scene based on the VR visiting route specifically includes the following steps:
identifying a logo scene location outside of a plurality of demand scene locations based on the VR visited route;
and marking a plurality of the required scene positions and a plurality of the mark scene positions as key scene positions.
As a further limitation of the technical solution of the embodiment of the present invention, when the user performs digital visiting according to the VR visiting route, generating, in real time, a first person scene according to the VR panoramic scene specifically includes the following steps:
when a user performs digital visiting according to the VR visiting route, acquiring the digital visiting position of the user in real time;
monitoring the visiting azimuth of the user in real time to obtain visiting azimuth data;
and generating a first person scene in real time according to the VR panoramic scene according to the digital visit position and the visit azimuth data.
As a further limitation of the technical solution of the embodiment of the present invention, the interactive guidance for the first person scene of the user at a plurality of key scene positions based on the AR technology specifically includes the following steps:
acquiring key azimuth data of a plurality of key scene positions according to the sand table scene data;
generating corresponding interactive guide data according to different key azimuth data at a plurality of key scene positions;
based on an AR technology, creating a corresponding interactive guiding interface according to the interactive guiding data;
and overlapping the interactive guidance interface to the first person scene to perform AR interactive guidance.
AR interactive digital sand table system based on VR panorama, the system includes panorama scene construction unit, visit route planning unit, focus position mark unit, first person's scene real-time generation unit and AR interactive guide unit, wherein:
the panoramic scene construction unit is used for acquiring sand table scene data of the digital sand table and constructing VR panoramic scenes of the digital sand table;
the visit route planning unit is used for receiving the visit requirement of the digital sand table and planning a VR visit route in the VR panorama scene;
the key position marking unit is used for marking a plurality of key scene positions in the VR panorama scene based on the VR visit route;
the first person scene real-time generation unit is used for generating a first person scene in real time according to the VR panorama scene when a user performs digital visit according to the VR visit route;
and the AR interactive guiding unit is used for carrying out interactive guiding on the first person scene of the user on the basis of the AR technology at a plurality of key scene positions.
As further defined by the technical solution of the embodiment of the present invention, the panoramic scene construction unit specifically includes:
the scene data acquisition module is used for acquiring sand table scene data of the digital sand table;
the data extraction module is used for extracting basic three-dimensional data and scene rendering data in the sand table scene data;
the base construction module is used for constructing a VR three-dimensional base scene according to the base three-dimensional data;
and the scene rendering module is used for rendering the scene of the VR three-dimensional basic scene according to the scene rendering data to obtain a VR panoramic scene.
As a further limitation of the technical solution of the embodiment of the present invention, the visit route planning unit specifically includes:
the demand receiving module is used for receiving the visit demand of the digital sand table;
the position marking module is used for marking a plurality of required scene positions in the VR panorama scene according to the visit requirement;
and the visit planning module is used for carrying out visit planning on the digital sand table according to a plurality of the required scene positions and generating a VR visit route.
As further defined by the technical solution of the embodiment of the present invention, the AR interactive guidance unit specifically includes:
the azimuth data acquisition module is used for acquiring key azimuth data of a plurality of key scene positions according to the sand table scene data;
the guide data generation module is used for generating corresponding interactive guide data according to different key azimuth data at a plurality of key scene positions;
the guidance interface creation module is used for creating a corresponding interactive guidance interface according to the interactive guidance data based on the AR technology;
and the AR interactive guiding module is used for overlapping the interactive guiding interface to the first person scene to conduct AR interactive guiding.
Compared with the prior art, the invention has the beneficial effects that:
according to the embodiment of the invention, the VR panoramic scene of the digital sand table is constructed; receiving the visit requirement of the digital sand table, and planning a VR visit route; marking a plurality of key scene positions; when digital visiting is carried out, a first person scene is generated in real time according to the VR panoramic scene; and at a plurality of key scene positions, carrying out interactive guidance on a first person scene of the user based on the AR technology. According to the method, a VR visit route can be planned according to visit requirements, a first-person scene is generated in real time, VR visit display is carried out, interactive guidance is carried out at a plurality of key scene positions based on the AR technology, so that users can visit the scene and the content of the key visit display, the visit display efficiency is improved, the visit freedom of the users can be guaranteed, and novel and free visit display experience is provided for the users.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following description will briefly introduce the drawings that are needed in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are only some embodiments of the present invention.
Fig. 1 shows a flowchart of a method provided by an embodiment of the present invention.
Fig. 2 shows a flowchart of a VR panorama scene for constructing a digital sand table in a method provided by an embodiment of the present invention.
Fig. 3 illustrates a flow chart of planning VR visited routes on demand in a method provided by an embodiment of the present invention.
Fig. 4 shows a flowchart of marking a plurality of key scene positions in the method according to the embodiment of the present invention.
Fig. 5 shows a flowchart of generating a first person scene in real time in the method according to the embodiment of the present invention.
Fig. 6 shows a flowchart of a first person scene interaction guidance in the method provided by the embodiment of the invention.
Fig. 7 shows an application architecture diagram of a system provided by an embodiment of the present invention.
Fig. 8 shows a block diagram of a panoramic scene construction unit in the system according to the embodiment of the present invention.
Fig. 9 is a block diagram showing a structure of a visit route planning unit in the system according to the embodiment of the present invention.
Fig. 10 is a block diagram illustrating a structure of an AR interactive guidance unit in a system according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
It will be appreciated that in the prior art, for the visit presentation of digital sand tables, a free visit and a fixed route visit are generally adopted, and these two different distributions have the following drawbacks: 1. when freely visiting, a user can easily ignore scenes and contents which need to be visited and displayed with emphasis, so that the efficiency of visiting and displaying is low; 2. when the fixed route is visited, the visiting freedom of the user is not high, and novel and free visiting display experience cannot be provided for the user.
In order to solve the problems, the embodiment of the invention constructs the VR panorama scene of the digital sand table; receiving the visit requirement of the digital sand table, and planning a VR visit route; marking a plurality of key scene positions; when digital visiting is carried out, a first person scene is generated in real time according to the VR panoramic scene; and at a plurality of key scene positions, carrying out interactive guidance on a first person scene of the user based on the AR technology. According to the method, a VR visit route can be planned according to visit requirements, a first-person scene is generated in real time, VR visit display is carried out, interactive guidance is carried out at a plurality of key scene positions based on the AR technology, so that users can visit the scene and the content of the key visit display, the visit display efficiency is improved, the visit freedom of the users can be guaranteed, and novel and free visit display experience is provided for the users.
Fig. 1 shows a flowchart of a method provided by an embodiment of the present invention.
Specifically, in a preferred embodiment of the present invention, a VR panorama-based AR interactive digital sand table method, the method specifically includes the following steps:
step S100, sand table scene data of the digital sand table are obtained, and VR panorama scene of the digital sand table is constructed.
In the embodiment of the invention, the sand table scene data of the digital sand table to be displayed is acquired, and the sand table scene data is classified and identified to obtain a classification and identification result. According to the classification and identification result, classifying and processing are carried out on the sand table scene data, basic three-dimensional data and scene rendering data in the sand table scene data are extracted, three-dimensional visualization processing is carried out on the basic three-dimensional data, a VR three-dimensional basic scene of the digital sand table is constructed, then scene rendering processing is carried out on the VR three-dimensional basic scene based on the scene rendering data, and a VR panoramic scene is generated on the basis of the VR three-dimensional basic scene, so that all sand table details of the digital sand table can be met by the VR panoramic scene, and preparation is carried out for VR display of the digital sand table.
Specifically, fig. 2 shows a flowchart of a VR panorama scene for constructing a digital sand table in the method provided by the embodiment of the present invention.
In a preferred embodiment of the present invention, the obtaining the sand table scene data of the digital sand table, and constructing the VR panorama scene of the digital sand table specifically includes the following steps:
step S101, sand table scene data of a digital sand table are obtained;
step S102, extracting basic three-dimensional data and scene rendering data in the sand table scene data;
the basic three-dimensional data comprises a plurality of sand table target objects, wherein each sand table target object corresponds to an object attribute type and an object coordinate position. The scene rendering data includes rendering colors and rendering levels. Step S103, constructing a VR three-dimensional basic scene according to the basic three-dimensional data;
in this embodiment, step S103 specifically includes: step S1031, performing positioning analysis on a plurality of sand table target objects in the basic three-dimensional data to obtain an object attribute type and an object coordinate position corresponding to each sand table target object;
step S1032, establishing a VR three-dimensional coordinate system, and carrying out coordinate conversion on the object coordinate position corresponding to each sand table target object in the VR three-dimensional coordinate system so as to obtain converted VR object coordinate positions respectively;
step S1033, positioning the corresponding sand table target object in the VR three-dimensional coordinate system according to the plurality of VR object coordinate positions to obtain a VR target object, and constructing according to the plurality of VR target objects and the corresponding VR object coordinate positions to obtain a VR three-dimensional basic scene.
And step S104, performing scene rendering on the VR three-dimensional basic scene according to the scene rendering data to obtain a VR panoramic scene.
In this embodiment, the above-described scene rendering data includes an object attribute color mapping table. Specifically, in the object attribute color mapping table, what color the object attribute type specifically corresponds to is recorded. It can be appreciated that the setting can provide default attribute colors, reducing the workload of user's rendering color selection, and reducing the difficulty of light rendering.
Specifically, step S104 specifically includes:
step S1041, obtaining attribute types of VR objects corresponding to each VR target object in the VR three-dimensional basic scene;
step S1042, according to the VR object attribute types corresponding to each VR target object, searching and determining a corresponding first color RGB value in an object attribute color mapping table;
step S1043, receiving a rendering grade sent by a user, and adjusting a first color RGB value corresponding to each VR target object according to the rendering grade to update to obtain a second color RGB value;
in this embodiment, the above-mentioned rendering class is divided into five classes, which are respectively: negative second order, negative first order, zero order, positive first order, and positive second order. For example, when receiving that the rendering level sent by the user is zero, then no adjustment is required to be performed on the first color RGB value; when receiving that the rendering grade sent by the user is negative, performing down-regulation on the first color RGB according to the set parameters; when the rendering level sent by the user is positive, the first color RGB is up-regulated according to the set parameters.
Step S1044, performing scene rendering on each VR target object according to the corresponding second color RGB value of the VR target object, so as to obtain a VR panoramic scene.
Further, the VR panorama-based AR interactive digital sand table method further includes the following steps:
step S200, receiving a visit requirement of the digital sand table, and planning a VR visit route in the VR panoramic scene.
In the embodiment of the invention, for different users, different visit requirements possibly exist, corresponding visit requirements are required to be input before formal digital sand table visit, the visit requirements uploaded by the users are received, analysis is carried out on the visit requirements, a plurality of positions of the users with key visit requirements in a VR panorama scene are determined, the positions are marked as requirement scene positions, route planning is carried out on the visit of the users in the VR panorama scene according to the plurality of requirement scene positions, and therefore VR visit routes capable of meeting the visit of the plurality of requirement scene positions and meeting the visit of the digital sand table with the marked scene are generated.
Specifically, fig. 3 shows a flowchart of planning VR visited routes on demand in a method provided by an embodiment of the present invention.
In the preferred embodiment provided by the invention, the receiving of the visit requirement of the digital sand table and the planning of the VR visit route in the VR panorama scene specifically comprise the following steps:
step S201, receiving the visit requirement of the digital sand table;
step S202, marking a plurality of required scene positions in the VR panorama scene according to the visit requirement;
step S203, according to a plurality of the required scene positions, carrying out the visit planning of the digital sand table, and generating a VR visit route.
In this embodiment, in order to improve the visit availability, the number of the above-mentioned demand scene positions is at least three. Regarding the setting of VR visited routes, there are the following steps:
step S2031, when it is determined that the number of the required scene positions is equal to three and the three required scene positions are located in the same straight line, automatically generating a first straight line, identifying marker scene positions with a vertical distance smaller than a preset distance from the first straight line, and automatically connecting all the identified marker scene positions with the three required scene positions in sequence to generate the VR visiting route;
step S2032, when it is determined that the number of the required scene positions is equal to three and the three required scene positions are not located on the same straight line, connecting the three required scene positions in a straight line to form a triangle route, identifying mark scene positions with vertical distances smaller than a preset distance from the inside and outside of a border of the triangle route, and automatically connecting all the identified mark scene positions with the three required scene positions in sequence to generate the VR visiting route;
step S2033, when it is determined that the number of the required scene positions is greater than three and the plurality of required scene positions are not located on the same straight line, connecting the plurality of required scene positions with a straight line to form a polygonal route, identifying the marker scene positions with vertical distances smaller than a preset distance from the inside to the outside of a boundary of the polygonal route, and automatically connecting all the identified marker scene positions with the plurality of required scene positions in sequence to generate the VR visiting route.
Further, the VR panorama-based AR interactive digital sand table method further includes the following steps:
step S300, marking a plurality of key scene positions in the VR panorama scene based on the VR visit route.
In the embodiment of the invention, the mark scene positions outside the plurality of requirement scene positions on the VR visiting route are determined, the plurality of mark scene positions are marked on the VR visiting route, and the plurality of requirement scene positions are correspondingly marked to obtain a plurality of key scene positions.
Specifically, fig. 4 shows a flowchart of marking a plurality of key scene positions in the method provided by the embodiment of the invention.
In a preferred embodiment of the present invention, marking a plurality of key scene positions in a VR panoramic scene based on the VR visit route specifically includes the following steps:
step S301, identifying mark scene positions outside a plurality of requirement scene positions based on the VR visit route;
here, the above-mentioned demand scene position and the sign scene position are both located on the VR visited route.
Step S302, marking a plurality of the required scene positions and a plurality of the mark scene positions as key scene positions.
In this embodiment, after marking the required scene position and the flag scene position, in order to distinguish the importance degree (i.e., the necessity degree of visiting) of each VR visited route, a visit necessity score may be calculated to evaluate.
Specifically, the calculation formula of the visit necessity score is expressed as:
；
wherein ,representing the calculated visit necessity score,/->Basic score indicating visit necessity, +.>Representing the belonging to the +.>First->A unit visit necessity score value corresponding to the individual VR target object, < ->Representing belonging to +.>First->A unit visit necessity score value corresponding to the individual VR target object, < ->Class number indicating VR target object in demand scenario, < ->Representing VR in demand scenariosThe total number of categories of the target object,representing->First->Individual VR target object, ++>Representing->Total number of VR target objects in seed class, +.>Class number representing VR target object in logo scene,/-, for example>Representing the total number of categories, +.>Representing +.>Total number of VR target objects in a class.
For the above requirement scene belong to the firstFirst->Unit visit necessity score value corresponding to individual VR target object +.>There is the following formula:
；
wherein ,basic score value representing the visit necessity corresponding to VR target object in demand scenario, +.>Representing correction factors>Representing the belonging to the +.>First->The frequency with which individual VR target objects are required per unit time.
It should be noted here that the sign scene belongs to the first categoryFirst->Unit visit necessity score value corresponding to individual VR target object +.>This value is typically set manually.
Further, the VR panorama-based AR interactive digital sand table method further includes the following steps:
step S400, when a user performs digital visit according to the VR visit route, a first person scene is generated in real time according to the VR panoramic scene.
In the embodiment of the invention, when a user wears VR equipment and digitally visits a digital sand table according to a VR visit route, scene visit positioning is carried out on the user, the digital visit position of the user in the VR panorama scene is obtained in real time, the visit azimuth data of the user is obtained by monitoring the visit azimuth of the user in real time, a first-person scene of the user is built in real time in the VR panorama scene by integrating the digital visit position and the visit azimuth data, and corresponding display is carried out on the visit of the user in the digital sand table according to the first-person scene updated in real time.
Specifically, fig. 5 shows a flowchart of generating a first person scene in real time in the method provided by the embodiment of the invention.
In the preferred embodiment of the present invention, when the user performs digital visiting according to the VR visiting route, generating, in real time, a first person scene according to the VR panoramic scene specifically includes the following steps:
step S401, when a user performs digital visit according to the VR visit route, acquiring the digital visit position of the user in real time;
step S402, monitoring the visiting azimuth of a user in real time to obtain visiting azimuth data;
step S403, generating a first person scene in real time according to the VR panoramic scene according to the digital visiting position and the visiting azimuth data.
Further, the VR panorama-based AR interactive digital sand table method further includes the following steps:
and S500, performing interactive guidance on a first person scene of the user on the basis of the AR technology at a plurality of key scene positions.
According to the embodiment of the invention, key azimuth data corresponding to a plurality of key scene positions are acquired according to sand table scene data, when a user refers to and approaches to one key scene position, corresponding interactive guide data are generated according to the key azimuth data corresponding to the key scene position, and further, based on an AR technology, a corresponding interactive guide interface is created according to the interactive guide data, the interactive guide interface is overlapped into a first person scene, AR interactive guide is carried out on the user, so that the user can carry out key visit on the key scene position of the guide, and the efficiency of visiting and displaying is improved.
Specifically, fig. 6 shows a flowchart of a first person scene interaction guidance in the method provided by the embodiment of the invention.
In the preferred embodiment of the present invention, the interactive guiding of the first person scene of the user based on the AR technology at the plurality of key scene positions specifically includes the following steps:
step S501, acquiring key azimuth data of a plurality of key scene positions according to the sand table scene data;
step S502, generating corresponding interactive guiding data according to different key azimuth data at a plurality of key scene positions;
step S503, based on AR technology, creating a corresponding interactive guiding interface according to the interactive guiding data;
step S504, overlapping the interactive guidance interface to the first person scene, and performing AR interactive guidance.
Further, fig. 7 shows an application architecture diagram of the system provided by the embodiment of the present invention.
In another preferred embodiment of the present invention, the VR panorama-based AR interactive digital sand table system includes:
the panoramic scene construction unit 100 is configured to obtain sand table scene data of a digital sand table, and construct a VR panoramic scene of the digital sand table.
In the embodiment of the invention, the panorama scene constructing unit 100 classifies and identifies sand table scene data of a digital sand table to be displayed by acquiring the sand table scene data, obtains a classification and identification result, classifies and processes the sand table scene data according to the classification and identification result, extracts basic three-dimensional data and scene rendering data in the sand table scene data, performs three-dimensional visualization processing on the basic three-dimensional data, constructs a VR three-dimensional basic scene of the digital sand table, performs scene rendering processing on the VR three-dimensional basic scene based on the scene rendering data, and generates a VR panorama scene on the basis of the VR three-dimensional basic scene, so that the VR panorama scene can meet all sand table details of the digital sand table, and prepares for VR display of the digital sand table.
Specifically, fig. 8 shows a block diagram of the panoramic scene construction unit 100 in the system according to the embodiment of the present invention.
In a preferred embodiment of the present invention, the panoramic scene construction unit 100 specifically includes:
a scene data acquisition module 101, configured to acquire sand table scene data of a digital sand table;
the data extraction module 102 is configured to extract basic three-dimensional data and scene rendering data in the sand table scene data;
a base construction module 103, configured to construct a VR three-dimensional base scene according to the base three-dimensional data;
and the scene rendering module 104 is configured to perform scene rendering on the VR three-dimensional basic scene according to the scene rendering data to obtain a VR panoramic scene.
Further, the VR panorama-based AR interactive digital sand table system further includes:
the visit route planning unit 200 is configured to receive a visit requirement of the digital sand table, and plan a VR visit route in the VR panorama scene.
In the embodiment of the present invention, for different users, which may have different visiting requirements, before visiting a formal digital sand table, the visiting route planning unit 200 needs to input corresponding visiting requirements, analyzes the visiting requirements by receiving the visiting requirements uploaded by the user, determines a plurality of positions of the user with key visiting requirements in the VR panorama scene, marks the plurality of positions as the required scene positions, and performs route planning on the visit of the user in the VR panorama scene according to the plurality of required scene positions, thereby generating a VR visiting route capable of meeting the plurality of required scene positions and meeting the visit of the user with the marked scene in the digital sand table.
Specifically, fig. 9 shows a block diagram of a visit route planning unit 200 in the system according to the embodiment of the present invention.
In a preferred embodiment of the present invention, the visit route planning unit 200 specifically includes:
a demand receiving module 201, configured to receive a visit demand of the digital sand table;
a position marking module 202, configured to mark a plurality of required scene positions in the VR panorama scene according to the visit requirement;
and the visit planning module 203 is configured to perform visit planning on the digital sand table according to a plurality of the demand scene positions, and generate a VR visit route.
Further, the VR panorama-based AR interactive digital sand table system further includes:
and the key position marking unit 300 is used for marking a plurality of key scene positions in the VR panorama scene based on the VR visiting route.
In the embodiment of the present invention, the key position marking unit 300 determines the mark scene positions on the VR visited route, which are outside the plurality of requirement scene positions, marks the plurality of mark scene positions on the VR visited route, and correspondingly marks the plurality of requirement scene positions to obtain a plurality of key scene positions.
And the first-person scene real-time generation unit 400 is configured to generate a first-person scene in real time according to the VR panoramic scene when the user performs digital visit according to the VR visit route.
In the embodiment of the invention, when a user wears VR equipment and digitally visits a digital sand table according to a VR visit route, a first-person scene real-time generation unit 400 performs scene visit positioning on the user, acquires the digital visit position of the user in the VR panorama scene in real time, monitors the visit position of the user in real time, acquires the visit position data of the user, constructs the first-person scene of the user in real time in the VR panorama scene by integrating the digital visit position and the visit position data, and performs corresponding display on the visit of the user in the digital sand table according to the first-person scene updated in real time.
The AR interactive guidance unit 500 is configured to perform interactive guidance on a first person scene of a user based on AR technology at a plurality of the key scene positions.
In the embodiment of the invention, the AR interactive guidance unit 500 obtains the key azimuth data corresponding to each of the plurality of key scene positions according to the sand table scene data, generates the corresponding interactive guidance data according to the key azimuth data corresponding to one key scene position when the user refers to and approaches to the key scene position, creates the corresponding interactive guidance interface according to the interactive guidance data based on the AR technology, and overlaps the interactive guidance interface into the first person scene to perform AR interactive guidance for the user, so that the user can perform key visit on the key scene position of the guidance, and the efficiency of visiting and displaying is improved.
Specifically, fig. 10 shows a block diagram of an AR interactive guidance unit 500 in the system according to an embodiment of the present invention.
In a preferred embodiment of the present invention, the AR interactive guidance unit 500 specifically includes:
the azimuth data obtaining module 501 is configured to obtain key azimuth data of a plurality of key scene positions according to the sand table scene data;
the guiding data generating module 502 is configured to generate corresponding interactive guiding data according to different key azimuth data at a plurality of key scene positions;
the guiding interface creating module 503 is configured to create a corresponding interactive guiding interface according to the interactive guiding data based on the AR technology;
the AR interactive guidance module 504 is configured to overlap the interactive guidance interface to the first person scene for AR interactive guidance.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in various embodiments may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of other steps or other steps.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the invention and are described in detail herein without thereby limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the invention.

Claims (4)

1. The AR interaction digital sand table method based on VR panorama is characterized by comprising the following steps of:
acquiring sand table scene data of a digital sand table, and constructing a VR panoramic scene of the digital sand table;
receiving a visit requirement of a digital sand table, and planning a VR visit route in the VR panorama scene;
marking a plurality of key scene positions in the VR panorama scene based on the VR visiting route;
when a user performs digital visit according to the VR visit route, a first person scene is generated in real time according to the VR panoramic scene;
in a plurality of key scene positions, based on an AR technology, performing interactive guidance on a first person scene of a user;
the method for acquiring the sand table scene data of the digital sand table and constructing the VR panorama scene of the digital sand table specifically comprises the following steps:
acquiring sand table scene data of a digital sand table;
extracting basic three-dimensional data and scene rendering data in the sand table scene data;
constructing a VR three-dimensional basic scene according to the basic three-dimensional data;
performing scene rendering on the VR three-dimensional basic scene according to the scene rendering data to obtain a VR panoramic scene;
according to the basic three-dimensional data, the method for constructing the VR three-dimensional basic scene specifically comprises the following steps:
positioning and analyzing a plurality of sand table target objects in the basic three-dimensional data to obtain object attribute types and object coordinate positions corresponding to each sand table target object;
establishing a VR three-dimensional coordinate system, and carrying out coordinate conversion on the object coordinate position corresponding to each sand table target object in the VR three-dimensional coordinate system to obtain converted VR object coordinate positions respectively;
positioning the corresponding sand table target object in the VR three-dimensional coordinate system according to the plurality of VR object coordinate positions to obtain a VR target object, and constructing according to the plurality of VR target objects and the corresponding VR object coordinate positions to obtain a VR three-dimensional basic scene;
according to the scene rendering data, performing scene rendering on the VR three-dimensional basic scene to obtain a VR panoramic scene, wherein the method comprises the following steps:
obtaining VR object attribute types corresponding to each VR target object in the VR three-dimensional basic scene;
searching and determining a corresponding first color RGB value in an object attribute color mapping table according to the VR object attribute type corresponding to each VR target object;
receiving a rendering grade sent by a user, and adjusting a first color RGB value corresponding to each VR target object according to the rendering grade to update to obtain a second color RGB value;
according to the RGB value of the second color corresponding to each VR target object, performing scene rendering on the corresponding VR target object to obtain a VR panoramic scene;
the method for planning the VR visiting route in the VR panorama scene specifically comprises the following steps of:
receiving the visit requirement of the digital sand table;
marking a plurality of requirement scene positions in the VR panorama scene according to the visit requirement;
according to the plurality of the demand scene positions, carrying out visit planning on the digital sand table to generate a VR visit route;
according to a plurality of the required scene positions, carrying out the visit planning of the digital sand table, and generating a VR visit route, wherein the method comprises the following steps:
when the number of the required scene positions is equal to three and the three required scene positions are located in the same straight line, automatically generating a first straight line, identifying mark scene positions with the vertical distance smaller than a preset distance from the first straight line, and automatically connecting all the identified mark scene positions with the three required scene positions in sequence to generate the VR visiting route;
when the number of the required scene positions is equal to three and the three required scene positions are not located on the same straight line, connecting the three required scene positions in a straight line to form a triangular route, identifying mark scene positions with vertical distances smaller than a preset distance from the inner side to the outer side of a side line of the triangular route, and automatically connecting all the identified mark scene positions with the three required scene positions in sequence to generate the VR visit route;
when the number of the required scene positions is judged to be more than three and the required scene positions are not located on the same straight line, connecting the required scene positions in a straight line to form a polygonal route, identifying mark scene positions with vertical distances between the required scene positions and the inner side and the outer side of a boundary of the polygonal route being smaller than a preset distance, and automatically connecting all the identified mark scene positions with the required scene positions in sequence to generate the VR visit route;
after the VR visit routes are obtained, a visit necessity score is obtained through calculation, and the importance degree of each VR visit route is distinguished;
the calculation formula of the visit necessity score is expressed as:
；
wherein ,representing the calculated visit necessity score,/->Basic score indicating visit necessity, +.>Representing the belonging to the +.>First->A unit visit necessity score value corresponding to the individual VR target object, < ->Representing belonging to +.>First->A unit visit necessity score value corresponding to the individual VR target object, < ->Class number indicating VR target object in demand scenario, < ->Representing the total number of categories, +.>Representing->First->Individual VR target object, ++>Representing->Total number of VR target objects in seed class, +.>Class number representing VR target object in logo scene,/-, for example>Representing the total number of categories, +.>Representing +.>The total number of VR target objects in the seed class;
for the above requirement scene belong to the firstFirst->Unit visit corresponding to each VR target objectValue of score of necessity->There is the following formula:
；
wherein ,basic score value representing the visit necessity corresponding to VR target object in demand scenario, +.>Representing correction factors>Representing the belonging to the +.>First->The frequency with which individual VR target objects are required per unit time.
2. The VR panorama-based AR interactive digital sand table method of claim 1, wherein the marking a plurality of highlight scene locations in a VR panorama scene based on the VR visit route specifically comprises the steps of:
identifying a logo scene location outside of a plurality of demand scene locations based on the VR visited route;
and marking a plurality of the required scene positions and a plurality of the mark scene positions as key scene positions.
3. The VR panorama-based AR interactive digital sand table method of claim 2, wherein when the user performs digital visiting according to the VR visiting route, generating a first person scene in real time according to the VR panorama scene specifically comprises the following steps:
when a user performs digital visiting according to the VR visiting route, acquiring the digital visiting position of the user in real time;
monitoring the visiting azimuth of the user in real time to obtain visiting azimuth data;
generating a first person scene in real time according to the VR panoramic scene according to the digital visit position and the visit azimuth data;
the interactive guidance for the first person scene of the user based on the AR technology at a plurality of key scene positions specifically comprises the following steps:
acquiring key azimuth data of a plurality of key scene positions according to the sand table scene data;
generating corresponding interactive guide data according to different key azimuth data at a plurality of key scene positions;
based on an AR technology, creating a corresponding interactive guiding interface according to the interactive guiding data;
and overlapping the interactive guidance interface to the first person scene to perform AR interactive guidance.
4. A VR panorama based AR interactive digital sand table system, characterized in that the VR panorama based AR interactive digital sand table method according to any of the claims 1 to 3 is applied, said system comprising a panorama scene construction unit, a visit route planning unit, an important position marking unit, a first person scene real time generation unit and an AR interactive guiding unit, wherein:
the panoramic scene construction unit is used for acquiring sand table scene data of the digital sand table and constructing VR panoramic scenes of the digital sand table;
the visit route planning unit is used for receiving the visit requirement of the digital sand table and planning a VR visit route in the VR panorama scene;
the key position marking unit is used for marking a plurality of key scene positions in the VR panorama scene based on the VR visit route;
the first person scene real-time generation unit is used for generating a first person scene in real time according to the VR panorama scene when a user performs digital visit according to the VR visit route;
the AR interactive guiding unit is used for carrying out interactive guiding on the first person scene of the user on the basis of the AR technology at a plurality of key scene positions;
the panoramic scene construction unit specifically includes:
the scene data acquisition module is used for acquiring sand table scene data of the digital sand table;
the data extraction module is used for extracting basic three-dimensional data and scene rendering data in the sand table scene data;
the base construction module is used for constructing a VR three-dimensional base scene according to the base three-dimensional data;
the scene rendering module is used for rendering the scene of the VR three-dimensional basic scene according to the scene rendering data to obtain a VR panoramic scene;
the visit route planning unit specifically includes:
the demand receiving module is used for receiving the visit demand of the digital sand table;
the position marking module is used for marking a plurality of required scene positions in the VR panorama scene according to the visit requirement;
the visit planning module is used for carrying out visit planning on the digital sand table according to a plurality of the required scene positions to generate a VR visit route;
the AR interactive guidance unit specifically comprises:
the azimuth data acquisition module is used for acquiring key azimuth data of a plurality of key scene positions according to the sand table scene data;
the guide data generation module is used for generating corresponding interactive guide data according to different key azimuth data at a plurality of key scene positions;
the guidance interface creation module is used for creating a corresponding interactive guidance interface according to the interactive guidance data based on the AR technology;
and the AR interactive guiding module is used for overlapping the interactive guiding interface to the first person scene to conduct AR interactive guiding.
CN202310917736.4A 2023-07-25 2023-07-25 AR interaction digital sand table system and method based on VR panorama Active CN116630584B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310917736.4A CN116630584B (en) 2023-07-25 2023-07-25 AR interaction digital sand table system and method based on VR panorama

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310917736.4A CN116630584B (en) 2023-07-25 2023-07-25 AR interaction digital sand table system and method based on VR panorama

Publications (2)

Publication Number Publication Date
CN116630584A CN116630584A (en) 2023-08-22
CN116630584B true CN116630584B (en) 2023-10-10

Family

ID=87603148

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310917736.4A Active CN116630584B (en) 2023-07-25 2023-07-25 AR interaction digital sand table system and method based on VR panorama

Country Status (1)

Country Link
CN (1) CN116630584B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006163670A (en) * 2004-12-06 2006-06-22 Kagoya Japan Inc Visiting route searching system and program
CN105763568A (en) * 2013-08-07 2016-07-13 江苏赞奇科技股份有限公司 Implementation method and system for three dimensional scene on-line panorama display, immersive roaming, and man-machine interaction
CN109887084A (en) * 2019-02-20 2019-06-14 成都市勘察测绘研究院 A method of urban planning is used for using Immersed Virtual Reality Technology
CN210427960U (en) * 2019-10-11 2020-04-28 南京晓庄学院 Sand table demonstration virtual reality VR projection arrangement
CN115222926A (en) * 2022-07-22 2022-10-21 领悦数字信息技术有限公司 Method, apparatus, and medium for planning a route in a virtual environment
CN116227834A (en) * 2022-12-28 2023-06-06 四川农业大学 Intelligent scenic spot digital platform based on three-dimensional point cloud model

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040032410A1 (en) * 2002-05-09 2004-02-19 John Ryan System and method for generating a structured two-dimensional virtual presentation from less than all of a three-dimensional virtual reality model

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006163670A (en) * 2004-12-06 2006-06-22 Kagoya Japan Inc Visiting route searching system and program
CN105763568A (en) * 2013-08-07 2016-07-13 江苏赞奇科技股份有限公司 Implementation method and system for three dimensional scene on-line panorama display, immersive roaming, and man-machine interaction
CN109887084A (en) * 2019-02-20 2019-06-14 成都市勘察测绘研究院 A method of urban planning is used for using Immersed Virtual Reality Technology
CN210427960U (en) * 2019-10-11 2020-04-28 南京晓庄学院 Sand table demonstration virtual reality VR projection arrangement
CN115222926A (en) * 2022-07-22 2022-10-21 领悦数字信息技术有限公司 Method, apparatus, and medium for planning a route in a virtual environment
CN116227834A (en) * 2022-12-28 2023-06-06 四川农业大学 Intelligent scenic spot digital platform based on three-dimensional point cloud model

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Fangchang Ma 等.Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image.《IEEE Xplore》.2018,全文. *
陈颖博 等.基于增强现实的场馆学习效果分析——以"AR盒子"虚拟仿真学习环境为例.《现代远程教育研究》.2020,全文. *

Also Published As

Publication number Publication date
CN116630584A (en) 2023-08-22

Similar Documents

Publication Publication Date Title
US10593104B2 (en) Systems and methods for generating time discrete 3D scenes
JP6627861B2 (en) Image processing system, image processing method, and program
US7031495B2 (en) Data authoring device
US20180357819A1 (en) Method for generating a set of annotated images
CN111008927B (en) Face replacement method, storage medium and terminal equipment
CN108388882A (en) Based on the gesture identification method that the overall situation-part is multi-modal RGB-D
KR101700648B1 (en) System for displaying carbon emission on the region planing model
JP2010055424A (en) Apparatus, method and program for processing image
CN112667179B (en) Remote synchronous collaboration system based on mixed reality
CN104484814A (en) Advertising method and system based on video map
US20180039715A1 (en) System and method for facilitating an inspection process
US11258945B2 (en) Interactive data visualization environment
CN116630584B (en) AR interaction digital sand table system and method based on VR panorama
JP2016143345A (en) Program, information processor, and information processing method
CN107481306B (en) Three-dimensional interaction method
CN106303694A (en) A kind of method prepared by multimedia slide
EP3972241A1 (en) Information processing device, information processing method, and program
CN109325991A (en) A kind of pre-buried map generalization method, apparatus of three-dimensional water power, equipment and storage medium
CN110853487A (en) Digital sand table system for urban design
JP6372165B2 (en) Design management apparatus and program
CN110689614A (en) Method, medium, device and system for collecting device information based on electronic map
CN115309113A (en) Guiding method for part assembly and related equipment
CN112085636B (en) Urban functional shrinkage analysis method, device and storage medium
CN111506280B (en) Graphical user interface for indicating off-screen points of interest
KR20150028377A (en) System and method for producing sns based contents

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant