CN115934014A - Immersive virtual large screen construction method based on cluster driving - Google Patents

Abstract

The invention discloses a cluster-driven immersive virtual large screen construction method, which comprises the following steps: displaying the legacy cluster through a single surround screen; displaying origin-destination (OD) clusters by a bilateral layout; the clusters output by the hierarchical clustering algorithm are displayed by a hierarchical layout. The invention can improve the analysis efficiency of scientific data and the readability and integrity of the analysis result, the integrity of the extraction result is mainly embodied in that cluster analysis of different semantics and topological structures is carried out, the final result can be searched, analyzed and explored, visual confusion can be reduced to a great extent, data noise can be removed, and the logical structure of the scientific data can be clarified.

Description

Immersive virtual large screen construction method based on cluster driving

Technical Field

The invention relates to the technical field of time change scientific data immersive visualization, in particular to a cluster-driven immersive virtual large screen construction method.

Background

The large-screen spliced display wall is a centralized display terminal for various signals of computers, videos, networks and the like. The traditional large-screen spliced display wall is composed of a plurality of displays, is the mainstream display equipment at present, the displays share the same coordinate space and have the capability of expanding and displaying large images, and the auxiliary function is provided for leadership decision and command by quickly acquiring various dynamic image signals. With recent breakthroughs in Virtual Reality (VR) technology, the immersive industry has provided reasonably priced high quality hardware and software to provide users with exploration and analysis of data. Data exploration and analysis are carried out through a mode of combining an immersive display wall and a physical large screen splicing display wall, and a user can be helped to observe and understand the logical structure of data more intuitively.

The traditional physical large-screen splicing display wall does not have good expansibility. It has a series of problems, such as high cost, complex maintenance, difficulty in carrying and moving, etc. These problems have greatly limited the popularity of large screen tiled display walls. More importantly, the topological information cannot be visually displayed on the traditional large-screen spliced display wall by the result obtained by the traditional clustering algorithm. This makes it impossible for the user to intuitively understand the hierarchy between data in the process of viewing screen content, particularly in relation to scientific data animation, which makes the user have some impediment to understanding the content displayed on the screen.

In general, currently, there are many limitations to time-varying scientific data exploration using large-screen tiled display walls, for example: the working efficiency is not high, visual confusion is caused by complex data, and the data display mode is not beneficial to understanding and the like. This is mainly due to the insufficient expansibility of the traditional large-screen splicing display wall, namely: high cost, complex maintenance, difficult transportation and movement, etc.

Disclosure of Invention

The purpose of the invention is as follows: in order to overcome the defects in the prior art, the immersion type virtual large screen construction method based on the cluster driving is provided, the analysis efficiency of scientific data and the readability and integrity of analysis results can be improved, the integrity of extraction results is mainly reflected in that cluster analysis of different semantics and topological structures is carried out, the final results can be searched, analyzed and explored, visual confusion can be reduced to a great extent, data noise can be removed, and the logical structure of the scientific data can be clarified.

The technical scheme is as follows: in order to achieve the above object, the present invention provides a method for constructing an immersive virtual large screen based on cluster driving, which includes the following steps:

s1: displaying the legacy clusters through a single surround screen;

s2: displaying the origin-destination cluster by a bilateral layout;

s3: the clusters output by the hierarchical clustering algorithm are displayed by a hierarchical layout.

Further, the step S1 specifically includes:

a1: creating a single surround screen rendered for a user position in an immersive environment;

a2: loading time-varying data displayed in a traditional cluster form;

a3: integrating all data of traditional clusters on a single screen

A4: animating the change in the data in the center of the surround screen;

a5: filtering time by using high resolution animation;

a6: the conventional cluster data is displayed on the surround screen.

Further, the step A6 specifically includes:

a user approaches the screen through a touch handle and observes the detail data of each continent;

the user moves the position of each continent by touching the handle to distinguish the cluster information of each region.

Further, the step S2 specifically includes:

b1: selecting a part with region representation meaning in the vector field ocean data;

b2: rendering a preview of the overall effect of the ocean current in an earth model at the center of the frame;

b3: generating a screen layout, namely generating a plurality of sub-screens distributed around a central sphere, wherein the central sphere displays an overview query effect, and the top and bottom screens display a detail query result;

b4: loading cluster data clustered by the original point on each screen at the top;

b5: loading cluster data of the destination cluster on each screen at the bottom;

b6: tracking ocean data of each cluster by using a DBSCAN clustering algorithm, and displaying the ocean data on a sphere and a screen by using a time-varying animation effect;

b7: and closely observing the detailed information of the sub-screen.

Further, the step B7 specifically includes:

the freely customized sub-screens allow a user to freely control the number of the sub-screens, and the position of any sub-screen is adjusted through a handle, so that the animation can be conveniently browsed or demonstrated;

the amplifying sub-screen is that any one of the sub-screens is selected through a button of the handle, and the selected sub-screen can appear in the center of the picture and be amplified through clicking, so that details can be observed conveniently.

Further, the step S3 specifically includes:

c1: selecting a part of points representing regional main clusters in the path;

c2: hierarchical clustering of all loading paths is obtained through hierarchical clustering, and the number of screens in the large-screen splicing display wall is equal to the number of clusters;

c3: assigning virtual camera shots to the screen to track the respective time-varying path clusters;

c4: observing updates of each ocean on the earth through the generated screen mapped to the clusters;

c5: all animated presentations of time-varying data types are displayed in an immersive virtual large screen.

Has the advantages that: compared with the prior art, the invention has the following advantages:

1. the invention designs three layouts to explore clusters with different semantics and topological structures so as to better present scientific data changing along with time, the cluster-driven large-screen spliced display wall presentation provides a strategy from summary to detailed exploration, and compared with the traditional physical large-screen spliced display wall, the layout in a virtual space can be flexibly changed according to the semantic information of the clusters.

2. The data display method is operated based on an immersive environment, the data display layout is constructed by using an immersive virtual reality technology, data exploration and analysis are carried out through a mode of combining an immersive mode and a physical large screen splicing display wall, and a user can be helped to explore data immersive visual analysis results more intuitively.

3. The interchangeability of the invention enables users to intuitively know the hierarchy structure of the data layers in the process of observing the screen content, particularly scientific data animation, and strengthens the understanding of the users to the mathematical logic of the screen display content.

Drawings

FIG. 1 is a schematic diagram of a two-sided layout showing origin-destination (OD) clustering according to the present invention;

FIG. 2 is a schematic diagram of a hierarchical layout showing a hierarchical clustering algorithm according to the present invention;

FIG. 3 is a schematic diagram illustrating a user exploring data using a bilateral layout display effect according to the present invention;

FIG. 4 is a schematic diagram of a user viewing cluster information by enlarging a bilateral layout sub-screen according to the present invention;

FIG. 5 is a schematic diagram of a user being able to amplify the overall clustering result to perform detailed data exploration and observe clustering information according to the present invention;

FIG. 6 is a schematic view of an origin (O) clustered large-screen tiled display wall according to the present invention;

FIG. 7 is a schematic view of a destination (D) clustered large-screen tiled display wall according to the present invention;

FIG. 8 is a schematic diagram illustrating a user exploring data using a hierarchical layout display effect in accordance with the present invention;

FIG. 9 is a schematic diagram of a user viewing cluster information by enlarging a sub-screen of a hierarchical layout according to the present invention.

Detailed Description

The present invention is further illustrated by the following figures and specific examples, which are to be understood as illustrative only and not as limiting the scope of the invention, which is to be given the full breadth of the appended claims and any and all equivalent modifications thereof which may occur to those skilled in the art upon reading the present specification.

The invention provides an immersive virtual large screen construction method based on cluster driving, which comprises the following steps:

s1: displaying a traditional cluster through a single surround screen, specifically comprising:

a1: creating a single surround screen rendered for a user position in an immersive environment;

a2: loading time-varying data displayed in a traditional cluster form;

a3: integrating all data of traditional clusters on a single screen

A4: animating the change in the data in the center of the surround screen;

a5: filtering time by using high resolution animation;

a6: displaying the traditional cluster data on a surround screen;

a7: a user approaches the screen through a touch handle and observes the detail data of each continent;

a8: the user moves the position of each continent through the touch handle to distinguish the cluster information of each area.

In the embodiment, a global carbon emission data set with a resolution of 960 × 1920 and a time step of 24, which is observed by a satellite of the institute of atmospheric research of the academy of sciences of china, is taken as an application example, and it can be seen from the layout that the change of carbon emission data is animated around the center of a screen, and a user performs data exploration and analysis without moving a space, and in the embodiment, the change of carbon emission per month in all regions in a climate model and all regions in the world can be seen; by using high resolution animation filtering time, the user can see the long term carbon emission trend of global carbon emission.

S2: origin-destination (OD) clusters are displayed by a two-sided layout, which, with reference to fig. 1, is specifically:

b1: selecting a part with region representation meaning in the vector field ocean data;

b2: rendering a preview of the overall effect of the ocean current in an earth model at the center of the frame;

b3: generating a screen layout, namely generating a plurality of sub-screens distributed around a central sphere, wherein the central sphere displays an overview query effect, and the top and bottom screens display a detail query result;

b4: loading cluster data of the origin cluster on each screen at the top, and as shown in fig. 6, displaying a large-screen spliced display wall with the origin (O) cluster schematically;

b5: each screen at the bottom loads cluster data of a destination cluster, and a schematic diagram of a destination (D) cluster large screen splicing display wall is shown in FIG. 7;

b6: tracking ocean data of each cluster by using a DBSCAN clustering algorithm, and displaying the ocean data on a sphere and a screen by using a time-varying animation effect;

b7: and closely observing the detailed information of the sub-screen.

B8: the freely customized sub-screens allow a user to freely control the number of the sub-screens, and the position of any sub-screen is adjusted through a handle, so that the animation can be conveniently browsed or demonstrated;

b9: the amplifying sub-screen is that any one of the sub-screens is selected through a button of the handle, and the selected sub-screen can appear in the center of a picture and be amplified through clicking, so that details can be observed conveniently.

In this layout, a user can select a certain portion of the vector field ocean data and place it as an overview over the earth model; the immersive virtual large screen automatically generates a screen layout which is suitable for carrying out origin-destination (OD) clustering query according to origin-destination (OD) clustering drive, namely, a top screen displays an origin (O) query result and a bottom screen displays a destination (D) query result; in addition, the user can closely observe the detailed information of each sub-screen by moving a rocker of the touch handle; also, tools in the system allow users to freely customize sub-screens in an immersive environment; the user can select a sub-screen to be enlarged to more clearly view details on the screen; the user may also drag the sub-screen up and down, placing the screen at a visually appropriate angle and position for the user to browse the presentation animation.

Based on the above steps, fig. 3 in this embodiment is a schematic diagram illustrating a user exploring data by using a bilateral layout display effect; FIG. 4 is a schematic diagram of a user viewing cluster information from a sub-screen with an enlarged bilateral layout; fig. 5 is a schematic diagram of a user capable of amplifying the whole clustering result to perform detailed data exploration and observe clustering information.

S3: the clusters output by the hierarchical clustering algorithm are displayed by hierarchical layout, and referring to fig. 2, the method specifically includes:

c1: selecting a part of points representing regional main clusters in the path;

c2: hierarchical clustering of all loading paths is obtained through hierarchical clustering, and the number of screens in the large-screen splicing display wall is equal to the number of clusters;

c3: assigning virtual camera shots to the screen to track the respective time-varying path clusters;

c4: observing updates of each ocean on the earth through the generated screen mapped to the cluster;

c5: all animated presentations of time-varying data types are displayed in an immersive virtual large screen.

In the layout, a user can obtain a time-varying clustering result by observing the animation effect of data changing along with time, and predict the data change trend;

based on the above steps, fig. 8 is a schematic diagram illustrating a user exploring data by using a hierarchical layout display effect; fig. 9 is a schematic diagram of a user being able to enlarge the hierarchical layout sub-screen to view cluster information.

The specific process of step S1 in this embodiment is as follows: first, changes in carbon emissions data are animated at the center of the surrounding screen, and data exploration and analysis can be performed without spatial movement. By filtering time using high resolution animation, users can see long-term trends in global carbon emissions on the surround screen. The carbon emissions for all regions in the climate model, and for all regions of the world, vary from month to month. The user approaches the screen by touching the handle and observes the carbon emission details of each continent. The immersive virtual large screen allows the user to move the position of each continent by touching the handle, clearly distinguishing the cluster information of each region.

The specific process of step S2 in this embodiment is: first, after selecting a portion of the vector field ocean data, a preview of the overall effect of ocean currents appears in the earth model at the center of the frame. Then, a screen layout is generated, namely a plurality of sub-screens are generated and distributed around the central sphere, the top screen displays the overview query effect, and the bottom screen displays the detail query result. The user can observe the detailed information of the sub-screen in a short distance, namely, the observation position and the observation angle are freely adjusted through remote sensing of the handle, so that the purpose of short-distance observation is achieved. The user can also freely customize the sub-screens, the user can freely control the number of the sub-screens, and the position of any sub-screen is adjusted through the handle, so that the animation can be conveniently browsed or demonstrated. The amplifying sub-screen is that any one of the sub-screens is selected through a button of a handle, and the selected sub-screen can appear in the center of a picture and be amplified through clicking, so that details can be observed conveniently.

The specific process of step S3 in this embodiment is as follows: firstly, selecting some specific points in the path, and then obtaining the hierarchical clustering of all the loading paths through the hierarchical clustering. The number of screens in the large-screen spliced display wall is equal to the number of clusters. One virtual camera lens is assigned to one screen (mapped to a cluster) to track the corresponding time-varying path cluster. In this layout, several specific points in the path line are selected, and the user can simultaneously observe the updates of each ocean on the earth on the generated screen mapped to the cluster. At the same time, all animated presentations of time-varying data types may be displayed in an immersive virtual large screen. The user can obtain a time-varying clustering result by observing the animation effect of the data changing along with the time, and the data change trend is predicted.

The embodiment also provides an immersive virtual large screen construction system based on cluster driving, which comprises a network interface, a memory and a processor; the network interface is used for receiving and sending signals in the process of receiving and sending information with other external network elements; a memory for storing computer program instructions executable on the processor; a processor for, when executing the computer program instructions, performing the steps of the consensus method described above.

The present embodiment also provides a computer storage medium storing a computer program that when executed by a processor can implement the method described above. The computer-readable medium may be considered tangible and non-transitory. Non-limiting examples of a non-transitory tangible computer-readable medium include non-volatile memory circuits (e.g., flash memory circuits, erasable programmable read-only memory circuits, or masked read-only memory circuits), volatile memory circuits (e.g., static random access memory circuits or dynamic random access memory circuits), magnetic storage media (e.g., analog or digital tapes or hard drives), and optical storage media (e.g., CD, DVD, or blu-ray disc), among others. The computer program includes processor-executable instructions stored on at least one non-transitory tangible computer-readable medium. The computer program may also comprise or rely on stored data. The computer programs may include a basic input/output system (BIOS) that interacts with the hardware of the special purpose computer, a device driver that interacts with specific devices of the special purpose computer, one or more operating systems, user applications, background services, background applications, and the like.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

Claims (6)

1. A cluster-driven immersive virtual large screen construction method is characterized by comprising the following steps:

s1: displaying the legacy clusters through a single surround screen;

s2: displaying the origin-destination cluster by a bilateral layout;

s3: the clusters output by the hierarchical clustering algorithm are displayed by a hierarchical layout.

2. The method for constructing the immersive virtual large screen based on the cluster driving as claimed in claim 1, wherein the step S1 specifically comprises:

a1: creating a single surround screen rendered for a user position in an immersive environment;

a2: loading time-varying data displayed in a traditional cluster form;

a3: integrating all data of traditional clusters on a single screen

A4: animating the change in the data in the center of the surround screen;

a5: filtering time by using high resolution animation;

a6: the conventional cluster data is displayed on a surround screen.

3. The method for constructing the immersive virtual large screen based on the cluster driving as claimed in claim 2, wherein the step A6 specifically comprises:

a user approaches the screen through a touch handle and observes the detail data of each continent;

the user moves the position of each continent by touching the handle to distinguish the cluster information of each region.

4. The method for constructing the immersive virtual large screen based on the cluster driving as claimed in claim 1, wherein the step S2 specifically comprises:

b1: selecting a part with region representation meaning in the vector field ocean data;

b2: rendering a preview of the overall effect of the ocean current in an earth model at the center of the frame;

b3: generating a screen layout, namely generating a plurality of sub-screens distributed around a central sphere, wherein the central sphere displays an overview query effect, and the top and bottom screens display detailed query results;

b4: loading cluster data clustered by the original point on each screen at the top;

b5: loading cluster data of the destination cluster on each screen at the bottom;

b6: tracking ocean data of each cluster by using a DBSCAN clustering algorithm, and displaying the ocean data on a sphere and a screen by using a time-varying animation effect;

b7: and closely observing the detailed information of the sub-screen.

5. The method for constructing the immersive virtual large screen based on the cluster driving as claimed in claim 1, wherein the step B7 specifically comprises:

the freely customized sub-screens allow a user to freely control the number of the sub-screens, and the position of any sub-screen is adjusted through a handle, so that the animation can be conveniently browsed or demonstrated;

the amplifying sub-screen is that any one of the sub-screens is selected through a button of the handle, and the selected sub-screen can appear in the center of a picture and be amplified through clicking, so that details can be observed conveniently.

6. The method for constructing the immersive virtual large screen based on the cluster driving as claimed in claim 1, wherein the step S3 specifically comprises:

c1: selecting a part of points representing regional main clusters in the path;

c2: hierarchical clustering of all loading paths is obtained through hierarchical clustering, and the number of screens in the large-screen splicing display wall is equal to the number of clusters;

c3: assigning virtual camera shots to the screen to track the respective time-varying path clusters;

c4: observing updates of each ocean on the earth through the generated screen mapped to the clusters;

c5: all animated presentations of time-varying data types are displayed in an immersive virtual large screen.

Images