CN102148818A - Method and system for realizing distributed virtual reality and visualization on mobile device - Google Patents

Method and system for realizing distributed virtual reality and visualization on mobile device Download PDF

Info

Publication number
CN102148818A
CN102148818A CN2010106128335A CN201010612833A CN102148818A CN 102148818 A CN102148818 A CN 102148818A CN 2010106128335 A CN2010106128335 A CN 2010106128335A CN 201010612833 A CN201010612833 A CN 201010612833A CN 102148818 A CN102148818 A CN 102148818A
Authority
CN
China
Prior art keywords
virtual reality
visualization
mobile device
server
command
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2010106128335A
Other languages
Chinese (zh)
Other versions
CN102148818B (en
Inventor
李胜
汪国平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Tong Jian telit Intelligent Systems Engineering Technology Co.,Ltd.
Original Assignee
Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University filed Critical Peking University
Priority to CN 201010612833 priority Critical patent/CN102148818B/en
Publication of CN102148818A publication Critical patent/CN102148818A/en
Application granted granted Critical
Publication of CN102148818B publication Critical patent/CN102148818B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a method and a system for realizing distributed virtual reality and visualization on a mobile device, which belong to the technical field of graph and visualization. The method is as follows: 1, communication connection between the mobile device and a virtual reality and visualization server is established; 2, an interactive operation request command is resolved into an interactive command for a virtual reality and visualization system by the mobile device; 3, the interactive command is transmitted to the virtual reality and visualization system by the mobile device; 4, corresponding calculations are executed by the virtual reality and visualization system according to the interactive command, and an execution result is sent to the mobile device; and 5, the received data is decoded by the mobile device to show virtual scene and visualization results. The system comprises a client installed on the mobile device, and a server on the virtual reality and visualization server; and the mobile device is connected with the virtual reality and visualization server through network. The invention can implement high-precision three-dimensional scene browsing and roaming on common mobile devices, and greatly improves the sense of reality for drawing.

Description

Realize distributed virtual reality and visualization method and system on the mobile device
Technical field
The present invention relates to a kind of distributed virtual reality and visualization method on mobile device, realized, belong to virtual reality and technology, figure and visualization technique, network communications technology field.
Background technology
Current society, the various application software on mobile device and the mobile device are more and more universal.The latest edition Cortex-A9 version of mobile computing chip on the present mobile device such as up-to-date embedded-type ARM framework, but the internal memory peak capacity is 512M, core frequency is up to 2GHZ, but its static storage and dynamic capability and calculated performance and tradition all greatly differ from each other based on the computer and the server of X86 framework, especially performance the most powerful dedicated version in GPU aspect is Mali-T604 under this framework, its parameter is for supporting OpenGL ES 1.1/2.0, the geometric manipulations capacity limit is per second ten million rank, the pixel filling rate limit is per second 100,000,000 ranks, only can support the 3D digital entertainment of some lightweights, but a width of cloth virtual scene may comprise the dough sheet of 1,000,000 millions in virtual reality and visualization system, also may include a large amount of physical models, the vector line drawing, or other virtual reality content such as illumination, wave, sky etc., finish these huge data computing and draw the calculating and the drawing ability of mobile device head and shoulders above, and how to store these mass datas and also face the challenge.
Therefore present mobile device is powerless fully to some senior 3 D image drawings and computing application, lets alone at the reality environment with magnanimity graph data (comprising how much, texture, image etc.) to carry out real-time rendering and carry out relevant visual application.
Summary of the invention
At carrying out 3 D image drawing, virtual reality and visual restriction on the mobile device, the method and system of virtual reality and visualization function have been the objective of the invention is to propose realize on a kind of mobile device to computing capability and storage capacity, 3-D graphic disposal ability.
Computing function, memory function and three-dimensional image processing function at virtual reality on the mobile device and visualization system are realized by being distributed on virtual reality and the visual high-performance GPU cluster server, and mobile device itself only provides functions such as receiving the decode of the parsing of user interaction graphical interface and interactive function, user interactions instruction and transmission, virtual reality and the visual Streaming Media of drawing out, this requirement to the mobile device calculated performance is very low, and the function that almost only need possess display image gets final product.The computational load of whole like this virtual reality and visual application is just almost completely born by the GPU cluster server, the GPU cluster server is responsible for finishing whole virtual reality and is calculated and all functions of drawing, and be responsible for receiving and carrying out user's control command of sending, and result and visual compressed encoding as a result that three-dimensional virtual scene is drawn are that carrier feeds back to mobile device with the Streaming Media by mobile device.According to this framework we develop prototype system, test result shows, this system has realized carrying out efficient virtual reality and visualization system function nimbly and freely on mobile device, surmount far away single mobile device can possess and finish and calculate and the function of storage, and mutual control also can reach real-time.Medical imaging is visual in addition: digital tomosynthesis, geoscience is visual: oil and natural gas exploration, calculation biology: a series of and visual relevant application such as molecular dynamics simulation also can be in the application that realizes under this framework on the mobile device.The leading person Google of digital earth system research and development and application has attempted according to current schema Google Map being transplanted on the mobile device, released GoogleMap Mobile (Google Maps mobile phone version), the user can use online browse whole world image under mobile device such as the PocketPC platform, but it realizes that framework is different fully with our method.
Technical scheme of the present invention is:
Realize distributed virtual reality and visualization method on a kind of mobile device, the steps include:
1) sets up communicating to connect of mobile device and virtual reality and visualization server; Wherein, mobile device comprises a graphical interface of user and carries out the client of virtual reality and visualization display that virtual reality and visualization server comprise a virtual reality and visualization system;
2) mobile device receives the interactive operation request command by described graphical interface of user, and it is resolved to the interactive command of virtual reality and visualization system;
3) mobile device is packaged into packet with the interactive command of resolving and sends to virtual reality and visualization server;
4) virtual reality and visualization server parse interactive command from packet, and send it to described virtual reality and visualization system;
5) virtual reality and visualization system are carried out corresponding calculated according to interactive command, carry out virtually drawing then and are that Streaming Media sends to mobile device with the execution result compressed encoding;
6) mobile device is decoded to receiving data, shows virtual scene and visualization result.
Further, if the interactive operation request command is the order outside the three-dimensional main window view of described graphical interface of user, then virtual reality and visualization server are resolved this order according to the graphical interfaces command messages response function of setting.
Further, if the interactive operation request command is the order within the three-dimensional main window view of described graphical interface of user, its command format is the coordinate of two dimension view, then virtual reality and visualization server with this two dimension view coordinate format command mapping be in the corresponding three-dimensional space object and according to action forward-backward correlation within this window, parse operational motion order to three dimensional object.
Further, described virtual reality and visualization system comprise a parallel virtually drawing subsystem; After these all virtual realities and Visual calculation task were finished, described parallel virtually drawing subsystem carried out the 3-D graphic virtually drawing.
Further, described parallel virtually drawing subsystem has the GPU cluster to make up; Described parallel virtually drawing subsystem adopts the sort-first strategy to carry out 3 D image drawing.
Further, described user images interface comprises: the container of interactive means in menu, button, toolbar, dialog box, shortcut, three-dimensional navigation graphical interfaces and the three-dimensional scenic.
Realize distributed virtual reality and visual system on a kind of mobile device, it is characterized in that comprising the server end on client, virtual reality and the visualization server on the mobile device; Described mobile device is connected by communication network with visualization server with described virtual reality; Wherein, described client comprises a graphical interface of user, a command analysis and sending module, stream media decoding module, Streaming Media drafting module; Described server end comprises a virtual reality and visualization system, orders receiver module, Streaming Media compressed encoding module;
Described graphical interface of user is used to receive the interactive operation request command;
Described command analysis and sending module are used for the interactive operation request command is resolved to the interactive command of virtual reality and visualization system, and it is packaged into packet sends to described order receiver module;
Described order receiver module is used for the packet that receives is stored and resolved, and the interactive command that parses is sent to described virtual reality and visualization system;
Described virtual reality and visualization system are used for carrying out corresponding calculated and virtually drawing according to interactive command, and execution result are sent to Streaming Media compressed encoding module;
Described Streaming Media compressed encoding module, being used for execution result is carried out compressed encoding is Streaming Media, and sends it to described stream media decoding module;
Described stream media decoding module is used for decoding to receiving data;
Described Streaming Media drafting module is used for decoded data are drawn demonstration virtual scene and visualization result.
Further, described virtual reality and visualization system comprise a parallel virtually drawing subsystem, are used for that these all virtual realities and Visual calculation task are finished data afterwards and carry out the 3-D graphic virtually drawing.
Further, described parallel virtually drawing subsystem has the GPU cluster to make up; Described parallel virtually drawing subsystem adopts the sort-first strategy to carry out 3 D image drawing.
Further, described server end adopts separate server framework or distributed server architecture.
Compared with prior art, good effect of the present invention is:
Google Maps mobile phone version is only supported general GIS function, map view for example, functions such as point searching navigation, do not possess the height interaction of similar virtual reality system, to the operability of three-dimensional scenic and controlled, the function (comprising editor's structure, the modification of three-dimensional virtual scene, virtual emulation etc.) that does not more possess the three-dimension virtual reality system.And its three-dimensional function very a little less than, only support very limited pseudo-three-dimensional browse mode, can't carry out browsing and roaming of high accuracy three-dimensional scene, the true sensitivity of the drafting of three-dimensional scenic is poor.
Novelty of the present invention is embodied in: solved finished on the mobile computing device of hardware performance relative mistake with existing ordinary individual's computer and high performance graphics work station, server on the real-time virtual reality function the same that can realize with visualization system, and the backstage adopts the GPU cluster to realize that as the server of high-performance calculation virtual reality and visualization function make the user at the virtual reality function experience effect on the mobile device even than the perfection more on common personal computer and high performance graphics work station.
Description of drawings
The operational flow diagram of Fig. 1, moving distributing virtual reality of the present invention and visualization system;
Distributed virtual reality and visualization system structure chart on Fig. 2, the mobile device of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention is further described in detail:
The operational process of moving distributing virtual reality of the present invention and visualization system is as shown in Figure 1:
1) the overall general flow of system is as follows: the client on the mobile device is connected with visual application server with virtual reality, to calculate and operation requests sends to virtual reality applications system on virtual reality and the visual application server, application system sends to client on the mobile device with corresponding calculated and execution result, and a virtual reality and visual application server can provide support and serve for a plurality of mobile devices;
2) user receives and result displayed according to the client on the mobile device, by the every function in mutual whole virtual reality of control of graphic user interface and the visualization system, user interface is divided into two parts: the 1) interactive interface within the three-dimensional main window view of graphical interfaces (perhaps being called the window main frame) (2) outside the three-dimensional main window views such as menu, button, tool bar.Above interface is generated by the client on the mobile device, and server end is not have the interactive graphics (IG) interface.Interactive interface is comprising the three-dimensional virtual scene that passes through in the interactive mode browsing virtual reality systems such as keyboard, mouse, menu graphical interface, select, pick up the three-dimensional object, add, deletion, revise three dimensional object with and correlation behavior and attribute, carry out the various forms of motion controls of three-dimensional body in the virtual scene, adjust various rendering attributes (for example illumination of three-dimensional environment, material, shade, the sense of reality is drawn grade), carry out a series of every function and the operations relevant such as visual of three-dimensional mass data set with virtual reality system;
Native system is different with Long-distance Control (for example remote desktop connection), the interactive graphics (IG) interface of native system is responsible for by the client on the mobile device fully, server end only provides the service on backstage, can not provide any interactive interface to long-range mobile subscriber, and server end can not generate any graphic user interface yet, more can on server, not show any interface content, user on the server can freely use server to carry out other various calculating and demonstration task, and the existence of imperceptible long-range mobile client at all.Long-distance Control belongs to system-level technology in addition, and the invention belongs to the technology of application layer.
3) every calculating in the virtual reality system and drafting function are finished jointly by the various server clusters on virtual reality and visual application server and backstage.
● wherein data server is responsible for to the application server Data transmission, and cooperation between the data server and scheduling are to realize by coordination server.In the distributed virtual reality platform, data server is responsible for the preservation and the distribution of massive terrains data, visualized data, model data etc.The task of data server is heavier, so in the platform a plurality of data servers can be arranged, and data server comes balanced load by coordination server.The virtual environment data of asking when application server are not when current some servers that connect, coordination server can be browsed or the request of data such as visual figure, image, multimedia calculates the position (promptly on which platform data server) of data in distributed environment according to user's needs, connect the obtaining and transmit of the line data of going forward side by side by application server and the data server that stores these data.
● owing to can have a plurality of clients that whole virtual reality is conducted interviews simultaneously and control in the Distributed Virtual Reality System, it is collaborative that client is moved in reality environment is to be responsible for by central server (collaborative, synchronously, load-balanced server).
● virtual reality and visual application server are mainly finished the drafting function of management, calculating and the three-dimensional environment of virtual reality system, when finishing above function, the data that use if desired are not on current server, then can send request and ask for related data, wait to obtain to calculate again after the data and processing such as drafting to data server.Drafting at three-dimensional environment, the hardware configuration of application server can be configuration polylith GPU on the main frame, also can be that multiple host (configuration one or polylith GPU on every main frame) is as drawing asynchronous GPU cluster of the common formation of node, software environment adopts the parallel drawing strategy, generally adopts sort-first parallel drawing strategy.The drafting action of carrying out at virtual reality and visual application server is " virtually drawing ", that is to say that this drafting does not have any image result output and is presented on the display terminal (as display, projecting apparatus etc.), but output to virtual image space (as FBO frame buffer object etc.), the image result that virtually drawing goes out is through making up on application server, and compressed encoding is sent to mobile client by application server then.
The system module structure of distributed virtual reality and visualization system as shown in Figure 2 on the mobile device of the present invention.Whole system is made of two parts, is respectively mobile device client and some virtual realities and visual application server end.The mobile device client runs on the mobile device, and virtual reality and visualization server end run on virtual reality and the visual application server.
1) graphical interface of user: graphical interfaces provides partly that the user carries out mutual various interfaces on mobile client, the container that comprises the various interactive meanses in menu, button, toolbar, dialog box, shortcut, three-dimensional navigation graphical interfaces and the three-dimensional scenic, the user can freely control the various objects in virtual reality and visualization system and the three-dimensional virtual scene by above various interactive interface instruments.(this graphical interfaces is user's exploitation, can utilize any mobile phone graphic user interface developing instrument exploitation).
2) user interaction commands is resolved and sending module: this module at first is responsible for receiving user's operational motion and is resolved the interactive command that becomes whole virtual reality system, because mobile client itself is not really carried out these orders, the execution reality of the operational order in these virtual reality systems all is to be finished by virtual reality and visual application server, is sent to virtual reality and visual application server so this module is responsible for that these interactive commands are broken into packet by wireless network.
3) user command receiver module: at server end special-purpose data buffering memory block is arranged, be used to receive the mutual control command that mobile client sends.
4) window main frame user command parsing module: according to the difference of the type of user command, if this order is the order on the window main frame of graphical interfaces of mobile client, corresponding graphical interfaces command messages response function is then arranged within this module, resolve this order, and executing the task of will ordering is given to distributed virtual reality and visualization system.
5) three-dimensional main window two dimension is shone upon and parsing module to three-dimensional: if user's mutual control command is within three-dimensional main window view, then the command format of Chuan Diing be two dimension view coordinate (for example, if what click is some points within the main window view, then transmit the coordinate of the Pixel-level of this point), utilize the function of this two dimension to three-dimensional inverse mapping, can obtain the object in the corresponding three-dimensional space, and forward-backward correlation according to the action within window, the practical operation action that parses three dimensional object (for example pulls, move etc.), parse after the corresponding action, pass through message passing mechanism, by distributed virtual reality and visualization system response message, and carry out relevant operational order.
5) distributed virtual reality and visualization system: carry out relevant instruction by this real time execution system, finish every calculation task (comprising scene management, DDM, system resource management, IO management, physical engine, collision detecting system, script engine, computer animation, artificial intelligence, network engine etc.) relevant in the virtual reality system
6) the parallel virtually drawing subsystem of GPU cluster:
The drafting subsystem is the part in virtual reality and the visualization system, among the present invention the GPU cluster is drawn acceleration and handles.
Because the task amount of 3 D image drawing all is the heaviest in virtual reality and the visualization system, often all can become the bottleneck of system's operation, so will drawing this step, we from virtual reality and visualization system, separate, after waiting for that these all virtual realities and Visual calculation task are finished, finish the work of whole drafting by the parallel virtually drawing subsystem of GPU cluster structure.Parallel virtually drawing subsystem adopts the sort-first strategy, promptly earlier with scene according to the difference in institute corresponding display window zone be divided into 4 sub-window areas (size of 4 subwindows be not all with division, dynamically adjust according to the size that shows task amount), give 4 GPU respectively with the drafting task of 4 subwindows and carry out parallel drawing, the drafting task amount born of each GPU can reduce like this, has improved the efficient of whole drafting.Simultaneously according to the difference of 4 performances of GPU hardware own, also can draw task amounts and carry out the drafting task by dividing in the window area how much according to the corresponding GPU of tactful dynamic assignment of self adaptation adjustment.
7) parallel drawing generates the post processing of image module: after treating that 4 GPU generation images finish, need carry out recovery operation in virtual reality and visualization system, 4 width of cloth images that disperse all be fetched and spliced and synthesize a complete image.(known can the realization)
8) Streaming Media compression and sending module: it is that (H.263 compression standard can adopt for a frame of Streaming Media that this module is responsible for image is carried out compressed encoding, H.264 or multiple standards coding form such as MPEG-4), after through compression and interframe compression in the frame, be sent to the mobile device client via the communication connection.
9) Streaming Media receives and decompression module: this module of mobile device end is after receiving frame of video, and the decoding of establishing criteria codec format reverts to a two field picture.
10) Streaming Media drafting module: the two field picture utilization means of drawing are shown in real time, and the user has just seen and duplicate virtual scene of virtual reality system and the visualization result of utilizing the calculating of high-performance calculation machine platform to demonstrate in real time like this.

Claims (10)

1. realize distributed virtual reality and visualization method on a mobile device, the steps include:
1) sets up communicating to connect of mobile device and virtual reality and visualization server; Wherein, mobile device comprises a graphical interface of user and carries out the client of virtual reality and visualization display that virtual reality and visualization server comprise a virtual reality and visualization system;
2) mobile device receives the interactive operation request command by described graphical interface of user, and it is resolved to the interactive command of virtual reality and visualization system;
3) mobile device is packaged into packet with the interactive command of resolving and sends to virtual reality and visualization server;
4) virtual reality and visualization server parse interactive command from packet, and send it to described virtual reality and visualization system;
5) virtual reality and visualization system are carried out corresponding calculated according to interactive command, carry out virtually drawing then and are that Streaming Media sends to mobile device with the execution result compressed encoding;
6) mobile device is decoded to receiving data, shows virtual scene and visualization result.
2. the method for claim 1, it is characterized in that then virtual reality and visualization server are resolved this order according to the graphical interfaces command messages response function of setting if the interactive operation request command is the order outside the three-dimensional main window view of described graphical interface of user.
3. the method for claim 1, it is characterized in that if the interactive operation request command is the order within the three-dimensional main window view of described graphical interface of user, its command format is the coordinate of two dimension view, then virtual reality and visualization server with this two dimension view coordinate format command mapping be in the corresponding three-dimensional space object and according to action forward-backward correlation within this window, parse operational motion order to three dimensional object.
4. as claim 1 or 2 or 3 described methods, it is characterized in that described virtual reality and visualization system comprise a parallel virtually drawing subsystem; After these all virtual realities and Visual calculation task were finished, described parallel virtually drawing subsystem carried out the 3-D graphic virtually drawing.
5. method as claimed in claim 4 is characterized in that described parallel virtually drawing subsystem has the GPU cluster to make up; Described parallel virtually drawing subsystem adopts the sort-first strategy to carry out 3 D image drawing.
6. method as claimed in claim 4 is characterized in that described user images interface comprises: the container of interactive means in menu, button, toolbar, dialog box, shortcut, three-dimensional navigation graphical interfaces and the three-dimensional scenic.
7. realize distributed virtual reality and visual system on a mobile device, it is characterized in that comprising the server end on client, virtual reality and the visualization server on the mobile device; Described mobile device is connected by communication network with visualization server with described virtual reality; Wherein, described client comprises a graphical interface of user, a command analysis and sending module, stream media decoding module, Streaming Media drafting module; Described server end comprises a virtual reality and visualization system, orders receiver module, Streaming Media compressed encoding module;
Described graphical interface of user is used to receive the interactive operation request command;
Described command analysis and sending module are used for the interactive operation request command is resolved to the interactive command of virtual reality and visualization system, and it is packaged into packet sends to described order receiver module;
Described order receiver module is used for the packet that receives is stored and resolved, and the interactive command that parses is sent to described virtual reality and visualization system;
Described virtual reality and visualization system are used for carrying out corresponding calculated and virtually drawing according to interactive command, and execution result are sent to Streaming Media compressed encoding module;
Described Streaming Media compressed encoding module, being used for execution result is carried out compressed encoding is Streaming Media, and sends it to described stream media decoding module;
Described stream media decoding module is used for decoding to receiving data;
Described Streaming Media drafting module is used for decoded data are drawn demonstration virtual scene and visualization result.
8. system as claimed in claim 7 is characterized in that described virtual reality and visualization system comprise a parallel virtually drawing subsystem, is used for that these all virtual realities and Visual calculation task are finished data afterwards and carries out the 3-D graphic virtually drawing.
9. system as claimed in claim 8 is characterized in that described parallel virtually drawing subsystem has the GPU cluster to make up; Described parallel virtually drawing subsystem adopts the sort-first strategy to carry out 3 D image drawing.
10. system as claimed in claim 7 is characterized in that described server end adopts separate server framework or distributed server architecture.
CN 201010612833 2010-12-29 2010-12-29 Method and system for realizing distributed virtual reality and visualization on mobile device Active CN102148818B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010612833 CN102148818B (en) 2010-12-29 2010-12-29 Method and system for realizing distributed virtual reality and visualization on mobile device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010612833 CN102148818B (en) 2010-12-29 2010-12-29 Method and system for realizing distributed virtual reality and visualization on mobile device

Publications (2)

Publication Number Publication Date
CN102148818A true CN102148818A (en) 2011-08-10
CN102148818B CN102148818B (en) 2013-10-16

Family

ID=44422815

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010612833 Active CN102148818B (en) 2010-12-29 2010-12-29 Method and system for realizing distributed virtual reality and visualization on mobile device

Country Status (1)

Country Link
CN (1) CN102148818B (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102571943A (en) * 2011-12-28 2012-07-11 中国人民解放军第四军医大学唐都医院 Narrowband-condition-based medical image operation synchronization interaction method
CN102609971A (en) * 2012-01-11 2012-07-25 南京大学 Quick rendering system using embedded GPU (Graphics Processing Unit) for realizing 3D-GIS (Three Dimensional-Geographic Information System)
CN102647511A (en) * 2012-03-07 2012-08-22 山东大学 Three-dimensional museum interaction system based on smartphone and interaction method thereof
CN102857667A (en) * 2012-09-12 2013-01-02 康佳集团股份有限公司 Method and system for realizing picture processing of multimedia playing equipment
CN102866919A (en) * 2012-07-31 2013-01-09 电子科技大学 Cloud drawing-based large-sized three-dimensional scene multi-person collaborative creation method
CN102903144A (en) * 2012-08-03 2013-01-30 樊晓东 Cloud computing based interactive augmented reality system implementation method
CN103929479A (en) * 2014-04-10 2014-07-16 惠州Tcl移动通信有限公司 Method and system for simulating real scene through mobile terminal to achieve user interaction
CN104077316A (en) * 2013-03-29 2014-10-01 江苏北极光科技发展有限公司 Visualization technique
CN104183023A (en) * 2014-07-25 2014-12-03 天津多微信息技术有限公司 Multi-scene graph construction method in distributed virtual environment
CN104346041A (en) * 2014-10-24 2015-02-11 联想(北京)有限公司 Information processing method and corresponding device
CN104754464A (en) * 2013-12-31 2015-07-01 华为技术有限公司 Audio playing method, terminal and system
CN104780180A (en) * 2015-05-12 2015-07-15 成都绿野起点科技有限公司 Virtual reality platform based on mobile terminals
CN104794754A (en) * 2015-05-12 2015-07-22 成都绿野起点科技有限公司 Distribution type virtual reality system
CN104869160A (en) * 2015-05-12 2015-08-26 成都绿野起点科技有限公司 Distributed virtual reality system based on cloud platform
CN103413345B (en) * 2013-08-26 2016-01-13 中国人民解放军国防科学技术大学 Three dimensions interaction point based on GPU judges accelerated method
CN105869215A (en) * 2016-03-28 2016-08-17 上海米影信息科技有限公司 Virtual reality imaging system
CN106067159A (en) * 2016-05-27 2016-11-02 范杭 Virtual reality, the real-time display method of augmented reality and system
CN106375704A (en) * 2016-10-26 2017-02-01 中国科学院自动化研究所 Holographic visual intercom interaction system
CN106502428A (en) * 2016-12-31 2017-03-15 佛山市幻云科技有限公司 Rack server emulation mode and system based on vCenter
CN106683179A (en) * 2016-12-31 2017-05-17 佛山市幻云科技有限公司 Storage simulation method, server, system and virtual storage server
CN108153656A (en) * 2017-12-20 2018-06-12 福建天晴数码有限公司 A kind of virtual reality software performance testing method and terminal
WO2018107913A1 (en) * 2016-12-12 2018-06-21 中兴通讯股份有限公司 Media information processing method, apparatus and system
CN108513671A (en) * 2017-01-26 2018-09-07 华为技术有限公司 A kind of 2D applies display methods and terminal in VR equipment
CN108579076A (en) * 2018-04-16 2018-09-28 武汉康慧然信息技术咨询有限公司 Virtual reality calculates power Enhancement Method in home entertainment center
CN108881117A (en) * 2017-05-12 2018-11-23 上海诺基亚贝尔股份有限公司 Method, equipment and the computer-readable medium of virtual reality service are disposed in access net
CN109147414A (en) * 2018-09-29 2019-01-04 南昌航空大学 A kind of Virtual Reality Training System and method can be used for ray DR image checking
CN109213005A (en) * 2018-11-21 2019-01-15 成都四方伟业软件股份有限公司 A kind of simulation control method and device
CN109661674A (en) * 2016-12-22 2019-04-19 华为技术有限公司 The system and method for Visual calculation workflow
CN109727504A (en) * 2018-12-19 2019-05-07 安徽建筑大学 A kind of animation interactive system based on Art Design
CN110297215A (en) * 2019-06-19 2019-10-01 东北电力大学 A kind of circular array auditory localization visualization system and method

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1656440A (en) * 2002-04-03 2005-08-17 索尼爱立信移动通讯股份有限公司 A method of navigating in a virtual three-dimensional environment and an electronic device employing such method

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1656440A (en) * 2002-04-03 2005-08-17 索尼爱立信移动通讯股份有限公司 A method of navigating in a virtual three-dimensional environment and an electronic device employing such method

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
WEN HANGLI等: "《MOPCVE: A New CVE Prototype Running on Mobile Phone》", 《ARTIFICIAL REALITY AND TELEXISTENCE--WORKSHOPS, 2006. ICAT "06. 16TH INTERNATIONAL CONFERENCE ON》, 1 December 2006 (2006-12-01) *
李文航等: "《分布式移动数字地球系统的设计与实现》", 《地理与地理信息科学》, vol. 25, no. 5, 30 September 2009 (2009-09-30) *
汪国平等: "《ViWoSG:超大规模分布是虚拟环境中的分布式场景图》", 《中国科学 F辑》, vol. 39, no. 1, 31 January 2009 (2009-01-31) *

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102571943A (en) * 2011-12-28 2012-07-11 中国人民解放军第四军医大学唐都医院 Narrowband-condition-based medical image operation synchronization interaction method
CN102609971A (en) * 2012-01-11 2012-07-25 南京大学 Quick rendering system using embedded GPU (Graphics Processing Unit) for realizing 3D-GIS (Three Dimensional-Geographic Information System)
CN102647511A (en) * 2012-03-07 2012-08-22 山东大学 Three-dimensional museum interaction system based on smartphone and interaction method thereof
CN102647511B (en) * 2012-03-07 2014-05-07 山东大学 Three-dimensional museum interaction system based on smartphone and interaction method thereof
CN102866919A (en) * 2012-07-31 2013-01-09 电子科技大学 Cloud drawing-based large-sized three-dimensional scene multi-person collaborative creation method
CN102866919B (en) * 2012-07-31 2014-11-05 电子科技大学 Cloud drawing-based large-sized three-dimensional scene multi-person collaborative creation method
CN102903144B (en) * 2012-08-03 2015-05-27 樊晓东 Cloud computing based interactive augmented reality system implementation method
CN102903144A (en) * 2012-08-03 2013-01-30 樊晓东 Cloud computing based interactive augmented reality system implementation method
CN102857667A (en) * 2012-09-12 2013-01-02 康佳集团股份有限公司 Method and system for realizing picture processing of multimedia playing equipment
CN102857667B (en) * 2012-09-12 2018-10-12 康佳集团股份有限公司 Realize the method and system of the picture processing to multimedia play equipment
CN104077316A (en) * 2013-03-29 2014-10-01 江苏北极光科技发展有限公司 Visualization technique
CN103413345B (en) * 2013-08-26 2016-01-13 中国人民解放军国防科学技术大学 Three dimensions interaction point based on GPU judges accelerated method
CN104754464A (en) * 2013-12-31 2015-07-01 华为技术有限公司 Audio playing method, terminal and system
US9613275B2 (en) 2014-04-10 2017-04-04 Huizhou Tcl Mobile Communication Co., Ltd Method and system for a mobile terminal to achieve user interaction by simulating a real scene
CN103929479A (en) * 2014-04-10 2014-07-16 惠州Tcl移动通信有限公司 Method and system for simulating real scene through mobile terminal to achieve user interaction
CN103929479B (en) * 2014-04-10 2017-12-12 惠州Tcl移动通信有限公司 Mobile terminal simulation of real scenes realizes the method and system of user interaction
WO2015154333A1 (en) * 2014-04-10 2015-10-15 惠州Tcl移动通信有限公司 Method and system for mobile terminal to simulate real scene to achieve user interaction
CN104183023B (en) * 2014-07-25 2017-06-27 天津微视威信息科技有限责任公司 The construction method of many scene graph in a kind of distributed virtual environment
CN104183023A (en) * 2014-07-25 2014-12-03 天津多微信息技术有限公司 Multi-scene graph construction method in distributed virtual environment
CN104346041B (en) * 2014-10-24 2018-04-27 联想(北京)有限公司 A kind of information processing method and corresponding intrument
CN104346041A (en) * 2014-10-24 2015-02-11 联想(北京)有限公司 Information processing method and corresponding device
CN104780180B (en) * 2015-05-12 2019-02-12 国电物资集团有限公司电子商务中心 A kind of Virtual Reality Platform based on mobile terminal
CN104869160B (en) * 2015-05-12 2018-07-31 成都绿野起点科技有限公司 A kind of Distributed Virtual Reality System based on cloud platform
CN104780180A (en) * 2015-05-12 2015-07-15 成都绿野起点科技有限公司 Virtual reality platform based on mobile terminals
CN104794754A (en) * 2015-05-12 2015-07-22 成都绿野起点科技有限公司 Distribution type virtual reality system
CN104794754B (en) * 2015-05-12 2018-04-20 成都绿野起点科技有限公司 A kind of Distributed Virtual Reality System
CN104869160A (en) * 2015-05-12 2015-08-26 成都绿野起点科技有限公司 Distributed virtual reality system based on cloud platform
CN105869215A (en) * 2016-03-28 2016-08-17 上海米影信息科技有限公司 Virtual reality imaging system
CN106067159A (en) * 2016-05-27 2016-11-02 范杭 Virtual reality, the real-time display method of augmented reality and system
CN106375704B (en) * 2016-10-26 2019-05-03 中国科学院自动化研究所 A kind of holography video intercom interactive system
CN106375704A (en) * 2016-10-26 2017-02-01 中国科学院自动化研究所 Holographic visual intercom interaction system
WO2018107913A1 (en) * 2016-12-12 2018-06-21 中兴通讯股份有限公司 Media information processing method, apparatus and system
US10911823B2 (en) 2016-12-12 2021-02-02 Zte Corporation Media information processing method, apparatus and system
CN108616751A (en) * 2016-12-12 2018-10-02 上海交通大学 The processing method of media information, apparatus and system
CN109661674B (en) * 2016-12-22 2020-06-16 华为技术有限公司 System and method for visualizing a computing workflow
CN109661674A (en) * 2016-12-22 2019-04-19 华为技术有限公司 The system and method for Visual calculation workflow
CN106683179A (en) * 2016-12-31 2017-05-17 佛山市幻云科技有限公司 Storage simulation method, server, system and virtual storage server
CN106502428B (en) * 2016-12-31 2019-02-26 佛山市幻云科技有限公司 Rack server emulation mode and system based on vCenter
CN106502428A (en) * 2016-12-31 2017-03-15 佛山市幻云科技有限公司 Rack server emulation mode and system based on vCenter
CN108513671A (en) * 2017-01-26 2018-09-07 华为技术有限公司 A kind of 2D applies display methods and terminal in VR equipment
US11294533B2 (en) 2017-01-26 2022-04-05 Huawei Technologies Co., Ltd. Method and terminal for displaying 2D application in VR device
CN108881117A (en) * 2017-05-12 2018-11-23 上海诺基亚贝尔股份有限公司 Method, equipment and the computer-readable medium of virtual reality service are disposed in access net
CN108153656A (en) * 2017-12-20 2018-06-12 福建天晴数码有限公司 A kind of virtual reality software performance testing method and terminal
CN108579076A (en) * 2018-04-16 2018-09-28 武汉康慧然信息技术咨询有限公司 Virtual reality calculates power Enhancement Method in home entertainment center
CN109147414A (en) * 2018-09-29 2019-01-04 南昌航空大学 A kind of Virtual Reality Training System and method can be used for ray DR image checking
CN109147414B (en) * 2018-09-29 2024-03-12 南昌航空大学 Virtual reality training system and method for ray DR imaging detection
CN109213005A (en) * 2018-11-21 2019-01-15 成都四方伟业软件股份有限公司 A kind of simulation control method and device
CN109727504A (en) * 2018-12-19 2019-05-07 安徽建筑大学 A kind of animation interactive system based on Art Design
CN110297215A (en) * 2019-06-19 2019-10-01 东北电力大学 A kind of circular array auditory localization visualization system and method

Also Published As

Publication number Publication date
CN102148818B (en) 2013-10-16

Similar Documents

Publication Publication Date Title
CN102148818B (en) Method and system for realizing distributed virtual reality and visualization on mobile device
CN105263050B (en) Mobile terminal real-time rendering system and method based on cloud platform
CN107274469A (en) The coordinative render method of Virtual reality
CN110059143A (en) A kind of method for drawing map based on remote sensing image tile data
CN107369205B (en) Mobile terminal city two-dimensional and three-dimensional linkage display method
CN114513520B (en) Web three-dimensional visualization method based on synchronous rendering of client and server
CN102254292A (en) Remote 3D instruction rendering system and method
EP2084671A1 (en) Method and system for delivering and interactively displaying three-dimensional graphics
JP2013099511A (en) Rendering system, rendering server, control method thereof, program, and recording medium
CN103679813B (en) The construction method of three-dimensional digital earth and three-dimensional digital earth system
Han Mobile immersive computing: Research challenges and the road ahead
WO2023151524A1 (en) Image display method and apparatus, electronic device, and storage medium
Noguera et al. A scalable architecture for 3D map navigation on mobile devices
CN114570020A (en) Data processing method and system
WO2024088144A1 (en) Augmented reality picture processing method and apparatus, and electronic device and storage medium
CN114981822A (en) Referencing of neural network models for adaptation of 2D video streaming to heterogeneous client endpoints
Lluch et al. Interactive three-dimensional rendering on mobile computer devices
KR102598603B1 (en) Adaptation of 2D video for streaming to heterogeneous client endpoints
Xiao et al. Cloud rendering scheme for standalone virtual reality headset
Deb et al. Real-time streaming and rendering of terrains
CN112489210A (en) Method for constructing autonomous controllable three-dimensional natural resource map system
Grimstead et al. Resource-aware visualization using web services
Chávez et al. Lightweight visualization for high-quality materials on WebGL
KR100986621B1 (en) System and method for dynamic map service
Selzer et al. Stereoscopic Image-Based Rendering Technique for Low-Cost Virtual Reality

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
DD01 Delivery of document by public notice

Addressee: Wang Yanlin

Document name: Notification that Application Deemed not to be Proposed

TR01 Transfer of patent right

Effective date of registration: 20181108

Address after: 100089 Haidian District, Beijing blue indigo factory, rainbow Tower 3, two floor a 3-1-223

Patentee after: Tong Jian wisdom (Beijing) Technology Co., Ltd.

Address before: 100871 Peking University, 5 the Summer Palace Road, Haidian District, Peking University

Patentee before: Peking University

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200831

Address after: No. a 2, duan'an District, Haidian District, Beijing 100089

Patentee after: Beijing Tong Jian telit Intelligent Systems Engineering Technology Co.,Ltd.

Address before: 100089 Haidian District, Beijing blue indigo factory, rainbow Tower 3, two floor a 3-1-223

Patentee before: Tong Jian wisdom (Beijing) Technology Co.,Ltd.

TR01 Transfer of patent right