CN101055494A - Dummy scene roaming method and system based on spatial index cube panoramic video - Google Patents
Dummy scene roaming method and system based on spatial index cube panoramic video Download PDFInfo
- Publication number
- CN101055494A CN101055494A CN 200610025674 CN200610025674A CN101055494A CN 101055494 A CN101055494 A CN 101055494A CN 200610025674 CN200610025674 CN 200610025674 CN 200610025674 A CN200610025674 A CN 200610025674A CN 101055494 A CN101055494 A CN 101055494A
- Authority
- CN
- China
- Prior art keywords
- cube
- panoramic video
- spatial index
- user
- roaming
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
A virtual scene roams method based on spatial index cube panoramic view video and a system thereof are disclosed. The system includes a motion control engine unit, a panoramic view video protract unit, a sound protract unit, a mapping unit and a text display unit, wherein the motion control engine unit is connected to an external input device and receives the spatial index cube panoramic view video signal input from external, the corresponding sound file of the roam paths, control map and text information. The invention executes fine model building for the virtual scene by existing three-dimensional tools, pre-protracts the required high quality image sequence, and compresses the panoramic view video data and improves the protracting speed by choosing the spatial index cube panoramic view video as input and using the compressing method supported by a three-dimension graphics card. The user can conveniently interact with the system by external instruments such as game handle; mouse and keyboard to obtain high quality roam experience.
Description
Technical field
The present invention relates to a kind of dummy scene roaming method and system thereof, is a kind of dummy scene roaming method and system thereof based on spatial index cube panoramic video specifically.
Background technology
The dummy scene roaming system adopts three-dimensional geometry and texture information thereof to describe object in the scene usually, utilizes the algorithm in the similar video-game that scene is carried out real-time rendering.This type systematic needs a large amount of loaded down with trivial details man-machine interactivelies to finish how much simplification and the texture optimization of three-dimensional model, to reach the minimizing data volume, realizes the purpose of real-time rendering.The accuracy of model has been sacrificed in reduced representation, thereby has reduced the quality of drawing image.In addition, the processing power of current personal computer (PC) and three-dimensional picture card is still limited, and high-quality photo realism graphic generation technique as ray trace, radiancy etc., still can't be applied to the dummy scene roaming system.Therefore make up still unusual difficulty of high-quality dummy scene roaming system.
With above-mentioned different based on the drawing system that shows geometric representation, based on the drawing system (Image-Based Rendering Systems) of image with the image sequence gathered in advance as input.The sampled images sequence of IBR system utilization input is rebuild full light function.By the full light function of rebuilding is carried out the image that resampling generates the new viewpoint position.With the immediate work of the present invention be the breadboard FlyAbout of FX Palo Alto system (FlyAbout:Spatially Indexed Panoramic Video.In Proceedings ofACM Multimedia 2001).The FlyAbout system is a kind of drawing system based on image, and it is input with the spatial index cylinder panorama video that obtains in the real scene.The spatial index information of panoramic video, when promptly panoramic video is gathered the three-dimensional space position of camera and towards etc. information, be to obtain by later image treatment technology and GPS (GPS).Because the limitation of camera design, this system only handles cylinder panorama video.Cylinder panorama video can not cover the whole of the vertical viewing area of user, can omit the scenery at sky and ground location place usually.Yet, in the roaming system of reality, the scenery that the common requirement of user watches these to be omitted.Worse, utilize the precision of the spatial index information that existing GPS (GPS) and Image post-processing algorithm obtained to guarantee within controlled error range.When therefore, utilizing this system that real scene is drawn through regular meeting the float phenomenon appears.System adopts MOTION JPEG (MJPEG) that cylinder panorama sketch sequence is carried out compressed encoding, yet existing three-dimensional picture card is not supported this compression algorithm.Therefore system at first decompresses to panoramic video, with CPU the image of decoding is carried out map function then and finishes scene drawing.The computing power of only utilizing CPU and not making full use of the 3-D view card has greatly limited the render speed of image.
Summary of the invention
The object of the present invention is to provide a kind of dummy scene roaming method and system thereof, thereby reach the roaming of virtual scene high-quality based on spatial index cube panoramic video.
A kind of dummy scene roaming method based on spatial index cube panoramic video provided by the present invention comprises the following steps:
(1) spatial index cube panoramic video obtains
The paths that in virtual scene, can go sight-seeing of designated user at first, and utilize existing three-dimensional software instrument, adopt the cube environment mapping to draw panoramic picture at the path sampling point position;
Cube environment mapping sequence has then constituted cube panoramic video, and the script that utilizes the three-dimensional software instrument to provide is programmed and obtained the pairing spatial index information of every width of cloth panorama sketch;
By cube panoramic video and corresponding spatial index information acquisition spatial index cube panoramic video;
(2) spatial index cube panoramic video compression and drafting
At first independent cube panorama sketch is compressed, the cube panorama sketch sequence of compression forms the cube panoramic video of compression;
The video data and the spatial index information of compression are merged the spatial index cube panoramic video that forms compression;
At first calculate required cube panoramic video data during drafting according to user's current viewpoint position and direction of visual lines;
Read desired data then and it is arrived virtual cube face as texture;
By the three-dimensional picture DLL (dynamic link library), utilize graphic hardware that this cube is drawn;
By changing direction of visual lines, all scenery that the user can watch the corresponding locus of cube environment mapping institute to locate;
Upgrade environment mapping realization virtual roaming by changing viewpoint position;
(3) form roaming system
The at first N paths that can go sight-seeing in virtual scene of designated user, and the path of appointment is connected each other and constitutes the roaming map;
The user is along the path roaming of stipulating in the scene map;
If reach path end points and run into the intersection, the path that system can choose automatically with user perspective angular separation minimum is a new route;
Simultaneously, the user can be along certain bar road through forward, backward, watch left and to the right, also can watch up and down.
The present invention also provides a kind of dummy scene roaming system based on spatial index cube panoramic video, it is characterized in that: comprise motion control engine unit, the panoramic video drawing unit, sound drawing unit, mapping unit and the text display unit that link to each other with this motion control engine unit respectively, wherein:
The motion control engine unit also connects external input device, receives spatial index cube panoramic video signal, the corresponding audio files in roaming path, control map and the text message of outside input, is used for the mutual control of user's viewpoint parameter;
The panoramic video drawing unit, be used for according to the target view locus to compression panoramic video data read, visible face judges, and utilizes graphic hardware to carry out target view and draw;
The sound drawing unit is used to generate and broadcast and user's viewpoint and the relevant sound of scenery place three-dimensional space position;
The mapping unit is used for explicit user view space position, and the function in user's Dynamic Selection path is provided;
Text display unit is used for roaming path and the relevant added text information of picture scenery are shown.
Owing to adopted above-mentioned technical solution, the present invention utilizes existing three-dimensional instrument virtual scene to be carried out fine modeling, pre-rendered required high quality graphic sequence for improve the quality of drawing image based on the drawing system of image.Compare (as FlyAbout) with existing based on image drawing system, the present invention is input with the spatial index cube panoramic video, utilize the compression method of three-dimensional picture card support that the panoramic video data are compressed and improve render speed, the user can utilize external units such as game paddle, mouse and keyboard to carry out alternately with system easily and flexibly, obtains the high-quality roaming and experiences.The present invention can construct the high-quality roaming system of virtual scene on the common PC platform fast, neatly, and the roaming system of representing towards three-dimensional geometry and texture than tradition provides the better pictures quality, has saved a large amount of loaded down with trivial details model optimization work simultaneously.The compression and the drafting that utilize graphics card to carry out panoramic video have improved system's render speed.
Description of drawings
Fig. 1 is a system architecture synoptic diagram of the present invention.
Embodiment
The present invention, promptly a kind of dummy scene roaming method based on spatial index cube panoramic video comprises the following steps:
(1) spatial index cube panoramic video obtains
The paths that in virtual scene, can go sight-seeing of designated user at first, and the existing three-dimensional software instrument of utilization, as 3DS Max, Maya etc., limited this shortcoming of user's vertical coverage for overcoming cylindrical panoramic figure, adopt the cube environment mapping to draw panoramic picture at the path sampling point position.The cube environment mapping incides all light of cube central point with cubical six surface recordings.
Cube environment mapping sequence has then constituted cube panoramic video, and the script that utilizes the three-dimensional software instrument to provide is programmed and is obtained the pairing spatial index information of every width of cloth panorama sketch, compare with the spatial index information that GPS obtains by the post processing of image technology with existing, this method can be obtained spatial index information accurately.Therefore jitter phenomenon can not appear during pattern drafting.
By cube panoramic video and corresponding spatial index information acquisition spatial index cube panoramic video;
(2) spatial index cube panoramic video compression and drafting
Have and generally adopt MJPEG that cylinder panorama sketch sequence is carried out compressed encoding, yet existing three-dimensional picture card is not supported this compression algorithm based on image drawing system.Must at first decompress during scene drawing, with CPU the image of decoding be carried out map function then panoramic video.The computing power of only utilizing CPU and not making full use of the 3-D view card has greatly limited the render speed of image.For improving render speed, the present invention adopts the compression method of three-dimensional picture card support that cube panoramic video is compressed.Because the DXT1 compression method can provide good ratio of compression and obtain the support of most of hardware, adopts it that independent cube panorama sketch is compressed.The cube panorama sketch sequence of compression forms the cube panoramic video of compression;
The video data and the spatial index information of compression are merged the spatial index cube panoramic video that forms compression;
At first calculate required cube panoramic video data during drafting according to user's current viewpoint position and direction of visual lines;
Read desired data then and it is arrived virtual cube face as texture;
By the three-dimensional picture DLL (dynamic link library),, as OpenGL or DirectX, utilize graphic hardware that this cube is drawn;
By changing direction of visual lines, all scenery that the user can watch the corresponding locus of cube environment mapping institute to locate;
Upgrade environment mapping realization virtual roaming by changing viewpoint position;
(3) form roaming system
System of the present invention replaces traditional time index to represent panoramic video with spatial index.
The at first N paths that can go sight-seeing in virtual scene of designated user, and the path of appointment is connected each other and constitutes the roaming map, and the user is along the path roaming of stipulating in the scene map;
Compare with existed system, the motion control engine of native system not only allow the user along certain bar road through forward, backward, watch left and to the right, also allow to watch up and down.If reach path end points and run into the intersection, the path that system can choose automatically with user perspective angular separation minimum is a new route, thereby saves the unnecessary man-machine interactively of user.System also allows user interactions to select interested individual path.
The user is undertaken by external units such as game paddle, keyboard and mouse and system alternately.Rotary knob on the game paddle is mapped as the user and spinning movement to the right left.On the handle in addition four separate button control respectively the user forward, backward, mode of motion up and down.The speed and the acceleration of Speed button control user movement.Keyboard interface is realized the repertoire of game paddle.Mouse is used for controlling user's spinning movement.
Complete system's input comprises the information such as spatial index cube panoramic video, the corresponding audio files in roaming path, textual description and control map of compression.These data of different types are drawn separately by corresponding module respectively.
As shown in Figure 1, a kind of dummy scene roaming system of the present invention based on spatial index cube panoramic video, comprise motion control engine unit 1, the panoramic video drawing unit 2, sound drawing unit 3, mapping unit 4 and the text display unit 5 that link to each other with this motion control engine unit 1 respectively, wherein:
The motion control engine unit also connects external input device, receives spatial index cube panoramic video signal, the corresponding audio files in roaming path, control map and the text message of outside input, is used for the mutual control of user's viewpoint parameter;
The panoramic video drawing unit, be used for according to the target view locus to compression panoramic video data read, visible face judges, and utilizes graphic hardware to carry out target view and draw;
The sound drawing unit is used to generate and broadcast and user's viewpoint and the relevant sound of scenery place three-dimensional space position;
The mapping unit is used for explicit user view space position, and the function in user's Dynamic Selection path is provided;
Text display unit is used for roaming path and the relevant added text information of picture scenery are shown.
With a certain roaming system is example, the introducing system implementation step.
(1) spatial index cube panoramic video obtains
1.1 control cartography
The roamed path of designated user in virtual scene at first.The be connected to each other control map of construction system of roaming path.
1.2 the individual paths spatial index cube panoramic video generates
In virtual scene, create six virtual cameras.The ken that requires every camera is 90 degree, and space angle also is 90 degree each other.This virtual camera group can be obtained all virtual ray that incide sample point.The virtual camera group binding is roamed the path to specifying.Utilize 3ds max to draw the image sequence of the virtual scene that every virtual camera sees successively.Take out six identical width of cloth images of sequence number from six image sequences respectively.This six width of cloth image has just constituted a cube environment mapping.Constituted the cube panoramic video of specified path by cube environment mapping sequence.
In 3ds max, carry out the spatial index information that following script obtains panoramic video:
fn＝createfile″d：\\spatialinfo.txt″
format″Name?frame?transform?fov?position?rotation?dir\n″to：fn
fort＝0?to?n?do
(
slidertime＝t
format″％％％％％％％\n″″Camera04″t?$Camera.transform$Camera.fov
$Camera.pos?$Camera.rotation?$Camera.dir?to：fn
)
close?fn
1.3 repeat 1.2 steps, generate the spatial index cube panoramic video of all specified paths.
(2) with the DXT1 compression method independent cube panorama sketch is compressed.The cube panorama sketch sequence of compression constitutes the cube panoramic video of compression.The video data and the spatial index information of compression are merged the spatial index cube panoramic video that constitutes compression.
(3) according to the corresponding multimedia material of spatial index information configuration, as information such as sound, texts.Manufacturing system starts picture.According to above information generating system configuration file.
(4) plug game paddle, start-up system.
Above embodiment is only for the usefulness that the utility model is described, but not to restriction of the present utility model, person skilled in the relevant technique, under the situation that does not break away from spirit and scope of the present utility model, can also make various conversion or modification, therefore all technical schemes that are equal to also should belong within the category of the present utility model, should be limited by each claim.And include within the scope of claim.
Claims (2)
1. the dummy scene roaming method based on spatial index cube panoramic video comprises the following steps:
(1) spatial index cube panoramic video obtains
The paths that in virtual scene, can go sight-seeing of designated user at first, and utilize existing three-dimensional software instrument, adopt the cube environment mapping to draw panoramic picture at the path sampling point position;
Cube environment mapping sequence has then constituted cube panoramic video, and the script that utilizes the three-dimensional software instrument to provide is programmed and obtained the pairing spatial index information of every width of cloth panorama sketch;
By cube panoramic video and corresponding spatial index information acquisition spatial index cube panoramic video;
(2) spatial index cube panoramic video compression and drafting
At first independent cube panorama sketch is compressed, the cube panorama sketch sequence of compression forms the cube panoramic video of compression;
The video data and the spatial index information of compression are merged the spatial index cube panoramic video that forms compression;
At first calculate required cube panoramic video data during drafting according to user's current viewpoint position and direction of visual lines;
Read desired data then and it is arrived virtual cube face as texture;
By the three-dimensional picture DLL (dynamic link library), utilize graphic hardware that this cube is drawn;
By changing direction of visual lines, all scenery that the user can watch the corresponding locus of cube environment mapping institute to locate;
Upgrade environment mapping realization virtual roaming by changing viewpoint position;
(3) form roaming system
The at first N paths that can go sight-seeing in virtual scene of designated user, and the path of appointment is connected each other and constitutes the roaming map;
The user is along the path roaming of stipulating in the scene map;
If reach path end points and run into the intersection, the path that system can choose automatically with user perspective angular separation minimum is a new route;
Simultaneously, the user can be along certain bar road through forward, backward, watch left and to the right, also can watch up and down.
2. dummy scene roaming system based on spatial index cube panoramic video, it is characterized in that: comprise motion control engine unit, the panoramic video drawing unit, sound drawing unit, mapping unit and the text display unit that link to each other with this motion control engine unit respectively, wherein:
The motion control engine unit also connects external input device, receives spatial index cube panoramic video signal, the corresponding audio files in roaming path, control map and the text message of outside input, is used for the mutual control of user's viewpoint parameter;
The panoramic video drawing unit, be used for according to the target view locus to compression panoramic video data read, visible face judges, and utilizes graphic hardware to carry out target view and draw;
The sound drawing unit is used to generate and broadcast and user's viewpoint and the relevant sound of scenery place three-dimensional space position;
The mapping unit is used for explicit user view space position, and the function in user's Dynamic Selection path is provided;
Text display unit is used for roaming path and the relevant added text information of picture scenery are shown.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006100256742A CN101055494B (en) | 2006-04-13 | 2006-04-13 | Dummy scene roaming method and system based on spatial index cube panoramic video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006100256742A CN101055494B (en) | 2006-04-13 | 2006-04-13 | Dummy scene roaming method and system based on spatial index cube panoramic video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101055494A true CN101055494A (en) | 2007-10-17 |
| CN101055494B CN101055494B (en) | 2011-03-16 |
Family
ID=38795354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006100256742A Expired - Fee Related CN101055494B (en) | 2006-04-13 | 2006-04-13 | Dummy scene roaming method and system based on spatial index cube panoramic video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101055494B (en) |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101872243A (en) * | 2010-06-13 | 2010-10-27 | 上海杰图软件技术有限公司 | System and method for realizing 360-degree panoramic play following real space direction |
| CN101448194B (en) * | 2007-11-26 | 2010-12-01 | 中兴通讯股份有限公司 | Incremental scene update method and mobile streaming media terminal supporting method |
| CN102023706A (en) * | 2009-09-15 | 2011-04-20 | 帕洛阿尔托研究中心公司 | System for interacting with objects in a virtual environment |
| CN102147925A (en) * | 2010-02-08 | 2011-08-10 | 上海华博信息服务有限公司 | Virtual reality processing method based on image sensor |
| CN101911128B (en) * | 2007-12-27 | 2012-09-19 | 星克跃尔株式会社 | Method and system for serving three dimension web map service using augmented reality |
| CN102750724A (en) * | 2012-04-13 | 2012-10-24 | 广州市赛百威电脑有限公司 | Three-dimensional and panoramic system automatic-generation method based on images |
| CN102780850A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for realizing cube transition special effect |
| CN102945563A (en) * | 2012-09-26 | 2013-02-27 | 天津游奕科技有限公司 | Showing and interacting system and method for panoramic videos |
| CN103335644A (en) * | 2013-05-31 | 2013-10-02 | 王玉娇 | Voice broadcast method for street view map, and relevant apparatus |
| CN103646424A (en) * | 2013-11-26 | 2014-03-19 | 北京空间机电研究所 | Aerial seamless virtual roaming system constructing method |
| CN103747230A (en) * | 2013-12-11 | 2014-04-23 | 深圳先进技术研究院 | Dynamic positioning video electronic map projection system and method |
| CN104740874A (en) * | 2015-03-26 | 2015-07-01 | 广州博冠信息科技有限公司 | Method and system for playing videos in two-dimension game scene |
| CN105898254A (en) * | 2016-05-17 | 2016-08-24 | 亿唐都科技（北京）有限公司 | VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth |
| CN105915885A (en) * | 2016-03-02 | 2016-08-31 | 优势拓展（北京）科技有限公司 | 3D interaction display method and system of fish-eye image |
| CN106204704A (en) * | 2016-06-29 | 2016-12-07 | 乐视控股（北京）有限公司 | The rendering intent of three-dimensional scenic and device in virtual reality |
| CN106303555A (en) * | 2016-08-05 | 2017-01-04 | 深圳市豆娱科技有限公司 | A kind of live broadcasting method based on mixed reality, device and system |
| US9632659B2 (en) | 2008-02-27 | 2017-04-25 | Google Inc. | Using image content to facilitate navigation in panoramic image data |
| CN106683175A (en) * | 2016-12-27 | 2017-05-17 | 合肥漫禹科技有限公司 | Three-dimensional modeling optimization method for VR virtual campus system |
| US9754413B1 (en) | 2015-03-26 | 2017-09-05 | Google Inc. | Method and system for navigating in panoramic images using voxel maps |
| US9807319B2 (en) | 2009-06-03 | 2017-10-31 | Flir Systems, Inc. | Wearable imaging devices, systems, and methods |
| CN107622468A (en) * | 2016-07-11 | 2018-01-23 | 完美幻境(北京)科技有限公司 | A kind of panoramic video storage format, the storage method of panoramic video and device |
| CN107833277A (en) * | 2017-10-16 | 2018-03-23 | 华南理工大学 | A kind of Panoramic Warping scene edit methods based on unity3D |
| CN107949773A (en) * | 2015-06-05 | 2018-04-20 | 诺基亚技术有限公司 | The crowdsourcing interaction of navigation patterns in 3D maps |
| US9973692B2 (en) | 2013-10-03 | 2018-05-15 | Flir Systems, Inc. | Situational awareness by compressed display of panoramic views |
| CN108257219A (en) * | 2018-01-31 | 2018-07-06 | 广东三维家信息科技有限公司 | A kind of method for realizing the roaming of panorama multiple spot |
| CN108702497A (en) * | 2016-02-02 | 2018-10-23 | 三星电子株式会社 | Three-dimensional camera for shooting the image for providing virtual reality |
| WO2018205663A1 (en) * | 2017-05-09 | 2018-11-15 | 优酷信息技术（北京）有限公司 | Video playback and data providing method in virtual scene, client and server |
| CN109099902A (en) * | 2018-06-29 | 2018-12-28 | 中国航空规划设计研究总院有限公司 | A kind of virtual reality panoramic navigation system based on Unity 3D |
| CN109299324A (en) * | 2018-10-19 | 2019-02-01 | 四川巧夺天工信息安全智能设备有限公司 | A kind of search method of label type video file |
| CN111148969A (en) * | 2017-09-27 | 2020-05-12 | 苹果公司 | Spatial audio navigation |
| WO2020102107A1 (en) * | 2018-11-12 | 2020-05-22 | Open Space Labs, Inc. | Automated spatial indexing of images to video |
| US10762698B2 (en) | 2017-06-29 | 2020-09-01 | Open Space Labs, Inc. | Automated spatial indexing of images based on floorplan features |
| CN113961078A (en) * | 2021-11-04 | 2022-01-21 | 中国科学院计算机网络信息中心 | Panoramic roaming method, device and equipment and readable storage medium |
| CN114510153A (en) * | 2022-04-19 | 2022-05-17 | 广州市影擎电子科技有限公司 | Wind sense simulation method and device applied to VR (virtual reality) environment simulation and electronic equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1409218A (en) * | 2002-09-18 | 2003-04-09 | 北京航空航天大学 | Virtual environment forming method |
| CN100428218C (en) * | 2002-11-13 | 2008-10-22 | 北京航空航天大学 | Universal virtual environment roaming engine computer system |
| CN1315102C (en) * | 2003-12-12 | 2007-05-09 | 西北工业大学 | Method and system for transparent roaming body of object |
| CN1556505A (en) * | 2004-01-08 | 2004-12-22 | 沈阳工业学院 | Virtual fractal spectacle three dimensional roaming system |
-
2006
- 2006-04-13 CN CN2006100256742A patent/CN101055494B/en not_active Expired - Fee Related
Cited By (58)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101448194B (en) * | 2007-11-26 | 2010-12-01 | 中兴通讯股份有限公司 | Incremental scene update method and mobile streaming media terminal supporting method |
| CN101911128B (en) * | 2007-12-27 | 2012-09-19 | 星克跃尔株式会社 | Method and system for serving three dimension web map service using augmented reality |
| US10163263B2 (en) | 2008-02-27 | 2018-12-25 | Google Llc | Using image content to facilitate navigation in panoramic image data |
| CN103824317B (en) * | 2008-02-27 | 2017-08-08 | 谷歌公司 | Help to navigate in panoramic image data using picture material |
| US9632659B2 (en) | 2008-02-27 | 2017-04-25 | Google Inc. | Using image content to facilitate navigation in panoramic image data |
| US9807319B2 (en) | 2009-06-03 | 2017-10-31 | Flir Systems, Inc. | Wearable imaging devices, systems, and methods |
| CN102023706A (en) * | 2009-09-15 | 2011-04-20 | 帕洛阿尔托研究中心公司 | System for interacting with objects in a virtual environment |
| CN102147925A (en) * | 2010-02-08 | 2011-08-10 | 上海华博信息服务有限公司 | Virtual reality processing method based on image sensor |
| CN101872243B (en) * | 2010-06-13 | 2012-10-10 | 上海杰图软件技术有限公司 | System and method for realizing 360-degree panoramic play following real space direction |
| CN101872243A (en) * | 2010-06-13 | 2010-10-27 | 上海杰图软件技术有限公司 | System and method for realizing 360-degree panoramic play following real space direction |
| CN102750724B (en) * | 2012-04-13 | 2018-12-21 | 广东赛百威信息科技有限公司 | A kind of three peacekeeping panoramic system automatic-generationmethods based on image |
| CN102750724A (en) * | 2012-04-13 | 2012-10-24 | 广州市赛百威电脑有限公司 | Three-dimensional and panoramic system automatic-generation method based on images |
| CN102780850A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for realizing cube transition special effect |
| CN102945563B (en) * | 2012-09-26 | 2017-05-24 | 天津游奕科技有限公司 | Showing and interacting system and method for panoramic videos |
| CN102945563A (en) * | 2012-09-26 | 2013-02-27 | 天津游奕科技有限公司 | Showing and interacting system and method for panoramic videos |
| CN103335644B (en) * | 2013-05-31 | 2016-03-16 | 王玉娇 | The sound playing method of streetscape map and relevant device |
| CN103335644A (en) * | 2013-05-31 | 2013-10-02 | 王玉娇 | Voice broadcast method for street view map, and relevant apparatus |
| US9973692B2 (en) | 2013-10-03 | 2018-05-15 | Flir Systems, Inc. | Situational awareness by compressed display of panoramic views |
| CN103646424A (en) * | 2013-11-26 | 2014-03-19 | 北京空间机电研究所 | Aerial seamless virtual roaming system constructing method |
| CN103646424B (en) * | 2013-11-26 | 2016-05-04 | 北京空间机电研究所 | A kind of aerial seamless Virtual Wandering System construction method |
| CN103747230A (en) * | 2013-12-11 | 2014-04-23 | 深圳先进技术研究院 | Dynamic positioning video electronic map projection system and method |
| CN104740874B (en) * | 2015-03-26 | 2018-03-27 | 广州博冠信息科技有限公司 | A kind of method and system that video is played in two-dimensional game scene |
| US9754413B1 (en) | 2015-03-26 | 2017-09-05 | Google Inc. | Method and system for navigating in panoramic images using voxel maps |
| US10186083B1 (en) | 2015-03-26 | 2019-01-22 | Google Llc | Method and system for navigating in panoramic images using voxel maps |
| CN104740874A (en) * | 2015-03-26 | 2015-07-01 | 广州博冠信息科技有限公司 | Method and system for playing videos in two-dimension game scene |
| CN107949773B (en) * | 2015-06-05 | 2021-04-27 | 诺基亚技术有限公司 | Method and device for providing recommended browsing path |
| CN107949773A (en) * | 2015-06-05 | 2018-04-20 | 诺基亚技术有限公司 | The crowdsourcing interaction of navigation patterns in 3D maps |
| CN108702497B (en) * | 2016-02-02 | 2020-07-24 | 三星电子株式会社 | Three-dimensional camera for photographing images providing virtual reality |
| US10750156B2 (en) | 2016-02-02 | 2020-08-18 | Samsung Electronics Co., Ltd. | Three-dimensional camera for capturing image to provide virtual reality |
| CN108702497A (en) * | 2016-02-02 | 2018-10-23 | 三星电子株式会社 | Three-dimensional camera for shooting the image for providing virtual reality |
| CN105915885A (en) * | 2016-03-02 | 2016-08-31 | 优势拓展（北京）科技有限公司 | 3D interaction display method and system of fish-eye image |
| CN105898254A (en) * | 2016-05-17 | 2016-08-24 | 亿唐都科技（北京）有限公司 | VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth |
| CN106204704A (en) * | 2016-06-29 | 2016-12-07 | 乐视控股（北京）有限公司 | The rendering intent of three-dimensional scenic and device in virtual reality |
| CN107622468A (en) * | 2016-07-11 | 2018-01-23 | 完美幻境(北京)科技有限公司 | A kind of panoramic video storage format, the storage method of panoramic video and device |
| CN106303555A (en) * | 2016-08-05 | 2017-01-04 | 深圳市豆娱科技有限公司 | A kind of live broadcasting method based on mixed reality, device and system |
| CN106683175A (en) * | 2016-12-27 | 2017-05-17 | 合肥漫禹科技有限公司 | Three-dimensional modeling optimization method for VR virtual campus system |
| CN108882018A (en) * | 2017-05-09 | 2018-11-23 | 合信息技术（北京）有限公司 | Video playing, data offering method, client and server in virtual scene |
| WO2018205663A1 (en) * | 2017-05-09 | 2018-11-15 | 优酷信息技术（北京）有限公司 | Video playback and data providing method in virtual scene, client and server |
| US11272154B2 (en) | 2017-05-09 | 2022-03-08 | Youku Information Technology (Beijing) Co., Ltd. | Providing video playback and data associated with a virtual scene |
| CN108882018B (en) * | 2017-05-09 | 2020-10-20 | 阿里巴巴（中国）有限公司 | Video playing and data providing method in virtual scene, client and server |
| TWI663874B (en) * | 2017-05-09 | 2019-06-21 | 中國商優酷信息技術（北京）有限公司 | Video playback, data providing method, client and server in virtual scene |
| US11386616B2 (en) | 2017-06-29 | 2022-07-12 | Open Space Labs, Inc. | Automated spatial indexing of images based on floorplan features |
| US10762698B2 (en) | 2017-06-29 | 2020-09-01 | Open Space Labs, Inc. | Automated spatial indexing of images based on floorplan features |
| CN111148969A (en) * | 2017-09-27 | 2020-05-12 | 苹果公司 | Spatial audio navigation |
| CN111148969B (en) * | 2017-09-27 | 2023-09-29 | 苹果公司 | spatial audio navigation |
| US11709068B2 (en) | 2017-09-27 | 2023-07-25 | Apple Inc. | Spatial audio navigation |
| CN107833277A (en) * | 2017-10-16 | 2018-03-23 | 华南理工大学 | A kind of Panoramic Warping scene edit methods based on unity3D |
| CN108257219A (en) * | 2018-01-31 | 2018-07-06 | 广东三维家信息科技有限公司 | A kind of method for realizing the roaming of panorama multiple spot |
| CN108257219B (en) * | 2018-01-31 | 2021-05-11 | 广东三维家信息科技有限公司 | Method for realizing panoramic multipoint roaming |
| CN109099902A (en) * | 2018-06-29 | 2018-12-28 | 中国航空规划设计研究总院有限公司 | A kind of virtual reality panoramic navigation system based on Unity 3D |
| CN109299324A (en) * | 2018-10-19 | 2019-02-01 | 四川巧夺天工信息安全智能设备有限公司 | A kind of search method of label type video file |
| US11178386B2 (en) | 2018-11-12 | 2021-11-16 | Open Space Labs, Inc. | Automated spatial indexing of images to video |
| WO2020102107A1 (en) * | 2018-11-12 | 2020-05-22 | Open Space Labs, Inc. | Automated spatial indexing of images to video |
| US11638001B2 (en) | 2018-11-12 | 2023-04-25 | Open Space Labs, Inc. | Automated spatial indexing of images to video |
| US10944959B2 (en) | 2018-11-12 | 2021-03-09 | Open Space Labs, Inc. | Automated spatial indexing of images to video |
| CN113961078A (en) * | 2021-11-04 | 2022-01-21 | 中国科学院计算机网络信息中心 | Panoramic roaming method, device and equipment and readable storage medium |
| CN113961078B (en) * | 2021-11-04 | 2023-05-26 | 中国科学院计算机网络信息中心 | Panoramic roaming method, device, equipment and readable storage medium |
| CN114510153A (en) * | 2022-04-19 | 2022-05-17 | 广州市影擎电子科技有限公司 | Wind sense simulation method and device applied to VR (virtual reality) environment simulation and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101055494B (en) | 2011-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101055494A (en) | Dummy scene roaming method and system based on spatial index cube panoramic video | |
| CN1215443C (en) | Layer representation of three-D body and method and device for drawing said body by utilizing it | |
| US9786075B2 (en) | Image extraction and image-based rendering for manifolds of terrestrial and aerial visualizations | |
| EP0794516B1 (en) | Image processing method and apparatus | |
| CN1404018A (en) | Intelligent scene drawing system and drawing & processing method in computer network environment | |
| US20020118890A1 (en) | Method and apparatus for processing photographic images | |
| US20110273451A1 (en) | Computer simulation of visual images using 2d spherical images extracted from 3d data | |
| CN1659551A (en) | Coordinating haptics with visual images in a human-computer interface | |
| US8508534B1 (en) | Animating objects using relative motion | |
| JP2007004578A (en) | Method and device for acquiring three-dimensional shape and recording medium for program | |
| Livny et al. | A GPU persistent grid mapping for terrain rendering | |
| CN1771740A (en) | Steroscopic panoramic image capture device | |
| KR20020068151A (en) | Digital Photogrammetric System | |
| US11418769B1 (en) | Viewport adaptive volumetric content streaming and/or rendering | |
| KR102065632B1 (en) | Device and method for acquiring 360 VR images in a game using a plurality of virtual cameras | |
| CN114332356A (en) | Virtual and real picture combining method and device | |
| JP3981454B2 (en) | Non-uniform resolution image data generation apparatus and method, and image processing apparatus using non-uniform resolution image data | |
| Liarokapis et al. | Design experiences of multimodal mixed reality interfaces | |
| Miles et al. | Crowd-sourced digitisation of cultural heritage assets | |
| Trapp et al. | Communication of digital cultural heritage in public spaces by the example of roman cologne | |
| Barrile et al. | A Combined Study of Cultural Heritage in Archaeological Museums: 3D Survey and Mixed Reality. Heritage 2022, 5, 1330–1349 | |
| Jung et al. | Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint made with a Single 360° Camera | |
| Daskalopoulos et al. | A trip from object to image and back | |
| Maruscsák et al. | MiniGI: Guerilla Mappings in Miniature | |
| KR20240044091A (en) | A system that implements data visualization in 3D virtual space |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110316 Termination date: 20190413 |