CN106296783A - A kind of combination space overall situation 3D view and the space representation method of panoramic pictures - Google Patents

A kind of combination space overall situation 3D view and the space representation method of panoramic pictures Download PDF

Info

Publication number
CN106296783A
CN106296783A CN201610607781.XA CN201610607781A CN106296783A CN 106296783 A CN106296783 A CN 106296783A CN 201610607781 A CN201610607781 A CN 201610607781A CN 106296783 A CN106296783 A CN 106296783A
Authority
CN
China
Prior art keywords
panoramic pictures
model
space
panoramic
pictures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610607781.XA
Other languages
Chinese (zh)
Other versions
CN106296783B (en
Inventor
高翔
刘强
黄敏声
张宗华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Public Interest (beijing) Technology Co Ltd
Original Assignee
Public Interest (beijing) Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Public Interest (beijing) Technology Co Ltd filed Critical Public Interest (beijing) Technology Co Ltd
Priority to CN201610607781.XA priority Critical patent/CN106296783B/en
Publication of CN106296783A publication Critical patent/CN106296783A/en
Application granted granted Critical
Publication of CN106296783B publication Critical patent/CN106296783B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/08Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation

Abstract

A kind of combination space overall situation 3D view and the space representation method of panoramic pictures, comprise the following steps: 1) 3D modeling panoramic pictures is generated the texturing of space overall situation 3D model;2) utilize 3 d graphic library to represent step 1) generate complete pinup picture by the 3D model in space to be presented;3) panoramic pictures collection, the panoramic pictures gathering multiple preset points of observation with indoor panorama three-dimensional data twin shaft automatic acquisition device in space to be presented records the exact space 3D coordinate information of each point of observation, and the corresponding panoramic pictures rotary shaft information including zero angle information in the 3D model in space to be presented simultaneously;4) 3D panorama mapping algorithm is utilized by step 3) panoramic pictures that obtains is mapped in step 1) obtain on 3D model;5) 3D model display pattern and panoramic pictures show the switching of pattern.

Description

A kind of combination space overall situation 3D view and the space representation method of panoramic pictures
Technical field
The present invention relates to the use of the three dimensions display technique of computer or the Internet, by combine space 3D data and Panoramic pictures reaches being demonstrated the space comprehensive methods of exhibiting from the overall situation to details.
Background technology
Existing space representation method mainly has panoramic pictures to show and three-dimensional modeling is shown.Panoramic pictures lacks three dimensions According to, Scene Representation lacks the displaying of the overall situation.And three-dimensional modeling is divided into manual measurement data modeling based on mapping and three-dimensional to sweep Retouch modeling.The former lacks real structure and texture information by made model, and scene sense of reality is the strongest;Although the latter space is tied Structure is built with sense of reality, but grain details is the most perfect.Therefore, existing space representation method can be broadly divided into: (one) panorama The displaying of picture, the 3D craft modeler model displaying of (two) scene, the 3D scanning modeling model display of (three) scene.Applicant In the range of retrieval, the existing document that the method for space representation can see method () is as follows:
In technical scheme disclosed in Chinese patent literature CN201110426966, by least including the complete of two photographic head Scape camera head shooting space, the visual angle sum of the most all cam lens forms the sphere visual angle more than or equal to 360 degree, Then the image processing software picture to different photographic head shootings will be utilized after the image transmitting photographed to image processing terminal Junction is modified, and makes the picture of different photographic head shooting realize smooth combination, generates 360 ° of panoramas.Free owing to not being Between three-dimensional data, lack scene global displaying;
In technical scheme disclosed in Chinese patent literature CN201210412995, the photo of panoramic picture is carried out at perspective Reason, to be modeled as real 3D scene, generates the file set with map mark.But the method lacks real spatial information, Feeling of immersion is the strongest;
Flat green grass or young crops deliver " 360 degree of panoramic techniques digital museum application (digital technology and application, 09 phase in 2015, 87) " take a photo that rotating camera shooting space overlaps in center, carry out splicing with PS software and make panorama sketch Sheet, then plays on plug-in unit, and user browses space only in program setting, it is impossible to realize interactively Consumer's Experience;
In technical scheme disclosed in Chinese patent literature CN201510167536.7, obtain aphorama with high-definition camera system Frequency evidence, is spliced into 360 degree of videos by video-splicing software by the video data obtained, and final effect is that user can select Switch between two-dimensional map and panoramic table, and then check positional information.Its shortcoming mainly two-dimensional map only comprises Geographical position and geographic name, lack actual geographic image, and Web Publishing form not only had by three-dimensional panoramic video stream map Requirement, and data volume is big, and the data network load time is long, and the fluency that video panorama is play is affected relatively by network broadband Greatly;
In technical scheme disclosed in Chinese patent literature CN200910127737.9, represent article method and be characterised by: Respond different operational orders to show different sequence images or animation, when beholder is with different command operating, make image cut Change on the image of respective angles, make beholder's freely multi angle view be taken article.Although the thing of this kind of method shooting The angle of product is many, and the photo of collection is many, but the mode that photo formula browses still shows article with two dimensional image, lacks three dimensions According to, scene switching is the most smooth.
In technical scheme disclosed in Chinese patent literature CN200610053842.9, produce sequence static map with general camera Picture, reapplies software engineering and serial static image is spliced into 360 degree of cylindricalitys looks around panorama sketch, owing to the method uses cylinder complete Jing Tu, institute in this way can only 360 degree look around, it is impossible to multi angle view object, lack the object dimensional degree of depth due to the method again Information, it is impossible to construct the axonometric chart with distance perspective.
Chinese patent literature CN201310084834.0) disclosed in technical scheme, set first with high definition bitmap collection 360 degree of omnidirectional image datas of standby acquisition, by advanced computer graphic image technology, are processed place to early stage bitmap Reason, forms outdoor scene full figure, then live-action panorama is carried out secondary operations, the panorama sketch under each environment of connecting.Image adds Add interactive interface, develop human-computer interaction interface based on Kinect, it is achieved the intelligent mutual impression of action command.The method is only User can be allowed to experience the visual experience of two-dimensional panoramic figure of informative, owing to lacking three-dimensional data information, it is impossible to true Real scene of three-dimensionally reducing.
The existing document of method (two) is as follows:
Liu Jun etc. deliver " modeling of the three dimension realistic of the site of ancient culture remains and virtual display technology (and computer engineering, 2010 20 phases, 286 290) " use projection domain Triangulation Technique fine modeling after 3 D laser scanning, then propose two-step method and enter Row texture maps, although achieve stronger sense of reality, but imperfect due to the impact of error and tower body binding site texture Property result in the inaccuracy of overall space details.And auxiliary building is used on the basis of design drawing by 3D Max 9.0 construct ruins scene, and the topographical information of object is imperfect, lack the real information of space structure;
In technical scheme disclosed in Chinese patent literature CN201310207203.3,3D modeling technique is utilized to be created that house Model, the most spatially can move freely at house 3D model with the use of virtual video camera, and with relevant position Displaying house, visual angle 3D model, adds the use of input module and control module, it is achieved human-computer interaction, it is ensured that system realizes various Personalized displaying demand.Although the three-dimensional data in space can all be shown by this system with panorama, but owing to this is System uses the method for pure manual 3D modeling to be created that building model, and it is empty that the structure in space and texture are not from actual physics Between, therefore represent untrue, be cartoon represent effect.
The prior art literature of method (three) is as follows
In technical scheme disclosed in Chinese patent literature 201310343113.7, three-dimensional scenic based on globular projection is proposed " two dimensional image " mapping method, is described in bidimensional panoramic picture and subsidiary description file by more three-dimensional informations such as the degree of depth In, thus breach 360 degree panorama sketch of tradition can only show can not immersion roam, the defect of human-computer interaction.Due to this system Utilizing the position of scene management module analysis room and door, automatically generate some points of observation, viewer can only be from entrance point of observation Start, the position observed according to syntopy switching, and can not be from main separation point of observation, so this system can not give viewer complete The displaying in orientation, it is impossible to adapt to the displaying demand of various personalization.
High big " Digital Campus primary construction (the digital skill that three-dimensional panorama combines with 3 D laser scanning delivered by force etc. Art and application, 05 phase in 2013,106 108) " propose panoramic pictures is combined with laser scanning that to obtain three dimensions complete The thinking of scape picture, but scheme is not made and illustrating.
By analyzing above-mentioned document it can be seen that three kinds of main method spatial scene shown by computer or network Respectively there are following pluses and minuses.
One, the displaying of panoramic pictures
A) advantage: the displaying in space is fine and smooth true, especially represents details
B) shortcoming: the switching (panoramic pictures) of scene is lofty, does not has transition;Lack the displaying of scene global, Consumer's Experience Cannot see the wood for the trees;Lacking the support of three-dimensional data, scene information is abundant not comprehensively.
Two, the 3D craft modeler model of scene shows (similar 3Dmax Hand drawing modeling)
A) advantage: the overall situation showing existing entirety in space represents, has again the details of internal local to represent.
B) shortcoming: owing to structure and the texture in space are not from actual physics space, therefore representing untrue, being Picture represent effect.
Three, the 3D scanning modeling model display of scene
A) advantage: the structure in space and texture derive from actual physics space, the same existing overall situation has again local to represent, exhibition Existing strong sense of reality.
B) shortcoming: due to the limitation of scanning sensor own, does not has the panoramic pictures in space, and therefore the details of model lacks Lose more serious, represent effect barely satisfactory.
To sum up, it is provided that a kind of comprehensive panoramic pictures is shown and three-dimensional modeling shows advantage, and the displaying in space is fine and smooth true, empty Between the overall situation showing existing entirety represent, have again the details of internal local represent and overcome structure and the stricture of vagina in respective method space Reason derives from actual physics space, and the same existing overall situation has again local to represent, and represents strong sense of reality, reaches perfect to truly The displaying in space.
Summary of the invention
It is to provide one for solution the problems referred to above the technical solution used in the present invention and combines space overall situation 3D view and panorama The space representation method of picture, is characterized in that said method comprising the steps of:
1) 3D modeling, first passes through indoor panorama three-dimensional data twin shaft automatic acquisition device and gathers the degree of depth in space to be presented Information data and panoramic pictures, utilize 3D modeling method based on various visual angles data fusion that the depth data collected is generated one Panoramic pictures is also generated the texturing of overall 3D model in space to be presented by the overall 3D model in individual space to be presented.Described The overall 3D model hereinafter referred to as 3D model in space to be presented
2) 3D model display, utilizes 3 d graphic library to represent step 1) the 3D model completing pinup picture that generates.
3) panoramic pictures collection, gathers multiple in space to be presented with indoor panorama three-dimensional data twin shaft automatic acquisition device The panoramic pictures of preset point of observation records the exact space 3D coordinate information of each point of observation, and corresponding panoramic pictures simultaneously The rotary shaft information including zero angle information in 3D model.
4) panoramic pictures maps, and utilizes 3D panorama mapping algorithm by step 3) panoramic pictures that obtains is mapped in step 1) On 3D model.
5) 3D model display pattern and panoramic pictures show the switching of pattern, when on the 3D model represented, certain is put and this When the panoramic pictures of the immediate preset point of observation of point switches over, the user perspective in record 3D model, and regard with this user Angle represents panoramic pictures.When switching back into 3D model from the distant view photograph of this user perspective, preset by be switched in 3D model On point of observation.
Described a kind of combination space overall situation 3D view and the space representation method of panoramic pictures, is characterized in that described panorama Picture is cube (Cube) figure
Described a kind of combination space overall situation 3D view and the space representation method of panoramic pictures, is characterized in that described step 4) mapping algorithm of 3D panorama described in specifically includes following steps
4.1) the screen coordinate system X/Y of definition two dimension and three-dimensional 3D model coordinate systems X '/Y '/Z ', described 3D model The direction of coordinate system is always consistent with the orientation of 3D model, and the center of gravity simultaneously specifying 3D model is former as 3D model coordinate systems Point O, definition Z ' are the feathering axis of 3D model, and X ' is the vertical rotating shaft of 3D model.
4.2) the feathering axis Z " and vertical rotating shaft X " of definition panoramic pictures.Horizontal rotation by each panoramic pictures Axle Z " aligns with the feathering axis Z ' travel direction of 3D model coordinate systems, simultaneously by the vertical rotating shaft X of each panoramic pictures " Align with 3D model coordinate systems vertical rotating shaft travel direction, complete the panoramic pictures mapping to 3D model.
Described a kind of combination space overall situation 3D view and the space representation method of panoramic pictures, is characterized in that described step 5) following steps are specifically included
5.1), when 3D model display pattern is to panoramic pictures displaying patten transformation, record and user are in 3D model display pattern The direction of observation of the immediate preset point of observation in lower selection region and the level angle of current 3D model.Described level angle is 3D The coordinate axes X ' of model coordinate systems and the angle with screen coordinate system X-axis,
5.2) select with user-selected area closest to the panoramic pictures of preset point of observation, and make the level of panoramic pictures revolve Corner Q and step 5.1) level angle equal;
5.3) according to step 5.2) in the feathering angle of panoramic pictures, the indication range of screen and needs complete selected Scape picture displaying ratio determines the scope that this panoramic pictures shows on screen, this part panoramic pictures is displayed, completes The conversion of pattern is shown from 3D model display pattern to panoramic pictures.
5.4) inverse operating procedure 5.1)~5.3), can realize showing that pattern is to 3D model display pattern from panoramic pictures Switching.
Described a kind of combination space overall situation 3D view and the space representation method of panoramic pictures, is characterized in that described indoor Panorama three-dimensional data twin shaft automatic acquisition device is by gathering panoramic pictures and depth information data acquisition module, horizontal rotatable platform With pitching rotation platform, it is possible to gather panoramic pictures and depth information data simultaneously.
Described a kind of combination space overall situation 3D view and the space representation method of panoramic pictures, is characterized in that described three Dimension shape library includes WebGL, local OpenGL or Direct3D.
Described a kind of combination space overall situation 3D view and the space representation method of panoramic pictures, it is characterized in that by whole entirely The calculating process of each pixel of scape picture is all placed in server end, will show that the 3D model calculating process with panoramic pictures is placed in User side, server end is connected by network with user side, and user side installs the browser supporting WebGL interface, operates in The Javascript script of user side browser can call WebGL interface and realize 3D model representing on screen;When from 3D mould When type is switched to panoramic pictures, while gradually being obscured by 3D model by the shader interface of WebGL, allow panoramic pictures gradually Clearly.
Compared with prior art, the invention have the advantages that
1, user is possible not only to see the 3D general layout in whole space, simultaneously it can also be seen that local, high-quality space is thin Joint.
2,3D model and panoramic pictures two kinds show that the switching of pattern is the most smooth, make Consumer's Experience reach optimal.When from 3D pattern to panoramic pictures pattern switch over time, owing to the movement at visual angle is entirely the source position in normal 3d space To the movement of destination locations, and source position is also a preset point of observation nearest with the target area of user's click, institute Consistent with the expection with user, experience the most smooth, it is true that preset point of observation is the closeest, this experience is the most smooth.Entering During row switching, user is difficult to distinguish that oneself see is texturing or the panoramic pictures of 3D model on earth, so 3D model The process of the panoramic pictures that texturing is transitioned into seems that only viewing area is exaggerated, it is difficult to find district therein Not.
3, from the point of view of the concrete technology that represents realizes, whole panoramic pictures the calculating process of each pixel be all placed in clothes Business device end, the calculating process showing 3D model and panoramic pictures is placed in user side, 3D model data and panoramic pictures data can Load with timesharing, thus can effectively shorten the data network load time, reduce the network bandwidth impact on Consumer's Experience, and have It is beneficial to be placed on the mobile terminal devices such as mobile phone user side.
Accompanying drawing explanation
Fig. 1 is the feathering axis of the panoramic pictures of an embodiment of the present invention and vertical rotating shaft and direction of rotation is shown It is intended to;
Fig. 2 is the principle schematic of the 3D model display pattern of an embodiment of the present invention;
Fig. 3 is the principle schematic of the recording level drift angle of an embodiment of the present invention;
Fig. 4 is the principle schematic that the determination panoramic pictures of an embodiment of the present invention represents scope.
Detailed description of the invention
Be further discussed below the present invention below in conjunction with embodiment and accompanying drawing thereof, referring herein to implementation method use browser HTML5 technology, can also be realized by technology such as classes OpenGL/Direct3D simultaneously, but the claim of the present patent application is protected Scope of protecting is not limited by implementing concrete technical method.
A kind of combination space overall situation 3D view and the space representation method of panoramic pictures that the present invention provides include following step Rapid:
1) 3D modeling, first passes through indoor panorama three-dimensional data twin shaft automatic acquisition device and gathers the degree of depth in space to be presented Information data and panoramic pictures, utilize 3D modeling method based on various visual angles data fusion that the depth data collected is generated one Panoramic pictures is also generated the texturing of 3D model by the overall 3D model (hereinafter referred to as 3D model) in individual space to be presented.
2) 3D model display, utilizes 3 d graphic library to represent step 1) the 3D model completing pinup picture that generates.
3) panoramic pictures collection, gathers multiple in space to be presented with indoor panorama three-dimensional data twin shaft automatic acquisition device The panoramic pictures of preset point of observation records the exact space 3D coordinate information of each point of observation, and corresponding panoramic pictures simultaneously The rotary shaft information including zero angle information in the 3D model in space to be presented.
4) panoramic pictures maps, and utilizes 3D panorama mapping algorithm by step 3) panoramic pictures that obtains is mapped in step 1) On 3D model.
Embodiment
In the present embodiment, indoor panorama three-dimensional data twin shaft automatic acquisition device includes that horizontal rotatable platform rotates with pitching The spider of platform, and control the motor of horizontal rotation angle, the motor controlling the pitching anglec of rotation and Microsoft Kinect, they are commercial products.Kinect is arranged on tripod, can adjust its level by controlling motor With the pitching anglec of rotation, to complete to treat panoramic pictures and the collection of depth information data in spacial flex.
In the present embodiment, panoramic pictures uses cube (Cube) mode to realize.Moment panoramic pictures is determined only at one So that one part (according to screen size and displaying ratio) is presented on screen.The 3D model used come from applicant with The model that the 3D scan mode of Kinect is set up.
Described step 4) described in 3D panorama mapping algorithm specifically include following steps
4.1) the screen coordinate system X/Y of definition two dimension and three-dimensional 3D model coordinate systems X '/Y '/Z ', described 3D model The direction of coordinate system is always consistent with the orientation of 3D model, and the center of gravity simultaneously specifying 3D model is former as 3D model coordinate systems Point O, the feathering axis that definition Z ' is 3D model, X ' is the vertical rotating shaft of 3D model.
4.2) the feathering axis Z " and vertical rotating shaft X " of definition panoramic pictures.Depth information data due to 3D model Gather with panoramic pictures data, therefore by feathering axis Z " and vertical rotating shaft X " and the 3D model of each panoramic pictures simultaneously The feathering axis Z ' of coordinate system and the alignment of vertical rotating shaft X ' travel direction can complete the panoramic pictures mapping to 3D model. The feathering axis of described panoramic pictures and vertical rotating shaft and direction of rotation schematic diagram thereof are as shown in Figure 1
Step 5) in specifically include following steps
5.1), when 3D model display pattern is to panoramic pictures displaying patten transformation, record and user are in 3D model display pattern The direction of observation of the immediate preset point of observation C in lower selection region and the level angle Q of current 3D model.Described level angle is The coordinate axes X ' of 3D model coordinate systems and the angle with screen coordinate system X-axis.Principle schematic such as Fig. 2 of 3D model display pattern Shown in, the principle schematic of recording level drift angle is as shown in Figure 3
5.2) select with user-selected area closest to the panoramic pictures cube graph of preset point of observation, and make panoramic pictures Feathering angle Q and step 5.1) level angle equal;
5.3) according to step 5.2) in the feathering angle of panoramic pictures, the indication range of screen and needs complete selected Scape picture displaying ratio obtains the scope that this panoramic pictures should show on screen, this part panoramic pictures is displayed, Complete to show the conversion of pattern from space 3D model display to panoramic pictures.Determine that panoramic pictures represents the principle schematic of scope As shown in Figure 4.Preset point of observation C in figure, it is the part between aa ' that panoramic pictures represents scope, the horizontal rotation of panoramic pictures Angle Q be 3D model coordinate systems coordinate axes X ' and with angle (the coordinate axes Y ' equal to 3D model coordinate systems of screen coordinate system X-axis And with the angle of screen coordinate system Y-axis)
5.4) inverse operating procedure 5.1)~5.3), can realize from 3D pattern to the switching of panoramic pictures pattern.
From actual realize effect from the point of view of, the above-mentioned effect represented is ideal, and it is big that handoff procedure at utmost meets the mankind Brain thinking habit, has reached good space observation Consumer's Experience.
The inventive method has given full play to the respective advantage that 3D data model is shown and panorama is shown, and by reasonably calculating Docking seamless for two kinds of methods of exhibiting is got up by method, has reached ideal effect.

Claims (7)

1. combine a space representation method for space overall situation 3D view and panoramic pictures, it is characterized in that described method includes following Step:
1) 3D modeling, first passes through indoor panorama three-dimensional data twin shaft automatic acquisition device and gathers the depth information in space to be presented Data and panoramic pictures, utilize 3D modeling method based on various visual angles data fusion the depth data collected generation one to be treated Panoramic pictures is also generated the texturing of overall 3D model in space to be presented by the overall 3D model of spacial flex, described in wait to open up Show the overall 3D model hereinafter referred to as 3D model in space;
2) 3D model display, utilizes 3 d graphic library to represent step 1) the 3D model completing pinup picture that generates;
3) panoramic pictures collection, gathers multiple preset in space to be presented with indoor panorama three-dimensional data twin shaft automatic acquisition device The panoramic pictures of point of observation records the exact space 3D coordinate information of each point of observation simultaneously, and corresponding panoramic pictures is being treated The rotary shaft information including zero angle information in the 3D model of spacial flex;
4) panoramic pictures maps, and utilizes 3D panorama mapping algorithm by step 3) panoramic pictures that obtains is mapped in step 1) obtain 3D On model;
5) 3D model display pattern and panoramic pictures show the switching of pattern, when on the 3D model represented certain point to this point When the panoramic pictures of close preset point of observation switches over, the user perspective in record 3D model, and with this user perspective exhibition Existing panoramic pictures, when switching back into 3D model from the distant view photograph of this user perspective, will be switched to the preset observation in 3D model On point.
A kind of combination space overall situation 3D view the most as claimed in claim 1 and the space representation method of panoramic pictures, its feature Be described panoramic pictures be cube (Cube) figure.
A kind of combination space overall situation 3D view the most as claimed in claim 1 or 2 and the space representation method of panoramic pictures, it is special Levying is described step 4) described in 3D panorama mapping algorithm specifically include following steps
4.1) the screen coordinate system X/Y of definition two dimension and three-dimensional 3D model coordinate systems X '/Y '/Z ', described 3D model coordinate The direction of system is always consistent with the orientation of 3D model, and the center of gravity of appointment 3D model is as 3D model coordinate systems initial point O simultaneously, Definition Z ' is the feathering axis of 3D model, and X ' is the vertical rotating shaft of 3D model;
4.2) the feathering axis Z " and vertical rotating shaft X " of definition panoramic pictures, by the feathering axis Z of each panoramic pictures " Align with the feathering axis Z ' travel direction of 3D model coordinate systems, simultaneously by the vertical rotating shaft X of each panoramic pictures " and 3D Model coordinate systems vertical rotating shaft travel direction aligns, and completes the panoramic pictures mapping to 3D model.
A kind of combination space overall situation 3D view the most as claimed in claim 3 and the space representation method of panoramic pictures, its feature It is described step 5) specifically include following steps
5.1), when 3D model display pattern is to panoramic pictures displaying patten transformation, record and user select under 3D model display pattern Selecting direction of observation and the level angle of current 3D model of the immediate preset point of observation in region, described level angle is 3D model The coordinate axes X ' of coordinate system and the angle with screen coordinate system X-axis;
5.2) select with user-selected area closest to the panoramic pictures of preset point of observation, and make the feathering angle of panoramic pictures Q and step 5.1) level angle equal;
5.3) according to step 5.2) in the feathering angle of panoramic pictures, the indication range of screen and the panorama sketch of needs selected Sheet displaying ratio determines the scope that this panoramic pictures shows on screen, this part panoramic pictures is displayed, completes from 3D Model display pattern shows the conversion of pattern to panoramic pictures;
5.4) inverse operating procedure 5.1)~5.3), can realize showing pattern cutting to 3D model display pattern from panoramic pictures Change.
A kind of combination space overall situation 3D view the most as claimed in claim 1 and the space representation method of panoramic pictures, its feature It is that described indoor panorama three-dimensional data twin shaft automatic acquisition device is by gathering panoramic pictures and depth information data acquisition module, water Flat rotation platform and pitching rotation platform, it is possible to gather panoramic pictures and depth information data simultaneously.
A kind of combination space overall situation 3D view the most as claimed in claim 1 and the space representation method of panoramic pictures, its feature The 3 d graphic library being described includes WebGL, local OpenGL or Direct3D.
A kind of combination space overall situation 3D view the most as claimed in claim 1 and the space representation method of panoramic pictures, its feature It is that the calculating process of each pixel of whole panoramic pictures is all placed in server end, the meter of 3D model and panoramic pictures will be shown Calculation process is placed in user side, and server end is connected by network with user side, and user side is installed and supported browsing of WebGL interface Device, operates in the Javascript script of user side browser and can call WebGL interface and realize 3D model representing on screen; When from 3D models switching to panoramic pictures, by the shader interface of WebGL by 3D model gradually fuzzy while allow panorama Picture is the most clear.
CN201610607781.XA 2016-07-28 2016-07-28 A kind of space representation method of combination space overall situation 3D view and panoramic pictures Active CN106296783B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610607781.XA CN106296783B (en) 2016-07-28 2016-07-28 A kind of space representation method of combination space overall situation 3D view and panoramic pictures

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610607781.XA CN106296783B (en) 2016-07-28 2016-07-28 A kind of space representation method of combination space overall situation 3D view and panoramic pictures

Publications (2)

Publication Number Publication Date
CN106296783A true CN106296783A (en) 2017-01-04
CN106296783B CN106296783B (en) 2019-01-11

Family

ID=57663338

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610607781.XA Active CN106296783B (en) 2016-07-28 2016-07-28 A kind of space representation method of combination space overall situation 3D view and panoramic pictures

Country Status (1)

Country Link
CN (1) CN106296783B (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107240065A (en) * 2017-04-19 2017-10-10 中科院微电子研究所昆山分所 A kind of 3D full view image generating systems and method
CN108510433A (en) * 2017-02-28 2018-09-07 上海小桁网络科技有限公司 Space representation method, apparatus and terminal
CN108564654A (en) * 2018-04-03 2018-09-21 中德(珠海)人工智能研究院有限公司 The picture mode of entrance of three-dimensional large scene
CN108629828A (en) * 2018-04-03 2018-10-09 中德(珠海)人工智能研究院有限公司 Scene rendering transition method in the moving process of three-dimensional large scene
CN108920598A (en) * 2018-06-27 2018-11-30 百度在线网络技术(北京)有限公司 Panorama sketch browsing method, device, terminal device, server and storage medium
CN108965718A (en) * 2018-08-03 2018-12-07 北京微播视界科技有限公司 image generating method and device
CN109064545A (en) * 2018-06-06 2018-12-21 链家网(北京)科技有限公司 The method and device that a kind of pair of house carries out data acquisition and model generates
WO2020019304A1 (en) * 2018-07-27 2020-01-30 深圳市大疆创新科技有限公司 Method and device for acquiring three-dimensional scene
CN111064947A (en) * 2019-12-04 2020-04-24 广东康云科技有限公司 Panoramic-based video fusion method, system, device and storage medium
CN111105347A (en) * 2019-11-19 2020-05-05 贝壳技术有限公司 Method, device and storage medium for generating panoramic image with depth information
CN111161129A (en) * 2019-11-25 2020-05-15 佛山欧神诺云商科技有限公司 Three-dimensional interaction design method and system for two-dimensional image
CN111951385A (en) * 2020-08-12 2020-11-17 中国银行股份有限公司 Enterprise display method and device
US10872467B2 (en) 2018-06-06 2020-12-22 Ke.Com (Beijing) Technology Co., Ltd. Method for data collection and model generation of house
CN112634414A (en) * 2020-12-24 2021-04-09 北京百度网讯科技有限公司 Map display method and device
US11055835B2 (en) 2019-11-19 2021-07-06 Ke.com (Beijing) Technology, Co., Ltd. Method and device for generating virtual reality data
CN113568688A (en) * 2020-04-29 2021-10-29 RealMe重庆移动通信有限公司 View switching method and device, electronic equipment and storage medium
CN113916236A (en) * 2021-10-13 2022-01-11 北京卫星环境工程研究所 Spacecraft panoramic view navigation method based on three-dimensional physical model
CN115019624A (en) * 2022-07-20 2022-09-06 湖北理工学院 Architectural model inner structure display device for architectural design

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7565029B2 (en) * 2005-07-08 2009-07-21 Seiko Epson Corporation Method for determining camera position from two-dimensional images that form a panorama
CN101877139A (en) * 2009-04-30 2010-11-03 爱国者全景(北京)网络科技发展有限公司 Method and system for realizing spacial hot spots in three-dimensional video panorama
CN102054247A (en) * 2009-11-04 2011-05-11 沈阳隆惠科技有限公司 Method for building three-dimensional (3D) panoramic live-action network business platform
CN102679959A (en) * 2012-05-03 2012-09-19 浙江工业大学 Omnibearing 3D (Three-Dimensional) modeling system based on initiative omnidirectional vision sensor
CN103139580A (en) * 2011-11-29 2013-06-05 长春理工大学 Generation method of three-dimensional panoramic space stereo image
CN103559737A (en) * 2013-11-12 2014-02-05 中国科学院自动化研究所 Object panorama modeling method
US20140285486A1 (en) * 2013-03-20 2014-09-25 Siemens Product Lifecycle Management Software Inc. Image-based 3d panorama
CN104219584A (en) * 2014-09-25 2014-12-17 广州市联文信息科技有限公司 Reality augmenting based panoramic video interaction method and system
CN105163158A (en) * 2015-08-05 2015-12-16 北京奇艺世纪科技有限公司 Image processing method and device
KR101619486B1 (en) * 2015-04-14 2016-05-10 공간정보기술 주식회사 3D cube panorama device using Coordinate transformation matrix

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7565029B2 (en) * 2005-07-08 2009-07-21 Seiko Epson Corporation Method for determining camera position from two-dimensional images that form a panorama
CN101877139A (en) * 2009-04-30 2010-11-03 爱国者全景(北京)网络科技发展有限公司 Method and system for realizing spacial hot spots in three-dimensional video panorama
CN102054247A (en) * 2009-11-04 2011-05-11 沈阳隆惠科技有限公司 Method for building three-dimensional (3D) panoramic live-action network business platform
CN103139580A (en) * 2011-11-29 2013-06-05 长春理工大学 Generation method of three-dimensional panoramic space stereo image
CN102679959A (en) * 2012-05-03 2012-09-19 浙江工业大学 Omnibearing 3D (Three-Dimensional) modeling system based on initiative omnidirectional vision sensor
US20140285486A1 (en) * 2013-03-20 2014-09-25 Siemens Product Lifecycle Management Software Inc. Image-based 3d panorama
CN103559737A (en) * 2013-11-12 2014-02-05 中国科学院自动化研究所 Object panorama modeling method
CN104219584A (en) * 2014-09-25 2014-12-17 广州市联文信息科技有限公司 Reality augmenting based panoramic video interaction method and system
KR101619486B1 (en) * 2015-04-14 2016-05-10 공간정보기술 주식회사 3D cube panorama device using Coordinate transformation matrix
CN105163158A (en) * 2015-08-05 2015-12-16 北京奇艺世纪科技有限公司 Image processing method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
沈柯: "基于全景视图管理的3D图像拼接方法研究与实现", 《中国优秀硕士学位论文全文数据库》 *
漆驰 等: "摄像机图像序列的全景图拼接", 《计算机辅助设计与图形学学报》 *

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108510433B (en) * 2017-02-28 2020-03-24 贝壳找房(北京)科技有限公司 Space display method and device and terminal
CN108510433A (en) * 2017-02-28 2018-09-07 上海小桁网络科技有限公司 Space representation method, apparatus and terminal
CN107240065A (en) * 2017-04-19 2017-10-10 中科院微电子研究所昆山分所 A kind of 3D full view image generating systems and method
CN108629828A (en) * 2018-04-03 2018-10-09 中德(珠海)人工智能研究院有限公司 Scene rendering transition method in the moving process of three-dimensional large scene
CN108629828B (en) * 2018-04-03 2019-08-13 中德(珠海)人工智能研究院有限公司 Scene rendering transition method in the moving process of three-dimensional large scene
CN108564654A (en) * 2018-04-03 2018-09-21 中德(珠海)人工智能研究院有限公司 The picture mode of entrance of three-dimensional large scene
CN109064545A (en) * 2018-06-06 2018-12-21 链家网(北京)科技有限公司 The method and device that a kind of pair of house carries out data acquisition and model generates
US10872467B2 (en) 2018-06-06 2020-12-22 Ke.Com (Beijing) Technology Co., Ltd. Method for data collection and model generation of house
CN108920598A (en) * 2018-06-27 2018-11-30 百度在线网络技术(北京)有限公司 Panorama sketch browsing method, device, terminal device, server and storage medium
WO2020019304A1 (en) * 2018-07-27 2020-01-30 深圳市大疆创新科技有限公司 Method and device for acquiring three-dimensional scene
CN108965718A (en) * 2018-08-03 2018-12-07 北京微播视界科技有限公司 image generating method and device
CN108965718B (en) * 2018-08-03 2021-03-23 北京微播视界科技有限公司 Image generation method and device
US11721006B2 (en) 2019-11-19 2023-08-08 Realsee (Beijing) Technology Co., Ltd. Method and device for generating virtual reality data
CN111105347A (en) * 2019-11-19 2020-05-05 贝壳技术有限公司 Method, device and storage medium for generating panoramic image with depth information
US11055835B2 (en) 2019-11-19 2021-07-06 Ke.com (Beijing) Technology, Co., Ltd. Method and device for generating virtual reality data
CN111161129A (en) * 2019-11-25 2020-05-15 佛山欧神诺云商科技有限公司 Three-dimensional interaction design method and system for two-dimensional image
CN111064947A (en) * 2019-12-04 2020-04-24 广东康云科技有限公司 Panoramic-based video fusion method, system, device and storage medium
CN113568688A (en) * 2020-04-29 2021-10-29 RealMe重庆移动通信有限公司 View switching method and device, electronic equipment and storage medium
CN113568688B (en) * 2020-04-29 2023-06-06 RealMe重庆移动通信有限公司 View switching method and device, electronic equipment and storage medium
CN111951385A (en) * 2020-08-12 2020-11-17 中国银行股份有限公司 Enterprise display method and device
CN112634414A (en) * 2020-12-24 2021-04-09 北京百度网讯科技有限公司 Map display method and device
CN112634414B (en) * 2020-12-24 2023-09-05 北京百度网讯科技有限公司 Map display method and device
US11893081B2 (en) 2020-12-24 2024-02-06 Beijing Baidu Netcom Science Technology Co., Ltd. Map display method and apparatus
CN113916236A (en) * 2021-10-13 2022-01-11 北京卫星环境工程研究所 Spacecraft panoramic view navigation method based on three-dimensional physical model
CN113916236B (en) * 2021-10-13 2023-08-15 北京卫星环境工程研究所 Spacecraft panoramic view navigation method based on three-dimensional physical model
CN115019624A (en) * 2022-07-20 2022-09-06 湖北理工学院 Architectural model inner structure display device for architectural design
CN115019624B (en) * 2022-07-20 2023-09-29 湖北理工学院 Building model inner structure display device for architectural design

Also Published As

Publication number Publication date
CN106296783B (en) 2019-01-11

Similar Documents

Publication Publication Date Title
CN106296783B (en) A kind of space representation method of combination space overall situation 3D view and panoramic pictures
US11367197B1 (en) Techniques for determining a three-dimensional representation of a surface of an object from a set of images
US9626790B1 (en) View-dependent textures for interactive geographic information system
US10430994B1 (en) Techniques for determining a three-dimensional textured representation of a surface of an object from a set of images with varying formats
CN101872492B (en) Multi-angle map implementation method of three-dimensional simulation city
US8390617B1 (en) Visualizing oblique images
CN107067447B (en) Integrated video monitoring method for large spatial region
US20130321575A1 (en) High definition bubbles for rendering free viewpoint video
KR20070086037A (en) Method for inter-scene transitions
Inamoto et al. Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras
CN103226830A (en) Automatic matching correction method of video texture projection in three-dimensional virtual-real fusion environment
US9025810B1 (en) Interactive geo-referenced source imagery viewing system and method
CN103646424A (en) Aerial seamless virtual roaming system constructing method
CN108765576B (en) OsgEarth-based VIVE virtual earth roaming browsing method
KR101591427B1 (en) Method for Adaptive LOD Rendering in 3-D Terrain Visualization System
Bradley et al. Image-based navigation in real environments using panoramas
WO2009093136A2 (en) Image capture and motion picture generation
Jian et al. Augmented virtual environment: fusion of real-time video and 3D models in the digital earth system
CN111524230A (en) Linkage browsing method for three-dimensional model and unfolded panoramic image and computer system
JP2000076488A (en) Three-dimensional virtual space display device and texture object setting information generating device
EP2022010A1 (en) Virtual display method and apparatus
JP6682984B2 (en) Free-viewpoint video display device
CN108510433B (en) Space display method and device and terminal
Andersen et al. HMD-guided image-based modeling and rendering of indoor scenes
Shahabi et al. Geodec: Enabling geospatial decision making

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CB03 Change of inventor or designer information

Inventor after: Gao Xiang

Inventor after: Liu Qiang

Inventor after: Huang Minsheng

Inventor before: Gao Xiang

Inventor before: Liu Qiang

Inventor before: Huang Minsheng

Inventor before: Zhang Zonghua

CB03 Change of inventor or designer information