CN108280873A - Model space position capture and hot spot automatically generate processing system - Google Patents
Model space position capture and hot spot automatically generate processing system Download PDFInfo
- Publication number
- CN108280873A CN108280873A CN201810009523.0A CN201810009523A CN108280873A CN 108280873 A CN108280873 A CN 108280873A CN 201810009523 A CN201810009523 A CN 201810009523A CN 108280873 A CN108280873 A CN 108280873A
- Authority
- CN
- China
- Prior art keywords
- hot spot
- panoramic picture
- dimensional
- information
- processing system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 13
- 238000004088 simulation Methods 0.000 claims abstract description 7
- 238000012805 post-processing Methods 0.000 claims abstract description 5
- 230000004807 localization Effects 0.000 claims description 16
- 238000005259 measurement Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 claims description 5
- 230000002452 interceptive effect Effects 0.000 claims description 3
- 230000004927 fusion Effects 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 abstract description 4
- 241000251468 Actinopterygii Species 0.000 abstract description 2
- 241001269238 Data Species 0.000 abstract description 2
- 238000000034 method Methods 0.000 abstract 1
- 230000003993 interaction Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000009877 rendering Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000008018 melting Effects 0.000 description 1
- 238000002844 melting Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
- G06T3/047—Fisheye or wide-angle transformations
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of model space position captures and hot spot to automatically generate processing system, including is used to collected group picture being fused into complete panoramic picture, records all hotspot location coordinate informations and the hotspot database to model object parameter in each scene.Finally the hot information recorded in database is reverted in panoramic picture by panoramic picture demonstration tool, utilize demonstration tool by the panoramic picture that splicing is completed, you can hot spot interacts；Model space position capture and hot spot provided by the invention automatically generate processing system, be it is a kind of based on have render multi-view image 3D scene simulation tools, full-automatic capture 3D contextual datas, the key messages such as record cast position, size, generate visual angle flat image or panorama fish eye images photo, by post-processing, addition reduction commodity can interact hot spot data information, it is output to cross-platform panorama sketch preview tool, to provide the technical solution and operating process of convenient and efficient in other-end platform preview.
Description
Technical field
The present invention relates to when a kind of Computerized three-dimensional scene rendering model space position capture and hot spot automatically generate place
Reason system.
Background technology
Currently, virtual reality experience mode is varied, panorama sketch is most direct at present, most intuitively, to hardware device
Of less demanding, and can also be by a kind of experience mode of web terminal preview, what it is due to its presentation be panorama fish-eye image, can and
Object interaction in picture becomes urgent demand, these hot spots that can be interacted need artificial addition, each hot spot letter at present
Interest statement is solely edited, and workload is cumbersome, and due to manually participating in, location information is inevitably inaccurate.The present invention is to solve this problem,
Hot spot can be interacted according to the generation of scene location information automation, it is automatic to fill interaction point information, system is managed by background information,
By object and commodity, commodity and merchandise news, merchandise news and hot spot, unified management, automation reduction generate.
Invention content
The present invention to solve above-mentioned technical problem and the technical solution adopted is that provide a kind of model space position capture and
Hot spot automatically generates processing system, solves the artificial addition panorama hot information inconvenience brought and the mistake easily occurred, automation
Panorama hot information is added, it is convenient, efficiently, wherein specific technical solution is：
Including being used to collected group picture being fused into complete panoramic picture, including record all hot spot positions in each scene
Set coordinate information and the hotspot database to model object parameter；The panoramic picture that splicing is completed, is shown by panoramic picture
The hot information recorded in database is reverted in panoramic picture, utilizes demonstration tool by tool, you can hot spot interacts.
Above-mentioned model space position capture and hot spot automatically generate processing system, wherein are automated based on panoramic picture
The virtual reality of acquisition hot spot manages network system realization：The first step, what is made by 3D scene simulation tools
In scene, the hot information of record can be saved in database and is supplied follow-up panorama sketch by automatically scanning by interactive hot spot model
As demonstration tool post-processing uses；Multiple local pictures being collected have been fused to by second step by acquiring image photograph
The whole big figures of flake panorama CUBE, by simultaneously treated, image preserves；Third walks, by hotspot database to the position of equipment with
Parameter carries out typing and editor, and hotspot database includes that three-dimensional localization point and two-dimentional tracking point, three-dimensional localization point are attached to three
N-dimensional sphere n model surface is for preserving hot spot serial number and spatial coordinated information, the technical parameter information of two-dimentional tracking point record hot spot
And the two-dimensional coordinate correspondence that can track the generation of three-dimensional localization spot projection is shown that treated, and hot spot data passes through JSON lattice
Formula inputs three-dimensional reconstruction textures module, and the textures address and all hot spots for corresponding to scene are recorded in each JSON formatted files
Coordinate and technical parameter information.
Above-mentioned model space position capture and hot spot automatically generate processing system, wherein the three-dimensional reconstruction textures mould
Block includes the two-dimensional layer for being responsible for display hot spot parameters information and the three-dimension layer for being responsible for display panoramic picture Sphere Measurement Model；Described
Hotspot database includes three-dimensional localization point and two-dimentional tracking point, and three-dimensional localization point is attached to panoramic picture Sphere Measurement Model surface use
In preserving hot spot serial number and spatial coordinated information, two-dimentional tracking point, which records the technical parameter information of hot spot and can track three-dimensional, to be determined
The two-dimensional coordinate correspondence that site projection generates is shown.
Above-mentioned model space position capture and hot spot automatically generate processing system, wherein are adopted automatically based on panoramic picture
The fusion for collecting the virtual reality management system diagram picture of hot information uses OpenCV shape libraries, and collected picture is first into professional etiquette
The renaming of generalized, and Feature point recognition matching is carried out to adjacent image, it is finally mapped as suitable for the complete complete of spherical surface textures
Scape textures are automatically performed reconstruction by three-dimensional reconstruction textures module.
The present invention has the advantages that compared with the existing technology：The present invention provides a kind of model space position captures
And hot spot automatically generates processing system, is a kind of based on having the 3D scene simulation tools for rendering multi-view image, it is full-automatic to capture
3D contextual datas, the key messages such as record cast position, size generate visual angle flat image or panorama fish eye images photo, warp
Post-processing is crossed, addition reduction commodity can interact hot spot data information, cross-platform panorama sketch preview tool are output to, at other
Terminal (PC, mobile terminal, virtual reality experience equipment VR glasses) platform preview provides the technical solution and operation stream of convenient and efficient
Journey.The present invention can be added and compile to panoramic picture hot information under the premise of automation collection hot spot key message
Volume, the flow of automation makes the acquisition of panoramic picture hot spot in maintenance, operation and using more convenient, efficient.
Description of the drawings
Fig. 1 is overall structure module block diagram.
Fig. 2 is the displaying principle schematic diagram that hot spot is located at screen prjection rectilinear direction.
Specific implementation mode
The invention will be further described with reference to the accompanying drawings and examples.
3D scene simulations tool (such as AutoDesk 3DMax, Maya；3D emulation tools based on game engine
Illusory 4 engines of UnrealEngine4, Unity3D engines etc.) by technological accumulation and development for many years, can it lead at present
Definition 3D scenes and model structural data are crossed, the position of true environment, angle, viewpoint etc. are simulated；With the development of technology, more next
More physical third dimensions can be by really being experienced, such as gravitational effects, model in the virtual scene of simulation
Texture true to nature, real illumination and shade etc.；The visual angle of screen as video camera camera lens, in current most of 3D emulation tools
In, the image information of viewing visual angle can be rendered, the fish-eye image of the panoramic picture even directly acquired.
The acquisition mode of the fish-eye image of panoramic picture can be divided into plan view acquisition according to camera lens difference and fish-eye image acquires.Fish
Glasses head advantage is：Great visible angle can enable collector that the spelling of panorama sketch can be completed with less number of pictures
It connects, usual fish-eye edge distortion distortion is higher than more serious and camera lens cost, but interacts field in the 3D made
Jing Zhong, due to comprising 3D data informations all in the scene, can be readily available by the switching of viewpoint plane and
Sound image.
3D roaming interactions there are while various limitations, experience excellent as the 3D interaction solutions of lightweight by panoramic picture
Gesture is further apparent, and panoramic picture can easily realize that the ends PC, the cross-platform preview of mobile terminal, hardware are set by WEB technologies
Low for requiring, operation is smooth, has the features such as 3D hot spots interaction.
To achieve the goals above, the present invention is based on the virtual reality of three-dimensional panoramic image manage system, including be used for by
Collected group picture is fused into complete panoramic picture, records in each scene all hotspot location coordinate informations and to model object
The hotspot database of (commodity) parameter.The panoramic picture that finally splicing is completed, by panoramic picture demonstration tool, by database
The hot information of middle record reverts in panoramic picture, utilizes demonstration tool, you can hot spot interacts.
The present invention is based on the virtual realities of panoramic picture automation collection hot spot to manage network system realization：
The first step, in the scene made by 3D scene simulation tools, automatically scanning can be by interactive heat
The hot information of record is saved in database and is used for follow-up panoramic picture demonstration tool post-processing by point model (commodity)；
Multiple local pictures being collected are fused to complete flake panorama by second step by acquiring image photograph
The big figures of CUBE, by simultaneously treated, image preserves；
Third walks, and carries out typing with parameter to the position of equipment by hotspot database and editor, hotspot database include
Three-dimensional localization point and two-dimentional tracking point, three-dimensional localization point are attached to three-dimensional sphere model surface for preserving hot spot serial number and sky
Between coordinate information, the technical parameter information of two-dimentional tracking point record hot spot simultaneously can track the two dimension that three-dimensional localization spot projection generates
Coordinate pair should be shown that treated, and hot spot data inputs three-dimensional reconstruction textures module, each JSON lattice by JSON formats
The textures address of corresponding scene and the coordinate and technical parameter information of all hot spots are recorded in formula file；
The three-dimensional reconstruction textures module includes being responsible for the two-dimensional layer of display hot spot parameters information and being responsible for display entirely
The three-dimension layer of scape image Sphere Measurement Model；The hotspot database includes three-dimensional localization point and two-dimentional tracking point, three-dimensional localization
Point is attached to panoramic picture Sphere Measurement Model surface and records hot spot for preserving hot spot serial number and spatial coordinated information, two-dimentional tracking point
Technical parameter information and can track three-dimensional localization spot projection generation two-dimensional coordinate correspondence shown.
Further, the present invention is based on the virtual realities of panoramic picture automatic collection hot information to manage melting for system diagram picture
It closes and uses OpenCV shape libraries, the renaming that collected picture standardizes first, and characteristic point is carried out to adjacent image
Identification matching, is finally mapped as the complete panorama textures suitable for spherical surface textures, can be automatic by three-dimensional reconstruction textures module
It completes to rebuild, it is easy to operate without artificial setting.
The present invention relates to when a kind of Computerized three-dimensional scene rendering model space position capture and hot spot automatically generate place
Reason system, the realization approach of automation so that panorama sketch collection of material, addition article merchandise news (word, picture, hyperlink)
It is efficiently convenient.The virtual reality of automation manages system, ensures information unification, and data flow is coherent, and intermediate prosthetic changes link,
So that information existence, management, displaying and follow-up editor update are accomplished without any letup.By virtual three-dimensional coordinate system in 3D emulation tools
In object space be converted to the launching position corresponded in panorama sketch in panorama fish-eye image.
Although the present invention is disclosed as above with preferred embodiment, however, it is not to limit the invention, any this field skill
Art personnel, without departing from the spirit and scope of the present invention, when can make a little modification and it is perfect, therefore the present invention protection model
It encloses to work as and is subject to what claims were defined.
Claims (4)
1. a kind of model space position capture and hot spot automatically generate processing system, it is characterised in that：Including being used to collect
Group picture be fused into complete panoramic picture, including record in each scene all hotspot location coordinate informations and model object joined
Several hotspot databases；The panoramic picture that splicing is completed, by panoramic picture demonstration tool, the hot spot that will be recorded in database
Information reverts in panoramic picture, utilizes demonstration tool, you can hot spot interacts.
2. model space position capture as described in claim 1 and hot spot automatically generate processing system, which is characterized in that be based on
The virtual reality of panoramic picture automation collection hot spot manages network system realization：The first step is passing through 3D scene simulation works
Have in the scene made, the hot information of record can be saved in data by automatically scanning by interactive hot spot model
Library is used for follow-up panoramic picture demonstration tool post-processing；Second step, by acquiring image photograph, multiple offices that will be collected
Portion's photo is fused to the big figures of complete flake panorama CUBE, and by simultaneously treated, image preserves；Third walks, and passes through hotspot database
Typing and editor are carried out to the position and parameter of equipment, hotspot database includes three-dimensional localization point and two-dimentional tracking point, three-dimensional
Anchor point is attached to three-dimensional sphere model surface and records hot spot for preserving hot spot serial number and spatial coordinated information, two-dimentional tracking point
Technical parameter information and the two-dimensional coordinate correspondence of three-dimensional localization spot projection generation can be tracked shown, treated hot spot
Data input three-dimensional reconstruction textures module by JSON formats, and the textures address of corresponding scene is recorded in each JSON formatted files
And the coordinate and technical parameter information of all hot spots.
3. model space position capture as claimed in claim 2 and hot spot automatically generate processing system, it is characterised in that：It is described
Three-dimensional reconstruction textures module includes being responsible for the two-dimensional layer of display hot spot parameters information and being responsible for showing panoramic picture Sphere Measurement Model
Three-dimension layer；The hotspot database includes that three-dimensional localization point and two-dimentional tracking point, three-dimensional localization point are attached to panorama sketch
As Sphere Measurement Model surface is for preserving hot spot serial number and spatial coordinated information, the technical parameter information of two-dimentional tracking point record hot spot
And the two-dimensional coordinate correspondence that can track the generation of three-dimensional localization spot projection is shown.
4. model space position capture as claimed in claim 3 and hot spot automatically generate processing system, it is characterised in that：It is based on
The fusion of the virtual reality management system diagram picture of panoramic picture automatic collection hot information uses OpenCV shape libraries, collected
The renaming that picture standardizes first, and Feature point recognition matching is carried out to adjacent image, it is finally mapped as being suitable for ball
The complete panorama textures of Face Map are automatically performed reconstruction by three-dimensional reconstruction textures module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810009523.0A CN108280873A (en) | 2018-01-05 | 2018-01-05 | Model space position capture and hot spot automatically generate processing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810009523.0A CN108280873A (en) | 2018-01-05 | 2018-01-05 | Model space position capture and hot spot automatically generate processing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108280873A true CN108280873A (en) | 2018-07-13 |
Family
ID=62803220
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810009523.0A Pending CN108280873A (en) | 2018-01-05 | 2018-01-05 | Model space position capture and hot spot automatically generate processing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108280873A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109272451A (en) * | 2018-08-24 | 2019-01-25 | 中国电力工程顾问集团西南电力设计院有限公司 | A method of the displaying of converter station panorama is carried out based on threedimensional model |
| CN110047035A (en) * | 2019-04-15 | 2019-07-23 | 深圳市数字城市工程研究中心 | Panoramic video hotspot interaction system and interaction equipment |
| CN110334139A (en) * | 2018-12-18 | 2019-10-15 | 济南百航信息技术有限公司 | A method of third party system data are docked by simulated operation |
| CN110796002A (en) * | 2019-09-23 | 2020-02-14 | 苏州光格设备有限公司 | Method and system for automatically generating panoramic image containing hot spot information |
| CN110955981A (en) * | 2019-12-16 | 2020-04-03 | 北京朗信智能科技有限公司 | Modeling method for loading site |
| CN111783014A (en) * | 2020-06-30 | 2020-10-16 | 北京百度网讯科技有限公司 | Image acquisition method, device, equipment and storage medium |
| CN112818194A (en) * | 2020-12-04 | 2021-05-18 | 佛山欧神诺云商科技有限公司 | Hot spot generation method and equipment for home decoration panorama and storage medium |
| CN112989063A (en) * | 2021-03-10 | 2021-06-18 | 青岛弯弓信息技术有限公司 | 3D modeling method and system based on knowledge graph |
-
2018
- 2018-01-05 CN CN201810009523.0A patent/CN108280873A/en active Pending
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109272451A (en) * | 2018-08-24 | 2019-01-25 | 中国电力工程顾问集团西南电力设计院有限公司 | A method of the displaying of converter station panorama is carried out based on threedimensional model |
| CN110334139A (en) * | 2018-12-18 | 2019-10-15 | 济南百航信息技术有限公司 | A method of third party system data are docked by simulated operation |
| CN110047035A (en) * | 2019-04-15 | 2019-07-23 | 深圳市数字城市工程研究中心 | Panoramic video hotspot interaction system and interaction equipment |
| CN110796002A (en) * | 2019-09-23 | 2020-02-14 | 苏州光格设备有限公司 | Method and system for automatically generating panoramic image containing hot spot information |
| CN110955981A (en) * | 2019-12-16 | 2020-04-03 | 北京朗信智能科技有限公司 | Modeling method for loading site |
| CN110955981B (en) * | 2019-12-16 | 2023-08-22 | 北京朗信智能科技有限公司 | On-site modeling method for loading |
| CN111783014A (en) * | 2020-06-30 | 2020-10-16 | 北京百度网讯科技有限公司 | Image acquisition method, device, equipment and storage medium |
| CN112818194A (en) * | 2020-12-04 | 2021-05-18 | 佛山欧神诺云商科技有限公司 | Hot spot generation method and equipment for home decoration panorama and storage medium |
| CN112989063A (en) * | 2021-03-10 | 2021-06-18 | 青岛弯弓信息技术有限公司 | 3D modeling method and system based on knowledge graph |
| CN112989063B (en) * | 2021-03-10 | 2023-02-10 | 青岛弯弓信息技术有限公司 | 3D modeling method and system based on knowledge graph |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108280873A (en) | Model space position capture and hot spot automatically generate processing system | |
| CN104268939B (en) | Transformer substation virtual-reality management system based on three-dimensional panoramic view and implementation method of transformer substation virtual-reality management system based on three-dimensional panoramic view | |
| EP3690815B1 (en) | Method, medium and apparatus for automatically labeling target object within image | |
| CN112053446B (en) | Real-time monitoring video and three-dimensional scene fusion method based on three-dimensional GIS | |
| CN108919944B (en) | Virtual roaming method for realizing data lossless interaction at display terminal based on digital city model | |
| US11978243B2 (en) | System and method using augmented reality for efficient collection of training data for machine learning | |
| CN106097435A (en) | A kind of augmented reality camera system and method | |
| CN103679204A (en) | Image identification and creation application system and method based on intelligent mobile device platform | |
| WO2023280038A1 (en) | Method for constructing three-dimensional real-scene model, and related apparatus | |
| CN105205853A (en) | 3D image splicing synthesis method for panoramic view management | |
| CN110544314B (en) | Fusion method, system, medium and equipment of virtual reality and simulation model | |
| CN101414383A (en) | Image processing apparatus and image processing method | |
| WO2009093136A2 (en) | Image capture and motion picture generation | |
| EP4111677B1 (en) | Multi-source image data synchronization | |
| CN111223190A (en) | Processing method for collecting VR image in real scene | |
| Suenaga et al. | A practical implementation of free viewpoint video system for soccer games | |
| CN107066605A (en) | Facility information based on image recognition has access to methods of exhibiting automatically | |
| CN113253842A (en) | Scene editing method and related device and equipment | |
| CN112102490A (en) | Modeling method for three-dimensional model of transformer substation | |
| US20230013009A1 (en) | Computing illumination of an elongated shape having a noncircular cross section | |
| CN213126248U (en) | Intelligent interaction system for metro vehicle section construction site and BIM scene | |
| CN108346183A (en) | A kind of method and system for AR origin reference locations | |
| CN114332356A (en) | Virtual and real picture combining method and device | |
| Wang et al. | Real‐time fusion of multiple videos and 3D real scenes based on optimal viewpoint selection | |
| KR102654323B1 (en) | Apparatus, method adn system for three-dimensionally processing two dimension image in virtual production |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180713 |
|
| WD01 | Invention patent application deemed withdrawn after publication |