CN105183823B - A kind of interactive exhibition system of virtual objects and live-action image - Google Patents

Abstract

The invention discloses the interactive exhibition systems of a kind of virtual objects and live-action image, including data management layer, processing computation layer and interactive display layer；It is equipped with live-action image database, live-action image spatial description information database, entity space description information database, virtual object space description information database and virtual object data library in data management layer, three-dimensional interactive presentation engine is equipped in interactive display layer；It handles computation layer and one object space of structure in the virtual three-dimensional space of its built in advance is calculated by the spatial alternation to several virtual objects, live-action image object and correspondent entity space, the information of virtual objects is obtained into the pretreatment display data of virtual objects with its spatial description information MAP to object space, by the information of live-action image object to obtain the pretreatment display data of live-action image object in its spatial description information MAP to the object space, and displaying is overlapped and synthesizes in the three-dimensional interactive operates engine.

Description

A kind of interactive exhibition system of virtual objects and live-action image

Technical field

The present invention relates to the interactive exhibition systems of a kind of virtual objects and live-action image.

Background technology

Currently, there are two main classes for the method for asset entity in record physical surroundings, one kind is using digital imagery means The various static live-action images or dynamic live-action image data of record, another kind of is then to be recorded in the abstractdesriptions method such as word The information of asset entity.

Two kinds of means cut both ways, and live-action image means can be completely restored to visual information, but can not show asset entity, patrol The information of the live-action images behinds such as volume region, and lack space correlation information between multiple two-dimentional live-action images, to will be live All live-action images mark association corresponding with the abstractdesription informative of asset entity of record, it would be desirable to find asset entity Position incidence relation in all live-action images, after the quantity of asset entity and live-action image reaches certain amount grade, this It will be a complexity and be difficult to the work accurately implemented.

This makes some carry out the business with physical surroundings tight association, the integration of information with it is intuitive demonstrate one's ability by Limitation, such as asset management, rapid field environment information acquisition and regression analysis, remote monitoring, entity space Information Sharing are arrived Etc. application fields, live-action image data and asset entity data separating can only be shown at present, or by a large amount of manual calibrations, one One corresponds to mark, once asset entity physical location changes, handles live-action image and asset entity information labeling again Process just becomes complicated, and its production effect and efficiency place one's entire reliance upon the ability of operating personnel, and controllability is poor, so this Often quantities is great for the development of class business, of a high price, it is more difficult to universal to implement.It is real additionally, due to extensive assets are difficult to The association of body and live-action image shows that the know-how and subjective dependency degree to traffic operation staff are all higher, even if system is built At use cost is also very high.

Invention content

The purpose of the invention is to overcome the deficiencies of the prior art and provide a kind of interaction of virtual objects and live-action image Display systems can be to virtual objects by by virtual objects and live-action image object map to the same object space Corresponding entity space carries out the visualized management of augmented reality, show asset entity corresponding to virtual objects entity Information in space, the absolute spatial position that user requires no knowledge about the asset entity corresponding to virtual objects can be to assets reality Body is managed, and the location register of the asset entity corresponding to virtual objects and becomes more convenient, can will be corresponding to virtual objects The information of asset entity and its image of entity space at place carry out unified management and displaying, pass through the phase being easy to understand To the description information of spatial position, the data such as entity space description information are automatically real by the assets corresponding to virtual objects Body is associated displaying with entity space and live-action image object, avoids the triviality that position marks on live-action image object, The problems such as repeatability and the management complexity of information change, improve feasibility, manageability and economy that related service is carried out.

Realizing a kind of technical solution of above-mentioned purpose is：A kind of interactive exhibition system of virtual objects and live-action image, packet Include data management layer, processing computation layer and interactive display layer；

It is empty that live-action image database, live-action image spatial description information database, entity are equipped in the data management layer Between description information database, virtual object space description information database and virtual object data library, in the interactive display layer Equipped with three-dimensional interactive presentation engine；

Record has the spatial description information of each live-action image object, the void in the live-action image spatial description information bank Intend recording the spatial description information for there are each virtual objects in object space description information library, in entity space description information library Record has the spatial description information of each entity space；

Described one virtual three-dimensional space of processing computation layer built in advance, to from the live-action image spatial description information data The space read in library, the virtual object space description information database and the entity space description information database Description information carries out the transformation calculations of spatial shape, is put into the virtual three-dimensional space, structure one is for finally showing use Object space；

Relative tertiary location of the processing computation layer according to any one of virtual objects in its affiliated partner, obtains To the virtual objects in corresponding entity space relative tertiary location, and obtain the virtual objects in turn in the object space In relative tertiary location；

The processing computation layer obtains virtual objects by the mapping of the information and the object space of the virtual objects Pretreatment display data；By the mapping of the information and the object space of the live-action image object, live-action image is obtained The pretreatment display data of object；

The pretreatment display data of the three-dimensional interactive presentation engine setting virtual objects is in virtual objects displaying figure layer It has been shown that, the pretreatment display data for setting live-action image object shown in live-action image displaying figure layer, and by the void Quasi- object display diagram stacking is added on the live-action image displaying figure layer, is shown.

Further, it is equipped in the processing computation layer：

For from the live-action image spatial description information database, entity space description information database, virtual objects Spatial description information is read in spatial description information database and carries out the spatial description information reading module of Data Format Transform；

Virtual three-dimensional space described in built in advance, and to the spatial description information reading module read spatial description information into Row spatial position is calculated builds the object space with spatial shape transformation, and according to any one of virtual objects in Qi Guan Join the relative tertiary location in object, finally obtains the space of relative tertiary location of the virtual objects in the object space Information computational module；

For reading the information of the virtual objects from the virtual object data library, and it is processed into virtual objects Standardized information virtual objects information reading module；

Information for reading the live-action image object from the live-action image database, and it is processed into outdoor scene The outdoor scene read module of the standardized information of imaged object；

For calling the correlation space description information for calling the object space in middleware from the spatial transformation information, And the standardized information of the virtual objects is read, and according to the correlation space description information of the object space to described virtual The standardized information of object carries out geometric transformation, to the correspondence position for making the virtual objects be mapped in the object space It sets, to form the virtual object space display module of the pretreatment display data of virtual objects；

For calling the correlation space description information for calling the object space in middleware from the spatial transformation information, And the standardized information of the live-action image object is read, and according to the correlation space description information of the object space to described The standardized information of live-action image object carries out geometric transformation, to make the live-action image object map to the object space In corresponding position, with formed live-action image object pretreatment display data Imaging space display module.

Further, the spatial transformation information is called in middleware and is additionally provided with spatial alternation algorithms library, the space Information computational module is carrying out spatial shape change to the virtual objects, the live-action image object and the entity space It changes, determine position in the virtual three-dimensional space of the virtual objects and the live-action image and builds the object space Afterwards, corresponding spatial alternation algorithm is called from the spatial alternation algorithms library, carries out the transformation of spatial shape, obtains the void Quasi- relative tertiary location and spatial shape data of the object in the object space.

Further, the spatial alternation algorithm in the spatial alternation algorithms library includes that GIS coordinates turn three-dimensional coordinate calculation Method, left hand/right hand three-dimensional coordinate mutually turn algorithm, and spherical model becomes scaling method, camera lens perspective distortion algorithm.

Further, the spatial transformation information calls middleware to be additionally provided with conversion proportion ruler demarcating module, described turn It includes for carrying out two-way communication with the spatial alternation algorithms library, calculating under setting ratio ruler, no to change engineer's scale demarcating module Isospace become scaling method under, spatial alternation as a result, and for the spatial information computing module when carrying out spatial alternation calculating The background processing module of calling, and for realizing spatial alternation algorithms selection, engineer's scale inputs numerical value selection, spatial alternation is calculated Method is the results show that a variety of spatial alternation arithmetic result comparisons and the manual setting of engineer's scale input numerical value under setting ratio ruler Engineer's scale condition entry and result display module, the background processing module connects engineer's scale database.

Further, the spatial transformation information calls middleware to be additionally provided with format conversion and type judging module and retouch Information association algorithm information library is stated, the format conversion judges that the spatial description information reading module is read with type judging module The data format of the spatial position description information taken calls corresponding data format to turn from the description information association algorithm information bank The algorithm changed returns to the spatial description information reading module after carrying out Data Format Transform.

Further, the spatial transformation information, which is called, is additionally provided with spatial-attribute mutual query retrieval module in middleware, use Virtual objects in the retrieval object space or live-action image object.

Further, any one live-action image pair of the three-dimensional interactive presentation engine corresponding to the object space As position of the shooting point in the object space, virtual camera is set up, and by setting up void in the virtual camera Virtual objects display diagram stacking is added on the live-action image displaying figure layer, and is rendered and synthesized by quasi- viewport Displaying.

Further, two-way communication can be carried out with the three-dimensional interactive presentation engine by being additionally provided in the interaction display layer User interaction operate interface and third party call control interface, for receiving operational order, realize and described realize the outdoor scene The fusion of imaged object, the entity space and the virtual objects is shown, and carries out two-way interaction.

Further, it in the data management layer, is additionally provided with to the virtual object space description information database and institute State virtual object data library into edlin and verification virtual objects information editing's module, to the entity space description information number According to library into the spatial object editor module of edlin and verification, and it is empty to the live-action image database and the live-action image Between description information database into edlin and verification live-action image editor module.

Use the technical solution of a kind of virtual objects of the present invention and the interactive exhibition system of live-action image, including data Management level, processing computation layer and interactive display layer；Live-action image database, live-action image space are equipped in the data management layer Description information database, entity space description information database, virtual object space description information database and virtual objects number According to library, three-dimensional interactive presentation engine is equipped in the interactive display layer；The processing computation layer by several virtual objects, Live-action image object and the spatial alternation in correspondent entity space build a target empty in the virtual three-dimensional space of its built in advance Between, a virtual objects are selected in the object space, obtain space of the virtual objects in the object space Position；The information of the virtual objects is mapped to the pretreatment display data that virtual objects are obtained in the object space, by institute It states in the information MAP to institute's object space of live-action image object and obtains the pretreatment display data of live-action image object, institute State three-dimensional interactive presentation engine by the pretreatment display data of virtual objects be added to live-action image object pretreatment show number On, synthesis displaying is carried out.It has the technical effect that：Visualization pipe can be carried out to the asset entity corresponding to virtual objects Reason, show virtual objects corresponding to asset entity entity space in relative tertiary location and spatial shape, user is not Need to know that the absolute spatial position of the asset entity corresponding to virtual objects can be managed location register to asset entity And change.

Description of the drawings

Fig. 1 is the structural schematic diagram of a kind of virtual objects of the present invention and the interactive exhibition system of live-action image.

Fig. 2 is that the spatial transformation information in a kind of virtual objects of the present invention and the interactive exhibition system of live-action image is called The structural schematic diagram of middleware.

Fig. 3 is the flow chart of a kind of virtual objects of the present invention and the interaction display method of live-action image.

Live-action image database 11, live-action image spatial description information database 12, entity space description information database 13, virtual object space description information database 14 and virtual object data library 15, spatial transformation information calls middleware 2, empty Quasi- object information read module 31, outdoor scene read module 32, virtual object space maps display module 41, Imaging space maps exhibition Show module 42, interactive operation display module 5.

Specific implementation mode

Referring to Fig. 1, the present inventor in order to preferably understand technical scheme of the present invention, is led to below Specifically embodiment is crossed, and is described in detail in conjunction with attached drawing：

Referring to Fig. 1, the interactive exhibition system of a kind of virtual objects and live-action image of the present invention, is equipped with data management Layer, processing computation layer and interactive display layer.Five databases are provided in the wherein described data management layer altogether：Live-action image number According to library 11, live-action image spatial description information database 12, entity space description information database 13, virtual object space description Information database 14 and virtual object data library 15.It is equipped with spatial transformation information in the processing computation layer and calls middleware 2, it is empty Quasi- object information read module 31, outdoor scene read module 32, virtual object space map display module 41 and Imaging space mapping Display module 42.Interactive operation display module 5 is equipped in the interactive display layer.

Wherein live-action image spatial description information database 12, entity space description information database 13, virtual objects are empty Between description information database 14 simultaneously with spatial transformation information call middleware 2 carry out two-way communication；Live-action image database 11 Two-way communication is carried out with outdoor scene read module 32；Virtual object data library 15 carries out two-way with virtual objects information reading module 31 Communication；Virtual object space maps display module 41 and spatial transformation information calls middleware 2 and virtual objects information to read Module 31 carries out two-way communication, and Imaging space maps display module 42 and outdoor scene read module 32 and spatial transformation information tune Two-way communication is carried out with middleware 2.Interactive operation display module 5 maps display module 41 and outdoor scene with virtual object space Space reflection display module 42 carries out two-way communication.

Every records the spatial description information for all pointing to an entity space in entity space description information database 13, i.e., The description information of the description information of the spatial position of the entity space and the spatial shape of the entity space.The entity space both may be used Can also be three dimensional closure space to be two-dimensional closed space.Every records all extremely in entity space description information database 13 Few includes being equipped with to record following content field：

The unique mark of the entity space.

Used space type when being described to entity space progress spatial position, i.e., used coordinate system, such as GIS coordinates, three-dimensional coordinate etc..

Used data format when spatial shape describes carried out to the entity space, for example, DWG formats, JSON formats or Person's XML format etc..

The specific spatial description information of the entity space, either be made of several fields in this records one Group data, can also be the link of an inwardly directed file；Or the link of a direction external file, that is, it quotes, for sky Between information converting call middleware 2 retrieved, read, called and calculated.

The spatial position description information of opposite father's entity space of the entity space：I.e. to entity space level-one on it The description information of relative tertiary location in father's entity space.

The spatial position description of association father's entity space of the entity space, that is, judge whether the entity space has upper level Father's entity space, and provide link when the entity space has upper level father's entity space.

Every record all can also be equipped with the field for recording following content in entity space description information database 13：

Used linear module when being described to entity space progress spatial position and spatial shape.

Used orientation and inclination angle when being described to entity space progress spatial position and spatial shape.

Every in virtual object data library 15 records the information for all pointing to a virtual objects, each virtual objects with One asset entity corresponds to, and every record in virtual object data library 15 is all at least provided with the field for recording following content：

The unique mark of the virtual objects.

The type of the virtual objects.

The attribute of the virtual objects.

The specifying information of the virtual objects, the specific data can be made of in this records several fields One group of data can also be the link of an external file of the specifying information for recording the virtual objects, that is, it is virtual to be directed toward this The reference of object for the retrieval of virtual objects information reading module 31, is read and is called.

Record in virtual object space description information database 14 and the record in virtual object data library 15 are one by one Corresponding, i.e., every in virtual object space description information database 14 records the spatial description for all pointing to a virtual objects Information, the i.e. description information of the spatial shape of the description information and virtual objects of the spatial position of the virtual objects, virtually Every record in object space description information database 14 is all at least provided with the field for recording following content：

The unique mark of the virtual objects.

Used space type when being described to virtual objects progress spatial position, i.e., used coordinate system, such as GIS coordinates, three-dimensional coordinate etc..

Used data format when spatial shape describes carried out to the virtual objects, for example, DWG formats, JSON formats or Person's XML format etc..

The specific spatial description information of the virtual objects, especially having recorded this virtual objects can be associated with by other virtual objects Spatial description information.

The virtual object space description information itself either in this records one group of data being made of several fields, It can also be the link of inwardly directed file or the link of a direction external file, that is, quote, so that spatial alternation is believed Breath calls middleware 2 to be retrieved, read, called and calculated.

The spatial position of opposite father's virtual objects of the virtual objects describes, i.e., to the virtual objects, level-one father is empty on it The description information of relative tertiary location in quasi- object.

The spatial position in the associated entity space of the virtual objects describes, i.e., does not have upper level father virtual in the virtual objects When object, the description information of relative tertiary location of the virtual objects in corresponding entity space is recorded, and establish and arrive the reality The link in body space.

Every record in virtual object space description information database 14 is also provided with the word for recording following content Section：

Used linear module when being described to virtual objects progress spatial position and spatial shape.

Used orientation and inclination angle when being described to virtual objects progress spatial position and spatial shape.

Every record in live-action image database 11 is directed toward the information of a live-action image object and should include at least The field for recording following content, so that outdoor scene read module 32 calls：

The unique mark of the live-action image object.

Type of the live-action image object, such as photo, image or outdoor scene etc..

Data format of the live-action image object, such as JPG formats, AVI format or FLV formats etc..

Can also include the field for recording following content in every record in live-action image database 11：

Lens type used by the live-action image object.

Distortion correction used by the live-action image object identifies.

The visual angle size of the live-action image object.

Record in live-action image spatial description information database 12 and the record in live-action image database 11 are one by one Corresponding, i.e., every record in live-action image spatial description information database 12 also all points to a live-action image object, note Carry the spatial description information there are one live-action image object, i.e., with the description information of the spatial position of a live-action image object and The description information of spatial shape.

Every record in live-action image spatial description information database 12 all includes at least fields：

The unique mark of the live-action image object.

The unique mark of all virtual objects included in the live-action image object establishes the live-action image object and void Correspondence between quasi- object.

Used space type when spatial position describes, i.e., used coordinate class are carried out to the live-action image object Type, such as GIS coordinates, three-dimensional coordinate etc..

Used data format when spatial shape describes, such as JSON formats, XML lattice are carried out to the live-action image object Formula etc..

The unique mark of entity space corresponding to the live-action image object, i.e. institute included in the live-action image object There is the unique mark of all entity spaces where entity space and the live-action image object.

The specific spatial description information of the live-action image object can be several fields composition in this records One group of data, can also be the internal links of the spatial description information for recording the live-action image object, i.e. file, or Person's external linkage, that is, quote, so that spatial transformation information calls the retrieval of middleware 2, reading, calling and calculates.

Every record in live-action image spatial description information database 12 can also include fields：

Used linear module when being described to live-action image object progress spatial position and spatial shape；

Used orientation and inclination angle etc. when being described to live-action image object progress spatial position and spatial shape.

In live-action image spatial description information database 12, virtual object space description information database 14 and entity space In all records in description information database 13, in the case of the space type and data uniform format that use, above-mentioned number Field according to the linear module in library all can be sky.

Virtual three-dimensional space there are one spatial transformation information calling middleware 2 is built-in.Spatial transformation information is called intermediate Part 2 finds the unique mark of corresponding virtual objects, and in reality according to the asset entity specified by interactive operation display module 5 It finds in scape image space description information database 12 and believes with the spatial description of the live-action image object corresponding to the virtual objects Breath, according to the unique mark of the entity space corresponding to above-mentioned live-action image object, is looked for from entity space description information library 13 To the spatial description information with the entity space corresponding to above-mentioned live-action image object, space is carried out to above-mentioned spatial description information It after the transformation of position and spatial shape, is put into the virtual three-dimensional space, foundation, which is available on display terminal 900, carries out interaction The object space of displaying.Spatial transformation information calls middleware 2, also can be according to the outdoor scene specified by interactive operation display module 5 Imaged object finds the spatial description information of corresponding live-action image object in live-action image spatial description information database 12, The unique mark of entity space corresponding to the live-action image object finds and is somebody's turn to do from entity space description information library 13 It is all virtual corresponding to the spatial description information of entity space corresponding to live-action image object and the live-action image object It is all to find that the live-action image object included in virtual object space description information database 14 for the unique mark of object Above-mentioned spatial description information is put into the virtual three-dimensional space by the spatial description information of virtual objects, carries out spatial position After the transformation of spatial shape, the object space for being available in and carrying out interaction display on display terminal 900 is established.

Spatial transformation information calls middleware 2, and it is virtual right to find this in virtual object space description information database 14 The description information of the spatial description information of elephant, the virtual object space position can be described based on GIS coordinates, Ke Yishi It is described, can be described based on linear module based on three-dimensional coordinate, or described based on inclination angle and orientation, And the spatial position description information described based on the spatial position coordinate of other standards.Spatial transformation information calls middleware 2 search simultaneously the virtual objects on it in level-one father virtual objects relative tertiary location description information, in the virtual objects The description information that virtual objects relative tertiary location in corresponding entity space is searched when no upper level father virtual objects, from And determine relative tertiary location of the virtual objects in the object space.

That is the virtual objects specified according to interactive operation display module 5, spatial transformation information call middleware 2 logical It crosses the unique mark of the virtual objects, the note of the virtual objects is searched in virtual object space description information database 14 Record, after obtaining the description information of relative tertiary location of the virtual objects in its affiliated partner, carries out the virtual objects step by step The iteration of relative tertiary location and cumulative, finally obtains relative tertiary location of the virtual objects in entity space, to really Fixed relative tertiary location of the virtual objects in the object space.

It is based on by live-action image spatial description information that spatial transformation information, which calls the object space to be established of middleware 2, The spatial description information of several live-action image objects recorded in database 12 and the institute of several live-action image objects What the spatial description information of common associated entity space was established, it is different in entity space description information database 13 by reading Entity space spatial description information, the form and position relationship of the object space can change.

Spatial transformation information calls middleware 2 that can also pass through multiple independent, the sky for the entity space object that is mutually related Between description information, establish a big complete object space.

Spatial transformation information calls middleware 2 to comprise the following modules：Spatial description information reading module 21, spatial information meter It calculates module 22, space information retrieval enquiry module 23, spatial alternation algorithms library 24, format conversion and type judging module 25, retouch State information association algorithm information library 26, conversion proportion ruler demarcating module 27 and engineer's scale database 28.Wherein conversion proportion ruler mark Cover half block 27 is divided into as background processing module 271 and engineer's scale condition entry and display module 272.

Spatial alternation algorithms library 24 stores various spatial alternation algorithms, as GIS coordinates turn three-dimensional coordinate algorithm, the left hand/right side Hand three-dimensional coordinate mutually turns algorithm, and spherical model becomes scaling method, camera lens perspective distortion algorithm and other third party's algorithms etc..

Algorithm of the description information association algorithm information bank 26 for the Data Format Transform of memory space description information, for lattice Formula is converted to be called with type judging module 25.Spatial description information includes being stored in live-action image spatial description information database 12 The spatial description information of live-action image object, the entity space stored in entity space description information database 13 space retouch State the spatial description information of the virtual objects stored in information and virtual object space description information database 14.

Spatial description information reading module 21 and live-action image spatial description information database 12, entity space description information Database 13 and virtual object space description information database 14 carry out two-way communication, to read live-action image spatial description letter Cease the spatial description in database 12, entity space description information database 13 or virtual object space description information database 14 Information.

Format conversion and type judging module 25 and spatial description information reading module 21 carry out two-way communication, and according to by The spatial description information that spatial description information reading module 21 is read, parses spatial class used by corresponding spatial description information Type and data format extract the algorithm of corresponding Data Format Transform, for space from description information association algorithm information bank 26 Description information read module 21 carries out the conversion of data format.Space type can be used by corresponding spatial description information GIS coordinates, used data format can be JSON formats, DWG formats, XML format etc..Format conversion and type judging module The algorithm of corresponding Data Format Transform is returned to spatial description information reading module 21, spatial description information reading module by 25 Corresponding spatial description information is resolved to the data format that can be called by spatial alternation algorithms library 24 by 21.

Spatial information computing module 22 is built-in there are one virtual three-dimensional space, and spatial information computing module 22 will pass through data The space of the spatial description information of entity space after format conversion, the spatial description information and live-action image object of virtual objects Description information, carry out spatial shape transformation and engineer's scale after reunification, be put into the virtual three-dimensional space, formed for being available in The object space of interaction display is carried out on display terminal 900.

Spatial information computing module 22 is responsible for the calculating of virtual objects relative tertiary location entirely iterated to calculate Journey to obtain relative tertiary location of any one virtual objects in the object space in the object space, and is adjusted Take the spatial alternation algorithm in spatial alternation algorithms library 24 and the engineer's scale in conversion proportion ruler demarcating module 27, step-by-step calculation should Relative tertiary location of the virtual objects in its affiliated partner finally determines that the virtual objects are opposite in the object space Spatial position.

When a virtual objects have upper level father's virtual objects, spatial information computing module 22 calculates a virtual objects Relative tertiary location in upper level father's virtual objects, then step by step iteration and accumulation calculating upper level father's virtual objects at it Relative tertiary location in affiliated partner finally obtains virtual objects relative tertiary location in corresponding entity space, most Relative tertiary location of the virtual objects in the object space is determined afterwards.

Spatial information computing module 22 calls conversion proportion ruler demarcating module 27 to provide by spatial alternation algorithms library 24 Different switching coefficient, so that spatial information computing module 22 iterates to calculate obtained result equivalent to the object space It is interior.

Conversion proportion ruler demarcating module 27 with spatial alternation algorithms library 24 by carrying out two-way communication, to demarcate various skies Between become scaling method between proportionate relationship.Conversion proportion ruler demarcating module 27 passes through background processing module 271 and spatial alternation algorithm Library 24 carries out two-way communication, and engineer's scale condition entry realizes that spatial alternation algorithms selection, engineer's scale are defeated with result display module 272 Enter numerical value selection, spatial alternation arithmetic result is shown, a variety of spatial alternation arithmetic result comparisons and engineer's scale input numerical value The functions such as setting by hand.Background processing module 271 according to input engineer's scale condition entry and result display module 272 data, After being calculated, obtains the result that different spaces become under scaling method and compare exhibition in engineer's scale condition entry and display module 272 Show, provides the foundation of proportionality coefficient formulation to the user, and by engineer's scale database 28, allow users to input, modification or protect It deposits different spaces and becomes specific ratio of the result of scaling method relative to spatial transformation information calling 2 established object space of middleware Numerical value is called for spatial information computing module 22.

Background processing module 271 is responsible for reading engineer's scale input numerical value simultaneously from engineer's scale condition entry and display module 272 Call the spatial alternation algorithm in spatial alternation algorithms library 24 to carry out processing calculating, by result return to engineer's scale condition entry with Display module 272, while it is also responsible for reception space information computational module 22 and is transferred by what spatial alternation algorithms library 24 was sent out Request, and safeguard engineer's scale database 28.

Engineer's scale condition entry provides the interactive interface that one engineer's scale of user calculates with display module 272, realizes space Algorithms selection is converted, engineer's scale inputs numerical value selection, and spatial alternation arithmetic result is shown, a variety of spatial alternation arithmetic results pair Than and ratio value the functions such as manual setting, meet user's operation demand, and interact with background processing module 271, operation is tieed up Protect engineer's scale database 28.

Virtual objects information reading module 31 is read according to the unique mark of virtual objects from virtual object data library 15 The information of corresponding virtual objects, and according to type of the virtual objects, such as picture, video, model, word etc., call corresponding Decoding, processing computational methods, by the contents processing of virtual objects be can be uniformly processed in the object space this virtually The standardized information of object.

Outdoor scene read module 32 reads correspondence according to the unique mark of live-action image object from live-action image database 11 The information of live-action image object, and according to the type of the live-action image object, corresponding decoding, processing computational methods are called, it will The information processing of live-action image object is the standardization letter for the live-action image object that can be uniformly processed in the object space Breath.

The type of live-action image object includes：Digital photograph, video, three-dimensional rendering figure, the digitized videos class such as full-view image Type.The standardized information of live-action image object includes：The lens type of wide-angle, flake, panorama etc. describes

Virtual object space maps display module 41：The object space that middleware 2 is established is called in spatial transformation information It is interior, call the spatial-attribute mutual query in middleware 2 to retrieve module 23 by spatial transformation information, one by one or batch query meets item The spatial description information of the virtual objects of part.

Virtual object space mapping display module 41 reads qualified void from virtual objects information reading module 31 The standardized information of quasi- object, such as word, picture, video, model.Meanwhile virtual object space map display module 41 from Spatial transformation information calls the correlation space description information that the object space is called in middleware 2, and according to the target empty Between correlation space description information call corresponding presentation engine or the virtual objects handled using corresponding processing method Standardized information, such as the size to virtual objects itself, position, geometric shape progress conversion process.Make the virtual objects Standardized information, be mapped to relative tertiary location of the virtual objects in the object space, make the virtual objects It can correctly be shown in display terminal 900, generate the pretreatment displaying number for the virtual objects that can be shown on display terminal 900 According to.

Imaging space mapping display module 42 reads the standardization of corresponding live-action image object from outdoor scene read module 32 Information, while the spatial description information called in middleware 2 in the object space is called from spatial transformation information, and according to institute The correlation space description information for stating object space, calls corresponding presentation engine or spatial transform method, to the live-action image The standardized information of object carries out geometric transformation, is carried out according to the size of live-action image object itself, position, geometric shape transformation Processing, and by the live-action image object, the corresponding position being mapped in the object space, so that live-action image object can It is correctly shown on display terminal 900, generates the pretreatment displaying number for the live-action image object that can be shown on display terminal 900 According to.

Interactive operation display module 5 includes that three-dimensional interactive presentation engine 51, third party's calling control interface 52 and user are mutual Dynamic operate interface 53.

Interactive operation display module 5 receives the pretreatment exhibition that 41 virtual objects of display module are mapped from virtual object space Registration evidence, and be illustrated in virtual objects displaying figure layer, receive the outdoor scene shadow that display module 42 is mapped from Imaging space It as the pretreatment display data of object, and is illustrated in live-action image displaying figure layer, the virtual objects is shown into figure layer It is added on the live-action image displaying figure layer, and is shown in the corresponding position of three-dimensional interactive presentation engine 51.It is three-dimensional Any one the live-action image object shooting point of interaction display engine 51 corresponding to the object space is in the object space In position, virtual camera is set up, and by setting up virtual viewport in the virtual camera, to the virtual objects exhibition Diagram layer and live-action image displaying figure layer are rendered and are synthesized and be showed on display terminal 900, and in interactive operation When remain the position correspondence of virtual objects displaying figure layer and the live-action image display diagram interlayer, it is synchronous to become It changes.

The unique mark or outdoor scene shadow that three-dimensional interactive presentation engine 51 in interactive operation display module 5 passes through virtual objects The unique mark of picture is called and the corresponding virtual objects shown or live-action image object, recalls information is needed to pass through third party's tune It is inputted with control interface 52.

Three-dimensional interactive presentation engine 51 in interactive operation display module 5 to virtual object space by mapping display module 41 and Imaging space mapping display module 42 send position of the virtual camera in the object space, obtain any one The position in three-dimensional interactive presentation engine 51 of shooting point or other arbitrary points of a virtual objects, any one live-action image object It sets and using it as origin, the spatial description information of virtual objects, controls the bat of any one live-action image object in particular range It takes the photograph a little or whether any one virtual objects as it can be seen that and needs the display in three-dimensional interactive presentation engine 51.

User interaction operate interface 53 or third party call control interface 52 to receive, and operational order such as mouse is clicked, keyboard is grasped Make, the virtual viewport direction or the position in the object space for changing the virtual camera are allowed users in three-dimensional The image of the shooting point of corresponding live-action image object is seen in interaction display engine 51, and in three-dimensional interactive presentation engine 51, Display module 41 is mapped by virtual object space and Imaging space maps the structural description information of the input of display module 42, i.e., The pretreatment display data of 41 virtual objects of display module is mapped from virtual object space and from Imaging space mapping displaying The pretreatment display data of the live-action image object of module 42, automatically by three-dimensional interactive presentation engine 51 in display terminal It floats in 900 and shows the specific information of virtual objects, it also can be in three-dimensional interactive presentation engine 51, in corresponding live-action image object Shooting point internetwork roaming, achieve the effect that by live-action image object, entity space and virtual objects merge show.Three-dimensional interactive exhibition Show that engine 51 is specified to the external control event such as click, double-click, dragging of any one virtual objects, or input by receiving Virtual objects, the extension of further event response is provided, such as shows the particular content of the virtual objects.

In user operation process, control interface 52 can be called to be taken the photograph to third party's procedure publication current virtual by third party The orientation of the virtual viewport of the position and current virtual video camera in the object space of camera, the behaviour to virtual objects Make event etc., third equation is enable to carry out two-way interaction with interactive operation display module 5.

In addition, in the data management layer, it is additionally provided with virtual objects information editing module 61, spatial object editor module 62 and live-action image editor module 63.

Virtual objects information editing module 61 can be to virtual object space description information database 14 and virtual object data Data in library 15 carry out typing, and editor, the operations such as modification deletion also can be to external input virtual object space description information number It is verified according to the integrality of 15 information of library 14 and virtual object data library, go forward side by side rower format quasi-ization and classification storage, and Automatic identification verification and completion are carried out to information such as data formats, check data exception, to ensure virtual object space description letter Correctness when information is called in database 14 and virtual object data library 15 is ceased, between safeguarding editor's virtual objects, with And the space correlation relationship between virtual objects and entity space.

Spatial object editor module 62 is from the external spatial description information for obtaining all entity spaces, to external input entity The integrality of the spatial description information of all entity spaces is verified in spatial description information database 13, standardized format with And classification storage, and automatic identification verification and completion are carried out to information such as data formats, data exception is checked, to ensure entity sky Between accuracy when information is called in description information database 13, to safeguard the space correlation relationship in edit substance space.

Live-action image information editing module 63, can be to live-action image database 11 and live-action image spatial description information data Data in library 12 carry out typing, and editor, the operations such as modification deletion also can be to external input live-action image database 11 and outdoor scene The integrality of the information of image space description information database 12 is verified, and carries out standard format and classification storage, And automatic identification verification and completion are carried out to information such as data formats, data exception is checked, to ensure live-action image database 11 With correctness of the information in live-action image spatial description information database 12 when called, live-action image object is edited to safeguard The space correlation relationship and live-action image pair between space correlation relationship and live-action image object between entity space As the space correlation relationship between virtual objects.

In a kind of virtual objects of the present invention and the interactive exhibition system of live-action image, entity space can be a room Between, the desk in room, the mobile phone in chair, box and box is all the asset entity corresponding to virtual objects, and box is Upper level father's virtual objects of mobile phone, i.e. affiliated partner in box.Mobile phone is the upper level parent object of battery in mobile phone, that is, is associated with Object, the room where mobile phone can be the entity space of the mobile phone and the affiliated partner of box.

Following effect may be implemented in a kind of virtual objects of the present invention and the interactive exhibition system of live-action image：By virtual In object and live-action image object map to the same object space, can be carried out to the asset entity corresponding to virtual objects can Depending on change manage, show virtual objects corresponding to asset entity entity space in information.

Due in the object space in a kind of virtual objects of the present invention and the interactive exhibition system of live-action image being base In with an entity space constructed by common associated live-action image object, therefore have holonmic space concept, Yong Hu The image that the shooting point of multiple live-action image objects corresponding with the object space is seen is to be mutually related.

Since a kind of virtual objects of the present invention and the interactive exhibition system of live-action image increase in the object space Virtual camera, therefore can switch viewpoint in the object space, observes the image of different location, due to virtual objects with The incidence relation of live-action image object, during view angle switch, rotation, assets corresponding with any one virtual objects are real The information of body can be labeled on the live-action image object in three-dimensional interactive presentation engine 51 automatically, be avoided in every outdoor scene shadow As the cumbersome and inconsequent marked by hand on object.

Due to the spatial description information of virtual objects, to it, relative tertiary location is described in its affiliated partner, User requires no knowledge about the absolute spatial position of the asset entity corresponding to virtual objects, you can is managed to it, meets people Basic comprehension mode, it is easy to implement, asset location registration and become more convenient.

The information of virtual objects, entity space or live-action image object can be changed individually, edited and be replaced, information coupling Spend low, maintenance update convenience.As re-shooting for outdoor scene imaged object does not need asset entity corresponding with virtual objects again Information marked again, equally, the change of the position of asset entity corresponding with virtual objects also need not be again in outdoor scene It is marked on imaged object.The mapping relations of all virtual objects corresponding with asset entity and live-action image object are by system Automatic calculate is completed.

Management convenient for assets and Information Sharing, it is corresponding with asset entity virtual right by live-action image object, mark The information and interactive operation of elephant, user can be complete from various dimensions such as the spatial position of virtual objects, spatial shape, parameter informations Asset entity relevant information corresponding with the virtual objects is obtained, avoids not readily understood, information caused by abstractdesription from transmitting and loses Final reception result deviation very etc. caused by reasons, particularly suitable for dispersion region place, it is unattended when assets Management, and to being equipped with good booster action at assets handing-over, emergency maintenance.

A kind of virtual objects of the present invention and the interaction display method of live-action image include the following steps：

Live-action image given step：One is inputted by the three-dimensional interactive presentation engine 51 in interactive operation display module 5 Or the unique mark of multiple specified live-action image objects, and display module 42, outdoor scene read module 32 are mapped by Imaging space It is sent to live-action image database 11.

Object space construction step：Spatial transformation information calls the spatial description information reading module 21 in middleware 2 logical The unique mark for crossing specified live-action image object, obtains the spatial description information of the specified live-action image object, by described The unique mark of entity space associated by specified live-action image object, obtains the spatial description information of above-mentioned entity space, leads to Cross the conversion that spatial transformation information calls the spatial description information reading module 21 of middleware 2 to carry out data format, spatial alternation Information calls the spatial information computing module 22 of middleware 2 by the sky of the specified live-action image object after Data Format Transform Between the entity space after description information and Data Format Transform spatial description information, be put into the virtual of its built in advance In three dimensions, the object space for finally showing is established.The spatial description information storage of the specified live-action image object In live-action image spatial description information database 12, the space of the entity space corresponding to the specified live-action image object is retouched Information storage is stated in entity space description information database 13.

Virtual objects searching step：A sub-spaces in the object space are given, which can be a two dimension envelope Space or a three dimensional closure space are closed, searches all virtual objects in the subspace, and obtain the sky of above-mentioned virtual objects Between description information, which is to call the spatial-attribute mutual query of middleware 2 to retrieve module 23 and space by spatial transformation information What description information read module 21 carried out.

Virtual objects iterative step, to determine specified relative tertiary location of the virtual objects in the object space with And the spatial shape of the virtual objects, it is divided into：

Virtual object space description information obtaining step：The virtual objects retrieved in virtual objects searching step In, it determines a specified virtual objects, obtains the affiliated partner of the specified virtual objects, the i.e. upper level of the specified virtual objects The unique mark of entity space where father's virtual objects or the virtual objects, and the specified virtual objects are calculated in its association pair As the spatial shape of middle relative tertiary location and the specified virtual objects.Such as unique mark of currently assigned virtual objects It is a1 to know, and according to the unique mark of a1 affiliated partners, reads the spatial description information of a1 affiliated partners, and determine that a1 is associated at it The relative tertiary location of object and the spatial shape of a1.

Virtual object space location information iterates to calculate step：Virtual objects space in affiliated partner is specified to this Position is iterated and adds up, until obtaining relative tertiary location of the specified virtual objects in entity space, and Relative tertiary location of the virtual objects in the object space is specified to this.Such as in the above example, by battery in mobile phone In relative tertiary location, relative tertiary location and box relative tertiary location in a room of the mobile phone in box into After row is cumulative, to obtain battery in room, i.e. relative tertiary location in entity space.The step is believed by spatial alternation Breath calls spatial information computing module 22, spatial alternation algorithms library 24, conversion proportion ruler demarcating module 27 and the ratio of middleware 2 What ruler database 28 carried out.

Virtual objects show that step, the pretreatment display data for generating virtual objects are divided into：

Virtual objects read step：Unique mark of the virtual objects information reading module 31 based on the specified virtual objects Know, the information of the specified virtual objects is read from virtual object data library 15.

Virtual objects load step：Virtual objects information reading module 31 according to this specify virtual objects information class Type, such as image, video, threedimensional model select corresponding decoding, carry out the conversion of data format, handle as that can be grasped in interaction Make the standardized information for the specified virtual objects being uniformly processed in the three-dimensional interactive presentation engine 51 in display module 5.

Virtual objects mapping step：Virtual object space maps display module 41 and calls middleware 2 from spatial transformation information The middle correlation space description information for calling the object space, while reading this from virtual objects information reading module 31 and specifying The standardized information of virtual objects, according to the correlation space description information of the object space, i.e., the described specified virtual objects exist Relative tertiary location in the object space and spatial shape specify the standardized information of virtual objects to carry out geometry change this It changes, so that the standardized information of the specified virtual objects is mapped in the object space corresponding with the specified virtual objects Position generates the pretreatment display data of the specified virtual objects in virtual object space maps display module 41.And it sets It is scheduled in the virtual objects displaying figure layer of three-dimensional interactive presentation engine 51 and shows.

Live-action image read step：Unique mark of the outdoor scene read module 32 based on the specified live-action image object is read It takes the information of the specified live-action image object, selects corresponding decoding, carry out the conversion of data format, handle as can be described The standardized information for the specified live-action image object being uniformly processed in object space.

Live-action image object space shift step：It is intermediate from spatial transformation information calling that Imaging space maps display module 42 The correlation space description information of the object space is called in part 2, while being read this from outdoor scene outdoor scene read module 41 and being specified in fact The standardized information of scape imaged object, according to the correlation space description information of the object space, i.e., the described specified live-action image Relative tertiary location and spatial shape of the object in the object space, specify this standardized information of live-action image object Geometric transformation is carried out, so that the standardized information of the specified live-action image object is mapped in the object space and is specified with described The corresponding position of live-action image object generates the pre- of the specified live-action image object in Imaging space maps display module 42 Display data is handled, and is set in the live-action image displaying figure layer of three-dimensional interactive presentation engine 51 and shows.

Display superposition step：Three-dimensional interactive presentation engine 51 is set：The pretreatment display data of the specified virtual objects It shows in virtual objects show figure layer, the pretreatment display data of the specified live-action image object, is shown in three-dimensional interactive It is shown in the live-action image displaying figure layer of engine 51, and virtual objects display diagram stacking is added to the live-action image and is shown It in figure layer, is shown on display terminal 900, three-dimensional interactive presentation engine 51 selects the bat of one of live-action image object It takes the photograph a little, virtual camera is established in the object space.Interactive operation display module 5 calls control interface 52 by third party Orientation, visual angle etc. of the virtual camera in the object space are controlled with user interaction operate interface 53, and is shown Show on display terminal 900, and receive the various interactive instructions for the virtual objects, carries out interaction display.

Switch live-action image object step：Switch the object space, returns to live-action image obtaining step, which is logical The third party crossed in interactive operation display module 5 calls control interface 52 and user interaction operate interface 53 to carry out.

Those of ordinary skill in the art it should be appreciated that more than embodiment be intended merely to illustrate the present invention, And be not used as limitation of the invention, as long as in the spirit of the present invention, the change to embodiment described above Change, modification will all be fallen within the scope of claims of the present invention.

Claims (10)

1. the interactive exhibition system of a kind of virtual objects and live-action image, including data management layer, processing computation layer and interaction exhibition Show layer；It is characterized in that：

Live-action image database, live-action image spatial description information database, entity space is equipped in the data management layer to retouch Information database, virtual object space description information database and virtual object data library are stated, is equipped in the interactive display layer Three-dimensional interactive presentation engine；

Record has the spatial description information of each live-action image object in the live-action image spatial description information bank, described virtual right Record has the spatial description information of each virtual objects, the entity space description information to be recorded in library in image space description information library There is the spatial description information of each entity space；

It is equipped with spatial transformation information in the processing computation layer and calls middleware, described one virtual three-dimensional of processing computation layer built in advance Space, to from the live-action image spatial description information database, the virtual object space description information database, Yi Jisuo The spatial description information read in entity space description information database is stated, the transformation calculations of spatial shape are carried out, is put into described Virtual three-dimensional space, structure one for finally showing the object space used；

Relative tertiary location of the processing computation layer according to any one of virtual objects in its affiliated partner, is somebody's turn to do Virtual objects relative tertiary location in corresponding entity space, and the virtual objects are obtained in turn in the object space Relative tertiary location；

The processing computation layer obtains the pre- of virtual objects by the information of the virtual objects and the mapping of the object space Handle display data；By the mapping of the information and the object space of the live-action image object, live-action image object is obtained Pretreatment display data；

The pretreatment display data of the three-dimensional interactive presentation engine setting virtual objects is shown in virtual objects to be shown in figure layer, The pretreatment display data for setting live-action image object shown in live-action image displaying figure layer, and by the virtual objects Display diagram stacking is added on the live-action image displaying figure layer, is shown.

2. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 1, it is characterised in that：It is described It is equipped in processing computation layer：

For from the live-action image spatial description information database, entity space description information database, virtual object space Spatial description information is read in description information database and carries out the spatial description information reading module of Data Format Transform；

Virtual three-dimensional space described in built in advance, and the spatial description information that the spatial description information reading module is read is carried out empty Between position calculate and build the object space with spatial shape transformation, and according to any one of virtual objects in its association pair Relative tertiary location as in finally obtains the spatial information of relative tertiary location of the virtual objects in the object space Computing module；

For reading the information of the virtual objects from the virtual object data library, and it is processed into the mark of virtual objects The virtual objects information reading module of standardization information；

Information for reading the live-action image object from the live-action image database, and it is processed into live-action image The outdoor scene read module of the standardized information of object；

The correlation space description information of the object space is called for being called in middleware from the spatial transformation information, and is read The standardized information of the virtual objects is taken, and according to the correlation space description information of the object space to the virtual objects Standardized information carry out geometric transformation, to make the virtual objects be mapped to the corresponding position in the object space, with Form the virtual object space display module of the pretreatment display data of virtual objects；

The correlation space description information of the object space is called for being called in middleware from the spatial transformation information, and is read The standardized information of the live-action image object is taken, and according to the correlation space description information of the object space to the outdoor scene The standardized information of imaged object carries out geometric transformation, to make in the live-action image object map to the object space Corresponding position, to form the Imaging space display module of the pretreatment display data of live-action image object.

3. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 2, it is characterised in that：It is described Spatial transformation information is called and is additionally provided with spatial alternation algorithms library in middleware, and the spatial information computing module is to described virtual Object, the live-action image object and the entity space carry out spatial shape transformation, determine virtual objects and described Position of the live-action image in the virtual three-dimensional space and after building the object space, from the spatial alternation algorithms library Corresponding spatial alternation algorithm is called, the transformation of spatial shape is carried out, obtains the virtual objects in the object space Relative tertiary location and spatial shape data.

4. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 3, it is characterised in that：It is described Spatial alternation algorithm in spatial alternation algorithms library includes that GIS coordinates turn three-dimensional coordinate algorithm, and left hand/right hand three-dimensional coordinate mutually turns Algorithm, spherical model become scaling method, camera lens perspective distortion algorithm.

5. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 3, it is characterised in that：It is described Spatial transformation information calls middleware to be additionally provided with conversion proportion ruler demarcating module, and the conversion proportion ruler demarcating module includes being used for Two-way communication is carried out with the spatial alternation algorithms library, is calculated under setting ratio ruler, different spaces become under scaling method, spatial alternation As a result, and for the spatial information computing module in the background processing module called when spatial alternation calculating, Yi Jiyong In realizing spatial alternation algorithms selection, engineer's scale input numerical value selection, spatial alternation arithmetic result is shown, more under setting ratio ruler The comparison of kind spatial alternation arithmetic result and the engineer's scale condition entry of engineer's scale input numerical value set by hand are shown with result Module, the background processing module connect engineer's scale database.

6. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 3, it is characterised in that：It is described Spatial transformation information calls middleware to be additionally provided with format conversion and type judging module and description information association algorithm information bank, institute State the spatial position description information that format conversion and type judging module judge that the spatial description information reading module is read Data format calls the algorithm of corresponding data format conversion from the description information association algorithm information bank, carries out data format The spatial description information reading module is returned to after conversion.

7. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 3, it is characterised in that：It is described Spatial transformation information, which is called, is additionally provided with spatial-attribute mutual query retrieval module in middleware, for retrieving the void in the object space Quasi- object or live-action image object.

8. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 1, it is characterised in that：It is described Any one the live-action image object shooting point of three-dimensional interactive presentation engine corresponding to the object space is in the target empty Between in position, virtual camera is set up, and by setting up virtual viewport in the virtual camera, by the virtual objects Display diagram stacking is added on the live-action image displaying figure layer, and is rendered and synthesized displaying.

9. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 8, it is characterised in that：Institute State be additionally provided in interaction display layer can with the three-dimensional interactive presentation engine carry out two-way communication user interaction operate interface and Third party calls control interface to realize the live-action image object, the entity space and the void for receiving operational order The fusion displaying of quasi- object, and carry out two-way interaction.

10. the interactive exhibition system of a kind of virtual objects and live-action image according to claim 1, it is characterised in that：Institute It states in data management layer, is additionally provided with to the virtual object space description information database and virtual object data library progress Editor and verification virtual objects information editing's module, to the entity space description information database into edlin and verification Spatial object editor module, and the live-action image database and the live-action image spatial description information database are carried out The live-action image editor module of editor and verification.