CN101872243A - System and method for realizing 360-degree panoramic play following real space direction - Google Patents

System and method for realizing 360-degree panoramic play following real space direction Download PDF

Info

Publication number
CN101872243A
CN101872243A CN 201010201793 CN201010201793A CN101872243A CN 101872243 A CN101872243 A CN 101872243A CN 201010201793 CN201010201793 CN 201010201793 CN 201010201793 A CN201010201793 A CN 201010201793A CN 101872243 A CN101872243 A CN 101872243A
Authority
CN
China
Prior art keywords
module
parameter
geomagnetic
geomagnetic parameter
full
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 201010201793
Other languages
Chinese (zh)
Other versions
CN101872243B (en
Inventor
殷铭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHANGHAI JIETU SOFTWARE TECHN CO Ltd
Original Assignee
SHANGHAI JIETU SOFTWARE TECHN CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI JIETU SOFTWARE TECHN CO Ltd filed Critical SHANGHAI JIETU SOFTWARE TECHN CO Ltd
Priority to CN201010201793A priority Critical patent/CN101872243B/en
Publication of CN101872243A publication Critical patent/CN101872243A/en
Application granted granted Critical
Publication of CN101872243B publication Critical patent/CN101872243B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a system and a method for realizing 360-degree panoramic play following real space direction. In a 360-degree panoramically playing system, a device for acquiring a geomagnetic induction parameter is arranged on a panoramic image acquiring system and a playing terminal to make the acquired 360-degree image have the corresponding geomagnetic attribute, so that the 360-degree panoramic image can be controlled to be played by utilizing the geomagnetic parameter and the 360-degree panoramic play following the real space direction can be realized. In the system and the method, the 360-degree panoramic play following the real space direction can be realized, so that an operator has strong operation immersive experience.

Description

A kind of 360 ° of panorama Play Systems and method thereof that realizes following the realistic space direction
Technical field:
The present invention relates to a kind of 360 ° of panorama browser technologies, particularly a kind of 360 ° of panorama Play Systems can realizing following the realistic space direction, and the method for this system's realization.
Background technology:
Along with constantly popularizing of mobile phone and wireless communication technology, continuing to increase for the demand of graph image.
Video tour, video calling, picture is shared, and digital map navigation, even 360 ° of panorama navigation emerge in an endless stream.But feeling of immersion is expanded demand to the degree of depth in space and be can not get good combination all the time, and most application all needs the people to pass through button, and screen comes mutual.
Wherein, the broadcast of 360 ° of panoramas also is so, need by to the people of screen picture for dragging, stretch, reach and rotate and amplification is dwindled, effect such as walk about.
Referring to Fig. 1, row's button 601 all can appear in the broadcast of 360 ° of panorama Play Systems of tradition on broadcast interface 600, and these buttons all are control and operate 360 ° of image panorama and play use.In broadcast is at ordinary times used, operation to image all needs to finish corresponding operation by clicking corresponding button at every turn, certainly for touch-screen, when playing, can and drag by contact screen and realize, but this all needs man-machine contact mutual.
Above-mentioned broadcast mode has not only reduced the operability of 360 ° of panorama Play Systems, also reduces by 360 ° of experience on the spot in person that the panorama Play System can bring greatly, reduces the feeling of immersion of system.
Involved herein 360 ° of full-view images or 360 ° of panoramic pictures or 360 ° of panoramas, be defined as follows: if image is placed on a spherical space or cubic space or cylindrical space, perhaps in cone space or the ellipsoid space, by fixing in the above-mentioned space a bit as observation point, adopting the process of the image that this image of one-point perspective obtained to be panorama by this observation point plays, then this image is by the spherical panorama that is called of correspondence, perhaps cube panorama, perhaps cylindricality panorama, perhaps taper panorama, perhaps ellipsoid panorama, and to be referred to as this image be 360 ° of full-view images or 360 ° of panoramic pictures or 360 ° of panoramas.
Summary of the invention:
The present invention is directed to above-mentioned existing 360 ° of existing defectives of panorama Play System, and provide a kind of 360 ° of novel panorama Play Systems, this Play System is based on the earth induction device, be implemented in 360 ° of panorama spaces, according to moving and rotation of system itself, refresh the image of 360 ° of panoramas in real time and play up, reach the real space of convergence immersive effects.
Simultaneously, the present invention also provides a kind of and realizes the method that 360 ° of full-view images are play by the earth induction device.
In order to achieve the above object, the present invention adopts following technical scheme:
A kind of 360 ° of panorama Play Systems of realizing following the realistic space direction, this Play System comprises
One image capturing system, described image capturing system carry out the synchronous acquisition of the geomagnetic parameter of the collection of 360 ° of panoramic pictures and panoramic picture correspondence;
One image processing system, described image processing system carries out respective handling to 360 ° of panoramic pictures of described image capturing system collection, and the geomagnetic parameter of described image capturing system collection carried out alignment processing, make 360 ° of panoramic pictures and geomagnetic parameter form corresponding relation;
One supporting system, described supporting system is used to store the information data that described image processing system is finished dealing with, so that the calling of corresponding information data;
One 360 ° of panorama playback terminals, described 360 ° of panorama playback terminals call institute of described supporting system canned data to carry out 360 ° of panoramic pictures and plays, and the geomagnetic parameter information in geomagnetic parameter of self obtaining according to 360 ° of panorama playback terminals and institute of the described supporting system canned data, control 360 ° of panoramic pictures and play, realize following 360 ° of panoramas broadcasts of realistic space direction.
In optimum embodiment of the present invention, image capturing system comprises:
The full-view image acquisition module, described full-view image acquisition module is used to gather 360 ° of panoramic pictures;
Geomagnetic parameter acquisition module, described geomagnetic parameter acquisition module are used to gather, transmit and show the geomagnetic parameter of every group of panoramic picture correspondence that described full-view image acquisition module is gathered;
Data sync trigger module, described data sync trigger module are used for the synchro control to described full-view image acquisition module and described geomagnetic parameter acquisition module collecting work;
Data sync storage module, described data sync storage module are used for the data of described full-view image acquisition module of stores synchronized and the collection of described geomagnetic parameter acquisition module;
Power supply and Voltage stabilizing module, described power supply and Voltage stabilizing module provide voltage-stabilizing working power supply for image capturing system, and the abnormity of power supply situation is reported to the police;
Central control module, described central control module are used to control described full-view image acquisition module, geomagnetic parameter acquisition module, data sync trigger module, data sync storage module and power supply and Voltage stabilizing module.
Further, also comprise the data preview read module in the described image capturing system, described data preview read module is controlled by described central control module, is used for that the data of described full-view image acquisition module and the collection of described geomagnetic parameter acquisition module are carried out breviary and shows, and check.
Described image processing system comprises:
360 ° of full-view image die sections, described 360 ° of full-view image die sections be used for to every group of 360 ° of panoramic pictures that form by described image capturing system collection splice, piecemeal and generate topological structure and handle;
Magnetic azimuth parameter synchronization processing module, described magnetic azimuth parameter synchronization processing module and 360 ° every group corresponding geomagnetic parameters of panoramic picture of described 360 ° of full-view image die section synchronous processing are filtered and buffer memory geomagnetic parameter.
Specified format image and parameter output module, described specified format image and parameter output module are integrated the every group of 360 ° of panoramic pictures and the corresponding geomagnetic parameter with corresponding relation of described 360 ° of full-view image die sections and described magnetic azimuth parameter synchronization processing module processing formation, make that every group of 360 ° of panoramic pictures are corresponding one by one with geomagnetic parameter, and generation mapping table, and the file of generation specified format.
Described supporting system comprises:
360 ° of full-view image memory modules, described 360 ° of full-view image memory modules are used for storage administration and are handled 360 ° of panoramic picture related datas that form by described image processing system;
Geomagnetic parameter and geography information memory module, described geomagnetic parameter and geography information memory module are used to store the related data of being handled the geomagnetic parameter that forms by described image processing system;
360 ° of full-view images and geomagnetic parameter index module, described 360 ° of full-view images and geomagnetic parameter index module are used to store the paired data of 360 ° of panoramic pictures and geomagnetic parameter, with form can two-way retrieval index;
360 ° of full-view images and geomagnetic parameter calling interface module, described 360 ° of full-view images and geomagnetic parameter calling interface module realize outside by described 360 ° of full-view images and geomagnetic parameter index module to described 360 ° of full-view image memory modules and described geomagnetic parameter and 360 ° of panoramic pictures of geography information memory module storage and calling of corresponding geomagnetic parameter.
Described 360 ° of panoramas and geomagnetic parameter index module also are used for the data that described geomagnetic parameter and geography information memory module are stored are safeguarded.
Described supporting system also comprises 360 ° of full-view images and geomagnetic parameter access log module, and described 360 ° of full-view images and geomagnetic parameter access log module are used to write down the process of calling 360 ° of full-view images and geomagnetic parameter.
Described 360 ° of panorama playback terminals comprise:
360 ° of panoramic picture calling modules, described 360 ° of panoramic picture calling modules call 360 ° of panoramic pictures storing in the described supporting system and show, and according to corresponding geomagnetic parameter 360 ° of panoramic pictures are corrected;
Playback terminal geomagnetic parameter acquisition module, described playback terminal geomagnetic parameter is obtained the geomagnetic parameter of playback terminal in real time;
Earth induction image operation control module, the geomagnetic parameter that described earth induction image operation control module obtains described playback terminal geomagnetic parameter acquisition module changes into the broadcast range parameter that the control chart picture is play, and reaches described 360 ° of panoramic picture calling modules.
Based on said system, the invention provides the method that a kind of 360 ° of panoramas realizing following the realistic space direction are play, described method utilizes geomagnetic parameter to control the broadcast of 360 ° of panoramic pictures, plays to realize 360 ° of panoramas of following the realistic space direction.
In optimum embodiment of the present invention, utilize geomagnetic parameter to control 360 ° of panoramic pictures and play, realize as follows:
(1) gather 360 ° of panoramic pictures, and these 360 ° of corresponding geomagnetic parameters of panoramic picture of synchronous acquisition;
360 ° of panoramic pictures that (2) will collect and corresponding geomagnetic parameter are handled to integrate and are formed one-to-one relationship, and store;
(3) obtain the geomagnetic parameter of 360 ° of panoramic picture playback terminals in real time, and this geomagnetic parameter is converted into the range parameter of 360 ° of panoramic pictures broadcasts;
(4) 360 ° of panoramic picture playback terminals call corresponding 360 ° of panoramic pictures according to the range parameter that forms and carry out 360 ° of panoramic pictures broadcasts.
Further, the image acquisition in the described step (1) is to adopt the fixing mode of the initial angle of panorama collecting device to gather or adopt the mode of real-time angle of the image of each width of cloth participation amalgamation of real time record to gather.
The system that obtains according to technique scheme has following characteristics:
What (1) native system can system for tracking itself moves and rotation, refreshes the image of 360 ° of panoramas in real time and plays up;
(2) make the operator have strong operation to immerse experience;
(3) do not need manually to drag and browse;
(4) native system is realized people's rotation, then also rotation thereupon of the image in the playback terminal;
(5) native system can be applicable on mobile wireless, the catv terminal, and reaches corresponding effects;
(6) can be used in the real scene navigation;
(7) can be used in 360 ° of scene demonstrations of simulation.
(8) native system can be used in the corresponding game terminal, can greatly provide player's operation to immerse experience, improves the recreational of recreation.
Method provided by the invention can realize following the broadcast that the realistic space direction is carried out 360 ° of panoramic pictures, utilizes this method can realize following the broadcast that the realistic space direction is carried out the non-360-degree panoramic picture equally.
This method can be applicable to make the operator have strong operation and immerse experience in the terminal of the communications industry, display and demonstration industry etc.
Description of drawings:
Further specify the present invention below in conjunction with the drawings and specific embodiments.
Fig. 1 is the broadcast synoptic diagram of 360 ° of panorama Play Systems of tradition.
Fig. 2 is the composition synoptic diagram of Play System among the present invention.
Fig. 3 carries out the synoptic diagram of image and geomagnetic parameter collection for the present invention.
Fig. 4 is the concrete structure synoptic diagram of Play System among the present invention.
Fig. 5 is the process flow diagram of panorama player method among the present invention.
Embodiment:
For technological means, creation characteristic that the present invention is realized, reach purpose and effect is easy to understand, below in conjunction with concrete diagram, further set forth the present invention.
360 ° of panorama Play Systems provided by the invention are to improve to obtain on the basis of 360 ° of traditional panorama Play Systems.The present invention in 360 ° of panorama Play Systems image acquisition part and broadcast partly magnetic-inductive device, to obtain the geomagnetic parameter of image and playback terminal in real time, with geomagnetic parameter and image integration, thereby realize utilizing geomagnetic parameter to control the broadcast of 360 ° of panoramic pictures, play to realize 360 ° of panoramas of following the realistic space direction.
Based on above-mentioned principle, 360 ° of panorama Play Systems provided by the invention are mainly formed (referring to Fig. 2) by image capturing system 100, image processing system 200, supporting system 300 and 360 ° of panorama playback terminals 400.
Wherein image capturing system 100, are used for the synchronous acquisition of the geomagnetic parameter of the collection of 360 ° of panoramic pictures and panoramic picture correspondence.
When image capturing system 100 carries out 360 ° of panoramic pictures collections, gather 360 ° of panoramic pictures by 360 ° of panorama collecting devices, also need determine the direction of panoramic picture in the space simultaneously, make in 360 ° panorama space that each direction is all corresponding to a direction in the real space.Based on above-mentioned requirements, the mode of 360 ° of panoramic picture collections has two kinds, and a kind of is when gathering, the fixing start angle of panorama collecting device, and the direction of each picture sensing that guarantees to participate in the image of amalgamation is fixed; A kind of is when gathering, and each width of cloth of real time record participates in the real-time angle (above-mentioned is prior art, is not given unnecessary details) of the image of amalgamation herein.
Image capturing system 100 is by the geomagnetic parameter of corresponding geomagnetic parameter deriving means and corresponding synchronous device synchronous acquisition panoramic picture correspondence.
Image capturing system 100 is when carrying out the collection of image and geomagnetic parameter, as shown in Figure 3:
When this figure is presented on the road images acquired, geomagnetic parameter obtain corresponding relation with every group of 360 ° of panoramic pictures.Having three groups of panoramic pictures (but being not limited to three groups) shown on this figure, is respectively 1,2,3 groups, and every group of image is made up of 4 fish-eye images, is labeled as A respectively, B, C, D.These three groups of panoramic pictures are collected respectively by three the image acquisition points 501,502,503 on the road 500 respectively, and wherein the shooting direction of A fish-eye image is respectively direction 504,505,506 in every group of image.
The centre is the 360 ° every group corresponding geomagnetic parameters of obtaining of panoramic picture, and the 1st group geomagnetic parameter is 35 °, and the 2nd group geomagnetic parameter is 335 °, and the 3rd group geomagnetic parameter is 351 °.That is, the shooting direction of every group of geomagnetic parameter A fish-eye image that is exactly 360 ° of panoramic pictures of this group and the angle of north pointer direction.
In order accurately to obtain this geomagnetic parameter, just earth magnetism collecting device and 360 ° of panorama collecting devices need be bound together, can not when taking, change the relative position of earth magnetism collecting device and 360 ° of panorama collecting devices.
The angle of geomagnetic parameter representative can be the angle of arbitrary image taking direction in a fixed-direction and every group of 360 ° of panoramic picture, but must guarantee to be the shooting direction of same image and the angle of a fixed-direction in every group of 360 ° of panoramic pictures, guarantee accurately obtaining of geomagnetic parameter.
With above-mentioned three groups of 360 ° of panoramic pictures is example, geomagnetic parameter can be the shooting direction of A fish-eye image and the angle of north pointer direction in three groups of 360 ° of panoramic pictures, also can be the shooting direction of B fish-eye image and the angle of north pointer direction in three groups of 360 ° of panoramic pictures, also can be the shooting direction of C fish-eye image and the angle of north pointer direction in three groups of 360 ° of panoramic pictures, also the shooting direction of D fish-eye image and the angle of north pointer direction in three groups of 360 ° of panoramic pictures can be, the unification of judgement basis must be guaranteed.
Image processing system 200, be used for 360 ° of panoramic pictures being gathered by image capturing system 100 are carried out respective handling, and to carrying out alignment processing by the geomagnetic parameter of image capturing system 100 collections, make 360 ° of panoramic pictures and geomagnetic parameter form corresponding relation, and the data of handling well are saved in the supporting system 300, so that call.
Wherein to treatment of picture mainly be to every group of image that image capturing system 100 is gathered splice, piecemeal, initial 0 degree angle and the real space direction of image, such as in a northerly direction angle or the like.Also need simultaneously corresponding geomagnetic parameter is carried out fusion treatment.
Supporting system 300 is erected on the corresponding webserver, accepts to send relevant panoramic picture and geomagnetic parameter information.The system of supporting simultaneously 300 is used to store the information data of being finished dealing with by image processing system 200, so that the calling of corresponding information data;
360 ° of panorama playback terminals 400 carry out 360 ° of panoramic pictures broadcasts by calling 400 canned datas of supporting system, and can provide the omnirange of 360 ° of panoramas broadcasts to drag, and walk about, and amplify reduction capability; The geomagnetic parameter of also self obtaining according to 360 ° of panorama playback terminals is controlled 360 ° of panoramic pictures and is play simultaneously, realizes following 360 ° of panoramas broadcasts of realistic space direction.
Based on technique scheme, 360 ° of panorama Play Systems provided by the invention in the specific implementation, it forms structure as shown in Figure 4:
Wherein, image capturing system 100 mainly is made up of full-view image acquisition module 101, geomagnetic parameter acquisition module 102, data sync trigger module 103, data sync storage module 104, power supply and Voltage stabilizing module 105, central control module 106.
Full-view image acquisition module 101, this module are used to gather 360 ° of panoramic pictures, and it generally comprises standardized camera, video camera, The Cloud Terrace, foot rest, mobile device, guider or the like (concrete structure is a prior art, does not add herein and gives unnecessary details).
Geomagnetic parameter acquisition module 102, the geomagnetic parameter that the geomagnetic parameter acquisition module is used for every group of panoramic picture correspondence that synchronous acquisition gathered by full-view image acquisition module 101 (as mentioned above, do not given unnecessary details herein), and the geomagnetic parameter that collects shown and transmit.
Data sync trigger module 103, this module are used to control full-view image acquisition module 101 and geomagnetic parameter acquisition module 102 synchronous acquisition panoramic pictures and corresponding geomagnetic parameter, to guarantee pairing getparms and accuracy.
Data sync storage module 104, this module are used for the data of stores synchronized by full-view image acquisition module 101 and geomagnetic parameter acquisition module 102 synchronous acquisition, and carry out corresponding memory management.
Power supply and Voltage stabilizing module 105, this module provides voltage-stabilizing working power supply for each module in the image capturing system 100, and the while can be realized and the abnormity of power supply situation is reported to the police.
Central control module 106 is the control center of image capturing system 100, and each module of its control image capturing system 100 realizes the exchanges data between above-mentioned each module, process such as synchronous are managed and control.When synchronizing process was controlled, central control module 106 triggered control full-view image acquisition module 101 and geomagnetic parameter acquisition module 102 synchronous workings by data sync trigger module 103, both data acquisitions of reality synchronously; By data sync storage module 104 data of full-view image acquisition module 101 and geomagnetic parameter acquisition module 102 synchronous acquisition are carried out stores synchronized simultaneously.
Further improve the practicality of this image capturing system 100, in image capturing system 100, also be provided with data preview read module 107, this module is controlled by central control module 106, be used for that the data of full-view image acquisition module 101 and 102 collections of geomagnetic parameter acquisition module are carried out breviary and show, and can suspend and check the various data of obtaining.
For reaching function corresponding, and cooperate with above-mentioned image capturing system 100, image processing system 200 is made up of 360 ° of full-view image die sections 201, magnetic azimuth parameter synchronization processing module 202 and specified format image and parameter output module 203.
360 ° of full-view image die sections 201, this module be used for to every group of 360 ° of panoramic pictures gathering storage by image capturing system 100 splice, piecemeal and generate processing such as topological structure;
Magnetic azimuth parameter synchronization processing module 202, this module and 360 ° every group corresponding geomagnetic parameters of panoramic picture of 360 ° of full-view image die section 201 synchronous processing are filtered and are stored geomagnetic parameter.
Specified format image and parameter output module 203, this module is integrated handled every group of 360 ° of panoramic pictures and the corresponding geomagnetic parameter with corresponding relation that form by 360 ° of full-view image die sections 201 and magnetic azimuth parameter synchronization processing module 202, make that every group of 360 ° of panoramic pictures are corresponding one by one with geomagnetic parameter, and generation mapping table, and generate the file of specified format, so that be formed for corresponding index.
Supporting system 300 mainly is made up of 360 ° of full-view image memory modules 301, geomagnetic parameter and 302,360 ° of full-view images of geography information memory module and geomagnetic parameter index module 303 and 360 ° of full-view images and geomagnetic parameter calling interface module 304.
360 ° of full-view image memory modules 301 are used for storage administration and handle 360 ° of panoramic picture relevant informations that form by 200 360 ° of full-view image die sections of image processing system 201, and it mainly comprises information such as section, thumbnail, size, coordinate.Canned data will be used for the broadcast of full-view image in this module.
Geomagnetic parameter and geography information memory module 302, being used for storing geomagnetic parameter data and panoramic picture and geomagnetic parameter corresponding mapping table by image processing system 200 magnetic azimuth parameter synchronization processing modules 202 and specified format image and 203 generations of parameter output module, mainly is to be used to store 360 ° of panoramic pictures first to gather information such as the angle of direction and north pointer direction, acquisition time, coordinate.The process that information in this module will be used for playing at 360 ° of panoramic pictures indicate and the counterparty to.
360 ° of full-view images and geomagnetic parameter index module 303, this module is used for storing the 360 ° of panoramic pictures being formed by image processing system 200 specified format images and parameter output module 203 and the paired data (being corresponding mapping table) of geomagnetic parameter, with form can two-way retrieval index, can retrieve corresponding geomagnetic parameter or retrieve corresponding panoramic picture by panoramic picture by geomagnetic parameter.
Because the data that geography information memory module 302 storage specified format images and parameter output module 203 form, so 360 ° of full-view images and geomagnetic parameter index module 303 will realize the maintenance to geomagnetic parameter and geography information memory module 302 data of storing, and comprise basic increasing, delete, look into, change and maintenance functions such as daily record.
360 ° of full-view images and geomagnetic parameter calling interface module 304, this module are used to realize outside by 360 ° of full-view images and 303 pairs of 360 ° of full-view image memory modules 301 of geomagnetic parameter index module and geomagnetic parameter and 360 ° of panoramic pictures of geography information memory module 302 storages and calling of corresponding geomagnetic parameter.
The system of supporting simultaneously 300 also comprises 360 ° of full-view images and geomagnetic parameter access log module 305, and this module is used to write down the process of calling the storage relevant information, comprises access object, time or the like.
360 ° of panorama playback terminals 400 are made up of 360 ° of panoramic picture calling modules 401, playback terminal geomagnetic parameter acquisition module 402 and earth induction image operation control module 403.
360 ° of panoramic picture calling modules 401, be used for calling 360 ° of panoramic pictures of supporting system 300 storages, 360 ° of panoramic pictures are met the perspective transform of human-eye stereoscopic vision, and divide block-grading to call 360 ° of panoramic pictures, 360 ° of panoramic pictures are shown in screen, mate according to the geomagnetic parameter of pairing simultaneously, image is corrected.
Playback terminal geomagnetic parameter acquisition module 402, this module is used for obtaining in real time the geomagnetic parameter of playback terminal.
Earth induction image operation control module 403, the geomagnetic parameter that this module obtains playback terminal geomagnetic parameter acquisition module 402 changes into the broadcast range parameter that the control chart picture plays (comprising the level angle of playing 360 ° of panoramic pictures, vertical angle, horizontal viewport angle etc.), and reaches 360 ° of panoramic picture calling modules 401.
By the Play System that such scheme obtains, can on mobile radio terminal, realize corresponding 360 ° of panoramic pictures broadcast.Accept the request of access that radio network gateway obtains by the supporting system 200 in the Play System, to mobile radio terminal send panoramic picture and with magnetic parameter information relatively, simultaneously 360 ° of panorama playback terminals 400 are arranged on mobile radio terminal and get final product, concrete function is realized as mentioned above.
In view of the above, this Play System can be used in the terminal of real scene navigation, simulation 360 scene demonstrations, catv terminal, the communications industry and game terminal and display and demonstration industry or the like.
Based on the Play System that such scheme forms, it is to utilize geomagnetic parameter to control the broadcast of 360 ° of panoramic pictures, realizes following 360 ° of panoramas broadcasts of realistic space direction with this, this specific implementation process following (referring to Fig. 5):
The first step, 360 ° of panoramic picture Play Systems are gathered 360 ° of panoramic pictures, and these 360 ° of corresponding geomagnetic parameters of panoramic picture of synchronous acquisition.
This step mainly is to be finished by image capturing system 100 in 360 ° of panoramic picture Play Systems:
(1-1) trigger control full-view image acquisition module 101 and geomagnetic parameter acquisition module 102 synchronous workings by data sync trigger module 103 by image capturing system central control module 106;
(1-2) full-view image acquisition module 101 and geomagnetic parameter acquisition module 102 carry out the synchronous acquisition (specifically as mentioned above) of panoramic picture and geomagnetic parameter;
(1-3) central control module 106 carries out stores synchronized by data sync storage module 104 with the data of full-view image acquisition module 101 and geomagnetic parameter acquisition module 102 synchronous acquisition.
In second step, the 360 ° of panoramic pictures and the corresponding geomagnetic parameter that collect are handled integration formation one-to-one relationship.
This step mainly is to be finished by image processing system 200 in 360 ° of panoramic picture Play Systems:
(2-1) 360 ° of full-view image die sections 201 with every group of 360 ° of panoramic pictures of storage in the stores synchronized module 104 splice, piecemeal and generate processing such as topological structure;
(2-2) magnetic azimuth parameter synchronization processing module 202 and 360 ° every group corresponding geomagnetic parameters of panoramic picture of 360 ° of full-view image die section 201 synchronous processing make every group of 360 ° of panoramic pictures and corresponding geomagnetic parameter form one-to-one relationship;
(2-3) every group of 360 ° of panoramic pictures and the corresponding geomagnetic parameter that will handle well of specified format image and parameter output module 203 integrated, and generates the file of specified format.
In the 3rd step, 360 ° of panoramic pictures and corresponding geomagnetic parameter that stores processor is good are to realize calling of corresponding data.
This step mainly is to be finished by supporting system 300 in 360 ° of panoramic picture Play Systems:
(3-1) 360 ° of full-view image memory modules 301 and geomagnetic parameter and geography information memory module 302 storage corresponding informations;
(3-2) the 360 ° of panoramic pictures forming by specified format image in the image processing system 200 and parameter output module 203 of 360 ° of full-view images and 303 storages of geomagnetic parameter index module and the paired data of geomagnetic parameter, and can form can two-way retrieval index.
In the 4th step, 360 ° of panoramic picture playback terminals obtain 360 ° of panoramic pictures, carry out 360 ° of panoramic pictures and play.
This step is finished by 360 ° of panorama playback terminals 400 in 360 ° of panoramic picture Play Systems:
(4-1) 360 ° of panoramic picture calling modules 401 according to corresponding play parameter by 360 ° of full-view images and geomagnetic parameter calling interface module 304 and 360 ° of full-view images and 303 message exchanges of geomagnetic parameter index module, call corresponding 360 ° of panoramic pictures by 360 ° of full-view images and geomagnetic parameter index module 303 again and carry out the panorama demonstration, and mate according to corresponding geomagnetic parameter, image is corrected;
(4-2) playback terminal geomagnetic parameter acquisition module 402 obtains the geomagnetic parameter of playback terminal in real time;
(4-3) earth induction image operation control module 403 changes into the broadcast range parameter that the control chart picture is play with the geomagnetic parameter that playback terminal geomagnetic parameter acquisition module 402 obtains, and reaches 360 ° of panoramic picture calling modules 401; Refreshing instructions that 360 ° of panoramic pictures in the broadcast window are sent simultaneously, thus impel 360 ° of panoramic picture broadcast windows in the scope of appointment, to refresh.
More than show and described ultimate principle of the present invention, principal character and advantage of the present invention.The technician of the industry should understand; the present invention is not restricted to the described embodiments; that describes in the foregoing description and the instructions just illustrates principle of the present invention; without departing from the spirit and scope of the present invention; the present invention also has various changes and modifications, and these changes and improvements all fall in the claimed scope of the invention.The claimed scope of the present invention is defined by appending claims and equivalent thereof.

Claims (11)

1. 360 ° of panorama Play Systems of realistic space direction are followed in a realization, it is characterized in that described Play System comprises
One image capturing system, described image capturing system carry out the synchronous acquisition of the geomagnetic parameter of the collection of 360 ° of panoramic pictures and panoramic picture correspondence;
One image processing system, described image processing system carries out respective handling to 360 ° of panoramic pictures of described image capturing system collection, and the geomagnetic parameter of described image capturing system collection carried out alignment processing, make 360 ° of panoramic pictures and geomagnetic parameter form corresponding relation;
One supporting system, described supporting system is used to store the information data that described image processing system is finished dealing with, so that the calling of corresponding information data;
One 360 ° of panorama playback terminals, described 360 ° of panorama playback terminals call institute of described supporting system canned data to carry out 360 ° of panoramic pictures and plays, and the geomagnetic parameter information in geomagnetic parameter of self obtaining according to 360 ° of panorama playback terminals and institute of the described supporting system canned data, control 360 ° of panoramic pictures and play, realize following 360 ° of panoramas broadcasts of realistic space direction.
2. a kind of 360 ° of panorama Play Systems of realizing following the realistic space direction according to claim 1 is characterized in that described image capturing system comprises:
The full-view image acquisition module, described full-view image acquisition module is used to gather 360 ° of panoramic pictures;
Geomagnetic parameter acquisition module, described geomagnetic parameter acquisition module are used to gather, transmit and show the geomagnetic parameter of every group of panoramic picture correspondence that described full-view image acquisition module is gathered;
Data sync trigger module, described data sync trigger module are used for the synchro control to described full-view image acquisition module and described geomagnetic parameter acquisition module collecting work;
Data sync storage module, described data sync storage module are used for the data of described full-view image acquisition module of stores synchronized and the collection of described geomagnetic parameter acquisition module;
Power supply and Voltage stabilizing module, described power supply and Voltage stabilizing module provide voltage-stabilizing working power supply for image capturing system, and the abnormity of power supply situation is reported to the police;
Central control module, described central control module are used to control described full-view image acquisition module, geomagnetic parameter acquisition module, data sync trigger module, data sync storage module and power supply and Voltage stabilizing module.
3. a kind of 360 ° of panorama Play Systems of realizing following the realistic space direction according to claim 2, it is characterized in that, also comprise the data preview read module in the described image capturing system, described data preview read module is controlled by described central control module, be used for that the data of described full-view image acquisition module and the collection of described geomagnetic parameter acquisition module are carried out breviary and show, and check.
4. a kind of 360 ° of panorama Play Systems of realizing following the realistic space direction according to claim 1 is characterized in that described image processing system comprises:
360 ° of full-view image die sections, described 360 ° of full-view image die sections be used for to every group of 360 ° of panoramic pictures that form by described image capturing system collection splice, piecemeal and generate topological structure and handle;
Magnetic azimuth parameter synchronization processing module, described magnetic azimuth parameter synchronization processing module and 360 ° every group corresponding geomagnetic parameters of panoramic picture of described 360 ° of full-view image die section synchronous processing are filtered and buffer memory geomagnetic parameter;
Specified format image and parameter output module, described specified format image and parameter output module are integrated the every group of 360 ° of panoramic pictures and the corresponding geomagnetic parameter with corresponding relation of described 360 ° of full-view image die sections and described magnetic azimuth parameter synchronization processing module processing formation, make that every group of 360 ° of panoramic pictures are corresponding one by one with geomagnetic parameter, and generation mapping table, and the file of generation specified format.
5. a kind of 360 ° of panorama Play Systems of realizing following the realistic space direction according to claim 1 is characterized in that, described supporting system comprises:
360 ° of full-view image memory modules, described 360 ° of full-view image memory modules are used for storage administration and are handled the relevant information of 360 ° of panoramic pictures that forms by described image processing system;
Geomagnetic parameter and geography information memory module, described geomagnetic parameter and geography information memory module are used to store the relevant information of being handled the geomagnetic parameter that forms by described image processing system;
360 ° of full-view images and geomagnetic parameter index module, described 360 ° of full-view images and geomagnetic parameter index module are used to store by described image processing system handles the 360 ° of panoramic pictures forming and the paired data of geomagnetic parameter, and the index that formation can two-way retrieval;
360 ° of full-view images and geomagnetic parameter calling interface module, described 360 ° of full-view images and geomagnetic parameter calling interface module realize outside by described 360 ° of full-view images and geomagnetic parameter index module to described 360 ° of full-view image memory modules and described geomagnetic parameter and 360 ° of panoramic pictures of geography information memory module storage and calling of corresponding geomagnetic parameter.
6. a kind of 360 ° of panorama Play Systems of realizing following the realistic space direction according to claim 5, it is characterized in that described 360 ° of panoramas and geomagnetic parameter index module also are used for the data that described geomagnetic parameter and geography information memory module are stored are safeguarded.
7. a kind of 360 ° of panorama Play Systems of realizing following the realistic space direction according to claim 5, it is characterized in that, described supporting system also comprises 360 ° of full-view images and geomagnetic parameter access log module, and described 360 ° of full-view images and geomagnetic parameter access log module are used to write down the process of calling 360 ° of full-view images and geomagnetic parameter.
8. a kind of 360 ° of panorama Play Systems of realizing following the realistic space direction according to claim 1 is characterized in that described 360 ° of panorama playback terminals comprise:
360 ° of panoramic picture calling modules, described 360 ° of panoramic picture calling modules call 360 ° of panoramic pictures storing in the described supporting system and show, and according to corresponding geomagnetic parameter 360 ° of panoramic pictures are corrected;
Playback terminal geomagnetic parameter acquisition module, described playback terminal geomagnetic parameter is obtained the geomagnetic parameter of playback terminal in real time;
Earth induction image operation control module, the geomagnetic parameter that described earth induction image operation control module obtains described playback terminal geomagnetic parameter acquisition module changes into the broadcast range parameter that the control chart picture is play, and reaches described 360 ° of panoramic picture calling modules.
9. the method that 360 ° of panoramas of realistic space direction are play is followed in a realization, it is characterized in that described method utilizes geomagnetic parameter to control the broadcast of 360 ° of panoramic pictures, plays to realize 360 ° of panoramas of following the realistic space direction.
10. the method that a kind of 360 ° of panoramas realizing following the realistic space direction according to claim 9 are play is characterized in that, describedly utilizes geomagnetic parameter to control 360 ° of panoramic pictures to play, realize as follows:
(1) gather 360 ° of panoramic pictures, and these 360 ° of corresponding geomagnetic parameters of panoramic picture of synchronous acquisition;
360 ° of panoramic pictures that (2) will collect and corresponding geomagnetic parameter are handled to integrate and are formed one-to-one relationship, and store;
(3) obtain the geomagnetic parameter of 360 ° of panoramic picture playback terminals in real time, and this geomagnetic parameter is converted into the range parameter of 360 ° of panoramic pictures broadcasts;
(4) 360 ° of panoramic picture playback terminals call corresponding 360 ° of panoramic pictures according to the range parameter that forms and carry out 360 ° of panoramic pictures broadcasts.
11. the method that a kind of 360 ° of panoramas realizing following the realistic space direction according to claim 10 are play, it is characterized in that the image acquisition in the described step (1) is to adopt the fixing mode of the initial angle of panorama collecting device to gather or adopt the mode of real-time angle of the image of each width of cloth participation amalgamation of real time record to gather.
CN201010201793A 2010-06-13 2010-06-13 System and method for realizing 360-degree panoramic play following real space direction Active CN101872243B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010201793A CN101872243B (en) 2010-06-13 2010-06-13 System and method for realizing 360-degree panoramic play following real space direction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010201793A CN101872243B (en) 2010-06-13 2010-06-13 System and method for realizing 360-degree panoramic play following real space direction

Publications (2)

Publication Number Publication Date
CN101872243A true CN101872243A (en) 2010-10-27
CN101872243B CN101872243B (en) 2012-10-10

Family

ID=42997142

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010201793A Active CN101872243B (en) 2010-06-13 2010-06-13 System and method for realizing 360-degree panoramic play following real space direction

Country Status (1)

Country Link
CN (1) CN101872243B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103336535A (en) * 2013-06-20 2013-10-02 上海市城市建设设计研究总院 Cradle head control system in dragging linkage with screen, and control method thereof
CN103472976A (en) * 2013-09-17 2013-12-25 百度在线网络技术(北京)有限公司 Streetscape picture display method and system
CN103543831A (en) * 2013-10-25 2014-01-29 梁权富 Head-mounted panoramic player
CN103841332A (en) * 2014-03-21 2014-06-04 英华达(上海)科技有限公司 Panorama scene shooting and browsing moving device, system and method
CN104079590A (en) * 2013-03-25 2014-10-01 深圳市新锐影视数码有限公司 720-degree panoramic roaming system
CN106162204A (en) * 2016-07-06 2016-11-23 传线网络科技(上海)有限公司 Panoramic video generation, player method, Apparatus and system
CN106445129A (en) * 2016-09-14 2017-02-22 乐视控股(北京)有限公司 Method, device and system for displaying panoramic picture information
CN107623812A (en) * 2016-07-14 2018-01-23 幸福在线(北京)网络技术有限公司 A kind of method, relevant apparatus and system for realizing outdoor scene displaying
CN110622483A (en) * 2017-03-23 2019-12-27 Vid拓展公司 Metrics and messages to improve experience for 360 degree adaptive streaming
US10649546B2 (en) 2014-06-16 2020-05-12 Huawei Technologies Co., Ltd. Method and apparatus for presenting panoramic photo in mobile terminal, and mobile terminal

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004084542A1 (en) * 2003-03-20 2004-09-30 Seijiro Tomita Panoramic picture creating method and device, and monitor system using the method and device
CN1588531A (en) * 2004-08-06 2005-03-02 马堃 Dynamic display method for static image and browser
US6891561B1 (en) * 1999-03-31 2005-05-10 Vulcan Patents Llc Providing visual context for a mobile active visual display of a panoramic region
CN1845094A (en) * 2006-04-29 2006-10-11 上海杰图软件技术有限公司 Method for establishing panorama electronic map service
CN101055494A (en) * 2006-04-13 2007-10-17 上海虚拟谷数码科技有限公司 Dummy scene roaming method and system based on spatial index cube panoramic video
CN101082926A (en) * 2007-07-03 2007-12-05 浙江大学 Modeling approachused for trans-media digital city scenic area
CN101136022A (en) * 2006-09-01 2008-03-05 李筑 Panorama manufacturing and displaying system of resource information

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6891561B1 (en) * 1999-03-31 2005-05-10 Vulcan Patents Llc Providing visual context for a mobile active visual display of a panoramic region
WO2004084542A1 (en) * 2003-03-20 2004-09-30 Seijiro Tomita Panoramic picture creating method and device, and monitor system using the method and device
CN1588531A (en) * 2004-08-06 2005-03-02 马堃 Dynamic display method for static image and browser
CN101055494A (en) * 2006-04-13 2007-10-17 上海虚拟谷数码科技有限公司 Dummy scene roaming method and system based on spatial index cube panoramic video
CN1845094A (en) * 2006-04-29 2006-10-11 上海杰图软件技术有限公司 Method for establishing panorama electronic map service
CN101136022A (en) * 2006-09-01 2008-03-05 李筑 Panorama manufacturing and displaying system of resource information
CN101082926A (en) * 2007-07-03 2007-12-05 浙江大学 Modeling approachused for trans-media digital city scenic area

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104079590A (en) * 2013-03-25 2014-10-01 深圳市新锐影视数码有限公司 720-degree panoramic roaming system
CN103336535A (en) * 2013-06-20 2013-10-02 上海市城市建设设计研究总院 Cradle head control system in dragging linkage with screen, and control method thereof
CN103472976B (en) * 2013-09-17 2017-04-12 百度在线网络技术(北京)有限公司 Streetscape picture display method and system
CN103472976A (en) * 2013-09-17 2013-12-25 百度在线网络技术(北京)有限公司 Streetscape picture display method and system
CN103543831A (en) * 2013-10-25 2014-01-29 梁权富 Head-mounted panoramic player
CN103841332B (en) * 2014-03-21 2018-10-12 英华达(上海)科技有限公司 Panorama scene is shot and the mobile device of browsing, system and method
CN103841332A (en) * 2014-03-21 2014-06-04 英华达(上海)科技有限公司 Panorama scene shooting and browsing moving device, system and method
US10649546B2 (en) 2014-06-16 2020-05-12 Huawei Technologies Co., Ltd. Method and apparatus for presenting panoramic photo in mobile terminal, and mobile terminal
US11126275B2 (en) 2014-06-16 2021-09-21 Huawei Technologies Co., Ltd. Method and apparatus for presenting panoramic photo in mobile terminal, and mobile terminal
CN106162204A (en) * 2016-07-06 2016-11-23 传线网络科技(上海)有限公司 Panoramic video generation, player method, Apparatus and system
CN107623812A (en) * 2016-07-14 2018-01-23 幸福在线(北京)网络技术有限公司 A kind of method, relevant apparatus and system for realizing outdoor scene displaying
CN106445129A (en) * 2016-09-14 2017-02-22 乐视控股(北京)有限公司 Method, device and system for displaying panoramic picture information
CN110622483A (en) * 2017-03-23 2019-12-27 Vid拓展公司 Metrics and messages to improve experience for 360 degree adaptive streaming
US11166072B2 (en) 2017-03-23 2021-11-02 Vid Scale, Inc. Metrics and messages to improve experience for 360-degree adaptive streaming
US11849178B2 (en) 2017-03-23 2023-12-19 Vid Scale, Inc. Metrics and messages to improve experience for 360-degree adaptive streaming

Also Published As

Publication number Publication date
CN101872243B (en) 2012-10-10

Similar Documents

Publication Publication Date Title
CN101872243B (en) System and method for realizing 360-degree panoramic play following real space direction
US11037365B2 (en) Method, apparatus, medium, terminal, and device for processing multi-angle free-perspective data
KR101667345B1 (en) System and method of indicating transition between street level images
US10403044B2 (en) Telelocation: location sharing for users in augmented and virtual reality environments
KR102038856B1 (en) System and method for creating an environment and for sharing a location based experience in an environment
JP2020514900A (en) Mixed reality viewer system and method
US20120281119A1 (en) Image data creation support device and image data creation support method
CN106951561B (en) Electronic map system based on virtual reality technology and GIS data
CN106683197A (en) VR (virtual reality) and AR (augmented reality) technology fused building exhibition system and VR and AR technology fused building exhibition method
CN107925753A (en) The method and system of 3D rendering seizure is carried out using dynamic camera
CN106162204A (en) Panoramic video generation, player method, Apparatus and system
JP2012080431A (en) Panoramic image display device and panoramic image display method
CN102054290A (en) Construction method of panoramic/realistic hybrid reality platform
CN106357966A (en) Panoramic image photographing device and panoramic image acquiring method
KR102435185B1 (en) How to create 3D images based on 360° VR shooting and provide 360° VR contents service
US20220295040A1 (en) Augmented reality system with remote presentation including 3d graphics extending beyond frame
CN107957772B (en) Processing method for collecting VR image in real scene and method for realizing VR experience
CN105979140A (en) Image generation device and image generation method
CN103777901A (en) History reappearing method and system used for scenic spot visiting
CN110058696A (en) A kind of virtual reality implementation method and its application method and correlation technique device
US20220295141A1 (en) Remote presentation with augmented reality content synchronized with separately displayed video content
US20220295032A1 (en) Augmented reality system for remote presentation for viewing an event
CN104854861B (en) Real viewpoint video method and apparatus
JP6617547B2 (en) Image management system, image management method, and program
JP2009087176A (en) Object generation system, object generation device, and object generation program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20101027

Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd.

Assignor: Shanghai Jietu Software Techn Co., Ltd.

Contract record no.: 2014310000049

Denomination of invention: System and method for realizing 360-degree panoramic play following real space direction

Granted publication date: 20121010

License type: Common License

Record date: 20140321

LICC Enforcement, change and cancellation of record of contracts on the licence for exploitation of a patent or utility model