CN106162204A - Panoramic video generation, player method, Apparatus and system - Google Patents

Panoramic video generation, player method, Apparatus and system Download PDF

Info

Publication number
CN106162204A
CN106162204A CN201610525899.8A CN201610525899A CN106162204A CN 106162204 A CN106162204 A CN 106162204A CN 201610525899 A CN201610525899 A CN 201610525899A CN 106162204 A CN106162204 A CN 106162204A
Authority
CN
China
Prior art keywords
video
frame
information
user
panoramic video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610525899.8A
Other languages
Chinese (zh)
Inventor
王涛
柯金杰
赵刚
顾思斌
潘柏宇
王冀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chuanxian Network Technology Shanghai Co Ltd
Original Assignee
Chuanxian Network Technology Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chuanxian Network Technology Shanghai Co Ltd filed Critical Chuanxian Network Technology Shanghai Co Ltd
Priority to CN201610525899.8A priority Critical patent/CN106162204A/en
Publication of CN106162204A publication Critical patent/CN106162204A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The present invention relates to a kind of panoramic video generation, player method, Apparatus and system.The method includes: obtain the frame of video of panoramic video；Determining the corresponding azimuth information of frame of video and/or geographical location information, wherein the azimuth information of frame of video represents the shooting orientation of frame of video, and the geographical location information of frame of video represents the camera site of frame of video；Frame of video is associated with azimuth information and/or described geographical location information；And generate panoramic video data based on the frame of video after association and azimuth information and/or geographical location information.The present invention can enable play panoramic video with towards orientation and/or location adapt, enhance user's immersion VR experience.

Description

Panoramic video generation, player method, Apparatus and system
Technical field
The present invention relates to video technique field, particularly relate to a kind of panoramic video generation, player method, panoramic video life One-tenth, playing device and panoramic video system.
Background technology
Panoramic video technology relates to the fields such as computer graphics, human-computer interaction technology, sensing technology, artificial intelligence, it With computational methods generate three-dimensional true to nature depending on, the sensation such as listen, provide user with regard to the simulation of the sense organ such as vision, the sense of hearing, allow user " projected " to oneself in this virtual environment by using various device, make user as immersively observed three-dimensional space Interior scene.But, at present when different user watches panoramic video by panoramic video playback equipment, all begin at identical Acquiescence starting point and direction, the broadcasting content that user sees may the actual environment residing with him or the direction paid close attention to complete Uncorrelated, the broadcasting causing panoramic video is incompatible with the appreciation demand of user, causes user to lack the virtual existing of immersion Real (VR, Virtual Reality) experiences, but, if manually adjusted the broadcasting content of panoramic video by user, again can Bring operation burden, the energy of dispersion user to user, affect Consumer's Experience.
Content of the invention
Technical problem
In view of this, the present invention proposes the generation of a kind of panoramic video, broadcasting scheme so that the broadcasting of panoramic video can It is adapted to the appreciation demand of user, strengthen the VR experience effect of user.
Solution
In order to solve above-mentioned technical problem, it is proposed that a kind of panoramic video generates method, and described method includes: obtain panorama The frame of video of video；Determine the corresponding azimuth information of described frame of video and/or geographical location information, the side of wherein said frame of video Position information represents the shooting orientation of described frame of video, and the geographical location information of described frame of video represents the shooting position of described frame of video Put；Described frame of video is associated with described azimuth information and/or described geographical location information；And based on the institute after association State frame of video and described azimuth information and/or described geographical location information generates panoramic video data.
In order to solve above-mentioned technical problem, it is proposed that a kind of panoramic video player method, described method includes: obtain panorama Video data, wherein said panoramic video data include frame of video and the azimuth information being associated with described frame of video and/or ground Reason positional information；Obtaining azimuth information and/or the geographical location information of user, the azimuth information of wherein said user represents described User towards orientation, the geographical location information of described user represents the geographical position residing for described user；By aphorama frequency Frame of video corresponding with the azimuth information of user and/or geographical location information according to shows user.
In order to solve above-mentioned technical problem, it is proposed that a kind of panoramic video generating means, described device includes: video acquisition Parts, for obtaining the frame of video of panoramic video；Determine parts, be used for determining the corresponding azimuth information of described frame of video and/or Geographical location information, the azimuth information of wherein said frame of video represents the shooting orientation of described frame of video, the ground of described frame of video Reason positional information represents the camera site of described frame of video；Associated member, for by described frame of video and described azimuth information and/ Or described geographical location information is associated；And generating unit, for based on the described frame of video after association and described side Position information and/or described geographical location information generate panoramic video data.
In order to solve above-mentioned technical problem, it is proposed that a kind of panoramic video playing device, described device includes: first obtains Parts, are used for obtaining panoramic video data, and wherein said panoramic video data include frame of video and are associated with described frame of video Azimuth information and/or geographical location information；Second obtaining widget, for obtaining azimuth information and/or the geographical position of user Information, the azimuth information of wherein said user represent described user towards orientation, the geographical location information of described user represents Geographical position residing for described user；Display member, for by azimuth information and/or the geography with user in panoramic video data The corresponding frame of video of positional information shows user.
In order to solve above-mentioned technical problem, it is proposed that panoramic video system, described panoramic video system includes: panoramic video Collecting device, for gathering the frame of video of panoramic video and being supplied to panoramic video generation equipment；Panoramic video generates equipment, institute State panoramic video generation equipment and carry above-mentioned panoramic video generating means；Server, is used for storing described panoramic video raw The panoramic video data that forming apparatus uploads；Panoramic video playback equipment, described panoramic video playback equipment carries above-mentioned complete Scape video play device, described panoramic video playback equipment is used for downloading panoramic video data from described server, and is user Play out.
Beneficial effect
By the frame of video of acquisition panoramic video, and determine the corresponding azimuth information of frame of video and/or geographical location information； Frame of video is associated with azimuth information and/or geographical location information such that it is able to when playing panoramic video, can basis The azimuth information of user and/or geographical location information, by corresponding with the azimuth information and/or geographical location information of user complete Scape video data display, to user, enables broadcasting content and actual environment residing for user and/or the concern direction of panoramic video Unanimously, the VR making user obtain immersion experiences.
According to below with reference to the accompanying drawings to detailed description of illustrative embodiments, the further feature of the present invention and aspect will become Clear.
Brief description
Comprise in the description and constitute a part of accompanying drawing of specification and specification together illustrates the present invention's Exemplary embodiment, feature and aspect, and for explaining the principle of the present invention.
Fig. 1 illustrates the flow chart of panoramic video generation method according to an embodiment of the invention；
Fig. 2 illustrates the flow chart of panoramic video player method according to an embodiment of the invention；
Fig. 3 illustrates the structure chart of panoramic video generating means according to an embodiment of the invention；
Fig. 4 illustrates another structure chart of panoramic video generating means according to an embodiment of the invention；
Fig. 5 illustrates the structure chart of panoramic video playing device according to an embodiment of the invention；
Fig. 6 illustrates another structure chart of panoramic video playing device according to an embodiment of the invention；
Fig. 7 illustrates the structure chart of panoramic video system according to an embodiment of the invention；
Fig. 8 shows the structured flowchart of a kind of panoramic video equipment of an alternative embodiment of the invention.
Detailed description of the invention
Describe the various exemplary embodiments of the present invention, feature and aspect below with reference to accompanying drawing in detail.In accompanying drawing identical Reference represent the same or analogous element of function.Although the various aspects of embodiment shown in the drawings, but remove Non-specifically is pointed out, it is not necessary to accompanying drawing drawn to scale.
Word " exemplary " special here means " being used as example, embodiment or illustrative ".Here as " exemplary " Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, in order to better illustrate the present invention, detailed description of the invention below gives numerous details. It will be appreciated by those skilled in the art that do not have some detail, the present invention equally implements.In some instances, for Method well known to those skilled in the art, means, element and circuit are not described in detail, in order to highlight the purport of the present invention.
Embodiment 1
Fig. 1 illustrates the flow chart of panoramic video generation method according to an embodiment of the invention.As it is shown in figure 1, the method Can be applicable to panoramic video and generate equipment, this panoramic video generates method and specifically includes that
Step 101, obtains the frame of video of panoramic video；
Step 102, determines the corresponding azimuth information of described frame of video and/or geographical location information, wherein said frame of video Azimuth information represent the shooting orientation of described frame of video, the geographical location information of described frame of video represents the bat of described frame of video Act as regent and put；
Described frame of video is associated by step 103 with described azimuth information and/or described geographical location information；And
Step 104, raw based on the described frame of video after association and described azimuth information and/or described geographical location information Become panorama video data.
The panoramic video that the embodiment of the present invention provides generates method, can obtain the frame of video of panoramic video, determine video Frame of video can be carried out by the corresponding azimuth information of frame and/or geographical location information with azimuth information and/or geographical location information Association, and generate panoramic video data based on the frame of video after association and azimuth information and/or geographical location information.By upper State technological means, make panoramic video combine azimuth information and geographical location information, enabling based on orientation needed for user and/ Or position carrys out playing panoramic video, the VR enhancing user's immersion experiences.
In one example, azimuth information described in step 102 can include following in one or more: east, the southeast, South, southwest, west, northwest, north, northeast, upper and lower；Horizontal direction excursion is the azimuth of 0 degree to 360 degree；Vertical direction becomes Change scope is the azimuth of 0 degree to 360 degree.
In one example, the frame of video of panoramic video can obtain from panoramic video collecting device, panoramic video collection Equipment can be device or a combination thereof, the collecting device of the frame of video that camera, sensor etc. arbitrarily can gather panoramic video Can be one or more, desired position can be laid in a distributed manner, and by wired or wireless mode by regarding of being gathered Frequently frame transmission generates equipment to panoramic video, and panoramic video generates the place that can carry out the present embodiment after equipment obtains these frame of video Reason, to generate panoramic video data.
As a example by carrying out panoramic video collection to museum, many camera lenses can be used to carry out full side to museum 1 showroom The video image acquisition of position, for example, can use 10 camera lenses, makes the shooting orientation of 10 camera lenses be respectively east, the southeast, south, west South, west, northwest, north, northeast, upper and lower, owing to each camera lens has determined that shooting orientation, the therefore ID according to each camera lens, I.e. can determine that the corresponding azimuth information with the frame of video captured by this camera lens.If using the preferable wide-angle lens in shooting visual angle, May be used without 6 camera lenses, make the shooting orientation of 6 camera lenses be respectively east, south, west, north, upper and lower carry out No. 1 showroom entirely The video image acquisition in orientation.Also can be by lens arrangement on circular guideway, camera lens can make 0 degree to 360 degree rotation along circular guideway Turn, when this lens shooting video image, the recordable a certain moment, the orientation arriving with the corresponding rotation of lens of frame of video of shooting Angle.Multiple camera lens can also be equidistantly spaced from circular guideway, for example, can arrange 3 camera lenses on circular guideway, camera lens Shooting azimuth is respectively 0 degree, 120 degree, 240 degree, and owing to each camera lens has determined that shooting orientation, therefore each camera lens exists During shooting, it may be determined that with the captured corresponding azimuth information of frame of video.Can be by being respectively arranged circular guideway in the horizontal direction With the camera lens on vertical direction circular guideway, omnibearing video image acquisition is carried out to showroom.Above example, can make complete The frame of video of scape video is corresponding with azimuth information, it is simple to when panoramic video plays out, can be according to the appreciation need of user The visual angle of panoramic video to be changed, so that the orientation phase one that in panoramic video, the shooting orientation of broadcasting pictures is paid close attention to user Causing, the VR enhancing user's immersion experiences.
In one example, geographical location information described in step 102 can include the warp of the camera site of described frame of video Latitude information, and/or the camera site of described frame of video is relative to the displacement information of reference position.
Again as a example by panoramic video collection is carried out to museum, can appoint at the doorway in museum and take a little as aphorama The starting point of frequency shooting, proceeds by the collection of panoramic video, and datum mark (the i.e. benchmark position shooting this as subsequent movement Put).The positioning instruments such as gps receiver can be used in starting point, obtain the corresponding longitude and latitude of frame of video in start position shooting Information.The positioning precision of usual gps receiver is between 3 meters to 30 meters, and is affected by the weather such as dense fog, cloud cover, Do not receive latitude and longitude information sometimes, therefore, when can move position shooting in little scope, use relative to datum mark Displacement information identify diverse location shooting the corresponding geographical location information of frame of video.Those skilled in the art can adopt Obtain the displacement information relative to datum mark for the taking lens by prior art (such as electronic compass, range unit etc.), this Bright this is not restricted.Certainly, in the case of positioning instrument precision is sufficiently high, it is also possible to all use shooting for each frame of video The latitude and longitude information of position is as geographical location information.Above example, can make frame of video and the geographical location information of panoramic video Corresponding, it is simple to when playing panoramic video, can need to change the bat of the broadcasting pictures of panoramic video according to the appreciation of user Acting as regent and putting so that the content of broadcasting pictures is consistent with the physical location residing for user, the VR enhancing user's immersion experiences.
As a example by panoramic video collection is carried out to museum, can select according to the layout of the floor space in museum, showroom Selecting 500 to 800 diverse locations, carrying out the video acquisition in each orientation of panoramic video, the camera site of selection is more, in difference The orientation of position shooting is more, is more conducive to user freely to appreciate from diverse location, different angles on one's own initiative in panoramic video The concrete style and features in museum.
In one example, can adopt and record the azimuth information corresponding with the frame of video of panoramic video with the following method And/or geographical location information.For example, when gathering the panoramic video based on this kind of still image in museum, can remember in starting point Record camera lens gathers the time of frame of video and the azimuth information of this frame of video this camera lens corresponding and this camera lens longitude and latitude in starting point Information, upper once gather frame of video when, azimuth information can be decomposed into change horizontally and vertically, record this time Azimuth information and last azimuth information difference both horizontally and vertically, also recordable this displacement information and upper The difference of secondary displacement information, additionally, between the timestamp for identifying frame of video can be by the time of the adjacent frame of video twice of collection Every calculating.By above-mentioned technological means, data volume can be effectively reduced, reduce video capture device hardware handles video data Pressure, and saved data space.
In one example, can be associated it for each frame of video in panoramic video in step 103 corresponding Azimuth information and/or geographical location information, it is also possible to be every certain frame of video interval stats with associate an azimuth information And/or geographical location information, this frame of video is spaced and can choose as required, for example, if shooting direction and position Switch panoramic video more frequently, less frame of video interval can be chosen, if shooting direction and position switching less frequency Numerous panoramic video, can choose bigger frame of video interval.One example of interrelational form is by directional information and/or geography Positional information is associated with the timestamp of frame of video, such as, with the time shaft identical with frame of video, record added up direction letter Breath and/or the time offset of the corresponding panoramic video of geographical location information, thus set up direction information and/or geographical position Associating between information with the frame of video corresponding to identical time offset.
In another example, this panoramic video generates method and may also include that to acquired described frame of video, described side Position information and/or described geographical location information carry out duplicate removal.
For example, due to video generation equipment acquisition panoramic video, when, a large amount of different azimuth is obtained, diverse location Video requency frame data, and need record and the corresponding azimuth information of these frame of video and geographical location information, video is generated by this The hardware processing capability of equipment poses a big pressure, simultaneously need to relative to ordinary video collection and generate more data storage Space, therefore, can be right according to the collection demand (for example going up in an example, the museum with based on still image) of panoramic video Acquired frame of video and corresponding azimuth information and/or described geographical location information carry out duplicate removal.For example, for direction letter They can be associated with a common direction letter by breath and/or the unconverted one group of continuous print frame of video of geographical location information Breath and/or geographical location information, and record the start frame of this group frame of video, close without for each frame of video therein Join and preserve respective directional information and/or geographical location information, to reduce the hardware processing capability generating equipment to video Pressure, and save memory space.Correspondingly, when playing panoramic video, can be according to the needs of user from the beginning of above-mentioned start frame Play this group frame of video.Those skilled in the art can use existing De-weight method to carry out aforesaid operations, and the present invention is to this not It is restricted.
In one example, this panoramic video generates method and may also include that the establishment description corresponding with described frame of video Information；Described frame of video and described azimuth information and/or described geographical location information and described description information are closed Connection；Based on the described frame of video after association, described azimuth information and/or described geographical location information and described description information Generate panoramic video data.
For example, description information can be for some special object in captured frame of video or this frame of video Word, voice or other any type of descriptions, for example, one piece of museum four directions upright stone tablet is carried out panoramic video gather when, Can create the Word message corresponding with the frame of video in each face of upright stone tablet, four directions or voice messaging, this can be by being for example manually entered Description information, or be identified to the object in frame of video and describe the various modes such as information matches realizing.For example, by upright stone tablet Ancient Chinese prose be converted to simplified Chinese character, or the voice etc. of the history story of explanation an inscription on a tablet.Can be by the corresponding Word message in different upright stone tablet faces From the frame of video in different upright stone tablet faces and after corresponding azimuth information and/or geographical location information are associated with frame of video, generate Panoramic video data, so, when panoramic video is play, can the azimuth information according to user and/or geographical location information to While user shows full-view video image, provide a user with the description of special object in the current playing frames of panoramic video Information (such as Word message, voice messaging etc.), to facilitate the understanding to perpetual object for the user.
In one example, this panoramic video generation method may also include that to acquired frame of video corresponding with frame of video Azimuth information and/or geographical location information (and optional description information etc.) preserve, and by the frame of video preserving, side Position information and/or geographical position etc. carry out package according to predetermined form, generate panoramic video packet, also can be complete by generate Jing Shipinshuojubao is uploaded onto the server by network, stores for server, facilitates user to download broadcasting.This area skill Art personnel can use existing storage method, package method, compression method and transmission method to carry out aforesaid operations, and the present invention is to this It is not restricted.
Embodiment 2
Fig. 2 illustrates the flow chart of panoramic video player method according to an embodiment of the invention.As described in Figure 2, the method Can be applicable to panoramic video playback equipment.This panoramic video player method specifically includes that
Step 201, obtain panoramic video data, wherein said panoramic video data include frame of video and with described frame of video The azimuth information being associated and/or geographical location information；
Step 202, obtains azimuth information and/or geographical location information, the azimuth information table of wherein said user of user Show described user towards orientation, the geographical location information of described user represents the geographical position residing for described user；
Step 203, by video corresponding with the azimuth information of user and/or geographical location information in panoramic video data Frame display is to user.
The panoramic video player method that the embodiment of the present invention provides, can obtain the azimuth information of user and/or geographical position Confidence ceases, and can be by the video in the panoramic video data corresponding with the azimuth information and/or geographical location information of user Frame display is to user.So, the panoramic video play can with user present position and/or towards the side of (concern) To adapting, the VR enhancing user's immersion experiences.
In one example, azimuth information and/or the geographical location information of the user in step 202 can pass through multiple sides Formula obtains, for example, can be used by users such as wearable device (the such as VR helmet), intelligent terminals (such as smart mobile phone) Equipment obtains, it is also possible to is acquired by the picture pick-up device in site environment, sensing equipment etc., and passes to panoramic video Playback equipment, the invention is not limited in this regard.
In one example, above-mentioned steps 203 is by azimuth information and/or the geographical position with user in panoramic video data The corresponding frame of video of information shows user, it may include: azimuth information and/or the geographical location information of user are mapped to entirely Corresponding azimuth information and/or geographical location information in scape video, will be with this corresponding azimuth information and/or geographical location information The frame of video being associated shows user.
Wearing as a example by the panoramic video of the cubic upright stone tablet generating in VR helmet viewing embodiment 1 by user, the VR helmet can pass through Wireless network downloads, from server, the panoramic video packet generating according to embodiment 1, and can enter this panoramic video packet Row unpacks, to obtain the frame of video of panoramic video and the azimuth information being associated with frame of video and/or geographical location information.VR head Helmet can Real-time Collection user location information and geographic location information, can be by real-time for user orientation and/or geographical position and panorama Corresponding relation (i.e. mapping) is set up in orientation in video and/or geographical position, can make panoramic video institute by above-mentioned mapping The shooting orientation of frame of video play and/or camera site can be according to the orientation residing in actual environment of user and/or positions Change and change.For example, after user appreciates a face an inscription on a tablet of four directions upright stone tablet in panoramic video, want to appreciate an adjacent face an inscription on a tablet Word, now user can carry out, around the cubic upright stone tablet that eyes are watched, the viewing position detoured to change oneself in actual environment Put, and rotatable head changes the viewing orientation of oneself, based on the above-mentioned corresponding relation in the method, the broadcasting of panoramic video Picture, also converted into the picture of corresponding shooting direction and camera site, keeps consistent with the viewing location of user and orientation.Logical Crossing above-mentioned technological means, user can need freely to walk about according to the appreciation of oneself, can freely select to be in a certain position, with Video image in panoramic video is appreciated in a certain orientation, and the VR enhancing user's immersion experiences.
It is right in panoramic video that the azimuth information of user and/or geographical location information and user can as required, be set " mapping " relation between the azimuth information answered and/or geographical location information, the invention is not limited in this regard.For example, if entirely The azimuth information of the frame of video association in scape video is one of east, south, west, north, upper and lower six direction, and the VR helmet is adopted The user location information of collection is azimuth information, then can set up azimuthal angular range of user and the respective party of frame of video Mapping relations between to (for example on the basis of direct north, the azimuth of 0 degree to 22.5 degree, and 337.5 degree to 360 degree Map to " northern " direction of panoramic video, etc.).Again for example, if the azimuth information of frame of video association is in panoramic video One of east, south, west, north, upper and lower six direction, and detect discovery user towards southeastern direction, owing to adopting at panoramic video During collection, do not gather the frame of video in orientation, the southeast, now, can the azimuth information of just user " eastern " that be mapped in panoramic video User is showed after " southern " both direction, and the frame of video synthesis being associated with both direction.To geographical location information also Mapping relations can be set up in a similar manner.
In one example, above-mentioned steps 203 is by azimuth information and/or the geographical position with user in panoramic video data The corresponding frame of video of information shows user, it may include: azimuth information and/or the geographical location information of user are mapped to entirely Corresponding azimuth information and/or geographical location information in scape video, determine and this corresponding azimuth information and/or geographical position letter First frame of video of manner of breathing association；Determine the second frame of video that shooting direction is adjacent with described first frame of video；By described first User is showed after frame of video and the synthesis of the second frame of video.
For example, in order to increase the field range showing user in panoramic video, if closed after mapping It is coupled to the frame of video in " eastern " direction, show use after northeast, east, the frame of video in three the adjacent directions in the southeast can be synthesized Family, to provide broader field range.
In one example, this panoramic video data may also include the description information being associated with described frame of video；Will be complete Frame of video corresponding with the azimuth information of user and/or geographical location information in scape video data shows user, it may include: By frame of video corresponding with the azimuth information of user and/or geographical location information in panoramic video data and retouching of being associated The information of stating shows user.With regard to description information shows the explanation of user can be found in the related description in embodiment 1, herein For simplicity's sake, repeat no more.
In one example, this panoramic video player method also includes: require the prompting of target bearing in response to user, By user currently towards the rotation direction of orientation to target bearing and/or rotation amplitude be indicated to user.
For example, traditional panoramic video is not owing to carrying out associating of frame of video and azimuth information, and multiple users exist When watching same panoramic video, and the inapt orientation known faced by oneself, for example, traditional same of multi-person interactive viewing During panoramic video, a certain user points out everybody to see eastwards, but everybody is when watching this traditional panoramic video, in this case it is not apparent that east exists Which orientation.In the embodiment of the present invention 1, frame of video is associated by panoramic video generation method with azimuth information, is therefore entering When row panoramic video is play, different user can be made to have unified azimuthal viewing angle, panoramic video playback equipment (the such as VR helmet) The prompting that a certain user requires that everybody sees eastwards can be responded require, detect each user currently towards orientation, and may indicate that to respectively User sees eastwards the direction (or also can indicate that rotational angle) each needing to rotate, and user can be by the rotation side of this instruction To, angle, rotation head.As it was noted above, panoramic video playback equipment can regard accordingly in the direction broadcasting according to faced by user Frequently frame, after therefore different user turns to equidirectional as indicated, will have unified azimuthal viewing angle, improve user it Between interaction, enhance user's immersion VR experience.
In one example, foregoing by azimuth information and/or the geographical position with user in panoramic video data The corresponding frame of video of information shows user, it may include: corresponding with the azimuth information and/or geographical location information with user Panoramic video data in frame of video as starting point, show the subsequent video frame in panoramic video data.For example, change user In the case of change towards orientation or residing geographical position, can be with the direction aphorama frequency corresponding with position after changing Frame of video according to continues to play subsequent video frame, i.e. follow-up panoramic video content as starting point.
In one example, the present embodiment also can input according to user azimuth information and/or geographical position are shown Panoramic video.For example, the azimuth information of user's input and/or geographical location information can be mapped to corresponding side in panoramic video Position information and/or geographical location information, and the video being associated with described corresponding azimuth information and/or geographical location information Frame display is to user.For example, user can be by its shooting orientation wanting viewing of the input such as button, gesture motion and shooting position Putting, correspondingly, panoramic video can switch to the frame of video corresponding with this shooting orientation and camera site, and with this frame of video is Starting point continues to play.
Embodiment 3
Fig. 3 illustrates the structure chart of panoramic video generating means according to an embodiment of the invention.As it is shown on figure 3, this device 300 can be used for realizing the operation of each step of method in embodiment 1, and this panoramic video generating means 300 specifically includes that
Video acquisition parts 301, for obtaining the frame of video of panoramic video；
Determine parts 302, be used for determining the corresponding azimuth information of described frame of video and/or geographical location information, Qi Zhongsuo The azimuth information stating frame of video represents the shooting orientation of described frame of video, the geographical location information of described frame of video represent described in regard Frequently the camera site of frame；
Associated member 303, for closing described frame of video with described azimuth information and/or described geographical location information Connection；And
Generating unit 304, the described frame of video after being used for based on association and described azimuth information and/or described geographical position Confidence breath generates panoramic video data.
By obtaining the frame of video of panoramic video, determine the corresponding azimuth information of frame of video and/or geographical location information, energy Enough frame of video is associated with azimuth information and/or geographical location information, and based on the frame of video after association and orientation letter Breath and/or geographical location information generate panoramic video data, and panoramic video generating means according to embodiments of the present invention can make Panoramic video combines azimuth information and geographical location information, can play panorama based on orientation needed for user and/or position Video, the VR enhancing user's immersion experiences.
In one example, described azimuth information can include following in one or more: east, the southeast, south, southwest, west, Northwest, north, northeast, upper and lower；Horizontal direction excursion is the azimuth of 0 degree to 360 degree；Vertical direction excursion is 0 degree To the azimuth of 360 degree.
Video acquisition parts 301 can obtain regarding of the panoramic video from the video capture device such as camera, sensor Frequently frame.As a example by carrying out panoramic video collection to museum, many camera lenses can be used to carry out omnibearing to museum 1 showroom Video image acquisition, for example, video acquisition parts can use 10 camera lenses to shoot, and is supplied to the frame of video photographing Video acquisition parts 301, can make 10 camera lenses shooting orientation be respectively east, the southeast, south, southwest, west, northwest, north, northeast, Upper and lower, owing to each camera lens has determined that shooting orientation, therefore each camera lens is when shooting, determines parts 302 according to video Frame of video corresponding camera lens ID acquired in obtaining widget 301, i.e. can determine that the corresponding azimuth information with acquired frame of video. If using shooting visual angle preferable wide-angle lens, it is possible to uses 6 camera lenses, make the shooting orientation of 6 camera lenses be respectively eastern, South, west, north, upper and lower omnibearing video image acquisition is carried out to No. 1 showroom.Also can be by lens arrangement at circular guideway On, camera lens can make 0 degree to 360 degree rotation along circular guideway, when this lens shooting video image, determines that parts 302 are recordable In a certain moment, the azimuth arrived with the corresponding rotation of lens of frame of video of shooting, this azimuth can be carried by video capture device Supply determines parts 302, it is also possible to be supplied to determine parts 302 by the driver part driving the motion of video acquisition parts.Also may be used To be equidistantly spaced from multiple camera lens on circular guideway, for example, can arrange 3 camera lenses, the shooting orientation of camera lens on circular guideway Angle is respectively 0 degree, 120 degree, 240 degree, and owing to each camera lens has determined that shooting orientation, therefore each camera lens is when shooting, Determine that parts 302 can determine that the corresponding azimuth information with captured frame of video.Can be circular in the horizontal direction by being respectively arranged Camera lens on guide rail and vertical direction circular guideway carries out omnibearing video image acquisition to showroom.Above example is permissible The frame of video making panoramic video is corresponding with azimuth information, it is simple to when panoramic video plays out, can glad according to user Reward needs to change the visual angle of panoramic video, so that the orientation phase that in panoramic video, the shooting orientation of broadcasting pictures is paid close attention to user Unanimously, the VR enhancing user's immersion experiences.
In one example, described geographical location information can include the latitude and longitude information of the camera site of described frame of video, And/or the camera site of described frame of video is relative to the displacement information of reference position.
Again as a example by panoramic video collection is carried out to museum, can appoint at the doorway in museum and take a little as aphorama The starting point of frequency shooting, proceeds by the collection of panoramic video, determines the benchmark that this can be shot by parts 302 as subsequent movement Point (i.e. reference position), determines that parts 302 can be connected with positioning instruments such as gps receivers, can utilize GPS receiver in starting point Devices etc. position instrument, obtain the corresponding latitude and longitude information of frame of video in start position shooting.The positioning accurate of usual gps receiver Degree is between 3 meters to 30 meters, and is affected by the weather such as dense fog, cloud cover, does not receives latitude and longitude information sometimes, because of This, when can move position shooting in little scope, use and identify at diverse location relative to the displacement information of datum mark The corresponding geographical location information of frame of video of shooting.Determine that parts 302 can be with the direction such as electronic compass, range unit and position Measurement apparatus connects, and obtains the displacement information relative to datum mark for the taking lens.Certainly, sufficiently high in positioning instrument precision In the case of, it is also possible to all use the latitude and longitude information of camera site as geographical location information for each frame of video.Above example, The frame of video that can make panoramic video is corresponding with geographical location information, it is simple to when playing panoramic video, can be according to user's Appreciate the camera site needing to change the broadcasting pictures of panoramic video so that the content of broadcasting pictures and the actual bit residing for user Putting consistent, the VR enhancing user's immersion experiences.
As a example by panoramic video collection is carried out to museum, can select according to the layout of the floor space in museum, showroom Selecting 500 to 800 diverse locations, carrying out the video acquisition in each orientation of panoramic video, the camera site of selection is more, in difference The orientation of position shooting is more, is more conducive to user freely to appreciate from diverse location, different angles on one's own initiative in panoramic video The concrete style and features in museum.
In one example, determine that parts 302 can record in the following way corresponding with the frame of video of panoramic video Azimuth information and/or geographical location information.For example, when gathering the panoramic video based on this kind of still image in museum, really Limiting-members 302 can gather the time of frame of video and the azimuth information of this frame of video this camera lens corresponding at starting point record camera lens With this camera lens in the latitude and longitude information of starting point, upper once gather frame of video when, azimuth information can be decomposed into horizontal direction and The change of vertical direction, records this azimuth information and last azimuth information difference both horizontally and vertically, also Recordable this displacement information and the difference of last displacement information, additionally, the timestamp being used for identifying frame of video can be by adopting The time interval collecting adjacent frame of video twice calculates.By above-mentioned technological means, data volume can be effectively reduced, reduce video raw The pressure of forming apparatus hardware handles video data, and saved data space.
In one example, as shown in Figure 4, panoramic video generating means 300 may also include that heavy parts 305, and it is right to be used for The described frame of video, described azimuth information and/or the described geographical location information that are gathered carry out duplicate removal.
For example, due to video generation equipment acquisition panoramic video, when, a large amount of different azimuth is obtained, diverse location Video requency frame data, and need record and the corresponding azimuth information of these frame of video and geographical location information, video is generated by this The hardware processing capability of equipment poses a big pressure, simultaneously need to relative to ordinary video collection, generate the storage of more data Space, therefore, goes heavy parts 305 (for example to go up in an example, based on still image according to the collection demand of panoramic video Museum), duplicate removal is carried out to acquired frame of video and corresponding azimuth information and/or described geographical location information.For example, Go heavy parts 305 for the unconverted one group of continuous print frame of video of directional information and/or geographical location information, they can be closed It is linked to a common directional information and/or geographical location information, and the start frame of this group frame of video recordable, without pin Associate and preserve respective directional information and/or geographical location information to each frame of video therein, raw to reduce to video The pressure of the hardware processing capability of forming apparatus, and memory space can be saved.Correspondingly, when playing panoramic video, can according to The needs at family commence play out this group frame of video from above-mentioned start frame.It will be understood by those skilled in the art that heavy parts 305 can use Existing De-weight method realizes aforesaid operations, the invention is not limited in this regard.
In one example, as shown in Figure 4, panoramic video generating means 300 may also include that information describes parts 306, uses In the establishment description information corresponding with acquired frame of video；Wherein, associated member 303 can be additionally used in by described frame of video with Described azimuth information and/or described geographical location information and described description information are associated；Generating unit 304 can also be used with Described frame of video after based on association, described azimuth information and/or described geographical location information and described description information are raw Become panorama video data.
For example, description information can be for some special object in captured frame of video or this frame of video Word, voice or other any type of descriptions, for example, video capture device is carrying out panorama to one piece of museum four directions upright stone tablet During video acquisition, information describes parts 306 can create the Word message corresponding with the frame of video in each face of upright stone tablet, four directions or voice Information, the object in frame of video by being for example manually entered description information, or can be identified and describe information matches by this Realize etc. various modes.For example, the ancient Chinese prose on upright stone tablet can be converted to simplified Chinese character, or the voice of the history story of explanation an inscription on a tablet Deng.Associated member 303 can be by the corresponding Word message in different upright stone tablet faces and the frame of video in different upright stone tablet faces and corresponding with frame of video After azimuth information and/or geographical location information are associated, generating unit 304 can be generated panoramic video data, so, entirely During scape video playback, full-view video image can be shown in the azimuth information according to user and/or geographical location information to user Meanwhile, description information (the such as Word message, voice of special object in the current playing frames of panoramic video are provided a user with Information etc.), to facilitate the understanding to perpetual object for the user.
In one example, this panoramic video generating means may also include that storage unit, can be used for acquired video Corresponding azimuth information and/or geographical location information preserve frame with frame of video, package parts, can be used for regarding of preserving Frequently frame, azimuth information and/or geographical position carry out package according to predetermined form, generate panoramic video packet.Communication component The panoramic video packet of generation can be uploaded onto the server by network, deposit for server by (such as bluetooth equipment) Storage, facilitates user to download broadcasting.It will be understood by those skilled in the art that above-mentioned parts can use art methods (for example existing Storage method, package method, compression method and transmission method) realize aforesaid operations, the invention is not limited in this regard.
Embodiment 4
Fig. 5 illustrates the structure chart of panoramic video playing device according to an embodiment of the invention.As it is shown in figure 5, this device 500 can be applicable to panoramic video playback equipment, and this panoramic video playing device 500 specifically includes that
First obtaining widget 501, is used for obtaining panoramic video data, wherein said panoramic video data include frame of video and The azimuth information being associated with described frame of video and/or geographical location information；
Second obtaining widget 502, for obtaining azimuth information and/or the geographical location information of user, wherein said user Azimuth information represent described user towards orientation, the geographical location information of described user represents the geography residing for described user Position；
Display member 503, for by relative with the azimuth information of user and/or geographical location information in panoramic video data The frame of video answered shows user.
The panoramic video playing device that the embodiment of the present invention provides, can obtain the azimuth information of user and/or geographical position Confidence ceases, and can be by the video in the panoramic video data corresponding with the azimuth information and/or geographical location information of user Frame display is to user.So, the panoramic video play can with user present position and/or towards the side of (concern) To adapting, the VR enhancing user's immersion experiences.
In one example, as shown in Figure 6, display member 503 mays include: the first map unit 5031, for by user Azimuth information and/or geographical location information be mapped to corresponding azimuth information and/or geographical location information in panoramic video, One display unit 5032, shows for the frame of video being associated with described corresponding azimuth information and/or geographical location information To user.
The panoramic video wearing the cubic upright stone tablet generating in the VR helmet (video playback apparatus) viewing embodiment 3 with user is Example, the first obtaining widget 501 can be downloaded video embodiment 3 by wireless network from server and generate the aphorama that equipment uploads Frequently packet, and can unpacking this panoramic video packet, to obtain the frame of video of panoramic video and related to frame of video The azimuth information of connection and/or geographical location information.Second obtaining widget 502 can Real-time Collection user location information and address location Information, the first map unit 5031 can be by the orientation in real-time for user orientation and/or geographical position and panoramic video and/or ground Corresponding relation (i.e. mapping) is set up in reason position, and the first display unit 5032 can make the bat of the frame of video that panoramic video play Take the photograph orientation and/or camera site to change according to the change of the orientation residing in actual environment of user and/or position.For example, After user appreciates a face an inscription on a tablet of four directions upright stone tablet in panoramic video, wanting to appreciate the word of an adjacent face an inscription on a tablet, now user can be Actual environment carries out around the cubic upright stone tablet that eyes are watched the viewing location detouring to change oneself, and rotatable head changes Becoming the viewing orientation of oneself, the above-mentioned corresponding relation set up based on the first map unit 5031, the broadcasting pictures of panoramic video is also The picture of corresponding shooting direction and camera site can be changed into, keep consistent with the viewing location of user and orientation.By above-mentioned Technological means, user can need freely to walk about according to the appreciation of oneself, can freely select to be in a certain position, with one party Video image in panoramic video is appreciated in position, and the VR enhancing user's immersion experiences.
First map unit 5031 as required, can arrange the azimuth information of user and/or geographical location information and use Family " mapping " relation between corresponding azimuth information and/or geographical location information in panoramic video, this is not made by the present invention Limit.For example, if in panoramic video, the azimuth information of frame of video association is east, south, west, north, in upper and lower six direction one Individual, and the user location information of VR helmet collection is azimuth information, then the first map unit 5031 can set up the side of user Mapping relations between the angular range of parallactic angle and the respective direction of frame of video (for example on the basis of direct north, 0 degree to 22.5 Degree, and the azimuth of 337.5 degree to 360 degree maps to " northern " direction of panoramic video, etc.).Again for example, if panorama In video, the azimuth information of frame of video association is one of east, south, west, north, upper and lower six direction, and detects discovery user Towards southeastern direction, owing to when panoramic video gathers, not gathering the frame of video in orientation, the southeast, now, the first map unit 5031 can " eastern " and " southern " both direction of being mapped in panoramic video of the azimuth information of just user, the first display unit 5032 User is showed after the frame of video synthesis that can will be associated with both direction.First map unit 5031 is to geographical location information also Mapping relations can be set up in a similar manner.
In one example, as shown in Figure 6, display member 503 may also include that the second map unit 5033, for using The azimuth information at family and/or geographical location information are mapped to corresponding azimuth information and/or geographical location information in panoramic video (this second map unit 5033 also can be realized by the first map unit 5031), the first frame of video determining unit 5034, it is used for Determine the first frame of video being associated with described corresponding azimuth information and/or geographical location information；Second frame of video determines single Unit 5035, for determining the second frame of video that shooting direction is adjacent with described first frame of video；Second display unit 5036, is used for User is showed after described first frame of video and the second frame of video are synthesized.
For example, in order to increase the field range showing user in panoramic video, if through the second map unit 5033 map after obtain the frame of video that pass is coupled to " eastern " direction, the second display unit 5036 can be by adjacent to northeast, east, three, the southeast The frame of video in direction shows user after synthesizing, to provide broader field range.
In one example, as shown in Figure 6, described panoramic video data may also include and retouching that described frame of video is associated State information；Display member 503 can be additionally used in azimuth information and/or the geographical location information phase with user in panoramic video data Corresponding frame of video and the description information being associated show user.With regard to display member 503, description information is showed use The explanation at family can be found in the related description in embodiment 1, repeats no more herein for simplicity's sake.
In one example, as shown in Figure 6, panoramic video playing device 500 may also include that instruction parts 504, is used for ringing In user, the prompting of target bearing should be required, by user currently towards the rotation direction of orientation to target bearing and/or turn Dynamic amplitude is indicated to user.
For example, traditional panoramic video is not owing to carrying out associating of frame of video and azimuth information, and multiple users exist When watching same panoramic video, and the inapt orientation known faced by oneself, for example, traditional same of multi-person interactive viewing During panoramic video, a certain user points out everybody to see eastwards, but everybody is when watching this traditional panoramic video, in this case it is not apparent that east exists Which orientation.In the embodiment of the present invention 3, frame of video is associated by associated member 303 with azimuth information, is therefore carrying out entirely During scape video playback, different user can be made to have unified azimuthal viewing angle, instruction parts 504 can respond a certain user and require everybody The prompting seen eastwards requires, according to each user detecting currently towards orientation, be indicated to each user and see eastwards respective needs The direction (or also can indicate that rotational angle) rotating, user can be by the rotation direction of this instruction, angle, rotation head.As Described previously, panoramic video playback equipment can play corresponding frame of video in the direction according to faced by user, and therefore different user is pressed After turning to equidirectional according to instruction, will have unified azimuthal viewing angle, improve the interaction between user, enhance The VR of user's immersion experiences.
In one example, as shown in Figure 6, display member 503 is particularly used in: with in panoramic video data with user's Azimuth information and/or the corresponding frame of video of geographical location information are as starting point, and that shows in panoramic video data follow-up regards Frequently frame.For example, in the case that user changes towards orientation or residing geographical position, after display member 503 can be to change Direction panoramic video data corresponding with position in frame of video continue to play subsequent video frame as starting point, i.e. follow-up entirely Scape video content.
In one example, as shown in Figure 6, display member 503 mays include: the 3rd map unit 5037, for by user The azimuth information of input and/or geographical location information are mapped to corresponding azimuth information and/or geographical position letter in panoramic video Breath, the 3rd display unit 5038, for the frame of video being associated with described corresponding azimuth information and/or geographical location information Show user.For example, the azimuth information of user's input and/or geographical location information can be mapped to by the 3rd map unit 5037 Corresponding azimuth information and/or geographical location information in panoramic video, the 3rd display unit 5038 can by with described corresponding side The frame of video that position information and/or geographical location information are associated shows user.For example, user can be moved by button, gesture Make etc. input its want viewing shooting orientation and camera site, correspondingly, panoramic video can switch to this shooting orientation and The corresponding frame of video in camera site, and continue to play with this frame of video for starting point.
Embodiment 5
Fig. 7 illustrates the structure chart of panoramic video system according to an embodiment of the invention.As it is shown in fig. 7, this device 700 is main Including:
Panoramic video collecting device 701, for gathering the frame of video of panoramic video and being supplied to panoramic video generation equipment 702；
Panoramic video generates equipment 702, carries the panoramic video generating means 300 in embodiment 3；
Server 703, generates, for storing panoramic video, the panoramic video data that equipment 702 uploads；
Panoramic video playback equipment 704, panoramic video playback equipment 704 carries the panoramic video in embodiment 4 and plays Device 500, panoramic video playback equipment 704 is used for downloading panoramic video data from server 703, and plays out for user.
The panoramic video system that the embodiment of the present invention provides, can obtain the frame of video of panoramic video, determine frame of video pair Frame of video can be closed by the azimuth information answered and/or geographical location information with azimuth information and/or geographical location information Connection, and generate panoramic video data based on the frame of video after association and azimuth information and/or geographical location information, can obtain The azimuth information of user and/or geographical location information, and can be relative by the azimuth information and/or geographical location information with user Frame of video in the panoramic video data answered shows user.So, the panoramic video play can with residing for user Position and/or adapt towards the direction of (concern), the VR enhancing user's immersion experiences.
Embodiment 6
Fig. 8 shows the structured flowchart of a kind of panoramic video equipment of an alternative embodiment of the invention.Described aphorama Frequently equipment 1100 can be host server, personal computer PC or the portable portable computing possessing computing capability Machine or terminal etc..Implementing of node of calculating is not limited by the specific embodiment of the invention.
Described panoramic video equipment 1100 includes processor (processor) the 1110th, communication interface (Communications Interface) the 1120th, memory (memory) 1130 and bus 1140.Wherein, processor the 1110th, communication interface 1120 and Memory 1130 completes mutual communication by bus 1140.
Communication interface 1120 is used for and network device communications, and wherein the network equipment includes such as Virtual Machine Manager center, is total to Enjoy storage etc..
Processor 1110 is used for performing program.Processor 1110 is probably a central processor CPU, or special collection Become circuit ASIC (Application Specific Integrated Circuit), or be configured to implement the present invention One or more integrated circuits of embodiment.
Memory 1130 is used for depositing file.Memory 1130 may comprise high-speed RAM memory, it is also possible to also includes non- Volatile memory (non-volatile memory), for example, at least one magnetic disc store.Memory 1130 also can be to deposit Memory array.Memory 1130 is also possible to by piecemeal, and described piece can be combined into virtual volume by certain rule.
In a kind of possible embodiment, said procedure can be the program code including computer-managed instruction.This journey Sequence is particularly used in the operation realizing each step of method in the operation of each step of method in embodiment 1 or embodiment 2.
Those of ordinary skill in the art are it is to be appreciated that each exemplary cell in embodiment described herein and algorithm Step, can being implemented in combination in electronic hardware or computer software and electronic hardware.These functions are actually with hardware also It is that software form realizes, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can be for Specific application selects different methods to realize described function, but this realization is it is not considered that exceed the model of the present invention Enclose.
If using the form of computer software realize described function and as independent production marketing or use when, then exist To a certain extent it is believed that all or part of (part for example contributing prior art) of technical scheme is Embody in form of a computer software product.This computer software product is generally stored inside the non-volatile of embodied on computer readable In storage medium, including some instructions are with so that computer equipment (can be that personal computer, server or network set Standby etc.) perform all or part of step of various embodiments of the present invention method.And aforesaid storage medium include USB flash disk, portable hard drive, Read-only storage (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic The various medium that can store program code such as dish or CD.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and any Those familiar with the art, in the technical scope that the invention discloses, can readily occur in change or replace, should contain Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with described scope of the claims.

Claims (25)

1. a panoramic video generates method, it is characterised in that described method includes:
Obtain the frame of video of panoramic video；
Determine the corresponding azimuth information of described frame of video and/or geographical location information, the azimuth information table of wherein said frame of video Showing the shooting orientation of described frame of video, the geographical location information of described frame of video represents the camera site of described frame of video；
Described frame of video is associated with described azimuth information and/or described geographical location information；And
Generate aphorama frequency based on the described frame of video after association and described azimuth information and/or described geographical location information According to.
2. panoramic video according to claim 1 generate method, it is characterised in that described azimuth information include following in One or more:
East, the southeast, south, southwest, west, northwest, north, northeast, upper and lower；
Horizontal direction excursion is the azimuth of 0 degree to 360 degree；
Vertical direction excursion is the azimuth of 0 degree to 360 degree.
3. panoramic video according to claim 1 generates method, it is characterised in that described geographical location information includes described The latitude and longitude information of the camera site of frame of video, and/or the camera site of described frame of video is relative to the displacement letter of reference position Breath.
4. panoramic video according to claim 1 generates method, it is characterised in that described method also includes:
Duplicate removal is carried out to the described frame of video obtaining, described azimuth information and/or described geographical location information.
5. panoramic video as claimed in any of claims 1 to 4 generates method, it is characterised in that described method is also Including:
Create the description information corresponding with described frame of video；
Described frame of video and described azimuth information and/or described geographical location information and described description information are associated；
Based on the described frame of video after association, described azimuth information and/or described geographical location information and described description information Generate panoramic video data.
6. a panoramic video player method, it is characterised in that described method includes:
Obtaining panoramic video data, wherein said panoramic video data include frame of video and the orientation being associated with described frame of video Information and/or geographical location information；
Obtaining azimuth information and/or the geographical location information of user, the azimuth information of wherein said user represents described user face To orientation, the geographical location information of described user represents the geographical position residing for described user；
Frame of video corresponding with the azimuth information of user and/or geographical location information in panoramic video data is showed use Family.
7. panoramic video player method according to claim 6, it is characterised in that by panoramic video data with user's Azimuth information and/or the corresponding frame of video of geographical location information show user, comprising:
Azimuth information and/or the geographical location information of user are mapped to corresponding azimuth information and/or geography in panoramic video Positional information,
The frame of video being associated with described corresponding azimuth information and/or geographical location information is showed user.
8. panoramic video player method according to claim 6, it is characterised in that by panoramic video data with user's Azimuth information and/or the corresponding frame of video of geographical location information show user, comprising:
Azimuth information and/or the geographical location information of user are mapped to corresponding azimuth information and/or geography in panoramic video Positional information,
Determine the first frame of video being associated with described corresponding azimuth information and/or geographical location information；
Determine the second frame of video that shooting direction is adjacent with described first frame of video；
User is showed after described first frame of video and the second frame of video are synthesized.
9. the panoramic video player method according to any one in claim 6 to 8, it is characterised in that described aphorama Frequency evidence also includes the description information being associated with described frame of video；
Frame of video corresponding with the azimuth information of user and/or geographical location information in panoramic video data is showed use Family, comprising:
By frame of video corresponding with the azimuth information of user and/or geographical location information in panoramic video data and be associated Description information show user.
10. the panoramic video player method according to any one in claim 6 to 8, it is characterised in that described method is also Including:
In response to user, the prompting of target bearing is required, by user currently towards the rotation direction of orientation to target bearing And/or rotation amplitude is indicated to user.
The 11. panoramic video player methods according to any one in claim 6 to 8, it is characterised in that by panoramic video Frame of video corresponding with the azimuth information of user and/or geographical location information in data shows user, comprising:
A frame of video corresponding with the azimuth information of user and/or geographical location information in panoramic video data as rise Point, shows the subsequent video frame in panoramic video data.
The 12. panoramic video player methods according to any one in claim 6 to 8, it is characterised in that described method is also Including:
Be mapped to the azimuth information of user's input and/or geographical location information in panoramic video corresponding azimuth information and/or Geographical location information,
The frame of video being associated with described corresponding azimuth information and/or geographical location information is showed user.
13. 1 kinds of panoramic video generating means, it is characterised in that described device includes:
Video acquisition parts, for obtaining the frame of video of panoramic video；
Determine parts, be used for determining the corresponding azimuth information of described frame of video and/or geographical location information, wherein said frame of video Azimuth information represent the shooting orientation of described frame of video, the geographical location information of described frame of video represents the bat of described frame of video Act as regent and put；
Associated member, for being associated described frame of video with described azimuth information and/or described geographical location information；And
Generating unit, the described frame of video after being used for based on association and described azimuth information and/or described geographical location information Generate panoramic video data.
14. panoramic video generating means according to claim 13, it is characterised in that described azimuth information include following in One or more:
East, the southeast, south, southwest, west, northwest, north, northeast, upper and lower；
Horizontal direction excursion is the azimuth of 0 degree to 360 degree；
Vertical direction excursion is the azimuth of 0 degree to 360 degree.
15. panoramic video generating means according to claim 13, it is characterised in that described geographical location information includes institute State the latitude and longitude information of the camera site of frame of video, and/or the camera site of described frame of video is relative to the displacement of reference position Information.
16. panoramic video generating means according to claim 13, it is characterised in that described device also includes:
Remove heavy parts, for removing acquired described frame of video, described azimuth information and/or described geographical location information Weight.
The 17. panoramic video generating means according to any one in claim 13 to 16, it is characterised in that described device Also include:
Information describes parts, for creating the description information corresponding with described frame of video；
Wherein, described associated member be additionally operable to by described frame of video and described azimuth information and/or described geographical location information, with And described description information is associated；Described generating unit be additionally operable to based on association after described frame of video, described azimuth information And/or described geographical location information and described description information generate panoramic video data.
18. 1 kinds of panoramic video playing devices, it is characterised in that described device includes:
First obtaining widget, is used for obtaining panoramic video data, wherein said panoramic video data include frame of video and with described Azimuth information that frame of video is associated and/or geographical location information；
Second obtaining widget, for obtaining azimuth information and/or the geographical location information of user, the orientation letter of wherein said user Breath represent described user towards orientation, the geographical location information of described user represents the geographical position residing for described user；
Display member, for by regard corresponding with the azimuth information of user and/or geographical location information in panoramic video data Frequently frame display is to user.
19. panoramic video playing devices according to claim 18, it is characterised in that described display member includes:
First map unit, for being mapped in panoramic video azimuth information and/or the geographical location information of user corresponding Azimuth information and/or geographical location information,
First display unit, for the frame of video exhibition being associated with described corresponding azimuth information and/or geographical location information Show to user.
20. panoramic video playing devices according to claim 18, it is characterised in that described display member includes:
Second map unit, for being mapped in panoramic video azimuth information and/or the geographical location information of user corresponding Azimuth information and/or geographical location information,
First frame of video determining unit is for determining the being associated with described corresponding azimuth information and/or geographical location information One frame of video；
Second frame of video determining unit, for determining the second frame of video that shooting direction is adjacent with described first frame of video；
Second display unit, shows user after synthesizing described first frame of video and the second frame of video.
The 21. panoramic video playing devices according to any one in claim 18 to 20, it is characterised in that described panorama Video data also includes the description information being associated with described frame of video；
Described display member is additionally operable to corresponding with the azimuth information of user and/or geographical location information in panoramic video data Frame of video and the description information being associated show user.
The 22. panoramic video playing devices according to any one in claim 18 to 20, it is characterised in that described device Also include:
Instruction parts, for the prompting of target bearing being required in response to user, by user currently towards orientation to target side The rotation direction of position and/or rotation amplitude are indicated to user.
The 23. panoramic video playing devices according to any one in claim 18 to 20, it is characterised in that described displaying Parts specifically for:
A frame of video corresponding with the azimuth information of user and/or geographical location information in panoramic video data as rise Point, shows the subsequent video frame in panoramic video data.
The 24. panoramic video playing devices according to any one in claim 18 to 20, it is characterised in that described displaying Parts include:
3rd map unit is right for being mapped to the azimuth information of user's input and/or geographical location information in panoramic video The azimuth information answered and/or geographical location information,
3rd display unit, for the frame of video exhibition being associated with described corresponding azimuth information and/or geographical location information Show to user.
25. 1 kinds of panoramic video systems, it is characterised in that described panoramic video system includes:
Panoramic video collecting device, for gathering the frame of video of panoramic video and being supplied to panoramic video generation equipment；
Panoramic video generates equipment, and described panoramic video generates equipment and carries according to any one institute in claim 13 to 17 The panoramic video generating means stated；
Server, generates, for storing described panoramic video, the panoramic video data that equipment uploads；
Panoramic video playback equipment, described panoramic video playback equipment carries according to any one institute in claim 18 to 24 The panoramic video playing device stated, described panoramic video playback equipment is used for downloading panoramic video data from described server, and Play out for user.
CN201610525899.8A 2016-07-06 2016-07-06 Panoramic video generation, player method, Apparatus and system Pending CN106162204A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610525899.8A CN106162204A (en) 2016-07-06 2016-07-06 Panoramic video generation, player method, Apparatus and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610525899.8A CN106162204A (en) 2016-07-06 2016-07-06 Panoramic video generation, player method, Apparatus and system

Publications (1)

Publication Number Publication Date
CN106162204A true CN106162204A (en) 2016-11-23

Family

ID=58061118

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610525899.8A Pending CN106162204A (en) 2016-07-06 2016-07-06 Panoramic video generation, player method, Apparatus and system

Country Status (1)

Country Link
CN (1) CN106162204A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106657923A (en) * 2017-01-10 2017-05-10 哈尔滨市舍科技有限公司 Scene changing shared viewing system based on position
CN106657792A (en) * 2017-01-10 2017-05-10 哈尔滨市舍科技有限公司 Shared viewing device
CN106657922A (en) * 2017-01-10 2017-05-10 哈尔滨市舍科技有限公司 Scene changing shared image processing system based on position
CN107172442A (en) * 2017-06-11 2017-09-15 成都吱吖科技有限公司 A kind of interactive panoramic video storage method and device based on virtual reality
CN108012202A (en) * 2017-12-15 2018-05-08 浙江大华技术股份有限公司 Video concentration method, equipment, computer-readable recording medium and computer installation
CN108174265A (en) * 2016-12-07 2018-06-15 华为技术有限公司 A kind of playback method, the apparatus and system of 360 degree of panoramic videos
CN108600858A (en) * 2018-05-18 2018-09-28 高新兴科技集团股份有限公司 A kind of video broadcasting method of simultaneous display AR information
CN109756727A (en) * 2017-08-25 2019-05-14 华为技术有限公司 Information display method and relevant device
WO2019100631A1 (en) * 2017-11-27 2019-05-31 中兴通讯股份有限公司 Video playing method, apparatus and system, and storage medium
CN109840952A (en) * 2018-12-29 2019-06-04 深圳市虚拟现实科技有限公司 Virtual reality remembers playback system and its method
CN109978945A (en) * 2019-02-26 2019-07-05 浙江舜宇光学有限公司 A kind of information processing method and device of augmented reality

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101872243A (en) * 2010-06-13 2010-10-27 上海杰图软件技术有限公司 System and method for realizing 360-degree panoramic play following real space direction
CN101971606A (en) * 2008-03-14 2011-02-09 索尼爱立信移动通讯有限公司 Device, method, and system for displaying data recorded with associated position and direction information
CN102572258A (en) * 2010-09-29 2012-07-11 卡西欧计算机株式会社 Image playback apparatus capable of playing back panoramic image
CN102056015B (en) * 2009-11-04 2012-12-05 沈阳迅景科技有限公司 Streaming media application method in panoramic virtual reality roaming
CN103141078A (en) * 2010-10-05 2013-06-05 索尼电脑娱乐公司 Image display device, and image display method
CN103487059A (en) * 2013-09-25 2014-01-01 中国科学院深圳先进技术研究院 Positioning and navigation system, device and method
CN103543831A (en) * 2013-10-25 2014-01-29 梁权富 Head-mounted panoramic player
CN104570577A (en) * 2015-02-12 2015-04-29 深圳市圆周率软件科技有限责任公司 720-degree panoramic camera
US20150302648A1 (en) * 2014-02-18 2015-10-22 Sulon Technologies Inc. Systems and methods for mapping an environment using structured light
CN105120251A (en) * 2015-08-19 2015-12-02 京东方科技集团股份有限公司 3D scene display method and device
WO2016050283A1 (en) * 2014-09-30 2016-04-07 Telefonaktiebolaget L M Ericsson (Publ) Reduced bit rate immersive video

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101971606A (en) * 2008-03-14 2011-02-09 索尼爱立信移动通讯有限公司 Device, method, and system for displaying data recorded with associated position and direction information
CN102056015B (en) * 2009-11-04 2012-12-05 沈阳迅景科技有限公司 Streaming media application method in panoramic virtual reality roaming
CN101872243A (en) * 2010-06-13 2010-10-27 上海杰图软件技术有限公司 System and method for realizing 360-degree panoramic play following real space direction
CN102572258A (en) * 2010-09-29 2012-07-11 卡西欧计算机株式会社 Image playback apparatus capable of playing back panoramic image
CN103141078A (en) * 2010-10-05 2013-06-05 索尼电脑娱乐公司 Image display device, and image display method
CN103487059A (en) * 2013-09-25 2014-01-01 中国科学院深圳先进技术研究院 Positioning and navigation system, device and method
CN103543831A (en) * 2013-10-25 2014-01-29 梁权富 Head-mounted panoramic player
US20150302648A1 (en) * 2014-02-18 2015-10-22 Sulon Technologies Inc. Systems and methods for mapping an environment using structured light
WO2016050283A1 (en) * 2014-09-30 2016-04-07 Telefonaktiebolaget L M Ericsson (Publ) Reduced bit rate immersive video
CN104570577A (en) * 2015-02-12 2015-04-29 深圳市圆周率软件科技有限责任公司 720-degree panoramic camera
CN105120251A (en) * 2015-08-19 2015-12-02 京东方科技集团股份有限公司 3D scene display method and device

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108174265A (en) * 2016-12-07 2018-06-15 华为技术有限公司 A kind of playback method, the apparatus and system of 360 degree of panoramic videos
US11184646B2 (en) 2016-12-07 2021-11-23 Huawei Technologies Co., Ltd. 360-degree panoramic video playing method, apparatus, and system
CN106657923B (en) * 2017-01-10 2020-02-18 哈尔滨市一舍科技有限公司 Scene switching type shared viewing system based on position
CN106657792B (en) * 2017-01-10 2020-02-18 哈尔滨市一舍科技有限公司 Shared viewing device
CN106657792A (en) * 2017-01-10 2017-05-10 哈尔滨市舍科技有限公司 Shared viewing device
CN106657922A (en) * 2017-01-10 2017-05-10 哈尔滨市舍科技有限公司 Scene changing shared image processing system based on position
CN106657922B (en) * 2017-01-10 2020-02-18 哈尔滨市一舍科技有限公司 Scene switching type shared image processing system based on position
CN106657923A (en) * 2017-01-10 2017-05-10 哈尔滨市舍科技有限公司 Scene changing shared viewing system based on position
CN107172442A (en) * 2017-06-11 2017-09-15 成都吱吖科技有限公司 A kind of interactive panoramic video storage method and device based on virtual reality
CN109756727B (en) * 2017-08-25 2021-07-20 华为技术有限公司 Information display method and related equipment
CN109756727A (en) * 2017-08-25 2019-05-14 华为技术有限公司 Information display method and relevant device
CN109842792B (en) * 2017-11-27 2021-05-11 中兴通讯股份有限公司 Video playing method, device, system and storage medium
CN109842792A (en) * 2017-11-27 2019-06-04 中兴通讯股份有限公司 Video broadcasting method, device, system and storage medium
WO2019100631A1 (en) * 2017-11-27 2019-05-31 中兴通讯股份有限公司 Video playing method, apparatus and system, and storage medium
WO2019114835A1 (en) * 2017-12-15 2019-06-20 Zhejiang Dahua Technology Co., Ltd. Methods and systems for generating video synopsis
US11076132B2 (en) 2017-12-15 2021-07-27 Zhejiang Dahua Technology Co., Ltd. Methods and systems for generating video synopsis
CN108012202A (en) * 2017-12-15 2018-05-08 浙江大华技术股份有限公司 Video concentration method, equipment, computer-readable recording medium and computer installation
WO2019218770A1 (en) * 2018-05-18 2019-11-21 高新兴科技集团股份有限公司 Video playing method for synchronously displaying ar information
CN108600858B (en) * 2018-05-18 2020-08-04 高新兴科技集团股份有限公司 Video playing method for synchronously displaying AR information
CN108600858A (en) * 2018-05-18 2018-09-28 高新兴科技集团股份有限公司 A kind of video broadcasting method of simultaneous display AR information
CN109840952A (en) * 2018-12-29 2019-06-04 深圳市虚拟现实科技有限公司 Virtual reality remembers playback system and its method
CN109978945A (en) * 2019-02-26 2019-07-05 浙江舜宇光学有限公司 A kind of information processing method and device of augmented reality
CN109978945B (en) * 2019-02-26 2021-08-31 浙江舜宇光学有限公司 Augmented reality information processing method and device

Similar Documents

Publication Publication Date Title
CN106162204A (en) Panoramic video generation, player method, Apparatus and system
US20220222905A1 (en) Display control apparatus, display control method, and program
US10403044B2 (en) Telelocation: location sharing for users in augmented and virtual reality environments
US20170124755A1 (en) Display application and perspective views of virtual space
CN106951561B (en) Electronic map system based on virtual reality technology and GIS data
CN106251404B (en) Orientation tracking, the method and relevant apparatus, equipment for realizing augmented reality
US10977864B2 (en) Techniques for capturing and displaying partial motion in virtual or augmented reality scenes
CN106683197A (en) VR (virtual reality) and AR (augmented reality) technology fused building exhibition system and VR and AR technology fused building exhibition method
CN105009163B (en) Content distribution system and its operating method with augmented reality mechanism
JP6126821B2 (en) Image generation method, image display method, image generation program, image generation system, and image display apparatus
US20170353658A1 (en) Immersive capture and review
JP6181993B2 (en) Information processing system, information processing apparatus, information processing program, and information transmission / reception method
CN101872243B (en) System and method for realizing 360-degree panoramic play following real space direction
JP6126820B2 (en) Image generation method, image display method, image generation program, image generation system, and image display apparatus
CN106775528A (en) A kind of touring system of virtual reality
JP6147966B2 (en) Information processing program, information processing apparatus, information processing system, and information processing method
CN105894584A (en) Method and device used for interaction with real environment in three-dimensional immersion type environment
CN106357966A (en) Panoramic image photographing device and panoramic image acquiring method
CN106791360A (en) Generate the method and device of panoramic video
CN109599047A (en) A kind of interactive guide interpretation system based on AR technology
CA3119609A1 (en) Augmented reality (ar) imprinting methods and systems
CN110058696A (en) A kind of virtual reality implementation method and its application method and correlation technique device
CN104501797B (en) A kind of air navigation aid based on augmented reality IP maps
CN113253842A (en) Scene editing method and related device and equipment
JP6566209B2 (en) Program and eyewear

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20161123