CN102984560B - The method and apparatus that video is played from breakpoint - Google Patents

Abstract

The embodiment of the present invention provides a kind of method and apparatus that video is played from breakpoint.The method includes：Bookmark is obtained from the webserver, bookmark is created according to the instruction for setting breakpoint；Obtain the temporal information of the video that bookmark is carried, and the Viewing-angle information for playing video corresponding with temporal information；According to the visual angle represented by Viewing-angle information, video is played from the breakpoint represented by temporal information.The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to watch video according to the visual angle represented by Viewing-angle information, improves the visual angle experience of user's viewing video.

Description

The method and apparatus that video is played from breakpoint

Technical field

The present embodiments relate to video technique field, and the method more particularly, to video is played from breakpoint And equipment.

Background technology

Conventional two-dimensional video is all single-view video streams, by a video camera capture content and encode generation video flow into Row storage is transmitted.With the development of multimedia technology, 3 D video (3D video, 3DV) is developed, 3 D video Develop just from multi-angle video to free view-point (free viewpoint) video.

One typical multi-angle video system includes herein below：

1. content obtaining：Multi-camera array catches Same Scene, the video at the multiple visual angles of generation simultaneously with different view Sequence.

2. encode：It is pre- when other visual angles encode relative to basic visual angle coding due to the similitude between multiple visual angles Geodesic structure is predicted between all employing visual angle, therefore needs the visual angle that combined decoding is relied on (at least including regarding substantially during the decoding of visual angle Angle).MVC (Multiview video coding, multi-view video coding) code stream is relied on by certain visual angle and its decoding The subflow that NAL (Network Abstraction Layer, the network abstraction layer) bags at visual angle are constituted constitute operating point (OP, Operation Point).OP can be decoded independently.

3. transmit：Various visual angles bring the increase of data volume, and all Viewing-angle informations should not be transmitted during transmission, should only transmit Meet the Viewing-angle information that decoding user selects visual angle.The access of MVC code streams or content is described by operating point OP, in media OP is described in description information and target exports the corresponding relation at visual angle, an OP contains the institute that decodable code target exports visual angle There is media data.When the visual angle of user's selection is identical with target output visual angle, then accesses and will be met according to corresponding OP Decode the visual angle content that the user selects visual angle.

4. terminal shows：When video is watched, user can select any one or one group of optimal viewing angle to watch to user. The optimal viewing angle of selection can be that the corresponding visual angle of real camera may also be the virtual perspective synthesized with reference to true visual angle.

Additionally, breakpoint continues sees it is an important experience in video system.User can protect at any time during program is watched Books in stock label (bookmark), realize " continue across screen breakpoint and see " of programme content.The bookmark, book can be stored in the webserver When the information recorded in label ensures to watch this program in same equipment or other equipment after user, can precise positioning breakpoint It is continuous to see, save and pull the trouble that time schedule bar finds viewing point.

Relative to two-dimensional video, in multi-angle video system, one or one group may be selected when video is watched for user Optimal viewing angle is watched.But, if user preserves bookmark on the webserver and continues to see according to the bookmark in next time When seeing this program, since terminal can only ask to access all of multi-view video content or basic multi-view video watching point Content is watched for user, and user needs to switch visual angle again to find optimal viewing angle, the missing for causing user perspective to experience, and Increased the complexity of operation.

The content of the invention

The embodiment of the present invention provides a kind of method and apparatus that video is played from breakpoint, can lift user's viewing video Visual angle experience.

On the one hand, there is provided it is a kind of from breakpoint play video method, including：Bookmark is obtained, the bookmark is according to setting The instruction for putting breakpoint is created；The temporal information of the video that the bookmark is carried is obtained, and corresponding with the temporal information is broadcast Put the Viewing-angle information of video；According to the visual angle represented by the Viewing-angle information, broadcast from the breakpoint represented by the temporal information Put video.

The Viewing-angle information may include the visual angle mark at the true visual angle for corresponding to real camera.It is described to be regarded according to described Visual angle represented by angle information, video is played from the breakpoint represented by the temporal information, including：Request accesses true with described The visual angle at real visual angle identifies corresponding video flowing；The video flowing is played from the breakpoint.

The Viewing-angle information may include the angle of the virtual perspective with reference at least two true visual angle synthesis.It is described according to institute The visual angle represented by Viewing-angle information is stated, video is played from the breakpoint represented by the temporal information, including：According to described virtual The angle at visual angle, determines at least two reference viewing angles mark of the virtual perspective, at least two reference viewing angles mark point Dui Yingyu be identified for synthesizing the visual angle at least two true visual angles of the virtual perspective；Request is accessed and described at least two Individual reference viewing angle identifies corresponding video flowing；Synthesized described with the corresponding video flowing of at least two reference viewing angles mark Corresponding to the video content of the virtual perspective, synthesized video content is played from the breakpoint.

The angle according to the virtual perspective, determines at least two reference viewing angles mark of the virtual perspective, can Including：At least two reference viewing angles mark corresponding with the virtual perspective is obtained from the Viewing-angle information.

The angle information according to the virtual perspective, determines at least two reference viewing angle marks of the virtual perspective Know, it may include：Electronic program guide (EPG) metadata is obtained, the EPG metadata carries the visual angle description letter of multi-angle video Breath, wherein the visual angle description information of the multi-angle video includes the nominal data of the corresponding real camera in true visual angle, or Person includes the corresponding relation at true visual angle and the angle of the virtual perspective；According to the corresponding real camera in the true visual angle Nominal data or true visual angle and the angle of the virtual perspective corresponding relation, and according to the angle of the virtual perspective Degree information, determines the reference viewing angle mark.

On the other hand, there is provided it is a kind of from breakpoint play video method, including：First terminal is received and sets breakpoint Indicate；The first terminal indicates to create bookmark according to described, and the bookmark carries the temporal information of video, and with it is described when Between information it is corresponding play video Viewing-angle information；The first terminal sends the bookmark, so that second terminal is according to described Visual angle represented by Viewing-angle information, video, the first terminal and second are played from the breakpoint represented by the temporal information Terminal is same terminal or is different terminals.

The Viewing-angle information may include the visual angle mark at the true visual angle for corresponding to real camera, in order to second terminal Request accesses the visual angle corresponding video flowing of mark with the true visual angle；And the video flowing is played from the breakpoint.

Or, the Viewing-angle information may include the angle of the virtual perspective with reference at least two true visual angle synthesis, so as to In second terminal according to the angle of the virtual perspective, at least two reference viewing angles mark of the virtual perspective is determined, it is described At least two reference viewing angles mark corresponds respectively to be marked for the visual angle for synthesizing at least two of the virtual perspective true visual angles Know；Request is accessed and the corresponding video flowing of at least two reference viewing angles mark；And described will be referred to described at least two Mark corresponding video flowing in visual angle synthesizes the video content corresponding to the virtual perspective, plays synthesized from the breakpoint Video content.

If the visual angle represented by the Viewing-angle information is the virtual perspective, the Viewing-angle information may also include described The corresponding at least two reference viewing angles mark of virtual perspective, at least two reference viewing angles mark is corresponded respectively to for synthesizing The visual angle mark at least two true visual angles of the virtual perspective, so that second terminal request is accessed and described at least two Individual reference viewing angle identifies corresponding video flowing, and will the video flowing synthesis corresponding with least two reference viewing angles mark It is the video content corresponding to the virtual perspective, synthesized video content is played from the breakpoint.

On the other hand, there is provided it is a kind of from breakpoint play video method, including：Second terminal is received to ask bookmark Ask, the bookmark carries the temporal information of video, and the Viewing-angle information for playing video corresponding with the temporal information；To Second terminal sends the bookmark, so that the second terminal is according to the visual angle represented by the Viewing-angle information, from the time Breakpoint represented by information plays video.

The Viewing-angle information may include the visual angle mark at the true visual angle for corresponding to real camera；It is described so as to described Two terminals play video from the breakpoint represented by the temporal information specific according to the visual angle represented by the Viewing-angle information For：Second terminal request accesses the visual angle corresponding video flowing of mark with the true visual angle, and institute is played from the breakpoint State video flowing.

Or, the Viewing-angle information may include the angle of the virtual perspective with reference at least two true visual angle synthesis；It is described So that the second terminal is according to the visual angle represented by the Viewing-angle information, played from the breakpoint represented by the temporal information Video is specially：Second terminal determines at least two reference viewing angles of the virtual perspective according to the angle of the virtual perspective Mark, at least two reference viewing angles mark is corresponded respectively to for synthesizing at least two of the virtual perspective true visual angles Visual angle mark；Request is accessed and the corresponding video flowing of at least two reference viewing angles mark；With described at least two by described in Individual reference viewing angle identifies corresponding video flowing and synthesizes video content corresponding to the virtual perspective, is played from the breakpoint Synthesized video content.

Or, the Viewing-angle information may include the angle and the virtual perspective corresponding at least two of the virtual perspective Reference viewing angle is identified, at least two reference viewing angle mark correspond respectively to for synthesize the virtual perspective at least two The visual angle mark at true visual angle, it is described so that the second terminal is according to the visual angle represented by the Viewing-angle information, from it is described when Between play video at breakpoint represented by information and be specially：The second terminal request is accessed and at least two reference viewing angle Corresponding video flowing is identified, and is synthesized described corresponding to institute with the corresponding video flowing of at least two reference viewing angles mark The video content of virtual perspective is stated, synthesized video content is played from the breakpoint.

If the Viewing-angle information includes the angle of the virtual perspective with reference at least two true visual angle synthesis, the side Method may also include：Generation carries the electronic program guide (EPG) metadata of the visual angle description information of multi-angle video, the various visual angles The visual angle description information of video includes the nominal data of the corresponding real camera in true visual angle, or including true visual angle and institute The corresponding relation of the angle of virtual perspective is stated, so that the second terminal is according to the demarcation of the corresponding real camera in true visual angle The corresponding relation of data or true visual angle and the angle of the virtual perspective, and believed according to the angle of the virtual perspective Breath, determines the reference viewing angle mark.

Methods described may also include：Store the bookmark received from first terminal.

On the other hand, there is provided a kind of terminal device, including：Acquiring unit, for obtaining bookmark, the bookmark is according to setting The instruction for putting breakpoint is created；Resolution unit, the temporal information for obtaining the video that the bookmark is carried, and with it is described The corresponding Viewing-angle information for playing video of temporal information；Broadcast unit, for according to the visual angle represented by the Viewing-angle information, from Video is played at breakpoint represented by the temporal information.

If the Viewing-angle information that the resolution unit is obtained includes the visual angle mark at the true visual angle corresponding to real camera Know, then the broadcast unit can ask to access and the true visual angle the visual angle corresponding video flowing of mark, and from the breakpoint Play the video flowing in place.

If the Viewing-angle information that the resolution unit is obtained includes the virtual perspective with reference at least two true visual angle synthesis Angle, then the broadcast unit at least two references of the virtual perspective according to the angle of the virtual perspective, can be determined Visual angle identifies, and at least two reference viewing angles mark corresponds respectively to true for synthesizing at least two of the virtual perspective The visual angle mark at visual angle；Request accesses the video flowing corresponding at least two reference viewing angle mark, and corresponds to described The video flowing of at least two reference viewing angles mark synthesizes the video content corresponding to the virtual perspective, from the breakpoint Locate the video content synthesized by broadcasting.

The broadcast unit can obtain at least two ginseng corresponding with the angle of the virtual perspective from the Viewing-angle information Examine visual angle mark.Or, the broadcast unit can obtain electronic program guide (EPG) metadata, and the EPG metadata carries regard more The visual angle description information of angle video, wherein the visual angle description information of the multi-angle video includes that true visual angle is corresponding truly taking the photograph The nominal data of camera, or the corresponding relation including true visual angle with the angle of the virtual perspective；Truly regarded according to described The corresponding relation of the nominal data of the corresponding real camera in angle or true visual angle and the angle of the virtual perspective, Yi Jigen According to the angle information of the virtual perspective, the reference viewing angle mark is determined.

On the other hand, there is provided a kind of terminal device, including：Receiving unit is indicated, the instruction of breakpoint is set for receiving； Bookmark creating unit, the instruction for being received according to the instruction receiving unit creates bookmark, and the bookmark carries video Temporal information, and the Viewing-angle information for playing video corresponding with the temporal information；Bookmark delivery unit, it is described for sending Bookmark, so that second terminal is according to the visual angle represented by the Viewing-angle information, broadcasts from the breakpoint represented by the temporal information Video is put, the terminal device and the second terminal are same terminal or are different terminals.

The Viewing-angle information carried in the bookmark that the bookmark creating unit is created may include to correspond to the true of real camera The visual angle mark at real visual angle, the visual angle corresponding video flowing of mark with the true visual angle is accessed in order to second terminal request； And the video flowing is played from the breakpoint.

Or, the Viewing-angle information may include the angle of the virtual perspective with reference at least two true visual angle synthesis, so as to In second terminal according to the angle of the virtual perspective, at least two reference viewing angles mark of the virtual perspective is determined, it is described At least two reference viewing angles mark corresponds respectively to be marked for the visual angle for synthesizing at least two of the virtual perspective true visual angles Know；Request is accessed and the corresponding video flowing of at least two reference viewing angles mark；And described will be referred to described at least two Mark corresponding video flowing in visual angle synthesizes the video content corresponding to the virtual perspective, plays synthesized from the breakpoint Video content.

Or, the Viewing-angle information may include the angle and the virtual perspective corresponding at least two of the virtual perspective Reference viewing angle is identified, at least two reference viewing angle mark correspond respectively to for synthesize the virtual perspective at least two The visual angle mark at true visual angle, so that second terminal request accesses regard corresponding with least two reference viewing angles mark Frequency flows, and is synthesized described corresponding to the virtual perspective with the corresponding video flowing of at least two reference viewing angles mark Video content, synthesized video content is played from the breakpoint.

On the other hand, there is provided it is a kind of realize from breakpoint play video device, including：Receiving unit, for receiving Request of the second terminal to bookmark, the bookmark carries the temporal information of video, and broadcasting corresponding with the temporal information The Viewing-angle information of video；Transmitting element, for sending the bookmark to second terminal, so that the second terminal is regarded according to described Visual angle represented by angle information, video is played from the breakpoint represented by the temporal information.

The Viewing-angle information carried in the bookmark that the transmitting element sends may include that corresponding to the true of real camera regards The visual angle mark at angle, so that second terminal request accesses the visual angle corresponding video flowing of mark with the true visual angle, and The video flowing is played from the breakpoint.

Or, the Viewing-angle information may include the angle of the virtual perspective with reference at least two true visual angle synthesis, so as to The second terminal determines at least two reference viewing angles mark of the virtual perspective, institute according to the angle of the virtual perspective State at least two reference viewing angles and identify the visual angle corresponded respectively to for synthesizing at least two of the virtual perspective true visual angles Mark；Request is accessed and the corresponding video flowing of at least two reference viewing angles mark；Described will be referred to described at least two Mark corresponding video flowing in visual angle synthesizes the video content corresponding to the virtual perspective, plays synthesized from the breakpoint Video content.

Or, the Viewing-angle information may include the angle and the virtual perspective corresponding at least two of the virtual perspective Reference viewing angle is identified, at least two reference viewing angle mark correspond respectively to for synthesize the virtual perspective at least two The visual angle mark at true visual angle, so that second terminal request accesses regard corresponding with least two reference viewing angles mark Frequency flows, and is synthesized described corresponding to the virtual perspective with the corresponding video flowing of at least two reference viewing angles mark Video content, synthesized video content is played from the breakpoint.

Described device may also include generation unit, the electronics for generating the visual angle description information for carrying multi-angle video Program guide (EPG) metadata, the visual angle description information of the multi-angle video includes the corresponding real camera in true visual angle Nominal data, or the corresponding relation including true visual angle with the angle of the virtual perspective, so as to the second terminal according to The corresponding relation of the nominal data of the true corresponding real camera in visual angle or true visual angle and the angle of the virtual perspective, And according to the angle information of the virtual perspective, determine the reference viewing angle mark.

Described device may also include memory cell, for storing the bookmark received from first terminal.

The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to watched according to the visual angle represented by Viewing-angle information Video, improves the visual angle experience of user's viewing video.

Brief description of the drawings

Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be in embodiment or description of the prior art The required accompanying drawing for using is briefly described, it should be apparent that, drawings in the following description are only some realities of the invention Example is applied, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to these accompanying drawings Obtain other accompanying drawings.

Fig. 1 is the flow chart of the method that video is played from breakpoint of one embodiment of the invention.

Fig. 2 is the flow chart of the method that video is played from breakpoint of another embodiment of the present invention.

Fig. 3 is the flow chart of the method that video is played from breakpoint of another embodiment of the present invention.

Fig. 4 is the schematic flow diagram that video process is played from breakpoint of one embodiment of the invention.

Fig. 5 is the schematic flow diagram that another embodiment of the present invention plays video process from breakpoint.

Fig. 6 is the block diagram of the terminal device of one embodiment of the invention.

Fig. 7 is the block diagram of the terminal device of another embodiment of the present invention.

Fig. 8 be one embodiment of the invention realization played from breakpoint video device block diagram.

Fig. 9 be another embodiment of the present invention realization played from breakpoint video device block diagram.

Specific embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than whole embodiments.Based on this hair Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made Example, belongs to the scope of protection of the invention.

Fig. 1 is the flow chart of the method that video is played from breakpoint of one embodiment of the invention.The method of Fig. 1 can be by The terminal device (hereinafter referred to " first terminal ") for setting breakpoint is performed.

101, first terminal receives the instruction for setting breakpoint.

For example, the instruction can be produced according to the button operation of user, for example user is directly selected from the menu establishment book Sign.Or, the instruction can be produced by system according to other trigger conditions, and such as system can carry out exiting video in user Bookmark is voluntarily created during operation.The embodiment of the present invention is not restricted to the instruction, can use any existing indicating mode.

102, first terminal according to it is described indicate create bookmark, the bookmark carry video temporal information, and with it is described The corresponding Viewing-angle information for playing video of temporal information.

Alternatively, as one embodiment, the reproduction time of video, Viewing-angle information when temporal information can represent breakpoint setup The viewing visual angle for playing video when breakpoint is set can be represented.Visual angle represented by Viewing-angle information can correspond to true shooting The true visual angle of machine or the virtual perspective with reference to multiple true visual angle synthesis.User play video when may be selected any one or One group of optimal viewing angle of person is watched.Visual angle selected by user is probably true visual angle, it is also possible to by multiple true visual angles The virtual perspective of synthesis.The information at the visual angle of the recordable user's selection of first terminal, and the information at the visual angle is carried in bookmark, I.e. described Viewing-angle information.

In an optional example, if the visual angle represented by Viewing-angle information is true visual angle, Viewing-angle information can be wrapped Include visual angle mark (for example, being designated as ViewId) at true visual angle.Or, if the visual angle represented by Viewing-angle information is virtually to regard Angle, then Viewing-angle information may include the angle (for example, being designated as ViewAngle) of virtual perspective.

Further, in another optional example, if the visual angle represented by Viewing-angle information is virtual perspective, visual angle Information can also include corresponding reference viewing angle mark (for example, being designated as ReferenceViewId) of virtual perspective.Reference viewing angle mark Knowledge may correspond to the visual angle mark at the true visual angle for synthesizing the virtual perspective.

103, first terminal sends bookmark, so that second terminal is according to the visual angle represented by Viewing-angle information, from temporal information Video is played at represented breakpoint.

With second terminal can be same terminal or be different terminals, the embodiment of the present invention is not limited this first terminal System.For example, first terminal and second terminal can be belonging to two terminals of same user, the user can be in two terminals The same video content of upper viewing, such as user watches video in first terminal, because some reasons exit video, viewing next time When can according in bookmark record information be watched on first terminal or second terminal.Or first terminal and second terminal can be with It is the terminal for belonging to different user, first terminal can set breakpoint at the content for thinking interesting, allows other users to see See.Or, first terminal and second terminal are same terminals, and same user or different users can be selected at the end Same video content is watched on end.

The bookmark of establishment can be uploaded and stored to the webserver by first terminal.Due to be have recorded in bookmark and representing disconnected The corresponding Viewing-angle information of temporal information of point, therefore user's (sight in same terminal or different terminals in viewing video next time See), can obtain bookmark and continue according to the visual angle represented by Viewing-angle information in bookmark from the webserver and see video.

Or, first terminal can also directly send a bookmark to second terminal.For example, first terminal user want and User's sharing video frequency content of second terminal, then can recommend the bookmark to the user of second terminal, and second terminal obtains bookmark And see video according to the visual angle represented by Viewing-angle information in bookmark is continuous.

Corresponding program identification can also be included in bookmark.The webserver, can be with program identification when bookmark is stored Bookmark is stored in association, to be subsequent supplied to ask the terminal of bookmark.Or, record bookmark can also be included in bookmark The ID of terminal, the webserver can in association store bookmark, so as to follow-up when bookmark is stored with ID It is supplied to the terminal of request bookmark.Alternatively, unique bookmark identification can be included in bookmark, the webserver is in storage book During label, bookmark can be in association stored with bookmark identification, to be subsequent supplied to ask the terminal of bookmark.The embodiment of the present invention The example of these specific storage modes is not limited to, and can be to store bookmark according to any existing mode.

The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to seen according to the visual angle represented by Viewing-angle information is continuous Video, improves the visual angle experience of user's viewing video.

Fig. 2 is the flow chart of the method that video is played from breakpoint of another embodiment of the present invention.The method of Fig. 2 is by continued broadcasting The terminal device (for example, above-mentioned second terminal) of video is performed.

201, bookmark is obtained, the bookmark is created according to the instruction for setting breakpoint.

For example, second terminal can obtain bookmark from the webserver, or book is obtained from the first terminal for creating bookmark Sign.Acquired bookmark can be first terminal 101 the step of Fig. 1 in create bookmark.To avoid repeating, no longer retouch in detail State.

Second terminal can send acquisition request bookmark by the webserver or first terminal, or be taken by receiving network The modes such as the push of business device or first terminal obtain bookmark.For example, second terminal can show video frequency program list to user.When Receive user continue see program instruction (for example, user click on the program continuation viewing button) when, second terminal can be asked The webserver or first terminal is asked to issue corresponding bookmark.The embodiment of the present invention is not made to the mode that second terminal obtains bookmark Limitation, can be according to any existing mode from the webserver or first terminal request bookmark.

For example, in the request to bookmark, the letter such as corresponding program identification, ID and/or bookmark identification can be carried Breath, so that the webserver or first terminal provide corresponding bookmark according to the information.

Here, the terminal device for setting breakpoint can be same equipment, or not with the terminal device for obtaining bookmark Two same equipment.

202, the temporal information of the video that bookmark is carried is obtained, and play video corresponding with the temporal information is regarded Angle information.

As described in the embodiment of Fig. 1, the reproduction time of video when temporal information can represent breakpoint setup, Viewing-angle information can table Show the viewing visual angle for playing video when breakpoint is set.For example, the visual angle represented by Viewing-angle information can correspond to truly take the photograph The true visual angle of camera or the virtual perspective with reference to multiple true visual angle synthesis.

In an optional example, if the visual angle represented by Viewing-angle information is true visual angle, Viewing-angle information can be wrapped The visual angle for including true visual angle identifies ViewId.Or, if the visual angle represented by Viewing-angle information is virtual perspective, Viewing-angle information May include the angle ViewAngle of virtual perspective.

203, according to the visual angle represented by Viewing-angle information, video is played from the breakpoint represented by temporal information.

Alternatively, as one embodiment, if the visual angle represented by Viewing-angle information is true visual angle, in Viewing-angle information The visual angle mark ViewId at true visual angle can be included, terminal device can be asked to access and identify ViewId pairs with the visual angle at true visual angle The video flowing answered.

On the other hand, if the visual angle represented by Viewing-angle information is virtual perspective, terminal device can be according to virtual perspective Angle ViewAngle incoming video streams.

The embodiment of the present invention is not limited to the mode of terminal device incoming video stream.Regarding after breakpoint can only be accessed Frequency flows, it is also possible to access the video flowing than breakpoint earlier, but terminal device plays the video flowing from breakpoint.

Alternatively, as a specific embodiment, when accessing and playing video flowing, terminal device can be according to virtually regarding The angle ViewAngle at angle, determines at least two reference viewing angles mark ReferenceViewId of virtual perspective.At least two Reference viewing angle mark corresponds respectively to be identified for the visual angle for synthesizing at least two of virtual perspective true visual angles.For example, Assuming that in case of two true visual angles (being individually identified as ViewId1 and ViewId2) synthesize a virtual perspective, then should Two reference viewing angles mark ReferenceViewId1 and ReferenceViewId2 of virtual perspective can be respectively adopted ViewId1 With the value of ViewId2.

Then, premises equipment requests are accessed and correspond to the video that identified reference viewing angle identifies ReferenceViewId Stream, and will be synthesized in the video corresponding to virtual perspective corresponding to the video flowing of reference viewing angle mark ReferenceViewId Hold, synthesized video content is played from breakpoint.

For example, when Viewing-angle information includes reference viewing angle mark ReferenceViewId, terminal device can be direct From the corresponding reference viewing angle mark of angle that Viewing-angle information obtains virtual perspective.

In addition, if not including that reference viewing angle identifies ReferenceViewId in Viewing-angle information, terminal device can also lead to Cross the corresponding reference viewing angle mark of angle that other information obtains virtual perspective.In an optional example, terminal device can EPG (Electronic Program Guide, electronic program guides) metadata issued by the webserver, with reference to visual angle The angle ViewAngle of the virtual perspective in information, determines the corresponding reference viewing angle marks of angle ViewAngle of virtual perspective Know.

Specifically, terminal device can obtain electronic program guide (EPG) metadata, and the EPG metadata carries multi-angle video Visual angle description information, wherein, it is corresponding true that the visual angle description information of multi-angle video may include but be not limited to true visual angle The nominal data of video camera, or the truly corresponding relation of the angle of visual angle and virtual perspective.Then terminal device is according to The corresponding relation of the nominal data of the true corresponding real camera in visual angle or true visual angle and the angle of the virtual perspective, And according to the angle information of the virtual perspective, determine the reference viewing angle mark.

Here, scope of the acquisition order of EPG and bookmark not to the embodiment of the present invention is construed as limiting.EPG can be in terminal Equipment is issued before obtaining bookmark, and for example the webserver can be handed down to the terminal before terminal device request program and set It is standby.

The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to seen according to the visual angle represented by Viewing-angle information is continuous Video, improves the visual angle experience of user's viewing video.

In addition, terminal device it is continuous see video when, select viewing visual angle again without user, improve the facility of user Degree.Additionally, terminal device need not access all video flowings, and need to only access the video related to true visual angle or virtual perspective Stream, can save bandwidth, improve system effectiveness.

Fig. 3 is the flow chart of the method that video is played from breakpoint of another embodiment of the present invention.The method of Fig. 3 is by network The first terminal of server or establishment bookmark is performed, and corresponding with the method for Fig. 1 and Fig. 2, therefore, will suitably omit in detail Description.

301, receive request of the second terminal to bookmark, the bookmark carries the temporal information of video, and with it is described when Between information it is corresponding play video Viewing-angle information.

For example, the bookmark asked in step 301 can be 102 the step of Fig. 1 in create bookmark, therefore no longer weigh Multiple description.

For example, in the request to bookmark, the letter such as corresponding program identification, ID and/or bookmark identification can be carried Breath, so that the webserver provides corresponding bookmark according to the information.

For example, the visual angle represented by Viewing-angle information can correspond to the true visual angle of real camera or with reference to multiple true The virtual perspective of real visual angle synthesis.

In an optional example, if the visual angle represented by Viewing-angle information is true visual angle, Viewing-angle information can be wrapped The visual angle mark ViewId at true visual angle is included but be not limited to, is identified with the visual angle at true visual angle so that second terminal request is accessed The corresponding video flowings of ViewId, and video flowing is played from breakpoint.Or, if the visual angle represented by Viewing-angle information is virtually to regard Angle, then Viewing-angle information may include but be not limited to the angle ViewAngle of virtual perspective, so that second terminal is according to virtual perspective Angle ViewAngle, determines at least two reference viewing angles mark of virtual perspective, at least two reference viewing angles mark difference Identified corresponding to for synthesizing the visual angle at least two of virtual perspective true visual angles；Request is accessed and described at least two references Visual angle identifies corresponding video flowing；To be synthesized corresponding to virtual with the corresponding video flowing of at least two reference viewing angles mark The video content at visual angle, synthesized video content is played from breakpoint.

Further, in another optional example, if the visual angle represented by Viewing-angle information is virtual perspective, visual angle Information can also include the corresponding reference viewing angle mark ReferenceViewId of virtual perspective.Reference viewing angle mark may correspond to Visual angle mark for synthesizing the true visual angle of the virtual perspective, so that second terminal request is accessed and described at least two references Visual angle identifies corresponding video flowing, and the video flowing corresponding with least two reference viewing angle mark is synthesized corresponding In the video content of the virtual perspective, synthesized video content is played from the breakpoint.

302, bookmark is sent to second terminal, so that second terminal is according to the visual angle represented by Viewing-angle information, from time letter Video is played at the represented breakpoint of breath.

Above-mentioned first terminal and second terminal can be same terminal or be different terminals, the embodiment of the present invention to this not It is restricted.

Alternatively, as one embodiment, if the visual angle represented by Viewing-angle information is virtual perspective, the webserver The EPG metadata of generation can carry the visual angle description information of multi-angle video, so as to second terminal regarding according to multi-angle video The angle of angle description information and virtual perspective, determines at least two reference viewing angles mark of virtual perspective.Wherein, multi-angle video Visual angle description information may include but be not limited to the nominal data of the corresponding real camera in true visual angle, or true visual angle with The corresponding relation of the angle of virtual perspective.

The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to seen according to the visual angle represented by Viewing-angle information is continuous Video, improves the visual angle experience of user's viewing video.

With reference to specific example, more detailed description embodiments of the invention.

Fig. 4 is the schematic flow diagram that video process is played from breakpoint of one embodiment of the invention.The embodiment of Fig. 4 is The example of webserver storage bookmark.In Fig. 4, " terminal A " represents the terminal device for setting breakpoint (for example, as above-mentioned " the One example of one terminal "), " terminal B " represents the terminal device of continued broadcasting video (for example, as the one of above-mentioned " second terminal " Individual example), " webserver " represents the server device of storage bookmark.Terminal A and terminal B can be same equipment, also may be used Being different equipment.In addition, terminal A and terminal B can belong to same user, it is also possible to belong to different users, the present invention is real Example is applied not to be restricted this.

401, the webserver sends video content in the way of video flowing to terminal A.The user of terminal A may be selected one Individual or one group of optimal viewing angle.

In a nonrestrictive specific example, terminal A can first receive one section of complete MVC video flowing, then from MVC Video flowing obtains the parameters such as camera calibration data.The calibrating parameters of video camera can be used to determine the corresponding angle mark of video camera The information such as knowledge, shooting angle, terminal A generates the diagram (such as slider bar) that visual angle selects, and visual angle choosing according to these information The diagram and the corresponding relation at visual angle selected.Enable a user to drag on the slider bar select optimal viewing angle.User selects most Good visual angle likely corresponds to the true visual angle of real camera, it is also possible between two true visual angles of real camera (that is, virtual perspective).

The user of 402, terminal A provides the instruction for setting breakpoint.Now terminal A can be created according to the instruction of the setting breakpoint Build bookmark (bookmark), the current viewing information of record user.

Information in bookmark can be divided mainly into two classes：One class is the information that must be carried in bookmark, including is associated with bookmark Program identification ProgramId, the Pgmtime skew Offset temporal information of breakpoint (represent)；Another kind of is inessential letter The annotation of the breath such as user name of founder, user input.These information in bookmark belong to prior art, thus terminal how Obtain these information, and how post-service device and terminal do not do detailed explanation and special using these information present invention Restriction.

In embodiments of the present invention, Viewing-angle information is also recorded in bookmark, for the currently selected visual angle of instruction user.

For example, terminal A can record the optimal viewing angle of user's selection, and corresponding video flowing is accessed according to optimal viewing angle.

Specifically, terminal can obtain the optimal of user's selection according to the diagram at selection visual angle and the corresponding relation at visual angle Visual angle.If the optimal viewing angle corresponds to real camera, terminal A records the visual angle mark ViewId of the optimal viewing angle, and During the visual angle of optimal viewing angle mark ViewId is increased into bookmark when bookmark is created, as included true in Viewing-angle information The visual angle mark at real visual angle.

Or, it is assumed that user selects an optimal viewing angle and the optimal viewing angle is virtual perspective, by two true visual angles Synthesize, then terminal A can record the angle ViewAngle of this virtual perspective, and when bookmark is created by angle ViewAngle In increasing to bookmark, as the angle of virtual perspective included in Viewing-angle information.It should be noted that in the embodiment of the present invention, virtually The angle ViewAngle at visual angle can use various forms.For example, angle ViewAngle can be corresponding angle value, bag Include various available unit forms, such as degree or radian, or other forms, such as corresponding index value etc., the present invention is real Example is applied not to be restricted this.

Further, if it is necessary, terminal A can also record the visual angle mark at two true visual angles of synthesis virtual perspective Know, and when bookmark is created the visual angle at the two true visual angles mark is increased into bookmark, as included in Viewing-angle information Virtual perspective reference viewing angle mark.

By taking the bookmark of XML (Extensible Markup Language, extensible markup language) form as an example, Ke Yi Increase in bookmark described below：

<xs:Element name=" ViewInfo " type=" tns:ViewInfoType " minOccurs=" 0 "/>

Wherein ViewInfo represents Viewing-angle information.Visual angle represented by Viewing-angle information ViewInfo may include two types, I.e. true visual angle and virtual perspective.Can be described as follows, wherein RealViewType represents true visual angle type, VirtualViewType represents virtual perspective type.

For true visual angle type RealViewType, the visual angle mark at the true visual angle can be carried in Viewing-angle information ViewId。

For virtual perspective type VirtualViewType, the angle of the virtual perspective can be carried in Viewing-angle information ViewAngle。

403, terminal A upload bookmark to the webserver.

404, the bookmark that webserver storage is received.

The webserver can in association be deposited when bookmark is stored with program identification, ID and/or bookmark identification Storage bookmark, to be subsequent supplied to ask the terminal of bookmark.The embodiment of the present invention is not limited to the example of these specific storage modes Son, and can be to store bookmark according to any existing mode, therefore the mode to webserver storage bookmark is not carried out in detail Explanation and special restriction.

405, if the user of terminal B wishes to watch video, terminal B is to web server requests bookmark.

For example, user uses the ID registration terminal A of oneself, video frequency program is watched, and book is recorded on terminal A Sign.Same ID registration terminal B is sometime used after, it is desirable to same video is watched on terminal B.Or, The user of terminal A can recommend the video frequency program in the rear user to terminal B of record bookmark, and provide acquisition bookmark to terminal B Required information.The information that terminal B is provided according to terminal A, to web server requests bookmark.

For example, terminal B can show video frequency program list to user, and which program has bookmark.When receiving use When family continues instruction (for example, user clicks on the continuation viewing button of the program) for seeing program, terminal B can be to web server requests Corresponding bookmark.The embodiment of the present invention is not restricted to the mode for asking bookmark, can be taken from network according to any existing mode Business device request bookmark.

406, the webserver issues bookmark according to the request of terminal B to terminal B.

407, terminal B access corresponding video flowing according to the information recorded in bookmark to web server requests.

When the Viewing-angle information carried in bookmark includes that the corresponding visual angle in true visual angle identifies, terminal B can be marked according to visual angle Know corresponding operating point OP requests multi-visual angle video stream, and decoded and shown.

On the other hand, when the Viewing-angle information carried in bookmark includes the angle of virtual perspective, terminal B determines reference viewing angle Mark, multi-visual angle video stream is obtained further according to reference viewing angle mark.For example terminal B can obtain camera calibration data, according to this The angle of nominal data and virtual perspective, determines that reference viewing angle is identified.Reference viewing angle mark is marked corresponding to the visual angle at true visual angle Know.Terminal B need to obtain reference viewing angle from video flowing and identify corresponding camera parameters before the video flowing acquired in display To carry out the synthesis of virtual perspective, and show the video content of synthesis.

Specifically, terminal B needs request to access one section of complete MVC video flowing to obtain camera calibration data first.MVC Supplemental enhancement information (the Supplemental that the calibrating parameters of video camera are stored in various visual angles acquisition information in video flowing Enhancement Information, SEI) message (Multiview acquisition information SEI Message in) and one IDR of association (Instantaneous Decoding Refresh, decoding refreshes immediately) AU (Access Unit, access unit).Then terminal B calculates the position of video camera according to calibrating parameters.Nominal data includes internal reference and outer ginseng two Part.Internal reference determines video camera inner geometry and optical characteristics including focal length central point etc., and outer ginseng includes the conversion square of coordinate system Three-dimensional position and direction of the battle array determination video camera in a world coordinate system.After camera position is calculated, it is determined that The corresponding reference viewing angle mark of virtual perspective.For example, because adjacent true visual angle similarity is higher, common visual angle is closed Into adjacent two true visual angles can be based on.Nominal data will be described and according to nominal data determination with reference to specific example further below The method of reference viewing angle mark.

Therefore, the embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to according to regarding represented by Viewing-angle information Video is watched at angle, improves the visual angle experience of user's viewing video.

Described above is Viewing-angle information includes the example of the angle of virtual perspective.Alternatively, in the fig. 4 embodiment, If Viewing-angle information is virtual perspective, in step 402, reference viewing angle mark is also can record in the bookmark that terminal A is created ReferenceViewId, reference viewing angle mark can be directly obtained in order to terminal B from bookmark, and only request is accessed and ginseng Examine visual angle and identify corresponding video flowing, and one section of complete MVC video flowing need not be received, can so save the access of terminal B Bandwidth, improves the efficiency of data transfer.

If it is necessary, terminal A can also record the visual angle mark at two true visual angles of synthesis virtual perspective, and creating During the visual angle at the two true visual angles mark increased into bookmark during bookmark, this is virtual respectively as included in Viewing-angle information Two reference viewing angles mark ReferenceViewId at visual angle.

In the case, for virtual perspective type Virtual ViewType, this can be carried in Viewing-angle information and is virtually regarded The angle ViewAngle at angle and corresponding reference viewing angle mark ReferenceViewId.

The description of other specification can be identical with above example in bookmark, therefore is not repeated.

Then, in step 407, references of the terminal B according to the corresponding visual angle mark of real camera or virtual perspective Visual angle identifies corresponding operating point OP request multi-visual angle video stream, and then decoded video streams to be showing true visual angle content, or Reference viewing angle is obtained from video flowing and identifies corresponding video content, synthesis corresponds to the video content of virtual perspective and shows conjunction Into video content.

Therefore, the embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to according to regarding represented by Viewing-angle information Angle is continuous to see video, improves the visual angle experience of user's viewing video.Meanwhile, reference viewing angle mark is directly carried in Viewing-angle information Know, camera calibration parameter is obtained without parsing video flowing, breakpoint can be reduced and continue data interaction amount when seeing, quickly access use The visual angle of family selection.

Fig. 5 is the schematic flow diagram that another embodiment of the present invention plays video process from breakpoint.In Fig. 5, " terminal A " table Show the terminal device that breakpoint is set, " terminal B " represents the terminal device of continued broadcasting video, and " webserver " represents storage bookmark Server device.Terminal A and terminal B can be same equipment, or different equipment.

In Fig. 5, the step same or similar with Fig. 4 is represented using identical reference, therefore appropriate omission repetition Description.The embodiment of Fig. 5 is with the difference of Fig. 4, if the visual angle in bookmark represented by Viewing-angle information is virtual perspective And Viewing-angle information includes the angle of virtual perspective, without being identified including reference viewing angle, then the webserver can be in EPG units The visual angle description information of multi-angle video is carried in data, so that terminal B is according to the visual angle description information and book of multi-angle video The angle of the virtual perspective that label include, determines the reference viewing angle mark of virtual perspective.

405a, the webserver provides EPG metadata to terminal B, so that terminal B carries out video request program.In EPG units number In, the visual angle description information of multi-angle video is carried.The visual angle description information can be the demarcation number of visual angle correspondence video camera According to, or the corresponding relation of true visual angle and virtual angle described.

Below as a example by EPG metadata in xml form.

Table 1 is a specific implementation of the visual angle description information that multi-angle video is carried in EPG metadata.Table 1 It is the example that the nominal data at visual angle is described in the increased XML element of EPG metadata, these nominal datas can be similar in step The camera calibration data obtained from MVC video flowings in rapid 401.

The Viewing-angle information of camera calibration data is carried in table 1EPG metadata

Parameter name	Scope	It is whether optional	Description
				ViewAcquisitionInfo	0,1	○	The nominal data information at visual angle
ViewId	0, N	○	Visual angle identifies
				IntrinsicParam	0,1	○	The internal reference of visual angle correspondence video camera
focal_length_x	0,1	○	Horizontal focal length
				focal_length_y	0,1	○	Vertical focal length
principal_point_x	0,1	○	Origin horizontal coordinate
				principal_point_y	0,1	○	Origin vertical coordinate
skew_factor	0,1	○	Warping factor
				ExtrinsicParam	0,1	○	The outer ginseng of visual angle correspondence video camera
Rotation_matrix	0,1	○	Spin matrix
				Translation_vector	0,1	○	Translation vector

In table 1, each ViewId in individual (N is positive integer) visual angle mark ViewId of 0-N has corresponding internal reference respectively With outer ginseng.Internal reference may include horizontal focal length, vertical focal length, origin horizontal coordinate, origin vertical coordinate, warping factor etc., outer ginseng May include spin matrix and translation vector etc..The position at the visual angle of the video camera of each ViewId can be calculated from these data And direction, calculating process to it is similar in the prior art, therefore repeat no more.

In step 407, due to identifying Viewing-angle information in bookmark, when viewing visual angle is virtual perspective, terminal B can root According to the nominal data of the multiple visual angles correspondence video camera described in EPG metadata, the position at the visual angle of each video camera is calculated Put and direction, thus may determine that the shooting angle of each video camera.Then terminal B can be according to the virtual perspective carried in bookmark Angle ViewAngle determine viewing visual angle corresponding reference viewing angle mark.For example, it is assumed that ViewAngle takes the photograph between certain two Between the shooting angle of camera (corresponding visual angle mark be respectively ViewId1 and ViewId2), then can by ViewId1 and The value that the value of ViewId2 is identified as corresponding two reference viewing angles of virtual perspective ViewAngle.

Table 2 is another specific implementation of visual angle description information that multi-angle video is carried in EPG metadata.Table 2 exists EPG metadata increases the corresponding relation that XML element describes true visual angle and virtual perspective.

The corresponding relation of true visual angle and virtual perspective is carried in table 2EPG metadata

In table 2, in individual (N is positive integer) visual angle relation ViewRelation of 0-N, each ViewRelation includes reference The minimum angles and reference viewing angle that the LOOK LEFT at visual angle, the LOOK RIGHT of reference viewing angle, reference viewing angle can synthesize virtual perspective can be closed Into the maximum angle of virtual perspective.Parameter in table 2 has directly given the shooting angle of each video camera.In one embodiment In, the webserver can be calculated the parameter of table 2 according to the parameter in table 1.For example, the LOOK LEFT of reference viewing angle is ViewId1, the LOOK RIGHT of reference viewing angle is ViewId2, and the minimum angles that reference viewing angle can synthesize virtual perspective are 0, with reference to regarding Angle can synthesize the maximum angle 5 of virtual perspective, represent that the two visual angles ViewId1 and ViewId2 can synthesize the angle of virtual perspective Degree scope is 0-5.

Similarly, in step 407, terminal B can according to the corresponding relation of true visual angle and virtual perspective in table 2, according to The angle ViewAngle of the virtual perspective carried in bookmark determines the corresponding reference viewing angle mark of viewing visual angle.For example, it is assumed that ViewAngle between certain two video camera (corresponding visual angle mark is respectively ViewId1 and ViewId2) shooting angle it Between, that is, fall into the angular range of the virtual perspective that two video cameras can synthesize, then can be by the value of ViewId1 and ViewId2 As the value that corresponding two reference viewing angles of virtual perspective ViewAngle are identified.

In Tables 1 and 2, it is optional parameters (Optional) that " O " represents the parameter.

In addition, what the various design parameters name be given in above embodiment was merely exemplary, the present invention is not implemented The scope of example is construed as limiting, and can be to be adjusted according to actual needs.Such modification each falls within the embodiment of the present invention In the range of.

The embodiment of the invention provides and support that the breakpoint of various visual angles system continues the method seen.By recording user in bookmark The Viewing-angle information of selection so that user can be watched when this program is watched next time from the visual angle of selection, continue user Visual angle experience, eliminate again switching visual angle find optimal viewing angle trouble.Meanwhile, it is virtual perspective at the visual angle of user's selection In the case of, if carrying the reference viewing angle mark of virtual perspective in bookmark, or carried for determining in EPG metadata The Viewing-angle informations such as the nominal data or corresponding relation of reference viewing angle mark, then user, can be only when this program is watched next time The optimal viewing angle selected before access is watched, and the video flowing without accessing all visual angles reduces data interaction amount, section Bandwidth is saved.

Fig. 6 is the block diagram of the terminal device of one embodiment of the invention.One example of the terminal device 60 of Fig. 6 is to set The terminal device (first terminal) of breakpoint, such as the terminal A in Fig. 4 and Fig. 5.Terminal device 60 include indicate receiving unit 61, Bookmark creating unit 62 and bookmark delivery unit 63.

Receiving unit 61 is indicated to receive the instruction that breakpoint is set.Bookmark creating unit 62 is according to the instruction receiving unit institute The instruction of reception creates bookmark, and the bookmark carries the temporal information of video, and broadcasting corresponding with the temporal information is regarded The Viewing-angle information of frequency.Bookmark delivery unit 63 sends the bookmark, so that second terminal is according to represented by the Viewing-angle information Visual angle, video is played from the breakpoint represented by the temporal information.Terminal device 60 and the second terminal are same terminal Or be different terminals.

The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to watched according to the visual angle represented by Viewing-angle information Video, improves the visual angle experience of user's viewing video.

Bookmark delivery unit 63 can be sent to webserver storage bookmark, so as to second terminal from the webserver Obtain bookmark.Or, bookmark delivery unit 63 directly can also be sent to second terminal bookmark.

Terminal device 60 can be realized being related to set the terminal device (first terminal) of breakpoint in the embodiment of above-mentioned Fig. 1-Fig. 5 Operation.For example, if the visual angle represented by Viewing-angle information is the true visual angle corresponding to real camera, bookmark creates single The Viewing-angle information carried in the bookmark that unit 62 creates may include the visual angle mark at true visual angle.Or, if Viewing-angle information institute table The visual angle for showing is the virtual perspective synthesized with reference to multiple true visual angles, then what is carried in the bookmark that bookmark creating unit 62 is created regards Angle information may include the angle of virtual perspective.

Alternatively, as another embodiment, if the visual angle represented by Viewing-angle information is virtual perspective, bookmark creates single The Viewing-angle information carried in the bookmark that unit 62 creates can also include corresponding at least two reference viewing angle of angle of virtual perspective Mark, at least two reference viewing angles mark is corresponded respectively to for synthesizing at least two of the virtual perspective true visual angles Visual angle mark.So can further reduce data interaction amount.

The other functions of terminal device 60 and operation can refer to described in above method embodiment, to avoid repeating, no longer Describe in detail

Fig. 7 is the block diagram of the terminal device of another embodiment of the present invention.One example of the terminal device 70 of Fig. 7 is continued broadcasting The terminal device (second terminal) of video, such as the terminal B in Fig. 4 and Fig. 5.Terminal device 70 includes acquiring unit 71, parsing Unit 72 and broadcast unit 73.

Acquiring unit 71 obtains bookmark, and the bookmark is created according to the instruction for setting breakpoint.Resolution unit 72 obtains described The temporal information of the video that bookmark is carried, and the Viewing-angle information for playing video corresponding with the temporal information.Play single Unit 73 plays video from the breakpoint represented by the temporal information according to the visual angle represented by the Viewing-angle information.

The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to watched according to the visual angle represented by Viewing-angle information Video, improves the visual angle experience of user's viewing video.

Acquiring unit 71 can obtain bookmark from the webserver, or directly can be obtained from the first terminal for creating bookmark Take bookmark.

Terminal device 70 can be realized being related to the terminal device (second terminal) of continued broadcasting video in the embodiment of above-mentioned Fig. 1-Fig. 5 Operation.If for example, the visual angle represented by the Viewing-angle information of the acquisition of resolution unit 72 is corresponding to the true of real camera Visual angle, then the Viewing-angle information may include true visual angle visual angle mark, now broadcast unit 73 can ask access and true visual angle Visual angle identify corresponding video flowing, and video flowing is played from breakpoint.

On the other hand, if the visual angle represented by the Viewing-angle information of the acquisition of resolution unit 72 is to be closed with reference to multiple true visual angles Into virtual perspective, then the Viewing-angle information may include the angle of virtual perspective, now broadcast unit 73 can be according to virtual perspective Angle, determine virtual perspective at least two reference viewing angles mark (at least two reference viewing angle mark correspond respectively to for Synthesize the visual angle mark at least two true visual angles of virtual perspective), request accesses the video flowing corresponding to reference viewing angle mark, And the video flowing that will be identified corresponding to reference viewing angle synthesizes the video content corresponding to virtual perspective, is played from breakpoint and is closed Into video content.Wherein, broadcast unit 73 can obtain the corresponding reference viewing angle mark of virtual perspective from Viewing-angle information, or, Broadcast unit 73 can obtain EPG metadata, and (EPG metadata carries the visual angle description information of multi-angle video, wherein regard more The visual angle description information of angle video includes but is not limited to the nominal data of the corresponding real camera in true visual angle, or including true The corresponding relation of real visual angle and the angle of the virtual perspective), and according to the mark of the corresponding real camera in the true visual angle The corresponding relation of the angle of fixed number evidence or true visual angle and virtual perspective, and according to the angle information of virtual perspective, it is determined that Reference viewing angle is identified.For example, the visual angle description information of multi-angle video can be the nominal data of table 1 or the corresponding relation of table 2.

The other functions of terminal device 70 and operation can refer to described in above method embodiment, to avoid repeating, no longer Describe in detail.

Fig. 8 be one embodiment of the invention realization played from breakpoint video device block diagram.The device 80 of Fig. 8 One example is the webserver in Fig. 4 and Fig. 5, or the terminal device 60 in Fig. 6.Device 80 includes receiving unit 81 With transmitting element 82.

Receiving unit 81 receives request of the second terminal to bookmark, and the bookmark carries the temporal information of video, Yi Jiyu The corresponding Viewing-angle information for playing video of the temporal information.Transmitting element 82 sends bookmark to second terminal, so as to second eventually Video is played from the breakpoint represented by temporal information according to the visual angle represented by Viewing-angle information in end.

The embodiment of the present invention carries Viewing-angle information in bookmark such that it is able to seen according to the visual angle represented by Viewing-angle information is continuous Video, improves the visual angle experience of user's viewing video.

Device 80 can be realized being related to the operation of the webserver in the embodiment of above-mentioned Fig. 1-Fig. 5.If for example, visual angle is believed The represented visual angle of breath is the true visual angle corresponding to real camera, the then visual angle carried in the bookmark that transmitting element 82 sends Information may include the visual angle mark at true visual angle.Or, if the visual angle represented by Viewing-angle information is with reference to multiple true visual angles The virtual perspective of synthesis, the then Viewing-angle information carried in the bookmark that transmitting element 82 sends may include the angle of virtual perspective.

Alternatively, if the visual angle represented by Viewing-angle information is virtual perspective, taken in the bookmark that transmitting element 82 sends The Viewing-angle information of band can also include the corresponding at least two reference viewing angles mark of virtual perspective, at least two reference viewing angles mark Knowledge corresponds respectively to be identified for the visual angle for synthesizing at least two of virtual perspective true visual angles.So second terminal can ask to connect Enter with least two reference viewing angles corresponding video flowing of mark, and corresponding with least two reference viewing angles mark video flowing is closed As the video content corresponding to virtual perspective, synthesized video content is played from breakpoint, therefore all regarding need not be accessed Frequency flows, and can save bandwidth.

Fig. 9 be another embodiment of the present invention realization played from breakpoint video device block diagram.The device 90 of Fig. 9 with The difference of Fig. 8 is also to include generation unit 83 and memory cell 84, will be omitted and same or analogous part in Fig. 8 Describe in detail.

Generation unit 83 is used to generate the EPG metadata of the visual angle description information for carrying multi-angle video, so as to second eventually End can determine the reference viewing angle mark of virtual perspective according to the visual angle description information of multi-angle video and the angle of virtual perspective Know.For example, as shown in Table 1 and Table 2, the visual angle description information of above-mentioned multi-angle video may include but be not limited to true visual angle correspondence Real camera nominal data, or true visual angle and the angle of virtual perspective corresponding relation.

Memory cell 84 can store the bookmark received from first terminal.The first terminal is same end with second terminal End is different terminals.For example, first terminal can create bookmark when the instruction for setting breakpoint is received, and bookmark is sent To the webserver 90, then the storage of memory cell 84 bookmark, is incited somebody to action when asking bookmark so as to second terminal by transmitting element 82 The bookmark is sent to second terminal.

Memory cell 84, can be with program identification, ID and/or bookmark identification in association when bookmark is stored Storage bookmark, to be subsequent supplied to ask the terminal of bookmark.The embodiment of the present invention is not limited to these specific storage modes Example, and can be to store bookmark according to any existing mode.

The other functions of device 80 and 90 and operation can refer to described in the embodiment of the method for above figure 3, to avoid repeating, no Describe in detail again.For example, device 80 or 90 can be the above-mentioned webserver, in the case, device 80 or 90 can receive The bookmark of one terminal transmission simultaneously stores the bookmark, and be sent to second terminal when second terminal asks the bookmark, so as to second Terminal watches video according to the bookmark.Or, device 80 or 90 can be first terminal, and in the case, device 80 or 90 is straight Connect and send a bookmark to second terminal, so that second terminal watches video according to the bookmark.Above-mentioned first terminal and second terminal Can be same terminal, or different terminals.

Audio/video player system according to embodiments of the present invention may include above-mentioned terminal device 60,70 or said apparatus 80,90.

Those of ordinary skill in the art are it is to be appreciated that the list of each example described with reference to the embodiments described herein Unit and algorithm steps, can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually Performed with hardware or software mode, depending on the application-specific and design constraint of technical scheme.Professional and technical personnel Described function, but this realization can be realized it is not considered that exceeding using distinct methods to each specific application The scope of the present invention.

It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.

In several embodiments provided herein, it should be understood that disclosed system, apparatus and method, can be with Realize by another way.For example, device embodiment described above is only schematical, for example, the unit Divide, only a kind of division of logic function there can be other dividing mode when actually realizing, for example multiple units or component Can combine or be desirably integrated into another system, or some features can be ignored, or do not perform.It is another, it is shown or The coupling each other for discussing or direct-coupling or communication connection can be the indirect couplings of device or unit by some interfaces Close or communicate to connect, can be electrical, mechanical or other forms.

The device that video is played from breakpoint in the embodiment of the present invention can be any computer equipment, and from breakpoint The above method step that the device that place plays video is performed can play video from breakpoint by the computing device of computer The functional unit of device can also be to run on the functional unit in the processor of computer.Additionally, the embodiment of the present invention Above-mentioned terminal can be any terminal device, such as mobile phone, PDA, computer, remote controllers etc. perform the side of above-mentioned terminal Method can be the processor of terminal device.The functional unit of terminal can also be to run on the work(in the processor of terminal device Can unit.

The unit that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be according to the actual needs selected to realize the mesh of this embodiment scheme 's.

In addition, during each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.

If the function is to realize in the form of SFU software functional unit and as independent production marketing or when using, can be with Storage is in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, including some instructions are used to so that a computer equipment (can be individual People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention. And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.

The above, specific embodiment only of the invention, but protection scope of the present invention is not limited thereto, and it is any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all contain Cover within protection scope of the present invention.Therefore, protection scope of the present invention described should be defined by scope of the claims.

Claims (22)

1. it is a kind of from breakpoint play video method, it is characterised in that including：

Bookmark is obtained, the bookmark is created according to the instruction for setting breakpoint；

The temporal information of the video that the bookmark is carried is obtained, and the visual angle letter for playing video corresponding with the temporal information Breath；

According to the visual angle represented by the Viewing-angle information, video is played from the breakpoint represented by the temporal information.

2. the method for claim 1, it is characterised in that the Viewing-angle information is included corresponding to the true of real camera The visual angle mark at visual angle,

The visual angle according to represented by the Viewing-angle information, video, bag are played from the breakpoint represented by the temporal information Include：

Request accesses the visual angle corresponding video flowing of mark with the true visual angle；

The video flowing is played from the breakpoint.

3. the method for claim 1, it is characterised in that the Viewing-angle information includes being closed with reference at least two true visual angles Into virtual perspective angle；

The visual angle according to represented by the Viewing-angle information, video, bag are played from the breakpoint represented by the temporal information Include：

According to the angle of the virtual perspective, at least two reference viewing angles mark of the virtual perspective, described at least two are determined Individual reference viewing angle mark corresponds respectively to be identified for the visual angle for synthesizing at least two of the virtual perspective true visual angles；

Request is accessed and the corresponding video flowing of at least two reference viewing angles mark；

By described regarding corresponding to the virtual perspective is synthesized with the corresponding video flowing of at least two reference viewing angles mark Frequency content, synthesized video content is played from the breakpoint.

4. method as claimed in claim 3, it is characterised in that the angle according to the virtual perspective, determines the void Intend at least two reference viewing angles mark at visual angle, including：

At least two reference viewing angles mark corresponding with the virtual perspective is obtained from the Viewing-angle information.

5. method as claimed in claim 3, it is characterised in that the angle information according to the virtual perspective, determines institute At least two reference viewing angles mark of virtual perspective is stated, including：

Electronic program guide (EPG) metadata is obtained, the EPG metadata carries the visual angle description information of multi-angle video, wherein The visual angle description information of the multi-angle video includes the nominal data of the corresponding real camera in true visual angle, or including true The corresponding relation of real visual angle and the angle of the virtual perspective；

The angle of nominal data or true visual angle according to the corresponding real camera in the true visual angle and the virtual perspective The corresponding relation of degree, and according to the angle information of the virtual perspective, determine the reference viewing angle mark.

6. it is a kind of from breakpoint play video method, it is characterised in that including：

First terminal receives the instruction for setting breakpoint；

The first terminal indicates to create bookmark according to described, and the bookmark carries the temporal information of video, and with it is described when Between information it is corresponding play video Viewing-angle information；

The first terminal sends the bookmark, so that second terminal is according to the visual angle represented by the Viewing-angle information, from described Video is played at breakpoint represented by temporal information.

7. method as claimed in claim 6, it is characterised in that

The Viewing-angle information includes the visual angle mark at the true visual angle corresponding to real camera, is connect in order to second terminal request Enter the visual angle corresponding video flowing of mark with the true visual angle；And the video flowing is played from the breakpoint；Or

The Viewing-angle information includes the angle of the virtual perspective with reference at least two true visual angle synthesis, in order to second terminal root According to the angle of the virtual perspective, at least two reference viewing angles mark of the virtual perspective, at least two reference are determined Visual angle mark corresponds respectively to be identified for the visual angle for synthesizing at least two of the virtual perspective true visual angles；Request access with At least two reference viewing angle identifies corresponding video flowing；And will be described corresponding with least two reference viewing angles mark Video flowing synthesizes the video content corresponding to the virtual perspective, and synthesized video content is played from the breakpoint.

8. method as claimed in claim 7, it is characterised in that if the visual angle represented by the Viewing-angle information is described virtual Visual angle, then the Viewing-angle information is also including the corresponding at least two reference viewing angles mark of the virtual perspective, described at least two Reference viewing angle mark corresponds respectively to be identified for the visual angle for synthesizing at least two of the virtual perspective true visual angles, with toilet Second terminal request is stated to access and the corresponding video flowing of at least two reference viewing angles mark, and will described in described at least two Individual reference viewing angle identifies corresponding video flowing and synthesizes video content corresponding to the virtual perspective, is played from the breakpoint Synthesized video content.

9. it is a kind of from breakpoint play video method, it is characterised in that including：

Receive request of the second terminal to bookmark, the bookmark carries the temporal information of video, and with the temporal information pair The Viewing-angle information of the broadcasting video answered；

The bookmark is sent to second terminal, so that the second terminal is according to the visual angle represented by the Viewing-angle information, from institute State broadcasting video at the breakpoint represented by temporal information.

10. method as claimed in claim 9, it is characterised in that

The Viewing-angle information includes the visual angle mark at the true visual angle corresponding to real camera；It is described so as to the second terminal According to the visual angle represented by the Viewing-angle information, broadcasting video is specially from the breakpoint represented by the temporal information：Second Terminal request accesses the visual angle corresponding video flowing of mark with the true visual angle, and the video is played from the breakpoint Stream；Or

The Viewing-angle information includes the angle of the virtual perspective with reference at least two true visual angle synthesis；It is described so as to described second According to the visual angle represented by the Viewing-angle information, broadcasting video is specially terminal from the breakpoint represented by the temporal information： Second terminal determines at least two reference viewing angles mark of the virtual perspective according to the angle of the virtual perspective, it is described extremely Few two reference viewing angles mark corresponds respectively to be identified for the visual angle for synthesizing at least two of the virtual perspective true visual angles； Request is accessed and the corresponding video flowing of at least two reference viewing angles mark；With at least two reference viewing angles mark by described in Know corresponding video flowing and synthesize video content corresponding to the virtual perspective, synthesized video is played from the breakpoint Content；Or

The Viewing-angle information includes the angle and the corresponding at least two reference viewing angles mark of the virtual perspective of the virtual perspective Know, at least two reference viewing angles mark is corresponded respectively to for synthesizing at least two of the virtual perspective true visual angles Visual angle identifies, described so that the second terminal is according to the visual angle represented by the Viewing-angle information, from temporal information institute table Video is played at the breakpoint for showing to be specially：The second terminal request accesses corresponding with least two reference viewing angles mark Video flowing, and synthesized described corresponding to the virtual perspective with the corresponding video flowing of at least two reference viewing angles mark Video content, synthesized video content is played from the breakpoint.

11. methods as claimed in claim 10, it is characterised in that if the Viewing-angle information includes that reference at least two is true Visual angle synthesis virtual perspective angle, then methods described also include：

Generation carries the electronic program guide (EPG) metadata of the visual angle description information of multi-angle video, the multi-angle video Visual angle description information includes the nominal data of the corresponding real camera in true visual angle, or virtual with described including true visual angle The corresponding relation of the angle at visual angle, so as to the second terminal according to the nominal data of the corresponding real camera in true visual angle or The corresponding relation of the true visual angle of person and the angle of the virtual perspective, and according to the angle information of the virtual perspective, it is determined that The reference viewing angle mark.

12. method as described in claim any one of 9-11, it is characterised in that methods described also includes：

Store the bookmark received from first terminal.

A kind of 13. terminal devices, it is characterised in that including：

Acquiring unit, for obtaining bookmark, the bookmark is created according to the instruction for setting breakpoint；

Resolution unit, the temporal information for obtaining the video that the bookmark is carried, and corresponding with the temporal information broadcast Put the Viewing-angle information of video；

Broadcast unit, for according to the visual angle represented by the Viewing-angle information, being broadcast from the breakpoint represented by the temporal information Put video.

14. terminal devices as claimed in claim 13, it is characterised in that if the Viewing-angle information bag that the resolution unit is obtained The visual angle mark at the true visual angle corresponding to real camera is included, then

The broadcast unit accessed specifically for request and the true visual angle the visual angle corresponding video flowing of mark, and from described The video flowing is played at breakpoint.

15. terminal devices as claimed in claim 13, it is characterised in that if the Viewing-angle information bag that the resolution unit is obtained The angle of the virtual perspective with reference at least two true visual angle synthesis is included, then

The broadcast unit determines at least two references of the virtual perspective specifically for the angle according to the virtual perspective Visual angle identifies, and at least two reference viewing angles mark corresponds respectively to true for synthesizing at least two of the virtual perspective The visual angle mark at visual angle；Request accesses the video flowing corresponding at least two reference viewing angle mark, and corresponds to described The video flowing of at least two reference viewing angles mark synthesizes the video content corresponding to the virtual perspective, from the breakpoint Locate the video content synthesized by broadcasting.

16. terminal devices as claimed in claim 15, it is characterised in that

The broadcast unit from the Viewing-angle information specifically for obtaining corresponding with the angle of the virtual perspective at least two Reference viewing angle is identified；Or,

The broadcast unit carries multi-angle video specifically for obtaining electronic program guide (EPG) metadata, the EPG metadata Visual angle description information, wherein the visual angle description information of the multi-angle video includes true visual angle corresponding real camera Nominal data, or the corresponding relation including true visual angle with the angle of the virtual perspective；According to the true visual angle correspondence Real camera nominal data or the corresponding relation of true visual angle and the angle of the virtual perspective, and according to described The angle information of virtual perspective, determines the reference viewing angle mark.

A kind of 17. terminal devices, it is characterised in that including：

Receiving unit is indicated, the instruction of breakpoint is set for receiving；

Bookmark creating unit, the instruction for being received according to the instruction receiving unit creates bookmark, and the bookmark is carried and regarded The temporal information of frequency, and the Viewing-angle information for playing video corresponding with the temporal information；

Bookmark delivery unit, for sending the bookmark, so that second terminal is according to the visual angle represented by the Viewing-angle information, from Video is played at breakpoint represented by the temporal information.

18. terminal devices as claimed in claim 17, it is characterised in that

The Viewing-angle information carried in the bookmark that the bookmark creating unit is created includes the true visual angle corresponding to real camera Visual angle mark, in order to second terminal ask access and the true visual angle the visual angle corresponding video flowing of mark；And from institute State and the video flowing is played at breakpoint；Or

The Viewing-angle information includes the angle of the virtual perspective with reference at least two true visual angle synthesis, in order to second terminal root According to the angle of the virtual perspective, at least two reference viewing angles mark of the virtual perspective, at least two reference are determined Visual angle mark corresponds respectively to be identified for the visual angle for synthesizing at least two of the virtual perspective true visual angles；Request access with At least two reference viewing angle identifies corresponding video flowing；And will be described corresponding with least two reference viewing angles mark Video flowing synthesizes the video content corresponding to the virtual perspective, and synthesized video content is played from the breakpoint；Or

The Viewing-angle information includes the angle and the corresponding at least two reference viewing angles mark of the virtual perspective of the virtual perspective Know, at least two reference viewing angles mark is corresponded respectively to for synthesizing at least two of the virtual perspective true visual angles Visual angle identifies, so as to second terminal request access and the corresponding video flowing of at least two reference viewing angles mark, and will The video content synthesized with the corresponding video flowing of at least two reference viewing angles mark corresponding to the virtual perspective, Synthesized video content is played from the breakpoint.

A kind of 19. devices for realizing playing video from breakpoint, it is characterised in that including：

Receiving unit, for receiving request of the second terminal to bookmark, the bookmark carries the temporal information of video, and with institute State the corresponding Viewing-angle information for playing video of temporal information；

Transmitting element, for sending the bookmark to second terminal, so that the second terminal is according to Viewing-angle information institute table The visual angle for showing, video is played from the breakpoint represented by the temporal information.

20. devices as claimed in claim 19, it is characterised in that

The Viewing-angle information carried in the bookmark that the transmitting element sends includes regarding for the true visual angle corresponding to real camera Footmark is known, so as to the second terminal ask to access and the true visual angle the visual angle corresponding video flowing of mark, and from described The video flowing is played at breakpoint；Or

The Viewing-angle information includes the angle of the virtual perspective with reference at least two true visual angle synthesis, so as to the second terminal According to the angle of the virtual perspective, at least two reference viewing angles mark of the virtual perspective, at least two ginseng are determined Visual angle mark is examined to correspond respectively to be identified for the visual angle for synthesizing at least two of the virtual perspective true visual angles；Request is accessed With the corresponding video flowing of at least two reference viewing angles mark；Will be described corresponding with least two reference viewing angles mark Video flowing synthesizes the video content corresponding to the virtual perspective, and synthesized video content is played from the breakpoint；Or

The Viewing-angle information includes the angle and the corresponding at least two reference viewing angles mark of the virtual perspective of the virtual perspective Know, at least two reference viewing angles mark is corresponded respectively to for synthesizing at least two of the virtual perspective true visual angles Visual angle identifies, so as to second terminal request access and the corresponding video flowing of at least two reference viewing angles mark, and will The video content synthesized with the corresponding video flowing of at least two reference viewing angles mark corresponding to the virtual perspective, Synthesized video content is played from the breakpoint.

21. devices as claimed in claim 20, it is characterised in that described device also includes：Generation unit, carries for generating The electronic program guide (EPG) metadata of the visual angle description information of multi-angle video, the visual angle description information of the multi-angle video Nominal data including the corresponding real camera in true visual angle, or including true visual angle and the angle of the virtual perspective Corresponding relation, so as to the second terminal according to the nominal data of the corresponding real camera in true visual angle or true visual angle with The corresponding relation of the angle of the virtual perspective, and according to the angle information of the virtual perspective, determine the reference viewing angle Mark.

22. device as described in claim any one of 19-21, it is characterised in that described device also includes：

Memory cell, for storing the bookmark received from first terminal.