CN108235113A - A kind of panoramic video renders and presents attribute indicating means and system - Google Patents
A kind of panoramic video renders and presents attribute indicating means and system Download PDFInfo
- Publication number
- CN108235113A CN108235113A CN201611155809.7A CN201611155809A CN108235113A CN 108235113 A CN108235113 A CN 108235113A CN 201611155809 A CN201611155809 A CN 201611155809A CN 108235113 A CN108235113 A CN 108235113A
- Authority
- CN
- China
- Prior art keywords
- panoramic video
- information
- instruction information
- indicates
- renders
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The present invention provides a kind of panoramic video and renders and present attribute indicating means and system, the method is rendered and presents in associated description information with panoramic video for the first instruction information of panoramic video insertion and the second instruction information and/or third instruction information；Described first indicates that information indicates the media content attribute of the panoramic video, including：The identifier of the mapping format of panoramic video；Whether panoramic video covers the identifier at 360 degree of visual angles；The second instruction information, indicates the spatial information of the panoramic video；The third indicates information, and the quality information of the panoramic video is indicated.The present invention can realize the rendering and presentation of the media content based on visual angle, match the panoramic video at visual angle and can meet high quality consumption demand of the user to panoramic video as far as possible in the case where network bandwidth is limited.
Description
Technical field
The present invention relates to technical field of digital media, and in particular, to a kind of panoramic video renders and present attribute instruction
Method and system provide panoramic video necessity instruction information, real-time rendering and presentation for panoramic video.
Background technology
With the fast development of digital media technology, immersion media are increasingly becoming one of developing direction of Future Media.
While industrial quarters and academia put into panoramic video making and coding study extensively, the transmission of panoramic video also faces
Some problems to be solved.
For panoramic video, the media content that user consumes every time is all a part of space region of entire complete video
Domain, and the area of space for the media content consumed is as user watches the visual angle change of panoramic video and changes.
Through retrieval, Chinese invention CN201210365946.9, disclose a kind of displaying of panoramic video and interactive system and
Method, the patent are identified by being set on reference substance, and using one, at least there are two identify to realize to panoramic video for tool
The free exhibition and interactive process of panoramic video are realized in 360 ° of rotation process controls.But the patent can not realize video content
Instruction, to the index of media content when being not used to rendering of the panoramic video based on visual angle, presentation and view angle switch.
Invention content
It is rendered the object of the present invention is to provide a kind of panoramic video and attribute indicating means and system is presented, to being directed to panorama
Rendering and presentation attribute of the video under different mappings mode are indicated, can realize the rendering of the media content based on visual angle
And presentation.
According to the first aspect of the invention, a kind of panoramic video is provided and renders and present attribute indicating means, the method：
Render and present with panoramic video in associated description information for the panoramic video be inserted into the first instruction information and
Second instruction information and/or third instruction information；
Described first indicates that information indicates the media content attribute of the panoramic video, including：
The identifier of the mapping format of panoramic video；
Whether panoramic video covers the identifier of whole angulars field of view；
The second instruction information, indicates the spatial information of the panoramic video；
The third indicates information, and the quality information of the panoramic video is indicated.
Preferably, the identifier of the mapping format of the panoramic video, be used to indicate plane frame to panoramic video present when
Mapping mode.
Preferably, whether the panoramic video covers the identifier of whole angulars field of view, is used to indicate the panoramic video
In data whether can complete map into whole angulars field of view panoramic video present.
Preferably, the spatial information indicates panoramic video media resource and different visual angles area on model is presented in client
The correspondence in domain.
Preferably for the different mapping modes, the spatial information includes the following contents：
For longitude and latitude figure and binocular solid longitude and latitude figure mapping mode, the spatial information includes area of space and covers pitching
Angle and azimuthal range；
For polyhedron mapping mode, the spatial information includes the polyhedral face for indicating that the panoramic video includes
Number；
For cylinder mapping mode, the spatial information includes the number in the face that the panoramic video includes and in side
The specific horizontal and space coordinate range in face.
Preferably, the quality information includes the resolution information of the panoramic video.
It is highly preferred that the resolution information includes the horizontal and vertical number of pixels of area of space, particularly, for circle
The resolution ratio of bottom surface is indicated with bottom surface radius on cylinder.
Further, the method further includes：Receive the instruction information from network entity, and to the instruction information into
Row parsing, for the rendering and presentation of the panoramic video.
According to the second aspect of the invention, a kind of panoramic video rendering and rendering method are provided, including：
S1：Signaling information is built in server end, is rendered and present in associated signaling for institute with panoramic video
State panoramic video and be inserted into the first instruction information and the second instruction information and/or third instruction information, by the panoramic video and
Its corresponding signaling information is sent to client；
S2：After client receives the panoramic video that server sends and its corresponding signaling information, to including institute
The signaling information for stating the first instruction information is parsed, and when the panoramic video is rendered and presented, utilizes described second
Instruction information and/or third instruction information determine that model different visual angles region is presented in the panoramic video media resource and client
Correspondence, correctly to render and present.
According to the third aspect of the invention we, a kind of panoramic video is provided and renders and present system, including：
Server end is inserted into first rendering and presenting in associated signaling with panoramic video for the panoramic video
It indicates information and the second instruction information and/or third instruction information, the panoramic video and its corresponding signaling information is sent out
Give client；
Client, after receiving the panoramic video and its corresponding signaling information that server sends, to comprising described
The signaling information of first instruction information is parsed, and when the panoramic video is rendered and presented, is referred to using described second
Show that information and/or third instruction information determine that model different visual angles region is presented in the panoramic video media resource and client
Correspondence, correctly to render and present.
Compared with prior art, the present invention has following advantageous effect：
The present invention is directed to the instruction that rendering and presentation attribute of the panoramic video under different mappings mode propose complete set
Mechanism, and further the space of panoramic video and quality information transmitted are identified on the manufacturing basis, so as to
Enough renderings and presentation for realizing the panoramic video based on visual angle.The panoramic video for matching visual angle can be in the situation that network bandwidth is limited
Under meet high quality consumption demand of the user to panoramic video as far as possible.
The present invention indicates the media content attribute, spatial information and/or quality information of panoramic video, can be fine
Ground is for rendering of the panoramic video based on visual angle, presentation and during view angle switch to the index of media content.
Description of the drawings
By reading with reference to the detailed description made with figure below to non-limiting example, other feature of the invention, mesh
And advantage will become more apparent upon：
Fig. 1 is the simplified flowchart that one embodiment of the invention panoramic video indicates information；
Fig. 2 is media content attribute, spatial position and resolution ratio process of analysis；
Fig. 3 indicates exemplary plot for longitude and latitude figure mapping mode spatial position；
Fig. 4 is the arrangement mode exemplary plot of binocular solid longitude and latitude figure；
Fig. 5 is the indexical relation in each face of regular hexahedron；
Fig. 6 is the different arrangement mode exemplary plots of regular hexahedron；
Fig. 7 indicates exemplary plot for cylinder mapping mode spatial position；
Fig. 8 is the application example flow chart of the panoramic video attribute indication information in one embodiment of the invention.
Specific embodiment
With reference to specific embodiment, the present invention is described in detail.Following embodiment will be helpful to the technology of this field
Personnel further understand the present invention, but the invention is not limited in any way.It should be pointed out that the ordinary skill to this field
For personnel, without departing from the inventive concept of the premise, various modifications and improvements can be made.These belong to the present invention
Protection domain.
In order to realize the real-time switching in the user real-time rendering of media content, presentation and the visual field within sweep of the eye, need
Necessary instruction is carried out to the space attribute of media content.In view of human eye to the susceptibilitys of different zones within sweep of the eye not
Together, it is also desirable to indicate the quality information of panoramic video.Thus, rendering of the panoramic video based on visual angle, presentation and visual angle are cut
The index of media content can be just normally carried out when changing.
Therefore, the present invention renders and presents the relevant media content attribute of attribute, space with panoramic video in stream rank pair
Position and resolution information are indicated.The simple flow of media content instruction information is shown in Fig. 1.
It indicates, is needed associated with panoramic video rendering and presentation in order to which attribute is rendered and presented to panoramic video
Description information in be inserted into following instruction information：
First instruction information：Different mapping modes to the panoramic video are indicated, and indicate that this is described
Can the content that panoramic video gain media is included completely cover panoramic video content.Subsequently indicate information (in media accordingly
Hold attribute) it is indicated to carry out a point situation for following spatial position.
Specifically, the first instruction information includes：
The mapping format (vr_projection_format) of panoramic video：Indicate the mapping mode of media content, accordingly
Indicate that a point situation for the following spatial information of information progress indicates；
Whether panoramic video covers whole visual angles (is_complete)：Indicate whether is content that the media resource included
For complete panoramic video content, value is complete panoramic video content by the content that the 1 expression media resource includes, and is taken
It is worth by the panoramic video content that 0 content that includes of the expression media resource is piecemeal, accordingly media resource content attribute information
Point situation for carrying out following spatial information indicates.
In some embodiments, it is further rendered and presents in associated description information below insertion with panoramic video
The one or two of second instruction information, third instruction information：
The second instruction information, indicates the spatial information of the panoramic video；
The third indicates information, and the quality information of the panoramic video is indicated.
Specifically, the spatial information, the spatial information indicates panoramic video media resource and mould is presented in client
The corresponding of different visual angles is closed on the correspondence in different visual angles region in type, i.e. panoramic video media resource and user viewing spherical surface
System, the definition of spatial dimension are determined using the rectangular extent on data plane frame.By the definition of range on plane frame and
Plane frame watches the correspondence definition on spherical surface to user, and media content watches the spatial position on spherical surface with regard to unique in user
It determines.And the generation of plane frame is based on mapping mode, that is to say, that the plane frame under different mappings mode is seen with user
See that the correspondence of spherical surface can be different, therefore the spatial position definition of the present invention will be based on mapping mode.
Current existing panoramic video mapping mode is varied, have longitude and latitude figure, binocular solid longitude and latitude figure, regular polygon,
The mapping modes such as cylinder, it is different for the indicating mode of the suitable spatial position of media content in each mapping mode.
For different mapping modes, spatial information includes as follows：
For longitude and latitude figure and binocular solid longitude and latitude figure mapping mode, spatial information includes area of space covering pitch angle and side
The range of parallactic angle；
For polyhedron mapping mode, spatial information indicates the number in polyhedral face that media content includes；
For cylinder mapping mode, number and the specific water in side that spatial information includes the face that media content includes
Gentle space coordinate range.
Resolution information includes the horizontal and vertical number of pixels of area of space, particularly for bottom surface on cylinder
Resolution ratio is indicated with bottom surface radius.
The second instruction information, third instruction information carry out space letter to the video content of different mapping modes respectively
Breath, quality information are indicated, specifically, in the preferred embodiment of part:
The second instruction information is carried out by defining following field：
Initial visual angle azimuthal coordinate (initial_center_yaw)：For longitude and latitude figure, binocular solid longitude and latitude figure and circle
Cylinder mapping mode, using initial visual angle azimuthal coordinate come the initial orientation angle of identity user viewing video；
Initial visual angle pitching angular coordinate (initial_center_pitch)：For longitude and latitude figure, binocular solid longitude and latitude figure and
Cylinder mapping mode, using initial visual angle pitching angular coordinate come the initial pitch angle of identity user viewing video；
Unified resolution marks (is_unify_resolution)：For complete panoramic video content, with the field mark
Remember whether the different spaces region in video content is unified resolution, and value is that 1 expression media content is unified resolution, is taken
It is worth and represents it is not unified resolution for 0；
Area of space quantity (num_vr_regions)：For complete panoramic video content, when video content is not system
During one resolution ratio, the area of space block count of different video content resolution needs to carry out each area of space after this
The label of resolution ratio；
Area of space numbers (vr_region_id)：Indicate video content area of space number；
Area of space upper end pitch angle (region_pitch_top)：Indicate the pitch angle of current region top edge；
Area of space left end azimuth (region_yaw_left)：Indicate the azimuth of current region left end；
Area of space pitch range (region_pitch_height)：Indicate the pitch angle angle of current region covering
Range；
Area of space azimuth coverage (region_yaw_width)：Indicate the azimuth angle model of current region covering
It encloses；
Arrangement mode (layout)：For binocular solid longitude and latitude figure and polyhedron mapping mode, each face can be with difference
Arrangement mode form the video content of the whole panoramic viewing angles of complete covering；
Primary face numbers (initial_surface_id)：For polyhedron, represented just with initial viewing face number
The initial default visual angle of video is watched at beginning face, the center of primary face as user；
Acquiescence face sign of rotation (default_rotation_flag)：For polyhedron mapping mode, each face is being spliced
When whether using acquiescence rotation angle, value for 1 represent using acquiescence rotation angle, value for 0 represent do not use acquiescence rotate
Mode；
Number (face_id) in face：For polyhedron or cylinder, video frame is spliced by multiple faces, and face number is
The label in face is used for marking the spatial position where face；
Face rotates (face_rotations)：For polyhedron mapping mode, for volume when face is spliced into planar video frame
The considerations of code meeting opposite carries out appropriate rotary splicing, and rotation angle is marked with face rotation；
Side maximal degree pitch angle (side_pitch)：For cylinder mapping mode, the angle model corresponding to each face
Enclose it is uncertain, as the angular field of view corresponding to side maximum pitch angle can uniquely determine each face of cylinder.Method of determination is such as
Under：
Side spreading width (side_width)：For cylinder mapping mode, the picture of horizontal direction after the expansion of side
Prime number amount；
Side expansion height (side_height)：For cylinder mapping mode, side is in the pixel number of vertical direction
Amount；
Area of space left upper apex horizontal coordinate (region_horizontal_left), area of space left upper apex indulge seat
It marks (region_vertical_top)：For cylinder mapping mode, current spatial region is in the side expanded view in cylinder
The coordinate of top left corner apex in shape.
The third instruction information is carried out by defining following field：
Horizontal resolution (resolution_width)：Current spatial zone level direction number of pixels；
Vertical resolution (resolution_height)：Current spatial region vertical direction pixel number；
Bottom surface radius (underside_radius)：For cylinder mapping mode, upper bottom surface is circle, with bottom
The radius in face uniquely determines the resolution ratio of upper bottom surface；
Further, usage of some the above-mentioned fields in certain specific embodiments is described in detail：
Mapping format is used to indicate the mapping mode of media content, can define in the following way：
| Mapping format | Description |
| 0 | Longitude and latitude figure |
| 1 | Binocular solid longitude and latitude figure |
| 2 | Regular hexahedron |
| 3 | Cylinder |
| 4 | Positive 8 face body |
| 5 | Positive 20 face body |
| Other | Retain |
For longitude and latitude figure mapping mode, the top edge pitch angle and left hand edge in the area of space region on spherical surface are determined
The pitch angle and azimuthal range size area of space pitch range of azimuth and the area of space and area of space side
Parallactic angle range determines, as shown in Figure 2.
For binocular solid, there are two types of the connecting methods of binocular solid longitude and latitude figure, and arrangement mode value is 0, represent with it is left,
The corresponding binocular planar video frame of right spherical surface is ranked sequentially into a planar video frame according to left and right, and left side corresponds to left spherical surface, right
Side corresponds to right spherical surface；Arrangement mode value is 1, represents that binocular planar video frame corresponding with left and right spherical surface is arranged according to upper and lower sequence
Row are arranged in a planar video frame, correspond to left spherical surface above, correspond to right spherical surface below, as shown in Figure 3.
For polyhedron, each face is spliced into there are many modes of planar video frame, by taking regular hexahedron as an example：
1. face number and the correspondence in face are determined first, referring to Fig. 4；
| It numbers in face | Face title |
| 0 | The left side |
| 1 | Front |
| 2 | The right side |
| 3 | The back side |
| 4 | Top surface |
| 5 | Bottom surface |
2. hypothesis has following several optional arrangement modes, referring to Fig. 5.Then the corresponding specific value example of arrangement mode is such as
Under：
| Arrangement mode | Arrangement type |
| 0 | 6×1 |
| 1 | 3×2 |
| 2 | 2×3 |
| Other | Other |
3. the specific example of acquiescence rotation angle of each face in splicing is as follows：
When stitching without using acquiescence rotation angle, the rotation angle in each face is indicated one by one, with face rotation come
Instruction, specific example are as shown in the table：
| Face rotates | Rotation angle (counterclockwise) |
| 0 | 0° |
| 1 | –90° |
| 2 | +90° |
| 3 | +180° |
So far, in binocular solid longitude and latitude figure and polyhedron mapping mode, the one-to-one correspondence of plane frame to panoramic video
Relationship determines that.
Particularly, for cylinder, the maximum pitch range side maximal degree pitch angle to side, side are needed
Height and bottom surface radius is unfolded to determine the pixel in the plane frame under cylinder mapping mode to panorama in spreading width, side
The one-to-one relationship of video different visual angles, it should be noted that for the plane frame of different resolution ratio, side exhibition
Width is opened, side expansion height and bottom surface radius can be different, and correspondence is as shown in Figure 6.
Based on information above, by taking MMT as an example, it is given below in MP_message and matchmaker is indicated respectively to each asset
The spatial information and the example of resolution information held in vivo retouches above-mentioned instruction information in vr_asset_descriptor
It states, as shown in the table, each field meanings in following table are referring to above description：
In upper table for panoramic video media resource attribute description field and flow be all based on it is proposed by the invention
It is inserted into instruction information design.
It should be noted that only media content beacon information is illustrated by taking above-mentioned field as an example in the present invention, and
It is not limited to more than field and its size.In order to be better understood from the meaning of more than field, reference can be made to application shown in FIG. 1 is real
Example.
Using the instruction of attribute above-mentioned to panoramic video, in some embodiments, a kind of panoramic video renders and presentation side
Method, including：
1. building signaling information in server end, media resource is indicated into media content attribute, spatial positional information and matter
Amount information (resolution ratio) is added in signaling, and instruction process is shown in Fig. 1, and media resource and its corresponding signaling information are sent to visitor
Family end；
2. client is received after the signaling of the media resource that server sends and its attribute description to media resource attribute
Information is parsed, and process of analysis is shown in Fig. 2；
3. client when being rendered and being presented using media resource, using media content attribute proposed by the present invention,
Spatial information and resolution information determine that media resource and user watch the correspondence of spherical surface, correctly to render and present.
Corresponding, in some embodiments, a kind of panoramic video renders and presents system, including：
Server end is inserted into first rendering and presenting in associated signaling with panoramic video for the panoramic video
It indicates information, the second instruction information and/or third instruction information, the panoramic video and its corresponding signaling information is sent to
Client；
Client, after receiving the panoramic video and its corresponding signaling information that server sends, to comprising described
The signaling information of first instruction information is parsed, and when the panoramic video is rendered and presented, is believed using the second instruction
Breath and/or third instruction information determine that media resource and user watch the correspondence of spherical surface, correctly to render and present；
Based on above-mentioned statement, a concrete application example is given below：
Clearly to illustrate indicating mechanism proposed by the present invention to support the rendering of client media content and presentation,
A concrete implementation flow has been illustrated in indicating means in Fig. 7 combination specific examples：
When client login service, server can be sent in MP_message (), other signaling informations and media resource
Hold, then client receives MP_message (), media resource content and other relevant informations；
After user receives asset and MP_message (), MP_message () is parsed, reads MP_table
(), and vr_asset_descriptor () therein is parsed, the content read is needed to include：
1. the mapping mode of video content in asset；
2. can video content completely cover all visual angles of panoramic video in asset；
3. the initial Viewing-angle information of panoramic video content, the layout being mapped on solid space from plane frame are believed in asset
Rotary angle information when breath, the splicing of each face etc.；
4. the resolution ratio of video content in asset；
5. the position corresponding informance in asset on video content different spaces area maps to panoramic video.
After client has parsed the information above with respect to each asset, when client need to call some asset render and
The rendering and presentation of video can be instructed using information indicated above during presentation.
Above section embodiment of the present invention illustrates proposed solution, but these schemes are equally by taking MMT as an example
It can be used in other Document encapsulations, Transmission system and agreement.
The present invention indicates media content attribute, spatial information and/or quality information, to realize that panoramic video renders
With when presenting to the index of media content.For different mapping modes, suitable area of space indicating mode can be used.For
Whole frame video and space separating video content have corresponding spatial position instruction information.In addition also to media content not same district
The corresponding resolution ratio in domain is indicated.Be conducive to accurately index what is with user perspective matched in rendering and presentation
Media content.In the case where network bandwidth is limited, the high quality demand of user is met as far as possible.
It should be understood that above example is the section Example that part of the invention is directed to video multimedia content, this
Invention is equally applicable to storing and transmitting for other multimedia content, such as image etc..This is to those skilled in the art
It is that by.
Specific embodiments of the present invention are described above.It is to be appreciated that the invention is not limited in above-mentioned
Particular implementation, those skilled in the art can make various deformations or amendments within the scope of the claims, this not shadow
Ring the substantive content of the present invention.
Claims (10)
1. a kind of panoramic video renders and presents attribute indicating means, it is characterised in that：Phase is being rendered and presented with panoramic video
The first instruction information and the second instruction information are inserted into for the panoramic video and/or third refers in associated description information
Show information；
Described first indicates that information indicates the media content attribute of the panoramic video, including：
The identifier of the mapping format of panoramic video；
Whether panoramic video covers the identifier of whole angulars field of view；
The second instruction information, indicates the spatial information of the panoramic video；
The third indicates information, and the quality information of the panoramic video is indicated.
2. panoramic video according to claim 1 renders and presents attribute indicating means, it is characterised in that：The aphorama
The identifier of the mapping format of frequency, be used to indicate plane frame to panoramic video present when mapping mode.
3. panoramic video according to claim 1 renders and presents attribute indicating means, it is characterised in that：The aphorama
Whether frequency covers the identifiers of whole angulars field of view, the data being used to indicate in the panoramic video whether can complete map help
The panoramic video of portion's angular field of view is presented.
4. panoramic video according to claim 1 renders and presents attribute indicating means, it is characterised in that：The space letter
Breath indicates panoramic video media resource and the correspondence in different visual angles region on model is presented in client.
5. panoramic video according to claim 4 renders and presents attribute indicating means, it is characterised in that：For different
The mapping mode, the spatial information include the following contents：
For longitude and latitude figure and binocular solid longitude and latitude figure mapping mode, the spatial information include area of space covering pitch angle and
Azimuthal range；
For polyhedron mapping mode, the spatial information includes the volume in polyhedral face for indicating that the panoramic video includes
Number；
For cylinder mapping mode, the spatial information includes the number in the face that the panoramic video includes and in side
Specific horizontal and space coordinate range.
6. panoramic video according to claim 1 renders and presents attribute indicating means, it is characterised in that：The quality letter
Breath includes the resolution information of the panoramic video.
7. panoramic video according to claim 6 renders and presents attribute indicating means, it is characterised in that：The resolution ratio
Information includes the horizontal and vertical number of pixels of area of space, particularly, for the resolution ratio bottom surface of bottom surface on cylinder
Radius indicates.
8. attribute indicating means is rendered and presented according to claim 1-7 any one of them panoramic video, it is characterised in that：Institute
The method of stating further includes：The instruction information is received, and the instruction information is parsed from network entity, for the panorama
The rendering and presentation of video.
9. a kind of panoramic video using any one of claim 1-8 the methods renders and rendering method, it is characterised in that：Packet
It includes：
S1：Signaling information is built in server end, is rendered and present in associated signaling for described complete with panoramic video
Scape video is inserted into the first instruction information and the second instruction information and/or third instruction information, by the panoramic video and its right
The signaling information answered is sent to client；
S2：After client receives the panoramic video that server sends and its corresponding signaling information, to including described
The signaling information of one instruction information is parsed, and when the panoramic video is rendered and presented, utilizes the described second instruction
Information and/or third instruction information determine that different visual angles region on model is presented in the panoramic video media resource and client
Correspondence, correctly to render and present.
10. a kind of panoramic video using any one of claim 1-8 the methods renders and presents system, it is characterised in that：
Including：
Server end is inserted into the first instruction rendering and presenting in associated signaling with panoramic video for the panoramic video
Information and the second instruction information and/or third instruction information, the panoramic video and its corresponding signaling information are sent to
Client；
Client, after receiving the panoramic video and its corresponding signaling information that server sends, to including described first
It indicates that the signaling information of information is parsed, when the panoramic video is rendered and presented, is believed using the described second instruction
Breath and/or third instruction information determine that pair in different visual angles region on model is presented in the panoramic video media resource and client
It should be related to, correctly to render and present.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611155809.7A CN108235113B (en) | 2016-12-14 | 2016-12-14 | Panoramic video rendering and presentation attribute indication method and system |
| CN202110172873.0A CN112770178A (en) | 2016-12-14 | 2016-12-14 | Panoramic video transmission method, panoramic video receiving method, panoramic video transmission system and panoramic video receiving system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611155809.7A CN108235113B (en) | 2016-12-14 | 2016-12-14 | Panoramic video rendering and presentation attribute indication method and system |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110172873.0A Division CN112770178A (en) | 2016-12-14 | 2016-12-14 | Panoramic video transmission method, panoramic video receiving method, panoramic video transmission system and panoramic video receiving system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108235113A true CN108235113A (en) | 2018-06-29 |
| CN108235113B CN108235113B (en) | 2022-01-04 |
Family
ID=62651171
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110172873.0A Pending CN112770178A (en) | 2016-12-14 | 2016-12-14 | Panoramic video transmission method, panoramic video receiving method, panoramic video transmission system and panoramic video receiving system |
| CN201611155809.7A Active CN108235113B (en) | 2016-12-14 | 2016-12-14 | Panoramic video rendering and presentation attribute indication method and system |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110172873.0A Pending CN112770178A (en) | 2016-12-14 | 2016-12-14 | Panoramic video transmission method, panoramic video receiving method, panoramic video transmission system and panoramic video receiving system |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN112770178A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704673A (en) * | 2018-07-09 | 2020-01-17 | 上海交通大学 | Feedback information identification method, system and storage medium based on video content consumption |
| CN110944222A (en) * | 2018-09-21 | 2020-03-31 | 上海交通大学 | Method and system for immersive media content as user moves |
| CN111277800A (en) * | 2020-03-02 | 2020-06-12 | 成都国科微电子有限公司 | Monitoring video coding and playing method and device, electronic equipment and storage medium |
| CN113178019A (en) * | 2018-07-09 | 2021-07-27 | 上海交通大学 | Indication information identification method, system and storage medium based on video content |
| CN114051090A (en) * | 2021-10-12 | 2022-02-15 | 聚好看科技股份有限公司 | Method for releasing resources in panoramic video and display device |
| CN114051089A (en) * | 2021-10-12 | 2022-02-15 | 聚好看科技股份有限公司 | Method for releasing resources in panoramic video and display device |
| CN115225975A (en) * | 2020-03-24 | 2022-10-21 | 腾讯科技（深圳）有限公司 | Immersion type media obtaining method and device under multi-degree-of-freedom scene and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116309083A (en) * | 2021-12-17 | 2023-06-23 | 华为技术有限公司 | Panoramic video dynamic range mapping method and device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7256779B2 (en) * | 2003-05-08 | 2007-08-14 | Nintendo Co., Ltd. | Video game play using panoramically-composited depth-mapped cube mapping |
| CN102256154A (en) * | 2011-07-28 | 2011-11-23 | 中国科学院自动化研究所 | Method and system for positioning and playing three-dimensional panoramic video |
| CN102930592A (en) * | 2012-11-16 | 2013-02-13 | 李金地 | Cloud computation rendering method based on uniform resource locator analysis |
| CN102945563A (en) * | 2012-09-26 | 2013-02-27 | 天津游奕科技有限公司 | Showing and interacting system and method for panoramic videos |
| CN104919812A (en) * | 2013-11-25 | 2015-09-16 | 华为技术有限公司 | Device and method for processing video |
| US20160073023A1 (en) * | 2014-09-05 | 2016-03-10 | 360fly, Inc. | Panoramic camera systems |
| CN105898254A (en) * | 2016-05-17 | 2016-08-24 | 亿唐都科技（北京）有限公司 | VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth |
| CN106060570A (en) * | 2016-06-30 | 2016-10-26 | 北京奇艺世纪科技有限公司 | Panoramic video image playing and coding method and device |
| CN106060652A (en) * | 2016-06-08 | 2016-10-26 | 北京中星微电子有限公司 | Identification method and identification device for panoramic information in video code stream |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7720168B2 (en) * | 2004-05-26 | 2010-05-18 | University Of Maryland | Systems and methods for coding in broadband wireless communication systems to achieve maximum diversity in space, time and frequency |
| WO2011020321A1 (en) * | 2009-08-17 | 2011-02-24 | 浙江大学 | Panoramic viewing field three-dimensional display apparatus |
| CN104244019B (en) * | 2014-09-18 | 2018-01-19 | 孙轩 | Multi-screen display method and display system in a kind of panoramic video image room |
| CN104301677B (en) * | 2014-10-16 | 2018-06-15 | 北京十方慧通科技有限公司 | The method and device monitored towards the panoramic video of large scene |
| CN106101503A (en) * | 2016-07-18 | 2016-11-09 | 优势拓展（北京）科技有限公司 | Real time panoramic Living Network video camera and system and method |
-
2016
- 2016-12-14 CN CN202110172873.0A patent/CN112770178A/en active Pending
- 2016-12-14 CN CN201611155809.7A patent/CN108235113B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7256779B2 (en) * | 2003-05-08 | 2007-08-14 | Nintendo Co., Ltd. | Video game play using panoramically-composited depth-mapped cube mapping |
| CN102256154A (en) * | 2011-07-28 | 2011-11-23 | 中国科学院自动化研究所 | Method and system for positioning and playing three-dimensional panoramic video |
| CN102945563A (en) * | 2012-09-26 | 2013-02-27 | 天津游奕科技有限公司 | Showing and interacting system and method for panoramic videos |
| CN102930592A (en) * | 2012-11-16 | 2013-02-13 | 李金地 | Cloud computation rendering method based on uniform resource locator analysis |
| CN104919812A (en) * | 2013-11-25 | 2015-09-16 | 华为技术有限公司 | Device and method for processing video |
| US20160073023A1 (en) * | 2014-09-05 | 2016-03-10 | 360fly, Inc. | Panoramic camera systems |
| CN105898254A (en) * | 2016-05-17 | 2016-08-24 | 亿唐都科技（北京）有限公司 | VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth |
| CN106060652A (en) * | 2016-06-08 | 2016-10-26 | 北京中星微电子有限公司 | Identification method and identification device for panoramic information in video code stream |
| CN106060570A (en) * | 2016-06-30 | 2016-10-26 | 北京奇艺世纪科技有限公司 | Panoramic video image playing and coding method and device |
Non-Patent Citations (3)
| Title |
|---|
| TARAK GANDHI ET AL: "anoramic Appearance Map (PAM) for Multi-camera Based Person Re-identification", 《2006 IEEE INTERNATIONAL CONFERENCE ON VIDEO AND SIGNAL BASED SURVEILLANCE》 * |
| 刘碧靓: "视频图像处理的方法与实现", 《科技展望》 * |
| 彭祎帆: "全景视场三维显示机理及实现技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704673A (en) * | 2018-07-09 | 2020-01-17 | 上海交通大学 | Feedback information identification method, system and storage medium based on video content consumption |
| CN113178019A (en) * | 2018-07-09 | 2021-07-27 | 上海交通大学 | Indication information identification method, system and storage medium based on video content |
| CN110944222A (en) * | 2018-09-21 | 2020-03-31 | 上海交通大学 | Method and system for immersive media content as user moves |
| CN110944222B (en) * | 2018-09-21 | 2021-02-12 | 上海交通大学 | Method and system for immersive media content as user moves |
| CN111277800A (en) * | 2020-03-02 | 2020-06-12 | 成都国科微电子有限公司 | Monitoring video coding and playing method and device, electronic equipment and storage medium |
| CN115225975A (en) * | 2020-03-24 | 2022-10-21 | 腾讯科技（深圳）有限公司 | Immersion type media obtaining method and device under multi-degree-of-freedom scene and storage medium |
| CN114051090A (en) * | 2021-10-12 | 2022-02-15 | 聚好看科技股份有限公司 | Method for releasing resources in panoramic video and display device |
| CN114051089A (en) * | 2021-10-12 | 2022-02-15 | 聚好看科技股份有限公司 | Method for releasing resources in panoramic video and display device |
| CN114051090B (en) * | 2021-10-12 | 2023-07-18 | 聚好看科技股份有限公司 | Method for releasing resources in panoramic video and display equipment |
| CN114051089B (en) * | 2021-10-12 | 2023-09-15 | 聚好看科技股份有限公司 | Method for releasing resources in panoramic video and display equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108235113B (en) | 2022-01-04 |
| CN112770178A (en) | 2021-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108235113A (en) | A kind of panoramic video renders and presents attribute indicating means and system | |
| CN109691094B (en) | Method for transmitting omnidirectional video, method for receiving omnidirectional video, apparatus for transmitting omnidirectional video, and apparatus for receiving omnidirectional video | |
| US11109013B2 (en) | Method of transmitting 360-degree video, method of receiving 360-degree video, device for transmitting 360-degree video, and device for receiving 360-degree video | |
| US20210400305A1 (en) | Methods, devices and stream for encoding and decoding volumetric video | |
| US20190197661A1 (en) | Method for transmitting and receiving metadata of omnidirectional image | |
| US20210195162A1 (en) | Method, apparatus and stream for volumetric video format | |
| KR101547151B1 (en) | Image processing method and apparatus | |
| CN102308599B (en) | The method and apparatus of virtual graffiti is created in mobile virtual and augmented reality system | |
| KR20200096575A (en) | Method and apparatus for encoding point clouds representing three-dimensional objects | |
| CN109644262A (en) | The method for sending omnidirectional's video, the method for receiving omnidirectional's video, the device for sending omnidirectional's video and the device for receiving omnidirectional's video | |
| US20160321837A1 (en) | Blending between street view and earth view | |
| CN104537550B (en) | A kind of autonomous advertising method in internet based on augmented reality IP maps | |
| CN106908043B (en) | The three-dimensional amount measuring method of geographic position of target object and height based on Streetscape picture | |
| CN111264058A (en) | Method and apparatus for encoding and decoding three-degree-of-freedom and volume-compatible video streams | |
| CN107454468A (en) | The method, apparatus and stream being formatted to immersion video | |
| CN110009561A (en) | A kind of monitor video target is mapped to the method and system of three-dimensional geographical model of place | |
| WO2018120294A1 (en) | Information processing method and device | |
| CN102054290A (en) | Construction method of panoramic/realistic hybrid reality platform | |
| CN110798707B (en) | Method, client and server for transmitting media data | |
| TW201811025A (en) | Method and apparatus for streaming video content | |
| US20200413029A1 (en) | System for projecting naked-eye 3d image from selected 2d image | |
| CN110383846A (en) | For transmitting the method and device of area of space information | |
| KR20150077607A (en) | Dinosaur Heritage Experience Service System Using Augmented Reality and Method therefor | |
| CN108022204B (en) | A kind of method that cylinder panorama video is converted to spherical panoramic video | |
| CN107371011B (en) | The method that wide angle picture is converted into map projection's image and perspective projection image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |