CN107784686A - Various visual angles media displaying method based on multiresolution - Google Patents

Various visual angles media displaying method based on multiresolution Download PDF

Info

Publication number
CN107784686A
CN107784686A CN201610726946.5A CN201610726946A CN107784686A CN 107784686 A CN107784686 A CN 107784686A CN 201610726946 A CN201610726946 A CN 201610726946A CN 107784686 A CN107784686 A CN 107784686A
Authority
CN
China
Prior art keywords
video
visual angles
multiresolution
resolution
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610726946.5A
Other languages
Chinese (zh)
Other versions
CN107784686B (en
Inventor
徐异凌
张文军
胡颖
谢绍伟
孙军
管云峰
王延峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiaotong University
Original Assignee
Shanghai Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiaotong University filed Critical Shanghai Jiaotong University
Priority to CN201610726946.5A priority Critical patent/CN107784686B/en
Priority to CN202110620456.8A priority patent/CN113347374A/en
Publication of CN107784686A publication Critical patent/CN107784686A/en
Application granted granted Critical
Publication of CN107784686B publication Critical patent/CN107784686B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/04Synchronising

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a kind of various visual angles media displaying method based on multiresolution, comprise the following steps:Step 1:User login services, server issue space separating signaling information and multiresolution various visual angles signaling information to user;Step 2:User is according to region interested, the piecemeal video location relation indicated with reference to space separating signaling information, and piecemeal video and low-resolution video are asked to server;Step 3:Server sends the piecemeal video and low-resolution video of its request to client;Step 4:The media content of different visual angles and different resolution is combined and is presented to user;Step 5:Repeat step two, Step 3: step 4.The present invention both solves the problems, such as switching blank screen, in turn ensure that multiresolution and the flexibility that various visual angles combine.

Description

Various visual angles media displaying method based on multiresolution
Technical field
The present invention relates to a kind of various visual angles media displaying method, in particular it relates to a kind of various visual angles based on multiresolution Media displaying method.
Background technology
With the fast development of digital media technology, explosive growth is presented in caused content of multimedia in internet, The particularly extensive use of ultrahigh resolution video traffic (such as 4K, 8K etc.) and immersion video traffic, multimedia service is to net Network bandwidth causes white elephant further.Meanwhile terminal display device is more and more diversified, such as ultra high-definition TV, flat board Computer, smart mobile phone, helmet etc., due to the limitation of hardware capabilities, equipment component does not support ultrahigh resolution video Decoding and presentation.
For reply network bandwidth overloadization and terminal device variation, some current multi-media protocols are proposed super-resolution The content of multimedia of rate spatially carries out piecemeal, according to user network situation, capacity of equipment and the user region of interest of itself Domain is come for the piecemeal content of multimedia of different visual angles corresponding to user's transmission and presentation.
It is greatly saved however, although this kind of scheme ensure that while the visual field consumed required for being presented to user Bandwidth, because user can only once consume a part of visual field, when user needs to consume the other parts visual field, though this kind of scheme It can so continue that the corresponding visual field is presented, but it inevitably causes interim card, blank screen etc. are bad to regard when picture switches Yupin effect.
The content of the invention
For in the prior art the defects of, it is an object of the invention to provide a kind of various visual angles media based on multiresolution to be in Existing method, it introduces more low resolution video content and synchronously presented, and indicates that specific content of multimedia is present by signaling message Multiresolution and various visual angles combination, both solve the problems, such as switch blank screen, in turn ensure that multiresolution and various visual angles combine Flexibility.
According to an aspect of the present invention, there is provided a kind of various visual angles media displaying method based on multiresolution, its feature It is, comprises the following steps:
Step 1:User login services, server issue space separating signaling information and multiresolution various visual angles to user Signaling information;
Step 2:User is closed according to region interested with reference to the piecemeal video location that space separating signaling information indicates System, piecemeal video is asked to server, meanwhile, differentiate various visual angles signaling information, low-resolution video corresponding to request according to more;
Step 3:Server sends the piecemeal video and low-resolution video of its request to client;
Step 4:After client receives piecemeal video and low-resolution video, pass through space separating information and multiresolution The media content of different visual angles and different resolution is combined and is presented to user by various visual angles information;
Step 5:Repeat step two, Step 3: step 4.
Preferably, the server informs client with the presence or absence of multiresolution media resource, the media of every kind of resolution ratio Resource whether there is space separating.
Compared with prior art, the present invention has following beneficial effect:The invention provides one kind to be based on multiresolution Various visual angles media presentation mechanism.Existing switching blank screen problem, introduces lower point during for existing various visual angles media presentation Resolution video content is synchronously presented, and indicates that multiresolution existing for specific content of multimedia and various visual angles are tied by signaling message Conjunction mode, both solve the problems, such as to switch blank screen, in turn ensure that multiresolution and the flexibility that various visual angles combine.
Brief description of the drawings
The detailed description made by reading with reference to the following drawings to non-limiting example, further feature of the invention, Objects and advantages will become more apparent upon:
Fig. 1 is that high definition piecemeal visual angle and low clear complete visual angle combine figure.Figure bend part is what user was actually viewed Part.
Fig. 2 is that high definition piecemeal visual angle and low sorting block visual angle combine figure.Figure bend part is what user was actually viewed Part
The visual field content graph that user sees when Fig. 3 is view angle switch.Figure bend part is the portion that user is actually viewed Point.
Embodiment
With reference to specific embodiment, the present invention is described in detail.Following examples will be helpful to the technology of this area Personnel further understand the present invention, but the invention is not limited in any way.It should be pointed out that the ordinary skill to this area For personnel, without departing from the inventive concept of the premise, various modifications and improvements can be made.These belong to the present invention Protection domain.
To transmit the content of multimedia bigger when transmitting its required area of visual field for user, while for user by the present invention The slightly lower video of the definition of field range.Now when user needs to switch visual angle, regarded more greatly because client is locally present The low clear version video of wild scope, the video of low clear version can be presented by switching the transition period at visual angle.And due to switching Time visual angle transitional period is more of short duration, and this period of time user watches the experience at low clear visual angle to be also far superior to blank screen Experience.After the high-resolution visual angle content Successful transmissions required for user are to user, user can continue to watch high-resolution Video content.
With the fast development of digital media technology, the more matchmakers of caused content of multimedia, especially ultra high-definition in internet Explosive growth is presented in body, for network bandwidth overloadization caused by reply and terminal device variation, some current multimedias Agreement proposes the content of multimedia of ultrahigh resolution spatially carrying out piecemeal, according to user network situation, capacity of equipment and The area-of-interest of user itself comes for the piecemeal content of multimedia of different visual angles corresponding to user's transmission and presentation.
Various visual angles media displaying method of the invention based on multiresolution comprises the following steps:
Step 1:User login services, server issue space separating signaling information and multiresolution various visual angles to user Signaling information;
Step 2:User is closed according to region interested with reference to the piecemeal video location that space separating signaling information indicates System, specific media resource, i.e. piecemeal video are asked to server, meanwhile, differentiate various visual angles signaling information, request pair according to more The low-resolution video answered;
Step 3:Server sends the piecemeal video and low-resolution video of its request to client;
Step 4:After client receives piecemeal video and low-resolution video, pass through space separating information and multiresolution The media content of different visual angles and different resolution is combined and is presented to user's (combination presentation mode of client by various visual angles information Presentation is rendered after including but not limited to the media content of different visual angles and different resolution is spliced);
Step 5:Repeat step two, Step 3: step 4.
The present invention also will when ultra high-definition piecemeal media content is presented in client while ultra high-definition piecemeal video is combined It is combined with low clear video, user is then presented to, such as Fig. 1 and Fig. 2.Now, although the only ultra high-definition piecemeal that user sees The visual angle of video composition, but the visual angle that the low clear video of physical presence forms around the visual angle watched due to user, when visual angle is cut When changing, with the handover operation of user, the content of presentation can be moved and then, therefore will not cause interim card or blank screen, such as be schemed 3。
It is further, it is necessary to as existing for server informs different video content on client-server various visual angles and more points Resolution situation.I.e. to the media content of various visual angles be present, provide on all different resolutions present on the server of the content The video of rate, and the content of every kind of different resolution ratio whether there is corresponding space separating video, i.e., for above-mentioned steps One, server to client except issuing space separating signaling information, it is also necessary to sends various visual angles and multiresolution to client Configured information.
In step 1, server to client except issuing space separating signaling information, it is also necessary to is sent to client more Visual angle and multiresolution configured information.
By taking MMT as an example, reasonably add resolution ratio and visual angle combines message, including:
Resolution_amount, indicate low definition resolution ratio number existing for content of multimedia;Resolution, Indicate specific resolution ratio;
Multiblocks, indicates whether the media resource of this kind of resolution ratio is spatially divided into various visual angles.
And combine the knot between media asset (Asset) self attributes asset_id structure different resolutions and different visual angles Conjunction relation.
The specific implementation content of the present invention is as follows:
Signaling information form:Build multiresolution various visual angles signaling information multi_resolution_view_message (), indicate existing multiresolution and various visual angles situation in media resource.As a preferred embodiment, such as table 1 below can be used Shown form:
Table 1
Signaling sheet form:Build multiresolution various visual angles signaling table multi_resolution_view_table (), instruction Existing multiresolution and various visual angles situation in media resource.As a preferred embodiment, shape as shown in table 2 below can be used Formula:
Table 2
Above signaling information, signaling table example in, the field except definition has given above, multi_view_amout The ultra high-definition video resource number of various visual angles be present spatially by piecemeal in instruction;First asset_id () instruction is by piecemeal The asset_id of ultra high-definition video resource original video;Second asset_id () instruction is low with ultra high-definition original video content identical The asset_id of resolution video resource.
Sub- form is described:Based on MP_table (), the highest resolution media resource (Asset) in same media content Addition multiresolution various visual angles describe sub- multi_resolution_ in media resource description sub (asset_descriptors) View_descriptor (), existing multiresolution and various visual angles situation in media resource are indicated, it is as shown in table 3 below:
Table 3
Wherein, the number of the different resolution present in the corresponding media content of resolution_amount instructions;asset_ The Asset of some low sorting resolution of the corresponding media content of id instructions asset_id;Multiblocks indicates the interior of the resolution ratio Appearance whether there is more visuals field;Resolution indicates the specific resolution ratio of this kind of resolution content.
Below, with existing space separating signaling table (block_ in multiresolution various visual angles signaling table and MMT Association_table the application process of the present invention is illustrated exemplified by), wherein space separating signaling table is as shown in table 4 below.
Table 4
First, user login services, server issue block_association_table () and multi_ to user resolution_view_table();
Next, user is closed according to region interested with reference to the piecemeal video location that space separating signaling information indicates System, specific media resource Asset is asked to gather to server, i.e. piecemeal video.It is meanwhile former according to corresponding to these Asset Asset asset_id, corresponding multiresolution relation is matched in multi_resolution_view_table, It is i.e. identical with first asset_id in multi_resolution_view_table;
Then, further according to the low clear definition case under the asset_id, (multiblocks and resolution's takes Value) and user's self-condition, request low-resolution video Asset.If desired the low resolution multiblocks asked is False, then the low resolution A sset asked are complete low clear video corresponding to the resolution values;That if desired asks is low Resolution ratio multiblocks is true, then according to corresponding to the resolution ratio asset_id in block_association_table In find corresponding to low resolution piecemeal Asset collection merge to server ask;
Finally, server sends the piecemeal video and low-resolution video of its request to client;Client receives piecemeal After video and low-resolution video, by space separating information and multiresolution various visual angles information by different visual angles and different resolutions The media content combination of rate is presented to user, and (the combination presentation mode of client includes but is not limited to different visual angles and different points Presentation is rendered after the media content splicing of resolution);Repeat step two is to step 4.
In the present invention by taking MMT as an example, illustrate proposed solution, but these schemes equally can be used for it is other In Document encapsulation, Transmission system and agreement.Space separating information applied in the present invention, is illustrated by taking MMT as an example, but It is not limited thereto, it is all to be used to indicate to associate between position relationship and piecemeal video and former video between space separating video The scheme of relation can combine with the present invention.The video resource premise of corresponding multiresolution various visual angles in server be present in the present invention Under, i.e., there is the space separating video of different visual angles in server, and complete video corresponding to these multi-angle videos has more points In the case of resolution, client informed by certain signaling information as server existing for various visual angles and multiresolution situation, i.e., Server informs that client is divided with the presence or absence of the media resource of multiresolution media resource, every kind of resolution ratio with the presence or absence of space Block.
It should be noted that the involved description to video resolution in the present invention, ultra high-definition video refer to resolution ratio and are 4K (including resolution ratio be 4096 × 2160 including all main flow 4K videos), 8K (resolution ratio 7680x4320) and the above Video.Using ultra high-definition video as watershed, all videos lower than ultra high-definition video resolution are all low point of the present invention Resolution, it is the main flow high definition and SD video including 1920x1080,1280x720 and 720x480 including resolution ratio.In this hair It is low according to existing for server end during the combination of ultra high-definition piecemeal video content and low resolution video content in bright implementation The capacity of equipment of resolution video and user itself, network condition and personal choice etc., the choosing to low resolution video content Select the resolution ratio for being not limited to a certain fixation.
Particular embodiments described above, technical problem, technical scheme and the beneficial effect of the solution to the present invention are carried out It is further described, should be understood that the specific embodiment that the foregoing is only of the invention, be not limited to The present invention, within the spirit and principles of the invention, any modification, equivalent substitution and improvements done etc., it should be included in this Within the protection domain of invention.

Claims (2)

1. a kind of various visual angles media displaying method based on multiresolution, it is characterised in that comprise the following steps:
Step 1:User login services, server issue space separating signaling information and multiresolution various visual angles signaling to user Information;
Step 2:User is according to region interested, the piecemeal video location relation indicated with reference to space separating signaling information, to Server asks piecemeal video, meanwhile, differentiate various visual angles signaling information, low-resolution video corresponding to request according to more;
Step 3:Server sends the piecemeal video and low-resolution video of its request to client;
Step 4:After client receives piecemeal video and low-resolution video, regarded by space separating information and multiresolution more The media content of different visual angles and different resolution is combined and is presented to user by angle information;
Step 5:Repeat step two, Step 3: step 4.
2. the various visual angles media displaying method according to claim 1 based on multiresolution, it is characterised in that the service Device informs that client whether there is space separating with the presence or absence of multiresolution media resource, the media resource of every kind of resolution ratio.
CN201610726946.5A 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method Active CN107784686B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610726946.5A CN107784686B (en) 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method
CN202110620456.8A CN113347374A (en) 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610726946.5A CN107784686B (en) 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202110620456.8A Division CN113347374A (en) 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method

Publications (2)

Publication Number Publication Date
CN107784686A true CN107784686A (en) 2018-03-09
CN107784686B CN107784686B (en) 2021-06-11

Family

ID=61439836

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610726946.5A Active CN107784686B (en) 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method
CN202110620456.8A Withdrawn CN113347374A (en) 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202110620456.8A Withdrawn CN113347374A (en) 2016-08-25 2016-08-25 Multi-resolution-based multi-view media presentation method

Country Status (1)

Country Link
CN (2) CN107784686B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112153465A (en) * 2019-06-28 2020-12-29 北京京东尚科信息技术有限公司 Image loading method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155298A (en) * 2006-09-25 2008-04-02 华为技术有限公司 Method and system for implementing fast switching television channel
JP2009077082A (en) * 2007-09-19 2009-04-09 Toshiba Corp Resolution converting apparatus, resolution converting method, and pre-view displaying apparatus
US20100026737A1 (en) * 2008-08-04 2010-02-04 Kabushiki Kaisha Toshiba Video Display Device
US20100056274A1 (en) * 2008-08-28 2010-03-04 Nokia Corporation Visual cognition aware display and visual data transmission architecture
CN102347043A (en) * 2010-07-30 2012-02-08 腾讯科技(北京)有限公司 Method for playing multi-angle video and system
CN102480637A (en) * 2010-11-30 2012-05-30 上海博路信息技术有限公司 Internet protocol television (IPTV) self-adaptive display content resolution method
CN104503655A (en) * 2014-11-28 2015-04-08 晨星半导体股份有限公司 Application program interface display control method and device
CN105141876A (en) * 2015-09-24 2015-12-09 京东方科技集团股份有限公司 Video signal conversion method, video signal conversion device and display system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69432093T2 (en) * 1993-09-27 2003-07-17 Canon Kk Image processing device
DE10129631A1 (en) * 2001-06-20 2003-01-02 Philips Corp Intellectual Pty Process for the reconstruction of a high-resolution 3D image
JP5844745B2 (en) * 2010-02-02 2016-01-20 トムソン ライセンシングThomson Licensing Method and apparatus for reducing vector quantization error through patch shifting
US20120079000A1 (en) * 2010-09-27 2012-03-29 Motorola-Mobility, Inc. Selectively receiving media content
EP2680221B1 (en) * 2012-06-28 2016-05-11 Alcatel Lucent Method and system for generating a high-resolution video stream
CN104077103A (en) * 2014-07-09 2014-10-01 上海天奕达电子科技有限公司 Method and device for supporting high-resolution display device through low-resolution platform
CN104410857A (en) * 2014-12-26 2015-03-11 广东威创视讯科技股份有限公司 Image display control method and related device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155298A (en) * 2006-09-25 2008-04-02 华为技术有限公司 Method and system for implementing fast switching television channel
JP2009077082A (en) * 2007-09-19 2009-04-09 Toshiba Corp Resolution converting apparatus, resolution converting method, and pre-view displaying apparatus
US20100026737A1 (en) * 2008-08-04 2010-02-04 Kabushiki Kaisha Toshiba Video Display Device
US20100056274A1 (en) * 2008-08-28 2010-03-04 Nokia Corporation Visual cognition aware display and visual data transmission architecture
CN102347043A (en) * 2010-07-30 2012-02-08 腾讯科技(北京)有限公司 Method for playing multi-angle video and system
CN102480637A (en) * 2010-11-30 2012-05-30 上海博路信息技术有限公司 Internet protocol television (IPTV) self-adaptive display content resolution method
CN104503655A (en) * 2014-11-28 2015-04-08 晨星半导体股份有限公司 Application program interface display control method and device
CN105141876A (en) * 2015-09-24 2015-12-09 京东方科技集团股份有限公司 Video signal conversion method, video signal conversion device and display system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112153465A (en) * 2019-06-28 2020-12-29 北京京东尚科信息技术有限公司 Image loading method and device
CN112153465B (en) * 2019-06-28 2024-01-16 北京京东尚科信息技术有限公司 Image loading method and device

Also Published As

Publication number Publication date
CN107784686B (en) 2021-06-11
CN113347374A (en) 2021-09-03

Similar Documents

Publication Publication Date Title
EP3459252A1 (en) Method and apparatus for spatial enhanced adaptive bitrate live streaming for 360 degree video playback
US11450044B2 (en) Creating and displaying multi-layered augemented reality
CN106528025B (en) Multi-screen image projection method, terminal, server and system
US20120213294A1 (en) Media Acceleration for Virtual Computing Services
TW202002666A (en) Method, computer storage media, and client for switching scenes of panoramic video
CA2928152C (en) Method and apparatus for transmission and reception of media data
WO2019192509A1 (en) Media data processing method and apparatus
CN107105185A (en) The transmission method and device of vision signal
CN111026343A (en) Real-time synchronous display method for multiple spliced screens
CN113141523B (en) Resource transmission method, device, terminal and storage medium
CN105142000A (en) Information pushing method and system based on television playing content
CN112911318A (en) Live broadcast room background replacement method and device, electronic equipment and storage medium
WO2022227974A1 (en) Subtitle processing method, apparatus and device and storage medium
CN102770827A (en) Method for displaying multimedia content on a screen of a terminal
CN107784686A (en) Various visual angles media displaying method based on multiresolution
CN113825020A (en) Video definition switching method, device, equipment, storage medium and program product
CN110636372B (en) Video decoding method, video playing device, electronic equipment and storage medium
CN111385590A (en) Live broadcast data processing method and device and terminal
CN107018431B (en) A kind of storage and transmission method for supporting space separating based on media self attributes
CN106254929A (en) A kind of processing method and processing device of video data
CN111263214A (en) Multi-screen interaction realization method and system
CN108924637A (en) A kind of method for exhibiting data, device and electronic equipment
KR20010093190A (en) Font substitution system
CN105025379B (en) Information-pushing method, terminal and system in electronic program guide interface
CN112511701B (en) Interaction method based on video color ring, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant