CN106658011A - Panoramic video coding and decoding methods and devices - Google Patents
Panoramic video coding and decoding methods and devices Download PDFInfo
- Publication number
- CN106658011A CN106658011A CN201611127925.8A CN201611127925A CN106658011A CN 106658011 A CN106658011 A CN 106658011A CN 201611127925 A CN201611127925 A CN 201611127925A CN 106658011 A CN106658011 A CN 106658011A
- Authority
- CN
- China
- Prior art keywords
- piecemeal
- panoramic video
- code check
- coding
- video frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
Abstract
The invention discloses panoramic video coding and decoding methods and devices. The coding method comprises the following steps: a coding end obtains various block coding data of a panoramic video frame, wherein the panoramic video frame is blocked according to the playing position at a playing end; the code rate of each block coding data is determined according to the relative position relationship of the playing position of a block and the current viewpoint position of the playing end; and the coding end sends the panoramic video frame to the playing end, so that the playing end is indicated to perform decoding playing. By means of the panoramic video coding and decoding methods and devices disclosed by the invention, the code rate of a coded video is greatly reduced; the network bandwidth pressure is reduced; furthermore, because the code rates of various blocks are determined according to the current viewpoint position, human eyes always can have the high-definition video watching effect; and the problem that a panoramic live high-definition video cannot be transmitted in real time can be solved.
Description
Technical field
The present embodiments relate to video coding technique, more particularly to a kind of decoding method and device of panoramic video.
Background technology
The encoding and decoding technique of video is widely used in the pressure to multi-medium datas such as film video, camera videos
Contracting.With the popularization of virtual reality technology, traditional video modality has been not limited solely to the video film of single channel, and single channel is taken the photograph
The image that camera shoots, and the panoramic video that synthesizes is shot by multichannel video camera and spliced simultaneously, have become a kind of new regarding
Frequency form.
In prior art, panoramic video is encoded, be all using H264 the main flow such as H265 coding techniques, will be complete
Scape video is considered as video media all the way, is encoded using the encoding scheme as the video shot with single channel video camera.Due to
Panoramic video is typically spliced by multichannel camera video, and data volume is huge, directly enters panoramic video frame in coding
Row coding, to support that user passes through to rotate VR (Virtual Reality, the virtual reality) helmet, watches horizontal 360-degree, hangs down
Straight 360 degree of omni-directional video content, causes the video code rate after encoding very big, is far longer than the code check of single channel video.Big code
Rate is exported, and to the network bandwidth huge pressure is brought, and causes the network transmission of high definition panorama video cannot in real time or cannot be complete
Into directly affecting the live application of panoramic video.
The content of the invention
In view of this, the embodiment of the present invention provides a kind of decoding method and device of panoramic video, to reduce Netowrk tape
Wide pressure, solves the problems, such as that panorama live video cannot real-time Transmission.
In a first aspect, embodiments providing a kind of coding method of panoramic video, methods described includes：
Coding side obtains each block encoding data of panoramic video frame, wherein, the panoramic video frame is according at broadcasting end
Play position carry out piecemeal, the code check of each block encoding data according to the play position of the piecemeal with play end current view point
The relative position relation of position determines；
The coding side sends the panoramic video frame to end is played, to indicate that playing end carries out decoding broadcasting.
Second aspect, the embodiment of the present invention additionally provides a kind of code device of panoramic video, and described device includes：
Block data acquisition module, in being configured at coding side, for obtaining each block encoding data of panoramic video frame, its
In, the panoramic video frame carries out piecemeal according in the play position for playing end, and the code check of each block encoding data is according to this
The play position of piecemeal determines with the relative position relation for playing end current view point position；
Frame of video sending module, in being configured at the coding side, for the panoramic video frame to be sent to broadcasting end, with
Indicate that playing end carries out decoding broadcasting.
The third aspect, the embodiment of the present invention additionally provides a kind of coding/decoding method of panoramic video, and methods described includes：
Play end and obtain current view point position of the user in panoramic video display screen, and be sent to coding side, to indicate
Coding side is encoded using the piecemeal code check that the current view point position determines to panoramic video frame；
The broadcasting end receives the panoramic video frame after the coding that coding side sends；
The broadcasting end decapsulates to the panoramic video frame, obtains block encoding data and the block encoding data
Position in panoramic video frame；
Each block encoding decoding data of the broadcasting end to panoramic video frame；
Panoramic video frame after the broadcast decoder of the broadcasting end.
Fourth aspect, the embodiment of the present invention additionally provides a kind of decoding apparatus of panoramic video, and described device includes：
Viewpoint position acquisition module, it is current in panoramic video display screen for obtaining user in being configured at broadcasting end
Viewpoint position, and coding side is sent to, to indicate coding side using the piecemeal code check of current view point position determination to panorama
Frame of video is encoded；
Frame of video receiver module, in being configured at the broadcasting end, for the aphorama after the coding for receiving coding side transmission
Frequency frame；
Decapsulation module, in being configured at the broadcasting end, for decapsulating to the panoramic video frame, obtains piecemeal
Coded data and the position of the block encoding data in panoramic video frame；
Decoder module, in being configured at the broadcasting end, for each block encoding decoding data to panoramic video frame；
Playing module, in being configured at the broadcasting end, for the panoramic video frame after broadcast decoder.
The technical scheme of the embodiment of the present invention, piecemeal is carried out by panoramic video frame case in the play position for playing end,
Play position and the relative position relation of playing end current view point position of the code check of each block encoding data according to the piecemeal
It is determined that so that the code check apart from the nearer piecemeal in current view point position is higher, apart from the code of current view point position piecemeal farther out
Rate is relatively low, no longer unified to maintain the high code check of identical so as to the block encoding data in panoramic video frame adopt different code checks,
The video code rate after coding is greatly reduced, the pressure of the network bandwidth is reduced, and due to being determined according to current view point position
The code check of each piecemeal, it is ensured that human eye can obtain all the time the viewing effect of HD video quality, solve panorama live video
Cannot real-time Transmission problem so that panorama live video can be with real-time Transmission.
Description of the drawings
Fig. 1 is a kind of flow chart of the coding method of panoramic video that the embodiment of the present invention one is provided；
Fig. 2 is a kind of flow chart of the coding method of panoramic video that the embodiment of the present invention two is provided；
Fig. 3 is the piecemeal example of a panoramic video frame in the coding method of panoramic video provided in an embodiment of the present invention
Figure；
Fig. 4 is that the current view point position in the coding method of panoramic video provided in an embodiment of the present invention falls wherein one
Schematic diagram in piecemeal；
Fig. 5 a- Fig. 5 d are four kinds of region division modes in the coding method of panoramic video provided in an embodiment of the present invention
Schematic diagram；
Fig. 6 is a kind of flow chart of the coding method of panoramic video that the embodiment of the present invention three is provided；
Fig. 7 is a kind of structural representation of the code device of panoramic video that the embodiment of the present invention four is provided；
Fig. 8 is a kind of flow chart of the coding/decoding method of panoramic video that the embodiment of the present invention five is provided；
Fig. 9 is a kind of structural representation of the decoding apparatus of panoramic video that the embodiment of the present invention six is provided.
Specific embodiment
With reference to the accompanying drawings and examples the present invention is described in further detail.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention, rather than limitation of the invention.It also should be noted that, in order to just
Part related to the present invention rather than full content are illustrate only in description, accompanying drawing.
Embodiment one
Fig. 1 is a kind of flow chart of the coding method of panoramic video that the embodiment of the present invention one is provided, and the present embodiment can be fitted
For the feelings encoded using different code checks to the piecemeal in panoramic video frame according to current view point position in end is played
Condition, the method can be performed by the code device of panoramic video, and the code device of the panoramic video is configured in coding side, should
Method specifically includes following steps：
Step 110, coding side obtain panoramic video frame each block encoding data, wherein, the panoramic video frame according to
Carry out piecemeal in the play position for playing end, the code check of each block encoding data according to the play position of the piecemeal with play end
The relative position relation of current view point position determines.
Wherein, panoramic video is different from common single channel video, and panoramic video is while shooting and spelling by multichannel video camera
What is be bonded into can cover horizontal 360-degree, the large scene video at vertical 180 degree visual angle, during video playback, need by projecting calculation
Method, by the panoramic video of 360 degree × 180 degree, on the inwall of the ball for projecting to customer-centric, user can be by VR helmets etc.
Playback equipment, is watched, and obtains feeling of immersion on the spot in person, however, the scope of each viewing viewpoint is all the time or human eye
Effective angular field of view, the decoding video information of other angles belongs to idle information.
In the present embodiment, coding side can be plug-flow end, or cloud platform end.When coding side is plug-flow end, push away
Stream end is got after panoramic video frame, and piecemeal, and the play position according to each piecemeal and broadcasting are carried out to the panoramic video frame
The relative position relation of end current view point position, determines the encoder bit rate of each piecemeal, and each piecemeal is entered according to corresponding code check
Row coding, obtains block encoding data.When coding side is cloud platform end, dividing after different code check codings is obtained from plug-flow end
The panoramic video frame that block coded data is formed, and the play position according to each piecemeal is relative with broadcasting end current view point position
Position relationship determines the code check of each block encoding data, and the block encoding data obtained according to different code checks coding are encapsulated as
Panoramic video frame.
Wherein, the code check for adopting apart from the nearer piecemeal in current view point position is higher, apart from current view point position farther out
The code check that piecemeal is adopted is relatively low, to ensure that in viewing user clearly image can be watched within sweep of the eye.Current view point
Position is to play end to get using gyroscope etc., and is sent to coding side.
When encoding to each piecemeal, video coding and decoding technology standard, such as H264, H265, AVS can be adopted,
In coding implementation process, being all based on macro block carries out the coded system of frame in and interframe encode to video sequence piecemeal, removes
Information redundancy.The image of each piecemeal is divided into first 16 × 16 or 64 × 64 block of pixels, as the elementary cell of coded treatment,
Then by estimation and transition coding, time and spatial redundancy are eliminated, reaches the purpose of compression video information.
Step 120, the coding side sends the panoramic video frame to end is played, and is broadcast with indicating that broadcasting end carries out decoding
Put.
Coding side sends the panoramic video frame that the block encoding data obtained by different code checks coding are constituted to broadcasting end,
So that playing end carries out decoding broadcasting when panoramic video frame is received.
The technical scheme of the present embodiment, piecemeal is carried out by panoramic video frame case in the play position for playing end, each
Play position and the relative position relation determination of playing end current view point position of the code check of block encoding data according to the piecemeal,
So that the code check apart from the nearer piecemeal in current view point position is higher, apart from current view point position piecemeal farther out code check compared with
It is low, it is no longer unified to maintain the high code check of identical so as to the block encoding data in panoramic video frame adopt different code checks, significantly
The video code rate after coding is reduced, the pressure of the network bandwidth is reduced, and due to determining each point according to current view point position
The code check of block, it is ensured that human eye can obtain all the time the viewing effect of HD video quality, and solving panorama live video cannot
The problem of real-time Transmission so that panorama live video can be with real-time Transmission.
Embodiment two
Fig. 2 is a kind of flow chart of the coding method of panoramic video that the embodiment of the present invention two is provided, and the present embodiment is in reality
Apply and be optimized on the basis of example one, each block encoding data that coding side obtains panoramic video frame are further optimized for：
Plug-flow end carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video data；The plug-flow end from
A code check is sequentially selected at least two code checks, as current code check, and using current code check to all piecemeal video datas
Encoded；Piecemeal video data after all codings is classified and is encapsulated by the plug-flow end according to code check, is sent to cloud
Platform end；The cloud platform end is obtained according to the broadcasting current view point position at end and broadcasting for each piecemeal as the coding side
Put the code check of each piecemeal of position determination；The cloud platform end according to the code check of each piecemeal, from the corresponding wrapper of each code check
Search corresponding piecemeal；The cloud platform end becomes the piecemeal split for finding after coding according to the play position of piecemeal
Panoramic video frame.The method specifically includes following steps：
Step 210, plug-flow end carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video counts
According to.
Plug-flow end obtains panoramic video frame, and carries out piecemeal to panoramic video frame, is easy to follow-up coded treatment, can be by
Piecemeal is carried out in the play position for playing end according to panoramic video frame, can such as be divided into 16 × 16 or 64 × 64 piecemeal, certainly, also
Other piecemeals can be divided in the play position for playing end according to panoramic video frame.
Wherein, plug-flow end carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video data
Preferably include：
The plug-flow end carries out piecemeal according to human eye physilogical characteristics to the panoramic video frame.
According to human-eye stereoscopic vision transmission principle and human eye physilogical characteristics, two coincidence kens of people have 124 degree, that is to say, that
In the range of human eye is watched, the object only in this 124 degree of visual angles just has third dimension, but this angle is too big, usual people
Vision is sensitizing range at 10 degree, 10～20 degree can correct identification information, 20～30 degree are more sensitive to dynamic thing, therefore,
Piecemeal can be carried out to panoramic video frame according to the feature, and obtain preferable third dimension.
Wherein, the plug-flow end carries out piecemeal and preferably includes according to human eye physilogical characteristics to the panoramic video frame：
The panoramic video frame is divided into horizontal direction for 10 pieces, Vertical Square by the plug-flow end according to human eye physilogical characteristics
To the piecemeal for 9 pieces.
When the vertical direction visual angle of image is 20 degree, when the visual angle of horizontal direction is 36 degree, extraordinary vision is just had
Telepresenc, nor can be because frequently rotating eyeball causes tired.Based on these features of human eye, by panoramic video according to sky
Between visual angle carry out piecemeal, in the horizontal direction, horizontal 360-degree field of view is divided into 10 blocks, and each piecemeal horizontal direction is covered
Visual angle is 36 degree, and in vertical direction, vertical 180 degree visual angle is divided into 9 blocks, and the visual angle that each block vertical direction is covered is 20 degree,
Each piecemeal for finally obtaining covers 36 degree × 20 degree visual angles, 90 piecemeals is formed altogether, as shown in figure 3, Fig. 3 is enforcement of the present invention
The piecemeal exemplary plot of a panoramic video frame in the coding method of the panoramic video that example is provided.
Step 220, the plug-flow end sequentially selects a code check from least two code checks, as current code check, and adopts
With current code check to all piecemeal coding video datas.
Wherein, at least two code checks can be the user configured code check of the code check, or reception for pre-setting, also
Can be that other code checks are calculated according to the code check or a user configured code check for pre-setting.According to one
When code check is calculated other code checks, it is assumed that the code check is n, then be panoramic video frame to full frame image based on code check n
Coding can adopt the code check specification of various class, here by taking the code check specification using three kinds of class as an example, R is designated as respectively1,R2,
R3, wherein R1=n, R2=R1/ 2, R3=R2/ 2,1<n<30, accordingly, the code check difference R of each piecemeal1f=R1/N,R2f=R2/ N,
R3f=R3/ N, wherein, N is the total quantity of piecemeal in panoramic video frame.
At least two code check is sorted with order from high to low, and plug-flow end selects first code check highest code
Rate as current code check, and using current code check to panoramic video frame in all piecemeal coding video datas；Then again
Successively using the code check of low one-level as current code check, to all piecemeal coding video datas.
Piecemeal video data after all codings is classified and is encapsulated by step 230, the plug-flow end according to code check,
It is sent to cloud platform end.
The piecemeal video data encoded according to same code check is divided into a class by plug-flow end, and after encoding according to same code rate
Position of the piecemeal video data according to the piecemeal in panoramic video frame be packaged, and be sent to cloud platform end.Carry out
During encapsulation, each piecemeal is packaged together according to the play position order from left to right, from top to bottom of piecemeal.Wherein, exist
RTMP can be adopted when wrapper is sent to into cloud platform end, and (Real Time Messaging Protocol, real-time messages are passed
Defeated agreement) carry out plug-flow.
Step 240, used as the coding side, acquisition is according to the current view point position for playing end and respectively at the cloud platform end
The code check of each piecemeal that the play position of piecemeal determines.
The cloud platform end can be by multiple server groups into so that big data volume can be processed.Make at the cloud platform end
For the coding side, the current view point position for playing end feedback, and the play position according to each piecemeal and current view point position are obtained
The relative position relation put determines the code check of each piecemeal so that code check of the play position apart from the nearer piecemeal in current view point position
Higher, the code check of piecemeal of the play position apart from current view point position farther out is relatively low.
Wherein, the coding side obtains what is determined according to the play position of the current view point position and each piecemeal of playing end
The code check of each piecemeal it is optional including：
The coding side obtains current view point position from end is played；
According to the current view point position, the type for determining piecemeal is progressive region or idle region to the coding side, its
In, the current view point position in the progressive region, periphery of the idle region in the progressive region；
The coding side determines the code check of each piecemeal according to the type of piecemeal, wherein, the piecemeal correspondence in the progressive region
Code check more than the idle region the corresponding code check of piecemeal.
The cloud platform end is used as the coding side.The coding side obtains current view point position from end is played, according to working as
Front viewpoint position, it is determined that the progressive region and idle region of viewing video, the coded data of zones of different application difference code check, close
Video frame compression code stream is watched into user, when user's viewing viewpoint changes, in real time according to current view point position adjustment
Progressive region and idle region, reconfigure frame of video.It is determined that behind progressive region and idle region, according to each piecemeal complete
Play position in scape frame of video, the type for determining each piecemeal is progressive region or idle region.And according to progressive region
With the corresponding code check in idle region, the code check of each piecemeal is determined.Because current view point position is in the progressive region, area of leaving unused
Domain is in the periphery in the progressive region, and the corresponding code check of piecemeal in progressive region is more than the corresponding code of piecemeal in idle region
Rate so that user can clearly watch at the moment clearly image, the image that can't see below can be with Relative Fuzzy, so as to big
Code check is reduced greatly.
Wherein, the progressive region can include core space, auxiliary region and extended area, and the current view point position is described
In core space, the auxiliary region in the periphery of the core space, the extended area in the periphery of the auxiliary region, the idle area
Periphery of the domain in the extended area.
In the piecemeal that the panoramic video frame is divided into that horizontal direction is 10 pieces, vertical direction is 9 pieces, progressive region can be with
For horizontal direction be 5 pieces, vertical direction be 5 pieces, so as to build the horizontal direction 180 degree visual field, 100 degree of visuals field of vertical direction, structure
180 × 100 degree of visual field is built, i.e., the visual field is made up of core space, auxiliary region and extended area, zones of different adopts different code checks
Encoded, when viewing viewpoint changes, by the current view point position for playing end Real-time Feedback, accordingly to core
Area, auxiliary region, extended area and idle region synchronize renewal so that human eye can obtain all the time the viewing effect of HD video quality
Really.
Fig. 4 is that the current view point position in the coding method of panoramic video provided in an embodiment of the present invention falls wherein one
Schematic diagram in piecemeal, as shown in figure 4, when current view point position 1 falls in certain piecemeal, can according to current view point position with
The relation of the piecemeal, four kinds of region division modes of correspondence, i.e. upper left side, lower-left of the current view point position at the center of the piecemeal
Side, upper right side, lower right, four kinds of region division modes shown in difference corresponding diagram 5a- Fig. 5 d, current view point position is in the piecemeal
Center upper left side when, the region division mode of corresponding diagram 5a；Current view point position at the lower left at the center of the piecemeal,
The region division mode of corresponding diagram 5b；Viewpoint position at the upper right side at the center of the piecemeal, the region division side of corresponding diagram 5c
Formula；Viewpoint position at the lower right at the center of the piecemeal, the region division mode of corresponding diagram 5d, in Fig. 5 a- Fig. 5 d, 10 are
Core space, 20 is auxiliary region, and 30 is extended area, and 40 is idle region.In the code check specification of above-mentioned three kinds of class, core space
The code check that piecemeal is adopted is for R1f=R1/ N, the code check that the piecemeal of auxiliary region is adopted is for R2f=R2/ N, the piecemeal employing of extended area
Code check is R3f=R3/ N, for 0, here, N is 90 to the code check that the piecemeal in idle region is adopted.Because idle region regarding in user
Outside wild scope, so show image does not nor affect on the viewing of user, and send out in the current view point position for detecting user
During changing, the region that can be shown with real-time update.By the code check for so successively decreasing, the code check of transmission is greatly reduced, reduced
The pressure of the network bandwidth.
Searched from the corresponding wrapper of each code check corresponding according to the code check of each piecemeal at step 250, the cloud platform end
Piecemeal.
The cloud platform end decapsulates respectively to the corresponding wrapper of each code check, and according to the code of each piecemeal for determining
Rate, from the corresponding wrapper of each code check corresponding piecemeal is searched.
Step 260, the cloud platform end becomes the piecemeal split for finding after coding according to the play position of piecemeal
Panoramic video frame.
Play position of the cloud platform end according to each piecemeal in panoramic video frame, the piecemeal split for finding is become
Panoramic video frame after coding is simultaneously encapsulated.
Step 270, the coding side sends the panoramic video frame to end is played, and is broadcast with indicating that broadcasting end carries out decoding
Put.
The technical scheme of the present embodiment, by plug-flow end piecemeal is carried out to panoramic video frame, and according to different code check point
Other each piecemeal coding video data to panoramic video frame, the piecemeal video data that same code rate is encoded is packaged together
And cloud platform end is sent to, determined respectively according to the play position of the current view point position and each piecemeal of playing end by cloud platform end
The code check of piecemeal, and corresponding piecemeal is extracted from the corresponding wrapper of each code check, and carry out the code stream i.e. split of reconstruct and become volume
Panoramic video frame after code is no longer unified to maintain phase so as to the block encoding data in panoramic video frame adopt different code checks
Same high code check, greatly reduces the video code rate after coding, reduces the pressure of the network bandwidth, and because basis works as forward sight
Point position determines the code check of each piecemeal, it is ensured that human eye can obtain all the time the viewing effect of HD video quality, it is to avoid complete
Due to the video buffer that network bandwidth deficiency is caused during scape net cast, solving panorama live video cannot real-time Transmission
Problem so that panorama live video can improve the experience effect of high definition panorama net cast with real-time Transmission, and pass through
Plug-flow end and cloud platform end can greatly improve the speed of process cooperateing with process.
Embodiment three
Fig. 6 is a kind of flow chart of the coding method of panoramic video that the embodiment of the present invention three is provided, and the present embodiment is in reality
Apply and be optimized on the basis of example one, each block encoding data that coding side obtains panoramic video frame are further optimized for：
The coding side carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video data；The coding
End obtains the code check of each piecemeal determined according to the play position of the current view point position and each piecemeal of playing end；The coding
Hold according to the code check of each piecemeal to piecemeal coding video data, to form coding after panoramic video frame.The method is concrete
Comprise the steps：
Step 310, the coding side carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal and regards
Frequency evidence.
The coding side carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video data,
16 × 16 or 64 × 64 piecemeal can be such as divided into, it is, of course, also possible to play the play position point at end according to panoramic video frame
For other piecemeals.
Wherein, coding side carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video data
Preferably include：
The coding side carries out piecemeal according to human eye physilogical characteristics to the panoramic video frame.
Wherein, the coding side carries out piecemeal and preferably includes according to human eye physilogical characteristics to the panoramic video frame：
The panoramic video frame is divided into horizontal direction for 10 pieces, Vertical Square by the coding side according to human eye physilogical characteristics
To the piecemeal for 9 pieces.
Step 320, the coding side obtains true according to the play position of the current view point position and each piecemeal of playing end
The code check of fixed each piecemeal.
Coding side obtains the current view point position for playing end feedback, and the play position according to each piecemeal and current view point position
The relative position relation put determines the code check of each piecemeal so that code check of the play position apart from the nearer piecemeal in current view point position
Higher, the code check of piecemeal of the play position apart from current view point position farther out is relatively low.
Wherein, the coding side obtains what is determined according to the play position of the current view point position and each piecemeal of playing end
The code check of each piecemeal it is optional including：
The coding side obtains current view point position from end is played；
According to the current view point position, the type for determining piecemeal is progressive region or idle region to the coding side, its
In, the current view point position in the progressive region, periphery of the idle region in the progressive region；
The coding side determines the code check of each piecemeal according to the type of piecemeal, wherein, the piecemeal correspondence in the progressive region
Code check more than the idle region the corresponding code check of piecemeal.
Coding side determines that the mode of the code check of each piecemeal is identical with the mode in embodiment two, repeats no more here.
Step 330, the coding side according to the code check of each piecemeal to piecemeal coding video data, to form coding after
Panoramic video frame.
Coding side according to determine each piecemeal code check respectively to the corresponding piecemeal coding video data of the piecemeal,
And the play position according to piecemeal video data in panoramic video frame is packaged, the panoramic video frame after coding is formed.
Step 340, the coding side sends the panoramic video frame to end is played, and is broadcast with indicating that broadcasting end carries out decoding
Put.
The technical scheme of the present embodiment, is carried out point according to panoramic video frame by coding side in the play position for playing end
Block, obtains the code check of each piecemeal determined according to the play position of the current view point position and each piecemeal of playing end, according to each
The code check of piecemeal forms the panoramic video frame after coding to corresponding piecemeal coding video data, so that distance is current
The code check of the nearer piecemeal of viewpoint position is higher, and the code check apart from current view point position piecemeal farther out is relatively low, so as to drop significantly
Low code check, and the viewing quality of user is not affected, the pressure of the network bandwidth is reduced, solving panorama live video cannot be real
When the problem transmitted so that panorama live video can be with real-time Transmission.
Example IV
Fig. 7 is a kind of structural representation of the code device of panoramic video that the embodiment of the present invention four is provided, such as Fig. 7 institutes
Show, the code device of the panoramic video described in the present embodiment includes：Block data acquisition module 410 and frame of video sending module
420。
Wherein, block data acquisition module 410, in being configured at coding side, each piecemeal for obtaining panoramic video frame is compiled
Code data, wherein, the panoramic video frame carries out piecemeal according in the play position for playing end, the code of each block encoding data
Rate determines according to the play position of the piecemeal with the relative position relation for playing end current view point position；
Frame of video sending module 420, in being configured at the coding side, for the panoramic video frame to be sent to broadcasting
End, to indicate that playing end carries out decoding broadcasting.
Optionally, the block data acquisition module includes：
First frame of video blocking unit, in being configured at plug-flow end, for according to panoramic video frame play end broadcasting position
Putting carries out piecemeal, obtains piecemeal video data；
Coding video frames unit, in being configured at the plug-flow end, for sequentially selecting a code from least two code checks
Rate, as current code check, and using current code check to all piecemeal coding video datas；
Frame of video transmitting element, in being configured at the plug-flow end, for according to code check, by the piecemeal video after all codings
Data are classified and are encapsulated, and are sent to cloud platform end；
First piecemeal code check acquiring unit, in being configured at the cloud platform end, the cloud platform end as the coding side,
For obtaining the code check of each piecemeal determined according to the play position of the current view point position and each piecemeal of playing end；
Block research unit, it is corresponding from each code check for according to the code check of each piecemeal in being configured at the cloud platform end
Corresponding piecemeal is searched in wrapper；
Code stream reconfiguration unit, in being configured at the cloud platform end, for according to the play position of piecemeal, by dividing for finding
Block split becomes the panoramic video frame after coding.
Optionally, the block data acquisition module includes：
Second frame of video blocking unit, in being configured at the coding side, for playing broadcasting for end according to panoramic video frame
Putting position carries out piecemeal, obtains piecemeal video data；
Second piecemeal code check acquiring unit, in being configured at the coding side, for obtaining according to the current view point for playing end
The code check of each piecemeal that the play position of position and each piecemeal determines；
Block encoding unit, for the coding side according to the code check of each piecemeal to piecemeal coding video data, with
Form the panoramic video frame after coding.
Optionally, the first piecemeal code check acquiring unit or the second piecemeal code check acquiring unit specifically for：
Current view point position is obtained from end is played；
According to the current view point position, the type for determining piecemeal is progressive region or idle region, wherein, it is described current
Viewpoint position in the progressive region, periphery of the idle region in the progressive region；
The code check of each piecemeal is determined according to the type of piecemeal, wherein, the corresponding code check of piecemeal in the progressive region is more than
The corresponding code check of piecemeal in the idle region.
Optionally, the first frame of video blocking unit or the second frame of video blocking unit include：
Piecemeal subelement, in being configured at plug-flow end or coding side, for according to human eye physilogical characteristics, to the panoramic video
Frame carries out piecemeal.
Optionally, the piecemeal subelement specifically for：
According to human eye physilogical characteristics, by the panoramic video frame be divided into horizontal direction be 10 pieces, vertical direction be 9 pieces point
Block.
The code device of above-mentioned panoramic video can perform the coding staff of the panoramic video that any embodiment of the present invention is provided
Method, possesses the corresponding functional module of execution method and beneficial effect.Ins and outs of detailed description in the present embodiment, can not join
See the coding method of the panoramic video that any embodiment of the present invention is provided.
Embodiment five
Fig. 8 is a kind of flow chart of the coding/decoding method of panoramic video that the embodiment of the present invention five is provided, and the present embodiment can be fitted
For situation about being decoded to the different code checks coding adopted to the piecemeal in panoramic video frame according to current view point position,
The method can be performed by the decoding apparatus of panoramic video, and the decoding apparatus of the panoramic video are configured at broadcasting end (such as VR heads
Helmet etc.) in, the method specifically includes following steps：
Step 510, plays end and obtains current view point position of the user in panoramic video display screen, and is sent to coding
End, to indicate that coding side is encoded using the piecemeal code check that the current view point position determines to panoramic video frame.
Play end and positional information is obtained in real time by gyroscope, and according to positional information, obtain user aobvious in panoramic video
Current view point position in display screen, and coding side is sent to, to indicate coding side using dividing that the current view point position determines
Block code rate is encoded to panoramic video frame.When user's rotary head, walk about etc. cause position to change when, corresponding current view point
Position will be triggered the code check of each piecemeal of coding side real-time update and reconstruct code stream carries out transmission of video distribution.Wherein, the coding
Hold as cloud platform end and/or plug-flow end, i.e., described coding side can for cloud platform end or plug-flow end, or cloud platform end and
Plug-flow end is collectively as coding side.
Wherein, play end and obtain current view point position of the user in panoramic video display screen, and be sent to coding side can
Choosing includes：
According to the current view point position, the type for determining piecemeal is progressive region or idle region at the broadcasting end, its
In, the current view point position in the progressive region, periphery of the idle region in the progressive region；
The type of the piecemeal and/or all types of corresponding piecemeal code checks are sent to the coding side by the broadcasting end.
Progressive region and idle region that end can also determine in panorama display screen according to current view point position are played, so as to
The type for determining each piecemeal is progressive region or idle region, so as to the type of piecemeal is sent to into coding side, or will be all kinds of
The corresponding piecemeal code check of type is sent to coding side, or while the type of piecemeal and all types of corresponding piecemeal code checks is sent to
Coding side.
Step 520, the broadcasting end receives the panoramic video frame after the coding that coding side sends.
Play end and take out panoramic video frame in video streaming by the form of YV21.
Step 530, the broadcasting end decapsulates to the panoramic video frame, obtains block encoding data and the piecemeal
Position of the coded data in panoramic video frame.
The information that each piecemeal is extracted at end is played, the panoramic video frame is decapsulated, the compression information of each piecemeal is obtained, that is, is divided
Block coded data and the position of the block encoding data in panoramic video frame.
Step 540, each block encoding decoding data of the broadcasting end to panoramic video frame.
According to each block encoding accepted standard, carry out video decoding to each piecemeal, such as h264 h265 etc. decoding.
After the decoding, can also include：Block encoding data to decoding carry out segment fusion.
At block margin, centered on border, it is that processing region (is such as selected that 2～20 pixels are chosen on each piecemeal both sides
10 pixels are taken for processing region), by the way of 8 neighborhood medium filterings, merge block margin data so that display is regarded
Frequency is more smoothed at block margin.
Step 550, the panoramic video frame after the broadcast decoder of the broadcasting end.
Play end and decoded panoramic video frame is adopted into conventional method, project to and carry out on sphere double screen output, user
The panoramic video can be watched by VR helmets etc..
The technical scheme of the present embodiment, by playing end current view point position of the user in panoramic video display screen is obtained
Put, and be sent to coding side, to indicate coding side using the piecemeal code check of current view point position determination to panoramic video frame
Encoded, received the panoramic video frame after the coding that coding side sends, decoding broadcasting is carried out to the panoramic video frame, due to
The panoramic video frame that coding side transmission comes is that the different piecemeal code check determined according to current view point position is carried out to each piecemeal
Coding so that the code check apart from the nearer piecemeal in current view point position is higher, apart from the code of current view point position piecemeal farther out
Rate is relatively low, so as to greatly reduce code check, and does not affect the viewing quality of user, reduces the pressure of the network bandwidth, solves
Panorama live video cannot real-time Transmission problem so that panorama live video can be with real-time Transmission.
Embodiment six
Fig. 9 is a kind of structural representation of the decoding apparatus of panoramic video that the embodiment of the present invention six is provided, such as Fig. 9 institutes
Show, the decoding apparatus of the panoramic video described in the present embodiment include：Viewpoint position acquisition module 610, frame of video receiver module
620th, decapsulation module 630, decoder module 640 and playing module 650.
Wherein, viewpoint position acquisition module 610, in being configured at broadcasting end, for obtaining user in panoramic video display screen
In current view point position, and coding side is sent to, to indicate the piecemeal code that coding side is determined using the current view point position
Rate is encoded to panoramic video frame；
Frame of video receiver module 620, in being configured at the broadcasting end, for the panorama after the coding for receiving coding side transmission
Frame of video；
Decapsulation module 630, in being configured at the broadcasting end, for decapsulating to the panoramic video frame, obtains
Block encoding data and the position of the block encoding data in panoramic video frame；
Decoder module 640, in being configured at the broadcasting end, for solving to each block encoding data of panoramic video frame
Code；
Playing module 650, in being configured at the broadcasting end, for the panoramic video frame after broadcast decoder.
Optionally, the viewpoint position acquisition module includes：
Piecemeal type determining units, in being configured at the broadcasting end, for according to the current view point position, determining piecemeal
Type be progressive region or idle region, wherein, the current view point position in the progressive region, the idle region
In the periphery in the progressive region；
Piecemeal code check transmitting element, in being configured at the broadcasting end, for by the type of the piecemeal and/or all types of right
The piecemeal code check answered, is sent to the coding side.
Wherein, the coding side is chosen as cloud platform end and/or plug-flow end.
The decoding apparatus of above-mentioned panoramic video can perform the decoding side of the panoramic video that any embodiment of the present invention is provided
Method, possesses the corresponding functional module of execution method and beneficial effect.Ins and outs of detailed description in the present embodiment, can not join
See the coding/decoding method of the panoramic video that any embodiment of the present invention is provided.
Note, above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that
The invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various obvious changes,
Readjust and substitute without departing from protection scope of the present invention.Therefore, although the present invention is carried out by above example
It is described in further detail, but the present invention is not limited only to above example, without departing from the inventive concept, also
More other Equivalent embodiments can be included, and the scope of the present invention is determined by scope of the appended claims.
Claims (18)
1. a kind of coding method of panoramic video, it is characterised in that methods described includes：
Coding side obtains each block encoding data of panoramic video frame, wherein, the panoramic video frame is according to broadcasting at broadcasting end
Putting position carries out piecemeal, the code check of each block encoding data according to the play position of the piecemeal with play end current view point position
Relative position relation determine；
The coding side sends the panoramic video frame to end is played, to indicate that playing end carries out decoding broadcasting.
2. method according to claim 1, it is characterised in that coding side obtains each block encoding data of panoramic video frame
Including：
Plug-flow end carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video data；
The plug-flow end sequentially selects a code check from least two code checks, as current code check, and using current code check pair
All piecemeal coding video datas；
Piecemeal video data after all codings is classified and is encapsulated by the plug-flow end according to code check, is sent to cloud platform
End；
The cloud platform end obtains the broadcasting position according to the current view point position and each piecemeal for playing end as the coding side
Put the code check of each piecemeal of determination；
The cloud platform end corresponding piecemeal is searched from the corresponding wrapper of each code check according to the code check of each piecemeal；
The piecemeal split for finding is become the panoramic video frame after coding by the cloud platform end according to the play position of piecemeal.
3. method according to claim 1, it is characterised in that coding side obtains each block encoding data of panoramic video frame
Including：
The coding side carries out piecemeal according to panoramic video frame in the play position for playing end, obtains piecemeal video data；
The coding side obtains each piecemeal of the play position determination according to the current view point position and each piecemeal for playing end
Code check；
The coding side according to the code check of each piecemeal to piecemeal coding video data, to form coding after panoramic video
Frame.
4. according to the method in claim 2 or 3, it is characterised in that the coding side is obtained works as forward sight according to broadcasting end
The code check of each piecemeal that the play position of point position and each piecemeal determines includes：
The coding side obtains current view point position from end is played；
According to the current view point position, the type for determining piecemeal is progressive region or idle region to the coding side, wherein, institute
Current view point position is stated in the progressive region, periphery of the idle region in the progressive region；
The coding side determines the code check of each piecemeal according to the type of piecemeal, wherein, the corresponding code of piecemeal in the progressive region
Piecemeal corresponding code check of the rate more than the idle region.
5. according to the method in claim 2 or 3, it is characterised in that plug-flow end or coding side are being broadcast according to panoramic video frame
Putting the play position at end carries out piecemeal, and obtaining piecemeal video data includes：
The plug-flow end or coding side carry out piecemeal according to human eye physilogical characteristics to the panoramic video frame.
6. method according to claim 5, it is characterised in that the plug-flow end or coding side according to human eye physilogical characteristics,
Carrying out piecemeal to the panoramic video frame includes：
The panoramic video frame is divided into horizontal direction and is 10 pieces, hangs down by the plug-flow end or coding side according to human eye physilogical characteristics
Nogata is to the piecemeal for 9 pieces.
7. a kind of code device of panoramic video, it is characterised in that include：
Block data acquisition module, in being configured at coding side, for obtaining each block encoding data of panoramic video frame, wherein,
The panoramic video frame carries out piecemeal according in the play position for playing end, and the code check of each block encoding data is according to the piecemeal
Play position with play end current view point position relative position relation determine；
Frame of video sending module, in being configured at the coding side, for the panoramic video frame to be sent to end is played, to indicate
Playing end carries out decoding broadcasting.
8. device according to claim 7, it is characterised in that the block data acquisition module includes：
First frame of video blocking unit, in being configured at plug-flow end, for entering in the play position for playing end according to panoramic video frame
Row piecemeal, obtains piecemeal video data；
Coding video frames unit, in being configured at the plug-flow end, for sequentially selecting a code check from least two code checks, makees
For current code check, and using current code check to all piecemeal coding video datas；
Frame of video transmitting element, in being configured at the plug-flow end, for according to code check, by the piecemeal video data after all codings
Classified and encapsulated, be sent to cloud platform end；
First piecemeal code check acquiring unit, in being configured at the cloud platform end, the cloud platform end is used for as the coding side
Obtain the code check of each piecemeal determined according to the play position of the current view point position and each piecemeal of playing end；
Block research unit, in being configured at the cloud platform end, for according to the code check of each piecemeal, from the corresponding encapsulation of each code check
Corresponding piecemeal is searched in bag；
Code stream reconfiguration unit, in being configured at the cloud platform end, for according to the play position of piecemeal, the piecemeal for finding being spelled
Synthesize the panoramic video frame after coding.
9. device according to claim 7, it is characterised in that the block data acquisition module includes：
Second frame of video blocking unit, in being configured at the coding side, for according to panoramic video frame play end broadcasting position
Putting carries out piecemeal, obtains piecemeal video data；
Second piecemeal code check acquiring unit, in being configured at the coding side, for obtaining according to the current view point position for playing end
And the code check of each piecemeal of the play position determination of each piecemeal；
Block encoding unit, for the coding side according to the code check of each piecemeal to piecemeal coding video data, to be formed
Panoramic video frame after coding.
10. device according to claim 8 or claim 9, it is characterised in that the first piecemeal code check acquiring unit or described
Two piecemeal code check acquiring units specifically for：
Current view point position is obtained from end is played；
According to the current view point position, the type for determining piecemeal is progressive region or idle region, wherein, the current view point
Position in the progressive region, periphery of the idle region in the progressive region；
The code check of each piecemeal is determined according to the type of piecemeal, wherein, the corresponding code check of piecemeal in the progressive region is more than described
The corresponding code check of piecemeal in idle region.
11. devices according to claim 8 or claim 9, it is characterised in that the first frame of video blocking unit or the second frame of video point
Module unit includes：
Piecemeal subelement, in being configured at plug-flow end or coding side, for according to human eye physilogical characteristics, entering to the panoramic video frame
Row piecemeal.
12. devices according to claim 11, it is characterised in that the piecemeal subelement specifically for：
According to human eye physilogical characteristics, the panoramic video frame is divided into into the piecemeal that horizontal direction is 10 pieces, vertical direction is 9 pieces.
13. a kind of coding/decoding methods of panoramic video, it is characterised in that methods described includes：
Play end and obtain current view point position of the user in panoramic video display screen, and be sent to coding side, to indicate coding
The piecemeal code check determined using the current view point position is held to encode panoramic video frame；
The broadcasting end receives the panoramic video frame after the coding that coding side sends；
The broadcasting end decapsulates to the panoramic video frame, obtains block encoding data and the block encoding data complete
Position in scape frame of video；
Each block encoding decoding data of the broadcasting end to panoramic video frame；
Panoramic video frame after the broadcast decoder of the broadcasting end.
14. methods according to claim 13, it is characterised in that broadcasting end obtains user in panoramic video display screen
Current view point position, and be sent to coding side and include：
According to the current view point position, the type for determining piecemeal is progressive region or idle region at the broadcasting end, wherein, institute
Current view point position is stated in the progressive region, periphery of the idle region in the progressive region；
The type of the piecemeal and/or all types of corresponding piecemeal code checks are sent to the coding side by the broadcasting end.
15. methods according to claim 14, it is characterised in that the coding side is cloud platform end and/or plug-flow end.
16. a kind of decoding apparatus of panoramic video, it is characterised in that include：
Viewpoint position acquisition module, in being configured at broadcasting end, for obtaining current view point of the user in panoramic video display screen
Position, and coding side is sent to, to indicate coding side using the piecemeal code check of current view point position determination to panoramic video
Frame is encoded；
Frame of video receiver module, in being configured at the broadcasting end, for the panoramic video frame after the coding for receiving coding side transmission；
Decapsulation module, in being configured at the broadcasting end, for decapsulating to the panoramic video frame, obtains block encoding
Data and the position of the block encoding data in panoramic video frame；
Decoder module, in being configured at the broadcasting end, for each block encoding decoding data to panoramic video frame；
Playing module, in being configured at the broadcasting end, for the panoramic video frame after broadcast decoder.
17. devices according to claim 16, it is characterised in that the viewpoint position acquisition module includes：
Piecemeal type determining units, in being configured at the broadcasting end, for according to the current view point position, determining the class of piecemeal
Type is progressive region or idle region, wherein, in the progressive region, the idle region is in institute for the current view point position
State the periphery in progressive region；
Piecemeal code check transmitting element, in being configured at the broadcasting end, for by the type of the piecemeal and/or all types of corresponding
Piecemeal code check, is sent to the coding side.
18. devices according to claim 17, it is characterised in that the coding side is cloud platform end and/or plug-flow end.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611127925.8A CN106658011A (en) | 2016-12-09 | 2016-12-09 | Panoramic video coding and decoding methods and devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611127925.8A CN106658011A (en) | 2016-12-09 | 2016-12-09 | Panoramic video coding and decoding methods and devices |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106658011A true CN106658011A (en) | 2017-05-10 |
Family
ID=58824667
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611127925.8A Pending CN106658011A (en) | 2016-12-09 | 2016-12-09 | Panoramic video coding and decoding methods and devices |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106658011A (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107396081A (en) * | 2017-06-19 | 2017-11-24 | 深圳市铂岩科技有限公司 | For the Optimized Coding and device of panoramic video |
| CN107529064A (en) * | 2017-09-04 | 2017-12-29 | 北京理工大学 | A kind of self-adaptive encoding method based on VR terminals feedback |
| CN108650460A (en) * | 2018-05-10 | 2018-10-12 | 深圳视点创新科技有限公司 | Server, panoramic video store and transmit method and computer storage media |
| CN108737820A (en) * | 2018-05-21 | 2018-11-02 | 北京奇艺世纪科技有限公司 | panoramic video compression method and device |
| CN109348291A (en) * | 2018-11-16 | 2019-02-15 | 深圳市梦网百科信息技术有限公司 | A kind of panoramic video code stream distribution method and system based on motion analysis |
| CN109391779A (en) * | 2017-08-10 | 2019-02-26 | 纳格拉维森公司 | The scene view of extension |
| CN109963185A (en) * | 2017-12-26 | 2019-07-02 | 杭州海康威视数字技术股份有限公司 | Video data transmitting method, image display method, device, system and equipment |
| CN110049324A (en) * | 2019-04-12 | 2019-07-23 | 深圳壹账通智能科技有限公司 | Method for video coding, system, equipment and computer readable storage medium |
| CN110072121A (en) * | 2018-01-23 | 2019-07-30 | 南京大学 | A kind of immersion media data transmission method adapting to human eye perception situation |
| CN110121067A (en) * | 2018-02-07 | 2019-08-13 | 深圳市掌网科技股份有限公司 | A kind of virtual implementing helmet being equipped with wireless device |
| CN110519652A (en) * | 2018-05-22 | 2019-11-29 | 华为软件技术有限公司 | VR video broadcasting method, terminal and server |
| CN111131879A (en) * | 2019-12-30 | 2020-05-08 | 歌尔股份有限公司 | Video data playing method and device and computer readable storage medium |
| CN111225293A (en) * | 2018-11-23 | 2020-06-02 | 深圳市中兴微电子技术有限公司 | Video data processing method and device and computer storage medium |
| CN111726640A (en) * | 2020-07-03 | 2020-09-29 | 中图云创智能科技(北京)有限公司 | Live broadcast method with 0-360 degree dynamic viewing angle |
| CN111885417A (en) * | 2020-07-28 | 2020-11-03 | 北京奇艺世纪科技有限公司 | VR video playing method, device, equipment and storage medium |
| CN112130667A (en) * | 2020-09-25 | 2020-12-25 | 深圳市佳创视讯技术股份有限公司 | Interaction method and system for ultra-high definition VR (virtual reality) video |
| CN112437286A (en) * | 2020-11-23 | 2021-03-02 | 成都易瞳科技有限公司 | Method for transmitting panoramic original picture video in blocks |
| CN112616014A (en) * | 2020-12-09 | 2021-04-06 | 福州大学 | GAN-based panoramic video adaptive streaming transmission method |
| WO2021109397A1 (en) * | 2020-04-10 | 2021-06-10 | Zte Corporation | Rank information in immersive media processing |
| CN113141346A (en) * | 2021-03-16 | 2021-07-20 | 青岛小鸟看看科技有限公司 | Streaming-based VR-multiservice system and method |
| CN113329269A (en) * | 2020-02-28 | 2021-08-31 | 杭州海康威视数字技术股份有限公司 | Video encoding method, video decoding method, video encoding device, video decoding device, electronic equipment and storage medium |
| CN113645500A (en) * | 2021-10-15 | 2021-11-12 | 北京蔚领时代科技有限公司 | Virtual reality video stream data processing system |
| CN113766235A (en) * | 2021-08-30 | 2021-12-07 | 聚好看科技股份有限公司 | Panoramic video transmission method and device |
| CN115002519A (en) * | 2022-05-31 | 2022-09-02 | 北京势也网络技术有限公司 | Method for playing 8K panoramic video file in low-bandwidth network |
| CN115580738A (en) * | 2022-02-23 | 2023-01-06 | 北京拙河科技有限公司 | High-resolution video display method, device and system based on-demand transmission |
| CN112437286B (en) * | 2020-11-23 | 2024-04-26 | 成都易瞳科技有限公司 | Panoramic original picture video block transmission method |
-
2016
- 2016-12-09 CN CN201611127925.8A patent/CN106658011A/en active Pending
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107396081A (en) * | 2017-06-19 | 2017-11-24 | 深圳市铂岩科技有限公司 | For the Optimized Coding and device of panoramic video |
| US10499082B2 (en) | 2017-06-19 | 2019-12-03 | Shenzhen Boyan Technology Ltd. | Optimized coding method for omnidirectional video, computer readable storage medium and computer device |
| CN107396081B (en) * | 2017-06-19 | 2019-04-12 | 深圳市铂岩科技有限公司 | For the Optimized Coding and device of panoramic video |
| CN109391779A (en) * | 2017-08-10 | 2019-02-26 | 纳格拉维森公司 | The scene view of extension |
| CN107529064A (en) * | 2017-09-04 | 2017-12-29 | 北京理工大学 | A kind of self-adaptive encoding method based on VR terminals feedback |
| CN109963185A (en) * | 2017-12-26 | 2019-07-02 | 杭州海康威视数字技术股份有限公司 | Video data transmitting method, image display method, device, system and equipment |
| CN110072121A (en) * | 2018-01-23 | 2019-07-30 | 南京大学 | A kind of immersion media data transmission method adapting to human eye perception situation |
| CN110121067A (en) * | 2018-02-07 | 2019-08-13 | 深圳市掌网科技股份有限公司 | A kind of virtual implementing helmet being equipped with wireless device |
| CN108650460A (en) * | 2018-05-10 | 2018-10-12 | 深圳视点创新科技有限公司 | Server, panoramic video store and transmit method and computer storage media |
| CN108737820A (en) * | 2018-05-21 | 2018-11-02 | 北京奇艺世纪科技有限公司 | panoramic video compression method and device |
| CN110519652B (en) * | 2018-05-22 | 2021-05-18 | 华为软件技术有限公司 | VR video playing method, terminal and server |
| CN110519652A (en) * | 2018-05-22 | 2019-11-29 | 华为软件技术有限公司 | VR video broadcasting method, terminal and server |
| US11765427B2 (en) | 2018-05-22 | 2023-09-19 | Huawei Technologies Co., Ltd. | Virtual reality video playing method, terminal, and server |
| CN109348291A (en) * | 2018-11-16 | 2019-02-15 | 深圳市梦网百科信息技术有限公司 | A kind of panoramic video code stream distribution method and system based on motion analysis |
| CN111225293A (en) * | 2018-11-23 | 2020-06-02 | 深圳市中兴微电子技术有限公司 | Video data processing method and device and computer storage medium |
| CN111225293B (en) * | 2018-11-23 | 2023-10-03 | 深圳市中兴微电子技术有限公司 | Video data processing method and device and computer storage medium |
| CN110049324A (en) * | 2019-04-12 | 2019-07-23 | 深圳壹账通智能科技有限公司 | Method for video coding, system, equipment and computer readable storage medium |
| CN111131879A (en) * | 2019-12-30 | 2020-05-08 | 歌尔股份有限公司 | Video data playing method and device and computer readable storage medium |
| CN113329269A (en) * | 2020-02-28 | 2021-08-31 | 杭州海康威视数字技术股份有限公司 | Video encoding method, video decoding method, video encoding device, video decoding device, electronic equipment and storage medium |
| WO2021109397A1 (en) * | 2020-04-10 | 2021-06-10 | Zte Corporation | Rank information in immersive media processing |
| CN111726640A (en) * | 2020-07-03 | 2020-09-29 | 中图云创智能科技(北京)有限公司 | Live broadcast method with 0-360 degree dynamic viewing angle |
| CN111885417A (en) * | 2020-07-28 | 2020-11-03 | 北京奇艺世纪科技有限公司 | VR video playing method, device, equipment and storage medium |
| CN112130667A (en) * | 2020-09-25 | 2020-12-25 | 深圳市佳创视讯技术股份有限公司 | Interaction method and system for ultra-high definition VR (virtual reality) video |
| CN112437286B (en) * | 2020-11-23 | 2024-04-26 | 成都易瞳科技有限公司 | Panoramic original picture video block transmission method |
| CN112437286A (en) * | 2020-11-23 | 2021-03-02 | 成都易瞳科技有限公司 | Method for transmitting panoramic original picture video in blocks |
| CN112616014A (en) * | 2020-12-09 | 2021-04-06 | 福州大学 | GAN-based panoramic video adaptive streaming transmission method |
| CN113141346B (en) * | 2021-03-16 | 2023-04-28 | 青岛小鸟看看科技有限公司 | VR one-to-multiple system and method based on series flow |
| CN113141346A (en) * | 2021-03-16 | 2021-07-20 | 青岛小鸟看看科技有限公司 | Streaming-based VR-multiservice system and method |
| CN113766235A (en) * | 2021-08-30 | 2021-12-07 | 聚好看科技股份有限公司 | Panoramic video transmission method and device |
| CN113766235B (en) * | 2021-08-30 | 2023-10-17 | 聚好看科技股份有限公司 | Panoramic video transmission method and equipment |
| CN113645500B (en) * | 2021-10-15 | 2022-01-07 | 北京蔚领时代科技有限公司 | Virtual reality video stream data processing system |
| CN113645500A (en) * | 2021-10-15 | 2021-11-12 | 北京蔚领时代科技有限公司 | Virtual reality video stream data processing system |
| CN115580738A (en) * | 2022-02-23 | 2023-01-06 | 北京拙河科技有限公司 | High-resolution video display method, device and system based on-demand transmission |
| CN115580738B (en) * | 2022-02-23 | 2023-09-19 | 北京拙河科技有限公司 | High-resolution video display method, device and system for on-demand transmission |
| CN115002519A (en) * | 2022-05-31 | 2022-09-02 | 北京势也网络技术有限公司 | Method for playing 8K panoramic video file in low-bandwidth network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106658011A (en) | Panoramic video coding and decoding methods and devices | |
| US10645369B2 (en) | Stereo viewing | |
| US11706403B2 (en) | Positional zero latency | |
| US11140378B2 (en) | Sub-picture-based processing method of 360-degree video data and apparatus therefor | |
| EP3603056A1 (en) | A method and an apparatus and a computer program product for adaptive streaming | |
| EP3434021B1 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| US20200304549A1 (en) | Immersive Media Metrics For Field Of View | |
| KR101329057B1 (en) | An apparatus and method for transmitting multi-view stereoscopic video | |
| Hu et al. | Mobile edge assisted live streaming system for omnidirectional video | |
| US11010923B2 (en) | Image encoding method and technical equipment for the same | |
| CN114040184A (en) | Image display method, system, storage medium and computer program product | |
| WO2017220851A1 (en) | Image compression method and technical equipment for the same | |
| CN109479147A (en) | Method and technique equipment for time interview prediction | |
| WO2015016691A1 (en) | Method for converting and reproducing image for providing moderate three-dimensional effect between two-dimensional image and three-dimensional image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170510 |
|
| WD01 | Invention patent application deemed withdrawn after publication |