CN108886616A - The method, apparatus and computer system of Video coding - Google Patents
The method, apparatus and computer system of Video coding Download PDFInfo
- Publication number
- CN108886616A CN108886616A CN201780018384.1A CN201780018384A CN108886616A CN 108886616 A CN108886616 A CN 108886616A CN 201780018384 A CN201780018384 A CN 201780018384A CN 108886616 A CN108886616 A CN 108886616A
- Authority
- CN
- China
- Prior art keywords
- motion vector
- vector value
- frame number
- image
- default frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Studio Devices (AREA)
Abstract
Disclose the method, apparatus and computer system of a kind of Video coding.This method includes：The motion vector information of the first default frame number image in 360 degree of panoramic videos is obtained by image-signal processor；According to the motion vector information, determine minimum movement vector value and pole motion vector value, wherein, the minimum movement vector value is the motion vector value in the smallest region of motion vector value in the described first default frame number image, and the pole motion vector value is the motion vector value that the two poles of the earth region of 360 degree of panoramic videos is corresponded in the described first default frame number image；According to the minimum movement vector value, the pole motion vector value and motion vector value thresholding, the rotation angle of the second default frame number image in 360 degree of panoramic videos is determined；According to the rotation angle, the described second default frame number image is rotated, is then encoded again.The technical solution of the embodiment of the present invention can be improved the code efficiency of 360 degree of panoramic videos.
Description
Copyright notice
This patent document disclosure includes material protected by copyright.The copyright is all for copyright holder.Copyright
Owner does not oppose the patent document in the presence of anyone replicates the proce's-verbal of Patent&Trademark Office and archives or should
Patent discloses.
Technical field
The present invention relates to information technology fields, and more particularly, to the method, apparatus and calculating of a kind of Video coding
Machine system.
Background technique
Recently as the extension of video capture scene, 360 degree of panoramic video applications are gradually popularized.360 degree of panoramic videos
Typically refer to the video that horizontal view angle has 360 degree (- 180 °~180 °), vertical angle of view to have 180 degree (- 90 °~90 °), usually with
Three-dimensional sphere form is presented.360 degree of panoramic videos would generally be mapped with certain geometrical relationship generates two-dimensional surface video, then again
Via Digital Image Processing and coding-decoding operation.
When 360 degree of panoramic videos are mapped to two-dimensional surface and are encoded, such as it is mapped to longitude and latitude bitmap-format, aphorama
The part of the two poles of the earth up and down (vertical angle of view is -90 degree and 90 degree of near zones, is referred to as poles region) of frequency has apparent
It stretches, the stitching portion of longitude and latitude figure the right and left also has apparent discontinuous.In view of human eye region-of-interest is mainly in aphorama
The equator region (vertical angle of view is 0 degree of near zone) of frequency, when pair warp and weft figure is encoded, often for longitude and latitude figure
More bits are distributed in central area, coding more carefully；The two poles of the earth up and down of longitude and latitude figure and the left and right sides are just distributed
Bit it is opposite will less, the quality of Video coding is relatively less better.But it is violent for certain the two poles of the earth componental movements, in
The bit of 360 degree of gentle panoramic videos of heart regional movement, this coding mode consumption great quantities of spare is moving shoulder, and
Then cause coding quality poor since the bit of distribution is less the two poles of the earth part of motion intense, so as to cause code efficiency compared with
It is low.
Therefore, it is necessary to a kind of coding methods of 360 degree of panoramic videos, to improve the code efficiency of 360 degree of panoramic videos.
Summary of the invention
The embodiment of the invention provides a kind of method, apparatus of Video coding and computer system, can be improved 360 degree it is complete
The code efficiency of scape video.
In a first aspect, a kind of method of Video coding is provided, including：360 degree are obtained entirely by image-signal processor
The motion vector information of first default frame number image in scape video；According to the motion vector information, minimum movement vector is determined
Value and pole motion vector value, wherein the minimum movement vector value is motion vector value in the described first default frame number image
The motion vector value in the smallest region, the pole motion vector value are to correspond to described 360 in the described first default frame number image
Spend the motion vector value in the two poles of the earth region of panoramic video；According to the minimum movement vector value, the pole motion vector value, with
And motion vector value thresholding, determine the rotation angle of the second default frame number image in 360 degree of panoramic videos；According to the rotation
Gyration rotates the described second default frame number image, is then encoded again.
Second aspect provides the device of Video coding, including：Image-signal processor, for obtaining 360 degree of aphoramas
The motion vector information of first default frame number image in frequency；Processing unit, for determining minimum according to the motion vector information
Motion vector value and pole motion vector value, wherein the minimum movement vector value is to transport in the described first default frame number image
The motion vector value in the smallest region of dynamic vector value, the pole motion vector value are corresponding in the described first default frame number image
The motion vector value in the two poles of the earth region of 360 degree of panoramic videos；And according to the minimum movement vector value, the pole
Motion vector value and motion vector value thresholding determine the rotation angle of the second default frame number image in 360 degree of panoramic videos
Degree；Rotary unit, for being rotated to the described second default frame number image according to the rotation angle；Coding unit is used for
Postrotational image is encoded.
The third aspect provides a kind of computer system, including：Memory, for storing computer executable instructions；Place
Device is managed, for accessing the memory, and the computer executable instructions are executed, in the method to carry out above-mentioned first aspect
Operation.
Fourth aspect provides a kind of computer storage medium, is stored with program code in the computer storage medium, should
Program code can serve to indicate that the method for executing above-mentioned first aspect.
The technical solution of the embodiment of the present invention obtains motion vector information by image-signal processor, is sweared according to movement
Information is measured, determines minimum movement vector value and pole motion vector value, and determine therefrom that the rotation angle of 360 degree of panoramic videos,
It can not need secondary coding and realize the rotary codings of 360 degree of panoramic videos, the compression effect of 360 degree of panoramic videos can be improved
Rate and coding quality, so as to improve the code efficiency of 360 degree of panoramic videos.
Detailed description of the invention
Fig. 1 is the architecture diagram using the technical solution of the embodiment of the present invention.
Fig. 2 is the processing framework figure of the encoder of the embodiment of the present invention.
Fig. 3 is the schematic diagram of the data to be encoded of the embodiment of the present invention.
Fig. 4 a is that 360 degree of panoramic videos mapping of the embodiment of the present invention generates the diagram of two-dimensional surface video.
Fig. 4 b is the diagram of the video rotation of the embodiment of the present invention.
Fig. 5 is the schematic flow chart of the method for the Video coding of the embodiment of the present invention.
Fig. 6 is the flow chart of the method for the Video coding of the embodiment of the present invention.
Fig. 7 is the schematic block diagram of the device of the Video coding of the embodiment of the present invention.
Fig. 8 is the schematic block diagram of the computer system of the embodiment of the present invention.
Specific embodiment
Below in conjunction with attached drawing, technical solution in the embodiment of the present invention is described.
It should be understood that specific example herein is intended merely to that those skilled in the art is helped to more fully understand that the present invention is real
Example is applied, the range for the embodiment that is not intended to limit the present invention.
It should also be understood that the formula in the embodiment of the present invention is a kind of example, the range for the embodiment that is not intended to limit the present invention,
Each formula can be deformed, these deformations also should belong to the scope of protection of the invention.
It should also be understood that in various embodiments of the present invention, the size of the serial number of each process is not meant to execute sequence
It is successive, the execution of each process sequence should be determined by its function and internal logic, the implementation without coping with the embodiment of the present invention
Journey constitutes any restriction.
It should also be understood that various embodiments described in this specification, both can individually implement, implementation can also be combined,
The embodiment of the present invention does not limit this.
Unless otherwise indicated, all technical and scientific terms used in the embodiment of the present invention and technical field of the invention
The normally understood meaning of technical staff it is identical.Term used in this application is intended merely to the mesh of description specific embodiment
, it is not intended that limitation scope of the present application.Term "and/or" used in this application includes one or more relevant listed
Any and all combinations of item.
Fig. 1 is the architecture diagram using the technical solution of the embodiment of the present invention.
As shown in Figure 1, system 100 can receive data to be encoded 102, data to be encoded 102 are encoded, generate volume
Code data 108, and can further Video coding 108.For example, system 100 can receive 360 degree of panoramic video data, to 360
It spends panoramic video data and carries out rotary coding to generate the data after rotary coding.In some embodiments, the portion in system 100
Part can be realized that the processor can be the processor calculated in equipment by one or more processors, be also possible to movement and set
Processor in standby (such as unmanned plane).The processor can be the processor of any kind, and the embodiment of the present invention does not do this
It limits.In some possible designs, which may include image-signal processor (Image Signal
Processor, ISP), encoder etc..It can also include one or more memories in system 100.The memory can be used for depositing
Instruction and data is stored up, for example, realize the computer executable instructions of the technical solution of the embodiment of the present invention, data to be encoded 102,
Coded data 108 etc..The memory can be the memory of any kind, the embodiment of the present invention to this also without limitation.
Data to be encoded 102 may include text, image, Drawing Object, animation sequence, audio, video or any need
Other to be encoded data.In some cases, data to be encoded 102 may include the sensing data from sensor, the biography
Sensor can be visual sensor (for example, camera, infrared sensor), and microphone, nearfield sensor is (for example, supersonic sensing
Device, radar), position sensor, temperature sensor, touch sensor etc..In some cases, data to be encoded 102 can wrap
Information from the user is included, for example, biological information, which may include facial characteristics, finger scan, and retina is swept
It retouches, voice record, DNA sampling etc..
Coding is required for efficient and/or safe transmission or storing data.It can to the coding of data to be encoded 102
To include data compression, encryption, Error Correction of Coding, format conversion etc..For example, being compressed to multi-medium data (such as video or audio)
The amount of bits transmitted in a network can be reduced.Sensitive data, such as Financial Information and identification information are being transmitted and are being deposited
It can be encrypted before storage to protect secret and/or privacy.Occupied bandwidth is stored and transmitted in order to reduce video, is needed to video
Data carry out encoding compression processing.
Any suitable coding techniques may be used to encode data to be encoded 102.Type of coding depends on encoded
Data and specific code requirement.
In some embodiments, one or more different codecs may be implemented in encoder.Every kind of codec can
To include the code for realizing different coding algorithm, instruction or computer program.Based on various factors, including data to be encoded 102
Type and/or source, the receiving entity of coded data, available computing resource, network environment, business environment, rule and mark
Standard etc. can choose a kind of data to be encoded 102 that suitable encryption algorithm coding is given.
For example, encoder can be configured as a series of video frames of coding.The data encoded in each frame can be using one
Series of steps.In some embodiments, coding step may include the processing steps such as prediction, transformation, quantization, entropy coding.
Prediction include intra prediction and inter-prediction two types, its object is to using prediction block message removal currently to
The redundancy of coded picture block.Intra prediction utilizes the information acquisition prediction block data of this frame image.Inter-prediction utilizes ginseng
The information acquisition prediction block data of frame are examined, process includes that image block to be encoded is divided into several subimage blocks；Then, needle
To each subimage block, search is with the most matched image block of current subimage block as prediction block in a reference image；Thereafter, will
The respective pixel values of the subimage block and prediction block subtract each other to obtain residual error, and combine the corresponding residual error of obtained each subimage block
Together, the residual error of image block is obtained.
The correlation that can remove the residual error of image block is converted using residual block of the transformation matrix to image, that is, is removed
The redundancy of image block, to improve code efficiency, the transformation of the data block in image block generallys use two-dimensional transform, that is, exists
The residual information of data block is multiplied with the transformation matrix of NxM and its transposed matrix by coding side respectively, obtains after being multiplied
Be transformation coefficient.Transformation coefficient is quantified quantified after coefficient, finally by after quantization coefficient carry out entropy coding, most
Coding mode information by bit stream that entropy coding obtains and after being encoded afterwards, such as intra prediction mode, motion vector information
Deng being stored or be sent to decoding end.In the decoding end of image, entropy decoding is carried out after acquisition entropy coding bit stream first, is obtained
To corresponding residual error, the corresponding forecast image block of information images block such as the motion vector or intra prediction that are obtained according to decoding, root
It is predicted that the residual error of image block and image block obtains the value of each pixel in current subimage block.
Fig. 2 shows the processing framework figures of the encoder of the embodiment of the present invention.As shown in Fig. 2, prediction processing may include
Intra prediction and inter-prediction.It is handled by prediction, the corresponding residual error of available data cell (such as pixel), wherein
When predicting a certain pixel, the pixel obtained after being rebuild from reference image vegetarian refreshments is obtained in the context of storage,
The pixel of the pixel and the pixel that obtain after rebuilding according to reference image vegetarian refreshments, obtains the corresponding pixel residual error of the pixel.Picture
Plain residual error by carrying out entropy coding after transformation, quantization again.In quantification treatment, can be realized by the control to quantization parameter
Control to code rate.Pixel residual error after the corresponding quantification treatment of a certain pixel can also be carried out at inverse quantization inverse transformation
Reason, then reconstruction processing is carried out, the pixel after the pixel is rebuild is obtained, and the pixel after pixel reconstruction is stored,
In order to which when the pixel is as reference image vegetarian refreshments, it is corresponding that the pixel after being rebuild using the pixel obtains other pixels
Pixel residual error.
Quantization parameter may include quantization step, indicate quantization step or value relevant to quantization step, for example,
H.264, the quantization parameter H.265 or in similar encoder (Quantization Parameter, QP), alternatively, quantization
Matrix or its R-matrix etc..
Fig. 3 shows the schematic diagram of the data to be encoded of the embodiment of the present invention.
As shown in figure 3, data to be encoded 302 may include multiple frames 304.For example, multiple frames 304 can indicate video flowing
In continuous picture frame.Each frame 304 may include one or more bands 306.Each band 306 may include one or
Multiple macro blocks 308.Each macro block 308 may include one or more blocks 310.Each piece 310 may include one or more pictures
Element 312.Each pixel 312 may include one or more data sets, correspond to one or more data portions, for example, brightness
Data portion and chroma data part.Data cell can be frame, band, macro block, block, the group of pixel or any of the above.?
In different embodiments, the size of data cell can change.As an example, a frame 304 may include 100 bands 306,
Each band 306 may include 10 macro blocks 308, and each macro block 308 may include 4 (for example, 2x2) blocks 310, and each piece
310 may include 64 (for example, 8x8) pixels 312.
The technical solution of the embodiment of the present invention can be used for encoding 360 degree of panoramic videos, can be applied to various
It is related to the product of 360 degree of panoramic videos, for example, panorama camera, virtual reality products, headset equipment (Head Mount
Device, HMD), augmented reality product, video encoder, Video Decoder etc..
360 degree of panoramic videos would generally be mapped with certain geometrical relationship generates two-dimensional surface video, then again via number
Image procossing and coding-decoding operation.Through 360 degree of panorama sketch with particular geometric relationship map at the common format of 2 d plane picture
There is longitude and latitude figure (Equirectangular).What longitude and latitude figure indicated is a complete spherical surface azimuthal θ and pitch angleIt carries out
Obtained 2 d plane picture is sampled, as shown in fig. 4 a.
In addition to longitude and latitude figure, there are also hexahedron, octahedron, icosahedron lattice for the common two-dimensional surface bitmap-format being mapped to
Formula can also use other mapping mechanisms that one spherical surface body is mapped to a 2 d plane picture, the two dimension after mapping
Plan view forms two-dimensional surface video, and general video encoding and decoding standard, such as HEVC/ can be used in the two-dimensional surface video
H.265, H.264/AVC, AVS1-P2, AVS2-P2, VP8, VP9 etc. carry out coding compression.The two-dimensional surface video passes through ball
Plane video maps to obtain, and can also map to obtain via spherical calotte video.The spherical video or spherical calotte video usually by
Multiple video cameras shoot to obtain.
It in embodiments of the present invention, unless otherwise indicated, is to its two-dimensional surface video to the processing of 360 degree of panoramic videos
Processing.
In order to improve the compression efficiency and coding quality of 360 degree of panoramic videos, code efficiency is improved, the embodiment of the present invention mentions
A kind of rotary coding scheme applied in 360 degree of panorama video codes is supplied, for 360 degree of panoramic videos to be encoded, first
By the rotation of some angle, then again by postrotational Video coding.
The rotation of 360 degree of panoramic videos is exactly the rotation of common geometry spherical surface.As shown in Figure 4 b, it is assumed that 360 degree of aphoramas
The rotation angle of frequency is (α, beta, gamma), then to every frame image of 360 degree of panoramic videos rotating around x-axis, y-axis, z-axis rotation alpha, β,
Postrotational video can be obtained in γ angle.
Fig. 5 shows the schematic flow chart of the method 500 of the Video coding of the embodiment of the present invention.This method 500 can be with
System 100 as shown in Figure 1 executes.
510, believed by the motion vector that image-signal processor obtains the first default frame number image in 360 degree of panoramic videos
Breath.
In embodiments of the present invention, motion vector information is obtained by image-signal processor, it in this way can be to avoid secondary
Cataloged procedure.
Video passes through each pixel of every frame image or every in the available video of pretreatment of image-signal processor
The motion vector information in one region.The motion vector information of each pixel or each region based on image can calculate
The motion vector information of different images block in image.
In embodiments of the present invention, the first default frame number image in 360 degree of panoramic videos is obtained from image-signal processor
Motion vector information.Optionally, the motion vector information of the described first default frame number image is described image signal processor
Described in the first default frame number image local motion vector or global motion vector.
520, according to the motion vector information, determine minimum movement vector value and pole motion vector value, wherein described
Minimum movement vector value is the motion vector value in the smallest region of motion vector value in the described first default frame number image, the pole
Point motion vector value is the motion vector that the two poles of the earth region of 360 degree of panoramic videos is corresponded in the described first default frame number image
Value.
Difference can be calculated according to the motion vector information of the obtain from image-signal processor first default frame number image
The motion vector value in region.Optionally, region herein can be image block (Block), it can divide an image into image
Block calculates the motion vector value of each image block, but the embodiment of the present invention does not limit this.
Specifically, image is first drawn block for a frame image, each image block divided is denoted as a Block,
The fortune of each Block in image is calculated by the motion vector information of each pixel or each region (being less than Block)
Dynamic vector value.
Optionally, described image block includes multiple tree-like units (Coding Tree Unit, CTU) of coding, described image
The motion vector value of block is the average value of the motion vector value of the multiple CTU.The motion vector value of each CTU can be described
The sum of absolute value and the absolute value of vertical component of the horizontal component of the motion vector of all pixels point of each CTU.
For example, Block can be the size of 512x512, CTU can be 64x64 size, i.e. a Block is 8x8
CTU.Using CTU as motion vector (Motion Vector, MV) computing unit.It is a Block to image according to 8x8 CTU
It is divided, the place at image boundary less than 8x8 CTU can be then a Block according to CTU number of real surplus.It will
The MV of one CTU is denoted as MVctu, then the value of MVctu can be the MV of all pixels point in the block of pixels of a 64x64 size
The absolute value of horizontal component (MVx) and the sum of the absolute value of vertical component (MVy), i.e.,：
The MV of each CTU in image can be calculated according to above formula.Then it is calculated according to the MV of CTU each in image each
The MV of Block, is denoted as MVblock.Optionally, the value of the MV of each Block can be the flat of the MV of all CTU in the Block
Mean value.
It obtains in the first default frame number image in each frame image after the motion vector value of each Block, it can accordingly really
Determine minimum movement vector value and pole motion vector value.
Optionally, when the described first default frame number is 1, i.e., when only taking a frame image, the minimum movement vector value is
The motion vector value minMVblock of the smallest image block of motion vector value in the frame image.
Optionally, when the described first default frame number is greater than 1, the minimum movement vector value is the described first default frame number
The minimum value avgMinMVblock in the average value of the motion vector value of the image block of same position is corresponded in image.For example, with
For first default frame number takes 5, minimum movement vector value is the motion vector value that the image block of same position is corresponded in 5 frame images
Average value in minimum value.
In view of spherical video has symmetry, as long as actually handling the top half of spherical video.For example, for longitude and latitude
Each Block in figure first finds the Block in sphere about the symmetrical Block of the centre of sphere, with being averaged for the two MVblock
It is worth the MV as the two Block, only needs to search for the top half of longitude and latitude figure in search calculating process in this way, can save
The calculation amount of half.
Pole motion vector value is the two poles of the earth region that 360 degree of panoramic videos are corresponded in the described first default frame number image
Motion vector value.Optionally, for a frame image, the motion vector value of the Block of the predetermined quantity in the two poles of the earth region can be taken
Average value as pole motion vector value.For example, choosing in longitude and latitude figure, topmost two regions row CTU are sweared to calculate pole movement
Magnitude.First by the MVctu of two row CTU topmost and its average as actual about the MVctu of centrosymmetric CTU
MVctu value, then the MVctu value of pair warp and weft figure the top all CTU of two rows is averaged as pole motion vector value, is denoted as
polarMVctu.It, being averaged the pole motion vector value of multiple image obtained in a manner described for multiple image
Value is used as pole motion vector value.For example, by taking the first default frame number takes 5 as an example, the pole motion vector value of 5 frame images
AvgPolarMVctu is the average value of the polarMVctu of this 5 frame image.
530, according to the minimum movement vector value, the pole motion vector value and motion vector value thresholding, determine
The rotation angle of second default frame number image in 360 degree of panoramic videos.
By the minimum movement vector value and the pole motion vector value compared with motion vector value thresholding, judge whether
It needs to rotate the second default frame number image in 360 degree of panoramic videos.
It should be understood that in embodiments of the present invention, if rotation angle is 0, then it represents that without rotation；If rotation angle is not
0, then it represents that rotated.
In embodiments of the present invention, the minimum movement vector obtained according to the described first default frame number image is utilized
Value, the pole motion vector value determine the rotation angle of the described second default frame number image.Optionally, the described first default frame
Number image can be the image of the default frame number after the first random point of penetration of 360 panoramic video.The second default frame
Number images can for 360 panoramic video the described first random point of penetration to the default frame number between the second random point of penetration
Image, wherein the second random point of penetration be the described first random point of penetration next random point of penetration.
Optionally, the described first default frame number is less than or equal to the described second default frame number.That is, can according to compared with
Few frame number image determines the rotation angle of more frame number image.For example, can be determined according to a few frame images after random point of penetration
Rotation angle of the random point of penetration to all images between next random point of penetration.It is carried out for each random point of penetration
Rotation judgement, can be avoided the phenomenon of subsequent image rotation mistake in video, accomplishes more accurate rotary coding.
It is alternatively possible to determine the motion vector value thresholding according to the motion search range of 360 degree of panoramic videos.
It is alternatively possible to determine the motion search range by described image signal processor.
Specifically, it is assumed that the motion search range size obtained from image-signal processor is (± H, ± V), that is,
The search range of horizontal direction is [- H, H], and the search range of vertical direction is [- V, V], then motion vector value thresholding MVlow can
Think：
For example, in a particular embodiment, motion search range can be (± 16, ± 8), therefore, according to above-mentioned public affairs
The motion vector value thresholding MVlow that formula is calculated is 1536.
Rotation judgement is done using the motion vector value thresholding designed according to motion search range, can be applicable in various differences
The coding of motion search condition.
By above-mentioned minimum movement vector value, pole motion vector value, compared with motion vector value thresholding, institute can be determined
State the rotation angle of the second default frame number image.
Optionally, if the pole motion vector value is less than the motion vector value thresholding, it is determined that the rotation angle
It is 0.Such case shows that poles region motion vector value is smaller, therefore does not need to do and rotate.
Optionally, if the pole motion vector value is not less than the motion vector value thresholding, and the minimum movement is sweared
Magnitude is less than the motion vector value thresholding, it is determined that is first angle to the rotation angle.Such case shows pole area
Domain motion vector value is larger, and the region that other regions are smaller there are motion vector value, it is therefore desirable to be rotated, will be moved
The smallest region of vector value rotates to poles region.Optionally, the mode specifically rotated, which can be, first passes through the motion vector value
The central point in the smallest region calculates the coordinate on corresponding spherical surface in the coordinate on longitude and latitude figure, then calculates rotation by rotation formula
Gyration (the i.e. described first angle, calculation formula are presented below), finally can be according to the rotation of geometry spherical surface shown in Fig. 4 b
The mode of turning is rotated.
The first angle is true according to the position in the smallest region of motion vector value in the described first default frame number image
Fixed angle.
Specifically, can be according to the position in the smallest region of motion vector value in the described first default frame number image, really
The fixed first angle.For example, by the smallest region of motion vector value, it, can if the coordinate of the central point of Block is denoted as (m, n)
With by point on the sampled point (m, n) and spherical surface on longitude and latitude figure in longitude and latitude figure mapping mode (Transformational relation meter between θ)
Obtain (Coordinate θ), specific conversion formula are as follows：
θ=(0.5-v) * π
Wherein W, H are the width and height of longitude and latitude figure, then calculate rotation angle according to following formula, i.e., first jiao described
It spends (α, β, 0)：
α=90- θ,
In the case where needing to rotate, rotation angle uses the first angle (α, β, 0), rotates according to shown in Fig. 4 b
Mode is rotated, and the smallest region of motion vector value can be rotated to poles region.
Optionally, if the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector
Value is not less than the motion vector value thresholding, and the pole motion vector value is greater than the minimum movement vector of prearranged multiple
Value, it is determined that be first angle to the rotation angle.Although such case shows minimum movement, vector value is also larger, pole
Motion vector value is much larger than minimum movement vector value, therefore is also required to rotate the first angle, and motion vector value is the smallest
Region rotates to poles region.
Optionally, the prearranged multiple can be 8, but the embodiment of the present invention does not limit this, that is to say, that as long as energy
Enough show pole motion vector value much larger than minimum movement vector value.
Optionally, if the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector
Value is not less than the motion vector value thresholding, and the pole motion vector value is sweared no more than the minimum movement of prearranged multiple
Magnitude, it is determined that the rotation angle is 0.Such case shows that minimum movement vector value and pole motion vector value are all larger,
Pole motion vector value is not much larger than minimum movement vector value, therefore does not need to do and rotate.
540, according to the rotation angle, the described second default frame number image is rotated, is then encoded again.
Specifically, if the rotation angle is 0, without rotation；If the rotation angle is the first angle,
By first angle described in image rotation.It is encoded after rotation process, then to image.
Optionally, the rotation of 360 degree of panoramic videos and encoding operation can be executed all by encoder, can also respectively by
Different processing units executes.
Optionally, in one embodiment, it can be and first calculated before original video is sent into video encoder coding
Angle is rotated, rotation angle and original video are then sent into video encoder and encoded.Video is done by video encoder
It is re-encoded after rotation, in the angle write-in code stream that in an encoding process can rotate video, decoding end obtains rotation from code stream
The video come will be decoded after angle again to be rotated back.The video rotation angle information can be written into sequence head
(sequence header), image head (picture header), slice header (slice header), video parameter collection
(video parameter set, VPS), sequence parameter set (sequence parameter set, SPS), picture parameter set
(picture parameter set, PPS), supplemental enhancement information (Supplemental Enhancement
Information, SEI) or growth data (extension data) in.
Optionally, in another embodiment, it can be and first counted before original video is sent into video encoder coding
Rotation angle is calculated, then original video is done by the tool that can be rotated to video and is rotated, again by postrotational video
Video encoder is sent into be encoded.Since 360 degree of panoramic videos are watched with headset equipment or virtual reality products etc., depending on
Frequency will not influence the information that can be watched after rotation, it is possible to without being again rotated back decoded video.
Fig. 6 is the flow chart of the method for the Video coding of the embodiment of the present invention.It should be understood that Fig. 6 is only example, should not be understood
For the restriction to the embodiment of the present invention.
As shown in fig. 6, first judging whether to need to rotate before to 360 degree of panorama video codes.By calculating in image
The MV of CTU respectively obtains pole MV and minimum MV, and calculates rotation angle according to the corresponding position minimum MV.By by pole
MV and minimum MV, is compared with threshold value, judges whether to need to rotate, wherein can use according to the first default frame number figure
As obtained pole MV and minimum MV, determine whether the second default frame number image needs to rotate.If desired it rotates, then will accordingly scheme
Image rotation turns above-mentioned rotation angle, is then encoded again；If not needing to rotate, directly encoded.
The technical solution of the embodiment of the present invention obtains motion vector information by image-signal processor, is sweared according to movement
Information is measured, determines minimum movement vector value and pole motion vector value, and determine therefrom that the rotation angle of 360 degree of panoramic videos,
It can not need secondary coding and realize the rotary codings of 360 degree of panoramic videos, the compression effect of 360 degree of panoramic videos can be improved
Rate and coding quality, so as to improve the code efficiency of 360 degree of panoramic videos.
The method that the Video coding of the embodiment of the present invention has been described in detail above, is described below the embodiment of the present invention
The device and computer system of Video coding.
Fig. 7 shows the schematic block diagram of the device 700 of the Video coding of the embodiment of the present invention.The device 700 can be held
The method of the Video coding of the row embodiments of the present invention.
As shown in fig. 7, the device 700 may include：
Image-signal processor 710, the motion vector for obtaining the first default frame number image in 360 degree of panoramic videos are believed
Breath；
Processing unit 720, for determining minimum movement vector value and pole motion vector according to the motion vector information
Value, wherein the minimum movement vector value is the movement in the smallest region of motion vector value in the described first default frame number image
Vector value, the pole motion vector value are the two poles of the earth that 360 degree of panoramic videos are corresponded in the described first default frame number image
The motion vector value in region；And according to the minimum movement vector value, the pole motion vector value and motion vector
It is worth thresholding, determines the rotation angle of the second default frame number image in 360 degree of panoramic videos；
Rotary unit 730, for being rotated to the described second default frame number image according to the rotation angle；
Coding unit 740, for being encoded to postrotational image.
Optionally, the processing unit 720 is also used to：
The motion vector value thresholding is determined according to the motion search range of 360 degree of panoramic videos.
Optionally, described image signal processor is also used to：
Determine the motion search range.
Optionally, the motion vector information of the described first default frame number image is the described in described image signal processor
The local motion vector or global motion vector of one default frame number image.
Optionally, the described first default frame number image is default after the first random point of penetration of 360 panoramic video
The image of frame number.
Optionally, the described second default frame number image is the described first random point of penetration of 360 panoramic video to the
The image of default frame number between two random points of penetration, wherein the second random point of penetration is the described first random point of penetration
Next random point of penetration.
Optionally, the described first default frame number is less than or equal to the described second default frame number.
Optionally, the processing unit 720 is specifically used for：
If the pole motion vector value is less than the motion vector value thresholding, it is determined that the rotation angle is 0；Or
Person,
If the pole motion vector value is not less than the motion vector value thresholding, and the minimum movement vector value is less than
The motion vector value thresholding, it is determined that be first angle to the rotation angle；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector value is not less than
The motion vector value thresholding, and the pole motion vector value is greater than the minimum movement vector value of prearranged multiple, then really
Fixed is first angle to the rotation angle；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector value is not less than
The motion vector value thresholding, and the pole motion vector value is not more than the minimum movement vector value of prearranged multiple, then
Determine that the rotation angle is 0；
Wherein, the first angle is the position according to the smallest region of motion vector value in the described first default frame number image
Set determining angle.
Optionally, the prearranged multiple is 8.
Optionally, the processing unit 720 is also used to：
According to the position in the smallest region of motion vector value in the described first default frame number image, described first jiao is determined
Degree.
Optionally, the minimum movement vector value is the image block that same position is corresponded in the described first default frame number image
Motion vector value average value in minimum value, wherein described image block includes multiple pixels.
Optionally, described image block includes multiple tree-like unit CTU of coding, and the motion vector value of described image block is described
The average value of the motion vector value of multiple CTU, wherein the motion vector value of each CTU is all pixels point of each CTU
Motion vector horizontal component absolute value and the sum of the absolute value of vertical component.
Optionally, above-mentioned rotary unit 730 and coding unit 740 can be realized all by encoder, can also be implemented separately,
For example, rotary unit 730 is by that can realize the tool that video is rotated, coding unit 740 is realized by encoder.
It should be understood that the device of the Video coding of the embodiments of the present invention can be chip, it specifically can be by circuit reality
It is existing, but the embodiment of the present invention to concrete implementation form without limitation.
Fig. 8 shows the schematic block diagram of the computer system 800 of the embodiment of the present invention.
As shown in figure 8, the computer system 800 may include processor 810 and memory 820.
It should be understood that the computer system 800 can also include component usually included in other computer systems, example
Such as, input-output equipment, communication interface etc., the embodiment of the present invention does not limit this.
Memory 820 is for storing computer executable instructions.
Memory 820 can be various memories, such as may include high-speed random access memory (Random
Access Memory, RAM), can also include non-labile memory (non-volatile memory), for example, at least one
A magnetic disk storage, the embodiment of the present invention do not limit this.
Processor 810 executes the computer executable instructions for accessing the memory 820, to carry out above-mentioned hair
Operation in the method for the Video coding of bright embodiment.
Processor 810 may include microprocessor, field programmable gate array (Field-Programmable Gate
Array, FPGA), central processing unit (Central Processing unit, CPU), graphics processor (Graphics
Processing Unit, GPU) etc., the embodiment of the present invention does not limit this.
The video that the device and computer system of the Video coding of the embodiment of the present invention can correspond to the embodiment of the present invention is compiled
The executing subject of the method for code, and above and other operation of the modules in the device and computer system of Video coding
And/or function is respectively in order to realize the corresponding process of aforementioned each method, for sake of simplicity, details are not described herein.
The embodiment of the invention also provides a kind of electronic equipment, which may include the various implementations of aforementioned present invention
The device or computer system of the Video coding of example.
The embodiment of the invention also provides a kind of computer storage medium, program generation is stored in the computer storage medium
Code, the program code can serve to indicate that the method for executing the Video coding of the embodiments of the present invention.
It should be understood that in embodiments of the present invention, term "and/or" is only a kind of incidence relation for describing affiliated partner,
Indicate may exist three kinds of relationships.For example, A and/or B, can indicate：Individualism A, exists simultaneously A and B, individualism B this
Three kinds of situations.In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware
With the interchangeability of software, each exemplary composition and step are generally described according to function in the above description.This
A little functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Specially
Industry technical staff can use different methods to achieve the described function each specific application, but this realization is not
It is considered as beyond the scope of this invention.
It is apparent to those skilled in the art that for convenience of description and succinctly, foregoing description is
The specific work process of system, device and unit, can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.In addition, shown or beg for
Opinion mutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING of device or unit
Or communication connection, it is also possible to electricity, mechanical or other form connections.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.Some or all of unit therein can be selected to realize the embodiment of the present invention according to the actual needs
Purpose.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, is also possible to two or more units and is integrated in one unit.It is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the present invention
Portion or part steps.And storage medium above-mentioned includes：USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace
It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with right
It is required that protection scope subject to.
Claims (25)
1. a kind of method of Video coding, which is characterized in that including：
The motion vector information of the first default frame number image in 360 degree of panoramic videos is obtained by image-signal processor；
According to the motion vector information, minimum movement vector value and pole motion vector value are determined, wherein the minimum movement
Vector value is the motion vector value in the smallest region of motion vector value in the described first default frame number image, the pole movement arrow
Magnitude is the motion vector value that the two poles of the earth region of 360 degree of panoramic videos is corresponded in the described first default frame number image；
According to the minimum movement vector value, the pole motion vector value and motion vector value thresholding, described 360 are determined
Spend the rotation angle of the second default frame number image in panoramic video；
According to the rotation angle, the described second default frame number image is rotated, is then encoded again.
2. the method according to claim 1, wherein the method also includes：
The motion vector value thresholding is determined according to the motion search range of 360 degree of panoramic videos.
3. according to the method described in claim 2, it is characterized in that, the method also includes：
The motion search range is determined by described image signal processor.
4. according to the method in any one of claims 1 to 3, which is characterized in that the fortune of the first default frame number image
Dynamic vector information is the local motion vector or global motion of the first default frame number image described in described image signal processor
Vector.
5. method according to claim 1 to 4, which is characterized in that the first default frame number image is institute
The image of default frame number after stating the first random point of penetration of 360 panoramic videos.
6. according to the method described in claim 5, it is characterized in that, the second default frame number image is 360 aphorama
Image of the described first random point of penetration of frequency to the default frame number between the second random point of penetration, wherein described second is random
Point of penetration is next random point of penetration of the described first random point of penetration.
7. method according to any one of claim 1 to 6, which is characterized in that the first default frame number is less than or waits
In the described second default frame number.
8. method according to any one of claim 1 to 7, which is characterized in that described according to the minimum movement vector
Value, the pole motion vector value and motion vector value thresholding, determine the second default frame number in 360 degree of panoramic videos
The rotation angle of image, including：
If the pole motion vector value is less than the motion vector value thresholding, it is determined that the rotation angle is 0；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, and the minimum movement vector value is less than described
Motion vector value thresholding, it is determined that be first angle to the rotation angle；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector value is not less than described
Motion vector value thresholding, and the pole motion vector value is greater than the minimum movement vector value of prearranged multiple, it is determined that it is right
The rotation angle is first angle；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector value is not less than described
Motion vector value thresholding, and the pole motion vector value is not more than the minimum movement vector value of prearranged multiple, it is determined that
The rotation angle is 0；
Wherein, the first angle is true according to the position in the smallest region of motion vector value in the described first default frame number image
Fixed angle.
9. according to the method described in claim 8, it is characterized in that, the prearranged multiple is 8.
10. method according to claim 8 or claim 9, which is characterized in that the method also includes：
According to the position in the smallest region of motion vector value in the described first default frame number image, the first angle is determined.
11. method according to any one of claim 1 to 10, which is characterized in that the minimum movement vector value is institute
State the minimum value in the average value for corresponding to the motion vector value of image block of same position in the first default frame number image, wherein
Described image block includes multiple pixels.
12. according to the method for claim 11, which is characterized in that described image block includes multiple tree-like unit CTU of coding,
The motion vector value of described image block is the average value of the motion vector value of the multiple CTU, wherein the movement of each CTU is sweared
Magnitude be each CTU all pixels point motion vector horizontal component absolute value and vertical component absolute value it
With.
13. a kind of device of Video coding, which is characterized in that including：
Image-signal processor, for obtaining the motion vector information of the first default frame number image in 360 degree of panoramic videos；
Processing unit, for determining minimum movement vector value and pole motion vector value according to the motion vector information,
In, the minimum movement vector value is the motion vector in the smallest region of motion vector value in the described first default frame number image
Value, the pole motion vector value are the two poles of the earth region that 360 degree of panoramic videos are corresponded in the described first default frame number image
Motion vector value；And according to the minimum movement vector value, the pole motion vector value and motion vector value door
Limit, determines the rotation angle of the second default frame number image in 360 degree of panoramic videos；
Rotary unit, for being rotated to the described second default frame number image according to the rotation angle；
Coding unit, for being encoded to postrotational image.
14. device according to claim 13, which is characterized in that the processing unit is also used to：
The motion vector value thresholding is determined according to the motion search range of 360 degree of panoramic videos.
15. device according to claim 14, which is characterized in that described image signal processor is also used to：
Determine the motion search range.
16. device described in any one of 3 to 15 according to claim 1, which is characterized in that the first default frame number image
Motion vector information is the local motion vector or overall situation fortune of the first default frame number image described in described image signal processor
Dynamic vector.
17. device described in any one of 3 to 16 according to claim 1, which is characterized in that the first default frame number image is
The image of default frame number after first random point of penetration of 360 panoramic video.
18. device according to claim 17, which is characterized in that the second default frame number image is 360 panorama
Image of the described first random point of penetration of video to the default frame number between the second random point of penetration, wherein described second with
Machine-cut access point is next random point of penetration of the described first random point of penetration.
19. device described in any one of 3 to 18 according to claim 1, which is characterized in that the first default frame number be less than or
Equal to the described second default frame number.
20. device described in any one of 3 to 19 according to claim 1, which is characterized in that the processing unit is specifically used for：
If the pole motion vector value is less than the motion vector value thresholding, it is determined that the rotation angle is 0；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, and the minimum movement vector value is less than described
Motion vector value thresholding, it is determined that be first angle to the rotation angle；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector value is not less than described
Motion vector value thresholding, and the pole motion vector value is greater than the minimum movement vector value of prearranged multiple, it is determined that it is right
The rotation angle is first angle；Alternatively,
If the pole motion vector value is not less than the motion vector value thresholding, the minimum movement vector value is not less than described
Motion vector value thresholding, and the pole motion vector value is not more than the minimum movement vector value of prearranged multiple, it is determined that
The rotation angle is 0；
Wherein, the first angle is true according to the position in the smallest region of motion vector value in the described first default frame number image
Fixed angle.
21. device according to claim 20, which is characterized in that the prearranged multiple is 8.
22. the device according to claim 20 or 21, which is characterized in that the processing unit is also used to：
According to the position in the smallest region of motion vector value in the described first default frame number image, the first angle is determined.
23. device described in any one of 3 to 22 according to claim 1, which is characterized in that the minimum movement vector value is institute
State the minimum value in the average value for corresponding to the motion vector value of image block of same position in the first default frame number image, wherein
Described image block includes multiple pixels.
24. device according to claim 23, which is characterized in that described image block includes multiple tree-like unit CTU of coding,
The motion vector value of described image block is the average value of the motion vector value of the multiple CTU, wherein the movement of each CTU is sweared
Magnitude be each CTU all pixels point motion vector horizontal component absolute value and vertical component absolute value it
With.
25. a kind of computer system, which is characterized in that including：
Memory, for storing computer executable instructions；
Processor for accessing the memory, and executes the computer executable instructions, to carry out according to claim 1
Operation into method described in any one of 12.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/119000 WO2019127100A1 (en) | 2017-12-27 | 2017-12-27 | Video coding method, device, and computer system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108886616A true CN108886616A (en) | 2018-11-23 |
Family
ID=64325696
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780018384.1A Pending CN108886616A (en) | 2017-12-27 | 2017-12-27 | The method, apparatus and computer system of Video coding |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108886616A (en) |
| WO (1) | WO2019127100A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111294648A (en) * | 2020-02-20 | 2020-06-16 | 成都纵横自动化技术股份有限公司 | Unmanned aerial vehicle air-ground video transmission method |
| CN112367486A (en) * | 2020-10-30 | 2021-02-12 | 维沃移动通信有限公司 | Video processing method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017120776A1 (en) * | 2016-01-12 | 2017-07-20 | Shanghaitech University | Calibration method and apparatus for panoramic stereo video system |
| CN107135397A (en) * | 2017-04-28 | 2017-09-05 | 中国科学技术大学 | A kind of panorama video code method and apparatus |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8437538B2 (en) * | 2009-09-29 | 2013-05-07 | Peking University | Volumetric image data processing |
| CN104063843B (en) * | 2014-06-18 | 2017-07-28 | 长春理工大学 | A kind of method of the integrated three-dimensional imaging element image generation based on central projection |
| US9277122B1 (en) * | 2015-08-13 | 2016-03-01 | Legend3D, Inc. | System and method for removing camera rotation from a panoramic video |
-
2017
- 2017-12-27 CN CN201780018384.1A patent/CN108886616A/en active Pending
- 2017-12-27 WO PCT/CN2017/119000 patent/WO2019127100A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017120776A1 (en) * | 2016-01-12 | 2017-07-20 | Shanghaitech University | Calibration method and apparatus for panoramic stereo video system |
| CN107135397A (en) * | 2017-04-28 | 2017-09-05 | 中国科学技术大学 | A kind of panorama video code method and apparatus |
Non-Patent Citations (2)
| Title |
|---|
| JILL BOYCE ET AL: "Spherical rotation orientation SEI for HEVC and AVC coding of 360 video", 《JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG16 WP3 AND ISO/IEC JTC1/SC29/WG11 26TH MEETING: GENEVA, CH》 * |
| 林畅等: "全景视频双环带映射算法", 《计算机应用》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111294648A (en) * | 2020-02-20 | 2020-06-16 | 成都纵横自动化技术股份有限公司 | Unmanned aerial vehicle air-ground video transmission method |
| CN112367486A (en) * | 2020-10-30 | 2021-02-12 | 维沃移动通信有限公司 | Video processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019127100A1 (en) | 2019-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11290682B1 (en) | Background modification in video conferencing | |
| JP7069111B2 (en) | Methods and equipment for processing 3D images | |
| CN110892453B (en) | Point cloud and grid compression using image/video codec | |
| CN109644279B (en) | Method and system for signaling 360 degree video information | |
| US10467775B1 (en) | Identifying pixel locations using a transformation function | |
| US20190191170A1 (en) | System and method for improving efficiency in encoding/decoding a curved view video | |
| US9232189B2 (en) | Background modification in video conferencing | |
| CN111316331A (en) | Point cloud compression using non-orthogonal projection | |
| KR102527816B1 (en) | Method and apparatus of processing virtual reality image | |
| CN109478312A (en) | A kind of method and device of coding and decoding video | |
| CN110036640B (en) | System and method for supporting video bitstream switching | |
| TW201916685A (en) | Method and apparatus for rearranging vr video format and constrained encoding parameters | |
| TWI673681B (en) | Video processing apparatus using one or both of reference frame re-rotation and content-oriented rotation selection and associated video processing method | |
| JP6899443B2 (en) | Processing equirectangular object data to compensate for distortion due to spherical projection | |
| CN107945101B (en) | Image processing method and device | |
| US11721044B2 (en) | Method and apparatus for decoding three-dimensional scenes | |
| EP3434021B1 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| CN110769323A (en) | Video communication method, system, device and terminal equipment | |
| CN109783658A (en) | Image processing method, device and storage medium | |
| CN108886616A (en) | The method, apparatus and computer system of Video coding | |
| US20210150665A1 (en) | Image processing method and device | |
| CN105187794B (en) | A kind of video monitoring system and the extensive dispatching method of video | |
| CN109496429A (en) | Method for video coding, video encoding/decoding method and relevant apparatus | |
| US11915373B1 (en) | Attribute value compression for a three-dimensional mesh using geometry information to guide prediction | |
| Hu et al. | Low Latency Point Cloud Rendering with Learned Splatting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |