CN109922342A - Panoramic video coding/decoding method and device - Google Patents

Panoramic video coding/decoding method and device Download PDF

Info

Publication number
CN109922342A
CN109922342A CN201910237726.XA CN201910237726A CN109922342A CN 109922342 A CN109922342 A CN 109922342A CN 201910237726 A CN201910237726 A CN 201910237726A CN 109922342 A CN109922342 A CN 109922342A
Authority
CN
China
Prior art keywords
coordinate range
present frame
panoramic video
rotation
terminal device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910237726.XA
Other languages
Chinese (zh)
Inventor
刘俊成
徐昊
凌康
顾思斌
潘柏宇
王冀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Chuanxian Network Technology Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chuanxian Network Technology Shanghai Co Ltd filed Critical Chuanxian Network Technology Shanghai Co Ltd
Priority to CN201910237726.XA priority Critical patent/CN109922342A/en
Publication of CN109922342A publication Critical patent/CN109922342A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/282Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/527Global motion vector estimation

Abstract

The present invention relates to panoramic video coding/decoding method and devices.This method comprises: determining that user watches the coordinate range of the regional area of the present frame of panoramic video;It is decoded according to regional area of the coordinate range to the present frame, obtains the corresponding decoding data of the present frame;The present frame is played according to the coordinate range and the decoding data.By determining that user watches the coordinate range of the regional area of the present frame of panoramic video, it is decoded according to regional area of the coordinate range to present frame, obtain the corresponding decoding data of present frame, and present frame is played according to the coordinate range and decoding data, panoramic video coding/decoding method and device according to the present invention can save decoding resource, the decoding performance for helping to improve equipment can reduce the requirement to the computing capability of equipment.

Description

Panoramic video coding/decoding method and device
The application be on October 24th, 2016 applying date, application No. is 201610927275.9, invention and created names to be The divisional application of the application of panoramic video coding/decoding method and device.
Technical field
The present invention relates to video technique field more particularly to a kind of panoramic video coding/decoding methods and device.
Background technique
In the related technology, when being decoded to panoramic video, the whole of panoramic video data to be decoded are decoded, The corresponding decoding data of various pieces of panoramic video is obtained, further according to the part of the viewing visual angle playing panoramic video of user. Due to only watching the part of panoramic video when user watches panoramic video, the whole of panoramic video data to be decoded are carried out Decoding can cause to waste to decoding resource.
Summary of the invention
Technical problem
In view of this, the technical problem to be solved by the present invention is to panoramic video decoding technique causes to waste to decoding resource.
Solution
In order to solve the above-mentioned technical problem, an embodiment according to the present invention provides a kind of panoramic video coding/decoding method, Include:
Determine that user watches the coordinate range of the regional area of the present frame of panoramic video;
It is decoded according to regional area of the coordinate range to the present frame, obtains the corresponding solution of the present frame Code data;
The present frame is played according to the coordinate range and the decoding data.
For the above method, in one possible implementation, according to the coordinate range to the office of the present frame Portion region is decoded, and obtains the corresponding decoding data of the present frame, comprising:
All pixels in coordinate range described in the present frame are decoded, and are sat to described in the present frame All pixels outside mark range are filled processing, obtain the corresponding decoding data of the present frame.
For the above method, in one possible implementation, to coordinate range described in the present frame outside institute There is pixel to be filled processing, comprising:
To 0 filling of all pixels outside coordinate range described in the present frame.
For the above method, in one possible implementation, determine that user watches the office of the present frame of panoramic video The coordinate range in portion region, comprising:
Obtain the current pose and initial attitude of terminal device;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and the initial attitude;
The user is determined according to the corresponding coordinate range of the initial attitude, the direction of rotation and the rotation angle Watch the coordinate range of the regional area of the present frame.
For the above method, in one possible implementation, determine that user watches the office of the present frame of panoramic video The coordinate range in portion region, comprising:
The current pose of acquisition terminal device and a upper posture;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and a upper posture;
The user is determined according to the corresponding coordinate range of the upper posture, the direction of rotation and the rotation angle Watch the coordinate range of the regional area of the present frame.
In order to solve the above-mentioned technical problem, according to another embodiment of the present invention, a kind of panoramic video decoding dress is provided It sets, comprising:
Coordinate range determining module, for determining that user watches the coordinate model of the regional area of the present frame of panoramic video It encloses;
Decoder module obtains described for being decoded according to regional area of the coordinate range to the present frame The corresponding decoding data of present frame;
Playing module, for playing the present frame according to the coordinate range and the decoding data.
For above-mentioned apparatus, in one possible implementation, the decoder module is used for:
All pixels in coordinate range described in the present frame are decoded, and are sat to described in the present frame All pixels outside mark range are filled processing, obtain the corresponding decoding data of the present frame.
For above-mentioned apparatus, in one possible implementation, the decoder module is used for:
To 0 filling of all pixels outside coordinate range described in the present frame.
For above-mentioned apparatus, in one possible implementation, the coordinate range determining module includes:
First posture acquisition submodule, for obtaining the current pose and initial attitude of terminal device;
First direction of rotation and angle determine submodule, for being determined according to the current pose and the initial attitude The direction of rotation of the terminal device and rotation angle;
First coordinate range determines submodule, for according to the corresponding coordinate range of the initial attitude, the rotation side Determine that the user watches the coordinate range of the regional area of the present frame to the rotation angle.
For above-mentioned apparatus, in one possible implementation, the coordinate range determining module includes:
Second posture acquisition submodule, for obtain terminal device current pose and a upper posture;
Second direction of rotation and angle determine submodule, for being determined according to the current pose and a upper posture The direction of rotation of the terminal device and rotation angle;
Second coordinate range determines submodule, for according to the corresponding coordinate range of the upper posture, the rotation side Determine that the user watches the coordinate range of the regional area of the present frame to the rotation angle.
Beneficial effect
By determining that user watches the coordinate range of the regional area of the present frame of panoramic video, according to the coordinate range pair The regional area of present frame is decoded, and obtains the corresponding decoding data of present frame, and according to the coordinate range and solution yardage According to present frame is played, panoramic video coding/decoding method and device according to an embodiment of the present invention can save decoding resource, facilitate The decoding performance for improving equipment, can reduce the requirement to the computing capability of equipment.
According to below with reference to the accompanying drawings becoming to detailed description of illustrative embodiments, other feature of the invention and aspect It is clear.
Detailed description of the invention
Comprising in the description and constitute the attached drawing of part of specification and specification together illustrate it is of the invention Exemplary embodiment, feature and aspect, and principle for explaining the present invention.
Fig. 1 shows the flow chart of panoramic video coding/decoding method according to an embodiment of the invention;
Fig. 2 shows an illustrative processes of step S11 in panoramic video coding/decoding method according to an embodiment of the invention Figure;
Fig. 3 shows the stream of the another exemplary of step S11 in panoramic video coding/decoding method according to an embodiment of the invention Cheng Tu;
Fig. 4 shows the structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention;
Fig. 5 shows an illustrative structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention;
Fig. 6 shows a kind of structural block diagram of panoramic video decoding device of another embodiment of the invention.
Specific embodiment
Below with reference to attached drawing various exemplary embodiments, feature and the aspect that the present invention will be described in detail.It is identical in attached drawing Appended drawing reference indicate element functionally identical or similar.Although the various aspects of embodiment are shown in the attached drawings, remove It non-specifically points out, it is not necessary to attached drawing drawn to scale.
Dedicated word " exemplary " means " being used as example, embodiment or illustrative " herein.Here as " exemplary " Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, in order to better illustrate the present invention, numerous details is given in specific embodiment below. It will be appreciated by those skilled in the art that without certain details, the present invention equally be can be implemented.In some instances, for Method, means, element and circuit well known to those skilled in the art are not described in detail, in order to highlight purport of the invention.
Embodiment 1
Fig. 1 shows the flow chart of panoramic video coding/decoding method according to an embodiment of the invention.The execution master of the present embodiment Body can be mobile phone, tablet computer, laptop or PC (Personal Computer, PC) etc., not make herein It limits.As shown in Figure 1, this method specifically includes that
In step s 11, determine that user watches the coordinate range of the regional area of the present frame of panoramic video.
Wherein, panoramic video can be more than the video of the normal viewing angle of user for visual angle.For example, panoramic video can be water The video at 360 degree of angle, vertical angle of view 180 degree is looked squarely, in this case, each frame of panoramic video may map to a spherical surface On.Since the visual angle of panoramic video is more than the normal viewing angle of user, user is when watching each frame of panoramic video, often The secondary regional area that can only see each frame.For example, user is watching panorama by handheld devices such as mobile phone or tablet computers During video, panoramic video, Huo Zheke can be watched by rotation mobile phone or each visual angle of tablet computer unrestricted choice To watch panoramic video by each visual angle of virtual key unrestricted choice on mobile phone or tablet computer.For another example user exists It perhaps can be by laptop or PC during the terminal devices such as PC watch panoramic video by laptop Physical button or each visual angle of virtual key unrestricted choice watch panoramic video.
In the present embodiment, before the present frame to panoramic video is decoded, determine that user watches panoramic video The coordinate range of the regional area of present frame.Wherein, the present frame of panoramic video can be the frame that will be played of panoramic video. In the present embodiment, the changing coordinates range that user watches panoramic video can be determined as user and watches the current of panoramic video The coordinate range of the regional area of frame.For example, can determine shown work as in real time during user watches panoramic video Preceding coordinate range, to determine that user watches the regional area of the present frame of panoramic video according to shown changing coordinates range Coordinate range.
In step s 12, it is decoded according to regional area of the coordinate range to present frame, it is corresponding to obtain present frame Decoding data.
As an example of the present embodiment, only all pixels in the coordinate range can be decoded, worked as The corresponding decoding data of previous frame, so as to farthest save decoding resource and improve the decoding performance of equipment.
As another example of the present embodiment, the geometric center of the coordinate range can be determined, by a geometric center left side 90 degree of LOOK RIGHT, 90 degree of upper downwards angle of visibility coordinate range be determined as the first coordinate range, and to all in the first coordinate range Pixel is decoded, and obtains the corresponding decoding data of present frame.
As another example of the present embodiment, the regional area of the present frame of panoramic video can be watched according to user Coordinate range determines the second coordinate range, wherein the second coordinate range includes the part that user watches the present frame of panoramic video The coordinate range in region, and the second coordinate range is greater than the coordinate model of the regional area of the present frame of user's viewing panoramic video It encloses.Wherein, the second coordinate range can watch the coordinate range of the regional area of the present frame of panoramic video, example slightly larger than user Such as, the second coordinate range can watch the 1.3 of the area of the coordinate range of the regional area of the present frame of panoramic video for user Times.Can not only save according to the example decoding resource, improve equipment decoding performance, moreover it is possible to user change viewing visual angle and In the case that viewing visual angle after change is still correspond to the second coordinate range, normal play present frame.
In step s 13, present frame is played according to the coordinate range and decoding data.
In the present embodiment, decoding data mapped according to the coordinate range, be rendered on screen.
Panoramic video coding/decoding method according to an embodiment of the present invention can save decoding resource, help to improve the solution of equipment Code performance can reduce the requirement to the computing capability of equipment.For example, if being only decoded to the pixel of half in every frame, The calculation amount that one times can be reduced saves the decoding resource of half, promotes one times of decoding performance.
In one possible implementation, it is decoded, is obtained according to regional area of the coordinate range to present frame The corresponding decoding data of present frame, comprising: all pixels in present frame in the coordinate range are decoded, and to present frame In all pixels outside the coordinate range be filled processing, obtain the corresponding decoding data of present frame.
In one possible implementation, processing is filled to all pixels in present frame outside the coordinate range, It include: to 0 filling of all pixels in present frame outside the coordinate range.For example, in present frame outside the coordinate range All pixels are filled with 0x00000000.
Fig. 2 shows an illustrative processes of step S11 in panoramic video coding/decoding method according to an embodiment of the invention Figure.As shown in Fig. 2, determining that user watches the coordinate range of the regional area of the present frame of panoramic video, comprising:
In the step s 21, the current pose and initial attitude of terminal device are obtained.
In this example, it can be obtained when starting to play the panoramic video by gyroscope or other motion sensors The initial attitude of terminal device is taken, and records the initial attitude of terminal device.During user watches panoramic video, may be used also The current pose of terminal device is obtained to pass through gyroscope or other motion sensors in real time.For example, terminal device is current Posture can be the current value of gyroscope, and the initial attitude of terminal device can be the initial value of gyroscope.
In step S22, direction of rotation and the rotation angle of terminal device are determined according to current pose and initial attitude.
It, can be with for example, according to the current value and initial value of gyroscope according to the current pose and initial attitude of terminal device The direction of rotation of computing terminal equipment and rotation angle.
In step S23, determine that user watches according to the corresponding coordinate range of initial attitude, direction of rotation and rotation angle The coordinate range of the regional area of present frame.
Fig. 3 shows the stream of the another exemplary of step S11 in panoramic video coding/decoding method according to an embodiment of the invention Cheng Tu.As shown in figure 3, determining that user watches the coordinate range of the regional area of the present frame of panoramic video, comprising:
In step S31, obtain terminal device current pose and a upper posture.
In this example, gyroscope or other movements can be passed through in real time during user watches panoramic video The current pose of sensor acquisition terminal device.For example, the current pose of terminal device can be the current value of gyroscope, terminal A upper posture for equipment can be a upper value for gyroscope.
In step s 32, direction of rotation and the rotation angle of terminal device are determined according to current pose and a upper posture.
It, can be with for example, according to the current value of gyroscope and a upper value according to the current pose of terminal device and a upper posture The direction of rotation of computing terminal equipment and rotation angle.
In step S33, determine that user watches according to the corresponding coordinate range of a upper posture, direction of rotation and rotation angle The coordinate range of the regional area of present frame.
In this way, by determining that user watches the coordinate range of the regional area of the present frame of panoramic video, according to the coordinate Range is decoded the regional area of present frame, obtains the corresponding decoding data of present frame, and according to the coordinate range and Decoding data plays present frame, and panoramic video coding/decoding method according to an embodiment of the present invention can save decoding resource, facilitate The decoding performance for improving equipment, can reduce the requirement to the computing capability of equipment.
Embodiment 2
Fig. 4 shows the structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention.Fig. 4 can be used for transporting Row panoramic video coding/decoding method shown in FIG. 1.For ease of description, only the parts related to this embodiment are shown in Fig. 4.
As shown in figure 4, the panoramic video decoding apparatus includes: coordinate range determining module 41, for determining that user watches The coordinate range of the regional area of the present frame of panoramic video;Decoder module 42, for being worked as according to the coordinate range to described The regional area of previous frame is decoded, and obtains the corresponding decoding data of the present frame;Playing module 43, for according to the seat It marks range and the decoding data plays the present frame.
Fig. 5 shows an illustrative structural block diagram of panoramic video decoding apparatus according to another embodiment of the present invention.Fig. 5 It can be used for running Fig. 1 to panoramic video coding/decoding method shown in Fig. 3.For ease of description, it is illustrated only and this reality in Fig. 5 Apply the relevant part of example.Label component function having the same identical with Fig. 4 in Fig. 5 is omitted to these groups for simplicity The detailed description of part.Referring to Fig. 5:
In one possible implementation, the decoder module 42 is used for: to coordinate range described in the present frame Interior all pixels are decoded, and are filled processing to all pixels outside coordinate range described in the present frame, are obtained To the corresponding decoding data of the present frame.
In one possible implementation, the decoder module 42 is used for: to coordinate range described in the present frame 0 filling of outer all pixels.
In one possible implementation, the coordinate range determining module 41 includes: the first posture acquisition submodule 411, for obtaining the current pose and initial attitude of terminal device;First direction of rotation and angle determine submodule 412, use In the direction of rotation and rotation angle that determine the terminal device according to the current pose and the initial attitude;First sits Range determination submodule 413 is marked, for according to the corresponding coordinate range of the initial attitude, the direction of rotation and the rotation Angle determines that the user watches the coordinate range of the regional area of the present frame.
In one possible implementation, the coordinate range determining module 41 includes: the second posture acquisition submodule 414, for obtain terminal device current pose and a upper posture;Second direction of rotation and angle determine submodule 415, use In the direction of rotation and rotation angle that determine the terminal device according to the current pose and a upper posture;Second sits Range determination submodule 416 is marked, for according to the corresponding coordinate range of the upper posture, the direction of rotation and the rotation Angle determines that the user watches the coordinate range of the regional area of the present frame.
It should be noted that in this way, by determining that user watches the coordinate model of the regional area of the present frame of panoramic video It encloses, is decoded according to regional area of the coordinate range to present frame, obtain the corresponding decoding data of present frame, and according to this Coordinate range and decoding data play present frame, and panoramic video decoding apparatus according to an embodiment of the present invention can save decoding Resource helps to improve the decoding performance of equipment, can reduce the requirement to the computing capability of equipment.
Embodiment 3
Fig. 6 shows a kind of structural block diagram of panoramic video decoding device of another embodiment of the invention.It is described complete Scape video decoding apparatus 1100 can be the host server for having computing capability, personal computer PC or it is portable just Take formula computer or terminal etc..The specific embodiment of the invention does not limit the specific implementation of calculate node.
The panoramic video decoding device 1100 includes processor (processor) 1110, communication interface (Communications Interface) 1120, memory (memory) 1130 and bus 1140.Wherein, processor 1110, Communication interface 1120 and memory 1130 pass through bus 1140 and complete mutual communication.
Communication interface 1120 is used for and network device communications, and wherein the network equipment includes such as Virtual Machine Manager center, is total to Enjoy storage etc..
Processor 1110 is for executing program.Processor 1110 may be a central processor CPU or dedicated collection At circuit ASIC (Application Specific Integrated Circuit), or it is arranged to implement the present invention One or more integrated circuits of embodiment.
Memory 1130 is for storing file.Memory 1130 may include high speed RAM memory, it is also possible to further include non- Volatile memory (non-volatile memory), for example, at least a magnetic disk storage.Memory 1130 is also possible to deposit Memory array.Memory 1130 is also possible to by piecemeal, and described piece can be combined into virtual volume by certain rule.
In a kind of possible embodiment, above procedure can be the program code for including computer operation instruction.The journey Sequence is particularly used in: realizing the operation of each step in embodiment 1.
Those of ordinary skill in the art may be aware that each exemplary cell and algorithm in embodiment described herein Step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions actually with hardware also It is software form to realize, the specific application and design constraint depending on technical solution.Professional technician can be directed to It is specific that described function is realized using different methods is selected, but this realization is it is not considered that exceed model of the invention It encloses.
If realizing the function and when sold or used as an independent product in the form of computer software, To a certain extent it is believed that all or part (such as the part that contributes to existing technology) of technical solution of the present invention is It embodies in form of a computer software product.The computer software product is generally stored inside computer-readable non-volatile In storage medium, including some instructions are used so that computer equipment (can be personal computer, server or network to set It is standby etc.) execute all or part of the steps of various embodiments of the present invention method.And storage medium above-mentioned include USB flash disk, mobile hard disk, Read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic The various media that can store program code such as dish or CD.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (6)

1. a kind of panoramic video coding/decoding method characterized by comprising
The changing coordinates range that user watches the panoramic video is determined as the part that user watches the present frame of panoramic video The coordinate range in region;
Only all pixels in coordinate range described in the present frame are decoded, and to coordinate described in the present frame 0 filling of all pixels outside range, obtains the corresponding decoding data of the present frame, wherein not to institute in the present frame The pixel stated outside coordinate range is decoded;
The present frame is played according to the coordinate range and the decoding data.
2. the method according to claim 1, wherein determining that user watches the partial zones of the present frame of panoramic video The coordinate range in domain, comprising:
Obtain the current pose and initial attitude of terminal device;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and the initial attitude;
User's viewing is determined according to the corresponding coordinate range of the initial attitude, the direction of rotation and the rotation angle The coordinate range of the regional area of the present frame.
3. the method according to claim 1, wherein determining that user watches the partial zones of the present frame of panoramic video The coordinate range in domain, comprising:
The current pose of acquisition terminal device and a upper posture;
Direction of rotation and the rotation angle of the terminal device are determined according to the current pose and a upper posture;
User's viewing is determined according to the corresponding coordinate range of the upper posture, the direction of rotation and the rotation angle The coordinate range of the regional area of the present frame.
4. a kind of panoramic video decoding apparatus characterized by comprising
Coordinate range determining module, it is complete that the changing coordinates range for user to be watched to the panoramic video is determined as user's viewing The coordinate range of the regional area of the present frame of scape video;
Decoder module for being only decoded to all pixels in coordinate range described in the present frame, and is worked as to described 0 filling of all pixels outside coordinate range described in previous frame, obtains the corresponding decoding data of the present frame, wherein not right Pixel outside coordinate range described in the present frame is decoded;
Playing module, for playing the present frame according to the coordinate range and the decoding data.
5. device according to claim 4, which is characterized in that the coordinate range determining module includes:
First posture acquisition submodule, for obtaining the current pose and initial attitude of terminal device;
First direction of rotation and angle determine submodule, for according to the current pose and initial attitude determination The direction of rotation of terminal device and rotation angle;
First coordinate range determines submodule, for according to the corresponding coordinate range of the initial attitude, the direction of rotation and The rotation angle determines that the user watches the coordinate range of the regional area of the present frame.
6. device according to claim 4, which is characterized in that the coordinate range determining module includes:
Second posture acquisition submodule, for obtain terminal device current pose and a upper posture;
Second direction of rotation and angle determine submodule, for according to the current pose and the upper posture determination The direction of rotation of terminal device and rotation angle;
Second coordinate range determines submodule, for according to the corresponding coordinate range of the upper posture, the direction of rotation and The rotation angle determines that the user watches the coordinate range of the regional area of the present frame.
CN201910237726.XA 2016-10-24 2016-10-24 Panoramic video coding/decoding method and device Pending CN109922342A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910237726.XA CN109922342A (en) 2016-10-24 2016-10-24 Panoramic video coding/decoding method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910237726.XA CN109922342A (en) 2016-10-24 2016-10-24 Panoramic video coding/decoding method and device
CN201610927275.9A CN106454314A (en) 2016-10-24 2016-10-24 Panoramic video decoding method and device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201610927275.9A Division CN106454314A (en) 2016-10-24 2016-10-24 Panoramic video decoding method and device

Publications (1)

Publication Number Publication Date
CN109922342A true CN109922342A (en) 2019-06-21

Family

ID=58177297

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201910237726.XA Pending CN109922342A (en) 2016-10-24 2016-10-24 Panoramic video coding/decoding method and device
CN201610927275.9A Pending CN106454314A (en) 2016-10-24 2016-10-24 Panoramic video decoding method and device

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201610927275.9A Pending CN106454314A (en) 2016-10-24 2016-10-24 Panoramic video decoding method and device

Country Status (1)

Country Link
CN (2) CN109922342A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110267026A (en) * 2019-07-05 2019-09-20 浙江开奇科技有限公司 Data processing method, mobile terminal and system based on 5G network
CN114666603A (en) * 2022-05-06 2022-06-24 厦门美图之家科技有限公司 Video decoding method and device, electronic equipment and storage medium
CN114666603B (en) * 2022-05-06 2024-05-03 厦门美图之家科技有限公司 Video decoding method and device, electronic equipment and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107484004B (en) * 2017-07-24 2020-01-03 北京奇艺世纪科技有限公司 Video processing method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110069147A1 (en) * 2009-09-18 2011-03-24 Hon Hai Precision Industry Co., Ltd. Panoramic camera, and system and method for monitoring target places using the panoramic camera
CN104580967A (en) * 2013-10-24 2015-04-29 中国移动通信集团公司 Map projection method based on portable projector, and device for projection
CN104735464A (en) * 2015-03-31 2015-06-24 华为技术有限公司 Panorama video interactive transmission method, server and client end
CN105791882A (en) * 2016-03-22 2016-07-20 腾讯科技(深圳)有限公司 Video coding method and device
CN105898344A (en) * 2016-04-12 2016-08-24 乐视控股(北京)有限公司 Method and device for playing panoramic video

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103294358B (en) * 2013-05-17 2016-12-28 小米科技有限责任公司 A kind of control the method for screen rotation, device and equipment
CN105847850A (en) * 2016-03-28 2016-08-10 乐视控股(北京)有限公司 Panorama video real time playing method and apparatus
CN105872467A (en) * 2016-04-14 2016-08-17 普宙飞行器科技(深圳)有限公司 Real-time panoramic audio-video wireless sharing method and real-time panoramic audio-video wireless sharing platform based on unmanned aerial vehicle

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110069147A1 (en) * 2009-09-18 2011-03-24 Hon Hai Precision Industry Co., Ltd. Panoramic camera, and system and method for monitoring target places using the panoramic camera
CN104580967A (en) * 2013-10-24 2015-04-29 中国移动通信集团公司 Map projection method based on portable projector, and device for projection
CN104735464A (en) * 2015-03-31 2015-06-24 华为技术有限公司 Panorama video interactive transmission method, server and client end
CN105791882A (en) * 2016-03-22 2016-07-20 腾讯科技(深圳)有限公司 Video coding method and device
CN105898344A (en) * 2016-04-12 2016-08-24 乐视控股(北京)有限公司 Method and device for playing panoramic video

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110267026A (en) * 2019-07-05 2019-09-20 浙江开奇科技有限公司 Data processing method, mobile terminal and system based on 5G network
CN114666603A (en) * 2022-05-06 2022-06-24 厦门美图之家科技有限公司 Video decoding method and device, electronic equipment and storage medium
CN114666603B (en) * 2022-05-06 2024-05-03 厦门美图之家科技有限公司 Video decoding method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN106454314A (en) 2017-02-22

Similar Documents

Publication Publication Date Title
CN107018336B (en) The method and apparatus of method and apparatus and the video processing of image procossing
EP2029248B1 (en) Control of data processing using cumulative inter-frame motion
US20170186219A1 (en) Method for 360-degree panoramic display, display module and mobile terminal
CN103414844B (en) Video jitter modification method and device
CN109743892B (en) Virtual reality content display method and device
CN110392251B (en) Dynamic projection method and system based on virtual reality
CN108196669B (en) Game role model correction method and device, processor and head-mounted display equipment
CN109660783A (en) Virtual reality parallax correction
WO2016197469A1 (en) Method and apparatus for generating unlocking interface, and electronic device
US20170186243A1 (en) Video Image Processing Method and Electronic Device Based on the Virtual Reality
CN108668108B (en) Video monitoring method and device and electronic equipment
CN112288665A (en) Image fusion method and device, storage medium and electronic equipment
CN111583381B (en) Game resource map rendering method and device and electronic equipment
CN104967893A (en) Video generation method and apparatus for portable electronic equipment
CN106997613A (en) Generated according to the 3D models of 2D images
CN109448050A (en) A kind of method for determining position and terminal of target point
US11662580B2 (en) Image display method, apparatus, and system to reduce display latency
CN107392961A (en) Space-location method and device based on augmented reality
CN106791346B (en) A kind of method and device of image prediction
CN108553895A (en) User interface element and the associated method and apparatus of three-dimensional space model
CN108063946A (en) Method for encoding images and device, storage medium and electronic device
CN109922342A (en) Panoramic video coding/decoding method and device
CN108235138A (en) Method, processing unit and its computer system of preview video
CN111462339A (en) Display method and device in augmented reality, medium and electronic equipment
CN106210859B (en) Panoramic video rendering method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20200526

Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Applicant after: Alibaba (China) Co.,Ltd.

Address before: Room 02, 2nd floor, E/F, 555 Dongchuan Road, Baoshan District, Shanghai, 2001

Applicant before: CHUANXIAN NETWORK TECHNOLOGY (SHANGHAI) Co.,Ltd.

TA01 Transfer of patent application right
RJ01 Rejection of invention patent application after publication

Application publication date: 20190621

RJ01 Rejection of invention patent application after publication