CN111131865A - Method, device and system for improving VR video playing fluency and set top box - Google Patents
Method, device and system for improving VR video playing fluency and set top box Download PDFInfo
- Publication number
- CN111131865A CN111131865A CN201811272627.7A CN201811272627A CN111131865A CN 111131865 A CN111131865 A CN 111131865A CN 201811272627 A CN201811272627 A CN 201811272627A CN 111131865 A CN111131865 A CN 111131865A
- Authority
- CN
- China
- Prior art keywords
- frame
- picture
- angle
- judgment
- next frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The disclosure provides a method, a device and a system for improving VR video playing fluency and a set top box, and relates to the technical field of smart families. The method comprises the following steps: receiving a user visual angle variation parameter sent by display equipment; generating a pre-judgment picture frame based on the user visual angle variation parameter and the current visual angle VR picture frame; if the next frame of VR picture data returned by the server is not received within the preset time, inserting the pre-judged picture frame into the next frame position of the current visual angle VR picture frame; and returning the next frame containing the prejudged picture frame to the display equipment for displaying. The method and the device can solve the problem of picture jitter caused by frame loss or frame delay, thereby improving the smoothness of VR video playing.
Description
Technical Field
The disclosure relates to the technical field of smart families, in particular to a method, a device and a system for improving VR video playing fluency and a set top box.
Background
Solving the vertigo of users is a hot spot of the current VR (Virtual Reality) technology research. When the VR video is transmitted online, if the processing capability of the device is insufficient or the data transmission rate/time delay jitter, the display of the next frame of the VR video may be affected, and if the frame is lost or jammed to a certain extent, the frame jitter may be caused, so that the user may quickly feel dizzy and the service use of the user may be affected.
The VR video is different from the ordinary two-dimensional video, not only is a 3D spherical video, but also the difference between the previous and subsequent frames may be large along with the change of the user view angle, and the conventional method for performing frame interpolation processing by using the previous frame is not suitable for VR video playing.
Disclosure of Invention
The technical problem to be solved by the present disclosure is to provide a method, an apparatus, a system and a set top box for improving the smoothness of playing a VR video, which can improve the smoothness of playing the VR video.
According to one aspect of the disclosure, a method for improving the playing fluency of a Virtual Reality (VR) video is provided, which includes: receiving a user visual angle variation parameter sent by display equipment; generating a pre-judgment picture frame based on the user visual angle variation parameter and the current visual angle VR picture frame; if the next frame of VR picture data returned by the server is not received within the preset time, inserting the pre-judged picture frame into the next frame position of the current visual angle VR picture frame; and returning the next frame containing the prejudged picture frame to the display equipment for displaying.
Optionally, the user view angle variation parameter includes resolution, horizontal variation angle, pitch variation angle, and field angle; and generating a prejudgment picture frame based on the resolution, the horizontal change angle, the pitching change angle, the field angle and the current visual angle VR picture frame.
Optionally, a look ahead frame is generated with the local graphics processor GPU based on the resolution, the horizontal change angle, the pitch change angle, the field angle, and the current view VR frame.
Optionally, the method further comprises: receiving a next frame VR picture request sent by the display equipment, and initiating the next frame VR picture request to the server; and if the next frame of VR picture data returned by the server is not received within the preset time, acquiring a corresponding pre-judgment picture frame according to the next frame of VR picture request, and inserting the pre-judgment picture frame into the next frame position of the current visual angle VR picture frame.
According to another aspect of the present disclosure, a device for improving fluency of virtual reality VR video playing is further provided, including: the parameter receiving unit is used for receiving the user visual angle variation parameters sent by the display equipment; the pre-judgment frame generating unit is used for generating a pre-judgment picture frame based on the user visual angle change parameter and the current visual angle VR picture frame; the pre-judgment frame inserting unit is used for inserting the pre-judgment frame into the next frame position of the current visual angle VR frame if the next frame VR frame data returned by the server is not received within the preset time; and the picture frame sending unit is used for returning the next frame containing the prejudged picture frame to the display equipment for displaying.
Optionally, the user view angle variation parameter includes resolution, horizontal variation angle, pitch variation angle, and field angle; the pre-judging frame generating unit is used for generating a pre-judging picture frame based on the resolution, the horizontal change angle, the pitching change angle, the field angle and the current visual angle VR picture frame.
Optionally, the pre-decision frame generating unit is configured to generate the pre-decision picture frame by using the local graphics processor GPU based on the resolution, the horizontal change angle, the pitch change angle, the field angle, and the current view angle VR picture frame.
Optionally, the apparatus further comprises: the VR picture request unit is used for receiving a next frame of VR picture request sent by the display equipment and initiating the next frame of VR picture request to the server; and the pre-judgment frame inserting unit is used for acquiring a corresponding pre-judgment frame according to the next frame VR frame request and inserting the pre-judgment frame into the next frame position of the current visual angle VR frame if the next frame VR frame data returned by the server is not received within the preset time.
According to another aspect of the present disclosure, a device for improving fluency of virtual reality VR video playing is further provided, including: a memory; and a processor coupled to the memory, the processor configured to perform the method for improving VR video playback fluency as described above based on the instructions stored in the memory.
According to another aspect of the disclosure, a set top box is further provided, which includes the above apparatus for improving the smoothness of playing the virtual reality VR video.
According to another aspect of the present disclosure, a system for improving fluency of virtual reality VR video playing is further provided, including: the display equipment is used for sending the user visual angle variation parameters to the set top box and receiving the next frame which is returned by the set top box and contains the prejudged picture frame, and performing picture display; a set-top box; and the server is used for returning the next frame of VR picture data to the set top box.
According to another aspect of the present disclosure, a computer-readable storage medium is further provided, on which computer program instructions are stored, and the instructions, when executed by a processor, implement the steps of the above method for improving the fluency of virtual reality VR video playing.
Compared with the prior art, the method and the device have the advantages that the pre-judgment picture frame is generated by utilizing the existing current visual angle VR picture frame and the pre-judgment of the change of the user visual angle, when the frame loss occurs in network transmission or the frame delay arrives, the pre-judgment picture frame can be inserted into the position of the next frame of the current visual angle VR picture frame and displayed on the display equipment, the problem of picture jitter caused by frame loss and frame delay can be solved, and therefore the smoothness of VR video playing is improved.
Other features of the present disclosure and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description, serve to explain the principles of the disclosure.
The present disclosure may be more clearly understood from the following detailed description, taken with reference to the accompanying drawings, in which:
fig. 1 is a flowchart illustrating an embodiment of a method for improving VR video playing fluency according to the present disclosure.
Fig. 2 is a flowchart illustrating another embodiment of the method for improving VR video playing fluency according to the present disclosure.
Fig. 3 is a schematic structural diagram illustrating an embodiment of an apparatus for improving VR video playing fluency according to the present disclosure.
Fig. 4 is a schematic structural diagram illustrating another embodiment of an apparatus for improving VR video playing fluency according to the present disclosure.
Fig. 5 is a schematic structural diagram illustrating a device for improving VR video playing fluency according to another embodiment of the present disclosure.
Fig. 6 is a schematic structural diagram illustrating a device for improving VR video playing fluency according to another embodiment of the present disclosure.
Fig. 7 is a schematic structural diagram of an embodiment of a system for improving VR video playing fluency according to the present disclosure.
Detailed Description
Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.
Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
For the purpose of promoting a better understanding of the objects, aspects and advantages of the present disclosure, reference is made to the following detailed description taken in conjunction with the accompanying drawings.
Fig. 1 is a flowchart illustrating an embodiment of a method for improving VR video playing fluency according to the present disclosure. The embodiment can be executed by a device for improving the VR video playing fluency, and the device can be specifically a set top box.
In step 110, a user viewing angle variation parameter sent by the display device is received. The display device is, for example, a head-mounted display, and after detecting the change of the user viewing angle, the head-mounted display sends the user viewing angle change parameters such as resolution, horizontal change angle, pitch change angle, and viewing angle to the set-top box.
In step 120, a prejudged frame is generated based on the user view variation parameter and the current view VR frame. For example, the predictive picture frame is generated based on the resolution, the horizontal change angle, the pitch change angle, the field angle, and the current view angle VR picture frame.
In step 130, if the next VR frame data returned by the server is not received within the predetermined time, the pre-determined frame is inserted into the next frame position of the VR frame from the current view.
In step 140, the next frame including the predicted frame is returned to the display device for display.
In the embodiment, the pre-judgment picture frame is generated by utilizing the existing current visual angle VR picture frame and the pre-judgment of the change of the user visual angle, when the frame loss occurs or the frame delay arrives in the network transmission, the pre-judgment picture frame can be inserted into the next frame position of the current visual angle VR picture frame and displayed on the display equipment, so that the problem of picture jitter caused by the frame loss and the frame delay can be solved, and the smooth playing of the picture at the user side is realized.
Fig. 2 is a flowchart illustrating another embodiment of the method for improving VR video playing fluency according to the present disclosure.
At step 210, the head mounted display detects a change in the user's viewing angle.
In step 220, the head-mounted display sends the user view variation parameter to the set-top box and sends a next frame VR picture request to the set-top box.
In step 230, the set-top box initiates a next VR frame request to the server and starts the receive delay calculator.
In step 240, the set-top box generates a pre-judgment frame by using a local GPU (Graphics Processing Unit) to render based on the user view variation parameter and the current view VR frame, and stores the pre-judgment frame in a cache region.
In step 250, the set-top box determines whether the time delay calculator is overtime, if not, the step is continued to time, otherwise, step 260 is executed. And if not, the set top box continues to wait for the server to return the next frame of VR picture data.
In step 260, the predicted frame is fetched from the buffer and inserted into the next frame position of the VR frame from the current view. If the time is out, the problem of video picture blocking and frame loss caused by network transmission quality change is shown, a corresponding pre-judgment picture frame can be obtained in a buffer area according to a next VR picture request, and the pre-judgment picture frame is inserted into the next frame position of the current VR picture frame.
In step 270, the set-top box returns the next frame containing the predicted picture frame to the head-mounted display for display.
In the embodiment, the set top box calculates the next frame of data as the pre-judgment frame by using the local GPU capability, the user view angle variation parameter and the current view angle VR frame, and if the data transmitted by the server is not received in the specified time, the pre-judgment frame is inserted into the next frame position of the current view angle VR frame and displayed on the head-mounted display, so that the problems of video frame blockage and frame loss caused by network transmission quality variation can be solved, the smoothness of VR video playing is improved, and the user experience is improved.
Fig. 3 is a schematic structural diagram illustrating an embodiment of an apparatus for improving VR video playing fluency according to the present disclosure. The apparatus includes a parameter receiving unit 310, a look-ahead frame generating unit 320, a look-ahead frame inserting unit 330, and a picture frame transmitting unit 340.
The parameter receiving unit 310 is configured to receive the user viewing angle variation parameter sent by the display device. The display device is, for example, a head-mounted display, and after detecting the variation of the user viewing angle, the head-mounted display sends the user viewing angle variation parameters such as resolution, horizontal variation angle, pitch variation angle, and viewing angle to the parameter receiving unit 310.
The pre-decision frame generating unit 320 is configured to generate a pre-decision picture frame based on the user view variation parameter and the current view VR picture frame. For example, the predictive picture frame is generated based on the resolution, the horizontal change angle, the pitch change angle, the field angle, and the current view angle VR picture frame.
The predicted frame inserting unit 330 is configured to insert the predicted frame into a next frame position of the VR frame of the current view angle if the next frame VR frame data returned by the server is not received within a predetermined time.
The frame sending unit 340 is configured to return the next frame containing the predicted frame to the display device for displaying.
In the embodiment, the pre-judgment picture frame is generated by utilizing the existing current visual angle VR picture frame and the pre-judgment of the change of the user visual angle, when the frame loss occurs or the frame delay arrives in the network transmission, the pre-judgment picture frame can be inserted into the next frame position of the current visual angle VR picture frame and displayed on the display equipment, so that the problem of picture jitter caused by the frame loss and the frame delay can be solved, and the smooth playing of the picture at the user side is realized.
Fig. 4 is a schematic structural diagram illustrating another embodiment of an apparatus for improving VR video playing fluency according to the present disclosure. The apparatus includes a parameter receiving unit 410, a VR picture requesting unit 420, a look-ahead frame generating unit 430, a look-ahead frame inserting unit 440, and a picture frame transmitting unit 450.
The parameter receiving unit 410 is configured to receive the user viewing angle variation parameter sent by the head mounted display.
VR picture request unit 420 is configured to receive a next frame VR picture request sent by the head mounted display. Wherein the device may initiate a next VR frame request to the server and start the receive latency calculator.
The pre-judgment frame generating unit 430 is configured to generate a pre-judgment frame by using local GPU rendering based on the user view variation parameter and the current view VR frame, and store the pre-judgment frame in a buffer area.
The pre-judgment frame inserting unit 440 is configured to, if no next VR frame data returned by the server is received within a predetermined time, obtain a corresponding pre-judgment frame according to the next VR frame request, and insert the pre-judgment frame into a next frame position of the current view VR frame.
The frame transmitting unit 450 is configured to return the next frame including the predicted frame to the head-mounted display for displaying.
In the embodiment, the next frame data is calculated by using the local GPU capability, the user view angle variation parameter and the current view angle VR frame to serve as the pre-judgment frame, and if the data transmitted by the server is not received in the specified time, the pre-judgment frame is inserted into the next frame position of the current view angle VR frame and is displayed on the head-mounted display, so that the problems of video frame blockage and frame loss caused by network transmission quality variation can be solved, the smoothness of VR video playing is improved, and the user experience is improved.
Fig. 5 is a schematic structural diagram illustrating a device for improving VR video playing fluency according to another embodiment of the present disclosure. The apparatus includes a memory 510 and a processor 520. Wherein: the memory 510 may be a magnetic disk, flash memory, or any other non-volatile storage medium. The memory 510 is used for storing instructions in the embodiments corresponding to fig. 1 and 2. Processor 520 is coupled to memory 510 and may be implemented as one or more integrated circuits, such as a microprocessor or microcontroller. The processor 520 is configured to execute instructions stored in memory.
In one embodiment, as also shown in FIG. 6, the apparatus 600 includes a memory 610 and a processor 620. Processor 620 is coupled to memory 610 through a BUS 630. The apparatus 600 may also be coupled to an external storage device 650 via a storage interface 640 for external data retrieval, and may also be coupled to a network or another computer system (not shown) via a network interface 660, which will not be described in detail herein.
In the embodiment, the data instruction is stored in the memory, and the instruction is processed by the processor, so that the smoothness of VR video stream playing is improved, and the problems of video playing blocking and dizziness are solved.
In another embodiment of the disclosure, a set top box is protected, and the set top box comprises the device for improving the VR video playing fluency.
Fig. 7 is a schematic structural diagram of an embodiment of a system for improving VR video playing fluency according to the present disclosure. The system includes a display device 710, a set-top box 720, and a server 730. The functions of the set-top box 720 have been described in detail in the above embodiments and will not be further described here.
The display device 710 is, for example, a head-mounted display, and is capable of detecting a user view angle variation, sending a user view angle variation parameter to the set-top box 720, and sending a next frame VR picture request to the set-top box 720. The display device 710 is further configured to receive a next frame including the predicted picture frame returned by the set top box 720, and perform picture display.
The set top box 720 initiates a next frame VR frame request to the server 730, generates a pre-determined frame by using local GPU rendering based on the user view change parameter and the current view VR frame, and stores the pre-determined frame in a buffer area, and if the next frame VR frame data returned by the server 730 is not received within a predetermined time, takes out the pre-determined frame in the buffer area, inserts the pre-determined frame into the next frame position of the current view VR frame, and returns the next frame including the pre-determined frame to the display device 710 for display.
The server 730 can receive the next frame VR picture request sent by the set-top box 720 and return the next frame VR picture data to the set-top box 720.
In the embodiment, the set top box generates the pre-judgment picture frame by using the existing current visual angle VR picture frame and the pre-judgment on the change of the user visual angle, and when the frame loss occurs or the frame is delayed to arrive in the network transmission, the pre-judgment picture frame can be inserted into the position of the next frame of the current visual angle VR picture frame and displayed on the display equipment, so that the fluency of picture playing at the user side can be improved.
In another embodiment, a computer-readable storage medium has stored thereon computer program instructions which, when executed by a processor, implement the steps of the method in the corresponding embodiments of fig. 1, 2. As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, apparatus, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Thus far, the present disclosure has been described in detail. Some details that are well known in the art have not been described in order to avoid obscuring the concepts of the present disclosure. It will be fully apparent to those skilled in the art from the foregoing description how to practice the presently disclosed embodiments.
Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the foregoing examples are for purposes of illustration only and are not intended to limit the scope of the present disclosure. It will be appreciated by those skilled in the art that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
Claims (12)
1. A method for improving the playing fluency of virtual reality VR videos comprises the following steps:
receiving a user visual angle variation parameter sent by display equipment;
generating a pre-judgment picture frame based on the user visual angle variation parameter and the current visual angle VR picture frame;
if the next frame of VR picture data returned by the server is not received within preset time, inserting the pre-judgment picture frame into the next frame position of the current visual angle VR picture frame;
and returning the next frame containing the prejudged picture frame to the display equipment for displaying.
2. The method of claim 1, wherein the user view angle variation parameters include resolution, pan angle, tilt angle, field angle;
and generating the prejudgment picture frame based on the resolution, the horizontal change angle, the pitching change angle, the field angle and the current visual angle VR picture frame.
3. The method of claim 2, wherein,
and generating the pre-judging picture frame by utilizing a local Graphic Processor (GPU) based on the resolution, the horizontal change angle, the pitching change angle, the field angle and the current visual angle VR picture frame.
4. The method of any of claims 1-3, further comprising:
receiving a next frame of VR picture request sent by the display equipment, and initiating the next frame of VR picture request to the server;
and if the next frame of VR picture data returned by the server is not received within the preset time, acquiring a corresponding pre-judgment picture frame according to the next frame of VR picture request, and inserting the pre-judgment picture frame into the next frame position of the current visual angle VR picture frame.
5. An apparatus for improving fluency of Virtual Reality (VR) video playing, comprising:
the parameter receiving unit is used for receiving the user visual angle variation parameters sent by the display equipment;
a pre-judgment frame generating unit, configured to generate a pre-judgment picture frame based on the user view variation parameter and the current view VR picture frame;
the pre-judgment frame inserting unit is used for inserting the pre-judgment frame into the next frame position of the current visual angle VR frame if the next frame VR frame data returned by the server is not received within the preset time;
and the picture frame sending unit is used for returning the next frame containing the prejudged picture frame to the display equipment for displaying.
6. The apparatus of claim 5, wherein the user view angle variation parameters include resolution, pan angle, tilt angle, field angle;
the pre-judging frame generating unit is used for generating the pre-judging picture frame based on the resolution, the horizontal change angle, the pitching change angle, the field angle and the current visual angle VR picture frame.
7. The apparatus of claim 6, wherein,
the pre-judging frame generating unit is used for generating the pre-judging picture frame by utilizing a local graphic processor GPU based on the resolution, the horizontal change angle, the pitching change angle, the field angle and the current visual angle VR picture frame.
8. The apparatus of any of claims 5-7, further comprising:
a VR picture request unit, configured to receive a next frame of VR picture request sent by the display device, and initiate the next frame of VR picture request to the server;
and the pre-judgment frame inserting unit is used for acquiring a corresponding pre-judgment frame according to the next frame VR frame request and inserting the pre-judgment frame into the next frame position of the current visual angle VR frame if the next frame VR frame data returned by the server is not received within the preset time.
9. An apparatus for improving fluency of Virtual Reality (VR) video playing, comprising:
a memory; and
a processor coupled to the memory, the processor configured to perform the method of improving VR video playback fluency of any of claims 1-4 based on instructions stored in the memory.
10. A set top box comprising the apparatus for improving fluency of virtual reality VR video playback recited in any of claims 5-9.
11. A system for improving fluency of virtual reality VR video playback, comprising:
the display equipment is used for sending the user visual angle variation parameters to the set top box, receiving the next frame which is returned by the set top box and contains the prejudged picture frame, and displaying the picture;
the set-top box of claim 10; and
and the server is used for returning the next frame of VR picture data to the set top box.
12. A computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the method of improving fluency of virtual reality VR video playback recited in any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811272627.7A CN111131865A (en) | 2018-10-30 | 2018-10-30 | Method, device and system for improving VR video playing fluency and set top box |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811272627.7A CN111131865A (en) | 2018-10-30 | 2018-10-30 | Method, device and system for improving VR video playing fluency and set top box |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111131865A true CN111131865A (en) | 2020-05-08 |
Family
ID=70484157
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811272627.7A Pending CN111131865A (en) | 2018-10-30 | 2018-10-30 | Method, device and system for improving VR video playing fluency and set top box |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111131865A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023237095A1 (en) * | 2022-06-09 | 2023-12-14 | 咪咕视讯科技有限公司 | Video synthesis method based on surround angle of view, and controller and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013173728A1 (en) * | 2012-05-17 | 2013-11-21 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for unified scene acquisition and pose tracking in a wearable display |
| US20160191795A1 (en) * | 2014-12-30 | 2016-06-30 | Alpine Electronics, Inc. | Method and system for presenting panoramic surround view in vehicle |
| CN105892683A (en) * | 2016-04-29 | 2016-08-24 | 上海乐相科技有限公司 | Display method and target equipment |
| CN106919360A (en) * | 2017-04-18 | 2017-07-04 | 珠海全志科技股份有限公司 | A kind of head pose compensation method and device |
| CN107943287A (en) * | 2017-11-16 | 2018-04-20 | 烽火通信科技股份有限公司 | A kind of system and method that VR floats are solved based on Android set top box system |
| WO2018108104A1 (en) * | 2016-12-13 | 2018-06-21 | 中兴通讯股份有限公司 | Method and device for transmitting panoramic videos, terminal, server and system |
| CN108628446A (en) * | 2013-03-15 | 2018-10-09 | 奇跃公司 | Display system and method |
-
2018
- 2018-10-30 CN CN201811272627.7A patent/CN111131865A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013173728A1 (en) * | 2012-05-17 | 2013-11-21 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for unified scene acquisition and pose tracking in a wearable display |
| CN108628446A (en) * | 2013-03-15 | 2018-10-09 | 奇跃公司 | Display system and method |
| US20160191795A1 (en) * | 2014-12-30 | 2016-06-30 | Alpine Electronics, Inc. | Method and system for presenting panoramic surround view in vehicle |
| CN105892683A (en) * | 2016-04-29 | 2016-08-24 | 上海乐相科技有限公司 | Display method and target equipment |
| WO2018108104A1 (en) * | 2016-12-13 | 2018-06-21 | 中兴通讯股份有限公司 | Method and device for transmitting panoramic videos, terminal, server and system |
| CN106919360A (en) * | 2017-04-18 | 2017-07-04 | 珠海全志科技股份有限公司 | A kind of head pose compensation method and device |
| CN107943287A (en) * | 2017-11-16 | 2018-04-20 | 烽火通信科技股份有限公司 | A kind of system and method that VR floats are solved based on Android set top box system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023237095A1 (en) * | 2022-06-09 | 2023-12-14 | 咪咕视讯科技有限公司 | Video synthesis method based on surround angle of view, and controller and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3557845B1 (en) | Method and device for transmitting panoramic videos, terminal, server and system | |
| CN111052750B (en) | Method and device for point cloud stream transmission | |
| US10171851B2 (en) | Video content distribution system and content management server | |
| CN107888987B (en) | Panoramic video playing method and device | |
| EP3760287A1 (en) | Method and device for generating video frames | |
| US20170085964A1 (en) | Interactive Object Placement in Virtual Reality Videos | |
| US20100073364A1 (en) | Conversion method and apparatus with depth map generation | |
| WO2017189490A1 (en) | Live action volumetric video compression / decompression and playback | |
| WO2019158000A1 (en) | Method and device for viewing angle synchronization in virtual reality (vr) live broadcast | |
| US10477198B2 (en) | Display control method and system for executing the display control method | |
| JP2022141937A (en) | Arbitrary view generation | |
| CN105992043A (en) | Data processing method and device | |
| US20200105050A1 (en) | Display method and display device | |
| US11341712B2 (en) | VR video processing method and related apparatus | |
| EP2574066A2 (en) | Method and apparatus for converting 2D content into 3D content | |
| US20150039778A1 (en) | Transition points in an image sequence | |
| CN111131865A (en) | Method, device and system for improving VR video playing fluency and set top box | |
| CN102413382A (en) | Method for promoting smoothness of real-time video | |
| KR102459850B1 (en) | Method and apparatus for processing 3-dimension image, and graphic processing unit | |
| CN111277857B (en) | Streaming media scheduling method and device | |
| Zhao et al. | Bandwidth adaptation for 3D mesh preview streaming | |
| CN108197248B (en) | Method, device and system for displaying 3D (three-dimensional) 2D webpage | |
| KR101347744B1 (en) | Image processing apparatus and method | |
| JP2016146044A (en) | Video processing system, video processing device and control method thereof, program, and storage medium | |
| CN108765524B (en) | Animation generation method and device based on panoramic photo |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200508 |