WO2018121014A1

WO2018121014A1 - Video play control method and apparatus and terminal device

Info

Publication number: WO2018121014A1
Application number: PCT/CN2017/107311
Authority: WO
Inventors: 吴昊; 徐光兴
Original assignee: 广州虎牙信息科技有限公司
Priority date: 2016-12-30
Filing date: 2017-10-23
Publication date: 2018-07-05
Also published as: CN106713937A

Abstract

The present invention relates to the technical field of multimedia, and in particular, to a video play control method and apparatus and a terminal device. The method comprises the steps of: acquiring a video stream for a live studio from a server; determining a decoding condition provided by a terminal, and selecting a matching decoding interface to decode the video stream, in which when the decoding condition comprises a hardware decoding interface and a software decoding interface, the hardware decoding interface being preferentially invoked for decoding; otherwise, the software decoding interface being invoked for decoding; and determining a rendering condition provided by the terminal, and selecting a matching graphics rendering interface to render the decoded video stream and then output the rendered decoded video stream to a user interface for display, in which when the rendering condition comprises a hardware rendering interface and a software rendering interface, the hardware rendering interface being preferentially invoked for rendering; otherwise, the software rendering interface being invoked for rendering. According to the present invention, a terminal can realize smooth viewing of a live video stream having a high resolution, a high bit rate, and a high frame rate.

Description

Video playback control method, device and terminal device

[Technical Field]

The present invention relates to the field of multimedia technologies, and in particular, to a video playback control method, apparatus, and terminal device.

【Background technique】

With the development of Internet technology and intelligent mobile terminal devices, various Internet products have brought a lot of convenience and entertainment to people's work and life. In recent years, various live broadcast platforms for live video broadcasts have emerged in an endless stream. More real-time social experience, and in recent years, the upgrade of shooting equipment, high-resolution, high-rate, high-frame rate video has also been applied to the live broadcast scene, currently for the client watching the live video stream, are using software decoding And use traditional GDI (a graphical interface drawn with pure software) for rendering, for viewing high resolution (width >= 1920 high >= 1080), high bit rate >= 3000, high frame number (FPS:>= 30) When the video is broadcast live, the software decoding and GDI rendering take up too much CPU resources, causing the video picture to be stuck and the audio and video are not synchronized, which brings a bad viewing experience to the user, affects the live platform reputation, and thus reduces User activity.

Therefore, how to use the existing hardware of the terminal, reduce the CPU usage as much as possible, and ensure the smoothness of live video playback is an urgent problem to be solved.

[Summary of the Invention]

A primary object of the present invention is to provide a video playback control method and apparatus;

Another object of the present invention is to provide a terminal device that implements the video playing method.

To achieve this, the present invention adopts the following technical solutions:

In a first aspect, the present invention provides a video playback control method, including the following steps:

Obtaining a video stream between the live broadcasts from the server;

Determining a decoding condition provided by the terminal, selecting an adapted decoding interface to decode the video stream, and when the decoding condition includes a hardware decoding interface and a software decoding interface, preferentially calling the hard The decoding interface decodes, otherwise the software decoding interface is called for decoding;

Determining a rendering condition provided by the terminal, selecting a matching graphic rendering interface to draw the decoded video stream and outputting the output to the user interface display, and preferentially calling the hardware when the rendering condition includes a hardware rendering interface and a software rendering interface The rendering interface is rendered, otherwise the software rendering interface is called for rendering.

Further, before the determining the decoding condition provided by the terminal and determining the rendering condition provided by the terminal, the method further includes:

Determine the operating system version of the terminal.

Specifically, the operating system is a WINDOWS system. When the operating system of the terminal is a WINDOWS7 version or a WINDOWS7 or higher version, it is determined that the terminal meets the prerequisites for providing hardware decoding and hardware rendering, otherwise the software decoding interface is called to decode the video stream. Then, the software rendering interface is called to draw the decoded video stream and output it to the user interface display.

Specifically, the step of determining the decoding condition provided by the terminal, and selecting the adapted decoding interface to decode the video stream, specifically includes:

Determining a decoder type supported by the terminal, the decoder type including an Nvidia hardware decoder, an Intel hardware decoder, and an AMD hardware decoder;

When the terminal supports the Nvidia hardware decoder, the hardware decoding interface of the Nvidia hardware decoder is called to decode the video stream;

When the terminal supports the Intel hardware decoder, the hardware decoding interface of the Intel hardware decoder is called to decode the video stream;

When the terminal supports the AMD hardware decoder, the hardware decoding interface of the AMD hardware decoder is called to decode the video stream.

Preferably, the hardware rendering interface is a DirectX 11 graphics rendering interface. When the video stream is hardware decoded, the DirectX 11 graphics rendering interface is called to convert the decoded video stream into a YUV 420 format and loaded into the DirectX 11 format. In the texture, the video stream is then drawn using the DirectX 11 device and output to the user interface.

Optionally, when the video stream is decoded by software, the DirectX 11 graphics rendering interface is called to convert the decoded video stream into an RGBA format and loaded in the video memory, and then the video stream is drawn by the DirectX 11 device and output to the user interface. .

Preferably, when the video stream is rendered by hardware, determining whether the video stream is a VR view Frequency, if it is, then use 3D graphics rendering, otherwise, use 2D graphics rendering.

Further, after the step of acquiring the video stream between the live broadcasts from the server, the subsequent steps of the method are performed when the control instruction of the user is received.

In a second aspect, the present invention provides a video playback control apparatus, including:

Read module: used to obtain a video stream between live broadcasts from a server;

a decoding module: configured to determine a decoding condition provided by the terminal, and select an adapted decoding interface to decode the video stream. When the decoding condition includes a hardware decoding interface and a software decoding interface, the hardware decoding interface is preferentially invoked. Decoding, otherwise calling the software decoding interface for decoding;

The rendering module is configured to determine a rendering condition provided by the terminal, and select a matching graphic rendering interface to draw the decoded video stream and output the result to the user interface display. When the rendering condition includes a hardware rendering interface and a software rendering interface, The hardware rendering interface is preferentially invoked for rendering, otherwise the software rendering interface is invoked for rendering.

In addition, the present invention further provides a terminal device for implementing the method of the above first aspect, comprising: a video decoder, a video rendering engine, a central processing unit, a graphics processor, a memory, and a touch sensitive display.

Compared with the prior art, the present invention has the following advantages:

The present invention can effectively standardize the encoding format of the live video stream for the video live broadcast platform. When the terminal watching the live video meets the hardware decoding condition and/or the hardware rendering condition, the live decoding video stream is preferably decoded and rendered by hardware decoding and hardware rendering. It can ensure the smoothness of high-quality live video stream playback, especially for VR video stream, hardware decoding and hardware rendering can effectively reduce the CPU usage of the terminal, and solve the problem of video playback caused by software coding and GDI rendering. ;

In addition, since the live broadcast platform can effectively standardize the encoding format of the live video stream, the video stream encoding format can be effectively prevented from satisfying the condition of supporting hardware decoding, and the video stream is provided with hardware decoding to provide more convenient conditions.

It is apparent that the above description of the advantages of the present invention is general, and more advantages will be described in the following embodiments, and those skilled in the art can also reasonably discover other aspects of the present invention. Many advantages.

The additional aspects and advantages of the invention will be set forth in part in the description which follows.

[Description of the Drawings]

1 is a schematic flow chart of an embodiment of a video playback control method according to the present invention;

2 is a schematic flow chart of an embodiment of determining a type of a terminal decoder according to the present invention;

3 is a schematic diagram of an embodiment of playing a live video stream according to the present invention;

FIG. 4 is a schematic diagram of an embodiment of a video playback control apparatus according to the present invention.

【detailed description】

The invention is further described in the following with reference to the drawings and exemplary embodiments, wherein like reference numerals refer to the same parts throughout. Further, if a detailed description of a known technique is not necessary to show the features of the present invention, it will be omitted.

The singular forms "a", "an", "the" It is to be understood that the phrase "comprise" or "an" Integers, steps, operations, components, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element. Further, "connected" or "coupled" as used herein may include either a wireless connection or a wireless coupling. The phrase "and/or" used herein includes all or any one and all combinations of one or more of the associated listed.

Those skilled in the art will appreciate that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention belongs, unless otherwise defined. It should also be understood that terms such as those defined in a general dictionary should be understood to have meaning consistent with the meaning in the context of the prior art, and will not be idealized or excessive unless specifically defined as here. The formal meaning is explained.

Those skilled in the art can understand that the "terminal" and "terminal device" used herein include both a wireless signal receiver device, a device having only a wireless signal receiver without a transmitting capability, and a receiving and transmitting hardware. A device having a device capable of performing two-way communication receiving and transmitting hardware on a two-way communication link. Such devices may include cellular or other communication devices having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and / or data communications capabilities; PDA (personal digital _Assistant, personal digital assistants), which may include network access to a radio frequency receiver, a pager, Internet / web browser, notepad, calendar and / or GPS (Global Positioning System (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having a conventional laptop and/or palmtop computer or other device that includes and/or includes a radio frequency receiver. As used herein, "terminal", "terminal device" may be portable, transportable, installed in a vehicle (aviation, sea and/or land), or adapted and/or configured to operate locally, and/or Run in any other location on the Earth and/or space in a distributed form. The "terminal" and "terminal device" used herein may also be a communication terminal, an internet terminal, a music/video playing terminal, and may be, for example, a PDA, a MID (Mobile Internet Device), and/or have a music/video playback. Functional mobile phones can also be smart TVs, set-top boxes and other devices.

Those skilled in the art can understand that the remote network device used herein includes, but is not limited to, a computer, a network host, a single network server, a plurality of network server sets, or a cloud composed of multiple servers. Here, the cloud is composed of a large number of computers or network servers based on Cloud Computing, which is a kind of distributed computing, a super virtual computer composed of a group of loosely coupled computers. In the embodiment of the present invention, the communication between the remote network device, the terminal device and the WNS server can be implemented by any communication method, including but not limited to, mobile communication based on 3GPP, LTE, WIMAX, TCP/IP, UDP protocol. Computer network communication and short-range wireless transmission based on Bluetooth and infrared transmission standards.

Those skilled in the art should understand that the concepts of "application", "application", "application software" and similar expressions as used in the present invention are the same concepts well known to those skilled in the art, and are referred to by a series of computer instructions and related. Data software is an organically constructed computer software suitable for electronic operation. Unless otherwise specified, the naming itself is not limited by the type and level of programming language, nor by the operating system or platform on which it operates. Of course, such concepts are also not limited by any form of terminal.

The implementation of the method of the present invention depends on a certain functional module or plug-in in the mobile terminal operating system, specifically executable code built in the corresponding application of the mobile terminal or a separately executable application independent of any application. It can be executed in a specific application and can run in a variety of compatible applications. The specific implementation form of the functional module or the plug-in is not specifically limited to the present invention.

The live broadcast room includes the following meanings: 1 a virtual space (or virtual room) created based on the webcast platform. The live broadcast room is generally created by the anchor client and connected to multiple viewing clients, that is, live broadcast. The anchor and the plurality of viewers are included in the room, and the viewing client located in the virtual space can watch the live content of the anchor client, and the user of the anchor client and the user who views the client, the user who views the client, and the user who views the client. You can interact with voice, pictures, text or electronic gifts; 2 an instant messaging platform that aggregates users together in groups, such as a video conferencing system, where users log in to the client to enter the group, and the user is in the group. The group exists as a member of the group. The same group contains multiple group members. The user can join or leave the group arbitrarily. Within the group, various interactions such as text, voice, and video can be performed.

FIG. 1 is a schematic flowchart of an embodiment of a video playback control method according to the present invention, including the following steps:

Step S100: Obtain a video stream between the live broadcasts from the server.

The live broadcast process is as follows: the watcher sends a video live broadcast request to watch a live broadcast -> after receiving the request, the server returns the play address (usually a multicast URL) of the live broadcast to the viewer -> the watcher The address is added to the corresponding multicast group-> and then the video stream (stream data) of the live broadcast is obtained from the server. After the terminal obtains the video stream, before converting the video stream into an image output and displaying it on the terminal user interface, the video stream needs to be decoded, rendered, and the like.

Preferably, the encoded format of the video stream is an H.264 or H.265 encoding format, and the live broadcast platform can effectively control the encoding format of the live video stream, thereby providing more convenient conditions for hardware decoding of the video stream. .

Step S200: determining a decoding condition provided by the terminal, selecting an adapted decoding interface to decode the video stream, and when the decoding condition includes a hardware decoding interface and a software decoding interface, preferentially calling the hardware decoding interface to perform decoding, Otherwise, the software decoding interface is called for decoding.

Step S300: determining a rendering condition provided by the terminal, selecting a matching graphic rendering interface to draw the decoded video stream and outputting the output to the user interface display, and when the rendering condition includes a hardware rendering interface and a software rendering interface, preferentially calling The hardware rendering interface performs rendering, otherwise the software rendering interface is invoked for rendering.

Before determining the decoding condition provided by the terminal and determining the rendering condition provided by the terminal, the method further includes the steps of:

Determine the operating system version of the terminal.

The operating system is a WINDOWS system. Since Microsoft has configured a hardware acceleration interface for the underlying system in WINDOWS7 and above of the WINDOWS system, the operating system below WINDOWS7 cannot meet the conditions of hardware decoding and hardware rendering, so in this embodiment When the operating system of the terminal is WINDOWS7 version or WINDOWS7 or higher, it is determined that the terminal meets the preconditions for providing hardware decoding and hardware rendering. Otherwise, the software decoding interface is called to soft decode the video stream, and then the WINDOWS GDI is called to decode. The subsequent video stream is drawn and output to the user interface display.

After determining that the operating system of the terminal is the WINDOWS7 version or the WINDOWS7 or later version, it is also necessary to determine whether the hardware of the terminal supports hardware decoding. Therefore, the embodiment further includes the following steps:

Determine the type of decoder supported by the terminal.

The decoder types include NVIDIA hardware decoder, INTEL hardware decoder, AMD hardware decoder, and hardware decoding technology is mainly provided by NVIDIA/INTEL/AMD. Among them, Nvidia's graphics card introduces PureVideo technology and PureVideo in hardware decoding. HD technology, Intel's graphics card introduced Intel Clear Video technology in hardware decoding, AMD's graphics card introduced AMD Avivo technology and AMD Avivo HD technology in hardware decoding.

At the same time, the graphics cards that support PureVideo technology are: GeForce6 series graphics cards, GeForce7 series graphics cards; graphics cards supporting PureVideo HD (first generation) technology: GeForce6 series graphics cards, GeForce7 series graphics cards, GeForce6150 integrated graphics; support PureVideo HD (second generation) The technical graphics cards are: GeForce8 series.

Graphics cards that support AMD Avaio technology include the ATi X1300/X1600/X1800/X1900 series, the ATi HD2000/HD3000/HD4000 series, and the AMD HD5000/HD6000 series.

Graphics cards that support AMD Avaio HD technology are: ATI HD2400/HD2600 series.

Graphics cards that support Intel Clear Video technology are: Intel GMA X4500 series.

FIG. 2 is a flowchart of determining a decoder type supported by a terminal according to the embodiment, specifically,

For hardware decoding, in addition to the support of the system and hardware of the terminal itself, the package format and encoding format of the video stream are required to be hardware decoded. Therefore, in the live broadcast field, the live broadcast platform can strictly control the live video stream. Encoding formats (such as H.264 or H.265 format) and encapsulation formats provide more convenient conditions for hardware decoding of video streams.

After the video stream is decoded, the decoded video stream needs to be rendered. In this case, it is also required to determine a rendering condition provided by the terminal. When the rendering condition includes a hardware rendering interface and a software rendering interface, the first call is performed. The hardware rendering interface is rendered, otherwise the software rendering interface is invoked for rendering.

Specifically, the hardware rendering interface is a DirectX graphics rendering interface, and Microsoft Corporation integrates DirectX11 into Windows 7. The following is an example of DirectX 11:

In one embodiment, when the video stream is decoded by hardware, the DirectX 11 graphics rendering interface is called to convert the decoded video stream into a YUV 420 format and loaded into a texture created by DirectX 11 (a picture saved in the video memory). In the container, the video stream is then drawn and output to the user interface display using the DirectX 11 device, which can save CPU usage to the utmost extent.

In another embodiment, when the video stream is decoded by software, the DirectX 11 graphics rendering interface is called to convert the decoded video stream into an RGBA format and loaded in the video memory, and then the video stream is drawn and output by using the DirectX 11 device. Displayed to the user interface.

Moreover, when the video stream is rendered by the DirectX 11 graphics rendering interface, it is determined whether the video stream is a VR video, and if so, the 3D graphics rendering is performed; otherwise, the 2D graphics rendering is performed. The DirectX 11 includes a Direct 3D and a Direct Draw interface. The 3D graphics rendering is performed by calling a Direct 3D interface. The 2D graphics rendering is performed by calling a Direct Draw. The VR (Virtual Reality) video is also called a panoramic video. A video that can realize three-dimensional space display function. In the field of video live broadcast, VR video stream is a high-resolution, high-rate, high-frame-rate live video stream. If software decoding and GDI rendering are used, it will occupy too many terminals. CPU resources, causing video picture jamming, and using hardware decoding and / or hardware rendering, can effectively release the end The pressure of the CPU ensures the smoothness of high-quality video playback.

In addition, in this embodiment, the function of turning on hardware decoding and/or hardware rendering includes the following manners:

An implementation manner is: when the terminal uses the software decoding and the GDI to render the output video stream, and after detecting that the CPU usage of the terminal is higher than a preset threshold, the video stream is hardware decoded and/or according to the method of the present invention. Hardware rendering, to reduce the CPU usage of the terminal, reduce the dropped frame of the video stream, improve the smoothness of video playback, and thus enhance the user experience.

The second implementation manner is that, after the terminal acquires the video stream, according to the decoding condition and the rendering condition provided by the terminal, if the hardware decoding and hardware rendering conditions are met, the hardware decoding and hardware rendering of the video stream are automatically turned on.

Another embodiment is to enable hardware decoding and/or hardware rendering of the video stream when receiving the control instruction of the user, and the control instruction may be triggered before the terminal acquires the video stream or after the terminal acquires the video stream, such as FIG. 3 is a schematic diagram of an embodiment of playing a live video stream according to the present invention. The user can click on the button pointed to by the arrow in FIG. 3 to enable hardware decoding and hardware rendering of the video stream.

In a second aspect, FIG. 4 is a schematic diagram of an embodiment of a video playback control apparatus according to the present invention, including:

The reading module 100 is configured to acquire a video stream between the live broadcasts from the server.

The live broadcast process is as follows: the watcher sends a video live broadcast request to watch a live broadcast -> after receiving the request, the server returns the play address (usually a multicast URL) of the live broadcast to the viewer -> the watcher The address is added to the corresponding multicast group-> and then the video stream (stream data) of the live broadcast is obtained from the server. After the reading module 100 obtains the video stream, before converting the video stream into an image output and displaying it on the terminal user interface, the video stream needs to be decoded, rendered, and the like.

The decoding module 200 is configured to determine a decoding condition provided by the terminal, select an adapted decoding interface to decode the video stream, and preferentially invoke the hardware decoding interface when the decoding condition includes a hardware decoding interface and a software decoding interface. Decoding is performed, otherwise the software decoding interface is called for decoding.

The rendering module 300 is configured to determine a rendering condition provided by the terminal, and select a matching graphic rendering interface to draw the decoded video stream and output the output to the user interface, when the rendering condition includes a hard When the rendering interface and the software rendering interface are used, the hardware rendering interface is preferentially called for rendering, otherwise the software rendering interface is called for rendering.

In this embodiment, when the operating system of the terminal is the WINDOWS7 version or the WINDOWS7 or higher version, it is determined that the terminal meets the prerequisites for providing hardware decoding and hardware rendering. Otherwise, the decoding module 200 calls the software decoding interface to perform soft decoding on the video stream. The rendering module 300 then calls WINDOWS GDI to draw and output the decoded video stream to the user interface display.

After determining that the operating system of the terminal is a WINDOWS7 version or a WINDOWS7 or higher version, it is also necessary to determine a decoder type supported by the terminal, the decoder type including an NVIDIA hardware decoder, an INTEL hardware decoder, and an AMD hardware decoder;

When the terminal supports the Nvidia hardware decoder, the decoding module 200 calls the hardware decoding interface of the Nvidia hardware decoder to decode the video stream;

When the terminal supports the Intel hardware decoder, the decoding module 200 calls the hardware decoding interface of the Intel hardware decoder to decode the video stream;

When the terminal supports the AMD hardware decoder, the decoding module 200 calls the hardware decoding interface of the AMD hardware decoder to decode the video stream.

After decoding the video stream, it is also required to determine a rendering condition provided by the terminal. When the video stream is hardware decoded, the rendering module 300 calls the DirectX 11 graphics rendering interface to convert the decoded video stream into the YUV 420 format, and Loaded into the texture created by DirectX 11 (a type of image container saved in the video memory), and then the video stream is drawn by the DirectX 11 device and output to the user interface display; when the video stream is decoded by software, the rendering module 300 calls DirectX. 11 graphics rendering interface converts the decoded video stream into RGBA format and loads it in the video memory, and then uses the DirectX 11 device to draw the video stream and output it to the user interface display.

In a third aspect, the present invention further provides a terminal device, which is used to implement the above video playback control method, including: a video decoder, a video rendering engine, a central processing unit, a graphics processor, a memory, and a touch sensitive display.

The present invention can effectively standardize the encoding format of the live video stream for the video live broadcast platform. When the terminal watching the live video meets the hardware decoding condition and/or the hardware rendering condition, the live decoding video stream is preferably decoded and rendered by hardware decoding and hardware rendering. It can ensure the smoothness of high-quality live video stream playback. Especially for VR video stream, hardware decoding and hardware rendering can effectively reduce the CPU usage of the terminal, and solve the problem of video playback caused by software coding and GDI rendering. The problem;

While some exemplary embodiments of the invention have been shown in the foregoing, the embodiments of the invention may The scope is defined by the claims and their equivalents.

Claims

A video playback control method includes the following steps:

Obtaining a video stream between the live broadcasts from the server;

Determining a decoding condition provided by the terminal, selecting an adapted decoding interface to decode the video stream, and when the decoding condition includes a hardware decoding interface and a software decoding interface, preferentially calling the hardware decoding interface to decode, otherwise calling the device Decoding the software decoding interface;

Determining a rendering condition provided by the terminal, selecting a matching graphic rendering interface to draw the decoded video stream and outputting the output to the user interface display, and preferentially calling the hardware when the rendering condition includes a hardware rendering interface and a software rendering interface The rendering interface is rendered, otherwise the software rendering interface is called for rendering.
The method according to claim 1, wherein before the determining the decoding condition provided by the terminal and determining the rendering condition provided by the terminal, the method further includes:

Determine the operating system version of the terminal.
The method according to claim 2, wherein the operating system is a WINDOWS system, and when the operating system of the terminal is a WINDOWS7 version or a WINDOWS7 or higher version, the terminal is determined to meet the preconditions for providing hardware decoding and hardware rendering, otherwise The software decoding interface decodes the video stream, and then calls the software rendering interface to draw the decoded video stream and output it to the user interface for display.
The method according to claim 1, wherein the step of determining a decoding condition provided by the terminal, and selecting a matching decoding interface to decode the video stream, specifically includes:

Determining a decoder type supported by the terminal, the decoder type including an Nvidia hardware decoder, an Intel hardware decoder, and an AMD hardware decoder;

When the terminal supports the Nvidia hardware decoder, the hardware decoding interface of the Nvidia hardware decoder is called to decode the video stream;

When the terminal supports the Intel hardware decoder, the hardware decoding interface of the Intel hardware decoder is called to decode the video stream;

When the terminal supports the AMD hardware decoder, the hardware decoding interface of the AMD hardware decoder is called to decode the video stream.
The method of claim 1 wherein said hardware rendering interface is DirectX 11 graphics rendering interface, when the video stream is hardware decoded, call the DirectX 11 graphics rendering interface to convert the decoded video stream into YUV 420 format, and load it into the texture created by DirectX 11, and then use DirectX 11 device The video stream is drawn and output to the user interface.
The method according to claim 5, wherein when the video stream is decoded by software, the DirectX 11 graphics rendering interface is called to convert the decoded video stream into an RGBA format and loaded in the video memory, and then the DirectX 11 device is used. The video stream is drawn and output to the user interface.
The method according to claim 5 or 6, wherein when the video stream is rendered by hardware, it is determined whether the video stream is a VR video, and if so, 3D graphics rendering is used; otherwise, 2D graphics rendering is adopted.
The method according to claim 1 or 2, wherein after the step of obtaining the video stream between the live broadcasts from the server, the subsequent steps of the method are performed when the control instruction of the user is received.
A video playback control device, comprising:

Read module: used to obtain a video stream between live broadcasts from a server;

a decoding module: configured to determine a decoding condition provided by the terminal, and select an adapted decoding interface to decode the video stream. When the decoding condition includes a hardware decoding interface and a software decoding interface, the hardware decoding interface is preferentially invoked. Decoding, otherwise calling the software decoding interface for decoding;

The rendering module is configured to determine a rendering condition provided by the terminal, and select a matching graphic rendering interface to draw the decoded video stream and output the result to the user interface display. When the rendering condition includes a hardware rendering interface and a software rendering interface, The hardware rendering interface is preferentially invoked for rendering, otherwise the software rendering interface is invoked for rendering.
A terminal device for performing the steps of the method of claims 1-8, comprising: a video decoder, a video rendering engine, a central processing unit, a graphics processor, a memory, and a touch sensitive display.