WO2021082299A1

WO2021082299A1 - Video playback method and device

Info

Publication number: WO2021082299A1
Application number: PCT/CN2020/074921
Authority: WO
Inventors: 陈相镇
Original assignee: 杭州海康威视系统技术有限公司
Priority date: 2019-11-01
Filing date: 2020-02-12
Publication date: 2021-05-06
Also published as: CN112770188B; CN112770188A

Abstract

The embodiments of the present application provide a video playback method and device, used for a web client of an electronic equipment. The method comprises: generating a video acquisition request; sending the video acquisition request to a local server so that the local server can, according to the video acquisition request, acquire and decode a video to be processed to obtain multiple video frames, and sending the multiple video frames to a web client; and receiving the multiple video frames returned by the local server and rendering the multiple video frames. In such a way, the local server does not provide any interface-related functions but only provides data and network services, and thus cross-platform porting of the local server is facilitated and thereby the compatibility of a solution that the acquired video data is playbacked on web by means of the web client is improved.

Description

Method and device for playing video

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on November 1, 2019, the application number is 201911061090.4, and the invention title is "a method and device for video playback", the entire content of which is incorporated into this application by reference .

Technical field

This application relates to the technical field of video processing, and in particular to a video playback method and device.

Background technique

In some scenarios, after the video data is obtained from the server, the obtained video data may be played through the user client, or the obtained video data may be played on the web page through the web client.

In related technologies, the solution for playing the acquired video data on the web page through the web client is: through the browser's OCX (Object Linking and Embedding Control Extension) plug-in or NPAPI (Netscape Plugin Application Programming Interface, Netscape plug-in application programming interface) plug-in, call the video playback module of the corresponding user client, and then play the acquired video data on the webpage through the video playback module.

However, the OCX plug-in or NPAPI plug-in may be unusable in some browsers. In this way, the browser cannot call the video playback module of the user client, resulting in the inability to play the acquired video data on the web page.

Summary of the invention

The purpose of the embodiments of the present application is to provide a video playback method and device, so as to improve the compatibility of the solution of playing the acquired video data on the webpage through the webpage client. The specific technical solutions are as follows:

The embodiment of the application provides a video playback method, which is applied to a web client of an electronic device, and the method includes:

Generate video acquisition request;

Send the video acquisition request to the local server, so that the local server acquires the video to be processed according to the video acquisition request, decodes the video to be processed, and obtains multiple video frames, and sends the multiple video frames to the web client. The server is used to provide network services for electronic devices;

Receive multiple video frames returned by the local server, and render multiple video frames.

Optionally, before rendering multiple video frames, the method further includes:

Create a working thread. The working thread is a web page thread in the HTML5 standard of Hypertext Markup Language. The working thread includes one or more;

In the working thread, create an off-screen canvas;

Render multiple video frames, including:

Call WebGL to render multiple video frames in an off-screen canvas.

Optionally, the video acquisition request is sent to the local server, including:

Establish a websocket connection with the local server;

Through the websocket connection, the video acquisition request is sent to the local server;

Receive the decoded to-be-processed video returned by the local server, including:

Through the websocket connection, receive the decoded to-be-processed video returned by the local server.

Optionally, receiving multiple video frames returned by the local server, and rendering the multiple video frames, including:

Receive multiple video frames returned by the local server;

Store the received multiple video frames in the buffer area;

Obtain video frames from the buffer area according to the video playback parameters;

Render the acquired video frame.

Optionally, after rendering multiple video frames, the method further includes:

Obtain the element to be superimposed corresponding to each video frame;

The elements to be superimposed are superimposed on each rendered video frame, and the superimposed video image is displayed.

Optionally, after sending the video acquisition request to the local server, the method further includes:

Generate a video pause instruction according to the stop playback instruction sent by the user;

The video pause instruction is sent to the local server, so that the local server stops acquiring the video to be processed and stops decoding the video to be processed according to the video pause instruction.

The embodiment of the present application also provides a video playback method, which is applied to a local server of an electronic device, and the method includes:

Receive the video acquisition request sent by the web client of the electronic device, and acquire the to-be-processed video according to the video acquisition request;

Decode the video to be processed to obtain multiple video frames;

Determine the resolution of the multiple video frames obtained, and determine the data transmission format of the multiple video frames according to the resolution;

According to the data transmission format, multiple video frames are sent to the web client, so that the web client renders the multiple video frames.

An embodiment of the application also provides a video playback device, which is applied to a web client of an electronic device, and the device includes:

The generation module is used to generate a video acquisition request;

The sending module is used to send the video acquisition request to the local server, so that the local server acquires the video to be processed according to the video acquisition request, decodes the video to be processed, obtains multiple video frames, and sends the multiple video frames to Web client, the local server is used to provide network services for electronic devices;

The rendering module is used to receive multiple video frames returned by the local server and render multiple video frames.

Optionally, the rendering module is also used for:

In the working thread, create an off-screen canvas;

Call WebGL to render multiple video frames in an off-screen canvas.

Optionally, the sending module is specifically used for:

Establish a websocket connection with the local server;

The rendering module is also used to connect through the websocket to receive the decoded to-be-processed video returned by the local server.

Optionally, the rendering module is specifically used for:

Receive multiple video frames returned by the local server;

Store the received multiple video frames in the buffer area;

Render the acquired video frame.

Optionally, the rendering module is also used for:

Obtain the element to be superimposed corresponding to each video frame;

Optionally, the generating module is also used to generate a video pause instruction according to the stop playing instruction sent by the user after the video acquisition request is sent to the local server;

The sending module is also used to send the video pause instruction to the local server, so that the local server stops acquiring the video to be processed according to the video pause instruction, and stops decoding the video to be processed.

The embodiment of the present application also provides a video playback device, which is applied to a local server of an electronic device, and the device includes:

The receiving module is used to receive the video acquisition request sent by the web client of the electronic device, and obtain the video to be processed according to the video acquisition request;

The decoding module is used to decode the video to be processed to obtain multiple video frames;

The determining module is used to determine the resolutions of the obtained multiple video frames, and determine the data transmission format of the multiple video frames according to the resolution;

The sending module is used to send multiple video frames to the web client according to the data transmission format, so that the web client renders the multiple video frames.

An embodiment of the present application also provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;

Memory, used to store computer programs;

The processor is used to implement any one of the above-mentioned video playback methods when executing the program stored in the memory.

The embodiments of the present application also provide a computer-readable storage medium, and a computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, any one of the above-mentioned video playback methods is implemented.

The embodiments of the present application also provide a computer program product containing instructions, which when run on a computer, cause the computer to execute the video playback method described in any of the above embodiments.

The video playback method and device provided in the embodiments of this application can be applied to the web client of an electronic device. First, a video acquisition request is generated, and then the video acquisition request is sent to the local server, so that the local server can obtain the video according to the video acquisition request. , Obtain the video to be processed, decode the video to be processed, obtain multiple video frames, and send the multiple video frames to the web client, where the local server is used to provide network services for electronic devices, and in turn, receive the local server The returned multiple video frames are used to render multiple video frames. In this way, the local server does not provide any interface-related functions, but only provides data and network services, which is conducive to the cross-platform migration of the local server, which can improve the compatibility of the program of playing the acquired video data on the web page through the web client. Sex. Of course, implementing any product or method of the present application does not necessarily need to achieve all the above advantages at the same time.

Description of the drawings

In order to explain the embodiments of the present application and the technical solutions of the prior art more clearly, the following briefly introduces the drawings needed in the embodiments and the prior art. Obviously, the drawings in the following description are merely the present For some of the applied embodiments, those of ordinary skill in the art can obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic flowchart of a video playback method applied to a web client of an electronic device according to an embodiment of the application;

2 is a schematic diagram of the function distribution of the web client and the local server in the video playback method provided by the embodiment of the application;

3 is a schematic flowchart of a video playback method applied to a local server of an electronic device according to an embodiment of the application;

FIG. 4 is a timing diagram between a web client and a local server in the video playback method provided by an embodiment of the present application in an implementation manner;

FIG. 5 is a schematic structural diagram of a video playback device applied to a web client of an electronic device according to an embodiment of the application;

6 is a schematic structural diagram of a video playback device applied to a local server of an electronic device according to an embodiment of the application;

FIG. 7 is a schematic structural diagram of an electronic device provided by an embodiment of the application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

In related technologies, the scheme of playing the acquired video data on the webpage through the webpage client is: through the browser's OCX plug-in or NPAPI plug-in, call the video playback module of the corresponding user client, and then use the video playback module to display the video on the webpage. Play the acquired video data.

In order to solve the above-mentioned technical problems, embodiments of the present application provide a video playback method, which can be applied to a web client of an electronic device.

The following describes the video playback method provided in the embodiments of the present application as a whole.

In an implementation manner, the foregoing video playback method includes:

Generate video acquisition request;

Send the video acquisition request to the local server, so that the local server acquires the video to be processed according to the video acquisition request, decodes the video to be processed, obtains multiple video frames, and sends the multiple video frames to the web client;

It can be seen from the above that, in the video playback method provided by the embodiments of the present application, the local server does not provide any interface-related functions, but only provides data and network services, which is beneficial to the cross-platform migration of the local server, which can improve the access to the web client. The compatibility of the scheme for playing the acquired video data on the web page.

The following will describe in detail the video playback method provided in the embodiments of the present application through specific embodiments.

As shown in FIG. 1, it is a schematic flowchart of a video playback method provided by an embodiment of this application, which is applied to a web client of an electronic device, and the method includes the following steps:

S101: Generate a video acquisition request.

For example, the client can generate a video acquisition request according to the user's video playback instruction. For example, the user can open the preset interface on the web client, and include a list of videos in the preset interface. Then, the user can select a video from the list as the video to be played, and by clicking the play button of the video, Send a video play instruction for the video, and further, after receiving the video play instruction, the client generates a video acquisition request for the video.

S102: Send the video acquisition request to the local server, so that the local server acquires the video to be processed according to the video acquisition request, decodes the video to be processed, obtains multiple video frames, and sends the multiple video frames to the web client .

Among them, the local server is used to provide network services for electronic devices (executors), and is a program running in the background. It can be understood that other electronic devices cannot access the local server, and only applications currently running on the electronic device (executor) can access the local server.

In one implementation, before the video acquisition request is sent to the local server, a websocket (network socket) connection with the local server can be established in advance, and then the video acquisition request is sent to the local through the websocket connection The server, and the local server can return the decoded to-be-processed video through the websocket connection.

It can be understood that webSocket makes the data exchange between the web client and the local server easier, allowing the local server to actively push data to the web client, and the web client and the local server only need to complete a handshake. You can directly create a persistent connection and perform two-way data transmission.

In an implementation manner, the web client may receive multiple concurrent video playback instructions from the user, that is, the web client generates multiple video acquisition requests and needs to play video frames of multiple videos concurrently. In this case, the web client needs to establish a websocket connection between the video and the local server in advance for each video, and then send the video acquisition request to the local server through the websocket connection corresponding to the video, and , The local server can return the decoded to-be-processed video through the websocket connection corresponding to the video. In other words, for different videos, the websocket connection between the web client and the local server is independent of each other.

In this way, when multiple videos are played concurrently, the data transmission of multiple videos will not affect each other, and even if one of the video data is transmitted incorrectly, the other videos can also perform data transmission normally.

For example, the to-be-processed video obtained by the local server can be the file of the to-be-processed video or the code stream of the to-be-processed video. The video acquisition request can include the URL (Uniform Resource Locator) address of the video to be processed. In this way, after the local server receives the video acquisition request, it can obtain the URL address of the video to be processed according to the URL address of the video to be processed. video.

The local server sends the decoded multiple video frames to the web client according to the corresponding data transmission format, where the data transmission format can be determined by the local server. After obtaining multiple video frames, the local server can further analyze the obtained multiple video frames to determine the resolution of each video frame, and then determine the data transmission format of the video frame according to the resolution of the video frame, and According to the determined data transmission format, multiple video frames are sent to the web client.

For example, the data transmission format of a video frame can include YUV, JPEG (Joint Photographic Experts Group), or PNG (Portable Network Graphics, portable network graphics), etc. Among them, the amount of video frame data in the YUV format is relatively large. , JPEG format has a small amount of video frame data, but JPEG format will lose part of the video frame information. In this way, when the resolution of the video frame is high, multiple video frames can be sent to the web client according to the JPEG format, thereby reducing the amount of data transmission and reducing the overload of data transmission, and when the resolution of the video frame is low At the same time, multiple video frames can be sent to the web client according to the YUV format, and the information in the video frames can be preserved as much as possible.

S103: Receive multiple video frames returned by the local server, and render the multiple video frames.

In one implementation, if the browser corresponding to the web client supports OffscreenCanvas (off-screen canvas), then before rendering multiple video frames, you can create a Worker (worker thread), where Worker is HTML5 (HyperText Markup Language 5.0, Hypertext Markup Language 5.0) The webpage thread in the standard, the work thread includes one or more, which can realize the multi-threaded work of the webpage client.

Then, you can create OffscreenCanvas in Worker. OffscreenCanvas is an API (Application Programming Interface). Through OffscreenCanvas, Canvas (canvas) can be called in Worker, so that web clients can load Canvas in Worker. And operate Canvas to display images, thereby effectively improving the rendering performance of the web client.

In this way, when rendering multiple video frames, multiple video frames can be rendered based on OffscreenCanvas. For example, you can call WebGL (Web Graphics Library) to render multiple video frames in OffscreenCanvas.

In an implementation manner, the web client may receive multiple concurrent video playback instructions from the user, that is, the web client generates multiple video acquisition requests and needs to play video frames of multiple videos concurrently. In this case, the web client needs to create a Worker corresponding to the video for each video, and then, in the Worker corresponding to the video, create an OffscreenCanvas corresponding to the video. In other words, each video has its unique corresponding Worker and OffscreenCanvas.

In this way, when multiple videos are played concurrently, the multiple videos will not affect each other, and even if one of the videos is played incorrectly, the other videos can be played normally.

In another implementation manner, if the browser corresponding to the web client does not support OffscreenCanvas, the main thread can receive multiple video frames returned by the local server, and render multiple video frames.

In this step, after receiving the decoded to-be-processed video returned by the local server, the received multiple video frames can be stored in the buffer area, and then the video frames are obtained from the buffer area according to the video playback parameters, and then Render the acquired video frame.

Among them, the video playback parameters may be generated by the playback control module. For example, the playback control module may obtain video frames from the buffer area at a uniform speed according to the video frame rate, and push the obtained video frames to the audio and video rendering module for rendering. In this way, the function of playing audio and video smoothly. For example, if the frame rate of the video is 25FPS (Frame Per Second, the number of frames transmitted per second), the playback control module acquires video frames at a constant rate at a rate of acquiring one frame every 40 milliseconds.

Alternatively, the video playback parameters can also be parsed from the video acquisition request. For example, the user can set the frame rate when playing the video. In this way, the video acquisition request can carry the frame rate set by the user, and further, The video frame can be obtained according to the frame rate set by the user.

In addition, in one implementation, the web client can also perform element superposition. After rendering multiple video frames, it can obtain the elements to be superimposed corresponding to each video frame, and superimpose the elements to be superimposed on each rendered Above the video frame, the superimposed video picture is displayed.

Among them, the elements to be superimposed can be text, images, special effects, etc., can be elements manually added by the user, or can be superimposed on specific elements according to preset rules, which are not specifically limited. Through element superposition, the video images displayed to users can be made richer.

When the video acquisition request is sent to the local server and the stop playback instruction sent by the user is received, the web client can generate a video pause instruction, and then send the video pause instruction to the local server to make the local server pause according to the video Instruction to stop obtaining the video to be processed, and stop decoding the video to be processed. In this way, the web client cannot obtain the video frame returned by the local server, and cannot render the video frame. Thus, the playback of the video is stopped.

Further, the local server can return a stop result to the web client. After receiving the stop result returned by the local server, the web client can close the work thread and off-screen canvas, thereby reducing resource occupancy as soon as possible.

In the embodiment of this application, the function distribution of the web client and the local server is shown in Figure 2. The web client performs video rendering, playback control, and element overlay, and the local server obtains and reads the to-be-processed video through the websocket service. , Functions such as decoding the video to be processed.

As shown in FIG. 3, a schematic flowchart of a video playback method provided by an embodiment of this application is applied to a local server of an electronic device, and the method includes the following steps:

S301: Receive a video acquisition request sent by a web client of the electronic device, and acquire a to-be-processed video according to the video acquisition request.

In one implementation, the web client can pre-establish a websocket connection with the local server, and then send the video acquisition request to the local server through the websocket connection, and the local server can return the decoded via the websocket connection Pending video.

S302: Decode the video to be processed to obtain multiple video frames.

For example, the to-be-processed video obtained by the local server may be a file of the to-be-processed video, or it may be a code stream of the to-be-processed video. The video acquisition request can include the URL (Uniform Resource Locator) address of the video to be processed. In this way, after the local server receives the video acquisition request, it can obtain the URL address of the video to be processed according to the URL address of the video to be processed. video.

S303: Determine the resolution of the obtained multiple video frames, and determine the data transmission format of the multiple video frames according to the resolution.

For example, the data transmission format of a video frame can include YUV, JPEG, or PNG. Among them, the amount of video frame data in the YUV format is larger, and the amount of video frame data in the JPEG format is smaller. However, the JPEG format will lose the amount of video frame data. Part of the information. In this way, when the resolution of the video frame is high, multiple video frames can be sent to the web client according to the JPEG format, thereby reducing the amount of data transmission and reducing the overload of data transmission, and when the resolution of the video frame is low At the same time, multiple video frames can be sent to the web client according to the YUV format, and the information in the video frames can be preserved as much as possible.

S304: Send multiple video frames to the web client according to the data transmission format, so that the web client renders the multiple video frames.

After receiving the stop playback instruction sent by the user, the web client can generate a video pause instruction, and then send the video pause instruction to the local server, so that the local server stops acquiring the pending video according to the video pause instruction, and stops Decode the video to be processed. In this way, the web page client cannot obtain the video frame returned by the local server, and cannot render the video frame. Thus, the playback of the video is stopped.

For example, as shown in FIG. 4, it is a timing diagram between the web client and the local server in the video playback method provided in the embodiment of the present application in an implementation manner. among them:

S401: The web client obtains the video obtaining request sent by the user, creates a working thread, creates an off-screen canvas in the working thread, and establishes a websocket connection with a local server.

S402: The web client sends the video acquisition request to the local server.

S403: The local server obtains the video to be processed according to the video acquisition request, decodes the video to be processed, and obtains multiple video frames.

S404: The local server sends multiple video frames to the web client.

S405: The web client receives multiple video frames returned by the local server, stores the received multiple video frames in the buffer area, and obtains the video frames from the buffer area according to the video playback parameters, and performs processing on the obtained video frames. Rendering.

S406: The web client receives the stop playing instruction sent by the user, and generates a video pause instruction.

S407: The web client sends the video pause instruction to the local server.

S408: According to the video pause instruction, the local server stops acquiring the video to be processed, and stops decoding the video to be processed.

S409: The local server returns a stop result to the web client.

S410: The web client closes the working thread and off-screen canvas.

It can be seen from the above that in the video playback method provided by the embodiments of the present application, the local service does not provide any interface-related functions, but only provides data and network services, which is conducive to the cross-platform migration of local services, which can improve the Compatibility of the scheme for playing the acquired video data in the webpage.

As shown in FIG. 5, an embodiment of the present application also provides a video playback device, which is applied to a web client of an electronic device, and the device includes:

The generating module 501 is used to generate a video acquisition request;

The sending module 502 is used to send the video acquisition request to the local server, so that the local server acquires the video to be processed according to the video acquisition request, decodes the video to be processed, obtains multiple video frames, and sends the multiple video frames To the web client, the local server is used to provide network services for electronic devices;

The rendering module 503 is configured to receive multiple video frames returned by the local server, and render the multiple video frames.

In an implementation manner, the rendering module 503 is also used for:

In the working thread, create an off-screen canvas;

Based on off-screen canvas, multiple video frames are rendered.

In an implementation manner, the rendering module 503 is also used for:

Call WebGL to render multiple video frames in an off-screen canvas.

In an implementation manner, the sending module 502 is specifically used for:

Establish a websocket connection with the local server;

The rendering module 503 is also used for receiving the decoded to-be-processed video returned by the local server through a websocket connection.

In one implementation manner, the rendering module 503 is specifically used for:

Receive multiple video frames returned by the local server;

Store the received multiple video frames in the buffer area;

Render the acquired video frame.

In an implementation manner, the rendering module 503 is also used for:

Obtain the element to be superimposed corresponding to each video frame;

In an implementation manner, the generating module 501 is further configured to generate a video pause instruction according to a stop playing instruction sent by the user after the video acquisition request is sent to the local server;

The sending module 502 is also used to send the video pause instruction to the local server, so that the local server stops acquiring the video to be processed according to the video pause instruction, and stops decoding the video to be processed.

It can be seen from the above that in the video playback device provided by the embodiment of the present application, the local server does not provide any interface-related functions, but only provides data and network services, which is beneficial to the cross-platform migration of the local server, which can improve the accessibility of the web client. The compatibility of the scheme for playing the acquired video data on the web page.

As shown in FIG. 6, an embodiment of the present application also provides a video playback device, which is applied to a local server of an electronic device, and the device includes:

The receiving module 601 is configured to receive a video acquisition request sent by a web client of an electronic device, and obtain a video to be processed according to the video acquisition request;

The decoding module 602 is configured to decode the video to be processed to obtain multiple video frames;

The determining module 603 is configured to determine the resolution of the obtained multiple video frames, and determine the data transmission format of the multiple video frames according to the resolution;

The sending module 604 is configured to send multiple video frames to the web client according to the data transmission format, so that the web client renders the multiple video frames.

An embodiment of the present application also provides an electronic device, as shown in FIG. 7, including a processor 701, a communication interface 702, a memory 703, and a communication bus 704. The processor 701, the communication interface 702, and the memory 703 pass through the communication bus 704. Complete the communication between each other,

The memory 703 is used to store computer programs;

The processor 701 is configured to execute a program stored in the memory 703.

Among them, the program stored in the memory 703 can implement the following steps:

Generate video acquisition request;

Alternatively, the program stored in the memory 703 may also implement the following steps:

Decode the video to be processed to obtain multiple video frames;

It can be seen from the above that in the electronic equipment provided by the embodiments of the present application, the local server does not provide any interface-related functions, but only provides data and network services, which is beneficial to the cross-platform migration of the local server, thereby improving the access to the web client. Compatibility of the scheme for playing the acquired video data in the webpage.

The communication bus mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the above-mentioned electronic device and other devices.

The memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage. Optionally, the memory may also be at least one storage device located far away from the foregoing processor.

The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it may also be a digital signal processor (Digital Signal Processing, DSP), a dedicated integrated Circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

In yet another embodiment provided in this application, a computer-readable storage medium is also provided. The computer-readable storage medium stores instructions that, when run on a computer, cause the computer to execute any of the above-mentioned embodiments. The described video playback method.

In another embodiment provided in this application, a computer program product containing instructions is also provided, which when running on a computer, causes the computer to execute the video playback method described in any of the above embodiments.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, computer instructions may be transmitted from a website, computer, server, or data center through a cable (such as Coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to transmit to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply one of these entities or operations. There is any such actual relationship or order between. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or equipment. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or equipment that includes the element.

The various embodiments in this specification are described in a related manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the device embodiment, the electronic device embodiment, and the storage medium embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.

The above are only preferred embodiments of the present application, and are not used to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application are all included in the protection scope of this application.

Claims

A video playback method, characterized in that it is applied to a web client of an electronic device, and the method includes:

Generate video acquisition request;

The video acquisition request is sent to the local server, so that the local server acquires the video to be processed according to the video acquisition request, decodes the video to be processed, and obtains multiple video frames, and then Multiple video frames are sent to the web client, and the local server is used to provide network services for the electronic device;

Receiving the multiple video frames returned by the local server, and rendering the multiple video frames.
The method according to claim 1, characterized in that, before the rendering the multiple video frames, the method further comprises:

Creating a working thread, where the working thread is a web page thread in the Hypertext Markup Language HTML5 standard, and the working thread includes one or more;

In the working thread, create an off-screen canvas;

The rendering the multiple video frames includes:

The network graphics library WebGL is called, and the multiple video frames are rendered in the off-screen canvas.
The method according to claim 1, wherein the sending the video acquisition request to a local server comprises:

Establish a websocket connection with the local server;

Sending the video acquisition request to the local server through the websocket connection;

The receiving the decoded to-be-processed video returned by the local server includes:

Receive the decoded to-be-processed video returned by the local server through the websocket connection.
The method according to claim 1, wherein the receiving the multiple video frames returned by the local server and rendering the multiple video frames comprises:

Receiving the multiple video frames returned by the local server;

Storing the received multiple video frames in a buffer area;

Obtaining video frames from the buffer area according to the video playback parameters;

Render the acquired video frame.
The method according to claim 1, wherein after the rendering of the multiple video frames, the method further comprises:

Obtain the element to be superimposed corresponding to each video frame;

The element to be superimposed is superimposed on each rendered video frame, and the superimposed video picture is displayed.
The method according to claim 1, wherein after sending the video acquisition request to a local server, the method further comprises:

Generate a video pause instruction according to the stop playback instruction sent by the user;

The video pause instruction is sent to the local server, so that the local server stops acquiring the video to be processed and stops decoding the video to be processed according to the video pause instruction.
A video playback method, characterized in that it is applied to a local server of an electronic device, and the method includes:

Receiving a video acquisition request sent by a web client of the electronic device, and acquiring a video to be processed according to the video acquisition request;

Decode the to-be-processed video to obtain multiple video frames;

Determine the resolutions of the obtained multiple video frames, and determine the data transmission format of the multiple video frames according to the resolutions;

According to the data transmission format, the multiple video frames are sent to the web client, so that the web client renders the multiple video frames.
A video playback device, characterized in that it is applied to a web client of an electronic device, and the device includes:

The generation module is used to generate a video acquisition request;

The sending module is configured to send the video acquisition request to the local server, so that the local server acquires the video to be processed according to the video acquisition request, decodes the video to be processed, and obtains multiple video frames , And sending the multiple video frames to the web client, and the local server is used to provide network services for the electronic device;

The rendering module is configured to receive the multiple video frames returned by the local server, and render the multiple video frames.
A video playback device, characterized in that it is applied to a local server of an electronic device, and the device includes:

A receiving module, configured to receive a video acquisition request sent by a web client of the electronic device, and acquire a video to be processed according to the video acquisition request;

A decoding module for decoding the to-be-processed video to obtain multiple video frames;

A determining module, configured to determine the resolution of the obtained multiple video frames, and determine the data transmission format of the multiple video frames according to the resolution;

The sending module is configured to send the multiple video frames to the web client according to the data transmission format, so that the web client renders the multiple video frames.
An electronic device, characterized by comprising a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory complete mutual communication through the communication bus;

Memory, used to store computer programs;

The processor is configured to implement the method steps described in any one of claims 1 to 6 or claim 7 when executing the program stored in the memory.
A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1 to 6 or claim 7 is implemented step.