CN111246253B - Video streaming method and device - Google Patents

Abstract

The invention provides a video stream transmission method and a video stream transmission device, which relate to the technical field of data transmission and comprise the steps of sending a request for establishing communication transmission connection to a Content Delivery Network (CDN) node; and after the communication transmission connection is successfully established, sending mixing data obtained by performing mixing processing operation on the video stream data to the content delivery network CDN node, wherein the starting time point of the mixing processing operation does not occur after the time point of sending the establishment request of the communication transmission connection, and the mixing processing operation is not performed after the communication transmission connection request, so that the transmission delay is reduced, and seamless transmission is realized.

Description

Video streaming method and device

technical field

The present invention relates to the technical field of data transmission, and in particular, to a video stream transmission method and device.

Background technique

The vigorous development of the live broadcast industry has brought opportunities to the CDN (Content Delivery Network, Content Delivery Network) live broadcast business. At present, the main mode of live broadcast is: the streamer pushes the live stream to the CDN edge node (edge streaming server) through the RTMP (Real Time Messaging Protocol) protocol; the CDN edge node is distributed to provide RTMP, HTTP (HyperText Transfer Protocol, hypertext transfer protocol) + FLV (FlashVideo, Flash video), HLS (HTTP Live Streaming, HTTP real-time streaming media) and other services.

The current video stream transmission method is: after the mixing server establishes a connection with the CDN, the mixing server performs mixing processing to generate a mixing file, and then sends the mixing file to the CDN. However, because the mixing server usually needs to mix large-scale data, there will be a certain time delay after the CDN connection is established, and the CDN will mistakenly believe that the connection is faulty, resulting in unsmooth video data streaming.

SUMMARY OF THE INVENTION

The purpose of the present invention is to provide a video stream transmission method and device, which can reduce transmission delay and realize seamless transmission by not performing a frequency mixing operation after a communication transmission connection request.

In a first aspect, the embodiment provides a video stream transmission method, including:

Send a request for establishing a communication transmission connection to the CDN node of the content distribution network;

After the communication transmission connection is successfully established, the frequency mixing data obtained by performing the frequency mixing processing operation on the video stream data is sent to the CDN node of the content distribution network, wherein the frequency mixing processing operation is not after sending the establishment request of the communication transmission connection occur.

In an optional implementation manner, the step of sending a request for establishing a communication transmission connection to a CDN node of a content distribution network includes:

First, perform a frequency mixing operation on the video stream data to obtain the frequency mixing data;

Then, a request for establishing a communication transmission connection is sent to the CDN node of the content distribution network.

In an optional implementation manner, before the step of sending the mixing data obtained by performing the mixing operation on the video stream data to the CDN node of the content distribution network, the method further includes:

The mixing data is buffered.

In an optional implementation manner, the step of sending a request for establishing a communication transmission connection to a CDN node of a content distribution network includes:

When the mixing data is obtained by performing the mixing processing operation on the video stream data, a request for establishing a communication transmission connection is sent to the CDN node of the content distribution network.

In an optional implementation manner, the step of mixing data obtained by mixing the video stream data includes:

The frequency mixing operation is performed on video frames of the same time in the video stream data from at least one acquisition device to obtain frequency mixing data.

In an optional embodiment, the method further includes:

A request for establishing the communication transmission connection sent by the CDN node of the content distribution network is received.

In an optional implementation manner, the mixing data is used for the client to simultaneously display video stream data from at least one acquisition device.

In a second aspect, the embodiment provides a video streaming device, comprising:

a request establishment module, configured to send a communication transmission connection establishment request to the CDN node of the content distribution network;

A frequency mixing transmission module, configured to send the frequency mixing data obtained by performing the frequency mixing processing operation on the video stream data to the CDN node of the content distribution network after the communication transmission connection is successfully established, wherein the frequency mixing processing operation is not sending Occurs after an establishment request for a communication transport connection.

In a third aspect, an embodiment provides an electronic device, including a memory, a processor, and a program stored on the memory and capable of running on the processor, and the processor implements the foregoing embodiments when the processor executes the program The video streaming method described in any one of.

In a fourth aspect, the embodiments provide a computer-readable storage medium, where a computer program is stored in the readable storage medium, and when the computer program is executed, the video streaming method described in any one of the foregoing embodiments is implemented.

Embodiments of the present invention provide a video transmission method and device, by sending a request for establishing a communication transmission connection to a CDN node of a content distribution network, and after the communication transmission connection is successfully established, sending the video stream data to the CDN node of the content distribution network The mixing data obtained by the mixing processing operation is used to realize the transmission of video stream data. In order to ensure the seamless transmission of the video stream data and reduce the delay, the mixing processing operation is not performed after sending the establishment request of the communication transmission connection. occur.

Other features and advantages of the present invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the description and drawings.

In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below, and are described in detail as follows in conjunction with the accompanying drawings.

Description of drawings

In order to illustrate the specific embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the specific embodiments or the prior art. Obviously, the accompanying drawings in the following description The drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative efforts.

1 is a flowchart of a video stream transmission method according to an embodiment of the present invention;

2 is a schematic diagram of functional modules of a video stream transmission device according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a hardware architecture of an electronic device according to an embodiment of the present invention.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of them. example. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

At present, because the mixing server usually deals with large-scale data, after the connection is established, there will be a certain delay before the mixing data is generated. During this delay, the CDN will mistakenly think that the connection is faulty. The transmission of data flow is not smooth.

Based on this, the video stream transmission method and device provided by the embodiments of the present invention can reduce transmission delay and realize seamless transmission by not performing a frequency mixing operation after a communication transmission connection request.

To facilitate understanding of this embodiment, a video stream transmission method disclosed in this embodiment of the present invention is first introduced in detail.

FIG. 1 is a flowchart of a video stream transmission method according to an embodiment of the present invention.

Referring to FIG. 1 , the video stream transmission method provided by the embodiment may be applied to the server side, and the method may at least include the following steps:

Step S102, sending a request for establishing a communication transmission connection to a CDN node of a content distribution network;

Step S104: After the communication and transmission connection is successfully established, the frequency mixing data obtained by performing the frequency mixing processing operation on the video stream data is sent to the CDN node of the content distribution network, wherein the start time point of the frequency mixing processing operation is not at the time of sending the communication transmission connection. Occurs after the point in time when the request was established.

In a preferred embodiment of practical application, a request for establishing a communication transmission connection is sent to the CDN node of the content distribution network, and after the communication transmission connection is successfully established, the operation of mixing the video stream data is sent to the CDN node of the content distribution network. The obtained frequency mixing data is used to realize the transmission of video stream data, wherein, in order to ensure seamless transmission of video stream data and reduce delay, the frequency mixing operation does not occur after sending the establishment request of the communication transmission connection.

In an optional implementation manner, the above step S102 may be implemented by the following steps:

Step 1.1), first perform a mixing process operation on the video stream data to obtain mixing data;

Step 1.2), and then send a request for establishing a communication transmission connection to the CDN node of the content distribution network.

Here, a frequency mixing operation is performed on the video stream data first, and then the communication transmission connection is established after the frequency mixing operation is completed, so as to avoid a delay in performing the frequency mixing operation on the video stream after the communication transmission connection is established first.

In an optional implementation manner, before step S102, it further includes:

Step 2.1), buffer the mixing data.

Among them, the mixed frequency data can be cached in the database, and when the communication transmission connection is established, the data can be called from the cached database.

In an optional implementation manner, the above step S102 can also be implemented by the following steps:

Step 3.1), when the mixing data is obtained by performing the mixing processing operation on the video stream data, a request for establishing a communication transmission connection is sent to the CDN node of the content distribution network.

Here, in order to improve the data transmission efficiency, it is also possible to send an establishment request for establishing a communication transmission connection while the video stream data is being mixed. The mixing data transmitted through the communication transmission connection is not corresponding to the overall video stream data, but the mixing data generated in real time, which is a part of the overall video stream data.

In an optional implementation manner, the step of performing the mixing process operation on the video stream data in step S104 to obtain the mixing data includes:

Step 4.1), performing a frequency mixing operation on video frames of the same time in the video stream data from at least one acquisition device to obtain frequency mixing data.

Here, the video stream data may come from different cameras or servers. In an actual live broadcast scenario, it may be necessary to display the game scene picture and the portrait picture captured by the camera at the same time on one page at the same time.

In an optional implementation manner, the mixing data is used for the client to simultaneously display video stream data from at least one acquisition device.

It can be understood that the video stream data here may come from the same user client or multiple different user clients.

As an optional embodiment, for the same user client, the mixing data can be simultaneously acquired by multiple acquisition devices or acquired by selecting any acquisition device. For example, user A acquires user A's data through the first acquisition device. video data, and obtain game operation data in user A's client through the second collection device, or user B obtains user B's video data through a smart device with front and rear cameras, and user B can select any camera to capture. The number of cameras of the smart device here is not limited to two.

In an optional embodiment, the method further includes:

Step 5.1): Receive the establishment request of the communication transmission connection sent by the CDN node of the content distribution network.

As an optional embodiment, the mixing server establishes a connection with the CDN node according to the establishment request sent by the CDN node of the content distribution network, and pushes the mixed mixing data to the CDN node of the content distribution network. The user client sends the data request to the CDN node, the CDN node parses the data request, and sends the parsing and verification pass signal to the user client. The user client actively pulls the mixing data from the CDN node, or mixes the frequency according to the actual protocol. Data is pushed to the user client.

As an optional embodiment, the mixing server establishes a connection with the CDN node according to the establishment request sent by the CDN node of the content distribution network, performs mixing operation at the same time, and pushes the mixing data to the CDN node of the content distribution network. The user client sends the data request to the CDN node, the CDN node parses the data request, and sends the parsing and verification pass signal to the user client. The user client actively pulls the mixing data from the CDN node, or mixes the frequency according to the actual protocol. Data is pushed to the user client.

As shown in FIG. 2, an embodiment of the present invention provides a video streaming device, including:

a request establishment module, configured to send a communication transmission connection establishment request to the CDN node of the content distribution network;

A frequency mixing transmission module, configured to send the frequency mixing data obtained by performing the frequency mixing processing operation on the video stream data to the CDN node of the content distribution network after the communication transmission connection is successfully established, wherein the frequency mixing processing operation is not sending Occurs after an establishment request for a communication transport connection.

In an optional implementation manner, the request establishment module is further specifically configured to first perform a frequency mixing operation on the video stream data to obtain frequency mixing data; and then send a communication transmission connection establishment request to the CDN node of the content distribution network.

In an optional implementation manner, the request establishment module is further specifically configured to, before the step of sending the mixing data obtained by performing the mixing processing operation on the video stream data to the CDN node of the content distribution network, generate the frequency mixing of the video stream data. data is cached.

In an optional embodiment, the request establishment module is further specifically configured to send a communication transmission connection establishment request to the CDN node of the content distribution network when the video stream data is mixed data obtained by a frequency mixing operation.

In an optional implementation manner, the frequency mixing transmission module is further specifically configured to perform a frequency mixing operation on video frames of the same time in the video stream data from at least one acquisition device to obtain frequency mixing data.

In an optional implementation manner, the request establishment module is further specifically configured to receive an establishment request of the communication transmission connection sent by the CDN node of the content distribution network.

In an optional implementation manner, the mixing data is used for the client to simultaneously display video stream data from at least one acquisition device.

The embodiment of the present invention provides an electronic device for realizing an electronic device. In this embodiment, the electronic device may be, but is not limited to, a personal computer (Personal Computer, PC), a notebook computer, a monitoring device, a server, etc. Computer equipment with processing power.

As an exemplary embodiment, referring to FIG. 3, an electronic device 300 includes a communication interface 301, a processor 302, a memory 303, and a bus 304. The processor 302, the communication interface 301, and the memory 303 are connected through the bus 304; the above-mentioned memory 303 For storing a computer program that supports the processor 302 to perform the above-mentioned image sharpening method, the above-mentioned processor 302 is configured to execute the program stored in the memory 303 .

A machine-readable storage medium referred to herein can be any electronic, magnetic, optical, or other physical storage device that can contain or store information, such as executable instructions, data, and the like. For example, the machine-readable storage medium may be: RAM (Radom Access Memory, random access memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard disk drive), any type of storage disk (such as optical disk) , DVD, etc.), or similar storage media, or a combination thereof.

The non-volatile medium may be non-volatile memory, flash memory, storage drives (eg, hard drives), storage disks of any type (eg, optical discs, dvds, etc.), or similar non-volatile storage media, or a combination thereof.

It can be understood that, for the specific operation method of each functional module in this embodiment, reference may be made to the detailed description of the corresponding steps in the above method embodiment, and details are not repeated here.

A computer-readable storage medium provided by an embodiment of the present invention stores a computer program in the readable storage medium. When the computer program code is executed, the video stream transmission method described in any of the above-mentioned embodiments can be implemented. Refer to the method embodiment, which is not repeated here.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the system and device described above, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In addition, in the description of the embodiments of the present invention, unless otherwise expressly specified and limited, the terms "installed", "connected" and "connected" should be understood in a broad sense, for example, it may be a fixed connection or a detachable connection , or integrally connected; it can be a mechanical connection or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate medium, or the internal communication between the two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood in specific situations.

In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. The indicated orientation or positional relationship is based on the orientation or positional relationship shown in the accompanying drawings, which is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the indicated device or element must have a specific orientation or a specific orientation. construction and operation, and therefore should not be construed as limiting the invention. Furthermore, the terms "first", "second", and "third" are used for descriptive purposes only and should not be construed to indicate or imply relative importance.

Finally, it should be noted that the above-mentioned embodiments are only specific implementations of the present invention, and are used to illustrate the technical solutions of the present invention, but not to limit them. The protection scope of the present invention is not limited thereto, although referring to the foregoing The embodiment has been described in detail the present invention, those of ordinary skill in the art should understand: any person skilled in the art who is familiar with the technical field within the technical scope disclosed by the present invention can still modify the technical solutions described in the foregoing embodiments. Or can easily think of changes, or equivalently replace some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be covered in the present invention. within the scope of protection.

Claims (9)

1. a video stream transmission method, is characterized in that, comprises: Send a request for establishing a communication transmission connection to the CDN node of the content distribution network; After the communication transmission connection is successfully established, the frequency mixing data obtained by performing the frequency mixing processing operation on the video stream data is sent to the CDN node of the content distribution network, wherein the start time point of the frequency mixing processing operation is not in sending the communication transmission connection occurs after the point in time of the establishment request; The step of sending a request for establishing a communication transmission connection to a CDN node of a content distribution network includes: When the mixing data is obtained by performing the mixing processing operation on the video stream data, a request for establishing a communication transmission connection is sent to the CDN node of the content distribution network, wherein the mixing data transmitted through the communication transmission connection in real time is not the corresponding overall video Streaming data, but mixing data generated in real time, is part of the overall video stream data. 2. The video stream transmission method according to claim 1, wherein the step of sending the establishment request of the communication transmission connection to the CDN node of the content distribution network comprises: First, perform a frequency mixing operation on the video stream data to obtain the frequency mixing data; Then, a request for establishing a communication transmission connection is sent to the CDN node of the content distribution network. 3. The video stream transmission method according to claim 2, wherein before the step of sending the mixing data obtained by mixing the video stream data to the CDN node of the content distribution network, the method further comprises: The mixing data is buffered. 4. video stream transmission method according to claim 1, is characterized in that, the step of mixing frequency data that is obtained by mixing frequency processing operation to video stream data, comprises: The frequency mixing operation is performed on video frames of the same time in the video stream data from at least one acquisition device to obtain frequency mixing data. 5. The video streaming method according to claim 1, wherein the method further comprises: A request for establishing the communication transmission connection sent by the CDN node of the content distribution network is received. 6 . The video stream transmission method according to claim 4 , wherein the mixing data is used for the client to simultaneously display the video stream data from at least one acquisition device. 7 . 7. A video streaming device, comprising: a request establishment module, configured to send a communication transmission connection establishment request to the CDN node of the content distribution network; A frequency mixing transmission module, configured to send, to the CDN node of the content distribution network, after the communication transmission connection is successfully established, the frequency mixing data obtained by performing the frequency mixing processing operation on the video stream data, wherein the frequency mixing processing operation is not sending Occurs after the establishment request of the communication transport connection; The request establishment module is also used for: when the mixing data is obtained by performing the mixing processing operation on the video stream data, sending a request for establishing a communication transmission connection to the CDN node of the content distribution network, wherein the mixing frequency transmitted through the communication transmission connection is transmitted in real time in real time. The data does not correspond to the overall video stream data, but the mixing data generated in real time, which is a part of the overall video stream data. 8. An electronic device, characterized in that it comprises a memory, a processor, and a program stored on the memory and capable of running on the processor, and when the processor executes the program, the programs according to claims 1 to 10 are implemented. The video streaming method described in any one of 6. 9. A computer-readable storage medium, characterized in that, a computer program is stored in the readable storage medium, and when the computer program is executed, the video streaming method according to any one of claims 1-6 is implemented .

Images