CN109788314B - Method and device for transmitting video stream data - Google Patents

Abstract

The embodiment of the application provides a method and a corresponding device for transmitting video stream data, the method and the device are applied to a video network, the video network comprises a video network server and a video network terminal which is in communication connection with the video network server, the video network comprises a streaming media server, a transcoding server and an internet terminal, the transcoding server is respectively in level with the streaming media server, the video network server is in communication connection with the streaming media server, the streaming media server generates a transcoding instruction according to video parameters of the internet terminal and converts the received video network video stream data sent by the video network terminal into internet video stream data, the transcoding server re-encodes the internet video stream data into video stream data with a target resolution according to the transcoding instruction, and the streaming media server sends the re-encoded video stream data to the internet terminal, the purpose that the resolution ratio of video stream data of the video network is autonomously defined by the Internet terminal is achieved.

Description

Method and device for transmitting video stream data

Technical Field

The present application relates to the field of video networking technologies, and in particular, to a method and an apparatus for transmitting video stream data.

Background

At present, in a video call service or a live broadcast service, when video stream data is transmitted between a video networking terminal and an internet terminal, the internet terminal cannot actively select the resolution of a received real-time video stream according to the resolution of the internet terminal, so that sometimes when the video networking terminal sends high-definition video, the high-definition video cannot be decoded due to parameter limitation of the internet terminal equipment, so that the internet terminal cannot watch the high-definition video, or when the internet terminal is in a real-time video call, the resolution of the video stream cannot be actively selected, and only the resolution of the video stream data sent by the video networking terminal can be passively adapted. In conclusion, the problem of poor customer experience is caused.

Disclosure of Invention

In view of the above problems, embodiments of the present application are proposed to provide a method for video stream data transmission and a corresponding apparatus for video stream data transmission that overcome or at least partially solve the above problems.

In order to solve the above problem, an embodiment of the present application provides a method for transmitting video stream data, where the method is applied to a video network and an internet, the video network includes a video network server and a video network terminal communicatively connected to the video network server, the internet includes a streaming media server, a transcoding server and an internet terminal, the streaming media server is communicatively connected to the transcoding server and the internet terminal respectively, and the video network server is communicatively connected to the streaming media server, and the method includes:

the streaming media server receives first video stream data forwarded by the video networking server and receives a video parameter instruction sent by the internet terminal; the first video stream data is generated by the video networking terminal and is sent to the video networking server, the first video stream data is a video stream supporting a video networking protocol, the video parameters are generated by the internet terminal aiming at triggered resolution selection operation, and the video parameter instruction comprises a target resolution;

the streaming media server converts the first video stream data into second video stream data supporting an internet protocol, and generates a first transcoding instruction for the video parameter instruction; wherein the first transcoding instruction includes the target resolution;

the streaming media server sends the second video stream data and the first transcoding instruction to the transcoding server; the transcoding server is used for encoding the second video stream data into third video stream data according to the target resolution aiming at the first transcoding instruction;

and the streaming media server receives the third video streaming data returned by the transcoding server and sends the third video streaming data to the internet terminal.

Preferably, the target resolution is a resolution of a CIF format of a common image transfer video conference.

Preferably, the step of generating, by the streaming media server, a first transcoding instruction for the video parameter instruction includes:

the streaming media server acquires a network bandwidth from a current network, and determines a target code stream aiming at the network bandwidth;

the streaming media server extracts the target resolution from the video parameter instruction;

and the streaming media server generates a second transcoding instruction, wherein the second transcoding instruction comprises the target code stream and the target resolution.

Preferably, the streaming media server sends the second video stream data and the second transcoding instruction to the transcoding server; and the transcoding server is used for coding the second video stream data into third video stream data according to the target resolution and the target code stream aiming at the second transcoding instruction.

In order to solve the above problem, an embodiment of the present application further provides a method for transmitting video stream data, where the method is applied to a video network and an internet, the video network includes a video network server and a video network terminal communicatively connected to the video network server, the internet includes a streaming media server, a transcoding server communicatively connected to the streaming media server, and an internet terminal, and the video network server is communicatively connected to the streaming media server; the method comprises the following steps:

the transcoding server receives second video stream data and a first transcoding instruction sent by the streaming media server; the first transcoding instruction is generated by the streaming media server aiming at a video parameter instruction sent by an internet terminal and comprises a target resolution; the second video stream data is generated by the streaming media server after protocol conversion is carried out on first video stream data forwarded by the video networking server, and the first video stream data is collected by the video networking terminal and is sent to the video networking server; the first video stream data is video stream data supporting a video networking protocol, and the second video stream data is video stream data supporting an internet protocol; the video parameter instruction is generated by the internet terminal aiming at the triggered resolution selection operation and comprises a target resolution;

the transcoding server encodes the second video stream data into third video stream data according to the target resolution for the first transcoding instruction;

and the transcoding server sends the third video stream data to the streaming media server, and the streaming media server is used for sending the third video stream data to the internet terminal.

Preferably, the transcoding server encodes the second video stream data into third video stream data at the target resolution for the first transcoding instruction:

the transcoding server decodes the second video stream data into intermediate video stream data;

and the transcoding server encodes the intermediate video stream data into third video stream data according to the target resolution aiming at the first transcoding instruction.

Preferably, the first transcoding instruction further includes a target code stream, and the target code stream is determined by the streaming media server according to a network bandwidth acquired in a current network where the streaming media server is located.

Preferably, the transcoding server encodes the second video stream data into third video stream data according to the target resolution and the target code stream for the first transcoding instruction.

In order to solve the above problem, the embodiment of the present application further provides a device for video stream data transmission, where the device is applied in a video network and the internet, and the method is applied in a video network and the internet, where the video network includes a video network server and a video network terminal communicatively connected to the video network server, the internet includes a streaming media server, a transcoding server and an internet terminal, the streaming media server is communicatively connected to the transcoding server and the internet terminal, respectively, the video network server is communicatively connected to the streaming media server, and the device is located at the streaming media server, and includes:

the first receiving module is used for receiving first video stream data forwarded by the video networking server and receiving a video parameter instruction sent by the internet terminal; the first video stream data is acquired by the video networking terminal and is sent to the video networking server, the first video stream data is a video stream supporting a video networking protocol, the video parameters are generated by the internet terminal aiming at the triggered resolution selection operation, and the video parameter instruction comprises a target resolution;

the protocol conversion module is used for converting the first video stream data into second video stream data supporting an internet protocol;

the transcoding instruction generating module is used for generating a first transcoding instruction aiming at the video parameter instruction; wherein the first transcoding instruction includes the target resolution;

the first sending module is used for sending the second video stream data and the first transcoding instruction to the transcoding server; to inform the transcoding server to encode the second video stream data into third video stream data at the target resolution for the first transcoding instruction;

and the forwarding module is used for receiving the third video stream data returned by the transcoding server and sending the third video stream data to the internet terminal, and the internet terminal is used for playing the decoded third video stream data.

In order to solve the above problem, an embodiment of the present application further provides another apparatus for transmitting video stream data, where the apparatus is applied in a video network and an internet, and the method is applied in a video network and an internet, where the video network includes a video network server and a video network terminal communicatively connected to the video network server, the internet includes a streaming media server, a transcoding server and an internet terminal, the streaming media server is communicatively connected to the transcoding server and the internet terminal, respectively, the video network server is communicatively connected to the streaming media server, and the apparatus is located on the transcoding server, and includes:

the second receiving module is used for receiving second video stream data and a first transcoding instruction sent by the streaming media server; the first transcoding instruction is generated by the streaming media server aiming at a video parameter instruction sent by an internet terminal and comprises a target resolution; the second video stream data is generated by the streaming media server after protocol conversion is carried out on first video stream data forwarded by the video networking server, and the first video stream data is collected by the video networking terminal and is sent to the video networking server; the first video stream data is video stream data supporting a video networking protocol, and the second video stream data is video stream data supporting an internet protocol; the video parameter instruction is generated by the internet terminal aiming at the triggered resolution selection operation and comprises a target resolution;

a transcoding module, configured to encode, according to the target resolution, the second video stream data into third video stream data according to the first transcoding instruction;

and the second sending module is used for sending the third video stream data to the streaming media server so as to inform the streaming media server to send the third video stream data to the internet terminal, and the internet terminal is used for decoding the third video stream data and playing the decoded third video stream data.

Compared with the prior art, the embodiment of the application has the following advantages:

firstly, the embodiment of the application applies the characteristics of video networking, a stream media server generates a transcoding instruction according to video parameters of an internet terminal, and converts received video networking video stream data sent by the video networking terminal into internet video stream data, the transcoding server re-encodes the internet video stream data into video stream data with a target resolution for the transcoding instruction, and the stream media server sends the re-encoded video stream data to the internet terminal, so that the video stream data received by the internet terminal is the video stream supported by the internet terminal equipment parameters, the purpose of the resolution of the video stream which can be actively self-defined by a user is realized, and the viewing experience of a video networking user is improved.

Secondly, the target resolution sent by the internet terminal can be CIF format resolution, so that the requirement that the internet terminal selects the format resolution to be interconnected and intercommunicated with the video network under the environment of poor network environment such as 3G/4G/WiFi and the like can be met, the CIF format target resolution is 352x 288, and the transcoded video stream data is greatly reduced due to the reduction of the resolution, so that the transmission efficiency of the video network video stream data in the 3G/4G/WiFi network in the video call service is greatly improved, the image fluency in the video call process is improved, and the watching of high-definition video network video stream on the internet terminal is also realized.

Finally, the streaming media server can also automatically determine a proper target code rate according to the network bandwidth, so that the transcoding server can encode according to the target code rate during transcoding, and the network self-adaptive capacity of video streaming data transmission is improved.

Drawings

FIG. 1 is a networking schematic of a video network of the present application;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present application;

fig. 3 is a schematic diagram of a hardware architecture of an access switch of the present application;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present application;

fig. 5 is a flowchart of steps of embodiment 1 of a method for video stream data transmission according to the present application;

fig. 6 is an application environment diagram of embodiment 1 of a method for transmitting video stream data according to the present application;

fig. 7 is a flowchart of the steps of embodiment 2 of a method for video stream data transmission according to the present application;

fig. 8 is a block diagram of the structure of an embodiment 3 of the apparatus for video stream data transmission according to the present application;

fig. 9 is a block diagram of a video stream data transmission apparatus embodiment 4 according to the present application.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present application, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network technology (network technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server technology (Servertechnology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present application can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which in this embodiment is divided into two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate operation module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate operation module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate operation module 308.

Ethernet protocol gateway:

as shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a code rate operation module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present application: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the characteristics of the video networking, one of the core concepts of the embodiments of the present application is provided, in which, following a protocol of the video networking, a streaming media server converts video networking data of the video networking protocol into video streaming data of an internet protocol, and generates a transcoding instruction according to a video parameter of an internet terminal to notify a transcoding server to re-encode the video streaming data of the internet protocol into video streaming data with a target resolution for the transcoding instruction, and the streaming media server sends the video streaming data to the internet terminal, so that the video streaming data received by the internet terminal is the video streaming supported by the parameters of the internet terminal device, the purpose of customizing the resolution of the video streaming that a user can watch is achieved, and the watching experience of the user of the video networking is improved.

Example one

Referring to fig. 5, a flowchart of steps of embodiment 1 of a video stream data transmission method of the present application is shown, in this embodiment of the present application, the method is applied to a video network and an internet, the video network includes a video network server 603 and a video network terminal 604 communicatively connected to the video network server 603, the internet includes a streaming media server 602, a transcoding server 605 and an internet terminal 601, the streaming media server 602 is communicatively connected to the transcoding server 605 and the internet terminal 601, respectively, and the video network server 603 is communicatively connected to the streaming media server 602.

As shown in fig. 6, an application environment of the embodiment of the present application is that a streaming media server 602 can be understood as a server that can simultaneously support an internet protocol and a video networking protocol, where the streaming media server 602 receives a real-time video stream in a streaming protocol and then broadcasts the real-time video stream to an internet terminal 601 in the streaming protocol; the transcoding server 605 may be understood as a server that performs internet protocol communication with the streaming server 602, and may decode and encode the received video stream; the internet terminal 601 and the video networking terminal 604 may be hardware devices such as an android mobile phone, a PC or a tablet computer; in the embodiment of the present application, the internet terminal 601 communicates with the streaming server 602 in the internet protocol, and the video network terminal 604 communicates with the video network server 603 in the video network protocol.

The method for transmitting the video stream data in the embodiment of the application can comprise the following steps:

in step 501, the streaming media server 602 receives the first video stream data forwarded by the video networking server 603, and receives a video parameter instruction sent by the internet terminal 601.

The first video stream data is generated by the video networking terminal 604 and sent to the video networking server 603, the first video stream data is a video stream supporting a video networking protocol, the video parameter is generated by the internet terminal 601 for a triggered resolution selection operation, and the video parameter instruction includes a target resolution.

In practice, the first video stream data may be a live video stream or a video conference video stream. In practice, the internet terminal 601 may provide, on a display interface, a plurality of resolution options that the device parameter of the internet terminal 601 can decode for a user, and the user may select a target resolution on the plurality of resolution options, where the selection operation may be a touch operation, a key operation, or a voice operation, and the specific manner of the selection operation is not limited in this application.

By generating the video parameter instruction, the internet terminal 601 user can actively select the resolution of the video when watching the real-time video stream.

Step 502, the streaming media server 602 converts the first video stream data into a second video stream data supporting internet protocol, and generates a first transcoding instruction for the video parameter instruction.

Wherein the first transcoding instruction includes the target resolution.

In practice, the first video stream data is a video captured by the video network terminal 604 and sent to the video network server 603 according to the video network protocol, the streaming server 602 receives the first video stream data according to the video network protocol, because the video network and the internet use different communication protocols, the first video stream data of the video network protocol cannot be transmitted in the internet, and after the streaming server 602 converts the first video stream data into the second video stream data of the internet protocol, the second video stream data can be transmitted in the internet. Wherein the first transcoding instruction may be understood as signaling that informs the transcoding server 605 to transcode for the second video stream data.

The handheld software of the mobile phone is generally installed to acquire live video or video of conference video in the video network, and the handheld software of the mobile phone

In step 503, the streaming media server 602 sends the second video stream data and the first transcoding instruction to the transcoding server 605.

The transcoding server 605 is configured to encode the second video stream data into third video stream data according to the target resolution for the first transcoding instruction.

In practice, the resolution of the re-encoded third video stream data is the target resolution, and in practice, the target resolution may be higher than the resolution of the first video stream data or lower than the resolution of the first video stream data. For example, the resolution of the first video stream data is a resolution of 1080P format, the target resolution may be a resolution of 720P format or 480P format; if the resolution of the first video stream data is 720P format, the target resolution may be 1080P format resolution or 480P format resolution. When the target resolution is smaller than that of the first video stream data, the third video stream data is reduced, so that the transmission speed can be increased, and in scenes with high requirements on video real-time performance, such as live broadcast, a user can watch more smooth videos, so that the live broadcast delay time is greatly shortened, and the watching experience is improved; when the target resolution is greater than the resolution of the first video stream data, and the third video stream data is decoded and then played at the internet terminal 601, the image quality definition can be improved, and the user viewing experience can be improved.

In step 504, the streaming media server 602 receives the third video stream data returned by the transcoding server 605, and sends the third video stream data to the internet terminal 601.

As an optional example of the embodiment of the present application, the target resolution is a resolution of a CIF format of a common image transfer video conference.

In practice, the network environment where the internet terminal 601 watches the video stream may be a 3G/4G/WiFi network, the network bandwidth is small, and the transmission of high-definition real-time video streams in the video network cannot be satisfied, and especially in the live broadcast application, live broadcast video is watched by a mobile phone under the 3G/4G/WiFi network, and a long time delay occurs, and the video is not smooth and is easy to be jammed, so that the user experience is poor. In addition, the general internet terminal 601 watches video stream of the video network by installing software such as mobile phone palm communication, but the video stream data sent by the video network terminal 604 are generally high definition video stream data, for example, 1024P format resolution, but the mobile phone palm communication cannot decode the video of the resolution; based on the above problem, when the internet terminal 601 generates the video parameter instruction, the resolution used by CIF protocol transmission, that is, the resolution of 352x 288 is adopted, so that the resolution of the third video stream data formed after transcoding by the transcoding server 605 is the resolution of 352x 288, which greatly reduces the third video stream data, improves the fluency of the internet terminal 601 in watching high-definition video streams in the 3G/4G/WiFi network, and enables the internet terminal 601 installed with the palm top communication software to watch high-definition video networking video streams.

As an optional example of the embodiment of the present application, step 502 may specifically include the following sub-steps:

in sub-step 5021, the streaming media server 602 obtains a network bandwidth from a network where the streaming media server is currently located, and determines a target code stream according to the network bandwidth.

The code stream can be understood as the data flow used by the video file in unit time, which is the most important part in the picture quality control in video coding, and under the same resolution of the same video stream data, the larger the code stream is, the better the picture quality is, and the larger the occupied network bandwidth is; the smaller the code stream is, the smaller the occupied network bandwidth is, and the more smooth the video picture is.

In a specific implementation, when the current network bandwidth is wide, for example, 8M, the streaming media server 602 may select a high target code stream, for example, a 2M target code stream; when the current network bandwidth is narrow, a low target code stream can be selected. In practice, the streaming media server 602 may determine the current target code stream adapted to the network bandwidth according to the network bandwidth and the historical data of the code stream.

The code stream of the third video stream data is selected autonomously according to the network bandwidth, the video stream is transcoded into a high target code stream under the high network bandwidth, so that the image quality of the video obtained by the internet terminal 601 is better, and the video stream is transcoded into a low target code stream under the low network bandwidth, so that the image quality of the video obtained by the internet terminal 601 is better in smoothness.

Sub-step 5022, the streaming media server 602 extracts the target resolution from the video parameter instruction.

In sub-step 5023, the streaming media server 602 generates a second transcoding command, where the second transcoding command includes the target code stream and the target resolution.

In the case that the streaming media server 602 further generates a transcoding instruction according to the target code stream, the streaming media server 602 sends the second video stream data and the second transcoding instruction to the transcoding server 605; the transcoding server 605 is configured to encode the second video stream data into third video stream data according to the target resolution and the target code stream for the second transcoding instruction.

In the embodiment of the application, the streaming media server 602 generates a transcoding instruction according to the video parameter of the internet terminal 601, so as to notify the transcoding server 605 to re-encode the video stream data sent by the video network terminal 604 into the video stream data with the target resolution for the transcoding instruction, so that the video stream data received by the internet terminal 601 is the video stream supported by the internet terminal 601 equipment parameter, the purpose that the user can actively define the resolution of the video stream to be watched by the user is achieved, and the watching experience of the video network user is improved.

Example two

Referring to fig. 7, a flowchart of steps of embodiment 1 of a video stream data transmission method of the present application is shown, in this embodiment of the present application, the method is applied to a video network and an internet, the video network includes a video network server 603 and a video network terminal 604 communicatively connected to the video network server 603, the internet includes a streaming media server 602, a transcoding server 605 and an internet terminal 601, the streaming media server 602 is communicatively connected to the transcoding server 605 and the internet terminal 601, respectively, and the video network server 603 is communicatively connected to the streaming media server 602.

The application environment of the embodiment of the present application may refer to the description of the first embodiment, which is not described herein, and the method for transmitting video stream data of the embodiment of the present application may specifically include the following steps:

in step 701, the transcoding server 605 receives the second video stream data and the first transcoding instruction sent by the streaming server 602.

The first transcoding instruction is generated by the streaming media server 602 for a video parameter instruction sent by the internet terminal 601, and includes a target resolution; the second video stream data is generated by the streaming media server 602 after performing protocol conversion on first video stream data forwarded by the video networking server 603, and the first video stream data is collected by the video networking terminal 604 and sent to the video networking server 603; the first video stream data is video stream data supporting a video networking protocol, and the second video stream data is video stream data supporting an internet protocol; the video parameter instruction is generated by the internet terminal 601 for a triggered resolution selection operation, including a target resolution.

The specific process of step 701 may refer to the descriptions of step 501 and step 502 in the first embodiment, and details are not described in this embodiment.

Step 702, the transcoding server 605 encodes the second video stream data into third video stream data according to the target resolution for the first transcoding instruction.

As an optional example of the embodiment of the present application, step 702 may specifically include the following sub-steps:

step 7021, the transcoding server 605 decodes the second video stream data into intermediate video stream data.

Step 7022, the transcoding server 605 encodes the intermediate video stream data into third video stream data according to the target resolution for the first transcoding instruction.

In practice, the transcoding server 605 may employ the existing video codec technology to decode and then encode the second video stream data, such as FFmpeg program, which is understood to be a set of open source computer programs that can be used to record, convert digital audio and video, and convert them into streams. The application is not limited to specific coding and decoding application software.

In this sub-step, when encoding the intermediate video stream data into the third video stream data, the transcoding server 605 may default that the bitrate of the third video stream data is 400 kb.

In step 703, the transcoding server 605 sends the third video stream data to the streaming server 602, and the streaming server 602 is configured to send the third video stream data to the internet terminal 601.

As an optional example of the embodiment of the present application, the first transcoding instruction further includes a target code stream, where the target code stream is determined by the streaming media server 602 according to a network bandwidth acquired in a current network where the streaming media server is located.

In this optional example, the specific process of determining the target code stream by the streaming media server 602 and generating the code stream instruction according to the target code stream may refer to the specific descriptions of step 5021 to step 5023 in the embodiments.

As an alternative example of the embodiment of the present application, the sub-step 7022 may specifically be as follows:

sub-step 7022', the transcoding server 605 encodes the second video stream data into third video stream data according to the target resolution and the target code stream for the first transcoding instruction.

In step 7022', the transcoding server 605 generates third video data according to the transcoding instruction of the streaming server 602, where a code stream of the third video data is a target code stream selected by the streaming server 602, and a resolution of the third video data is a target resolution autonomously selected by the internet terminal 601. When transcoding the video stream data, the transcoding server 605 meets both the target code stream determined by the streaming media server 602 and the target resolution autonomously selected by the internet terminal 601, thereby improving the transcoding capability of the transcoding server 605.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

EXAMPLE III

Fig. 8 shows an apparatus for transmitting video stream data according to embodiment 3 of the present application, which is applied to video networking and internet in comparison with the processing method of embodiment 1, where the video networking includes a video networking server 603 and a video networking terminal 604 communicatively connected to the video networking server 603, the internet includes a streaming media server 602, a transcoding server 605 and an internet terminal 601, the streaming media server 602 is communicatively connected to the transcoding server 605 and the internet terminal 601, respectively, the video networking server 603 is communicatively connected to the streaming media server 602, and the apparatus is located at the streaming media server 602, and specifically may include the following modules:

a first receiving module 801, configured to receive first video stream data forwarded by the video networking server 603, and receive a video parameter instruction sent by the internet terminal 601; the first video stream data is acquired by the video networking terminal 604 and sent to the video networking server 603, the first video stream data is a video stream supporting a video networking protocol, the video parameters are generated by the internet terminal 601 aiming at a triggered resolution selection operation, and the video parameter instruction comprises a target resolution;

a protocol conversion module 802, which converts the first video stream data into a second video stream data supporting the internet protocol;

a transcoding instruction generating module 803, configured to generate a first transcoding instruction for the video parameter instruction; wherein the first transcoding instruction includes the target resolution;

a first sending module 804, configured to send the second video stream data and the first transcoding instruction to the transcoding server 605; to inform the transcoding server 605 to encode the second video stream data into third video stream data at the target resolution for the first transcoding instruction;

the forwarding module 805 is configured to receive the third video stream data returned by the transcoding server 605, and send the third video stream data to the internet terminal 601, where the internet terminal 601 is configured to play the decoded third video stream data.

As an optional example of the embodiment of the present application, the transcoding instruction generating module 802 may include the following sub-modules:

and the target code stream determining submodule acquires the network bandwidth from the current network and determines the target code stream according to the network bandwidth.

A target resolution extraction sub-module, configured to extract the target resolution from the video parameter instruction;

and the instruction generation submodule is used for generating a second transcoding instruction, and the second transcoding instruction comprises the target code stream and the target resolution.

As an optional example of the embodiment of the present application, the target resolution is a resolution of a CIF format of a common image transfer video conference.

Example four

As shown in fig. 9, an apparatus for transmitting video stream data according to embodiment 4 of the present application, in contrast to the processing method of embodiment 2, the apparatus is applied in a video network and an internet, the method is applied in a video network and an internet, the video network includes a video network server 603 and a video network terminal 604 communicatively connected to the video network server 603, the internet includes a streaming media server 602, a transcoding server 605 and an internet terminal 601, the streaming media server 602 is communicatively connected to the transcoding server 605 and the internet terminal 601, respectively, the video network server 603 is communicatively connected to the streaming media server 602, and the apparatus is located on the transcoding server 605, and specifically may include the following modules:

a second receiving module 901, configured to receive second video stream data and a first transcoding instruction sent by the streaming media server 602; the first transcoding instruction is generated by the streaming media server 602 for a video parameter instruction sent by the internet terminal 601, and includes a target resolution; the second video stream data is generated by the streaming media server 602 after performing protocol conversion on first video stream data forwarded by the video networking server 603, and the first video stream data is collected by the video networking terminal 604 and sent to the video networking server 603; the first video stream data is video stream data supporting a video networking protocol, and the second video stream data is video stream data supporting an internet protocol; the video parameter instruction is generated by the internet terminal 601 aiming at the triggered resolution selection operation, and comprises a target resolution;

a transcoding module 902, configured to encode, according to the target resolution, the second video stream data into third video stream data according to the first transcoding instruction;

a second sending module 903, configured to send the third video stream data to the streaming media server 602, so as to notify the streaming media server 602 to send the third video stream data to the internet terminal 601, where the internet terminal 601 is configured to decode the third video stream data and play the decoded third video stream data.

As an optional example of the embodiment of the present application, the transcoding module 902 may specifically include the following sub-modules:

and the video decoding submodule is used for decoding the second video stream data into intermediate video stream data.

And the video coding sub-module is used for coding the intermediate video stream data into third video stream data according to the target resolution aiming at the first transcoding instruction.

As an optional example of the embodiment of the present application, the first transcoding instruction further includes a target code stream, where the target code stream is determined by the streaming media server 602 according to a network bandwidth acquired in a current network where the streaming media server is located.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one of skill in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The foregoing detailed description is directed to a method for transmitting video stream data and a corresponding apparatus for transmitting video stream data, and specific examples are applied herein to illustrate the principles and embodiments of the present application, and the description of the foregoing examples is only used to help understand the method and the core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (6)

1. A method for transmitting video stream data is applied to a video network and an Internet, wherein the video network comprises a video network server and a video network terminal in communication connection with the video network server, the Internet comprises a streaming media server, a transcoding server and an Internet terminal, the streaming media server is in communication connection with the transcoding server and the Internet terminal respectively, and the video network server is in communication connection with the streaming media server, and the method comprises the following steps:

the streaming media server receives first video stream data forwarded by the video networking server and receives a video parameter instruction sent by the internet terminal; the first video stream data is generated by the video networking terminal and is sent to the video networking server, the first video stream data is a video stream supporting a video networking protocol, the video parameters are generated by the internet terminal aiming at triggered resolution selection operation, and the video parameter instruction comprises a target resolution;

the streaming media server converts the first video stream data into second video stream data supporting an internet protocol, and generates a first transcoding instruction for the video parameter instruction; the first transcoding instruction includes the target resolution; specifically, the step of generating a first transcoding instruction for the video parameter instruction includes:

the streaming media server acquires a network bandwidth from a current network, and determines a target code stream adapted to the current network bandwidth according to the network bandwidth and historical data of the code stream; the method specifically comprises the following steps: the streaming media server extracts the target resolution from the video parameter instruction; the streaming media server generates a second transcoding instruction, wherein the second transcoding instruction comprises the target code stream and the target resolution;

the streaming media server sends the second video stream data and the first transcoding instruction to the transcoding server; the transcoding server is used for encoding the second video stream data into third video stream data according to the target resolution aiming at the first transcoding instruction; wherein the streaming media server sends the second video stream data and the first transcoding instruction to the transcoding server, including: the streaming media server sends the second video stream data and the second transcoding instruction to the transcoding server; the transcoding server is used for coding the second video stream data into third video stream data according to the target resolution and the target code stream aiming at the second transcoding instruction;

and the streaming media server receives the third video streaming data returned by the transcoding server and sends the third video streaming data to the internet terminal.

2. The method of claim 1, wherein the target resolution is a CIF format resolution.

3. The method for transmitting the video stream data is applied to a video network and an internet, wherein the video network comprises a video network server and a video network terminal which is in communication connection with the video network server, the internet comprises a streaming media server, a transcoding server which is in communication connection with the streaming media server and an internet terminal, and the video network server is in communication connection with the streaming media server; the method comprises the following steps:

the transcoding server receives second video stream data and a second transcoding instruction sent by the streaming media server; the second transcoding instruction is generated by the streaming media server aiming at a video parameter instruction sent by an internet terminal and comprises a target resolution and a target code stream; the second video stream data is generated by the streaming media server after protocol conversion is carried out on first video stream data forwarded by the video networking server, and the first video stream data is collected by the video networking terminal and is sent to the video networking server; the first video stream data is video stream data supporting a video networking protocol, and the second video stream data is video stream data supporting an internet protocol; the video parameter instruction is generated by the internet terminal aiming at the triggered resolution selection operation, and comprises the target resolution; the target code stream is determined by the streaming media server according to the network bandwidth and the historical data of the code stream acquired in the current network;

the transcoding server encodes the second video stream data into third video stream data according to the target resolution and the target code stream aiming at the second transcoding instruction;

and the transcoding server sends the third video stream data to the streaming media server, and the streaming media server is used for sending the third video stream data to the internet terminal.

4. The method of claim 3, wherein the transcoding server encodes, for the second transcoding instruction, the second video stream data into a third video stream data at the target resolution:

the transcoding server decodes the second video stream data into intermediate video stream data;

and the transcoding server encodes the intermediate video stream data into third video stream data according to the target resolution and the target code stream aiming at the second transcoding instruction.

5. An apparatus for transmitting video stream data, wherein the apparatus is applied to a video network and an internet, the video network includes a video network server and a video network terminal communicatively connected to the video network server, the internet includes a streaming media server, a transcoding server and an internet terminal, the streaming media server is communicatively connected to the transcoding server and the internet terminal respectively, the video network server is communicatively connected to the streaming media server, and the apparatus is located at the streaming media server, and includes:

the first receiving module is used for receiving first video stream data forwarded by the video networking server and receiving a video parameter instruction sent by the internet terminal; the first video stream data is acquired by the video networking terminal and is sent to the video networking server, the first video stream data is a video stream supporting a video networking protocol, the video parameters are generated by the internet terminal aiming at the triggered resolution selection operation, and the video parameter instruction comprises a target resolution;

the protocol conversion module is used for converting the first video stream data into second video stream data supporting an internet protocol;

the transcoding instruction generating module is used for generating a first transcoding instruction aiming at the video parameter instruction; wherein the first transcoding instruction includes the target resolution; the video parameter instruction, generating a first transcoding instruction, comprises: acquiring a network bandwidth from a current network, and determining a target code stream according to the network bandwidth and historical data of the code stream; extracting the target resolution from the video parameter instruction; the streaming media server generates a second transcoding instruction, wherein the second transcoding instruction comprises the target code stream and the target resolution;

the first sending module is used for sending the second video stream data and the first transcoding instruction to the transcoding server; to inform the transcoding server to encode the second video stream data into third video stream data at the target resolution for the first transcoding instruction; specifically, the first sending module is configured to send the second video stream data and the second transcoding instruction to the transcoding server; the transcoding server is used for coding the second video stream data into third video stream data according to the target resolution and the target code stream aiming at the second transcoding instruction;

and the forwarding module is used for receiving the third video stream data returned by the transcoding server and sending the third video stream data to the internet terminal, and the internet terminal is used for playing the decoded third video stream data.

6. A transmission device of video stream data is characterized in that the device is applied to a video network

And in the internet, the video network includes the video network server, with video network server communication connection's video network terminal, including streaming media server, transcoding server and internet terminal in the internet, streaming media server with transcoding server reaches internet terminal is communication connection respectively, the video network server with streaming media server communication connection, the device is located on the transcoding server, include:

the second receiving module is used for receiving second video stream data and a second transcoding instruction sent by the streaming media server; the second transcoding instruction is generated by the streaming media server aiming at a video parameter instruction sent by an internet terminal and comprises a target resolution and a target code stream; the second video stream data is generated by the streaming media server after protocol conversion is carried out on first video stream data forwarded by the video networking server, and the first video stream data is collected by the video networking terminal and is sent to the video networking server; the first video stream data is video stream data supporting a video networking protocol, and the second video stream data is video stream data supporting an internet protocol; the video parameter instruction is generated by the internet terminal aiming at the triggered resolution selection operation, and comprises the target resolution; the target code stream is determined by the streaming media server according to the network bandwidth and the historical data of the code stream acquired in the current network;

a transcoding module, configured to encode, according to the target resolution and the target code stream, the second video stream data into third video stream data according to the second transcoding instruction;

and the second sending module is used for sending the third video stream data to the streaming media server so as to inform the streaming media server to send the third video stream data to the internet terminal, and the internet terminal is used for decoding the third video stream data and playing the decoded third video stream data.

Images