CN111629283A - Multi-stream media gateway service system and method - Google Patents
Multi-stream media gateway service system and method Download PDFInfo
- Publication number
- CN111629283A CN111629283A CN202010409207.XA CN202010409207A CN111629283A CN 111629283 A CN111629283 A CN 111629283A CN 202010409207 A CN202010409207 A CN 202010409207A CN 111629283 A CN111629283 A CN 111629283A
- Authority
- CN
- China
- Prior art keywords
- data
- streaming media
- data stream
- instruction
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/102—Gateways
- H04L65/1023—Media gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/27—Server based end-user applications
- H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
- H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a multi-stream media gateway service system and a method, which comprises a plurality of uploading terminal devices, a fusion gateway, a stream media conversion module and a playing terminal, wherein the streaming media uploading, data stream transmission and data stream storage divide a plurality of stream media into a plurality of regional combinations according to marking characteristics or address characteristics so as to realize the functions of multi-device video live broadcast, recorded broadcast, continuous video output and the like in a region. The invention can ensure the integrity of the streaming media data transmission and ensure the transmission quality and the time delay effect under the condition of a large number of receiving ends.
Description
Technical Field
The invention relates to the technical field of streaming media, in particular to a multi-stream media gateway service system and a method.
Background
With the rapid development of the streaming media technology, the streaming media of the complex network develops from the mode of a regular network and a random graph towards the direction of a topological structure and a structureless topological evolution model. The streaming media is affected by its buffering performance and error correction performance, and is very sensitive to packet loss, and especially under the condition of a large number of receiving ends, it is necessary to ensure not only the integrity of streaming media data transmission, but also to ensure that the time delay meets the requirements. In this case, the mechanism of using the streaming media is greatly restricted.
Patent application No.: CN201811440535.5 discloses a streaming media on demand method and system based on distributed storage system, which includes: the system comprises a push stream on-demand tool, a stream media gateway, a stream media server, a database, a distributed storage system and an object storage gateway which run in a client. Through the technical scheme of the invention, a user transcodes the RTMP protocol media stream pushed by the user into the TS file of the HLS protocol by setting the fragment playing length during stream pushing, so that the playback material does not need to be transcoded and encapsulated again in the stream media playing process, the user can be ensured to multiplex the TS file generated by stream pushing and quickly generate the M3U8 file or directly multiplex the previously generated M3U8 file, and the TS file corresponding to the playback material is finally downloaded from the designated storage bucket and is directly displayed to the user.
The patent only provides a distributed storage mode, and the media stream code is divided into a plurality of TS files in a slicing mode, which cannot solve the problems of how to ensure the integrity of the stream media data transmission and how to ensure the transmission quality and the time delay effect under the condition of a large number of receiving ends in the technical scheme.
Disclosure of Invention
Based on the above-mentioned deficiencies, the present application provides a multiflow media gateway service system and method to improve the integrity of multiflow media data transmission under the conditions of multiflow media transmission and multiple receiving terminals.
The purpose of the invention is realized by the following technical scheme:
in one aspect, examples of the present application provide a multiflow media gateway service system, including:
the system comprises a plurality of uploading terminal devices, a fusion gateway and a plurality of uploading terminal devices, wherein the uploading terminal devices are divided into a plurality of area combinations according to mark characteristics or address characteristics, each area combination comprises a unique identification code, each uploading terminal device is configured with data stream transmission instructions, and the transmission instructions enable the uploading terminal devices to transmit acquired data streams to the fusion gateway in a slicing or grouping mode;
the system comprises a convergence gateway and a data transmission gateway, wherein the convergence gateway is configured with a data storage instruction and a data transmission instruction, the data storage instruction is configured to execute at least one resource pre-auditing instruction, and the resource pre-auditing instruction stores a plurality of data stream packets entering pre-auditing into a streaming media storage server at a preset transmission quality based on the transmission quality of one or more executed data streams; configuring an error descriptor for each data stream to be transmitted by the data transmission instruction, wherein the error descriptor is used for defining the data size and the index position of the data stream, and executing error recovery operation at the stages of packet loss and time delay of the data stream;
a streaming media conversion module comprising at least one protocol conversion instruction and a transmission management instruction, the protocol conversion instruction configured to execute the instructions to transmit one or more sets of data streams to a destination address in a specified protocol type; the transmission management instruction is configured to call a data stream in the streaming media storage server and transmit the data stream from a source address to a destination address;
the playing terminal is configured with at least one playing management instruction, the playing management instruction comprises a check sum error recovery operation for executing an error descriptor, and the playing management instruction further loads the data stream to a data stream reading position for data reading and playing.
The uploading terminal devices comprise a data stream coding module, and the data stream coding module outputs video stream media with preset code rate and resolution in an H.264high Profile coding mode.
The convergence gateway is configured to perform screening, and the screening performs the instructions to store the streaming media data of different regional combinations in a distributed manner, or store a plurality of data streams of one regional combination or a plurality of regional combinations in a specified position in an overlapping manner.
The fusion gateway is configured with a data marking instruction, the data marking instruction allocates markers to the streaming media data of different area combinations in a preset loading sequence, and the data marking instruction allocates priority sequences to the streaming media of a plurality of area combinations when the preset loading sequence is absent.
The streaming media conversion module is configured with NORM protocol, RTMP protocol, RTP protocol, RTCP protocol, MMS protocol and RTSP protocol; and the streaming media conversion module converts the data into a preset protocol type before the data stream is transmitted to a preset address.
The playing terminal comprises a data stream checking instruction, the data stream checking instruction carries out checking operation on an error descriptor, an identification code and a marker of the data stream, the data stream checking instruction also carries out management operation on the loading sequence and the output mode of the data stream, and the loading sequence of the data stream comprises that streaming media data combined in one area are loaded according to a preset sequence, or streaming media data combined in a plurality of areas are loaded according to a marker preset sequence configured by a fusion gateway; the management of the output mode comprises loading a group of streaming media data to a playing terminal or loading a group of streaming media data to a plurality of playing terminals.
In one aspect, examples of the present application provide a method of multiflow media gateway service, including:
acquiring transmission requests of a plurality of data streams from a source position to a destination position;
based on the transmission quality, the transmission destination position and the occupied resources defined in the transmission request, pre-auditing the resources of the multiple data streams to be transmitted, and storing the multiple data streams in a streaming media storage server according to the preset transmission quality under the condition of not reducing the transmission quality of the executed data streams;
distributing markers to the streaming media data combined in different areas in a preset loading sequence, and transmitting a plurality of groups of data streams to a target position in a specified protocol type;
and executing the data stream loading operation according to the preset loading sequence.
Further, when a plurality of data stream packets are stored in the streaming media storage server at a preset transmission quality, the method further comprises the step of storing the streaming media data of different regional combinations in a code distribution manner, or storing the plurality of data streams of one regional combination or a plurality of regional combinations in a specified position in an overlapping manner.
Furthermore, when the stream media data of different area combinations are assigned with the markers in the preset loading sequence, the method also comprises assigning a priority sequence to the stream media of a plurality of area combinations when no preset loading sequence exists.
Further, when the data stream loading operation is executed according to the preset loading sequence, the method further includes loading a group of stream media data to one playing terminal, or loading a group of stream media data to a plurality of playing terminals.
The invention has the beneficial effects that: the method comprises the steps of uploading a plurality of streaming media, transmitting the data streams and storing the data streams, and dividing the plurality of streaming media into a plurality of regional combinations according to mark characteristics or address characteristics so as to realize the functions of multi-device video live broadcast, recorded broadcast, continuous output of a plurality of videos and the like in the regions; and error recovery operation is performed at the stages of packet loss and time delay of the data streams through the error descriptors, so that the risk of NACK storm is reduced under the condition that a plurality of data streams are simultaneously performed.
Drawings
Fig. 1 is a schematic diagram of a multi-streaming media convergence gateway system according to the present invention;
fig. 2 is an exemplary diagram of a system having a plurality of upload terminal devices and a plurality of play terminals according to the present invention;
FIG. 3 is a schematic view of the working flow of the acquisition encoder of the present invention;
fig. 4 is an exemplary diagram of a live system of the present invention;
FIG. 5 is a schematic diagram of a streaming media data packet decomposition according to the present invention;
in the figure, 1-uploading terminal equipment, 2-convergence gateway, 3-streaming media storage server, 4-streaming media conversion module and 5-playing terminal.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention are further described in detail below with reference to the accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
With the rapid development of streaming media technology, under the condition that a plurality of streaming media operate simultaneously, the packet loss rate and the bit error rate in the transmission process of the streaming media are extremely high. In addition, the streaming media system with multiple terminals also needs to consider the case that the number of users accessing simultaneously is large.
An example of the present application provides a multiflow media gateway service system, as shown in fig. 1, including:
the system comprises a plurality of uploading terminal devices 1, wherein the uploading terminal devices 1 are divided into a plurality of area combinations according to mark characteristics or address characteristics, each area combination comprises a unique identification code, each uploading terminal device 1 is configured with data stream transmission instructions, and the transmission instructions enable the uploading terminal devices 1 to transmit acquired data streams to a convergence gateway 2 in a slicing or grouping mode.
At present, the video service, the live broadcast service and other functions are started, and the streaming media technology is widely applied. However, the video quality provided by the existing streaming media system is not good, and the streaming media technology usually has a plurality of uploading terminal devices 1 and playing terminals 5, which results in poor playing quality, long lag time and great pressure on application.
Generally speaking, if a live broadcast service is involved, the upload terminal device 1 generally includes an audio and video acquisition device, an acquisition encoder, and the like, the audio and video acquisition device is configured with a streaming media acquisition module, and the streaming media acquisition module supports multiple concurrent real-time live broadcast stream application terminals, that is, the streaming media acquisition module supports video protocol transmission such as HTTP, RTMP, TS over UDP, and also supports protocol release such as HLS, HTTP, and RTMP. The streaming media acquisition module can acquire audio and video data in real time to achieve complete synchronization of audio and video, the acquired audio and video data are encoded and transcoded by the acquisition encoder, and audio and video data streams with various resolutions and code rates can be output for different playing terminals 5 to use, as shown in fig. 3. The audio and video acquisition equipment is provided with an audio and video recording module, and the audio and video recording module records, codes and uploads real-time video data by adopting an H.264 coding technology.
Generally, an acquisition encoder mainly takes charge of one or more physical signals in a streaming media system to generate multiple audio and video data streams with different resolutions and different code rates. Under the condition of functional characteristic extension, the acquisition encoder is also provided with an audio and video editing module, and the audio and video editing module can zoom, cut or adjust the code rate of an audio and video image to finally form different encoding schemes. The encoding scheme is mainly used for adjusting the encoding type, frame rate, code rate and the like of the audio and video so as to adapt to a plurality of different playing terminals 5.
On the other hand, the convergence gateway 2 is configured with a data storage instruction and a data transmission instruction, the data storage instruction is configured to execute at least one resource pre-auditing instruction, and the resource pre-auditing instruction stores a plurality of data stream packets entering pre-auditing in the streaming media storage server 3 at a preset transmission quality based on the transmission quality of one or more executed data streams; and configuring an error descriptor for each data stream to be transmitted by the data transmission instruction, wherein the error descriptor is used for defining the data size and the index position of the data stream, and performing error recovery operation at the packet loss and delay stages of the data stream.
Under the condition of a multi-propagation protocol mechanism, a processing mode needs to be given by simultaneous congestion control, flow control and end-to-end time delay performance of streaming media. The convergence gateway 2 in this example ensures the transmission quality of the streaming media data based on NACK and FEC, and improves the storage manner of the streaming media data, and since the amount of data information to be stored is continuous for a plurality of streaming media data, it is necessary to reasonably optimize and improve data storage, so that it has the capability of satisfying that a plurality of uploading terminal devices 1 simultaneously send streaming media data transmission requests.
For the storage requirement of the streaming media data, under the screening execution instruction configured by the convergence gateway 2, the streaming media data of different regional combinations are stored in a code distribution manner, or multiple data streams of one regional combination or multiple regional combinations are stored in a specified position in an overlapping manner.
As a new example, the convergence gateway 2 of the present application mainly uses a NACK protocol, which slices streaming media data into a plurality of data packets, and then takes the data packets as basic transmission units, and assigns a tag to each data packet when establishing a session, where the tag is actually a number, as shown in fig. 5. The group is set as the minimum operation unit in the packet. The number of each group is set to be n, and the repair time delay is shortened along with the reduction of n, so that the problem of overlong time delay of the streaming media can be solved.
In fact, the data transmission instruction configures an error descriptor for each data stream to be transmitted, where the error descriptor is used to define the data size and the index position of the data stream, and performs an error recovery operation at the stage of packet loss and delay of the data stream. Here, the error descriptor is sent by the receiving end. In the traditional streaming media feedback mechanism, data feedback is realized by a sending end, and in the example, a receiving end sends a feedback signal, so that the pressure of the traditional sending end is reduced, and the occurrence of network storms is also prevented. After the feedback operation, the receiving end and the sending end synchronize the reliable signal, and the receiving end immediately responds after receiving the request packet from the sending end. And when responding, filling roundID, current miss rate, query time and the like.
In one aspect, the streaming media conversion module 4 comprising at least one protocol conversion instruction and one transmission management instruction, the protocol conversion instruction being configured to execute the instructions to transmit one or more sets of data streams to a destination address with a specified protocol type; the transmission management instruction is configured to call a data stream in the streaming media storage server 3, and transmit the data stream from a source address to a destination address.
In the streaming media playing system, as shown in fig. 4, after receiving the data stream transmitted by the collecting encoder, the multi-terminal streaming media system needs to perform protocol conversion on the data stream, and then transmits the data stream to a plurality of different playing terminals 5. Sometimes, in order to meet the loading requirement of the playing terminal 5, a plurality of different sets of video data streams can be loaded to one playing terminal 5 at the same time to realize the split-screen display effect. Sometimes, in order to meet the requirements of a plurality of different types of playing terminals 5, a plurality of video data streams are converted into a plurality of different protocols for transmission, for example, the playing terminal 5 is a tablet computer, the tablet computer uses an RTMP protocol to play a 720P video, the television terminal uses a TS over HTTP protocol to play a 1080P video, and the mobile phone uses an HLS protocol to play a 480P video, and when the same data streams are transmitted to the above devices at the same time, the streaming media conversion module 4 is required to perform protocol conversion so as to adapt to the playing effects of different terminals.
In one aspect, the cast terminal 5 is configured with at least one cast management instruction that includes performing a checksum error recovery operation on the error descriptor, and loading the data stream to a data stream reading location for data reading and playing.
The playing terminal 5 comprises various data stream loading devices such as a computer, a television, a mobile terminal and the like, and the data stream is transmitted to the playing terminal 5 through a network. The playing terminal 5 further performs a mixed splicing process on the video data streams during the loading and playing processes, so that the video data streams can play a video clip on a plurality of sub-screen displays.
As a new example, the present application provides a method for multiflow media gateway service, including:
acquiring transmission requests of a plurality of data streams from a source position to a destination position;
based on the transmission quality, the transmission destination position and the occupied resources defined in the transmission request, pre-auditing the multiple data stream resources to be transmitted, and storing the multiple data stream packets in the streaming media storage server 3 with the preset transmission quality under the condition of not reducing the transmission quality of the executed data stream;
distributing markers to the streaming media data combined in different areas in a preset loading sequence, and transmitting a plurality of groups of data streams to a target position in a specified protocol type;
and executing the data stream loading operation according to the preset loading sequence.
In the process, continuous audio and video information is compressed and transmitted to the fusion gateway 2, and the fusion gateway 2 sends the audio and video information to the streaming media storage server 3 after resource verification. When a user needs to load or call audio/video data, the user only needs to convert the audio/video data into a predetermined protocol through the streaming media conversion module 4 and send the predetermined protocol to the playing terminal 5 for loading and playing.
It should be noted that, when storing multiple data stream packets in the streaming media storage server 3 at a preset transmission quality, the method further includes storing the streaming media data of different combinations of regions in a distributed manner by using the identification code, or storing multiple data streams of one or more combinations of regions in a specified position in an overlapping manner.
Furthermore, when the stream media data of different area combinations are assigned with the markers in the preset loading sequence, the method also comprises assigning a priority sequence to the stream media of a plurality of area combinations when no preset loading sequence exists. Specifically, when the data stream loading operation is executed according to the preset loading sequence, the method further includes loading a group of streaming media data to one play terminal 5, or loading a group of streaming media data to a plurality of play terminals 5.
As a new example, the present application provides a method for multiflow media gateway service, and in particular, a method for streaming media transmission during live broadcasting. In the method, after receiving live broadcast data transmitted by a collecting encoder, a fusion gateway 2 transmits the live broadcast data to a streaming media conversion module 4 to be converted into a plurality of protocols matched with a plurality of terminals, and transmits the live broadcast data to a streaming media data server for storage and retrieval.
When a plurality of terminals load live broadcast streaming media data at the same time, in order to adapt to the playing requirements of different terminals, the streaming media data are loaded to a live broadcast channel, and simultaneously, a plurality of groups of audio and video data streams are received, the streaming media conversion module 4 converts the data in the live broadcast channel into a plurality of protocols according to different types of terminals, and then the data are transmitted to the plurality of terminals through a network for use.
The above-mentioned embodiments only express the specific embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.
Claims (10)
1. A multi-streaming media gateway service system, comprising:
the system comprises a plurality of uploading terminal devices, a fusion gateway and a plurality of uploading terminal devices, wherein the uploading terminal devices are divided into a plurality of area combinations according to mark characteristics or address characteristics, each area combination comprises a unique identification code, each uploading terminal device is configured with data stream transmission instructions, and the transmission instructions enable the uploading terminal devices to transmit acquired data streams to the fusion gateway in a slicing or grouping mode;
the system comprises a convergence gateway and a data transmission gateway, wherein the convergence gateway is configured with a data storage instruction and a data transmission instruction, the data storage instruction is configured to execute at least one resource pre-auditing instruction, and the resource pre-auditing instruction stores a plurality of data stream packets entering pre-auditing into a streaming media storage server at a preset transmission quality based on the transmission quality of one or more executed data streams; configuring an error descriptor for each data stream to be transmitted by the data transmission instruction, wherein the error descriptor is used for defining the data size and the index position of the data stream, and executing error recovery operation at the stages of packet loss and time delay of the data stream;
a streaming media conversion module comprising at least one protocol conversion instruction and a transmission management instruction, the protocol conversion instruction configured to execute the instructions to transmit one or more sets of data streams to a destination address in a specified protocol type; the transmission management instruction is configured to call a data stream in the streaming media storage server and transmit the data stream from a source address to a destination address;
the playing terminal is configured with at least one playing management instruction, the playing management instruction comprises a check sum error recovery operation for executing an error descriptor, and the playing management instruction further loads the data stream to a data stream reading position for data reading and playing.
2. The system according to claim 1, wherein the plurality of uploading terminal devices include a data stream coding module, and the data stream coding module outputs video stream media with a preset bitrate and resolution in an h.264high Profile coding manner.
3. The system according to claim 1, wherein the convergence gateway is configured to perform filtering, and the filtering performs the filtering to store the streaming media data of different regional combinations to identify code distributed storage, or store a plurality of data streams of one regional combination or a plurality of regional combinations in a specific location in an overlapping manner.
4. The system according to claim 1, wherein the convergence gateway is configured with a data tagging instruction, the data tagging instruction allocates tags to the streaming media data in different area combinations in a preset loading order, and the data tagging instruction further allocates a priority order to the streaming media in multiple area combinations when there is no preset loading order.
5. The system of claim 1, wherein the streaming media conversion module is configured with NORM protocol, RTMP protocol, RTP protocol, RTCP protocol, MMS protocol, and RTSP protocol; and the streaming media conversion module converts the data into a preset protocol type before the data stream is transmitted to a preset address.
6. The system according to claim 1, wherein the broadcasting terminal includes a data stream check instruction, the data stream check instruction performs a check operation on an error descriptor, an identification code, and a marker of the data stream, the data stream check instruction further performs a management operation on a loading order and an output manner of the data stream, the loading order of the data stream includes that streaming media data of one area combination is loaded according to a preset order, or streaming media data of a plurality of area combinations is loaded according to a preset order of the marker configured by the convergence gateway; the management of the output mode comprises loading a group of streaming media data to a playing terminal or loading a group of streaming media data to a plurality of playing terminals.
7. A method for multiflow media gateway service according to claims 1-6, comprising:
acquiring transmission requests of a plurality of data streams from a source position to a destination position;
based on the transmission quality, the transmission destination position and the occupied resources defined in the transmission request, pre-auditing the resources of the multiple data streams to be transmitted, and storing the multiple data streams in a streaming media storage server according to the preset transmission quality under the condition of not reducing the transmission quality of the executed data streams;
distributing markers to the streaming media data combined in different areas in a preset loading sequence, and transmitting a plurality of groups of data streams to a target position in a specified protocol type;
and executing the data stream loading operation according to the preset loading sequence.
8. The method of claim 7, wherein when the multiple data stream packets are stored in the streaming media storage server at a predetermined transmission quality, the method further comprises storing the streaming media data in different combinations of zones in a manner of identifying code distribution, or storing multiple data streams in one or more combinations of zones in a superimposed manner at a specific location.
9. The method of claim 7, wherein when the markers are assigned to the streaming media data of different regional combinations in a preset loading order, the method further comprises assigning a priority order to the streaming media of the regional combinations when there is no preset loading order.
10. The method of claim 7, wherein when the data stream loading operation is performed according to a preset loading sequence, the method further comprises loading a set of streaming media data to a playback terminal, or loading a set of streaming media data to multiple playback terminals.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010409207.XA CN111629283B (en) | 2020-05-14 | 2020-05-14 | Multi-stream media gateway service system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010409207.XA CN111629283B (en) | 2020-05-14 | 2020-05-14 | Multi-stream media gateway service system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111629283A true CN111629283A (en) | 2020-09-04 |
| CN111629283B CN111629283B (en) | 2023-04-07 |
Family
ID=72271847
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010409207.XA Active CN111629283B (en) | 2020-05-14 | 2020-05-14 | Multi-stream media gateway service system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111629283B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112702660A (en) * | 2020-12-18 | 2021-04-23 | 北京百度网讯科技有限公司 | Multimedia data transmission method and device, automatic driving vehicle and cloud server |
| CN112992332A (en) * | 2021-04-02 | 2021-06-18 | 深圳市科曼医疗设备有限公司 | Remote intelligent real-time monitoring operation anesthesia system |
| CN114567818A (en) * | 2020-11-27 | 2022-05-31 | 青岛海信宽带多媒体技术有限公司 | Method, device and terminal for optimizing IPTV unicast program playing |
| CN114978977A (en) * | 2022-06-02 | 2022-08-30 | 星河互联网络(深圳)有限公司 | Edge computing gateway with multi-data fusion processing |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102316097A (en) * | 2011-07-27 | 2012-01-11 | 杭州斯凯网络科技有限公司 | Streaming media scheduling and distribution method capable of reducing wait time of user |
| CN103297452A (en) * | 2012-02-24 | 2013-09-11 | 北京对角巷科技发展有限公司 | Method and system for publishing and broadcasting streaming media on Internet in live mode |
| US20140351871A1 (en) * | 2013-05-22 | 2014-11-27 | Microsoft Corporation | Live media processing and streaming service |
| CN105872858A (en) * | 2016-04-27 | 2016-08-17 | 亦非云互联网技术（上海）有限公司 | Video sharing method and system, video processing system and client side |
| CN108418819A (en) * | 2018-02-27 | 2018-08-17 | 湖南农业大学 | A kind of rural area emergent broadcast stream media live broadcasting method and application |
| CN109286820A (en) * | 2018-11-29 | 2019-01-29 | 无锡华云数据技术服务有限公司 | Stream media ordering method and system based on distributed memory system |
| CN110430480A (en) * | 2019-08-09 | 2019-11-08 | 深圳市迈岭信息技术有限公司 | A kind of system and method that Streaming Media cloud storage is synchronous |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
-
2020
- 2020-05-14 CN CN202010409207.XA patent/CN111629283B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102316097A (en) * | 2011-07-27 | 2012-01-11 | 杭州斯凯网络科技有限公司 | Streaming media scheduling and distribution method capable of reducing wait time of user |
| CN103297452A (en) * | 2012-02-24 | 2013-09-11 | 北京对角巷科技发展有限公司 | Method and system for publishing and broadcasting streaming media on Internet in live mode |
| US20140351871A1 (en) * | 2013-05-22 | 2014-11-27 | Microsoft Corporation | Live media processing and streaming service |
| CN105872858A (en) * | 2016-04-27 | 2016-08-17 | 亦非云互联网技术（上海）有限公司 | Video sharing method and system, video processing system and client side |
| CN108418819A (en) * | 2018-02-27 | 2018-08-17 | 湖南农业大学 | A kind of rural area emergent broadcast stream media live broadcasting method and application |
| CN109286820A (en) * | 2018-11-29 | 2019-01-29 | 无锡华云数据技术服务有限公司 | Stream media ordering method and system based on distributed memory system |
| CN110430480A (en) * | 2019-08-09 | 2019-11-08 | 深圳市迈岭信息技术有限公司 | A kind of system and method that Streaming Media cloud storage is synchronous |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114567818A (en) * | 2020-11-27 | 2022-05-31 | 青岛海信宽带多媒体技术有限公司 | Method, device and terminal for optimizing IPTV unicast program playing |
| CN114567818B (en) * | 2020-11-27 | 2023-10-31 | 青岛海信宽带多媒体技术有限公司 | IPTV unicast program playing optimization method and device and intelligent set top box |
| CN112702660A (en) * | 2020-12-18 | 2021-04-23 | 北京百度网讯科技有限公司 | Multimedia data transmission method and device, automatic driving vehicle and cloud server |
| CN112702660B (en) * | 2020-12-18 | 2023-11-10 | 北京百度网讯科技有限公司 | Multimedia data transmission method and device, automatic driving vehicle and cloud server |
| CN112992332A (en) * | 2021-04-02 | 2021-06-18 | 深圳市科曼医疗设备有限公司 | Remote intelligent real-time monitoring operation anesthesia system |
| CN114978977A (en) * | 2022-06-02 | 2022-08-30 | 星河互联网络(深圳)有限公司 | Edge computing gateway with multi-data fusion processing |
| CN114978977B (en) * | 2022-06-02 | 2023-10-03 | 星河互联网络(深圳)有限公司 | Edge computing gateway with multivariate data fusion processing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111629283B (en) | 2023-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111629283B (en) | Multi-stream media gateway service system and method | |
| US11245940B2 (en) | Method and apparatus for transmitting media data in multimedia transport system | |
| CN100544439C (en) | A kind of method and system of supporting the media data of multiple coded format | |
| EP2890133B1 (en) | System and method for distributing live broadcast content | |
| CN102263959B (en) | Direct broadcast transfer method and system | |
| CN101889425B (en) | Apparatus and method for simulcast over variable bandwidth channel | |
| CN106233735B (en) | Method for managing multicast video transmission | |
| WO2016138844A1 (en) | Multimedia file live broadcast method, system and server | |
| CN112752115B (en) | Live broadcast data transmission method, device, equipment and medium | |
| CN102752669B (en) | The transfer processing method of multichannel real time flow medium file and system, receiving system | |
| CN109089129B (en) | Stable multi-video binding live broadcasting system and method thereof | |
| CN105577645A (en) | Agent-based HLS client-end device and realization method thereof | |
| US9762634B2 (en) | System and method to transmit digital broadcast grade video via a cellular data network | |
| WO2011050831A1 (en) | Client entity, network entity and data replacement entity | |
| CN105430510A (en) | Video on demand method, gateway, smart terminal and video on demand system | |
| CN112203050A (en) | Method and device for continuously transmitting video | |
| KR20160033027A (en) | The method for transmitting or receiving multimedia and apparatus thereof | |
| KR101452269B1 (en) | Content Virtual Segmentation Method, and Method and System for Providing Streaming Service Using the Same | |
| CN110570614A (en) | Video monitoring system and intelligent camera | |
| CN105763848A (en) | Fish-eye camera rear end access method and system | |
| US10271075B2 (en) | Cloud encoding system | |
| KR101568317B1 (en) | System for supporting hls protocol in ip cameras and the method thereof | |
| WO2022100742A1 (en) | Video encoding and video playback method, apparatus and system | |
| KR101855327B1 (en) | Apparatus and method for delivering multimedia data in hybrid network | |
| CN114866810A (en) | Streaming video downloading method and device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |