CN112953899A - Streaming media distribution system and method supporting multi-audio video streaming protocol - Google Patents
Streaming media distribution system and method supporting multi-audio video streaming protocol Download PDFInfo
- Publication number
- CN112953899A CN112953899A CN202110105350.4A CN202110105350A CN112953899A CN 112953899 A CN112953899 A CN 112953899A CN 202110105350 A CN202110105350 A CN 202110105350A CN 112953899 A CN112953899 A CN 112953899A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- module
- data
- protocol
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a streaming media distribution system and a method supporting a multi-audio video streaming protocol, wherein the method comprises the following steps: step 1: collecting audio and video data and completing the interaction with the audio and video request of a video source at the same time; step 2: processing the collected audio and video data, and analyzing a standard video frame, audio and video data and corresponding timestamps; and step 3: packaging the acquired audio and video frames into standard format data; and 4, step 4: responding to the request of the client, establishing different transmission channels according to a specific protocol, and distributing the data packets to the corresponding transmission channels; and 5: transmitting the data packet in the transmission channel to the request client to complete audio and video transmission; the system comprises an acquisition module, an analysis module, a packaging module, a distribution module and a transmission module.
Description
Technical Field
The present invention relates to audio and video transmission, and in particular, to a streaming media distribution system and method supporting a multi-audio and video streaming protocol.
Background
Streaming Media (Streaming Media) refers to a continuous stream of audio/video data that is transmitted and played in chronological order over a data network. When people watch movies or listen to music on the internet in the past, the whole video file must be downloaded and stored on a local computer before the user can watch the movie. Different from the traditional playing mode, the streaming media does not download the whole file before playing, only part of the content is cached, and the streaming media data stream is transmitted and played simultaneously, so that the downloading waiting time and the storage space are saved.
However, how to provide streaming media content distribution services for large-scale concurrent users has been a hot issue in the field of distributed computer networks and multimedia research.
Disclosure of Invention
The present invention is directed to a streaming media distribution system and method supporting multiple audio and video streaming protocols.
A stream media distribution method supporting multi-audio video stream protocol includes the following steps:
step 1: collecting audio and video data and completing the interaction with the audio and video request of a video source at the same time;
step 2: processing the collected audio and video data, and analyzing a standard video frame, audio and video data and corresponding timestamps;
and step 3: packaging the acquired audio and video frames into standard format data;
and 4, step 4: responding to the request of the client, establishing different transmission channels according to a specific protocol, and distributing the data packets to the corresponding transmission channels;
and 5: and transmitting the data packet in the transmission channel to the request client to complete audio and video transmission.
Preferably, the step 1 supports an onvif protocol, an rtsp protocol and an rtmp protocol.
Preferably, in the step 2, the audio coding supports g.711, g.722 and PCM formats, and the video coding supports h.264, h.265 and MPEG4 formats.
Preferably, rtp, hls, rtmp and flv protocol packing is supported in the step 3.
A streaming media distribution system supporting multi-audio video streaming protocol comprises a collection module, an analysis module, an encapsulation module, a distribution module and a transmission module, wherein:
the acquisition module is used for interacting with the video source audio and video requests and acquiring audio and video data;
the analysis module is used for analyzing the audio and video data acquired by the acquisition module, and analyzing a standard video frame, audio frame data and corresponding time stamps;
the packaging module is used for packaging the audio and video frames acquired from the analysis module and packaging the audio and video frames into standard format data;
the distribution module is used for receiving the audio and video requests of the client and establishing different transmission channels according to a specific protocol;
and the transmission module is used for transmitting the audio and video data which are packaged in the packaging module to the corresponding client through the transmission channel.
Preferably, the distribution module adopts a multithreading asynchronous network IO processing mechanism.
Preferably, the transmission module completes data writing into the kernel by reading and writing events through a socket asynchronous event mechanism, and adds a data circular linked list storage strategy.
The invention has the beneficial effects that: the method supports multi-protocol audio and video requests and meets high-concurrency audio and video transmission, the multi-protocol audio and video requests can solve the problem that multiple platforms play audio and video, the high-concurrency audio and video transmission is completed based on system kernel event detection and asynchronous data transmission, namely, full utilization of system resources is guaranteed, and meanwhile, the problem of audio and video transmission under network congestion and delay is solved.
Drawings
FIG. 1 is a flow chart of the steps of the present invention.
FIG. 2 is a flow chart illustrating the method of the present invention.
Detailed Description
The invention will be further explained with reference to the drawings.
As shown in fig. 1, a streaming media distribution method supporting a multi-audio video streaming protocol includes the following steps:
step 1: collecting audio and video data and completing the interaction with the audio and video request of a video source at the same time;
step 2: processing the collected audio and video data, and analyzing a standard video frame, audio and video data and corresponding timestamps;
and step 3: packaging the acquired audio and video frames into standard format data;
and 4, step 4: responding to the request of the client, establishing different transmission channels according to a specific protocol, and distributing the data packets to the corresponding transmission channels;
and 5: and transmitting the data packet in the transmission channel to the request client to complete audio and video transmission.
It is to be understood that step 1 supports the onvif protocol, the rtsp protocol and the rtmp protocol.
It should be understood that in step 2, the audio coding supports g.711, g.722 and PCM formats, and the video coding supports h.264, h.265 and MPEG4 formats.
It should be understood that rtp, hls, rtmp and flv protocol packing are supported in the step 3.
A streaming media distribution system supporting multi-audio video streaming protocol comprises a collection module, an analysis module, an encapsulation module, a distribution module and a transmission module, wherein:
the acquisition module is used for interacting with the video source audio and video requests and acquiring audio and video data;
the analysis module is used for analyzing the audio and video data acquired by the acquisition module, and analyzing a standard video frame, audio frame data and corresponding time stamps;
the packaging module is used for packaging the audio and video frames acquired from the analysis module and packaging the audio and video frames into standard format data;
the distribution module is used for receiving the audio and video requests of the client and establishing different transmission channels according to a specific protocol;
and the transmission module is used for transmitting the audio and video data which are packaged in the packaging module to the corresponding client through the transmission channel.
It is to be understood that the distribution module employs a multi-threaded, asynchronous network IO processing mechanism.
It should be understood that the distribution module employs a multi-threaded, asynchronous network IO processing mechanism.
It should be understood that, the transmission module completes data writing into the kernel by reading and writing events through a socket asynchronous event mechanism, and adds a data circular linked list storage strategy.
FIG. 2 is a flow chart illustrating the method of the present invention.
It is to be noted that, firstly, an audio/video channel is created, and system resources are initialized; completing onvif authentication and rtsp protocol assembly, and sending a video request to a video source; and processing the video source response packet, including processing the protocol packet and the audio and video packet.
It should be understood that, from the audio and video data obtained in the foregoing steps, complete audio and video frame data is extracted, and a time stamp of the audio and video frame is obtained.
It needs to be understood that the client sends an audio/video request, the server finds a built audio/video channel, and adds the client into the audio/video channel; when the server receives an audio and video request of the client, packaging audio and video data according to a protocol required by the client, and adding the packaged data to a client transmission queue; and completing audio and video data transmission.
Claims (7)
1. A stream media distribution method supporting multi-audio video stream protocol is characterized by comprising the following steps:
step 1: collecting audio and video data and completing the interaction with the audio and video request of a video source at the same time;
step 2: processing the collected audio and video data, and analyzing a standard video frame, audio and video data and corresponding timestamps;
and step 3: packaging the acquired audio and video frames into standard format data;
and 4, step 4: responding to the request of the client, establishing different transmission channels according to a specific protocol, and distributing the data packets to the corresponding transmission channels;
and 5: and transmitting the data packet in the transmission channel to the request client to complete audio and video transmission.
2. The streaming media distribution method supporting the multi-audio video streaming protocol as claimed in claim 1, wherein the step 1 supports an onvif protocol, an rtsp protocol and an rtmp protocol.
3. The streaming media distribution method supporting the multi-audio video streaming protocol as claimed in claim 1, wherein in the step 2, the audio coding supports g.711, g.722 and PCM formats, and the video coding supports h.264, h.265 and MPEG4 formats.
4. The streaming media distribution method supporting the multi-audio video streaming protocol as claimed in claim 1, wherein rtp, hls, rtmp and flv protocol packets are supported in the step 3.
5. A streaming media distribution system supporting a multi-audio video streaming protocol is characterized by comprising a collection module, an analysis module, an encapsulation module, a distribution module and a transmission module, wherein:
the acquisition module is used for interacting with the video source audio and video requests and acquiring audio and video data;
the analysis module is used for analyzing the audio and video data acquired by the acquisition module, and analyzing a standard video frame, audio frame data and corresponding time stamps;
the packaging module is used for packaging the audio and video frames acquired from the analysis module and packaging the audio and video frames into standard format data;
the distribution module is used for receiving the audio and video requests of the client and establishing different transmission channels according to a specific protocol;
and the transmission module is used for transmitting the audio and video data which are packaged in the packaging module to the corresponding client through the transmission channel.
6. The streaming media distribution system supporting the multi-audio video streaming protocol of claim 5, wherein the distribution module employs a multi-threaded, asynchronous network IO processing mechanism.
7. The streaming media distribution system supporting the multi-audio video streaming protocol as claimed in claim 5, wherein the transmission module completes data writing into the kernel by reading and writing events through a socket asynchronous event mechanism, and adds a new circular linked list storage policy for data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110105350.4A CN112953899A (en) | 2021-01-26 | 2021-01-26 | Streaming media distribution system and method supporting multi-audio video streaming protocol |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110105350.4A CN112953899A (en) | 2021-01-26 | 2021-01-26 | Streaming media distribution system and method supporting multi-audio video streaming protocol |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112953899A true CN112953899A (en) | 2021-06-11 |
Family
ID=76237151
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110105350.4A Pending CN112953899A (en) | 2021-01-26 | 2021-01-26 | Streaming media distribution system and method supporting multi-audio video streaming protocol |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112953899A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114339389A (en) * | 2022-01-10 | 2022-04-12 | 稿定（厦门）科技有限公司 | Audio-video system |
| CN115150369A (en) * | 2022-06-29 | 2022-10-04 | 湖北天融信网络安全技术有限公司 | Audio and video proxy method and audio and video proxy container |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1804455A1 (en) * | 2005-12-27 | 2007-07-04 | Siemens S.p.A. | Method and system to exchange videos in real-time taken by one's cellular handset during two-party voice calls |
| CN101287095A (en) * | 2008-03-28 | 2008-10-15 | 中兴通讯股份有限公司 | Implementing method and system for recorded broadcast service of stream media of meeting television |
| CN102131084A (en) * | 2010-01-19 | 2011-07-20 | 深圳市在线通网络科技开发有限公司 | RTMP (Real Time Messaging Protocol) pushing device and method for audio/video streaming media |
| CN103167275A (en) * | 2011-12-16 | 2013-06-19 | 中国航天科工集团第二研究院七〇六所 | Network video monitoring system and steaming media data distribution method thereof |
| CN109963184A (en) * | 2017-12-14 | 2019-07-02 | 阿里巴巴集团控股有限公司 | A kind of method, apparatus and electronic equipment of audio-video network broadcasting |
| CN110087147A (en) * | 2019-04-25 | 2019-08-02 | 视联动力信息技术股份有限公司 | A kind of method and apparatus of audio/video flow transmission |
| US10382452B1 (en) * | 2007-06-12 | 2019-08-13 | Icontrol Networks, Inc. | Communication protocols in integrated systems |
| CN110460910A (en) * | 2019-08-23 | 2019-11-15 | 南京美乐威电子科技有限公司 | A kind of conversion method of RTMP agreement to NDI agreement, conversion equipment and converting system |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
-
2021
- 2021-01-26 CN CN202110105350.4A patent/CN112953899A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1804455A1 (en) * | 2005-12-27 | 2007-07-04 | Siemens S.p.A. | Method and system to exchange videos in real-time taken by one's cellular handset during two-party voice calls |
| US10382452B1 (en) * | 2007-06-12 | 2019-08-13 | Icontrol Networks, Inc. | Communication protocols in integrated systems |
| CN101287095A (en) * | 2008-03-28 | 2008-10-15 | 中兴通讯股份有限公司 | Implementing method and system for recorded broadcast service of stream media of meeting television |
| CN102131084A (en) * | 2010-01-19 | 2011-07-20 | 深圳市在线通网络科技开发有限公司 | RTMP (Real Time Messaging Protocol) pushing device and method for audio/video streaming media |
| CN103167275A (en) * | 2011-12-16 | 2013-06-19 | 中国航天科工集团第二研究院七〇六所 | Network video monitoring system and steaming media data distribution method thereof |
| CN109963184A (en) * | 2017-12-14 | 2019-07-02 | 阿里巴巴集团控股有限公司 | A kind of method, apparatus and electronic equipment of audio-video network broadcasting |
| CN110087147A (en) * | 2019-04-25 | 2019-08-02 | 视联动力信息技术股份有限公司 | A kind of method and apparatus of audio/video flow transmission |
| CN110460910A (en) * | 2019-08-23 | 2019-11-15 | 南京美乐威电子科技有限公司 | A kind of conversion method of RTMP agreement to NDI agreement, conversion equipment and converting system |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114339389A (en) * | 2022-01-10 | 2022-04-12 | 稿定（厦门）科技有限公司 | Audio-video system |
| CN114339389B (en) * | 2022-01-10 | 2024-05-14 | 稿定（厦门）科技有限公司 | Audio-video system |
| CN115150369A (en) * | 2022-06-29 | 2022-10-04 | 湖北天融信网络安全技术有限公司 | Audio and video proxy method and audio and video proxy container |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4619353B2 (en) | System for distributing multimedia content | |
| US8874778B2 (en) | Live streaming media delivery for mobile audiences | |
| EP2383941B1 (en) | Client terminal, method and system for downloading streaming media | |
| WO2008061416A1 (en) | A method and a system for supporting media data of various coding formats | |
| CN106685942A (en) | Video live and replaying system and video live and replaying method | |
| WO2009070936A1 (en) | Content publishing and storing method for interactive personal television media delivery system | |
| WO2013053326A1 (en) | Method, server, client and system for recording and playing replay program | |
| MX2014012361A (en) | Methods and systems for real-time transmuxing of streaming media content. | |
| WO2014169828A1 (en) | Method, device, and system for playing surveillance video | |
| WO2016145913A1 (en) | Self-adaptive streaming medium processing method and apparatus | |
| RU2011137994A (en) | SMOOTH STREAM TRANSFER OF CUSTOMER MULTIMEDIA WITHOUT STATUS LOCK | |
| WO2013178010A1 (en) | Multimedia content distribution method, device and system | |
| CN101064669A (en) | Network real-time playing multimedia data method | |
| CN112953899A (en) | Streaming media distribution system and method supporting multi-audio video streaming protocol | |
| WO2015109847A1 (en) | Method for rapidly delivering segmented programs, server and client | |
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| KR20150048735A (en) | Rendering time control | |
| CN103024491A (en) | Video playing method and video playing system of mobile terminal | |
| JP2005094769A (en) | Apparatus and method for providing high speed download service of multimedia contents | |
| WO2012041039A1 (en) | Method, correlative equipment and system for digital tv terminal accessing internet video | |
| CN101984619A (en) | Implementation method and system of streaming media service | |
| CN103905922A (en) | Streaming media protocol encapsulation method and device based on http protocol | |
| CN102244813A (en) | Video playing method and internet television terminal applying same | |
| CN101193105A (en) | A media stream transmission/switching method | |
| Lazic et al. | One Implementation of adaptive streaming over HTTP on Android DTV platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |