CN106790030A - Multi-screen collaboration audio transmission service end, client, system and its processing method - Google Patents

Multi-screen collaboration audio transmission service end, client, system and its processing method Download PDF

Info

Publication number
CN106790030A
CN106790030A CN201611159671.8A CN201611159671A CN106790030A CN 106790030 A CN106790030 A CN 106790030A CN 201611159671 A CN201611159671 A CN 201611159671A CN 106790030 A CN106790030 A CN 106790030A
Authority
CN
China
Prior art keywords
screen
audio transmission
service end
client
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201611159671.8A
Other languages
Chinese (zh)
Other versions
CN106790030B (en
Inventor
龚翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Changhong Electric Co Ltd
Original Assignee
Sichuan Changhong Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Changhong Electric Co Ltd filed Critical Sichuan Changhong Electric Co Ltd
Priority to CN201611159671.8A priority Critical patent/CN106790030B/en
Publication of CN106790030A publication Critical patent/CN106790030A/en
Application granted granted Critical
Publication of CN106790030B publication Critical patent/CN106790030B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment

Abstract

The present invention relates to smart machine technology.The present invention is to solve now needing downloaded or copy the problem that smart machine end plays out to, there is provided a kind of multi-screen collaboration audio transmission service end, client, system and its processing method, its technical scheme can be summarized as:Multi-screen collaboration audio transmission service end includes service end conversation module and sending module, service end conversation module is connected with sending module, multi-screen collaboration audio transmission client includes client session module, receiver module, transmission quality control module and player, the receiver module is connected with client session module, transmission quality control module is connected with receiver module, player is connected with transmission quality control module, and transmission quality control module is connected with client session module.The beneficial effects of the invention are as follows facilitating user, it is adaptable to the multi-screen collaboration of smart machine.

Description

Multi-screen collaboration audio transmission service end, client, system and its processing method
Technical field
The present invention relates to smart machine technology, more particularly to the multi-screen coordination technique of smart machine.
Background technology
With the development and the popularization of home intelligent equipment of the network communications technology, ground of the intelligent television in terms of home entertaining Position becomes increasingly conspicuous, and using wireless network, realizes the interactive application of intelligent television and smart machine, need to be by audio using traditional approach File download copies intelligent television end to and plays out, and traditional mode cannot meet quick and easy in interactive application Principle.
The content of the invention
Needed downloaded at present the invention aims to solve or copy smart machine end to and play out Problem, there is provided a kind of multi-screen collaboration audio transmission service end, client, system and its processing method.
The present invention solves its technical problem, and the technical scheme of use is that multi-screen collaboration audio transmission service end, its feature exists In, including service end conversation module and sending module, the service end conversation module are connected with sending module,
The service end conversation module is used to pass through network connection with client, there is provided logical between service end and client Letter, including RTSP reports, RTP packets and transmission flow control tube reason packet;
The sending module is used to that corresponding voice data stream to be packaged into RTP bags and client is sent to, and receive and The transmission flow control tube reason packet that treatment client sends.
Specifically, the transmission flow control tube reason packet is RTCP packets.
Further, play instruction and/or pause instruction and/or halt instruction are included in the RTSP reports.
Multi-screen cooperates with audio transmission client, it is characterised in that including client session module, receiver module, transmission matter Amount control module and player, the receiver module be connected with client session module, transmission quality control module and reception mould Block is connected, and player is connected with transmission quality control module, and transmission quality control module is connected with client session module,
The client session module is used to pass through network connection with service end, there is provided logical between service end and client Letter, including RTSP reports, RTP packets and transmission flow control tube reason packet;
The receiver module is used to receive and parse through the RTP bags that service end sends;
The RTP bags that the transmission quality control module is used to be received according to receiver module are transmitted flow control tube reason, Transmission flow control tube reason packet is sent to service end;
The player is used to play the voice data stream obtained after parsing.
Specifically, the transmission flow control tube reason packet is RTCP packets.
Further, play instruction and/or pause instruction and/or halt instruction are included in the RTSP reports.
Multi-screen cooperates with audio transmission system, it is characterised in that cooperate with audio transmission service end and above-mentioned including above-mentioned multi-screen Multi-screen cooperates with audio transmission client, the service end conversation module to pass through network connection with client session module.
Multi-screen cooperates with the processing method of audio transmission system, is applied to above-mentioned multi-screen collaboration audio transmission system, its feature It is to comprise the following steps:
Step 1, multi-screen collaboration audio transmission client cooperate with audio transmission service end to send by RTSP agreements to multi-screen Session connection request is set up, multi-screen collaboration audio transmission service end sets up session connection;
Step 2, multi-screen collaboration audio transmission client cooperate with audio transmission service end to send by RTSP agreements to multi-screen Voice data transmission request;
Corresponding voice data stream is packaged into RTP bags by step 3, multi-screen collaboration audio transmission service end, and is stamped corresponding Timestamp information and sequence number and be sent to multi-screen collaboration audio transmission client;
Step 4, multi-screen cooperate with audio transmission client according to timestamp information in the RTP bags for receiving to audio therein Data stream is simultaneously stored in Data buffer;
Step 5, the transmission quality control module of multi-screen collaboration audio transmission client extract audio from Data buffer Data flow, is transferred to player and plays out after it is ranked up according to sequence number, and will play synchronizing information by transport stream Amount control management packet feeds back to multi-screen collaboration audio transmission service end, and multi-screen cooperates with audio transmission service end according to receiving The reason packet adjustment of transmission flow control tube send the tactful to realize audio sync of RTP bags;
When step 6, broadcasting, multi-screen collaboration audio transmission service end and multi-screen collaboration audio transmission client moment monitor The RTSP reports for receiving, and respective handling is carried out to it.
Specifically, step 1 includes step in detail below:
Step 101, multi-screen collaboration audio transmission service end start, one transmission flow control real time service thread of establishment, RTP real time services thread and a RTSP real time service thread;
Step 102, multi-screen collaboration audio transmission service end create a UDP socket and bind it to provided clothes On the address of business, RTP bags use an even number, then corresponding transmission flow control data bag uses odd number thereafter Port;
Step 103, multi-screen collaboration audio transmission service end moment monitor and receive and cooperate with audio transmission client from multi-screen The RTSP reports at end, if being session connection request in receiving the RTSP reports that multi-screen collaboration audio transmission client sends, Then enter step 104, otherwise into step 6;
Step 104, multi-screen collaboration audio transmission service end respond the session connection request, and audio transmission visitor is cooperateed with multi-screen Session connection is set up at family end, into step 2.
Further, step 3 is comprised the following steps:
Step 301, multi-screen collaboration audio transmission service end judge each voice data frame sign in corresponding voice data stream, If the length of a frame exceedes MTU, burst package is carried out to the frame;
Audio data frame is converted to RTP bags, and the root in RTP packet header by step 302, multi-screen collaboration audio transmission service end Sequence number and timestamp information are set according to every frame information, for playing synchronization and packet loss treatment;
RTP bags are stored in transmission Buffer Pool and are sent to according to sending strategy by step 303, multi-screen collaboration audio transmission service end Multi-screen cooperates with audio transmission client;
Step 4 is comprised the following steps:
Step 401, multi-screen collaboration audio transmission client receive RTP bags, and it is parsed, and remove RTP packet header letter Cease, and audio data frame, sequence number and the timestamp information for obtaining will be parsed and be stored in Data buffer;
Step 5 is comprised the following steps:
Step 501, the transmission quality control module of multi-screen collaboration audio transmission client extract sound from Data buffer Frequency data stream;
Step 502, the voice data stream that will be extracted are ranked up according to correspondence sequence number, while analysis is in UPD transmission The RTP bags lost, multi-screen collaboration audio transmission service end is fed back to by transmitting flow control tube reason packet;
Step 503, the corresponding timestamp information of extracted voice data stream is utilized to set up absolute time axis information, ought Preceding temporal information is compared with absolute time information and is transferred to player and plays out, and will compare difference by transmitting flow control Management packet feeds back to multi-screen collaboration audio transmission service end;
Step 504, multi-screen collaboration audio transmission service end are according to the transmission flow control tube reason packet adjustment for receiving The strategy of RTP bags is sent to realize audio sync.
The beneficial effects of the invention are as follows in the present invention program, by above-mentioned multi-screen collaboration audio transmission service end, client End, system and its processing method, can cooperate with audio transmission service end to cooperate with audio transmission with multi-screen by real-time performance multi-screen Between client use data stream transmitting voice data, it is not necessary to client again to need play audio file be downloaded or Copy to locally, facilitate user, treatment is quick.
Brief description of the drawings
Fig. 1 is the system block diagram that multi-screen of the present invention cooperates with audio transmission service end.
Fig. 2 is the system block diagram that multi-screen of the present invention cooperates with audio transmission client.
Fig. 3 is the system block diagram that multi-screen cooperates with audio transmission system.
Specific embodiment
Below in conjunction with the accompanying drawings and embodiment, technical scheme is described in detail.
Multi-screen of the invention cooperates with audio transmission service end, its system block diagram referring to Fig. 1, including service end conversation module and Sending module, service end conversation module is connected with sending module, wherein, service end conversation module is used to pass through network with client Connection, there is provided the communication between service end and client, including RTSP reports, RTP packets and transmission flow control tube reason number According to bag;Sending module is used to that corresponding voice data stream to be packaged into RTP bags and client is sent to, and receives and treatment client The transmission flow control tube reason packet that end sends.
Multi-screen of the invention cooperates with audio transmission client, its system block diagram referring to Fig. 2, including client session module, Receiver module, transmission quality control module and player, receiver module are connected with client session module, transmission quality control mould Block is connected with receiver module, and player is connected with transmission quality control module, transmission quality control module and client session mould Block is connected, wherein, client session module is used to pass through network connection with service end, there is provided logical between service end and client Letter, including RTSP reports, RTP packets and transmission flow control tube reason packet;Receiver module is used to receive and parse through service The RTP bags that end sends;The RTP bags that transmission quality control module is used to be received according to receiver module are transmitted flow control tube Reason, transmission flow control tube reason packet is sent to service end;Player is used to play the voice data stream obtained after parsing.
Multi-screen of the invention cooperates with audio transmission system, its system block diagram to be passed referring to Fig. 3, including above-mentioned multi-screen collaboration audio Defeated service end and above-mentioned multi-screen collaboration audio transmission client, the service end conversation module pass through net with client session module Network is connected.
Multi-screen of the invention cooperates with the processing method of audio transmission system, is applied to above-mentioned multi-screen collaboration audio transmission system In, it is specially:Multi-screen collaboration audio transmission client cooperates with audio transmission service end to send out by RTSP agreements to multi-screen first Send and set up session connection request, multi-screen collaboration audio transmission service end sets up session connection, multi-screen collaboration audio transmission client Cooperate with audio transmission service end to send voice data to multi-screen by RTSP agreements again and transmit request, then multi-screen collaboration audio is passed Corresponding voice data stream is packaged into RTP bags by defeated service end, and is stamped corresponding timestamp information and sequence number and be sent to many Screen collaboration audio transmission client, multi-screen cooperates with audio transmission client further according to timestamp information pair in the RTP bags for receiving Voice data stream therein is decoded and is stored in Data buffer, then the transmission quality control of multi-screen collaboration audio transmission client Module extracts voice data stream from Data buffer, and being transferred to player after it is ranked up according to sequence number plays out, And broadcasting synchronizing information is fed back into multi-screen collaboration audio transmission service end, multi-screen association by transmitting flow control tube reason packet The strategy of RTP bags is sent to realize sound according to the transmission flow control tube reason packet adjustment for receiving with audio transmission service end Frequency is synchronous;During broadcasting, multi-screen collaboration audio transmission service end and the client moment monitoring of multi-screen collaboration audio transmission are received RTSP reports, and respective handling is carried out to it.
Embodiment
The multi-screen collaboration audio transmission service end of the embodiment of the present invention, its system block diagram is referring to Fig. 1, including service end session Module and sending module, service end conversation module are connected with sending module, wherein, service end conversation module is used for logical with client Cross network connection, there is provided the communication between service end and client, including RTSP reports, RTP packets and transmission flow control Management packet;Sending module is used to that corresponding voice data stream to be packaged into RTP bags and client is sent to, and receives and locate The transmission flow control tube reason packet that reason client sends.
In this example, transmission flow control tube reason packet is preferably RTCP packets, and can also be included in RTSP reports The audio operations such as play instruction and/or pause instruction and/or halt instruction etc., broadcasting, pause and the stopping of correspondence player.
The multi-screen collaboration audio transmission client of the embodiment of the present invention, its system block diagram is referring to Fig. 2, including client session Module, receiver module, transmission quality control module and player, receiver module are connected with client session module, transmission quality Control module is connected with receiver module, and player is connected with transmission quality control module, transmission quality control module and client Conversation module is connected, wherein, client session module is used to pass through network connection with service end, there is provided service end and client it Between communication, including RTSP report, RTP packets and transmission flow control tube reason packet;Receiver module is used to receive and solve The RTP bags that analysis service end sends;The RTP bags that transmission quality control module is used to be received according to receiver module are transmitted flow Control management, transmission flow control tube reason packet is sent to service end;Player is used to play the audio number obtained after parsing According to stream.
In this example, transmission flow control tube reason packet is preferably RTCP packets, and can also be included in RTSP reports The audio operations such as play instruction and/or pause instruction and/or halt instruction etc., broadcasting, pause and the stopping of correspondence player.
The multi-screen collaboration audio transmission system of the embodiment of the present invention, its system block diagram is referring to Fig. 3, including the collaboration of above-mentioned multi-screen Audio transmission service end and above-mentioned multi-screen collaboration audio transmission client, the service end conversation module and client session module By network connection.
When using, specific process step is as follows:
Step 1, multi-screen collaboration audio transmission client cooperate with audio transmission service end to send by RTSP agreements to multi-screen Session connection request is set up, multi-screen collaboration audio transmission service end sets up session connection.
In this step, it may include step in detail below:
Step 101, multi-screen collaboration audio transmission service end start, one transmission flow control real time service thread of establishment, RTP real time services thread and a RTSP real time service thread;
Step 102, multi-screen collaboration audio transmission service end create a UDP socket and bind it to provided clothes On the address of business, RTP bags use an even number, then corresponding transmission flow control data bag uses odd number thereafter Port;
Step 103, multi-screen collaboration audio transmission service end moment monitor and receive and cooperate with audio transmission client from multi-screen The RTSP reports at end, if being session connection request in receiving the RTSP reports that multi-screen collaboration audio transmission client sends, Then enter step 104, otherwise into step 6;
Step 104, multi-screen collaboration audio transmission service end respond the session connection request, and audio transmission visitor is cooperateed with multi-screen Session connection is set up at family end, into step 2.
Step 2, multi-screen collaboration audio transmission client cooperate with audio transmission service end to send by RTSP agreements to multi-screen Voice data transmission request.
Corresponding voice data stream is packaged into RTP bags by step 3, multi-screen collaboration audio transmission service end, and is stamped corresponding Timestamp information and sequence number and be sent to multi-screen collaboration audio transmission client.
In this step, it may include step in detail below:
Step 301, multi-screen collaboration audio transmission service end judge each voice data frame sign in corresponding voice data stream, If the length of a frame exceedes MTU, burst package is carried out to the frame;
Audio data frame is converted to RTP bags, and the root in RTP packet header by step 302, multi-screen collaboration audio transmission service end Sequence number and timestamp information are set according to every frame information, for playing synchronization and packet loss treatment;
RTP bags are stored in transmission Buffer Pool and are sent to according to sending strategy by step 303, multi-screen collaboration audio transmission service end Multi-screen cooperates with audio transmission client.
Step 4, multi-screen cooperate with audio transmission client according to timestamp information in the RTP bags for receiving to audio therein Data stream is simultaneously stored in Data buffer.
In this step, it may include step in detail below:
Step 401, multi-screen collaboration audio transmission client receive RTP bags, and it is parsed, and remove RTP packet header letter Cease, and audio data frame, sequence number and the timestamp information for obtaining will be parsed and be stored in Data buffer.
Step 5, the transmission quality control module of multi-screen collaboration audio transmission client extract audio from Data buffer Data flow, is transferred to player and plays out after it is ranked up according to sequence number, and will play synchronizing information by transport stream Amount control management packet feeds back to multi-screen collaboration audio transmission service end, and multi-screen cooperates with audio transmission service end according to receiving The reason packet adjustment of transmission flow control tube send the tactful to realize audio sync of RTP bags.
In this step, it may include step in detail below:
Step 501, the transmission quality control module of multi-screen collaboration audio transmission client extract sound from Data buffer Frequency data stream;
Step 502, the voice data stream that will be extracted are ranked up according to correspondence sequence number, while analysis is in UPD transmission The RTP bags lost, multi-screen collaboration audio transmission service end is fed back to by transmitting flow control tube reason packet;Here, its point Analysing to be:All it is continuous due to sequence number, if the sequence number of the voice data stream then played before extracts voice data with current It is not continuous between the sequence number of stream, then it is assumed that wherein there are the RTP bags lost, then does not enter step 503 now, but by passing Defeated flow control tube reason packet feeds back to multi-screen collaboration audio transmission service end, otherwise into step 503;
Step 503, the corresponding timestamp information of extracted voice data stream is utilized to set up absolute time axis information, ought Preceding temporal information is compared with absolute time information and is transferred to player and plays out, and will compare difference by transmitting flow control Management packet feeds back to multi-screen collaboration audio transmission service end;
Step 504, multi-screen collaboration audio transmission service end are according to the transmission flow control tube reason packet adjustment for receiving The strategy of RTP bags is sent to realize audio sync.Here, if being described in the transmission flow control tube reason packet for receiving There are the RTP bags lost, then retransmitted according to strategy, otherwise according to the sending strategy for comparing difference adjustment RTP bags.
When step 6, broadcasting, multi-screen collaboration audio transmission service end and multi-screen collaboration audio transmission client moment monitor The RTSP reports for receiving, and respective handling is carried out to it.
Here, respective handling include with the corresponding broadcasting of RTSP reports, pause and stopping etc. audio operation.

Claims (10)

1. multi-screen cooperates with audio transmission service end, it is characterised in that including service end conversation module and sending module, the service End conversation module is connected with sending module,
The service end conversation module is used to pass through network connection with client, there is provided the communication between service end and client, Including RTSP reports, RTP packets and transmission flow control tube reason packet;
The sending module is used to that corresponding voice data stream to be packaged into RTP bags and client is sent to, and receives and process The transmission flow control tube reason packet that client sends.
2. multi-screen as claimed in claim 1 cooperates with audio transmission service end, it is characterised in that the transmission flow control tube reason Packet is RTCP packets.
3. multi-screen as claimed in claim 1 cooperates with audio transmission service end, it is characterised in that is included in the RTSP reports and broadcast Put instruction and/or pause instruction and/or halt instruction.
4. multi-screen cooperates with audio transmission client, it is characterised in that including client session module, receiver module, transmission quality Control module and player, the receiver module are connected with client session module, transmission quality control module and receiver module Connection, player is connected with transmission quality control module, and transmission quality control module is connected with client session module,
The client session module is used to pass through network connection with service end, there is provided the communication between service end and client, Including RTSP reports, RTP packets and transmission flow control tube reason packet;
The receiver module is used to receive and parse through the RTP bags that service end sends;
The RTP bags that the transmission quality control module is used to be received according to receiver module are transmitted flow control tube reason, to clothes Business end sends transmission flow control tube reason packet;
The player is used to play the voice data stream obtained after parsing.
5. multi-screen as claimed in claim 4 cooperates with audio transmission client, it is characterised in that the transmission flow control tube reason Packet is RTCP packets.
6. multi-screen as claimed in claim 5 cooperates with audio transmission client, it is characterised in that is included in the RTSP reports and broadcast Put instruction and/or pause instruction and/or halt instruction.
7. multi-screen cooperates with audio transmission system, it is characterised in that cooperate with audio including the multi-screen as described in claim 1 or 2 or 3 Transmission service end and the collaboration audio transmission client of the multi-screen as described in claim 4 or 5 or 6, the service end conversation module Pass through network connection with client session module.
8. multi-screen cooperates with the processing method of audio transmission system, is applied to multi-screen collaboration audio transmission as claimed in claim 7 System, it is characterised in that comprise the following steps:
Step 1, multi-screen collaboration audio transmission client cooperate with audio transmission service end to send and set up by RTSP agreements to multi-screen Session connection request, multi-screen collaboration audio transmission service end sets up session connection;
Step 2, multi-screen collaboration audio transmission client cooperate with audio transmission service end to send audio by RTSP agreements to multi-screen Data transfer request;
Corresponding voice data stream is packaged into RTP bags by step 3, multi-screen collaboration audio transmission service end, and when stamping corresponding Between stab information and sequence number and be sent to multi-screen collaboration audio transmission client;
Step 4, multi-screen cooperate with audio transmission client according to timestamp information in the RTP bags for receiving to voice data therein Stream is decoded and is stored in Data buffer;
Step 5, the transmission quality control module of multi-screen collaboration audio transmission client extract voice data from Data buffer Stream, is transferred to player and plays out after it is ranked up according to sequence number, and will play synchronizing information by transmitting flow control Tubulation reason packet feeds back to multi-screen collaboration audio transmission service end, and multi-screen cooperates with audio transmission service end according to the biography for receiving Defeated flow control tube reason packet adjustment sends the strategy of RTP bags to realize audio sync;
When step 6, broadcasting, multi-screen collaboration audio transmission service end and the client moment monitoring of multi-screen collaboration audio transmission are received The RTSP reports arrived, and respective handling is carried out to it.
9. multi-screen as claimed in claim 8 cooperates with the processing method of audio transmission system, it is characterised in that step 1 include with Lower specific steps:
Step 101, multi-screen collaboration audio transmission service end start, and create transmission flow control real time service thread, a RTP realities When a service thread and RTSP real time service thread;
Step 102, multi-screen collaboration audio transmission service end create a UDP socket and bind it to provided service On address, RTP bags use an even number, then corresponding transmission flow control data bag uses odd number end thereafter Mouthful;
Step 103, multi-screen collaboration audio transmission service end moment are monitored and received from multi-screen collaboration audio transmission client RTSP is reported, if being session connection request in receiving the RTSP reports that multi-screen collaboration audio transmission client sends, entered Enter step 104, otherwise into step 6;
Step 104, multi-screen collaboration audio transmission service end respond the session connection request, and audio transmission client is cooperateed with multi-screen Session connection is set up, into step 2.
10. multi-screen as claimed in claim 8 cooperates with the processing method of audio transmission system, it is characterised in that step 3 include with Lower step:
Step 301, multi-screen collaboration audio transmission service end judge each voice data frame sign in corresponding voice data stream, if one When the length of frame exceedes MTU, then burst package is carried out to the frame;
Audio data frame is converted to RTP bags by step 302, multi-screen collaboration audio transmission service end, and according to every in RTP packet header Frame information sets sequence number and timestamp information, for playing synchronization and packet loss treatment;
RTP bags are stored in transmission Buffer Pool and are sent to multi-screen according to sending strategy by step 303, multi-screen collaboration audio transmission service end Collaboration audio transmission client;
Step 4 is comprised the following steps:
Step 401, multi-screen collaboration audio transmission client receive RTP bags, and it is parsed, and remove RTP header packet informations, and Audio data frame, sequence number and the timestamp information for obtaining will be parsed and be stored in Data buffer;
Step 5 is comprised the following steps:
Step 501, the transmission quality control module of multi-screen collaboration audio transmission client extract audio number from Data buffer According to stream;
Step 502, the voice data stream that will be extracted are ranked up according to correspondence sequence number, while analysis is lost in UPD transmission RTP bags, by transmit flow control tube manage packet feed back to multi-screen cooperate with audio transmission service end;
Step 503, the corresponding timestamp information of extracted voice data stream is utilized to set up absolute time axis information, when will be current Between information compared with absolute time information and be transferred to player and play out, difference will be compared and managed by transmitting flow control tube Packet feeds back to multi-screen collaboration audio transmission service end;
Step 504, multi-screen collaboration audio transmission service end send according to the transmission flow control tube reason packet adjustment for receiving The strategy of RTP bags is realizing audio sync.
CN201611159671.8A 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof Active CN106790030B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611159671.8A CN106790030B (en) 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611159671.8A CN106790030B (en) 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof

Publications (2)

Publication Number Publication Date
CN106790030A true CN106790030A (en) 2017-05-31
CN106790030B CN106790030B (en) 2020-05-19

Family

ID=58887479

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611159671.8A Active CN106790030B (en) 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof

Country Status (1)

Country Link
CN (1) CN106790030B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110943977A (en) * 2019-11-11 2020-03-31 普联技术有限公司 Multimedia service data transmission method, server, equipment and storage medium
CN112449224A (en) * 2019-09-05 2021-03-05 深圳Tcl新技术有限公司 Method, system and storage medium for controlling smart television by voice
CN116471351A (en) * 2022-01-10 2023-07-21 荣耀终端有限公司 Method and device for transmitting call audio data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1656772A (en) * 2002-05-21 2005-08-17 通用仪表公司 Association of security parameters for a collection of related streaming protocols
CN102340506A (en) * 2011-09-29 2012-02-01 广东高新兴通信股份有限公司 Multimedia data transmission system and application method thereof
CN102917212A (en) * 2012-10-29 2013-02-06 合肥移瑞通信技术有限公司 3G (The 3rd Generation Telecommunication) wireless video monitoring implementation method and 3G wireless video monitoring system based on RTP (Real Time Protocol) and RTSP (Real Time Streaming Protocol)
CN103248956A (en) * 2013-05-20 2013-08-14 浙江传媒学院 Realizing method and system of intelligent home video business in multi-screen cooperating mode

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1656772A (en) * 2002-05-21 2005-08-17 通用仪表公司 Association of security parameters for a collection of related streaming protocols
CN102340506A (en) * 2011-09-29 2012-02-01 广东高新兴通信股份有限公司 Multimedia data transmission system and application method thereof
CN102917212A (en) * 2012-10-29 2013-02-06 合肥移瑞通信技术有限公司 3G (The 3rd Generation Telecommunication) wireless video monitoring implementation method and 3G wireless video monitoring system based on RTP (Real Time Protocol) and RTSP (Real Time Streaming Protocol)
CN103248956A (en) * 2013-05-20 2013-08-14 浙江传媒学院 Realizing method and system of intelligent home video business in multi-screen cooperating mode

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112449224A (en) * 2019-09-05 2021-03-05 深圳Tcl新技术有限公司 Method, system and storage medium for controlling smart television by voice
CN112449224B (en) * 2019-09-05 2023-02-17 深圳Tcl新技术有限公司 Method, system and storage medium for controlling smart television by voice
CN110943977A (en) * 2019-11-11 2020-03-31 普联技术有限公司 Multimedia service data transmission method, server, equipment and storage medium
CN116471351A (en) * 2022-01-10 2023-07-21 荣耀终端有限公司 Method and device for transmitting call audio data
CN116471351B (en) * 2022-01-10 2024-04-09 荣耀终端有限公司 Method and device for transmitting call audio data

Also Published As

Publication number Publication date
CN106790030B (en) 2020-05-19

Similar Documents

Publication Publication Date Title
US9407966B2 (en) Method and apparatus for transmitting and receiving signaling information in digital broadcasting system
CN100550999C (en) A kind of digital channel fast switch over method and system and device for creating auxiliary channel
CA2917516C (en) Method and apparatus for transmitting/receiving broadcast signal in hybrid broadcasting system
US7817672B2 (en) Method and device for providing programs to multiple end user devices
US8813160B2 (en) Method, system and user device for obtaining a key frame in a streaming media service
US11374681B2 (en) Video quality assessment method and device
CN105704580B (en) A kind of video transmission method
CN108696772B (en) Real-time video transmission method and device
CN104270684B (en) It is a kind of towards the video/audio network transmission system and method applied in real time
US11316959B2 (en) Method for transmitting broadcast signal and apparatus for transmitting broadcast signal
US8873368B2 (en) Method for processing channel switching failure case, terminal device, and channel switching server
CN107534777A (en) Method and apparatus for sending or receiving the service signaling for broadcast service
US20150029856A1 (en) Packets recovery system and method
CN101854286B (en) UDP (User Datagram Protocol)-based data stream sending-receiving method and device
US8959240B2 (en) Method, apparatus and system for rapid acquisition of multicast realtime transport protcol sessions
CN103532923B (en) A kind of real-time media stream transmission method and system
CN106454553A (en) A precise time delay live video network transmission control method
CN110113662A (en) A kind of video monitor client system adapting to multiple network situation
CN103856787A (en) Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network
CN101511013A (en) Method, equipment and system for processing video message
CN106790030A (en) Multi-screen collaboration audio transmission service end, client, system and its processing method
CN101034968B (en) System, method and device for providing the bidirectional service in the separated bidirectional network
EP1802120B1 (en) Information presentation system, device and methods
CN107197392B (en) Packet discarding method and packet loss device in barrage video stream transmission procedure
CN110012314A (en) A kind of IP transmission method and system based on DTMB

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant