CN108632681A - Play method, server and the terminal of Media Stream - Google Patents
Play method, server and the terminal of Media Stream Download PDFInfo
- Publication number
- CN108632681A CN108632681A CN201710172615.6A CN201710172615A CN108632681A CN 108632681 A CN108632681 A CN 108632681A CN 201710172615 A CN201710172615 A CN 201710172615A CN 108632681 A CN108632681 A CN 108632681A
- Authority
- CN
- China
- Prior art keywords
- terminal
- video flowing
- server
- video
- audio stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/64—Addressing
- H04N21/6405—Multicasting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This application discloses a kind of method, server and terminals playing Media Stream, belong to the communications field.The method includes：Terminal to server sends the acquisition request for the segmental identification for carrying video flow fragmentation, and the video flow fragmentation is the video flow fragmentation that the video flowing that the server that the terminal has received is sent includes；The server obtains the initial time of the video flowing according to the segmental identification of the video flow fragmentation；The server obtains the corresponding audio stream of the video flowing according to the initial time；The server sends the audio stream to the terminal；The terminal receives the audio stream, plays the video flowing and the audio stream.Present application addresses terminal plays in the related technology not to go out sound or the sound and the inconsistent problem of video pictures of broadcasting, ensures that the sound of terminal plays is consistent with video pictures.
Description
Technical field
This application involves the communications field, more particularly to a kind of method, server and terminal playing Media Stream.
Background technology
In Interactive Internet TV (Internet Protocol Television, IPTV) system, user can profit
TV programme are watched with terminals such as television set, mobile phone, tablet computers.User watch some channel TV programme when,
It usually needs to be switched to another channel, watches the TV programme of another channel.For convenience of description, claim another frequency
Road is target channel, and the Media Stream that terminal can obtain target channel in the following way plays out.
There is the scene of adaptive code stream at present, terminal can be switched to target channel under the scene, scene definition
The video flowing of each channel includes two kinds of high bit-rate video stream and low bit-rate video stream, and fast channel switches (Fast
Channel Change, FCC) be cached in server video source transmission each channel high bit-rate video stream and low bit- rate regard
Frequency flows, and in this way when terminal is switched to target channel, FCC servers can select a kind of video flowing to be supplied to terminal according to demand
It plays.Handoff procedure is as follows：FCC servers receive terminal transmission for after being switched to the playing request of target channel, being
The TV programme for enabling the terminals to quickly play target channel, so first sending the low bit-rate video of target channel to terminal
Stream sends after a period of time to improve the quality of terminal plays picture, then sends the high bit-rate video of target channel to terminal
It flows and notifies terminal that the multicast group of target channel is added.The high bit-rate video stream that terminal plays FCC servers are sent, and mesh is added
The multicast group for marking channel plays the audio stream and the video flowing after the audio stream and video flowing for receiving multicast group transmission.
FCC servers send video flowing to terminal in the scene of above-mentioned adaptive code stream, are not related to audio stream,
It may cause terminal that can not play out sound or the sound and the inconsistent problem of video pictures of broadcasting in this way.
Invention content
Sound or the sound and video pictures of broadcasting are not gone out in order to solve to may result in terminal plays in the prior art
Inconsistent problem, embodiments herein provide a kind of method, server and terminal playing Media Stream.The technical side
Case is as follows：
In a first aspect, providing a kind of method playing Media Stream, this method includes：What server receiving terminal was sent obtains
Request is taken, which asks to carry the segmental identification for the video flow fragmentation that it has been issued in the video flowing of terminal；Server
It determines that it has been issued to the initial time of the video flowing of terminal according to the segmental identification, which is obtained according to the initial time
Corresponding audio stream；Server sends the audio stream to the terminal, so that the terminal plays video flowing and the audio stream.Due to
After server receives the acquisition request of terminal transmission, the segmental identification carried in capable of being asked according to the acquisition determines it
The corresponding audio stream of video flowing of terminal is had been issued to, the audio stream is identical with the initial time of the video flowing, and therefore, terminal is same
When can ensure audio-visual synchronization when playing the video flowing and audio stream, solve terminal plays in the related technology do not go out sound or
The sound that person plays and the inconsistent problem of video pictures.
In a kind of possible realization method of first aspect, the video flowing that server is sent to terminal includes at least one
The description information of road audio stream, so that terminal therefrom selects the description information for the audio stream all the way being consistent with self-ability, in this way
So that the acquisition request that terminal to server is sent further includes the description information of the audio stream all the way；Server is obtained receiving this
After taking request, the segmental identification in being asked according to the acquisition determines that it has been issued to the initial time of the video flowing of terminal；Also root
The description information of audio stream all the way in being asked according to the acquisition determines audio stream all the way, according to the initial time from determining the road
The corresponding audio stream of the video flowing is obtained in audio stream.Such terminal can be obtained according to the ability of itself to be consistent with self-ability
Audio stream play out.
In a kind of possible realization method of first aspect, server carries segmental identification what reception terminal was sent
Acquisition request before, send RTCP Real-time Transport Control Protocol (Real-time Transport Control to terminal
Protocol, RTCP) it wraps, the fragment timestamp field of the RTCP packets carries the segmental identification.Server to terminal by sending
The fragment timestamp field of RTCP packets, the RTCP packets carries the segmental identification, so that terminal carries this to server transmission
The acquisition of segmental identification is asked, and video flowing of the acquisition request for being had received to the server acquisition request terminal is corresponding
Audio stream.
In a kind of possible realization method of first aspect, the video flowing that server has been issued to terminal is the first code check
The first video flowing, this method further includes：Server is stopping sending the first video flowing to terminal and is sending second to the terminal
When the second video flowing of code check, the first code check is less than the second code check, sends a notification message to terminal, which carries first
The serial number of the serial number of the last one data packet of video flowing and first data packet of the second video flowing.Since terminal receives
After the last one data packet of one video flowing, what is received is first data packet of the second video flowing, the last one data
The serial number of packet and the serial number of first data packet are discontinuous, to avoid terminal erroneous judgement at data-bag lost, stop playing second
Data flow, server send a notification message to terminal, so as to terminal according to the notification message determine the last one data packet and
First data packet is continuous data packet, to normally unwrap the second video flowing of beginning broadcasting from first data.
In a kind of possible realization method of first aspect, the notification message that server is sent to terminal is that server-side is whole
End notice (Server terminal notification, SCN) message, which includes old sequence number field and new serial number
Field, old sequence number field carry the serial number of the last one data packet of the first video flowing that server is sent to terminal, new serial number
Field carries the serial number of first data packet of the second video flowing that server is sent to terminal.
Second aspect, provides a kind of method playing Media Stream, and this method includes：Terminal to server sends to obtain and ask
It asks, which asks to carry the segmental identification of video flow fragmentation in the video flowing that it has been received, so that server is obtained according to this
Request is taken to send the corresponding audio stream of the video flowing, the initial time of the audio stream is identical with the initial time of the video flowing；Eventually
End receives the audio stream that server is sent, and plays received video flowing and audio stream.Due to the video flowing and the sound
The initial time of frequency stream is identical, therefore terminal can ensure audio-visual synchronization when playing the video flowing and audio stream simultaneously, solves
Terminal plays do not go out sound or the sound and video pictures inconsistent problems of broadcasting in the related technology.
In a kind of possible realization method of second aspect, the video flowing that terminal is received from server includes at least
The description information of audio stream all the way, terminal select the description for the audio stream all the way that self-ability is consistent also from these description informations
Information, the acquisition request sent to server further include the description information of the audio stream all the way, with from server obtain with from
The audio stream that body ability is consistent plays out.
In a kind of possible realization method of second aspect, terminal is carrying obtaining for segmental identification to server transmission
Before taking request, the RTCP packets of server transmission are also received, the fragment timestamp field for obtaining the RTCP packets carries the terminal
The segmental identification is added to acquisition request, makes server by the segmental identification of video flow fragmentation in the video flowing having received
After receiving acquisition request, the corresponding audio of video flowing which has received is sent to the terminal according to the segmental identification
Stream.
In a kind of possible realization method of second aspect, the video flowing that terminal has received regards for the first of the first code check
Frequency flows, and terminal also receives the second video flowing of the second code check of server transmission, and the second code check is more than the first code check；Terminal also connects
The notification message of server transmission is received, which carries two serial numbers, and one of serial number first video flowing is most
The serial number of the latter data packet, the serial number of first data packet of another serial number second video flowing；Disappeared according to the notice
Breath plays received second video flowing.After the last one data packet for receiving the first video flowing due to terminal, receive
First data packet of the second video flowing, the serial number of the last one data packet and the serial number of first data packet are discontinuous,
To avoid terminal erroneous judgement at data-bag lost, stop playing the second data flow, server sends a notification message to terminal, the notice
The serial number of serial number comprising the last one data packet and first data packet in message.So that terminal disappears according to the notice
Breath determines that the last one data packet and first data packet are continuous data packet, to normally be unwrapped from first data
Begin to play the second video flowing.
In a kind of possible realization method of second aspect, the notification message for the server transmission that terminal receives is
SCN messages, SCN messages include old sequence number field and new sequence number field, and old sequence number field carries the terminal and received from server
The first video flowing the last one data packet serial number, new sequence number field carries the terminal is received from server second and regards
The serial number of first data packet of frequency stream.
The third aspect provides a kind of device playing Media Stream, which includes at least one unit, this is at least one
Unit is for realizing the broadcasting Media Stream that any one possible realization method is provided in above-mentioned first aspect or first aspect
Method.
Fourth aspect provides a kind of device playing Media Stream, which includes at least one unit, this is at least one
Unit is for realizing the broadcasting Media Stream that any one possible realization method is provided in above-mentioned second aspect or second aspect
Method.
5th aspect, provides a kind of server, which includes：Processor and the network port, processor are configured
To realize that the possible realization method of any one in above-mentioned first aspect or first aspect provided broadcasts by executing instruction
The method for putting Media Stream.
6th aspect, provides a kind of terminal, which includes：Processor and the network port, processor are configured as leading to
It crosses and executes instruction to realize broadcasting matchmaker that the possible realization method of any one in above-mentioned second aspect or second aspect is provided
The method of body stream.
7th aspect, provides a kind of system playing Media Stream, and system includes such as the above-mentioned third aspect or the 5th side
The server that face is provided, and, such as the terminal provided in terms of above-mentioned fourth aspect or the 6th.
Eighth aspect provides a kind of computer-readable medium, and the computer-readable medium storage is for realizing first party
The instruction for the broadcasting Media Stream that the possible realization method of any one of face or first aspect is provided, alternatively, the computer can
Read the broadcasting media that media storage is provided for realizing the possible realization method of any one of second aspect or second aspect
The instruction of stream.
Description of the drawings
Fig. 1 is the structural schematic diagram for the IPTV system that an illustrative embodiment of the invention provides；
Fig. 2 is the video flow fragmentation and audio flow fragmentation schematic diagram that an illustrative embodiment of the invention provides；
Fig. 3 is the structural schematic diagram for the server that an illustrative embodiment of the invention provides；
Fig. 4 is the structural schematic diagram for the terminal that an illustrative embodiment of the invention provides；
Fig. 5 is the flow chart of the method for the broadcasting Media Stream that an illustrative embodiment of the invention provides；
Fig. 6 is the structural schematic diagram for the RTCP packets that an illustrative embodiment of the invention provides；
Fig. 7 is the structural schematic diagram for the SCN messages that an illustrative embodiment of the invention provides；
Fig. 8 is the structural schematic diagram for the server that another exemplary embodiment of the invention provides；
Fig. 9 is the structural schematic diagram for the terminal that another exemplary embodiment of the invention provides.
Specific implementation mode
To keep the purpose, technical scheme and advantage of the application clearer, below in conjunction with attached drawing to the application embodiment party
Formula is described in further detail.
Referring to FIG. 1, the structural schematic diagram of the IPTV system provided it illustrates an illustrative embodiment of the invention.It should
IPTV system includes：Source server 110, encoder server 120, multicast server 130, FCC servers 140 and terminal 150.
Source server 110 can be a server, or the server cluster being made of several servers, either
One cloud computing service center.Source server 110 includes the Media Stream of each channel at least one channel, the Media Stream packet
The second video flowing audio stream corresponding with second video flowing etc. is included, it can also be including caption stream etc..Source server 110 is by having
Gauze network or wireless network are connected with encoder server 120, and the media of each channel can be sent to encoder server 120
Stream.Wherein, channel may include television channel, direct broadcast band and carousel channel etc..
Generally, the Media Stream in source server 110 is that technical staff makes and uploads on source server 110 in advance
's.Technical staff can make the second video flowing at least audio all the way corresponding with second video flowing when making Media Stream
Stream, and the second video flowing that the description information per road audio stream is arranged, and makes includes retouching for every road audio stream of setting
State information.The description information of audio stream may include the information such as the corresponding broadcasting language of the road audio stream, traffic identifier and code check.It lifts
For example, technical staff, in addition to making the second video flowing A, also makes for the second video flowing A when making the second video flowing A
Two-way audio stream, wherein being to play the audio stream that language is Chinese all the way, another way is the audio stream for playing language as English, and
The the second video flowing A made includes the description information of the two-way audio stream.
Wherein, ordinary skill make the second video flowing code check it is higher, so the clarity of the second video flowing compared with
It is high.For convenience of description, the code check of the second video flowing is referred to as the second code check.
Encoder server 120 receives the Media Stream for each channel that source server 110 is sent.For the media of each channel
Stream, encoder server 120 is using self-adaption code rate (Adaptive Bit Rate, ABR) coding techniques to the Media Stream of the channel
Including the second video flowing carry out drop code and generate at least the first video flowing all the way, at least first roads video flowing Zhong Mei all the way
First code check of one video flowing is different, and the second code check of respectively less than the second video flowing.So each channel corresponds to all the way
Second video flowing, at least the first video flowing and at least audio stream etc. all the way all the way.Since the first video flowing of every road is all by right
Second video flowing carries out what drop code obtained, so the clarity of the first video flowing is less than the clarity of the second video flowing.
Optionally, at least one preset first code check is stored in encoder server 120, it can be according to storage at least
One the first code check carries out drop code to second video flowing and obtains at least the first video flowing all the way.
Encoder server 120 is connected by cable network or wireless network with multicast server 130, encoder server
120 send the Media Stream of each channel to multicast server 130, the Media Stream of each channel sent to multicast server 130
The second video flowing all the way for being received from source server 110 including it and at least all the way outside the contents such as audio stream, further includes to this
The second video flowing carries out at least the first video flowing all the way that drop code obtains all the way.
Multicast server 130 can be a server, the server cluster that is either made of several servers or
It is a cloud computing service center.Multicast server 130 by cable network or wireless network respectively with FCC servers 140
And terminal 150 is connected.
Multicast server 130 receives the Media Stream for each channel that encoder server 120 is sent, each frequency that will be received
The Media Stream in road is transmitted to FCC servers 140 in real time.Multicast server 130 also directed to one multicast group of each channel maintenance, to
Terminal 150 in the multicast group sends the Media Stream of the channel.
FCC servers 140 can be a server, the server cluster that is either made of several servers or
It is a cloud computing service center.FCC servers 140 are connected by cable network or wireless network with terminal 150.
Terminal 150 may include smart television, set-top box, smart mobile phone, tablet computer, smart television, on knee portable
Computer and desktop computer etc. carry target frequency on startup or in switching channels to the transmission of FCC servers 140
The playing request of the channel identication in road, request FCC servers 140 send the Media Stream of target channel.
FCC servers 140, the mesh for after receiving terminal 150 and sending playing request, being carried according to the playing request
The channel identication for marking channel sends corresponding first video flowing all the way of target channel to terminal 150 and the first video flowing includes
The segmental identification of video flow fragmentation；Receive the acquisition request for carrying the segmental identification that terminal 150 is sent；According to the fragment mark
Know and obtain the corresponding audio stream of the first video flowing, the audio stream is sent to terminal 150.
Terminal 150, the first video flowing and the segmental identification for receiving the transmission of FCC servers 140, to FCC servers
140 send the acquisition request for carrying the segmental identification, receive FCC servers 140 and send the corresponding audio stream of the first video flowing,
Play first video flowing and the audio stream.Since the first code check of the first video flowing is relatively low, it is less than the second code check, so terminal
150 can quickly play the first video flowing.
Some time of FCC servers 140 after starting to send the audio stream can send target channel to terminal 150
Corresponding second video flowing.Since the second code check of the second video flowing is more than the first code check of the first video flowing, it is possible to carry
High terminal 150 plays the quality of video pictures.
Terminal 150 is additionally operable to receive the second video flowing of the target channel that FCC servers 140 are sent and play second to regard
Frequency flows, while also the corresponding multicast group of the target channel in multicast server 130 is added in application, and receives multicast server
Second video flowing of 130 target channels sent；When the second video flowing and multicast server for playing the transmission of FCC servers 140
When second video flowing of 130 transmissions is identical, the second video flowing that multicast server 130 is sent is played.
It should be noted that：Encoder server 120 receive source server 110 send some channel Media Stream when,
The second video flowing that can also include to the Media Stream carries out fragment, and it includes multiple video flow fragmentations to make second video flowing, is
Each video flow fragmentation generates segmental identification.In addition, encoder server 120 carries out second video flowing on every road that drop code obtains
First video flowing is also to be made of video flow fragmentation.
Each video flow fragmentation in the second video flowing corresponds to a video flow fragmentation in the first video flowing.For
Any one video flow fragmentation and the video flow fragmentation in two video flowings corresponding video flow point in the first video flowing
Piece, initial time, video content and the segmental identification all same of two video flow fragmentations, but two video flow fragmentations is clear
Clear degree it is different and including data packet number it is different, the number for the data packet that the video flowing fragment positioned at the second video flowing includes
Mesh is more than the number for the data packet for including positioned at the video flowing fragment of the first video flowing.Positioned at each video flowing of the second video flowing
The first frame that fragment includes is the key frame for decoded video streams, and each video flowing fragment packets positioned at the first video flowing
The first frame included is also the key frame for decoded video streams.The data packet can be RTP data packets.
Fig. 2 is referred to, is illustrated with continuous 4 video flow fragmentation S11, S12, S13 and S14 in the first video flowing
Bright, video flow fragmentation S11 corresponding video flow fragmentations in the second video flowing are that the segmental identification of S21, S11 and S21 are
“1”；Video flow fragmentation S12 corresponding video flow fragmentations in the second video flowing are that the segmental identification of S22, S12 and S22 are
“2”；Video flow fragmentation S13 corresponding video flow fragmentations in the second video flowing are that the segmental identification of S23, S13 and S23 are
“3”；, video flow fragmentation S14 corresponding video flow fragmentations in the second video flowing are S24, and segmental identifications of the S14 in S24 is
“4”。
The number of data packets that each video slicing in the second video flowing includes is more than the video slicing in a video flowing
In the corresponding video flowing fragment number of data packets that includes.For example, referring still to Fig. 2, video flow point in the first video flowing
The quantity for the data packet that piece S11 includes is 2, less than the quantity 4 of the video flow fragmentation S21 data packets for including.
In addition, audio stream that the Media Stream includes can also be carried out fragment by encoder server 120, the audio stream is set to include
Multiple audio flow fragmentations generate segmental identification for the audio flow fragmentation.Each video in first video flowing and the second video flowing
Flow fragmentation corresponds to the audio flow fragmentation in audio stream, and video flow fragmentation is identical with its corresponding initial time of audio flow fragmentation.
After the first video flowing, the second video flowing and the audio stream that encoder server 120 includes to the Media Stream carry out fragment,
Just the Media Stream is sent to multicast server 130.
It should be noted that：Media of the multicast server 130 in some channel for receiving the transmission of encoder server 120
After stream, each video flow fragmentation in the first video flowing that can include to the Media Stream adds timestamp, the second video flowing
In each video flow fragmentation addition timestamp and audio stream include each audio flow fragmentation addition timestamp.For first
Any video flow fragmentation in video flowing, the video flow fragmentation and the video flow fragmentation corresponding video flowing in the second video flowing
The timestamp of fragment, two video flow fragmentations is identical, and the timestamp of the video flow fragmentation and the video flow fragmentation are in audio stream
In corresponding audio flow fragmentation timestamp it is also identical.
Referring still to Fig. 2, audio flow fragmentation corresponding with video flow fragmentation S11 and video flow fragmentation S21 is S31,
The corresponding timestamp of S11, S21 and S31 three is identical, therefore S11 is identical as the video content of S21, the audio content in S31
It is corresponding with the video content.
Each video flow fragmentation, the second video flowing in the first video flowing that multicast server 130 includes to the Media Stream
In each fragment and audio stream in each audio flow fragmentation add timestamp information respectively after, to FCC servers 140 with
And terminal 150 sends the Media Stream.
Referring to FIG. 3, the structural schematic diagram of the server provided it illustrates an illustrative embodiment of the invention, the clothes
Business device can be the FCC servers 140 in embodiment illustrated in fig. 1, which include：Processor 31, network interface 32, high speed
Buffer 33 and memory 34.
Processor 31 includes one or more than one processing core, and processor 31 passes through runs software program and mould
Block, to perform various functions application and data processing.
Network interface 32 can be multiple, and a portion network interface 32 is used to be communicated with multicast server 130,
A portion network interface 32 with terminal 150 for being communicated.
Cache 33 is connected with processor 31, for caching at least one frequency received from multicast server 130
The Media Stream in road can be connected by bus with network interface 32.
Memory 34 is connected with processor 31, for example, memory 34 can be connected by bus with processor 31；Memory
23 can be used for storing software program and module.
Memory 34 can store the application program module 35 needed at least one function, and application program module 35 can wrap
Containing sending module 351, processing module 352, receiving module 353 etc..Processor 31 is by running sending module 351, processing module
352 and receiving module 353 to execute the corresponding steps that FCC servers in Fig. 5 execute, referring specifically to the description to Fig. 5.
Memory 34 can be by any kind of volatibility or non-volatile memory device or combination thereof realization, such as
Static RAM (English：Static random access memory, SRAM), electrically erasable is read-only
Memory (English：Electrically erasable programmable read-only memory, EEPROM), it is erasable
Except programmable read only memory (English：Erasable programmable read only memory, EPROM), it may be programmed
Read-only memory (English：Programmable read only memory, PROM), read-only memory (English：read only
Memory image, ROM), magnetic memory, flash memory, disk or CD.
It will be understood by those skilled in the art that the structure of the server shown in Fig. 3 does not constitute the limit to server
It is fixed, may include either combining certain components or different components arrangement than illustrating more or fewer components.
Referring to FIG. 4, the structural schematic diagram of the terminal provided it illustrates an illustrative embodiment of the invention.The terminal
It can be with the terminal 150 in embodiment illustrated in fig. 1.The terminal includes：Processor 41, network interface 42 and memory 43.
Processor 41 includes one or more than one processing core, and processor 41 passes through runs software program and mould
Block, to perform various functions application and data processing.
Network interface 42 can be multiple, and a portion network interface 42 is used to be communicated with multicast server 130,
A portion network interface 42 with FCC servers 140 for being communicated.
Memory 43 is connected with processor 41, for example, memory 43 can be connected by bus with processor 41；Memory
43 can be used for storing software program and module.
Memory 43 can store the application program module 44 needed at least one function, and application program module 44 can wrap
Containing sending module 441, processing module 442, receiving module 443 etc..Processor 41 is by running sending module 441, processing module
442 and receiving module 443 to execute the corresponding steps that terminal in Fig. 5 executes, referring specifically to the description to Fig. 5.
Memory 43 can be by any kind of volatibility or non-volatile memory device or combination thereof realization, such as
Static SRAM, EEPROM, EPROM), PROM, ROM, magnetic memory, flash memory, disk or CD.
It will be understood by those skilled in the art that the restriction of the structure of terminal shown in Fig. 4 not structure paired terminal, it can
To include either combining certain components or different components arrangement than illustrating more or fewer components.
Referring to FIG. 5, the method for the broadcasting Media Stream provided it illustrates an illustrative embodiment of the invention, the broadcasting
The method of Media Stream is applied in IPTV system as shown in Figure 1, and the method for the broadcasting Media Stream may include：
Step 501, terminal sends the playing request for the channel identication for carrying target channel to FCC servers.
Terminal can send playing request in following situation to FCC servers, including：
The first, it sends to play to FCC servers when terminal needs are switched to target channel from currently playing original channel and ask
It asks.
When the Media Stream of original channel is currently played in terminal, user can select the target channel for needing to switch.When
When terminal detects selected target channel, the channel identication of target channel is obtained, target is carried to the transmission of FCC servers
The playing request of the channel identication of channel.
When terminal is when detecting selected target channel, terminal also disconnects it and is connected between multicast server, with
Stop receiving the Media Stream for the original channel that multicast server is sent.
The second, terminal sends playing request on startup using preset channel as target channel to FCC servers,
Target channel is added with request.
Preset channel can be the default channel that terminal is arranged in manufacture or terminal in primary closing upper recently
When the channel that plays.So when terminal can obtain the channel identication of default channel or once closing upper recently when being currently up
The channel identication of the channel of broadcasting is taken using the channel identication of acquisition as the channel identication of target channel to the transmission of FCC servers
The playing request of channel identication with target channel.
Step 502, the playing request that FCC server receiving terminals are sent, the target channel carried according to the playing request
Channel identication the first video flowing and first video flowing video flow fragmentation including of target channel are sent to terminal
Segmental identification.
FCC servers real-time reception and the Media Stream for caching each channel that multicast server is sent, the matchmaker of each channel
The first video flowing that body stream includes, the second video flowing and at least audio stream etc. all the way.
This step can be：The playing request that FCC server receiving terminals are sent, according to the mesh carried in the playing request
The channel identication for marking channel, determines the first video flowing of the target channel of FCC server buffers, from the mesh of FCC server buffers
It marks and obtains the time in the first video flowing of channel and be located at a key frame before current time, then from FCC server buffers
The key frame corresponding time is obtained in first video flowing of target channel to the first video flowing of current time, and is sent out to terminal
It send the first video flowing of acquisition and plays and respond, broadcasting response carries the video flow fragmentation that the first video flowing obtained includes
Segmental identification.
FCC servers obtain there are many modes of key frame, for example, can be from the target channel of FCC server buffers
The acquisition time is located at a key frame before current time and nearest from current time in first video flowing, alternatively, obtaining at random
Take key frame of the framing bit before current time.
FCC servers may be used and be regarded more than the first of its reception target channel when sending the first video flowing obtained
The receiving velocity of frequency stream sends the first video flowing of acquisition.For example, when realizing, FCC servers determine its current reception group
The receiving velocity for broadcasting the first video flowing of the target channel of server transmission, according to preset first multiple and the receiving velocity meter
Transmission rate is calculated, sends the first video flowing obtained to terminal by the transmission rate.First multiple is more than 1, such as first times
Number can be 1.4,1.5,1.6 equivalent, which is multiplied with the first multiple to obtain the size of the transmission rate.
FCC servers send the first video of acquisition and send the sequencing for playing response, can there is several kinds as follows,
One is first sending to play response, the first video flowing of acquisition is retransmited；One is send first obtained to terminal simultaneously to regard
Frequency flows and plays response.The case where for sending simultaneously, FCC servers can start to send the same of the first video flowing obtained
When to terminal send the broadcasting response, or start send the first video flowing after sometime send the broadcasting to terminal
Response.
The segmental identification carried in broadcasting response is n-th of video flow fragmentation included by the first video flowing of acquisition
Segmental identification, n are the positive integer more than or equal to 1.Under normal conditions, n values are 1, or 2 or 3 is equivalent.
Broadcasting response can be a RTCP packet, and referring to Fig. 6, which includes acquiescence/self-adaption code rate
(Fault Bitrate/Adaptive Bitrate) field, current unicast synchronize mark (the SSRC of Current of information source
Unicast Burst) field, user network protocol address (User Internet Protocol, User IP) field, user
The ports RTCP (User RTCPPort) field, reservation (Reserved) field, identification field (Representation ID), band
Wide (Bandwidth) field, and further include fragment timestamp (Fragment Time Stamp) field of extension, the fragment
Timestamp field is used to carry the segmental identification for the video flow fragmentation that the first video flowing obtained includes.
Step 503, terminal receives the segmental identification of the first video flowing and video flow fragmentation that FCC servers are sent, to FCC
Server sends the acquisition request for carrying the segmental identification.
The realization of this step can be：Terminal receives the first video flowing that FCC servers are sent and plays and responds, and is broadcast from this
The segmental identification for extracting the video slicing that first video flowing includes in response is put, the fragment is carried to the transmission of FCC servers
The acquisition of mark is asked.
First video flowing includes at least description information of audio stream all the way.Terminal can according to the ability information of itself from
This at least selects in the description information of audio stream the description information of audio stream all the way, acquisition request that can also carry selection all the way
The audio stream description information.
The ability information of terminal may include the hardware resource of the amount of bandwidth of terminal, decoding terminals ability and/or terminal
Deng.
Wherein, if the audio stream that description information or terminal that the first video flowing includes audio stream all the way select is whole
The end audio stream with FCC Server Defaults in advance, then acquisition request can carry or not carry the description of the audio stream all the way
Information or acquisition request can carry or not carry the description information of the default audio stream of selection.
Step 504, the acquisition request that FCC server receiving terminals are sent, the segmental identification in being asked according to the acquisition are true
The initial time of its fixed the first video flowing sent to terminal.
This step can be：The fragment that acquisition request carries is extracted in the acquisition request that FCC server receiving terminals are sent
Mark, the segmental identification of extraction are the segmental identification for n-th of video flow fragmentation that the first video flowing sent to terminal includes,
The segmental identification that first video flow fragmentation that first video flowing includes is determined according to the segmental identification of extraction, according to this first
The segmental identification of a video flow fragmentation obtains the timestamp of first video flow fragmentation, by the time of first video flow fragmentation
Stamp is determined as the initial time of first video flowing sent to terminal.
It, can be using the segmental identification of extraction as the segmental identification of first video flow fragmentation if n=1.If n is big
In 1, then the segmental identification of first video flow fragmentation is calculated according to the segmental identification of extraction and numerical value n.
Under normal conditions, the segmental identification of the video flow fragmentation in first video flowing is consecutive variations, two neighboring
The difference of the segmental identification of video flow fragmentation is numerical value 1, so can be as follows for the process of above-mentioned calculating segmental identification：If from
It is m to obtain the segmental identification extracted in request, then the segmental identification of first video flow fragmentation in first video flowing is m-
n-1。
Step 505, FCC servers obtain the corresponding audio stream of the first video flowing according to the initial time, are sent out to terminal
Give the audio stream.
When the playing request that FCC servers receive does not carry the description information of audio stream, show there are two kinds of situations, the
A kind of is the description information that the first video flowing only includes audio stream all the way, i.e., target channel only corresponds to audio stream all the way；Second
The description information of the default audio stream with FCC server commitments in advance has been selected for terminal.
This step can be at this time：When for the first above-mentioned situation, FCC servers determine the target channel pair of its caching
The audio stream all the way answered caches this from it and obtains the initial time to the audio stream of current time, to terminal in audio stream all the way
Send the audio stream obtained.When for above-mentioned the second situation, target channel corresponding at least one of the FCC servers from its caching
In the audio stream of road, determines the corresponding default audio stream of the description information of default audio stream, the starting is obtained from default audio stream
Time, to the audio stream of current time, the audio stream obtained was sent to terminal.
When carrying the description information of audio stream in the playing request that FCC servers receive, this step can be：FCC takes
The target channel that device is cached from it of being engaged in is corresponding at least to determine that the description information of the audio stream is corresponding all the way in audio stream all the way
Audio stream obtains the initial time to the audio stream of current time from determining audio stream all the way, acquisition is sent to terminal
Audio stream.
FCC servers may be used when sending the audio stream obtained and receive the receiving velocity of the audio stream more than it
Send the audio stream.For example, when realizing, FCC servers determine its current audio stream for receiving multicast server transmission
Receiving velocity calculates transmission rate according to preset second multiple and the receiving velocity, is sent to terminal by the transmission rate
The audio stream.Second multiple is more than 1, such as the first multiple can be 1.4,1.5,1.6 equivalent, by the receiving velocity and second times
Number, which is multiplied, obtains the size of the transmission rate.Second multiple can be equal or different to the first multiple.
Step 506, terminal receives the audio stream that FCC servers are sent, and the video flowing having received and audio stream are provided
It is played out to the player in the terminal.
Since the audio stream that terminal receives is identical as the initial time of video flowing, terminal start simultaneously at audio stream plays and
Video flowing is that can guarantee that the sound of target channel is synchronous with video pictures.
Step 507, FCC servers are stopping sending the first video flowing to terminal and are starting to send target channel to terminal
Send a notification message to terminal when the second video, the notification message carry the first video flowing the last one data packet serial number and
The serial number of first data packet of the second video flowing.
Wherein, FCC servers start to terminal send target channel the first video flowing after, can constantly and continuously to
Terminal sends first video flowing, while FCC servers also receive first video flowing of multicast server transmission.When FCC takes
Business device is when the data packet that preceding first video flowing sent to terminal includes and its this current for receiving that multicast server sends the
When the data packet that one video flowing includes is identical, FCC servers determine the video flow point belonging to the data packet sent to terminal before
Piece, and stop when determining video flow fragmentation has been sent sending first video flowing to terminal.FCC servers are to terminal simultaneously
Send the second video flowing of target channel, and the video flow fragmentation that the second video flowing first video flow fragmentation including is to determine
Next video flow fragmentation.
For example, with reference to Fig. 2, it is assumed that FCC servers are serial numbers 4 when the data packet of preceding the first video flowing sent to terminal
Data packet, and assume that the data packet of the first video flowing that FCC servers are currently received is also the data packet of serial number 4, then FCC
Server determines that the video flow fragmentation belonging to the data packet of serial number 4 is S12, and the segmental identification of video flow fragmentation S12 is 2；
FCC servers send the second video flowing, first video of the second video flowing when having sent video flow fragmentation S12, to terminal
Flow fragmentation is S23, and the segmental identification of video flow fragmentation S23 is 3, is next the regarding of video flow fragmentation S12 (segmental identification is 2)
Frequency flow fragmentation.
The number of data packets for including due to the video flowing fragment in the first video flowing in the second video flowing
The number of data packets that video flowing fragment includes is different, so the serial number for the last one data packet that the first video flowing includes and second
The serial number for first data packet that video flowing includes is discontinuous, and such terminal can be mistakenly considered to lose when playing the second video flowing
Packet phenomenon, in order to solve the problems, such as this, FCC servers are sent when starting to send the second video of target channel to terminal to terminal
Notification message, the serial number of the last one data packet of the first video flowing carried by the notification message and the of the second video flowing
The serial number of one data packet tells the last one data packet of the first video flowing of terminal and first data packet of the second video flowing
It is continuous data packet.
For example, referring still to Fig. 2, the serial number 4 of the last one data packet of video flow fragmentation S12, FCC servers are being sent out
When having given the data packet, the second video flowing is sent to terminal, first video flow fragmentation of the second video flowing is S23, video flowing
The serial number 9 of first data packet in fragment S23.Therefore, after terminal receives the data packet of serial number 4, sequence is had received
Number be 9 data packet.The notification message of serial number 4 and serial number 9 is carried since terminal also has received, can be determined according to the message
The data packet of the data packet and serial number 9 that go out received serial number 4 is continuous data packet, does not lose.
When sending the second video flowing, the receiving velocity that may be used less than its second video flowing of reception comes FCC servers
Send the second video flowing.For example, when realizing, FCC servers determine its current target channel for receiving multicast server and sending
The second video flowing receiving velocity, transmission rate is calculated according to preset third multiple and the receiving velocity, by the transmission
Rate sends the second video flowing obtained to terminal.Third multiple is less than 1, such as third multiple can be 0.6,0.7,0.8 etc.
The receiving velocity is multiplied with third multiple to obtain the size of the transmission rate by value.
Optionally, which can be SCN messages, and referring to Fig. 7, which includes final self-adaption code rate
(Final Optimal Adaptive Bitrate) field, and extension old serial number (Last Sequence Number) word
Section and new serial number (First Sequence Number) field, old sequence number field are used to carry the sequence of the last one data packet
Number, which is used to carry the serial number of first data packet.
Step 508, terminal receives the notification message that FCC servers are sent, play that FCC is sent according to the notification message the
Two video flowings and the multicast group that target channel is added receive the second video flowing and audio stream that multicast server is sent.
Terminal receives the notification message that FCC servers are sent, while also receiving the second video flowing that FCC servers are sent,
Obtain the serial number of the last one data packet of the first video flowing carried in the notification message and first number of the second video flowing
According to the serial number of packet.Terminal is according to the serial number of the last one data packet of the first video flowing and first data packet of the second video flowing
Serial number, first data packet of the last one data packet and the second video flowing for determining the first video flowing be continuous two numbers
According to packet, then the second video flowing of beginning broadcasting is unwrapped from first data of the second video flowing.
Terminal also sends adding for the channel identication for carrying target channel when playing the second video flowing to multicast server
Enter request.Multicast server receives addition request, and according to the channel identication of the target channel, the target channel is added in terminal
Multicast group, then to terminal send target channel the second video flowing and audio stream.FCC sends terminal the starting to play
The second video flowing and audio stream that multicast server is sent are received after two video flowings and are cached.
Step 509, the second of data packet and the multicast server transmission that the second currently playing video flowing of terminal includes regards
When the first data packet that frequency stream includes is identical, the second video flowing and audio stream that multicast server is sent are played.
When playing the second video flowing and audio stream that multicast server is sent, terminal completion is switched to terminal from original channel
Target channel or terminal are completed to be added to target channel after starting.Terminal can also disconnect between FCC servers simultaneously
Connection, to stop receiving the second video flowing and audio stream of FCC servers transmission target channel.
In conclusion the method for the broadcasting Media Stream that one embodiment of the present of invention provides, terminal is by FCC servers
It sends and obtains request, acquisition request carries the video flow fragmentation in the video flowing that the FCC servers that it has received are sent
Segmental identification；FCC servers determine that it has been issued to the initial time of the video flowing of terminal according to the segmental identification, according to this
Initial time obtains the corresponding audio stream of the video flowing, and the audio stream initial time is identical as the video flowing initial time, to end
End sends the audio stream；Since terminal has received the identical video flowing of initial time and audio stream of FCC servers transmission,
Therefore it can ensure audio-visual synchronization when terminal plays the video flowing and audio stream simultaneously, solve terminal plays in the related technology
Do not go out sound or the sound and the inconsistent problem of video pictures of broadcasting, ensures the sound and video pictures one of terminal plays
It causes.
The video flowing that server is sent to terminal includes at least description information of audio stream all the way, so that terminal is therefrom selected
The description information for selecting the audio stream all the way being consistent with self-ability, the acquisition request sent to server includes the audio stream all the way
Description information.Such terminal can obtain the audio stream being consistent with self-ability according to the ability of itself and play out.
For server by sending RTCP packets to terminal, the fragment timestamp field of the RTCP packets carries the segmental identification, with
Just terminal sends the acquisition request for carrying the segmental identification to the server, is had received to obtain the terminal from server
The corresponding audio stream of video flowing.
Server is by stopping sending the first video flowing to terminal and sending the second video of the second code check to the terminal
It when stream, sends a notification message to terminal, which carries the serial number and second of the last one data packet of the first video flowing
The serial number of first data packet of video flowing so that terminal determines the last one data packet and first according to the notification message
Data packet is continuous data packet, avoids terminal erroneous judgement from being lost at data packet, is broadcast to normally unwrap the beginning from first data
Put the second video flowing.
Referring to FIG. 8, it illustrates the server 800 that another exemplary embodiment of the present invention provides, the server
800 can be the FCC servers in Fig. 1, Fig. 3 and/or embodiment illustrated in fig. 5, which includes：Transmission unit 810,
Processing unit 820 and receiving unit 830.
Transmission unit 810, the function at least one step in above-mentioned steps 502, step 505 and step 507.
Processing unit 820, the function at least one step in above-mentioned steps 504, step 505.
Receiving unit 830, for above-mentioned steps 502, step 504, at least one step function.
Correlative detail is in combination with reference to above method embodiment.
It should be noted that：The server that above-described embodiment provides is in the target frequency for providing the terminal with terminal request broadcasting
When the Media Stream in road, only the example of the division of the above functional modules, in practical application, can as needed and incite somebody to action
Above-mentioned function distribution is completed by different function modules, i.e., the internal structure of server is divided into different function modules, with
Complete all or part of function described above.In addition, the method for the server and broadcasting Media Stream that above-described embodiment provides
Embodiment belongs to same design, and specific implementation process refers to embodiment of the method, and which is not described herein again.
Referring to FIG. 9, it illustrates the terminal 900 that another exemplary embodiment of the present invention provides, which can
Think that the terminal 900 in Fig. 1, Fig. 4 and/or embodiment illustrated in fig. 5, the terminal include：Transmission unit 910, processing unit 920 with
And receiving unit 930.
Transmission unit 910, the function at least one step in above-mentioned steps 501, step 503 and step 508.
Processing unit 920, the function at least one step in above-mentioned steps 506, step 508 and step 509.
Receiving unit 930, the function at least one step in above-mentioned steps 503, step 506 and step 508.
Correlative detail is in combination with reference to above method embodiment.
It should be noted that：The terminal that above-described embodiment provides is playing Media Stream constantly, only with above-mentioned each function module
Division progress for example, in practical application, can be complete by different function modules by above-mentioned function distribution as needed
At the internal structure of terminal being divided into different function modules, to complete all or part of the functions described above.Separately
Outside, the terminal that above-described embodiment provides belongs to same design with the embodiment of the method for playing Media Stream, and specific implementation process is detailed
See embodiment of the method, which is not described herein again.
The embodiments of the present invention are for illustration only, can not represent the quality of embodiment.
One of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment can pass through hardware
It completes, relevant hardware can also be instructed to complete by program, the program can be stored in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely the alternative embodiments of the application, not to limit the application, it is all in spirit herein and
Within principle, any modification, equivalent replacement, improvement and so on should be included within the protection domain of the application.
Claims (20)
1. a kind of method playing Media Stream, which is characterized in that the method includes：
The acquisition request for the segmental identification for carrying video flow fragmentation that server receiving terminal is sent, the video flow fragmentation are
The video flow fragmentation that the video flowing that the server has been issued to the terminal includes；
The server obtains the initial time of the video flowing according to the segmental identification of the video flow fragmentation；
The server obtains the corresponding audio stream of the video flowing according to the initial time；
The server sends the audio stream to the terminal, so that video flowing and the audio described in the terminal plays
Stream.
2. the method as described in claim 1, which is characterized in that the video flowing includes the description letter of at least audio stream all the way
Breath, the description information for obtaining request and also carrying audio stream all the way；
The server obtains the corresponding audio stream of the video flowing according to the initial time, including：
The server according to the description information of the audio stream all the way determine described in audio stream all the way；
The server obtains the corresponding audio stream of the video flowing according to the initial time from the audio stream all the way.
3. method as claimed in claim 1 or 2, which is characterized in that the server receiving terminal was sent carries video
Before the acquisition request of the segmental identification of flow fragmentation, the method further includes：
The server sends RTCP Real-time Transport Control Protocol RTCP packets, the fragment timestamp field of the RTCP packets to the terminal
Carry the segmental identification of the video flow fragmentation.
4. method as claimed in claim 1 or 2, which is characterized in that the server has been issued to the video flowing of the terminal
For the first video flowing of the first code check；
The method further includes：
Stop sending first video flowing to the terminal in the server and sends the of the second code check to the terminal
When two video flowings, the server sends a notification message to the terminal, and the notification message carries first video flowing
The serial number of the serial number of the last one data packet and first data packet of second video flowing, first code check are less than described
Second code check.
5. method as claimed in claim 4, which is characterized in that the notification message is server-side terminal notification SCN messages, institute
It includes old sequence number field and new sequence number field to state SCN messages, and the old sequence number field carries the sequence of the last one data packet
Number, the new sequence number field carries the serial number of first data packet.
6. a kind of method of channel switching, which is characterized in that the method includes：
Terminal to server sends the acquisition request for the segmental identification for carrying video flow fragmentation, and the video flow fragmentation is described
The video flow fragmentation that the video flowing that the server that terminal has received is sent includes；
The terminal receives the audio stream that the server is sent according to the segmental identification, the initial time of the audio stream and
The initial time of the video flowing is identical；
Video flowing and the audio stream described in the terminal plays.
7. method as claimed in claim 6, which is characterized in that the video flowing includes the description letter of at least audio stream all the way
Breath；
The terminal sends the acquisition request for the segmental identification for carrying video flow fragmentation to the server, including：
Description information of the terminal from the audio stream all the way at least selected in audio stream all the way；
The terminal sends the segmental identification and the audio stream all the way for carrying the video flow fragmentation to the server
The acquisition of description information is asked.
8. method as claimed in claims 6 or 7, which is characterized in that carry and regard to server transmission in the terminal
Before the acquisition request of the segmental identification of frequency flow fragmentation, further include：
The terminal receives the RTCP Real-time Transport Control Protocol RTCP packets that the server is sent, when obtaining the fragment of the RTCP packets
Between stamp field carry the video flow fragmentation segmental identification.
9. method as claimed in claims 6 or 7, which is characterized in that the video flowing that the terminal has received is the first code check
First video flowing；
The method further includes：
The terminal receives the second video flowing and notification message for the second code check that the server is sent, and second code check is big
In first code check, the notification message carries the serial number and described second of the last one data packet of first video flowing
The serial number of first data packet of video flowing；
The terminal plays second video flowing according to the notification message.
10. method as claimed in claim 9, which is characterized in that the notification message is server-side terminal notification SCN messages,
The SCN messages include old sequence number field and new sequence number field, and the old sequence number field carries the last one data packet
Serial number, the new sequence number field carry the serial number of first data packet.
11. a kind of server, which is characterized in that the server includes：
Receiving unit, the acquisition request of the segmental identification for carrying video flow fragmentation for receiving terminal transmission, the video
Flow fragmentation is the video flow fragmentation that the video flowing that the server has been issued to the terminal includes；
Processing unit obtains the initial time of the video flowing for the segmental identification according to the video flow fragmentation；According to institute
It states initial time and obtains the corresponding audio stream of the video flowing；
Transmission unit, for sending the audio stream to the terminal, so that video flowing and the sound described in the terminal plays
Frequency flows.
12. server as claimed in claim 11, which is characterized in that the video flowing includes at least description of audio stream all the way
Information, the description information for obtaining request and also carrying audio stream all the way；
The processing unit, is additionally operable to：
According to the description information of the audio stream all the way determine described in audio stream all the way；
According to the initial time, the corresponding audio stream of the video flowing is obtained from the audio stream all the way.
13. the server as described in claim 11 or 12, which is characterized in that the transmission unit is additionally operable to the terminal
RTCP Real-time Transport Control Protocol RTCP packets are sent, the fragment timestamp field of the RTCP packets carries the fragment of the video flow fragmentation
Mark.
14. the server as described in claim 11 or 12, which is characterized in that the server has been issued to regarding for the terminal
Frequency stream is the first video flowing of the first code check；
The transmission unit is additionally operable to stopping sending first video flowing to the terminal and sending second to the terminal
It when the second video flowing of code check, sends a notification message to the terminal, the notification message carries first video flowing most
The serial number of the serial number of the latter data packet and first data packet of second video flowing, first code check are less than described the
Two code checks.
15. server as claimed in claim 14, which is characterized in that the notification message is server-side terminal notification SCN reports
Text, the SCN messages include old sequence number field and new sequence number field, and the old sequence number field carries the last one described data packet
Serial number, the new sequence number field carries the serial number of first data packet.
16. a kind of terminal, which is characterized in that the terminal includes：
Transmission unit, the acquisition request for sending the segmental identification for carrying video flow fragmentation to server, the video flowing
Fragment is the video flow fragmentation that the video flowing that the server that the terminal has received is sent includes；
Receiving unit, the audio stream sent according to the segmental identification for receiving the server, the starting of the audio stream
Time is identical with the initial time of the video flowing；
Processing unit, for playing the video flowing and the audio stream.
17. terminal as claimed in claim 16, which is characterized in that the video flowing includes the description letter of at least audio stream all the way
Breath；
The processing unit is additionally operable to the description information from the audio stream all the way at least selected in audio stream all the way；
The transmission unit is additionally operable to send the segmental identification and described one for carrying the video flow fragmentation to the server
The acquisition of the description information of road audio stream is asked.
18. the terminal as described in claim 16 or 17, which is characterized in that the receiving unit is additionally operable to receive the service
The RTCP Real-time Transport Control Protocol RTCP packets that device is sent obtain the video flowing that the fragment timestamp field of the RTCP packets carries
The segmental identification of fragment.
19. the terminal as described in claim 16 or 17, which is characterized in that the video flowing received regards for the first of the first code check
Frequency flows；
The receiving unit is additionally operable to receive the second video flowing and notification message of the second code check that the server is sent, institute
It states the second code check and is more than first code check, the notification message carries the sequence of the last one data packet of first video flowing
Number and second video flowing first data packet serial number；
The processing unit is additionally operable to play second video flowing according to the notification message.
20. terminal as claimed in claim 19, which is characterized in that the notification message is server-side terminal notification SCN messages,
The SCN messages include old sequence number field and new sequence number field, and the old sequence number field carries the last one data packet
Serial number, the new sequence number field carry the serial number of first data packet.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710172615.6A CN108632681B (en) | 2017-03-21 | 2017-03-21 | Method, server and terminal for playing media stream |
| PCT/CN2018/079520 WO2018171567A1 (en) | 2017-03-21 | 2018-03-20 | Method, server, and terminal for playing back media stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710172615.6A CN108632681B (en) | 2017-03-21 | 2017-03-21 | Method, server and terminal for playing media stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108632681A true CN108632681A (en) | 2018-10-09 |
| CN108632681B CN108632681B (en) | 2020-04-03 |
Family
ID=63586208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710172615.6A Active CN108632681B (en) | 2017-03-21 | 2017-03-21 | Method, server and terminal for playing media stream |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108632681B (en) |
| WO (1) | WO2018171567A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111741314A (en) * | 2020-06-18 | 2020-10-02 | 聚好看科技股份有限公司 | Video playing method and display equipment |
| CN115474083A (en) * | 2022-11-02 | 2022-12-13 | 灵长智能科技(杭州)有限公司 | Multi-channel audio and video synchronous live broadcast method and system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1006689B1 (en) * | 1998-11-30 | 2008-02-06 | Matsushita Electric Industries Co., Ltd. | Packet retransmission control using priority information |
| CN102611894A (en) * | 2012-03-02 | 2012-07-25 | 华为技术有限公司 | Method, device and system for detecting video transmission packet loss |
| CN102802044A (en) * | 2012-06-29 | 2012-11-28 | 华为终端有限公司 | Video processing method, terminal and subtitle server |
| CN103167359A (en) * | 2013-03-27 | 2013-06-19 | 华为技术有限公司 | Method and device for transmitting real-time transport protocol (RTP) media stream |
| WO2015008490A1 (en) * | 2013-07-19 | 2015-01-22 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | Transmission method, reception method, transmission device, and reception device |
| CN105872583A (en) * | 2015-11-20 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Multifunctional media playing method and device |
| CN106210846A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl新技术有限公司 | Audio and video playing method and system |
| CN106488265A (en) * | 2016-10-12 | 2017-03-08 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus sending Media Stream |
-
2017
- 2017-03-21 CN CN201710172615.6A patent/CN108632681B/en active Active
-
2018
- 2018-03-20 WO PCT/CN2018/079520 patent/WO2018171567A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1006689B1 (en) * | 1998-11-30 | 2008-02-06 | Matsushita Electric Industries Co., Ltd. | Packet retransmission control using priority information |
| CN102611894A (en) * | 2012-03-02 | 2012-07-25 | 华为技术有限公司 | Method, device and system for detecting video transmission packet loss |
| CN102802044A (en) * | 2012-06-29 | 2012-11-28 | 华为终端有限公司 | Video processing method, terminal and subtitle server |
| CN103167359A (en) * | 2013-03-27 | 2013-06-19 | 华为技术有限公司 | Method and device for transmitting real-time transport protocol (RTP) media stream |
| WO2015008490A1 (en) * | 2013-07-19 | 2015-01-22 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | Transmission method, reception method, transmission device, and reception device |
| CN105872583A (en) * | 2015-11-20 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Multifunctional media playing method and device |
| CN106210846A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl新技术有限公司 | Audio and video playing method and system |
| CN106488265A (en) * | 2016-10-12 | 2017-03-08 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus sending Media Stream |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111741314A (en) * | 2020-06-18 | 2020-10-02 | 聚好看科技股份有限公司 | Video playing method and display equipment |
| CN115474083A (en) * | 2022-11-02 | 2022-12-13 | 灵长智能科技(杭州)有限公司 | Multi-channel audio and video synchronous live broadcast method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108632681B (en) | 2020-04-03 |
| WO2018171567A1 (en) | 2018-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103843301B (en) | The switching between expression during the network crossfire of decoded multi-medium data | |
| CN107409234B (en) | Streaming based on file format using DASH format based on LCT | |
| CN109246462B (en) | Seamless switching method and device for video stream | |
| JP5964972B2 (en) | Stream multimedia data from multiple sources | |
| US8340113B2 (en) | Method and arrangement for improved media session management | |
| US10863247B2 (en) | Receiving device and data processing method | |
| EP3654653A1 (en) | Processing continuous multi-period content | |
| KR20170074866A (en) | Receiving device, transmitting device, and data processing method | |
| JP2014531878A (en) | Network streaming of media data | |
| TW202123718A (en) | Dynamic reduction in playout of replacement content to help align end of replacement content with end of replaced content | |
| US20130204973A1 (en) | Method for transmitting a scalable http stream for natural reproduction upon the occurrence of expression-switching during http streaming | |
| KR20120107882A (en) | Apparatus and method of transmitting and receiving associated broadcasting contents based on heterogeneous network | |
| CN113141522B (en) | Resource transmission method, device, computer equipment and storage medium | |
| CN107295364B (en) | For the real-time streaming transport control method of barrage video, control device | |
| KR20170141677A (en) | Receiving device, transmitting device and data processing method | |
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| CN108471548A (en) | Live video fast playing method and device | |
| CN105430490B (en) | The flexible control of direct broadcast band and switching method | |
| CN101924910A (en) | Data sending method, receiving method and device during channel switching process | |
| CN108632681A (en) | Play method, server and the terminal of Media Stream | |
| EP2312826A2 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| CN107682718A (en) | The method and system of fast switching channels under more IPTV platforms | |
| US10771831B2 (en) | System and method for preemptive advertisement caching to optimize network traffic | |
| EP2192740A1 (en) | Method and apparatus for receiving content | |
| KR102533674B1 (en) | Receiving device, sending device and data processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200201 Address after: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Applicant after: HUAWEI TECHNOLOGIES Co.,Ltd. Address before: 210000 HUAWEI Nanjing base, 101 software Avenue, Yuhuatai District, Jiangsu, Nanjing Applicant before: Huawei Technologies Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |