CN1937609A - Method and system for supporting multi-audio-track content by flow media platform and flow media server - Google Patents
Method and system for supporting multi-audio-track content by flow media platform and flow media server Download PDFInfo
- Publication number
- CN1937609A CN1937609A CNA2006101120839A CN200610112083A CN1937609A CN 1937609 A CN1937609 A CN 1937609A CN A2006101120839 A CNA2006101120839 A CN A2006101120839A CN 200610112083 A CN200610112083 A CN 200610112083A CN 1937609 A CN1937609 A CN 1937609A
- Authority
- CN
- China
- Prior art keywords
- data
- language
- media server
- user
- streaming media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a method and system for supporting multitrack contents for streaming media platform, comprising: transmitting the processed data stream by a direct broadcast coder to a streaming media server, where the data stream contains a video data and multiple corresponding audio data; and according to the language appointed by user, the streaming media server selects an audio data corresponding to the language and copies the audio data and the video data and transmits them to the user. Besides, it discloses a processing system for supporting multitrack contents for streaming media server and streaming media platform.
Description
Technical field
The present invention relates to the stream media technology field, relate in particular to method, system and streaming media server about supporting multi-audio-track content by flow media platform.
Background technology
At present, terminal equipments such as mobile phone can be based on as GPRS (General Packet Radio Service, GPRS), EDGE (Enhanced Data rates for Global Evolution, Enhanced Data rates for GSM Evolution), WCDMA (Wide-band Code Division Multiple Access, WCDMA access system), CDMA2000 (Code Division Multiple Addressing 2000, CDMA access system 2000), TD-SCDMA (TD-SCDMA:Time Division SynchronizedCode Division Multiple Access, the time-division synchronous CDMA system), DVB-H (Digital VideoBroadcasting-Handhelds, digital TV network), DMB (Digital MultimediaBroadcasting, DMB), ISDB-T (Integrated Services DigitalBroadcasting-Terra, floor synthetic service digits broadcasting) etc. wireless network is surfed the Net freely, watches film by network, streaming medium contents such as TV.
Consult shown in Figure 1A, comprise based on the Streaming Media treatment system of wireless network: direct broadcast coder 100, streaming media server 101, portal website 102, wireless network 103 and terminal equipment 104.
Described direct broadcast coder 100 converts the analogue data of input to numerical data, and compress, and the data flow after will compressing real-time send to streaming media server 101; The analogue data of described input comprises one road audio frequency and one road video, and wherein, the diagram dotted arrow is represented this one road voice data, and solid arrow is represented this one road video data, down together.
Described direct broadcast coder 100 generates SDP (Session Descriptor Protocol, Session Description Protocol) file, and this document is sent to streaming media server 101; Comprise in the described SDP file that the data flow after direct broadcast coder will be compressed sends to the port data of streaming media server 101 and the audio description information of looking of this data flow.Provide a concrete example of SDP file below:
V=0 // protocol version " v=" field has provided the version of Session Description Protocol, does not comprise time version number.O=-2631350701 1507213 IN IP4 192.168.18.101 // session origin; O=＜username〉＜session id〉＜version〉＜network type〉＜address type〉＜address 〉; Specific to this example be: Usemame=-; Session id=2631350701; Version=1507213; Networktype=IN; Address type=IP4; Address=192.168.18.101 s=b314 // session name, s=＜session name〉c=IN IP4236.130.128.182/1 // connection data; C=＜network type〉＜address type〉＜connection address〉t=00 // temporal information: t=＜start time〉＜stop time 〉; The value of start time and stop time is metric NTP (the Network Time Protocol) time, if all be 0, then represents persistent sessions.M=video 8686 RTP/AVP 96 // media information all begins with " m=" territory; M=＜media〉＜port〉＜transport〉＜fmt list 〉; Media indicates medium type, represent video such as video, audio is an audio frequency, port indicates the port that sends Media Stream, transport indicates host-host protocol, such as RTP/AVP, promptly refer to the IETF ' s Realtime Transport Protocol using the Audio/Video profilecarried over UDP b=AS:1920 //b=" bandwidth of stream: b=＜modifier is described in the territory 〉:＜bandwidth-value 〉; Modifier indicates bandwidth characteristic, and two kinds of value AS (Application-Specific Maximum), CT (Conference Total) can be arranged; The unit of bandwidth-value is that kbps a=rtpmap:96 H264/90000 // medium property is described territory " a="; A=＜attribute〉or a=＜attribute:＜value 〉; Type, coded system, sampling clock frequency, the coding parameter of " rtpmap " attribute description RTP payload; A=rtpmap:＜payload type〉＜encodingname 〉/＜clock rate〉[/＜encoding parameters 〉]; " fmtp " attribute has provided the parameter of the type of special RTP payload; A=fmtp:＜format〉＜format specmc parameters〉a=fmtp:96 profile-level-id=4D3015; Sprop-parameter-sets=Z01AFZZWCwJNgyRAAAD6AAAYahgwADgnADq argAK, aO88gA=; Packetization-mode=1 // further the provide parameter a=cliprect:0 of load type 96,0,576, the left-to-right 0-576 of 352 // description picture coordinate, top to bottm 0-352 a=framerate:25. // description frame per second. per second 25 frame a=mpeg4-esid:201
// (video file may comprise a plurality of video flowings and audio stream corresponding to the stream that is numbered 201, each stream provides a numbering, and this audio stream is numbered 201 in this example) the version id m=audio 8688 RTP/AVP97 // beginning audio frequency media information description of a=x-envivio-verid:0002229A // description envivio encoder.The audio frequency media data will send to 8688 ports, send the Real-time Transport Protocol that agreement is based on UDP, (dynamically RTP load type) b=AS:32 // bandwidth that form is 97 is 32kbps a=rtpmap:97 mpeg4-generic/16000/2 // load type 97 is described, be the mpeg4-generic coded system, sampling clock is 16000HZ a=fmtp:97 profile-level-id=15; Config=1410; Streamtype=5; ObjectType=64; Mode=AAC-hbr; SizeLength=13; IndexLength=3; The parameter of IndexDeltaLength=3 // further provide load type 97 is " profile-level-id=15; Config=1410; Streamtype=5; ObjectType=64; Mode=AAC-hbr; SizeLength=13; IndexLength=3; IndexDeltaLength=3 " a=mpeg4-esid:101 // corresponding to the version id of the sign a=x-envivio-verid:0002229A // description envivio encoder that is numbered 101 stream (video file may comprise a plurality of video flowings and audio stream; each stream provides a numbering, and this audio stream is numbered 101 in this example) a=lang:eng // description input voice
After described terminal equipment 104 is surfed the Net by wireless network 103, obtain path URL (the Unifrm Resource Locator of streaming medium content by visit portal website 102, URL(uniform resource locator)), and according to this path URL initiate access request to streaming media server 101.
After described streaming media server 101 receives the access request of terminal equipment 104, resolve corresponding SDP file to obtain to receive the port of direct broadcast coder data flow; Described streaming media server 101 obtains the data flow that direct broadcast coder 100 sends by monitoring described port, and sends to terminal equipment after it is duplicated portion, is decoded and is play by terminal equipment.
Consult shown in Figure 1B, because direct broadcast coder 100 is only supported the input and output of single channel video data and SCVF single channel voice frequency data, streaming media server 101 only supports single channel video data and SCVF single channel voice frequency data to export to terminal equipment 104 by wireless network 103, terminal equipment 104 is also only supported the input of single channel video data and SCVF single channel voice frequency data, decompress(ion) and broadcast, and many streaming medium contents are multilingual, promptly form by one road video data and multi-path audio-frequency data, therefore when handling, need with one road video data by video dubbing device 105 duplicate the back and multi-path audio-frequency data mate, carry out mould/number conversion and compression by a plurality of direct broadcast coder 100 again.Among Figure 1B, portal website 102 is not shown, and its function is ditto described.Above-mentioned processing is very big to the quantitative requirement of direct broadcast coder, and the price of direct broadcast coder is very high at present, therefore causes the cost of wireless flow media platform significantly to rise, nor is convenient to follow-up maintenance.
Summary of the invention
The invention provides a kind of method, system and streaming media server of supporting multi-audio-track content by flow media platform, exist in the prior art because the waste problem serious and difficult in maintenance of using a plurality of coder processes multi-audio-track contents to cause in order to solve.
The invention provides following technical scheme:
A kind of method of supporting multi-audio-track content by flow media platform, the method comprising the steps of:
By a direct broadcast coder processed data stream is sent to streaming media server, this data flow comprises one road video data and corresponding multi-path audio-frequency data;
Described streaming media server duplicates this one road voice data and described video data and sends it to the user according to one road voice data of this language correspondence of speech selection of user's appointment.
According to said method:
Described direct broadcast coder is indicated port that receives described one road video data and a plurality of ports that receive described multi-path audio-frequency data in sending to the Session Description Protocol SDP file of streaming media server, described streaming media server receives described data flow by monitoring these ports.
Described direct broadcast coder is specified track and language by the serial number or the label of track when coding corresponding relation, described streaming media server is selected voice data by the serial number or the label of the pairing track of language of user's appointment.
The User Identity inquiring user attribute database of described streaming media server by reporting of user be with the serial number or the label of the pairing track of language that obtains user's appointment, and select voice data by the serial number or the label of this track.
The language of described user's appointment is set by the user its priority; Described streaming media server is selected voice data by the serial number or the label of the high pairing track of language of inquiry priority.
The language of described user's appointment is provided with by portal website by the user or is obtained from subscriber equipment by streaming media server, and the serial number of its pairing track or label are stored in the described user attribute database.
The serial number of the pairing track of language of described user's appointment or label are arranged in the access path of terminal equipment convection media server with the form of language parameter; Described streaming media server obtains the serial number or the label of the pairing track of language of user's appointment by resolving this access path, and selects voice data by the serial number or the label of this track.
If the pairing track of language of described user's appointment does not comprise voice data, then described streaming media server is optional one road voice data from the data flow that receives, and duplicates this one road voice data and described video data and sends it to terminal equipment.
A kind of streaming media server comprises:
Receiving element is used to receive one road video data of direct broadcast coder output and the multi-path audio-frequency data of correspondence;
Selected cell is used for selecting from described multi-path audio-frequency data according to the language of user's appointment one road voice data of this language correspondence;
Copied cells is used to duplicate described one road voice data and video data;
Transmitting element is used to send described one road voice data and video data after duplicating.
A kind of treatment system of supporting multi-audio-track content by flow media platform comprises:
Direct broadcast coder is used for one road analog video signal of input and multi-channel analog audio signal are changed and compressed processing, and output comprises the data flow of one road video data and corresponding multi-path audio-frequency data;
Streaming media server, be connected with described direct broadcast coder, be used to receive the data flow of described direct broadcast coder output, and, duplicate and send this one road voice data and described video data according to one road voice data of this language correspondence of speech selection of user's appointment.
Described system also comprises:
Portal website is used for providing the access path to described streaming media server data flow, and the user visits described streaming media server by this access path.
In addition, described system also comprises:
User attribute database is used to store the serial number or the label of the pairing track of language of user's appointment, and offers described streaming media server inquiry.
Beneficial effect of the present invention is as follows:
1, the multi-path audio-frequency data data flow that comprises one road video data and correspondence after the present invention will handle by a direct broadcast coder sends to streaming media server, by the road voice data of streaming media server according to this language correspondence of speech selection of user's appointment, duplicate this one road voice data and described video data and send it to the user, need not to use video dubbing device and too much direct broadcast coder can realize normal reception, decompress(ion) and the broadcast of user to data flow, Internet resources have been saved, reduced cost, and plant maintenance is simple relatively.
2, processing method of the present invention is not subjected to the restriction of system, can apply to the steaming media platform system of wireless networks such as GPRS, EDGE, WCDMA, CDMA2000, TD-SCDMA, DVB-H, DMB, ISDB-T, and terminal equipment also can use this method by clean culture or multicast mode in the mobile network, therefore, the present invention has adaptable advantage.
Description of drawings
Figure 1A is a structural representation of handling the Streaming Media treatment system of one road video data and one road voice data in the background technology;
Figure 1B is a structural representation of handling the Streaming Media treatment system of one road video data and multi-path audio-frequency data in the background technology;
Fig. 2 is the treatment system structural representation of supporting multi-audio-track content by flow media platform in the embodiment of the invention one;
Fig. 3 is the structural representation of streaming media server in the embodiment of the invention one;
The system handles flow chart of Fig. 4 when by the user hobby language being set in the embodiment of the invention one;
The system handles flow chart of Fig. 5 when reading the linguistic property of subscriber equipment by streaming media server in the embodiment of the invention one;
Fig. 6 is the treatment system structural representation of supporting multi-audio-track content by flow media platform in the embodiment of the invention two;
Fig. 7 is the process chart of supporting multi-audio-track content by flow media platform in the embodiment of the invention two.
Embodiment
The multi-path audio-frequency data data flow that comprises one road video data and correspondence after the present invention will handle by a direct broadcast coder sends to streaming media server, by the road voice data output of streaming media server, support multi-audio-track content with this according to this language correspondence of speech selection of user's appointment.
Embodiment one
Present embodiment is selected pairing one road voice data of this language with streaming media server to the language of user attribute database inquiring user appointment, and duplicating this one road voice data and described video data and sending it to terminal equipment is that example describes.
Consult shown in Figure 2ly, the treatment system of a kind of supporting multi-audio-track content by flow media platform in the present embodiment comprises: direct broadcast coder 200, user attribute database 201, streaming media server 202, wireless network 203, terminal equipment 204; Described treatment system also comprises portal website, is used for sending to terminal equipment the path URL of streaming medium content, and this portal website does not mark in Fig. 2.
Described direct broadcast coder 200 is used for the analogue data of input is carried out mould/number conversion and compression, and the data flow after will compressing real-time send to streaming media server 202, and generate SDP file and send to streaming media server 202; The analogue data of described input comprises one road video data and multi-path audio-frequency data; Described SDP file indication receives the port of described one road video data and receives a plurality of ports of described multi-path audio-frequency data, and comprises the audio description information of looking of this data flow.
Described look audio description information comprise with the audio description information of track number equal number in order to identifying different tracks, as:
V=0 o=-2631350701 1507213 IN IP4 192.168.18.101 s=b314
C=IN IP4236.130.128.182/1 b=RR:0 t=00 m=video8686RTP/AVP96 b=AS:1920 a=rtpmap:96 H264/90000 a=fmtp:96 profile-level-id=4D3015; Sprop-parameter-sets=Z01AFZZWCwJNgyRAAAD6AAAYahgwADgnADq argAK, aO88gA=; Packetization-mode=1 a=cliprect:0,0,576,352 a=framerate:25. a=mpeg4-esid:201 a=x-envivio-verid:0002229A m=audio, 8688 RTP/AVP97 b=AS:32 a=rtpmap:97 mpeg4-generic/16000/2 a=fmtp:97 profile-level-id=15; Config=1410; Streamtype=5; ObiectType=64; Mode=AAC-hbr; SizeLength=13; IndexLength=3; The sign a=x-envivio-verid:0002229A of the sign a=x-envivio-verid:0002229A m=audio 8690RTP/AVP14 b=AS:48 a=rtpmap:14MPA/48000/2 a=mpeg4-esid:102 a=lang:fra/ of IndexDeltaLength=3 a=mpeg4-esid:101 a=lang:eng//description input voice/description input voice
Described direct broadcast coder 200 is the corresponding relation of appointed language and track in advance, this corresponding relation can be specified by the track serial number, as to specify first track be English, second track is Chinese, the 3rd track is Guangdong language, the 4th track is French etc., consults shown in the table 1, and wherein the Language ID value is the track serial number that comprises pairing language; Described corresponding relation also can be specified for each track increases different labels when encoding by direct broadcast coder 200, consult shown in the table 2, label is English, Chinese, German, French, this label might not be represented concrete syntax, can replace with other language as required, during as the needs Guangdong language, can represent Guangdong language with the label of German.
The mapping table of table 1 language and track serial number
| Sequence number | Language ID | Language description |
| 1 | 001 | English |
| 2 | 002 | National language |
| 3 | 003 | Guangdong language |
| 4 | 004 | French |
| …… | …… | …… |
The mapping table of table 2 language and track label
| Sequence number | Label | Language description |
| 1 | English | English |
| 2 | Chinese | National language |
| 3 | German | Guangdong language |
| 4 | French | French |
| …… | …… | …… |
Described user attribute database 201, be used for serial number or label according to the pairing track of User Identity classification storage user preferences language, or according to the track serial number or the label of the pairing language of linguistic property of User Identity classification storage subscriber equipment; Described User Identity can be phone number of user, MSN (Message Switching Network, message net), ISDN (Integrated ServicesDigital Network, integrated services digital network) number etc.; Described user preferences language is provided with in the time of can be by user capture portal website, and the serial number of its pairing track or label are stored in the described user attribute database; The linguistic property of described subscriber equipment can be obtained from subscriber equipment by streaming media server, and the track serial number of its pairing language or label are stored in the described user attribute database; The serial number of described track or label are one or more, and indicate different priority; Described user attribute database 201 can be the database of present main flow, as Oracle (a kind of database), SQL Server (Structured QueryLanguage Server, sql server), DB2 (DataBase 2, a kind of database) etc.
As shown in table 3 is 3 kinds situation for the user preferences language, and the priority of language 1 is greater than the priority of language 2, the priority of language 2, can be adjusted the language number and the priority of user preferences according to actual conditions in application greater than the priority of language 3.
The language table of table 3 user preferences
| Sequence number | User Identity | Language 1_ID | Language 2_ID | Language 3_ID |
| 1 | 13800138000 | 001 | 002 | 003 |
| 2 | 13800138004 | 002 | 001 | 003 |
| 3 | 13800138007 | 003 | 001 | 004 |
| 4 | 13800138002 | 001 | 002 | 003 |
User preferences language table shown in the table 3 is the language that comes the identifying user hobby with the serial number of track, also can come the language of identifying user hobby with the track label here.
Described streaming media server 202 is used to receive the SDP file and the real time data stream of direct broadcast coder, and this real time data stream comprises one road video data and multi-path audio-frequency data; And pairing one road voice data of language that is used for selecting by the inquiring user attribute database user's appointment, duplicate this one road voice data and described video data and send it to terminal equipment.
Described streaming media server 202 is after receiving the access request of terminal equipment, resolve the pairing SDP file of this access request to obtain to receive the port of direct broadcast coder real time data stream, this port is a plurality of, corresponding to described one road video data and multi-path audio-frequency data; Described streaming media server 202 obtains the real time data stream that direct broadcast coder 200 sends by monitoring these a plurality of ports.
Described streaming media server 202 extracts User Identity from the terminal equipment access request that receives, and generates SQL (Structured Query Language, SQL) according to this User Identity; The hobby Language ID that described streaming media server 202 uses described SQL SQL query user to set by the interface with user attribute database, described streaming media server 202 can be ODBC (Open DataBase Connectivity Open Database Connection), ADO (Active Data Object with the interface of user attribute database, ADO), JDBC (Java DataBase ConnectivityJava, database connects) wait standard interface, this interface can be selected according to the implementation of streaming media server 202 self code.
Described streaming media server 202 is selected pairing one road voice data of user preferences Language ID of limit priority according to Query Result, duplicates this one road voice data and described video data and sends it to terminal equipment; If the pairing track of user preferences Language ID of described limit priority does not comprise voice data, then by described streaming media server 202 with pairing one road voice data of the user preferences Language ID of next priority, duplicate this one road voice data and described video data and send it to terminal equipment; If the pairing track of all user preferences Language IDs does not all comprise voice data, then optional one road voice data in a plurality of voice datas that receive duplicates this one road voice data and described video data and sends it to terminal equipment.
Consult shown in Figure 3ly, described streaming media server 202 comprises: receiving element 300, selected cell 301, copied cells 302, transmitting element 303; Described receiving element 300 is used to receive the data flow that described direct broadcast coder is exported, and this data flow comprises one road video data and corresponding multi-path audio-frequency data; Described selected cell 301 is used for selecting by the inquiring user attribute database pairing one road voice data of language of user's appointment; Described copied cells 302 is used to duplicate described one road voice data and video data; Described transmitting element 303 is used for described one road voice data and video data after duplicating are sent to the user.
Described wireless network 203 is used between terminal equipment 204 and the portal website, the wireless connections between terminal equipment 204 and the streaming media server 202.
Described terminal equipment 204 is used to set the user preferences language list, and to described streaming media server 202 request real time data streams, this real time data stream comprises one road video data and one road voice data, and decompress(ion) is play after receiving this real time data stream.
After the user logs on portal website by wireless network 203, set the number and the priority of the pairing Language ID of language of hobby, and will like language list and be saved in the described user attribute database 201; The user passes through the path URL that visit portal website obtains streaming medium content, and initiates access request according to this path to streaming media server 202 by described terminal equipment 204; Described terminal equipment 204 is after receiving the real time data stream that comprises one road video data and one road voice data that streaming media server 202 obtains by inquiring user attribute database 201, with this data flow decompress(ion) and play.
Consulting shown in Figure 4ly, is example with system configuration shown in Figure 2, and the handling process of supporting multi-audio-track content by flow media platform is as follows:
Step 400, direct broadcast coder are carried out mould/number conversion and compression with the analogue data that receives, and the data flow after will compressing real-time send to streaming media server; And generate SDP file and send to streaming media server; The described analogue data that receives comprises one road video data and multi-path audio-frequency data; Described SDP file indication receives the port of described one road video data and receives a plurality of ports of described multi-path audio-frequency data, and comprises the audio description information of looking of this data flow.
Step 401, terminal equipment are provided with the user preferences language when visiting portal website and it are saved in the user attribute database.
Step 402, terminal equipment are asked the path link URL of streaming medium content to portal website; The path link URL of streaming medium content is returned in the request of web portal responds terminal equipment to terminal equipment.
Step 403, terminal equipment are initiated access request according to the path link URL of described streaming medium content to streaming media server.
Step 404, streaming media server are resolved corresponding SDP file according to described access request, obtain to receive in real time the port data of the data flow that comprises one road video data and multi-path audio-frequency data, and, obtain to comprise the real time data stream of one road video data and multi-path audio-frequency data by monitoring corresponding a plurality of ports.
Step 405, described streaming media server extract User Identity with generating structure query language SQL from the access request of terminal equipment, the hobby language that uses this language to set to the user attribute database inquiring user.
Step 406, described streaming media server duplicate this one road voice data and described video data and send it to terminal equipment according to described hobby speech selection one road voice data.
Step 407, terminal equipment receive described data flow, and carry out decompress(ion) and broadcast.
In flow process shown in Figure 4, set the user preferences language during portal website and it is saved in the user attribute database in visit by terminal equipment by the user, here also can obtain the linguistic property of terminal equipment and it is saved in the user attribute database from terminal equipment by streaming media server, consult shown in Figure 5ly, handling process is as follows:
Step 500, direct broadcast coder are carried out mould/number conversion and compression with the analogue data that receives, and the data flow after will compressing real-time send to streaming media server; And generate SDP file and send to streaming media server; The described analogue data that receives comprises one road video data and multi-path audio-frequency data; Described SDP file indication receives the port of described one road video data and receives a plurality of ports of described multi-path audio-frequency data, and comprises the audio description information of looking of this data flow.
Step 501, streaming media server obtain the linguistic property of terminal equipment.
Step 502, streaming media server are saved in this linguistic property in the user attribute database.
Step 503, terminal equipment are asked the path link URL of streaming medium content to portal website; The path link URL of streaming medium content is returned in the request of web portal responds terminal equipment to terminal equipment.
Step 504, terminal equipment are initiated access request according to the path link URL of described streaming medium content to streaming media server.
Step 505, streaming media server are resolved corresponding SDP file according to described access request, obtain to receive in real time the port data of the data flow that comprises one road video data and multi-path audio-frequency data, and, obtain to comprise the real time data stream of one road video data and multi-path audio-frequency data by monitoring corresponding a plurality of ports.
Step 506, described streaming media server extract User Identity with generating structure query language SQL from the access request of terminal equipment, use the linguistic property of this language to user attribute database inquiry terminal equipment.
Step 507, described streaming media server duplicate this one road voice data and described video data and send it to terminal equipment according to pairing speech selection one road voice data of described linguistic property.
Step 508, terminal equipment receive described data flow, and carry out decompress(ion) and broadcast.
Embodiment two
Present embodiment is selected pairing one road voice data of user's appointed language to increase language parameter at terminal equipment in the access request URL path that streaming media server is initiated, and duplicating this one road voice data and described video data and sending it to terminal equipment is that example describes.
Consult shown in Figure 6ly, the treatment system of a kind of supporting multi-audio-track content by flow media platform in the present embodiment comprises: direct broadcast coder 600, streaming media server 601, wireless network 602, terminal equipment 603; Described steaming media platform multitone rail treatment system also comprises portal website, is used for sending to terminal equipment the path URL of streaming medium content, and this portal website does not mark in Fig. 6.
Described direct broadcast coder 600 is used for the analogue data of input is carried out mould/number conversion and compression, and the data flow after will compressing real-time send to streaming media server 601, and generate SDP file and send to streaming media server 601; The analogue data of described input comprises one road video data and multi-path audio-frequency data; Described SDP file indication receives the port of described one road video data and receives a plurality of ports of described multi-path audio-frequency data, and comprises the audio description information of looking of this data flow.
The described audio description information of looking comprises that audio description information with track number equal number is in order to identify different tracks, described in embodiment one; Described direct broadcast coder 600 is the corresponding relation of appointed language and track in advance, this corresponding relation can be specified by the track serial number, also can when encoding,, each track specify by direct broadcast coder 600 for increasing different labels, and described with direct broadcast coder 200 among the embodiment one.
Described streaming media server 601 is used to receive the SDP file and the real time data stream of direct broadcast coder, and this real time data stream comprises one road video data and multi-path audio-frequency data; And be used for obtaining language parameter by the access request URL path of resolving terminal equipment 603, and, duplicate this one road voice data and described video data and send it to terminal equipment 603 according to pairing one road voice data of this language parameter selection user's appointed language.
Described streaming media server 601 is after the access request that receives terminal equipment 603, resolve the pairing SDP file of this access request to obtain to receive the port of direct broadcast coder real time data stream, this port is a plurality of, corresponding to described one road video data and multi-path audio-frequency data; Described streaming media server 601 obtains the real time data stream that direct broadcast coder 600 sends by monitoring these a plurality of ports.
The user logs on to specify after the portal website by wireless network 602 and wants the language that receives, by the pairing track serial number of the indication user's appointed language of the language parameter in the URL path, consults shown in the table 4.
Language parameter in the table 4URL path is indicated different track serial numbers
| Sex and City (Chinese) | ?RTSP://stream_ip/TV.SDP？audiotraceid＝1 |
| Sex and City (English) | ?RTSP://stream_ip/TV.SDP？audiotraceid＝2 |
| Sex and City (Guangdong language) | ?RTSP://stream_ip/TV.SDP？audiotraceid＝3 |
| Sex and City (French) | ?RTSP://stream_ip/TV.SDP？audiotraceid＝4 |
Consult shown in the table 5, the language parameter in the described URL path also can be indicated the pairing track label of user's appointed language.
The different track label of language parameter indication in the table 5URL path
| Sex and City (Chinese) | ?RTSP://stream_ip/TV.SDP？language＝chinese |
| Sex and City (English) | ?RTSP://stream_ip/TV.SDP？language＝english |
| Sex and Ciity Guangdong language) | ?RTSP://stream_ip/TV.SDP？language＝german |
| Sex and City (French) | ?RTSP://stream_ip/TV.SDP？language＝franch |
For example, if the form in the terminal equipment 603 access request URL paths that described streaming media server 601 receives is: Rtsp: //stream_ip/tv.sdp? audiotraceid=3, what then parse user's needs is the voice data of the 3rd track; If the form in the terminal equipment 603 access request URL paths that described streaming media server 601 receives is: Rsp: //stream_ip/tv.sdp? audiotraceid=Chinese, what then parse user's needs is that label is the voice data of Chinese.
If serial number or the pairing track of label that described streaming media server 601 is resolved the track of the user's appointment that obtains do not comprise voice data, then described streaming media server is optional one road voice data from the data flow that receives, and duplicates this one road voice data and described video data and sends it to terminal equipment 603.
The structure of described streaming media server 601 is identical with the structure of streaming media server 202 among the embodiment one, at this moment, described selected cell 301, be used for obtaining language parameter, and select pairing one road voice data of user's appointed language according to this language parameter by the access request URL path of resolving terminal equipment 603; Identical among the function of described receiving element 300, copied cells 302, transmitting element 303 and the embodiment one.
Described wireless network 602 is used between terminal equipment 603 and the portal website, the wireless connections between terminal equipment 603 and the streaming media server 601.
Described terminal equipment 603, be used for setting the language parameter in URL path, and to described streaming media server 601 request real time data streams, this real time data stream comprises one road video data and one road voice data, and decompress(ion) is play after receiving this real time data stream.
The user obtains the URL path of streaming medium content by visit portal website, and by the language parameter that terminal equipment 603 is set in the described URL path, in order to indicate different track serial number or label, initiates access request to streaming media server 601; Behind the real time data stream that comprises one road video data and one road voice data that the language parameter of described terminal equipment 603 in receiving the streaming media server 601 basis URL paths that parse obtains, with this data flow decompress(ion) and broadcast.
Consulting shown in Figure 7ly, is example with system configuration shown in Figure 6, and the handling process of supporting multi-audio-track content by flow media platform is as follows:
Step 700, direct broadcast coder are carried out mould/number conversion and compression with the analogue data that receives, and the data flow after will compressing real-time send to streaming media server; And generate SDP file and send to streaming media server; The described analogue data that receives comprises one road video data and multi-path audio-frequency data; Described SDP file indication receives the port of described one road video data and receives a plurality of ports of described multi-path audio-frequency data, and comprises the audio description information of looking of this data flow.
Step 701, terminal equipment are asked the URL path of streaming medium content to portal website; The URL path of streaming medium content is returned in the request of web portal responds terminal equipment to terminal equipment.
Step 702, terminal equipment are set language parameter in the URL path of described streaming medium content in order to indicate different language or track.
Step 703, terminal equipment are initiated access request according to the URL path of described streaming medium content to streaming media server.
Step 704, streaming media server are resolved corresponding SDP file according to described access request, obtain to receive in real time the port data of the data flow that comprises one road video data and multi-path audio-frequency data, and, obtain to comprise the real time data stream of one road video data and multi-path audio-frequency data by monitoring corresponding a plurality of ports.
Step 705, described streaming media server parse the language parameter in the URL path from the terminal equipment access request that receives, select pairing one road voice data of user's appointed language according to the language parameter in this URL path, duplicate this one road voice data and described video data and send it to terminal equipment.
Step 706, terminal equipment receive described data flow, and carry out decompress(ion) and broadcast.
In above-mentioned two embodiment, streaming media server is according to one road voice data of this language correspondence of speech selection of user's appointment, duplicate this one road voice data and described video data and send it to a terminal equipment, here also can pass through multicast mode, as DVB-H, DMB, MBMS (MultimediaBroadcast Multicast Service, multimedia broadcast multicast services), BCMCS (Broadcast andMulticast Services, BroadCast MultiCast Service) etc. sends to a plurality of terminal uses with described voice data and video data.
From the foregoing description as can be known, the multi-path audio-frequency data data flow that comprises one road video data and correspondence after the present invention will handle by a direct broadcast coder sends to streaming media server, by the road voice data of streaming media server according to this language correspondence of speech selection of user's appointment, duplicate this one road voice data and described video data and send it to the user, need not to use video dubbing device and too much direct broadcast coder can realize the normal reception of user to data flow, decompress(ion) and broadcast, Internet resources have been saved, reduced cost, and plant maintenance is simple relatively; In addition, processing method of the present invention is not subjected to the restriction of system, can apply to the steaming media platform system of wireless networks such as GPRS, EDGE, WCDMA, CDMA2000, TD-SCDMA, DVB-H, DMB, ISDB-T, and terminal equipment also can use this method by point-to-point (unicast technique) mode or multicast mode in the mobile network, therefore, the present invention has adaptable advantage.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.
Claims (12)
1, a kind of method of supporting multi-audio-track content by flow media platform is characterized in that, the method comprising the steps of:
By a direct broadcast coder processed data stream is sent to streaming media server, this data flow comprises one road video data and corresponding multi-path audio-frequency data;
Described streaming media server duplicates this one road voice data and described video data and sends it to the user according to one road voice data of this language correspondence of speech selection of user's appointment.
2, the method for claim 1, it is characterized in that, described direct broadcast coder is indicated port that receives described one road video data and a plurality of ports that receive described multi-path audio-frequency data in sending to the Session Description Protocol SDP file of streaming media server, described streaming media server receives described data flow by monitoring these ports.
3, the method for claim 1, it is characterized in that, described direct broadcast coder is specified track and language by the serial number or the label of track when coding corresponding relation, described streaming media server is selected voice data by the serial number or the label of the pairing track of language of user's appointment.
4, method as claimed in claim 3, it is characterized in that, the User Identity inquiring user attribute database of described streaming media server by reporting of user be with the serial number or the label of the pairing track of language that obtains user's appointment, and select voice data by the serial number or the label of this track.
5, method as claimed in claim 4 is characterized in that, the language of described user's appointment is set by the user its priority; Described streaming media server is selected voice data by the serial number or the label of the high pairing track of language of inquiry priority.
6, method as claimed in claim 4, it is characterized in that, the language of described user's appointment is provided with by portal website by the user or is obtained from subscriber equipment by streaming media server, and the serial number of its pairing track or label are stored in the described user attribute database.
7, method as claimed in claim 3 is characterized in that, the serial number of the pairing track of language of described user's appointment or label are arranged in the access path of terminal equipment convection media server with the form of language parameter; Described streaming media server obtains the serial number or the label of the pairing track of language of user's appointment by resolving this access path, and selects voice data by the serial number or the label of this track.
8, as each described method of claim 3 to 7, it is characterized in that, if the pairing track of language of described user's appointment does not comprise voice data, then described streaming media server is optional one road voice data from the data flow that receives, and duplicates this one road voice data and described video data and sends it to terminal equipment.
9, a kind of streaming media server is characterized in that, comprising:
Receiving element is used to receive one road video data of direct broadcast coder output and the multi-path audio-frequency data of correspondence;
Selected cell is used for selecting from described multi-path audio-frequency data according to the language of user's appointment one road voice data of this language correspondence;
Copied cells is used to duplicate described one road voice data and video data;
Transmitting element is used to send described one road voice data and video data after duplicating.
10, a kind of treatment system of supporting multi-audio-track content by flow media platform is characterized in that, comprising:
Direct broadcast coder is used for one road analog video signal of input and multi-channel analog audio signal are changed and compressed processing, and output comprises the data flow of one road video data and corresponding multi-path audio-frequency data;
Streaming media server, be connected with described direct broadcast coder, be used to receive the data flow of described direct broadcast coder output, and, duplicate and send this one road voice data and described video data according to one road voice data of this language correspondence of speech selection of user's appointment.
11, system as claimed in claim 10 is characterized in that, described system also comprises:
Portal website is used for providing the access path to described streaming media server data flow, and the user visits described streaming media server by this access path.
12, as claim 10 or 11 described systems, it is characterized in that described system also comprises:
User attribute database is used to store the serial number or the label of the pairing track of language of user's appointment, and offers described streaming media server inquiry.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006101120839A CN1937609B (en) | 2006-08-29 | 2006-08-29 | Method and system for supporting multi-audio-track content by flow media platform and flow media server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2006101120839A CN1937609B (en) | 2006-08-29 | 2006-08-29 | Method and system for supporting multi-audio-track content by flow media platform and flow media server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1937609A true CN1937609A (en) | 2007-03-28 |
| CN1937609B CN1937609B (en) | 2010-10-06 |
Family
ID=37954878
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006101120839A Expired - Fee Related CN1937609B (en) | 2006-08-29 | 2006-08-29 | Method and system for supporting multi-audio-track content by flow media platform and flow media server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1937609B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101437149B (en) * | 2007-11-12 | 2010-10-20 | 华为技术有限公司 | Method, system and apparatus for providing multilingual program |
| CN101895406A (en) * | 2010-06-23 | 2010-11-24 | 中兴通讯股份有限公司 | Method and system for providing direct broadcast service of mobile streaming media |
| CN103093776A (en) * | 2011-11-04 | 2013-05-08 | 腾讯科技（深圳）有限公司 | Method and system of multi-audio-track content play in network seeing and hearing |
| CN104768052A (en) * | 2015-04-02 | 2015-07-08 | 无锡天脉聚源传媒科技有限公司 | Method and device for extracting voice frequency and subtitles according to language |
| CN105025319A (en) * | 2015-07-09 | 2015-11-04 | 无锡天脉聚源传媒科技有限公司 | Video pushing method and device |
| CN105263033A (en) * | 2015-10-12 | 2016-01-20 | 天脉聚源(北京)传媒科技有限公司 | Audio and video data sending method and device and audio and video data receiving method and device |
| CN105263032A (en) * | 2015-10-12 | 2016-01-20 | 天脉聚源(北京)传媒科技有限公司 | Program acquiring method and device |
| CN105392028A (en) * | 2015-10-12 | 2016-03-09 | 天脉聚源(北京)传媒科技有限公司 | Data transmission method and device |
| CN105791971A (en) * | 2014-12-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | method and device for switching stream media audio |
| CN106488297A (en) * | 2016-10-21 | 2017-03-08 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus of display image data |
| CN108737845A (en) * | 2018-05-22 | 2018-11-02 | 北京百度网讯科技有限公司 | Processing method, device, equipment and storage medium is broadcast live |
| CN108810575A (en) * | 2017-05-04 | 2018-11-13 | 杭州海康威视数字技术股份有限公司 | A kind of method and apparatus sending target video |
| WO2019227308A1 (en) * | 2018-05-29 | 2019-12-05 | 华为技术有限公司 | Method and device for selecting audio track from audio and video files |
| CN113709509A (en) * | 2021-08-05 | 2021-11-26 | 中移（杭州）信息技术有限公司 | Audio and video data transmission method and device and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE4236989C2 (en) * | 1992-11-02 | 1994-11-17 | Fraunhofer Ges Forschung | Method for transmitting and / or storing digital signals of multiple channels |
| EP1158799A1 (en) * | 2000-05-18 | 2001-11-28 | Deutsche Thomson-Brandt Gmbh | Method and receiver for providing subtitle data in several languages on demand |
| CN1208968C (en) * | 2002-11-21 | 2005-06-29 | 北京中科大洋科技发展股份有限公司 | Apparatus for making, transmitting and receiving broadcasting type quasi video frequency requested program |
| CN2724334Y (en) * | 2004-08-27 | 2005-09-07 | 马晨阳 | Cell phone video frequency image monitor |
-
2006
- 2006-08-29 CN CN2006101120839A patent/CN1937609B/en not_active Expired - Fee Related
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101437149B (en) * | 2007-11-12 | 2010-10-20 | 华为技术有限公司 | Method, system and apparatus for providing multilingual program |
| CN101895406A (en) * | 2010-06-23 | 2010-11-24 | 中兴通讯股份有限公司 | Method and system for providing direct broadcast service of mobile streaming media |
| CN101895406B (en) * | 2010-06-23 | 2014-12-10 | 中兴通讯股份有限公司 | Method and system for providing direct broadcast service of mobile streaming media |
| CN103093776A (en) * | 2011-11-04 | 2013-05-08 | 腾讯科技（深圳）有限公司 | Method and system of multi-audio-track content play in network seeing and hearing |
| CN103093776B (en) * | 2011-11-04 | 2016-01-20 | 腾讯科技（深圳）有限公司 | Multi-audio-track content player method and system in network audiovisual |
| CN105791971A (en) * | 2014-12-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | method and device for switching stream media audio |
| CN104768052A (en) * | 2015-04-02 | 2015-07-08 | 无锡天脉聚源传媒科技有限公司 | Method and device for extracting voice frequency and subtitles according to language |
| CN105025319A (en) * | 2015-07-09 | 2015-11-04 | 无锡天脉聚源传媒科技有限公司 | Video pushing method and device |
| CN105025319B (en) * | 2015-07-09 | 2019-03-12 | 无锡天脉聚源传媒科技有限公司 | A kind of video pushing method and device |
| CN105392028A (en) * | 2015-10-12 | 2016-03-09 | 天脉聚源(北京)传媒科技有限公司 | Data transmission method and device |
| CN105263033A (en) * | 2015-10-12 | 2016-01-20 | 天脉聚源(北京)传媒科技有限公司 | Audio and video data sending method and device and audio and video data receiving method and device |
| CN105263032A (en) * | 2015-10-12 | 2016-01-20 | 天脉聚源(北京)传媒科技有限公司 | Program acquiring method and device |
| CN105263032B (en) * | 2015-10-12 | 2018-06-19 | 天脉聚源(北京)传媒科技有限公司 | A kind of program acquisition method and device |
| CN105263033B (en) * | 2015-10-12 | 2018-09-25 | 天脉聚源(北京)传媒科技有限公司 | A kind of sending method of audio, video data, method of reseptance and device |
| CN105392028B (en) * | 2015-10-12 | 2019-05-24 | 天脉聚源(北京)传媒科技有限公司 | A kind of transmission method and device of data |
| CN106488297A (en) * | 2016-10-21 | 2017-03-08 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus of display image data |
| CN106488297B (en) * | 2016-10-21 | 2019-01-22 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus of display image data |
| CN108810575A (en) * | 2017-05-04 | 2018-11-13 | 杭州海康威视数字技术股份有限公司 | A kind of method and apparatus sending target video |
| CN108737845A (en) * | 2018-05-22 | 2018-11-02 | 北京百度网讯科技有限公司 | Processing method, device, equipment and storage medium is broadcast live |
| CN108737845B (en) * | 2018-05-22 | 2019-09-10 | 北京百度网讯科技有限公司 | Processing method, device, equipment and storage medium is broadcast live |
| US10743038B2 (en) | 2018-05-22 | 2020-08-11 | Beijing Baidu Netcom Science Technology Co., Ltd. | Live broadcast processing method, apparatus, device, and storage medium |
| WO2019227308A1 (en) * | 2018-05-29 | 2019-12-05 | 华为技术有限公司 | Method and device for selecting audio track from audio and video files |
| CN113709509A (en) * | 2021-08-05 | 2021-11-26 | 中移（杭州）信息技术有限公司 | Audio and video data transmission method and device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1937609B (en) | 2010-10-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1937609B (en) | Method and system for supporting multi-audio-track content by flow media platform and flow media server | |
| CN100479528C (en) | Method, system and stream media server of supporting multiple audio tracks | |
| CN100544439C (en) | A kind of method and system of supporting the media data of multiple coded format | |
| EP1922827B1 (en) | Signalling of cell id in digital mobile broadcast service guide for localized broadcasting | |
| KR100878534B1 (en) | Apparatus and method for providing internet protocol datacasting service in Digital Audio Broadcasting system | |
| US9614628B2 (en) | Adapting location based broadcasting | |
| RU2496256C2 (en) | Method and apparatus for providing service guide in mobile broadcasting system | |
| KR100609147B1 (en) | System and Method for providing TPEG traffic and traveler information, and DMB Broadcasting Receiving System and Method for receiving TPEG traffic and traveler information | |
| CN101049014B (en) | Auxiliary content handling over digital communication systems | |
| EP1708392B1 (en) | Apparatus and method for delivering a stream in a mobile broadcast system | |
| US20110103300A1 (en) | Data encapsulation and service discovery over a broadcast or multicast system | |
| CN102498722B (en) | The basis packet utilizing the media stream selecting mpeg 2 transport stream multiplexing carries out the distribution of this stream | |
| CN1610283A (en) | Digital broadcast system and method for providing a broadcast service with area-specific additional information | |
| CN103188522A (en) | Method and system for providing and delivering a composite condensed stream | |
| KR20060012510A (en) | Base of ip dmb data translation apparatus and method for dmb receiving system using that | |
| CN106105240A (en) | Send the device of broadcast singal, device, the transmission method of broadcast singal and the method for receiving broadcast signal of receiving broadcast signal | |
| CN1859526B (en) | Method for realizing stream media aualogue live telecast, stream media server and content management system | |
| CN106233693A (en) | Broadcast singal sends equipment, broadcasting signal receiving, broadcast singal sending method and broadcast signal received method | |
| CN103503439A (en) | Method and apparatus for transmitting/receiving broadcast service in digital broadcasting system, and system thereof | |
| EP2466840B1 (en) | Evolved multimedia broadcast multicast service system and method for performing statistical multiplexing for services with different quality of service class identifiers | |
| DE60302640D1 (en) | News broadcasting system in a radio communication network | |
| CN101771948B (en) | Configuration method for header compression mode in MBMS service | |
| CN101321293B (en) | Apparatus and method for implementing multi-path program multiplexing | |
| CN100442699C (en) | Method and system for discovering OMA BCAST service guide | |
| CN101193105A (en) | A media stream transmission/switching method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20101006 Termination date: 20120829 |