CN103686202A - Real-time transcoding transmitting method and system based on HTTP (Hyper Text Transport Protocol) under DLNA (Digital Living Network Alliance) - Google Patents
Real-time transcoding transmitting method and system based on HTTP (Hyper Text Transport Protocol) under DLNA (Digital Living Network Alliance) Download PDFInfo
- Publication number
- CN103686202A CN103686202A CN201210346503.5A CN201210346503A CN103686202A CN 103686202 A CN103686202 A CN 103686202A CN 201210346503 A CN201210346503 A CN 201210346503A CN 103686202 A CN103686202 A CN 103686202A
- Authority
- CN
- China
- Prior art keywords
- digital media
- data
- multimedia
- http
- item
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000005540 biological transmission Effects 0.000 claims abstract description 28
- 239000000463 material Substances 0.000 claims description 24
- 230000013011 mating Effects 0.000 claims description 10
- 230000008878 coupling Effects 0.000 description 11
- 238000010168 coupling process Methods 0.000 description 11
- 238000005859 coupling reaction Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 238000005538 encapsulation Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
- H04L12/281—Exchanging configuration information on appliance services in a home automation network indicating a format for calling an appliance service function in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
- H04N21/4516—Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L2012/2847—Home automation networks characterised by the type of home appliance used
- H04L2012/2849—Audio/video appliances
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Automation & Control Theory (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a real-time transcoding transmitting method based on HTTP (Hyper Text Transport Protocol) under DLNA (Digital Living Network Alliance). The method comprises the following steps: matching broadcast capability information with media item resource information, broadcasting multimedia content acquired from a digital media server or receiving encoded data transmitted from the digital media server through HTTP according to the matching result, and broadcasting the content. The invention further discloses a real-time transcoding transmitting system based on HTTP under DLNA. By adopting the method and the system, real-time transcoding of multimedia and real-time transmission of on-site stream based on HTTP under DLNA can be achieved.
Description
Technical field
The present invention relates to multimedia technology field, relate in particular to a kind of in DLNA network transcoding live transmission method and the system of digital media server based on HTTP.
Background technology
Equipment based on DLNA (Digital Living Network Alliance) can be divided into: digital media server (Digital Media Server/Mobile-Digital Media Server, be called for short DMS/M-DMS), digital media player (Digital Media Player/Mobile-Digital Media Player, be called for short DMP/M-DMP), Digital Media controller (Digital Media Controller/Mobile-Digital MediaController, be called for short DMC/M-DMC) and Digital Media renderer (Digital Media Render, be called for short DMR).Digital media server is responsible for issuing the content of multimedia that user is shared, and these multimedias can be picture, music and video, can have diversified coded format and file format.Digital media player and the shared content of multimedia of Digital Media renderer playing digital medium server, due to capacity of equipment restriction, conventionally digital media player or Digital Media renderer and digital media server are supported file format and Digital Media coded format are variant, so digital media player and Digital Media renderer cannot the shared whole content of multimedia of playing digital medium server.In this case, just need digital media server to carry out multimedia real-time transcoding.
Multimedia real-time transcoding needs digital media server to adopt real time streaming transport protocol (Real TimeStreaming Protocol conventionally, be called for short RTSP) carry out, for digital media server, adopt HTTP (HyperText Transfer Protocol, be called for short HTTP) time, following problems may be encountered:
1, under normal conditions, the digital media server that adopts HTTP to carry out real-time transcoding must clearly be known the total data size that will transmit, when this realizes multi-media transcoding function with regard to the digital media server that requires to adopt HTTP to transmit, must first corresponding media resource be converted in advance to the file of specified format, and then carry out HTTP transmission, this will inevitably produce larger delay, greatly reduce the experience of DLNA user to Digital Media, cannot be used for transmitting real-time resource, such as Digital Television, camera video etc.;
2, in the situation that cannot clearly know the size of data that will transmit, digital media server can adopt the piece encoding mechanism in HTTP to carry out real-time transcoding, in this piecemeal transfer encoding mechanism, a data block of each transmission, if while not having data to send, send so the data block of zero size, represent that transfer of data is complete, the first byte representation data block size (not comprising CRLF) of each data block, each data block stops with carriage return and line feed (Carriage Return/Line Feed is called for short CRLF); When this method is used for transmitting extend markup language (Extensible Markup Language, be called for short XML) data, can effectively solve the HTTP transmission of size of data the unknown, but have following problem while being used for transmitting multimedia data:
1) using the end of CRLF as each data block, there is not any problem in the XML data for UTF-8 coding, but for Multimedia Data Transmission, if multi-medium data self comprises CRLF, can be mistaken as this transmission of data blocks and stop, cause CRLF loss of data below;
2) underuse the relevant information that piece extend information provides data block.
Therefore, due to digital media server, there is above-mentioned restriction during by HTTP transmitting multimedia data, therefore, digital media server can only be by live TV stream (the HTTP LiveStreaming of RTSP or HTTP, abbreviation HLS) agreement just can be carried out real-time transcoding, real-time Transmission, cannot realize real-time transcoding, real-time Transmission by HTTP.
Summary of the invention
In view of this, main purpose of the present invention is to provide multi-media transcoding live transmission method and the system based on HTTP under a kind of DLNA, realizes while passing through HTTP transmitting multimedia data multimedia real-time transcoding, real-time Transmission.
For achieving the above object, technical scheme of the present invention is achieved in that
The invention provides the transcoding live transmission method based on HTTP under a kind of DLNA, the method comprises the steps:
Ability to play information is mated with media item resource information, and the data after the coding that the content of multimedia that broadcasting is obtained in digital media server according to matching result or reception digital media server send by HTTP are also play.
Here, described ability to play information is mated with media item resource information, comprising:
Digital media server is sent to digital media player by media item resource information; Digital media player mates the ability to play information of self with described media item resource information.
Wherein, described media item resource information comprises: source material item, special resource item and entirely mate resource items;
Data after the coding that the described content of multimedia that broadcasting is obtained in digital media server according to matching result or reception digital media server send by HTTP are also play, and comprising:
Digital media player can mate source material item, obtains content of multimedia and play in digital media server; Or,
Digital media player is in the situation that can not mating source material item, can mate special resource item or entirely mate resource items, matching result is sent to digital media server, digital media server carries out HTTP piece coding according to matching result by the data after content of multimedia transcoding, and the data after coding are sent to digital media player by HTTP, digital media player receives the data after coding and plays.
Here, described ability to play information is mated with media item resource information, or comprises:
Digital media server is sent to Digital Media controller by media item resource information; Digital Media controller obtains the ability to play information of Digital Media renderer, and described ability to play information is mated with described media item resource information.
Wherein, described media item resource information comprises: source material item, special resource item and entirely mate resource items;
Data after the coding that the described content of multimedia that broadcasting is obtained in digital media server according to matching result or reception digital media server send by HTTP are also play, and comprising:
Digital Media controller can mate source material item, and matching result is sent to Digital Media renderer, and Digital Media renderer obtains content of multimedia and plays in digital media server according to matching result; Or,
Digital Media controller, in the situation that can not mating source material item, can mate special resource item or entirely mate resource items, and matching result is sent to digital media server; Digital media server carries out HTTP piece coding by the data after content of multimedia transcoding, and the data after coding are sent to Digital Media renderer by HTTP, and Digital Media renderer receives the data after coding and plays.
Wherein, described special resource item comprises: one or more in TS resource items, MP4 resource items, Local resource item.
Described HTTP piece is encoded to multi-medium data is divided into general data piece and final piece; Wherein, described general data piece comprises: data block length information, data block extend information, extend information separator, data block data and separator; Described final piece comprises: data block length information and separator, and length is zero.
Described data block extend information comprises: the decoding time stamp of data block type, data block contents coded system and data block contents; And/or,
Described extend information separator and separator are new line character; And/or,
Described data block length is 4 byte lengths of network bytes order, and each data block length transmits at most 232-1 byte.
The present invention also provides the transcoding RTTS based on HTTP under a kind of DLNA, and described system comprises:
Digital media server, for sending the media item resource information of multi-medium data, receive the matching result that digital media player or Digital Media controller send, according to matching result, the data after content of multimedia transcoding are carried out to HTTP piece coding, by coding after transfer of data to digital media player or Digital Media renderer;
Digital Media controller, the media item resource information sending for receiving digital media server, the ability to play information of the Digital Media renderer that Bing Jiangcong Digital Media renderer gets is mated with described media item resource information, and matching result is transferred to Digital Media renderer; Also for described matching result is sent to digital media server;
Digital Media renderer, the matching result sending for receiving Digital Media controller, and according to matching result, in digital media server, obtain content of multimedia and play, or, receive from the data after the coding of digital media server and play;
Digital media player, the media item resource information sending for receiving digital media server, and the ability to play information of self is mated with described media item resource information, according to matching result, in digital media server, obtain content of multimedia and play, or, described matching result is sent to described digital media server, receives from the data after the coding of digital media server and play.
Here, described digital media server comprises: multimedia content description unit, content of multimedia coding unit and message elements;
Wherein, described multimedia content description unit: for content of multimedia being described by numerical digit project declaration language DIDL;
Described content of multimedia coding unit: for the data after content of multimedia transcoding being carried out to HTTP piece coding;
Described message elements: the matching result sending for receiving digital media player or Digital Media controller, according to matching result, the data after content of multimedia transcoding are carried out to HTTP piece coding, the data after coding are sent to digital media player or Digital Media renderer by HTTP.
Therefore, transcoding live transmission method based on HTTP under DLNA provided by the present invention and the advantage of system: by utilizing the piecemeal transfer encoding mechanism of improved HTTP, utilize digital media server in DLNA network to obtain the media item resource information of content of multimedia, then described digital media server is used improved HTTP piece encoding mechanism the information that will transmit is carried out to transcoding and be real-time transmitted on digital media player or Digital Media renderer and play by HTTP, and then realize multimedia real-time transcoding under DLNA and the real-time relay of situ flow, this process does not need to adopt RTSP or HLS agreement, the video format of shared medium and the tenability of file format in DLNA network have greatly been improved, realized the multimedia real-time transmission characteristic based on HTTP.
Accompanying drawing explanation
Fig. 1 is the transcoding real-time Transmission flow process figure based on HTTP under the DLNA of the embodiment of the present invention;
Fig. 2 is the HTTP piece coding structure schematic diagram after the present invention improves;
Fig. 3 is the device schematic diagram of the transcoding real-time Transmission based on HTTP under DLNA of the present invention.
Embodiment
Basic thought of the present invention is: ability to play information is mated with media item resource information, and the data after the coding that the content of multimedia that broadcasting is obtained in digital media server according to matching result or reception digital media server send by HTTP are also play.
Below in conjunction with diagram, describe implementation process of the present invention in detail.
The system of the transcoding real-time Transmission based on HTTP under DLNA of the present invention mainly comprises: digital media server, digital media player, Digital Media renderer and Digital Media controller.
Based on said system, the present invention realizes the method for the transcoding real-time Transmission based on http protocol under DLNA, and as shown in Figure 1, concrete steps are as follows:
Step 101: digital media server and Digital Media renderer are by UPnP (UniversalPlug and Play, being called for short UPnP) agreement sends respectively the state information of oneself to all devices in DLNA network, to inform that in DLNA network, each equipment oneself state is normal;
Step 102: Digital Media controller is received after described state information, obtains the multimedia content description information of the shared content of multimedia of digital media server, selects for user; And selected certain content of multimedia of the multimedia content description information that user provides by Digital Media controller is play in Digital Media renderer or digital media player, and Digital Media controller is sent to digital media server by the multimedia content description information of user-selected content of multimedia;
Wherein, described multimedia content description information is: whether media item sign, upper strata media item sign, media item can be revised, type and media item resource (res) information of media item title, media item date created, media item;
Wherein, described media item is designated: each content of multimedia of unique identification, is used for distinguishing the different multimedia content in digital media service;
Described upper strata media item is designated: the upper level container identification at content of multimedia place, while browsing for Digital Media controller, use;
Described media item type is: the classification of content of multimedia, such as audio frequency, video or picture etc.;
Described media item resource information is: the access mode of content of multimedia, comprise URL(uniform resource locator) (Universal Resource Locator, URL), the multi purpose internet mail extensions of content of multimedia byte number and content of multimedia (Multipurpose Internet Mail Extensions, MIME) type.
Step 103: digital media server receives after the selected multimedia content description information of described user, is sent to digital media player by the media item resource information in described multimedia content description information or Digital Media controller mates;
Wherein, described media item resource information comprises: source material item and full coupling resource items, also comprise: special resource item;
Wherein, described source material item is: the Format Type of content of multimedia self;
Described full coupling resource items is: the Format Type that the ability to play of digital media player, Digital Media renderer is all supported;
Described special resource item is: the object format type of content of multimedia being carried out to format conversion.
Wherein, described special resource item can comprise: in three of transport stream (Transport Stream, be called for short TS) resource items, MP4 resource items or Local resource items one or multinomial;
Here, described TS resource items is: the selected content of multimedia of user can be converted to the transport stream of MPEG4 form;
Described MP4 resource items is: the selected content of multimedia of user can be converted to the file of MP4 form;
Described Local resource item is: can be only the video flowing of the selected content of multimedia of user be converted to specific coding as the frame of video of H264 coding; Or, can be only the audio stream of the selected content of multimedia of user be converted to specific coding as the audio frame of AAC coding, thereby meets the requirement that digital media player or Digital Media renderer are only play the content of certain specific format;
Described full coupling resource items is specifically as follows: frame of video, the audio stream that the video flowing of the selected content of multimedia of user is converted to H264 coding is converted to the audio frame of AAC coding;
Wherein, described H264 coding is specifically as follows H.264 BaseLine Profile 3.1;
Described AAC coding is specifically as follows AAC-LC Profile.
Step 104 is to 107: digital media player mates the ability to play information of himself with described media item resource information, if digital media player can mate source material item, perform step 107, digital media player obtains the selected content of multimedia of user and plays in digital media server; Or, Digital Media controller obtains the ability to play information of Digital Media renderer, then described Digital Media controller mates with described media item resource information according to the ability to play information of the Digital Media renderer getting, if Digital Media controller can mate source material item, perform step 107, be that Digital Media controller is sent to Digital Media renderer by matching result, then Digital Media renderer obtains the selected content of multimedia of user and plays in digital media server according to matching result;
If digital media player is in the situation that can not mating source material item, can mate special resource item, or digital media player is in the situation that can not mating source material item and special resource item, can mate full coupling resource items, digital media player is sent to digital media server by matching result, then perform step 106, be that described digital media server carries out HTTP piece coding according to matching result by the data after described content of multimedia transcoding, and the data after coding are sent to digital media player by HTTP, perform step subsequently 108, be that digital media player receives the data after coding and plays, or, Digital Media controller is in the situation that can not mating source material item, can mate special resource item, or Digital Media controller is in the situation that can not mating source material item and special resource item, can mate full coupling resource items, Digital Media controller is sent to digital media server by matching result, then perform step 106 to step 108, be that digital media server carries out HTTP piece coding according to matching result by the data after described content of multimedia transcoding, and the data after coding are sent to Digital Media renderer by HTTP, Digital Media renderer receives the data after coding and plays,
Particularly, if digital media player can mate TS resource items, MP4 resource items, Local resource item or entirely mate resource items, digital media player is sent to digital media server by matching result, then perform step 106, be that described digital media server carries out HTTP piece coding by the data after described content of multimedia transcoding, and the data after coding are sent to digital media player by HTTP, perform step subsequently 108, digital media player receives the data after coding and plays; Or, if Digital Media controller can mate TS resource items, MP4 resource items, Local resource item or entirely mate resource items, Digital Media controller is sent to digital media server by matching result, then perform step 106 to step 108, be that digital media server carries out HTTP piece coding by the data after described content of multimedia transcoding, and the data after coding are sent to Digital Media renderer by HTTP, Digital Media renderer receives the data after coding and plays;
Wherein, what described digital media player or Digital Media controller mated is entirely to mate resource items or Local resource item, and digital media player or Digital Media renderer must be supported following Audio and Video coding:
Video H264 coding: Base Line Profile 3.1 H.264,
Audio A AC coding: AAC-LC Profile.
Described full coupling resource items and local resource items do not carry out file format encapsulation, send frame by frame data, according to HTTP piece coded data piece extend information content presentation, be audio frame or frame of video, with and audio frame decoding time stamp or its frame of video decoding time stamp, so that the digital media player of receiving terminal or Digital Media renderer can normal decoders, thereby realize real-time transcoding, the real-time Transmission of the content of multimedia based on HTTP;
Wherein, each frame of video or audio frame are a general data piece in HTTP piece coding.
For coupling is TS resource items, during MP4 resource items, described TS resource items is converted to the selected content of multimedia of described user the transport stream of MPEG4 form, and the transport stream of the described MPEG4 form of changing is in real time encapsulated as to TS frame, each TS frame is encapsulated in a general data piece in HTTP piece coding and carries out TS frame one by one and sends, and be TS frame according to HTTP piece coded data piece extend information content presentation, so that the digital media player of receiving terminal or Digital Media renderer can normal decoders, thereby realize the real-time transcoding of the content of multimedia based on HTTP, real-time Transmission,
Wherein, described TS frame comprises: frame of video and/or audio frame, and corresponding audio frame decoding time stamp and/or frame of video decoding time stamp;
Described MP4 resource items is converted to the selected content of multimedia of described user the file of MP4 form, in the literary composition of wherein said MP4 form, include different coded systems, the content after the selected content of multimedia of described user is encoded by specific coded system is called the transport stream of specific format, hence one can see that, the described MP4 resource items selected content of multimedia of the most described user is converted to the transport stream of specific format, subsequently the transport stream of the described specific format of changing is in real time packaged into MP4 frame, each MP4 frame is encapsulated in a general data piece in HTTP piece coding and carries out MP4 frame one by one and send, and be MP4 frame according to HTTP piece coded data piece extend information content presentation, so that the digital media player of receiving terminal or Digital Media renderer can normal decoders, thereby realize the real-time transcoding of the content of multimedia based on HTTP, real-time Transmission,
Wherein, the form that the transport stream of described specific format is packaged into is called MP4 frame, and wherein, the capacity of each MP4 frame is less than 2
32-1 byte, described MP4 frame comprises: frame of video and/or audio frame, and corresponding audio frame decoding time stamp and/or frame of video decoding time stamp.
Fig. 2 is the HTTP piece coding structure schematic diagram after the present invention improves, and described digital media server carries out HTTP piece coding by structure shown in Fig. 2 to multi-medium data:
Here, described HTTP piece is encoded to: described multi-medium data is divided into some general data pieces and a final piece; Wherein,
The data structure of described general data piece comprises: data block length information, data block extend information, extend information separator, data block data and separator;
The data structure of described final piece comprises: data block length information and separator, and length is zero;
Described data block extend information comprises: the decoding time stamp of data block type, data block contents coded system and data block contents; Wherein, the decoding time stamp of described data block contents comprises: audio frame decoding time stamp and/or frame of video decoding time stamp; Described data block type comprises: audio frame, frame of video, TS frame and MP4 frame;
Described extend information separator and separator are carriage return and line feed (CRLF) character, take two bytes;
Described data block length is 4 byte lengths of network bytes order, and each data block length transmits at most 232-1 byte.
Fig. 3 is the system schematic of the transcoding real-time Transmission based on HTTP under DLNA of the present invention, and as shown in Figure 3, the system of the transcoding real-time Transmission based on HTTP under a kind of DLNA, comprising:
Digital media server, for sending the media item resource information of content of multimedia, receive the matching result that digital media player or Digital Media controller send, according to matching result, the data after content of multimedia transcoding are carried out to HTTP piece coding, by coding after transfer of data to digital media player or Digital Media renderer;
Digital Media controller, the media item resource information sending for receiving digital media server, the ability to play information of the Digital Media renderer that Bing Jiangcong Digital Media renderer gets is mated with described media item resource information, and matching result is transferred to Digital Media renderer; Also for described matching result is sent to digital media server;
Digital Media renderer, the matching result sending for receiving Digital Media controller, and according to matching result, in digital media server, obtain the selected content of multimedia of user and play, or, receive from the data after the coding of digital media server and play;
Digital media player, the media item resource information sending for receiving digital media server, and the ability to play information of self is mated with described media item resource information, according to matching result, in digital media server, obtain the selected content of multimedia of user and play, or, described matching result is sent to described digital media server, receives from the data after the coding of digital media server and play.
Wherein, described digital media server comprises: multimedia content description unit, content of multimedia coding unit and message elements;
Described multimedia content description unit: for content of multimedia being described by numerical digit project declaration language (Digital ItemDeclaration Language, DIDL);
Described content of multimedia coding unit: for the data after content of multimedia transcoding being carried out to HTTP piece coding;
Described message elements: the matching result sending for receiving digital media player or Digital Media controller, according to matching result, the data after content of multimedia transcoding are carried out to HTTP piece coding, the data after coding are sent to digital media player or Digital Media renderer by HTTP.
Embodiment 1
In digital media server, store content of multimedia (as a certain WMV video film source), digital media server is described each content of multimedia as follows by DIDL, and following content is referred to as multimedia content description information:
1) media item sign, 2) upper strata media item sign, 3) whether media item can be revised, 4) media item title, 5) media item date created, the 6) type of media item, 7) media item resource (res) information;
Digital Media controller is by the multimedia content description information that obtains alternately content of multimedia with digital multimedia server, the multimedia content description information that user by selecting Digital Media controller provides specifies a certain WMV video film source to play in Digital Media renderer, after the multimedia content description information of the WMV video film source that Digital Media controller is selected user is sent to digital media server, the transcoding that adopts following detailed process to realize HTTP is implemented transmission:
Step 201: digital media server is sent to Digital Media controller by the media item resource information of described WMV video film source and mates;
Wherein, described media item resource information comprises: source material item, TS resource items, MP4 resource items, Local resource item and entirely mate resource items; Conventionally first be source material item, last is for entirely mating resource items, and centre is TS resource items, MP4 resource items and local resource items;
Wherein, described TS resource items is: the TS stream that described WMV video film source can be converted to MPEG4 form;
Described MP4 resource items is: described WMV video film source can be converted to the file of MP4 form;
Described Local resource item is: the audio stream of described WMV video film source can be converted to MP3 format;
Described full coupling resource items is: the video flowing of described WMV video film source can be converted to the frame of video of H264 coding, its audio stream be converted to the audio frame of AAC coding,
Wherein, described H264 is encoded to H.264 BaseLine Profile 3.1;
Described AAC is encoded to AAC-LC Profile.
Step 202: Digital Media controller obtains the ability to play information of Digital Media renderer, and the ability to play information of obtaining is mated with media item resource information, matching result is full coupling resource items, and Digital Media controller is sent to digital media server by described matching result;
Step 203: digital media server receives after above-mentioned matching result, carries out HTTP piece coding to the data after described WMV video film source transcoding, then the data after coding is sent to Digital Media renderer frame by frame by HTTP and plays.
Wherein, the following Audio and Video coding of Digital Media renderer support:
Video H264 coding: Base Line Profile 3.1 H.264, audio A AC coding: AAC-LCProfile.
Embodiment 2
In digital media server, store content of multimedia (as a certain WMV video film source), digital media server is described each content of multimedia as follows by DIDL, and following content is referred to as multimedia content description information:
1) media item sign, 2) upper strata media item sign, 3) whether media item can be revised, 4) media item title, 5) media item date created, the 6) type of media item, 7) media item resource (res) information;
Digital Media controller is by the multimedia content description information that obtains alternately content of multimedia with digital multimedia server, the multimedia content description information that user by selecting Digital Media controller provides specifies a certain WMV video film source to play in digital media player, after the multimedia content description information of the WMV video film source that Digital Media controller is selected user is sent to digital media server, the transcoding that adopts following detailed process to realize HTTP is implemented transmission:
Step 301: digital media server is sent to digital media player by the media item resource information of described WMV video film source and mates;
Wherein, described media item resource information comprises: source material item, TS resource items, MP4 resource items, Local resource item and entirely mate resource items; Conventionally first be source material item, last is for entirely mating resource items, and centre is TS resource items, MP4 resource items and local resource items;
Wherein, described TS resource items is: the TS stream that described WMV video film source can be converted to MPEG4 form;
Described MP4 resource items is: described WMV video film source can be converted to the file of MP4 encapsulation format;
Described Local resource item is: can only the audio stream of described WMV video film source be converted to the audio frame of AAC coding; Or only the video flowing of described WMV video film source is converted to the frame of video of H264 coding;
Described full coupling resource items is: the video flowing of described WMV video film source can be converted to the frame of video of H264 coding, its audio stream be converted to the audio frame of AAC coding,
Wherein, described H264 is encoded to H.264 BaseLine Profile 3.1;
Described AAC is encoded to AAC-LC Profile.
Step 302: digital media player mates the ability to play information of himself with described media item resource information, matching result is full coupling resource items, digital media player is sent to digital media server by matching result;
Step 303: digital media server receives after above-mentioned matching result, carries out HTTP piece coding to the data after described WMV video film source transcoding, and the data after coding are sent to frame by frame to digital media player by HTTP and play.
Wherein, the following Audio and Video coding of digital media player support:
Video H264 coding: Base Line Profile 3.1 H.264, audio A AC coding: AAC-LCProfile.
The above, be only preferred embodiment of the present invention, is not intended to limit protection scope of the present invention.
Claims (10)
1. the transcoding live transmission method based on HTTP under DLNA, is characterized in that, the method comprises the steps:
Ability to play information is mated with media item resource information, and the data after the coding that the content of multimedia that broadcasting is obtained in digital media server according to matching result or reception digital media server send by HTTP are also play.
2. method according to claim 1, is characterized in that, described ability to play information is mated with media item resource information, comprising:
Digital media server is sent to digital media player by media item resource information;
Digital media player mates the ability to play information of self with described media item resource information.
3. method according to claim 2, is characterized in that, described media item resource information comprises: source material item, special resource item and entirely mate resource items;
Data after the coding that the described content of multimedia that broadcasting is obtained in digital media server according to matching result or reception digital media server send by HTTP are also play, and comprising:
Digital media player can mate source material item, obtains content of multimedia and play in digital media server; Or,
Digital media player is in the situation that can not mating source material item, can mate special resource item or entirely mate resource items, matching result is sent to digital media server, digital media server carries out HTTP piece coding according to matching result by the data after content of multimedia transcoding, and the data after coding are sent to digital media player by HTTP, digital media player receives the data after coding and plays.
4. method according to claim 1, is characterized in that, described ability to play information is mated with media item resource information, comprising:
Digital media server is sent to Digital Media controller by media item resource information;
Digital Media controller obtains the ability to play information of Digital Media renderer, and described ability to play information is mated with described media item resource information.
5. method according to claim 4, is characterized in that, described media item resource information comprises: source material item, special resource item and entirely mate resource items;
Data after the coding that the described content of multimedia that broadcasting is obtained in digital media server according to matching result or reception digital media server send by HTTP are also play, and comprising:
Digital Media controller can mate source material item, and matching result is sent to Digital Media renderer, and Digital Media renderer obtains content of multimedia and plays in digital media server according to matching result; Or,
Digital Media controller, in the situation that can not mating source material item, can mate special resource item or entirely mate resource items, and matching result is sent to digital media server; Digital media server carries out HTTP piece coding by the data after content of multimedia transcoding, and the data after coding are sent to Digital Media renderer by HTTP, and Digital Media renderer receives the data after coding and plays.
6. according to the method described in claim 3 or 5, it is characterized in that, described special resource item comprises: one or more in TS resource items, MP4 resource items, Local resource item.
7. according to the method described in claim 3 or 5, it is characterized in that, described HTTP piece is encoded to multi-medium data is divided into general data piece and final piece;
Wherein, described general data piece comprises: data block length information, data block extend information, extend information separator, data block data and separator;
Described final piece comprises: data block length information and separator, and length is zero.
8. method according to claim 7, is characterized in that,
Described data block extend information comprises: the decoding time stamp of data block type, data block contents coded system and data block contents; And/or,
Described extend information separator and separator are new line character; And/or,
Described data block length is 4 byte lengths of network bytes order, and each data block length is transmission 2 at most
32-1 byte.
9. the transcoding RTTS based on HTTP under DLNA, is characterized in that, described system comprises:
Digital media server, for sending the media item resource information of multi-medium data, receive the matching result that digital media player or Digital Media controller send, according to matching result, the data after content of multimedia transcoding are carried out to HTTP piece coding, by coding after transfer of data to digital media player or Digital Media renderer;
Digital Media controller, the media item resource information sending for receiving digital media server, the ability to play information of the Digital Media renderer that Bing Jiangcong Digital Media renderer gets is mated with described media item resource information, and matching result is transferred to Digital Media renderer; Also for described matching result is sent to digital media server;
Digital Media renderer, the matching result sending for receiving Digital Media controller, and according to matching result, in digital media server, obtain content of multimedia and play, or, receive from the data after the coding of digital media server and play;
Digital media player, the media item resource information sending for receiving digital media server, and the ability to play information of self is mated with described media item resource information, according to matching result, in digital media server, obtain content of multimedia and play, or, described matching result is sent to described digital media server, receives from the data after the coding of digital media server and play.
10. system according to claim 9, is characterized in that, described digital media server comprises: multimedia content description unit, content of multimedia coding unit and message elements;
Described multimedia content description unit: for content of multimedia being described by numerical digit project declaration language DIDL;
Described content of multimedia coding unit: for the data after content of multimedia transcoding being carried out to HTTP piece coding;
Described message elements: the matching result sending for receiving digital media player or Digital Media controller, according to matching result, the data after content of multimedia transcoding are carried out to HTTP piece coding, the data after coding are sent to digital media player or Digital Media renderer by HTTP.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210346503.5A CN103686202B (en) | 2012-09-18 | 2012-09-18 | Transcoding live transmission method and system based on HTTP under a kind of DLNA |
| US14/428,732 US10051026B2 (en) | 2012-09-18 | 2013-07-01 | Real-time transcode transfer method and system based on HTTP under DLNA |
| EP13790290.4A EP2887676B1 (en) | 2012-09-18 | 2013-07-01 | Real-time transcode transfer method and system based on http under dlna |
| PCT/CN2013/078619 WO2013170811A1 (en) | 2012-09-18 | 2013-07-01 | Real-time transcode transfer method and system based on http under dlna |
| ES13790290T ES2700163T3 (en) | 2012-09-18 | 2013-07-01 | Procedure and real-time transcode transfer system based on HTTP under DLNA |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210346503.5A CN103686202B (en) | 2012-09-18 | 2012-09-18 | Transcoding live transmission method and system based on HTTP under a kind of DLNA |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103686202A true CN103686202A (en) | 2014-03-26 |
| CN103686202B CN103686202B (en) | 2018-06-19 |
Family
ID=49583171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210346503.5A Expired - Fee Related CN103686202B (en) | 2012-09-18 | 2012-09-18 | Transcoding live transmission method and system based on HTTP under a kind of DLNA |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US10051026B2 (en) |
| EP (1) | EP2887676B1 (en) |
| CN (1) | CN103686202B (en) |
| ES (1) | ES2700163T3 (en) |
| WO (1) | WO2013170811A1 (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105142015A (en) * | 2015-09-19 | 2015-12-09 | 北京暴风科技股份有限公司 | Method of sharing and playing BHD file based on DLNA |
| CN105187905A (en) * | 2015-09-19 | 2015-12-23 | 北京暴风科技股份有限公司 | Method for simultaneously downloading and playing P2P video based on DLNA |
| CN105376227A (en) * | 2015-11-06 | 2016-03-02 | 北京中传数广技术有限公司 | Media resource release method based on DLNA protocol, device and system |
| CN105898531A (en) * | 2015-12-07 | 2016-08-24 | 乐视云计算有限公司 | Video cache file packaging method and system |
| CN106790005A (en) * | 2016-12-13 | 2017-05-31 | 武汉市烽视威科技有限公司 | Realize the live system and methods of low delay HLS |
| CN108270740A (en) * | 2016-12-30 | 2018-07-10 | 上海华讯网络系统有限公司 | To the live broadcast system and method for the video conference containing multi-path video stream |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10277646B2 (en) * | 2014-12-19 | 2019-04-30 | Vmware, Inc. | Generating an automated multimedia feed based on virtual IT infrastructure users needs/interest |
| RU2681958C1 (en) | 2015-03-09 | 2019-03-14 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Frame aligned audio encoding |
| US10104416B2 (en) | 2015-05-08 | 2018-10-16 | Vmware, Inc. | Generating an automated multimedia feed based on customer specific application software running on customer data center/cloud |
| CN105704581A (en) * | 2016-01-25 | 2016-06-22 | 互联天下科技发展（深圳）有限公司 | HTTP real-time video transmission method based on MP4 file format |
| CN105812895A (en) * | 2016-03-17 | 2016-07-27 | 张俊莲 | Video on-demand data processing method and system |
| CN110915180B (en) * | 2017-05-16 | 2022-06-28 | 瑞典爱立信有限公司 | Low-latency media ingestion system, apparatus and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1980242A (en) * | 2005-12-05 | 2007-06-13 | 三星电子株式会社 | Method for providing a user interface configured using three frames in a DLNA system |
| CN101056277A (en) * | 2006-04-10 | 2007-10-17 | 三星电子株式会社 | Method for transferring a content in dlna system |
| CN101291324A (en) * | 2007-04-16 | 2008-10-22 | 三星电子株式会社 | Communication method and apparatus using super text transmission protocol |
| KR20110003211A (en) * | 2009-07-03 | 2011-01-11 | 주식회사 케이티 | Home network system for providing contents combined with advertisement and method thereof |
| KR20110003211U (en) * | 2009-09-23 | 2011-03-30 | 주식회사 에스피조인트 | A fixing assembly for hi-low adjustment |
| CN102143385A (en) * | 2011-03-16 | 2011-08-03 | 华为技术有限公司 | Media play processing method, digital media server and system |
| CN102447693A (en) * | 2011-11-02 | 2012-05-09 | 中兴通讯股份有限公司 | Screen sharing method and system for DLNA (Digital Living Network Alliance) terminals in home network |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE602008004573D1 (en) | 2007-09-11 | 2011-02-24 | Nxp Bv | Method for transcoding content, transcoder unit and UPnP network system |
| JP5568576B2 (en) * | 2009-03-03 | 2014-08-06 | テレフオンアクチーボラゲット エル エム エリクソン（パブル） | Media transfer from a server in the second local network to a renderer in the local network |
| US20110035466A1 (en) * | 2009-08-10 | 2011-02-10 | Sling Media Pvt Ltd | Home media aggregator system and method |
| CN102232298B (en) * | 2011-04-07 | 2013-10-09 | 华为技术有限公司 | Method, device and system for transmitting and processing media content |
-
2012
- 2012-09-18 CN CN201210346503.5A patent/CN103686202B/en not_active Expired - Fee Related
-
2013
- 2013-07-01 ES ES13790290T patent/ES2700163T3/en active Active
- 2013-07-01 US US14/428,732 patent/US10051026B2/en active Active
- 2013-07-01 WO PCT/CN2013/078619 patent/WO2013170811A1/en active Application Filing
- 2013-07-01 EP EP13790290.4A patent/EP2887676B1/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1980242A (en) * | 2005-12-05 | 2007-06-13 | 三星电子株式会社 | Method for providing a user interface configured using three frames in a DLNA system |
| CN101056277A (en) * | 2006-04-10 | 2007-10-17 | 三星电子株式会社 | Method for transferring a content in dlna system |
| CN101291324A (en) * | 2007-04-16 | 2008-10-22 | 三星电子株式会社 | Communication method and apparatus using super text transmission protocol |
| KR20110003211A (en) * | 2009-07-03 | 2011-01-11 | 주식회사 케이티 | Home network system for providing contents combined with advertisement and method thereof |
| KR20110003211U (en) * | 2009-09-23 | 2011-03-30 | 주식회사 에스피조인트 | A fixing assembly for hi-low adjustment |
| CN102143385A (en) * | 2011-03-16 | 2011-08-03 | 华为技术有限公司 | Media play processing method, digital media server and system |
| CN102447693A (en) * | 2011-11-02 | 2012-05-09 | 中兴通讯股份有限公司 | Screen sharing method and system for DLNA (Digital Living Network Alliance) terminals in home network |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105142015A (en) * | 2015-09-19 | 2015-12-09 | 北京暴风科技股份有限公司 | Method of sharing and playing BHD file based on DLNA |
| CN105187905A (en) * | 2015-09-19 | 2015-12-23 | 北京暴风科技股份有限公司 | Method for simultaneously downloading and playing P2P video based on DLNA |
| CN105142015B (en) * | 2015-09-19 | 2018-10-09 | 暴风集团股份有限公司 | A method of based on the shared broadcasting BHD files of DLNA |
| CN105376227A (en) * | 2015-11-06 | 2016-03-02 | 北京中传数广技术有限公司 | Media resource release method based on DLNA protocol, device and system |
| CN105376227B (en) * | 2015-11-06 | 2019-02-12 | 北京中传数广技术有限公司 | A kind of media resource method for releasing, apparatus and system based on DLNA agreement |
| CN105898531A (en) * | 2015-12-07 | 2016-08-24 | 乐视云计算有限公司 | Video cache file packaging method and system |
| CN106790005A (en) * | 2016-12-13 | 2017-05-31 | 武汉市烽视威科技有限公司 | Realize the live system and methods of low delay HLS |
| CN106790005B (en) * | 2016-12-13 | 2019-09-17 | 武汉市烽视威科技有限公司 | Realize the system and method for low delay HLS live streaming |
| CN108270740A (en) * | 2016-12-30 | 2018-07-10 | 上海华讯网络系统有限公司 | To the live broadcast system and method for the video conference containing multi-path video stream |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2013170811A1 (en) | 2013-11-21 |
| EP2887676A4 (en) | 2015-10-14 |
| EP2887676B1 (en) | 2018-09-05 |
| US20150237091A1 (en) | 2015-08-20 |
| EP2887676A1 (en) | 2015-06-24 |
| US10051026B2 (en) | 2018-08-14 |
| CN103686202B (en) | 2018-06-19 |
| ES2700163T3 (en) | 2019-02-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103686202A (en) | Real-time transcoding transmitting method and system based on HTTP (Hyper Text Transport Protocol) under DLNA (Digital Living Network Alliance) | |
| CN102143385B (en) | Media play processing method, digital media server and system | |
| CN101895750B (en) | Set-top box and PC-oriented real-time streaming media server and working method | |
| CN106452759B (en) | System and method for effectively supporting short encryption section under prototype pattern | |
| CN1893431B (en) | Content integration system with format and protocol conversion | |
| WO2013152580A1 (en) | Method for converting online media data or playing video and apparatus thereof | |
| US8862766B2 (en) | Customized data delivery and network configuration via aggregation of device attributes | |
| CN103036889A (en) | Self-adapting streaming media displaying method and self-adapting streaming media displaying system | |
| US8607284B2 (en) | Method of outputting video content from a digital media server to a digital media renderer and related media sharing system | |
| KR101771003B1 (en) | Content output system and codec information sharing method thereof | |
| CN103036888A (en) | Self-adapting stream-media play method and self-adapting play unit | |
| CN102075728A (en) | Method and system for sharing audio and/or video data | |
| CN103686434A (en) | Digital television program sharing method, terminal and system | |
| CN103916678A (en) | Multimedia data transcoding method, transcoding device and multimedia data play system | |
| JP7294472B2 (en) | Receiving device and receiving method | |
| CN102404646A (en) | Wireless television live broadcasting system and live broadcasting method thereof | |
| CN101848367B (en) | File-based video live webcasting method | |
| CN103118245A (en) | Real-time audio and video interactive instrumented platform | |
| CN104935952A (en) | Video transcoding method and system | |
| TWI531219B (en) | A method and system for transferring real-time audio/video stream | |
| CN102685599B (en) | TV program interaction system and method | |
| CN103986975B (en) | A kind of gateway device and program transmission method | |
| KR20110117568A (en) | Method and apparatus for transmitting/receiving service discovery information in a multimedia transmission system | |
| CA2801059C (en) | Electronic program guide data encoding method and system | |
| CN108173821A (en) | A kind of live video delivery method, device, server and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180619 Termination date: 20200918 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |