CN103957428A - Streaming media server with multi-code-rate transcoding function based on many-core processor - Google Patents
Streaming media server with multi-code-rate transcoding function based on many-core processor Download PDFInfo
- Publication number
- CN103957428A CN103957428A CN201410209039.4A CN201410209039A CN103957428A CN 103957428 A CN103957428 A CN 103957428A CN 201410209039 A CN201410209039 A CN 201410209039A CN 103957428 A CN103957428 A CN 103957428A
- Authority
- CN
- China
- Prior art keywords
- processor unit
- streaming media
- media server
- many
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005516 engineering process Methods 0.000 claims abstract description 14
- 238000012545 processing Methods 0.000 claims abstract description 8
- 230000003993 interaction Effects 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 description 21
- 230000006870 function Effects 0.000 description 19
- 230000005540 biological transmission Effects 0.000 description 16
- 230000000750 progressive effect Effects 0.000 description 12
- 230000008569 process Effects 0.000 description 9
- 230000006835 compression Effects 0.000 description 8
- 238000007906 compression Methods 0.000 description 8
- 230000008859 change Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000007726 management method Methods 0.000 description 3
- 238000004806 packaging method and process Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- JEOQACOXAOEPLX-WCCKRBBISA-N (2s)-2-amino-5-(diaminomethylideneamino)pentanoic acid;1,3-thiazolidine-4-carboxylic acid Chemical compound OC(=O)C1CSCN1.OC(=O)[C@@H](N)CCCN=C(N)N JEOQACOXAOEPLX-WCCKRBBISA-N 0.000 description 1
- 241000331006 Euchaeta media Species 0.000 description 1
- 241001611138 Isma Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000011330 nucleic acid test Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a streaming media server with a multi-code-rate transcoding function based on a many-core processor. The streaming media server at least comprises a first processor unit and a second processor unit connected with the first processor unit, wherein the first processor unit is used for conducting processing including multi-code-rate transcoding and slicing on video demand source information and/or live source information based on configuration information from the second processor unit and outputting a processing result; the second processor unit is used for providing a live and video demand service based the information output by the first processor unit and the web technology and providing a human-machine interaction interface through which configuration personnel input the configuration information; the requirement for a live or video demand service is met; meanwhile, cloud transcoding with extremely low delay further can be achieved.
Description
Technical Field
The invention relates to the technical field of streaming media, in particular to a streaming media server with a multi-code-rate transcoding function based on a many-core processor.
Background
In the era of increasingly widespread streaming media applications, the streaming media transmission technology has been significantly differentiated: on the one hand, real-time streaming technology represented by RTSP is getting more and more attention from academia and industry, on the other hand, conventional HTTP-based progressive streaming technology is still widely used, and a dynamic HTTP-based transmission technology is distinguished and has a great future trend. The streaming media technology is characterized in that multimedia data is continuously transmitted in a streaming manner in the internet based on an IP protocol in real time. The client plays the received media data in the buffer zone in a downloading and playing mode. The development of streaming media technology relies on the popularization of broadband networks and the development of multimedia compression technology. The streaming media protocol is one of the key technologies for supporting the operation of the streaming media service.
The traditional streaming media protocols mainly have HTTP-based progressive streaming download and RTSP/RTP-based real-time streaming. HTTP is a progressive streaming download, and servers are deployed simply and at a low cost, so that they are still widely used in many video websites. The real-time streaming media protocol represented by RTSP/RTP has high interactivity and adaptability to network bandwidth, and has been a hot spot of research in academia and industry. The ISMA specification supports both of these streaming media transport modes. In recent years, a transport protocol between progressive streaming and real-time streaming has emerged, namely dynamic streaming over HTTP. The method can adapt to the change of network bandwidth like real-time streaming transmission, and has the advantage of HTTP transmission, so that the method is rapidly and widely applied.
Progressive streaming download (progressive download), which is a streaming media mode in which a client requests a web server to download a media file via an HTTP protocol, and plays the media file while downloading. The current major video sharing websites basically adopt the mode. The media file format supporting progressive streaming download has the following characteristics: 1) information about the media data format (video size, compression, audio sampling rate, etc.) appears in the beginning of the file, at least before all the media data, such as audio and video. This information is necessary for decoding the audio-visual data. 2) The audio data and the video data should be stored in an interleaved manner according to a time sequence, so that the audio segments and the video segments with the same time stamps can arrive at the client in a time close to each other, and a player can realize synchronous playing of the audio and video data with minimum buffering and time delay. 3) The time-position index table for the key frame of the media data should appear before the media data. This information is necessary for random positioning (SEEK) during streaming media playing. The ISMA2.0 specification expands the support of the progressive streaming downloading mode on the basis of ISMA1.0, and provides that MP4 is used as a media file format, and the following restrictions are made on the packaging mode of the media file format: 1) the moov box should be placed at the beginning of the file, immediately after the ftyp box. 2) The media data should be entirely self-contained within the content of this document. 3) The media tracks should be stored interleaved, typically for an interleaving distance of 1 second.
The progressive stream downloading adopts a best effort transmission mode, and as long as the transmission rate is higher than the bit rate consumed by the normal playing of the client, the fluency of the playing of the client can be ensured. The client mainly depends on the analysis of the file to complete the playing control of pause, fast forward, positioning and the like. Even if the player presses the pause key, the HTTP link still exists, and the data stream can still be transmitted until the whole file is downloaded or the receiving end buffer is full. Although this will cause waste of bandwidth resources, in poor network conditions, smooth playing can be achieved by prolonging the buffering time [1 ]. In addition, progressive stream downloading has the following advantages: 1) and a special streaming media server does not need to be installed, and a common web server can be used. 2) Based on the HTTP protocol completely, only one 80-port is needed, and most gateways, firewalls and routers can be penetrated. 3) The server cluster is simple to deploy and is easier to realize load balancing. 4) The best-effort transmission mode conforms to the characteristics of the internet.
The real-time streaming protocol is suitable for strong real-time application scenes such as video conferences, remote education, video telephones and the like. The currently widely applied real-time streaming media protocols include real-time streaming protocol RTSP, real-time transport protocol RTP, real-time transport control protocol RTCP, session description protocol SDP, etc., which are a set of protocols defined by IETF for real-time streaming. The RTSP is positioned on protocols such as RTP/RTCP and the like and is responsible for establishing conversation and interaction between the server and the client, the RTP is responsible for packaging data from media files or real-time acquisition into data packets suitable for transmission, and the RTCP is responsible for feeding network conditions collected by the client back to the server so that the latter can adjust a sending strategy in time. ISMA1.0 specifies the use of the MPEG-4 standard as a media encoding format, the RTP/RTCP protocol as a media transport method, the RTSP protocol as a media transport control method, the SDP protocol as a description distribution specification of media, and the MP4 file format as a storage format of media. ISMA2.0 extends the media coding format, using the h.264 video compression standard and the HE-AAC audio compression standard. The RTSP protocol is similar in structure to the HTTP protocol, but the HTTP protocol only maintains a connection required for data transmission once, and the RTSP always maintains a connection between the client and the server and has a changeable state, thereby having strong interactivity. It defines the commands of DESCRIBE, SETUP, PLAY, PAUSE, TEARdown, etc. to control the media, inquire the information of the media, establish the data channel, and support the operations of PAUSE, fast forward, fast backward, positioning, etc. to the media. This is done by the client requesting the server. When the client side suspends playing, a PAUSE instruction is sent to the server, and the server stops sending data. The method avoids the waste of bandwidth in scenes with strong real-time requirements such as video conferences and the like, but is not suitable for weak-interaction and weak-real-time applications such as video on demand and the like.
In the RTP transmission process, the sending end should keep the sending rate of the media stream constantly equal to the playing rate of the receiving end as much as possible, otherwise, the sending end may cause overflow or underflow of data, thereby affecting the fluency of playing. In order to cope with various clients with different receiving rates and computing capacities and severe bandwidth fluctuation, a sending end can adjust the sending rate in time according to the connection speed of a user. The installation, configuration and maintenance of the real-time streaming media server are relatively complicated, and the RTSP/RTP packet types and ports may be blocked by firewalls, NATs and the like in some user networks, resulting in being unusable. In addition, under the condition of a relatively poor network, RTSP often cannot ensure smooth playing of a video.
One of the obvious manifestations appearing in the field of streaming media transmission in recent years is the regression from real-time transport protocols like RTSP/RTP to HTTP transport, which allows streaming media content to be distributed through web servers and easily traverse most network devices like firewalls, proxy servers, routers, etc. Different from the traditional progressive stream downloading mode, the new HTTP streaming media system adopts multi-rate transmission, and allows the client to change the transmission rate at any time according to the network condition and the decoding capability of the client in the playing process. This approach has begun to find application in mainstream video sharing websites. Such current systems include Apple's Live Streaming, Microsoft's IIS Smooth Streaming, Adobe's Dynamic Streaming, and the like, with varying names.
The HTTP Live Streaming protocol is a Streaming media protocol based on HTTP proposed by Apple company, and the basic principle of the HTTP Live Streaming protocol is that a large media file is cut into a series of small (the suggested playing time is about 10 seconds), time-continuous video slice files which can be played independently, and the video slice files are packaged according to the MPEG-2 transport stream format, and ts is used as a suffix name; a playlist index file in M3U format containing multiple video slice file metadata is also created, with a suffix name M3u8, which contains a list of URLs for all video slice files. The client firstly obtains the M3U index file by an external method, such as a browser, and then sequentially requests the URLs of all the slice files according to the indication of the index file, and plays the slices in sequence. The M3U index file is a plain text file that indicates the location of one or more video slice files from which the client player plays and positions the streaming media. The M3U file can index multiple video streams simultaneously to support the transmission of video streams with different bit rates of the same content, and can adapt to different bandwidths, network conditions or client devices. In this case, the server prepares a plurality of code streams encoded at different code rates and qualities for the same program source, and generates a sub-index file for each code stream, the sub-index files being designated by the same main index file. If the network condition of the client device is changed, dynamic switching can be performed between different code streams by searching the index file. This is where the HTTP Live Streaming protocol is fundamentally different from the original progressive Streaming download approach.
In recent years, various streaming media technologies carried by HTTP protocol are receiving more and more attention, and the fundamental reason is that the existing network architecture of Internet itself and its infrastructure are more suitable for HTTP file transmission. The largest traffic on the Internet is various Internet websites based on web servers, and operators at all levels continuously invest in upgrading servers and peripheral devices thereof, such as a CDN (content delivery network), a web cache, and various high-speed storage devices, in order to solve the problem of large traffic generated when large-scale users concurrently access the websites. One trend that has arisen is that the Internet is increasingly supporting the HTTP protocol from a performance standpoint. Streaming media content transmitted using the HTTP protocol, in the same form as a file stored on a web server, naturally benefits from this trend. In contrast, the conventional real-time streaming media system such as RTSP/RTP requires additional installation of its dedicated supporting facilities to obtain the same performance. In addition, HTTP is the most widely used communication protocol on the internet, and various firewalls, routers, proxy servers and the like do not generally block the HTTP.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the present invention is directed to providing a streaming media server with multi-rate transcoding function based on a many-core processor, so as to implement on-demand and live broadcast services based on web technology.
To achieve the above and other related objects, the present invention provides a streaming media server with multi-rate transcoding function based on a many-core processor, which at least includes: the system comprises a first processor unit and a second processor unit connected with the first processor unit; the first processor unit is used for carrying out processing including multi-code rate transcoding and slicing on-demand source information and/or live source information based on the configuration information from the second processor unit and outputting a processing result; the second processor unit is used for providing live broadcast and on-demand service based on the information output by the first processor unit and web technology, and providing a human-computer interaction interface for configuration personnel to input the configuration information.
Preferably, the streaming media server based on a many-core processor and having a multi-rate transcoding function further includes: the network storage equipment is connected with the first processor unit and the second processor unit and is used for storing the on-demand source information, the multi-code-rate transcoded information and the sliced information which are acquired by the first processor unit; more preferably, the network storage device is located locally to the first processor unit and the second processor unit.
Preferably, the streaming media server based on a many-core processor and having a multi-rate transcoding function further includes: and the first processor unit and the second processor unit are respectively connected with the network connection unit through respective network interfaces.
Preferably, the first processor unit comprises: and the micro control unit is used for controlling the multi-code rate transcoding and slicing of the on-demand source information and/or the live source information based on the configuration information.
Preferably, the streaming media server is arranged at an edge position of the content distribution network.
Preferably, the first processor unit transcodes the same information source information with multiple code rates in a parallel manner.
As described above, the streaming media server based on the many-core processor and having the multi-rate transcoding function of the present invention has the following beneficial effects: the transcoding method and the transcoding device can transcode multiple high-definition video sources simultaneously, so that the transcoding time delay is extremely low, a web-based streaming media service can be provided, and the service requirements of live broadcast and on-demand are met.
Drawings
Fig. 1 is a schematic diagram showing the deployment of a streaming media server with a multi-rate transcoding function in a network based on a many-core processor according to the present invention.
Fig. 2 is a schematic diagram of a streaming media server with multi-rate transcoding function based on a many-core processor according to a preferred embodiment of the present invention.
Fig. 3 is another preferred schematic diagram of the streaming media server with multi-rate transcoding function based on a many-core processor according to the present invention.
Fig. 4 is a schematic diagram showing batch transcoding of a streaming media server with a multi-rate transcoding function based on a many-core processor according to the present invention.
FIG. 5 is a schematic diagram of a streaming media server VOD with a multi-rate transcoding function based on a many-core processor according to the present invention.
Fig. 6 is a schematic view showing a live streaming service of a streaming media server with a multi-rate transcoding function based on a many-core processor according to the present invention.
Description of the element reference numerals
1 streaming media server
11 first processor unit
12 second processor unit
13 network connection unit
14 network storage device
Detailed Description
The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure.
Please refer to fig. 1 to 6. It should be understood that the structures, ratios, sizes, and the like shown in the drawings and described in the specification are only used for matching with the disclosure of the specification, so as to be understood and read by those skilled in the art, and are not used to limit the conditions under which the present invention can be implemented, so that the present invention has no technical significance, and any structural modification, ratio relationship change, or size adjustment should still fall within the scope of the present invention without affecting the efficacy and the achievable purpose of the present invention. In addition, the terms "upper", "lower", "left", "right", "middle" and "one" used in the present specification are for clarity of description, and are not intended to limit the scope of the present invention, and the relative relationship between the terms and the terms is not to be construed as a scope of the present invention.
As shown in fig. 1, the present invention provides a streaming media server with multi-rate transcoding function based on a many-core processor. The streaming server is preferably deployed at an edge location of a content distribution system (CDN), and is closer to the user terminal than to the central server in terms of route. Through the configuration deployment similar to the honeycomb cell, the network load of the central server can be greatly reduced, and the dual functions of load balancing and content backup are achieved.
As shown in fig. 2, the streaming media server 1 according to the present invention at least includes: a first processor unit 11 and a second processor unit 12.
The first processor unit 11 is configured to perform processing including multi-rate transcoding and slicing on the on-demand source information and/or the live source information based on the configuration information from the second processor unit 12, and output a processing result.
Preferably, the hardware of the first processor unit 11 may include: a Tilera8036 chip disposed on the motherboard of the ACTA architecture, the Tilera8036 chip having an independent memory space and being configured with a network interface, such as an XAUI interface; the software part of the first processor unit 11 may comprise: video transcoder, file splitter, HTTP download module, etc., as shown in fig. 3:
1) a video transcoder: the method is operated in a command line mode, firstly, on-demand source information or live source information is analyzed to generate audio streams and video streams, then audio transcoding and video transcoding are respectively performed, finally, packaging and outputting are performed according to an MP4 file format, and offline transcoding is responsible for transcoding local video files to generate MP4 files with different specifications. Each video transcoder process supports single-channel input and multi-channel output, and adopts a full-decoding full-coding pixel level transcoding mode to decode a single file stored in the local, and then perform multi-channel coding on a decoding result according to different configuration parameters. Therefore, for the multi-output specification, only one decoding is carried out, so that the calculated amount is saved, and the on-demand source information and/or the live source information are converted into MP4 files with various specifications, namely:
off-line transcoding, transcoding the local video file, generating MP4 files of different specifications.
Real-time transcoding, comprising three parts, RTSP/RTP front-end, transcoding and slicing, responsible for obtaining live source information from the live source device through XAUI interface and transcoding the live source information, generating, updating and deleting M3U index file and MP4 slice in real-time.
The command line format of the video transcoder is:
2) file divider: operating in a command line manner, MP4 file slices are made, generating an M3U index file and an MP4 slice file.
The command line format of the file splitter is:
3) HTTP download: operating in a command line fashion, on-demand source information is downloaded from a remote web host to the local via the XAUI interface.
The command line format is:
preferably, the first processor unit 11 further comprises: a Micro Control Unit (MCU) as shown in fig. 3.
The MCU is configured to control multi-rate transcoding and slicing of on-demand source information and/or live source information based on the configuration information from the second processor unit 12.
Specifically, the MCU is in a waiting state at ordinary times, monitors a control instruction in the configuration information received on the interface where the first processor unit 11 is connected to the second processor unit 11, and schedules the video transcoder to execute a corresponding operation according to the control instruction. Wherein the control instructions include:
-initiating off-line multi-rate transcoding
-terminating off-line multi-rate transcoding
-initiating live multi-rate transcoding
-terminating live multi-rate transcoding
All the control instructions can be transmitted and executed in parallel and in a crossed manner, that is, the control instruction MCU can receive and execute new control instructions in the process of executing any one control instruction.
The second processor unit 12 is connected to the first processor unit 11, and is configured to provide live broadcast and on-demand services based on the information output by the first processor unit 11 and web technologies, and provide a human-computer interaction interface for a configurator to input the configuration information.
Preferably, the hardware of the second processor unit 12 may include: a Tilera8036 chip disposed on the motherboard of the ACTA architecture, the Tilera8036 chip having an independent memory space and being configured with a network interface, such as an XAUI interface; the software portion of the second processor unit 12 may include: a WEB server software module and a management configuration service software module based on WEB pages, as shown in fig. 3, wherein,
1) a WEB server software module: the system is used for video on demand and live broadcast;
2) a management configuration service software module based on WEB pages: for providing a human-machine interaction interface.
Preferably, the streaming server 1 further includes: a network connection unit 13. The network connection unit 13 serves as a connection medium for the first processor unit 11 and the second processor unit 12, and connects respective network interfaces, for example, XAUI interfaces, of the first processor unit 11 and the second processor unit 12, as shown in fig. 3.
Preferably, the streaming server 1 further includes: a network storage device 14.
The network storage device 14 is configured to store information, for example, on-demand source information downloaded by an HTTP download module in the first processor unit 11, a transcoded file after multi-rate transcoding of a video transcoder, a slice file after splitting by the file splitter, and index information of each slice file, and the first processor unit 11 and the second processor unit 12 are connected to the network storage device 14 through their XAUI interfaces.
More preferably, the Network Storage device 14 is disposed locally in the first processor unit 11 and the second processor unit 12, and may be a Storage device based on NAS (Network Attached Storage), a Storage device based on IP-SAN (Storage Area Network), or the like.
The following will describe three basic applications supported by the streaming media server:
firstly, the method comprises the following steps: bulk transcoding of video files
Batch transcoding of on-demand source information (i.e. video files available for on-demand) the purpose of transcoding is to generate video streaming media files of various specifications suitable for on-demand for slicing operation, as shown in fig. 4. Firstly, an administrator issues a batch video transcoding instruction through a human-computer interaction interface, a video transcoder performs batch transcoding operation on a plurality of specified source files, stores the source files in local network storage equipment after the batch transcoding operation is completed, and returns URL addresses corresponding to the transcoded files. The local storage adopts network storage equipment based on NAS or IP-SAN and the like. Wherein the first processor unit is responsible for transcoding the video files available for on-demand.
In the application scene, the streaming media server is equivalent to a transcoding engine serving the whole network, and the transcoding process is completed at the cloud.
Second, WEB-based video on demand
For WEB-based video on demand, as shown in fig. 5, the transcoded video file is stored on the network storage device 14 in a slicing manner, and a network index file generated in the transcoding and slicing processes also exists. The second processor unit 12 provides WEB services, and when a user equipment requests a certain video content, the WEB server software module in the second processor unit 12 obtains a corresponding slice file from the network storage device 14 and then sends the slice file to the user equipment.
In the application scenario, the streaming media service is converted into the traditional web service, so that greater flexibility and higher efficiency can be obtained. Since the first processor unit 11 generates a plurality of grades of data streams according to the configuration information during the transcoding process, when the network condition of the user equipment changes, the user equipment adaptively requests to switch to a file with a proper code rate, thereby ensuring smooth playing with optimal quality.
Real-time transcoding of streaming media live content based on HTTP
The live streaming media requires real-time transcoding at the same time, and the process requires the first processor unit 11 and the second processor unit 12 to work simultaneously and cooperate with each other to complete live streaming services together. In this process, the first processor unit 11 requests the live source information from the live source device through RTSP/RTP or other streaming media protocols, then unpacks and transcodes the received live source information (i.e. media content, usually in compression format Mpeg2, resolution 1080p, bitrate 30fps), and then format-converts and transcodes the media content according to the configuration information of the administrator (including compression format, image resolution, bitrate, audio sampling rate, etc.), for example, converts the media file in compression format Mpeg2, resolution 1080p, bitrate 30fps into audio/video streams in compression format Mpeg2, resolution 1080p, bitrate 30fps, (h.264, D1, 30fps), and (h.263, QCIF, 15fps), and then packs the transcoded audio/video stream segments, where the format may be TS, MP4, FLV, etc., and outputs an index file and a plurality of continuous multimedia file slices, each slice is 2 to 10 seconds in length. In the live broadcast process, the slice file is continuously generated in real time, and the index file is continuously changed. The generated file is stored on the network storage device 14. When the user equipment requests to watch the live program, the WEB service software module of the second processor unit 12 reads a slice file suitable for the code rate of the user equipment and sends the slice file to the user equipment; when the network condition of the user equipment changes, the user equipment adaptively requests to switch to a file with a proper code rate, so that the smooth playing with the best quality is ensured.
In such an application scenario, the streaming server performs real-time transcoding and slicing as a live server while performing relay transmission of a video stream, as shown in fig. 6. The sliced streaming media file is forwarded by relying on the WEB service software module of the second processor unit 12.
In summary, the streaming media server with multi-code rate transcoding function based on the many-core processor of the present invention employs the first processor unit to complete the following functions:
1) downloading a video file in an HTTP mode, and storing the video file to local network storage equipment;
2) performing multi-code rate transcoding on the video file in the local network storage equipment, and storing the transcoded video file in the local network storage equipment;
3) dividing the transcoded video file in the local network storage equipment to generate an index file and a slice file, and still storing the index file and the slice file in the local network storage equipment;
4) real-time transcoding during live broadcasting, namely receiving live broadcast data in an RTSP/RTP mode, simultaneously performing multi-code-rate transcoding and slicing to generate a real-time index file and a slice file, and storing the real-time index file and the slice file in local network storage equipment;
5) the micro control unit is responsible for communicating with the second processor unit and scheduling the video transcoder;
employing a second processor unit to perform the following functions:
1) high performance WEB services; the method comprises video on demand service, data stream forwarding during video live broadcasting and the like;
2) the method comprises the steps that a management configuration service based on a WEB page is used for configuring transcoding parameters, communicating with a first processor unit through an XAUI interface and a network connection unit and transmitting control commands (namely CMD commands);
because the multi-core processor based on the MESH architecture is adopted to realize the functions of the first processor unit and the second processor unit, the main board adopts an ATCA architecture, two tilera8036 chips are adopted as the first processor unit and the second processor unit, the first processor unit and the second processor unit respectively have independent memory spaces (without memory sharing), are mutually connected through an XAUI interface and a network connection unit, and externally provide the highest network speed of 10Gb through the network connection unit, compared with the traditional X86 architecture, the power consumption is low; moreover, because the hardware mainboard is not provided with a hard disk or other large-capacity storage devices, the two tilera8036 chips are respectively connected with network storage devices such as NAS or IP-SAN through a XAUI interface of 10Gbps, thereby obtaining a storage space which can be almost infinitely expanded, improving the read-write efficiency of the disk and avoiding the overhead brought by directly transmitting data between processor units; in addition, the first processor unit also skillfully utilizes the characteristic of slicing, so that transcoding, slicing and web service of the streaming media live stream are all performed on the network storage device, thereby reducing the design difficulty and improving the system efficiency; furthermore, web services are based on the HTTP protocol and may not be blocked by any gateways and firewalls. Moreover, for on-demand or live broadcasting, the first processor unit provides multi-code rate transcoding, and dynamic code rate switching of the client can be realized, so that the method is adaptive to network condition change of user equipment. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. The streaming media server based on the many-core processor and having the multi-code rate transcoding function is characterized by at least comprising the following components: the system comprises a first processor unit and a second processor unit connected with the first processor unit; wherein,
the first processor unit is used for carrying out processing including multi-code rate transcoding and slicing on-demand source information and/or live source information based on the configuration information from the second processor unit and outputting a processing result;
the second processor unit is used for providing live broadcast and on-demand service based on the information output by the first processor unit and web technology, and providing a human-computer interaction interface for configuration personnel to input the configuration information.
2. The streaming media server with multi-rate transcoding function based on a many-core processor according to claim 1, further comprising: and the network storage equipment is connected with the first processor unit and the second processor unit and is used for storing the on-demand source information, the multi-code-rate transcoded information and the sliced information which are acquired by the first processor unit.
3. The streaming media server based on a many-core processor and having multi-rate transcoding function of claim 2, wherein: the network storage device is disposed locally to the first processor unit and the second processor unit.
4. The streaming media server based on a many-core processor and having multi-rate transcoding function according to claim 2 or 3, wherein: the first processor unit and the second processor unit are connected to the network storage device via respective XAUI interfaces.
5. The streaming media server with multi-rate transcoding function based on a many-core processor according to claim 1, further comprising: and the first processor unit and the second processor unit are respectively connected with the network connection unit through respective network interfaces.
6. The streaming media server based on a many-core processor and having multi-rate transcoding function according to claim 1 or 5, wherein: the first processor unit includes: and the micro control unit is used for controlling the multi-code rate transcoding and slicing of the on-demand source information and/or the live source information based on the configuration information.
7. The streaming media server based on a many-core processor and having multi-rate transcoding function of claim 1, wherein: the streaming media server is arranged at an edge position of the content distribution network.
8. The streaming media server based on a many-core processor and having multi-rate transcoding function of claim 1, wherein: and the first processor unit carries out multi-code rate transcoding on the same information source information in a parallel mode.
9. The streaming media server based on a many-core processor and having multi-rate transcoding function of claim 1, wherein: the first processor unit obtains on-demand source information and/or live source information via the XAUI interface.
10. The streaming media server based on a many-core processor and having multi-rate transcoding function of claim 1, wherein: the second processor unit provides live and on-demand services via the XAUI interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410209039.4A CN103957428A (en) | 2014-05-16 | 2014-05-16 | Streaming media server with multi-code-rate transcoding function based on many-core processor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410209039.4A CN103957428A (en) | 2014-05-16 | 2014-05-16 | Streaming media server with multi-code-rate transcoding function based on many-core processor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103957428A true CN103957428A (en) | 2014-07-30 |
Family
ID=51334636
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410209039.4A Pending CN103957428A (en) | 2014-05-16 | 2014-05-16 | Streaming media server with multi-code-rate transcoding function based on many-core processor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103957428A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104717507A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Video transcoding method and device |
| CN104780389A (en) * | 2015-04-21 | 2015-07-15 | 无锡天脉聚源传媒科技有限公司 | Video processing method and device |
| CN104935955A (en) * | 2015-05-29 | 2015-09-23 | 腾讯科技（北京）有限公司 | Live video stream transmission method, device and system |
| CN105227547A (en) * | 2015-09-09 | 2016-01-06 | 重庆邮电大学 | A kind of flow media flux generation systems based on many core platforms |
| CN105992016A (en) * | 2015-02-05 | 2016-10-05 | 天脉聚源（北京）科技有限公司 | HLS on-line transcoding method and system |
| CN106210760A (en) * | 2016-06-24 | 2016-12-07 | 杭州迪普科技有限公司 | The caching method of streaming media resource and device |
| CN106488263A (en) * | 2016-10-24 | 2017-03-08 | 北京小米移动软件有限公司 | Push the method and device of live broadcast stream media data |
| WO2017166499A1 (en) * | 2016-03-30 | 2017-10-05 | 乐视控股（北京）有限公司 | Live broadcast delay method and device |
| CN108024125A (en) * | 2017-11-03 | 2018-05-11 | 青岛海信电器股份有限公司 | A kind of audio, video data playback method and server and client side |
| CN108989426A (en) * | 2018-07-17 | 2018-12-11 | 深圳市网心科技有限公司 | Drawing stream method, system and client and storage medium based on HLS protocol |
| CN109525857A (en) * | 2018-12-06 | 2019-03-26 | 武汉微梦文化科技有限公司 | A kind of method for processing video frequency |
| CN109600574A (en) * | 2017-09-30 | 2019-04-09 | 上海宝信软件股份有限公司 | It is a kind of based on hardware-accelerated mobile flow medium gateway system |
| CN109698928A (en) * | 2018-11-15 | 2019-04-30 | 贵阳朗玛信息技术股份有限公司 | The method and device of video flowing in a kind of adjusting video conferencing system |
| CN110324658A (en) * | 2018-03-28 | 2019-10-11 | 优酷网络技术（北京）有限公司 | Method for processing video frequency and device |
| CN110557686A (en) * | 2019-09-27 | 2019-12-10 | 四川九州电子科技股份有限公司 | System and method for realizing playing satellite low-bit-rate live broadcast program by mobile terminal |
| CN111479134A (en) * | 2020-04-02 | 2020-07-31 | 亦非云互联网技术（上海）有限公司 | Distributed cloud transcoding method, system and server |
| CN116010437A (en) * | 2023-03-20 | 2023-04-25 | 成都佰维存储科技有限公司 | Device code writing method and device, readable storage medium and electronic device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008013484A1 (en) * | 2006-07-25 | 2008-01-31 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and device for stream adaptation |
| CN101459848A (en) * | 2008-12-26 | 2009-06-17 | 西安交通大学 | Distributed multi-format digital video transcoding construction design method |
| CN101895750A (en) * | 2010-07-13 | 2010-11-24 | 上海未来宽带技术及应用工程研究中心有限公司 | Set-top box and PC-oriented real-time streaming media server and working method |
| CN102088623A (en) * | 2011-01-18 | 2011-06-08 | 乐视网信息技术（北京）股份有限公司 | Downloading and dispatching system and method for adaptive network |
| CN103379362A (en) * | 2012-04-24 | 2013-10-30 | 腾讯科技（深圳）有限公司 | Video-on-demand method and system |
-
2014
- 2014-05-16 CN CN201410209039.4A patent/CN103957428A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008013484A1 (en) * | 2006-07-25 | 2008-01-31 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and device for stream adaptation |
| CN101459848A (en) * | 2008-12-26 | 2009-06-17 | 西安交通大学 | Distributed multi-format digital video transcoding construction design method |
| CN101895750A (en) * | 2010-07-13 | 2010-11-24 | 上海未来宽带技术及应用工程研究中心有限公司 | Set-top box and PC-oriented real-time streaming media server and working method |
| CN102088623A (en) * | 2011-01-18 | 2011-06-08 | 乐视网信息技术（北京）股份有限公司 | Downloading and dispatching system and method for adaptive network |
| CN103379362A (en) * | 2012-04-24 | 2013-10-30 | 腾讯科技（深圳）有限公司 | Video-on-demand method and system |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105992016A (en) * | 2015-02-05 | 2016-10-05 | 天脉聚源（北京）科技有限公司 | HLS on-line transcoding method and system |
| CN104717507A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Video transcoding method and device |
| CN104780389A (en) * | 2015-04-21 | 2015-07-15 | 无锡天脉聚源传媒科技有限公司 | Video processing method and device |
| CN104780389B (en) * | 2015-04-21 | 2018-01-05 | 无锡天脉聚源传媒科技有限公司 | A kind of method for processing video frequency and device |
| CN104935955A (en) * | 2015-05-29 | 2015-09-23 | 腾讯科技（北京）有限公司 | Live video stream transmission method, device and system |
| CN104935955B (en) * | 2015-05-29 | 2019-01-25 | 腾讯科技（北京）有限公司 | A kind of methods, devices and systems transmitting live video stream |
| CN105227547B (en) * | 2015-09-09 | 2018-10-12 | 重庆邮电大学 | A kind of flow media flux generating system based on many-core platform |
| CN105227547A (en) * | 2015-09-09 | 2016-01-06 | 重庆邮电大学 | A kind of flow media flux generation systems based on many core platforms |
| WO2017166499A1 (en) * | 2016-03-30 | 2017-10-05 | 乐视控股（北京）有限公司 | Live broadcast delay method and device |
| CN106210760A (en) * | 2016-06-24 | 2016-12-07 | 杭州迪普科技有限公司 | The caching method of streaming media resource and device |
| CN106488263A (en) * | 2016-10-24 | 2017-03-08 | 北京小米移动软件有限公司 | Push the method and device of live broadcast stream media data |
| CN109600574A (en) * | 2017-09-30 | 2019-04-09 | 上海宝信软件股份有限公司 | It is a kind of based on hardware-accelerated mobile flow medium gateway system |
| CN108024125A (en) * | 2017-11-03 | 2018-05-11 | 青岛海信电器股份有限公司 | A kind of audio, video data playback method and server and client side |
| WO2019085243A1 (en) * | 2017-11-03 | 2019-05-09 | 青岛海信电器股份有限公司 | Audio and video data playback method and server and client terminal |
| CN110324658A (en) * | 2018-03-28 | 2019-10-11 | 优酷网络技术（北京）有限公司 | Method for processing video frequency and device |
| CN108989426A (en) * | 2018-07-17 | 2018-12-11 | 深圳市网心科技有限公司 | Drawing stream method, system and client and storage medium based on HLS protocol |
| CN108989426B (en) * | 2018-07-17 | 2021-04-06 | 深圳市网心科技有限公司 | HLS protocol-based stream pulling method, system, client and storage medium |
| CN109698928A (en) * | 2018-11-15 | 2019-04-30 | 贵阳朗玛信息技术股份有限公司 | The method and device of video flowing in a kind of adjusting video conferencing system |
| CN109698928B (en) * | 2018-11-15 | 2021-04-13 | 贵阳朗玛信息技术股份有限公司 | Method and device for adjusting video stream in video conference system |
| CN109525857A (en) * | 2018-12-06 | 2019-03-26 | 武汉微梦文化科技有限公司 | A kind of method for processing video frequency |
| CN110557686A (en) * | 2019-09-27 | 2019-12-10 | 四川九州电子科技股份有限公司 | System and method for realizing playing satellite low-bit-rate live broadcast program by mobile terminal |
| CN111479134A (en) * | 2020-04-02 | 2020-07-31 | 亦非云互联网技术（上海）有限公司 | Distributed cloud transcoding method, system and server |
| CN116010437A (en) * | 2023-03-20 | 2023-04-25 | 成都佰维存储科技有限公司 | Device code writing method and device, readable storage medium and electronic device |
| CN116010437B (en) * | 2023-03-20 | 2023-12-19 | 成都佰维存储科技有限公司 | Device code writing method and device, readable storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103957428A (en) | Streaming media server with multi-code-rate transcoding function based on many-core processor | |
| Kesavan et al. | An investigation on adaptive HTTP media streaming Quality-of-Experience (QoE) and agility using cloud media services | |
| EP3000215B1 (en) | Live media processing and streaming service | |
| Sodagar | The mpeg-dash standard for multimedia streaming over the internet | |
| US10924781B2 (en) | Method and system for real-time transcoding of MPEG-DASH on-demand media segments while in transit from content host to dash client | |
| US8874778B2 (en) | Live streaming media delivery for mobile audiences | |
| KR101983432B1 (en) | Devices, systems, and methods for converting or translating dynamic adaptive streaming over http(dash) to http live streaming(hls) | |
| US20100312828A1 (en) | Server-controlled download of streaming media files | |
| US9374410B2 (en) | System and method for seamless switchover between unicast and multicast sources of over-the-top streams | |
| US9565225B2 (en) | Server configuration including stream preview | |
| US20150256600A1 (en) | Systems and methods for media format substitution | |
| CN114365503A (en) | Live media content delivery system and method | |
| WO2010134984A1 (en) | Methods and systems for delivering media to client device | |
| CA2844648A1 (en) | Method and apparatus for adaptive transcoding of multimedia stream | |
| CN102131106A (en) | Method, device and system for playing streaming media contents | |
| RU2656093C2 (en) | Content supply device, content supply method, program, terminal device and content supply system | |
| EP2773078B1 (en) | Method, system and devices for multimedia content delivery using adaptive streaming | |
| US20160373496A1 (en) | Content supply device, content supply method, program, terminal device, and content supply system | |
| US20160219311A1 (en) | Transmission apparatus, transmitting method, reception apparatus, and receiving method | |
| US20240155019A1 (en) | Synchronizing independent media and data streams using media stream synchronization points | |
| US20170155968A1 (en) | Content supply apparatus, content supply method, program terminal apparatus, and content supply system | |
| WO2019193991A1 (en) | Distribution device, distribution method and program | |
| CN106792216B (en) | Streaming media reading method in distributed file system and server | |
| Li et al. | Internet multimedia content distribution | |
| Sodagar | Industry and standards |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140730 |
|
| RJ01 | Rejection of invention patent application after publication |