CN105163204A - Real-time streaming media file slicing system and method - Google Patents
Real-time streaming media file slicing system and method Download PDFInfo
- Publication number
- CN105163204A CN105163204A CN201510540681.5A CN201510540681A CN105163204A CN 105163204 A CN105163204 A CN 105163204A CN 201510540681 A CN201510540681 A CN 201510540681A CN 105163204 A CN105163204 A CN 105163204A
- Authority
- CN
- China
- Prior art keywords
- data
- program
- pcie board
- pcie
- slice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a real-time streaming media file slicing system and method. The system comprises: a content server for receiving configuration information sent by a network video server, and carrying out corresponding configuration according to the configuration information so that program data output corresponds to network port numbers one to one, and meanwhile, receiving an input signal, processing the input signal and sending the program data obtained through processing to a PCIe board card; the PCIe board card for receiving the program data sent by the content server, slicing the received program data in real time and saving the obtained sliced program data in the internal memory chip of the PCIe board card; and the network video server provided with a disk array and used for sending the corresponding configuration information to the content server, reading the sliced program data from the PCIe board card via the PCIe interface of the PCIe board card, judging whether the sliced program data is valid, and if so, saving the sliced data in the disk array. The real-time streaming media file slicing system has the advantages of good concurrency, high slicing processing response speed, high stability and the like.
Description
Technical field
The present invention relates to streaming media playing field, particularly relate to the real-time slice systems of a kind of files in stream media and method.
Background technology
Along with the fast development of network technology, various video website emerges in an endless stream, no matter be internet video live broadcasting, program request or time shift, fluency and the requirement of real-time of streaming media broadcasting are more and more higher, and precision and the requirement of real-time of corresponding streaming media section are also more and more higher.Therefore, streaming media carries out cutting into slices and transmit the basic demand just become video website fast and accurately.
But the following problem of network video server ubiquity of existing video website:
1, concurrency is poor.Existing network video server is all based on windows software platform, during playing stream media file, every programs all need one independently thread process, but due to the restriction of processor (CPU), receiving thread is made to be generally that order is carried out, even if consider that processor can support multi-thread concurrent work, can the quantity of thread of concurrent efforts also be conditional.
2, time delay and packet loss serious.Due to by software receipt program data for CPU be order perform, therefore CPU can only could receive other program after receiving a programs, when needing when there being programs up to a hundred to receive, all programs all receive the time that one time at least needs up to a hundred milliseconds, programme televised live playout-delay can be caused, and program data packet loss problem.
3, system resource takies greatly.During receiving, the program data (or program section) of meeting buffer memory certain length in internal memory, in general, the bandwidth of SD program is generally 6-8Mbps, if the program data of buffer memory 2s duration, the spatial cache that then every programs needs is about 1.5MBytes, and (6Mbps*2s/8) – 2MBytes (8Mbps*2s/8), the spatial cache that so 100 programs need is then 150MB-200MB, takies the memory headroom that server is a large amount of.In addition, received by software simulating program data, need to take a large amount of cpu resources always, CPU is required it is also very high.
Summary of the invention
Object of the present invention is exactly to solve the problem, and provides the real-time slice systems of a kind of files in stream media and method, and it has, and concurrency is good, process section response is quick, stability advantages of higher.
To achieve these goals, the present invention adopts following technical scheme:
The real-time slice systems of a kind of files in stream media, comprising:
Content server, is connected with network video server by network, receives the configuration information that network video server is sent, configures accordingly according to configuration information, makes program data and the network terminal slogan port one_to_one corresponding of output; Receive input signal simultaneously, input signal is processed, and send to PCIe board by processing the program data obtained;
PCIe board, is connected with described content server by network, receives the program data that content server is sent, cuts into slices in real time, and be stored in the memory chip of PCIe board by the program slice of data obtained to the program data received;
Network video server, be provided with disk array, corresponding configuration information is sent to content server, and from PCIe board, read program slice of data by the PCIe interface of PCIe board, judge that whether program slice of data is effective, if effectively, then programs stored slice of data is to disk array, otherwise, do not store.
Described PCIe board comprises fpga chip, and fpga chip is bi-directionally connected with FLASH chip, memory chip, network interface and PCIe interface respectively; Wherein, fpga chip is cut into slices in real time to receiving program data, and is stored in memory chip by the slice of data obtained.
Described memory chip is DRR3.
Described fpga chip inside is provided with PCIe buffer memory, for the slice of data that buffer memory reads from memory chip.
The real-time dicing method of a kind of files in stream media, comprises the steps:
S1: network video server sends program configuration information to content server;
S2: content server program receiving configuration information is also configured according to program configuration information, receives input signal;
S3: content server is resolved input signal, obtains every programs data, every programs data is packaged into network packet respectively, and the network packet of every programs is sent to PCIe board respectively by the different network ports;
The network packet that S4:PCIe board reception content server is sent also is resolved, and obtains every programs data;
S5:PCIe board is cut into slices to every programs data, and is kept at by program slice of data in the memory chip of PCIe board;
S6: network video server reads the program slice of data of program and is stored in disk array from PCIe board.
Described network packet is UDP message bag.
Described PCIe board uses the system clock of fpga chip to cut into slices in real time to every programs data concurrently.
Also comprise before described step S4:
S4-0:PCIe board obtains section configuration information from the FLASH chip of described network video server or PCIe board, and carries out corresponding configuration according to section configuration information.
Described step S6 is further:
S6-1: network video server sends read data order to PCIe board;
The fpga chip of S6-2:PCIe board reads program slice of data from memory chip, and is stored in PCIe buffer memory;
S6-3: network video server reads program slice of data from the PCIe buffer memory of PCIe board, and judge whether program slice of data is valid data; If valid data, then perform step S6-4; Otherwise, if not valid data, then point out error message;
S6-4: be stored in disk array by program slice of data, forwards step S6-2 to and continues to perform.
Described step S6 further comprises: network video server judges whether to receive and suspends section order, suspends section order if receive, then send to PCIe board and stop section order, PCIe board stops section.
Beneficial effect of the present invention:
The present invention adopts PCIe board hardware, the system clock of Based PC Ie board, carries out concurrent reception and section, both solved the shortcoming of prior art concurrency difference to many cover single-unit order stream, also compensate for time delay and the serious defect of packet loss.In addition, because section work is by PCIe board hardware implementing, do not need network video server to participate in, the memory headroom that releasing network video server is a large amount of and cpu resource, greatly reduce network video server pressure.
Accompanying drawing explanation
Fig. 1 is the real-time slice systems structural representation of files in stream media of the present invention;
Fig. 2 is PCIe board structure schematic diagram of the present invention;
Fig. 3 is the real-time dicing method schematic flow sheet of files in stream media of the present invention;
Fig. 4 is that network video server of the present invention reads program slice of data flow chart from PCIe board;
Fig. 5 is that program slice of data of the present invention deposits schematic diagram in memory chip.
Embodiment
Below in conjunction with accompanying drawing and embodiment, the invention will be further described.
As shown in Figure 1, the real-time slice systems of a kind of files in stream media, comprising:
Content server, is connected with network video server by network, receives the configuration information that network video server is sent, configures accordingly according to configuration information, makes single program stream and network terminal slogan (port) one_to_one corresponding of output; Receive input signal simultaneously, input signal is processed, and send to PCIe board by processing the single program stream obtained;
PCIe board, is connected with described content server by network, receives the program data that content server is sent, cuts into slices in real time, and be stored in memory chip by the slice of data obtained to the program data received;
Network video server, is provided with disk array, sends corresponding configuration information to content server, and from PCIe board, read program slice of data by PCIe interface, judge that whether slice of data is effective, if effectively, then store slice of data to disk array, otherwise, do not store.
Described content server is for having ASI (AsynchronousSerialInterface, Asynchronous Serial Interface) equipment of interface, receive ASI input signal, demultiplexing is carried out to input signal, obtain program data, and program data is packaged into network packet, then send to PCIe board by the network terminal slogan of setting.
Described content server is PC, reads program data, then program data is packaged into network packet from internal disk, then sends to PCIe board by the network terminal slogan of setting.Program data in described internal disk is that PC obtains from external input signal and is stored in advance in disk.
As shown in Figure 2, PCIe board comprises fpga chip, and fpga chip is bi-directionally connected respectively at FLASH chip, memory chip, network interface and PCIe interface; Wherein, fpga chip is cut into slices in real time to receiving program data, and is stored in memory chip by the slice of data obtained.
Described memory chip is DRR3, for programs stored slice of data.Memory chip is the vitals of PCIe board, adopts DDR3, mainly because of DDR3 read or write speed quickly.DDR3 chip mainly contains the models such as DDR3-800, DDR3-1066, DDR3-1333, DDR3-1600 at present, and for the DDR3-800 of minimum frequency, its Peak bit rate is 6400MB/s.The section duration of every programs calculates according to 2s, and the slice size of a set of SD program is about 2MByte, and DDR3 reads this section only needs 312.5ns.
Described fpga chip inside is provided with PCIe buffer memory, for the slice of data that buffer memory reads from memory chip.
Described FLASH chip stores section configuration information, and PCIe board receives single program stream data by network interface from different network terminal slogans (port) according to section configuration information.
Described network interface is kilomega optic fiber network interface.
As shown in Figure 3, the real-time dicing method of a kind of files in stream media, comprises the steps:
S1: network video server sends program configuration information to content server;
S2: content server program receiving configuration information is also configured according to program configuration information, receives input signal;
S3: content server is resolved input signal, obtains every programs data, every programs data is packaged into network packet respectively, and the network packet of every programs is sent to PCIe board respectively by the different network ports;
The network packet that S4:PCIe board reception content server is sent also is resolved, and obtains every programs data;
S5:PCIe board is cut into slices to every programs data, and is kept at by slice of data in the memory chip of PCIe board;
S6: network video server reads the slice of data of program and is stored in disk array from PCIe board.
Described program configuration information at least comprises every programs and network terminal slogan one-to-one relationship, makes every programs data send to PCIe board from the network port of specifying respectively.Such as program 1 map network port numbers port10011, program 2 map network port numbers prot10012,
Described network packet is UDP message bag, and network packet is sent to PCIe equipment by udp protocol by content server.
Described PCIe board uses FPGA system clock to cut into slices in real time to every programs data concurrently.
Also comprise before described step S4: PCIe board obtains section configuration information from the FLASH chip of described network video server or PCIe board, and carry out corresponding configuration according to section configuration information.
As shown in Figure 4, described step S6 network video server reads slice of data and comprises the steps: further from PCIe board
S6-1: network video server sends read data order to PCIe board;
The fpga chip of S6-2:PCIe board reads program slice of data from memory chip, and in the PCIe buffer memory deposited;
S6-3: network video server reads program slice of data from the PCIe buffer memory of PCIe board, and judge whether program slice of data is valid data; If valid data, then perform step S6-4; Otherwise, if not valid data, then point out error message;
S6-4: be stored in disk array by program slice of data, forwards step S6-2 to and continues to perform.
Described step S6 further comprises: network video server judges whether to receive and suspends section order, suspends section order if receive, then send to PCIe board and stop section order, PCIe board stops section.
As shown in Figure 5, when program slice of data is deposited in PCIe board memory chip, every programs deposits one section of slice of data.The section supposing every programs stream is 2s, distribute to the section 2MBytes space of every programs, corresponding network terminal slogan is postponed from port10011, so, program 1 map network port numbers port10011, the deposit position in memory chip is 0 ~ 2MBytes; Program 2 map network port numbers port10012, deposit position in memory chip is 2 ~ 4Mbytes, the network terminal slogan that program 3 ~ n is corresponding and in memory chip memory location can the rest may be inferred, program n map network port numbers is port (10010+n), and the deposit position in memory chip is 2* (n-1) ~ 2*nMbytes.
By reference to the accompanying drawings the specific embodiment of the present invention is described although above-mentioned; but not limiting the scope of the invention; one of ordinary skill in the art should be understood that; on the basis of technical scheme of the present invention, those skilled in the art do not need to pay various amendment or distortion that creative work can make still within protection scope of the present invention.
Claims (10)
1. the real-time slice systems of files in stream media, is characterized in that, comprising:
Content server, is connected with network video server by network, receives the configuration information that network video server is sent, configures accordingly according to configuration information, makes program data and the network terminal slogan port one_to_one corresponding of output; Receive input signal simultaneously, input signal is processed, and send to PCIe board by processing the program data obtained;
PCIe board, is connected with described content server by network, receives the program data that content server is sent, cuts into slices in real time, and be stored in by the slice of data obtaining program in the memory chip of PCIe board to the program data received;
Network video server, be provided with disk array, corresponding configuration information is sent to content server, and from PCIe board, read program slice of data by the PCIe interface of PCIe board, judge that whether program slice of data is effective, if effectively, then store slice of data to disk array, otherwise, do not store.
2. the real-time slice systems of files in stream media as claimed in claim 1, it is characterized in that, described PCIe board comprises fpga chip, and fpga chip is bi-directionally connected with FLASH chip, memory chip, network interface and PCIe interface respectively; Wherein, fpga chip is cut into slices in real time to receiving program data, and is stored in memory chip by the slice of data obtained.
3. the real-time slice systems of files in stream media as claimed in claim 2, it is characterized in that, described memory chip is DRR3.
4. the real-time slice systems of files in stream media as claimed in claim 2, it is characterized in that, described fpga chip inside is provided with PCIe buffer memory, for the slice of data that buffer memory reads from memory chip.
5. the real-time dicing method of files in stream media, is characterized in that, comprise the steps:
S1: network video server sends program configuration information to content server;
S2: content server program receiving configuration information is also configured according to program configuration information, receives input signal;
S3: content server is resolved input signal, obtains every programs data, every programs data is packaged into network packet respectively, and the network packet of every programs is sent to PCIe board respectively by the different network ports;
The network packet that S4:PCIe board reception content server is sent also is resolved, and obtains every programs data;
S5:PCIe board is cut into slices to every programs data, and is kept at by program slice of data in the memory chip of PCIe board;
S6: network video server reads the program slice of data of program and is stored in disk array from PCIe board.
6. the real-time dicing method of files in stream media as claimed in claim 5, it is characterized in that, described network packet is UDP message bag.
7. the real-time dicing method of files in stream media as claimed in claim 5, is characterized in that, described PCIe board uses FPGA system clock to cut into slices in real time to every programs data concurrently.
8. the real-time dicing method of files in stream media as claimed in claim 5, is characterized in that, also comprise before described step S4:
S4-0:PCIe board obtains section configuration information from the FLASH chip of described network video server or PCIe board, and carries out corresponding configuration according to section configuration information.
9. the real-time dicing method of files in stream media as claimed in claim 5, it is characterized in that, described step S6 is further:
S6-1: network video server sends read data order to PCIe board;
The fpga chip of S6-2:PCIe board reads program slice of data from memory chip, and is stored in PCIe buffer memory;
S6-3: network video server reads program slice of data from the PCIe buffer memory of PCIe board, and judge whether program slice of data is valid data; If valid data, then perform step S6-4; Otherwise, if not valid data, then point out error message;
S6-4: be stored in disk array by program slice of data, forwards step S6-2 to and continues to perform.
10. the real-time dicing method of files in stream media as claimed in claim 5, it is characterized in that, described step S6 further comprises: network video server judges whether to receive and suspends section order, section order is suspended if receive, then send to PCIe board and stop section order, PCIe board stops section.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510540681.5A CN105163204B (en) | 2015-08-28 | 2015-08-28 | A kind of real-time slice systems of files in stream media and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510540681.5A CN105163204B (en) | 2015-08-28 | 2015-08-28 | A kind of real-time slice systems of files in stream media and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105163204A true CN105163204A (en) | 2015-12-16 |
| CN105163204B CN105163204B (en) | 2018-03-23 |
Family
ID=54803943
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510540681.5A Active CN105163204B (en) | 2015-08-28 | 2015-08-28 | A kind of real-time slice systems of files in stream media and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105163204B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106951380A (en) * | 2017-03-17 | 2017-07-14 | 山东浪潮商用系统有限公司 | A kind of client, service end, data transmission method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101931776A (en) * | 2010-06-21 | 2010-12-29 | 杭州海康威视数字技术股份有限公司 | Data storage system in video monitoring and method for storing, previewing and reviewing data |
| CN102123275A (en) * | 2010-12-30 | 2011-07-13 | 北京中科大洋科技发展股份有限公司 | Video component data information acquiring and extracting method |
| CN102547478A (en) * | 2012-02-20 | 2012-07-04 | 北京蓝汛通信技术有限责任公司 | Triggered slice on-demand system and method of streaming media based on CDN (Content Distribution Network) |
| CN104023244A (en) * | 2014-05-29 | 2014-09-03 | 深圳市云宙多媒体技术有限公司 | Method and apparatus for slicing stream media data in CDN system |
| US20150248366A1 (en) * | 2013-04-17 | 2015-09-03 | Apeiron Data Systems | Method and apparatus for accessing multiple storage devices from multiple hosts without use of remote direct memory access (rdma) |
-
2015
- 2015-08-28 CN CN201510540681.5A patent/CN105163204B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101931776A (en) * | 2010-06-21 | 2010-12-29 | 杭州海康威视数字技术股份有限公司 | Data storage system in video monitoring and method for storing, previewing and reviewing data |
| CN102123275A (en) * | 2010-12-30 | 2011-07-13 | 北京中科大洋科技发展股份有限公司 | Video component data information acquiring and extracting method |
| CN102547478A (en) * | 2012-02-20 | 2012-07-04 | 北京蓝汛通信技术有限责任公司 | Triggered slice on-demand system and method of streaming media based on CDN (Content Distribution Network) |
| US20150248366A1 (en) * | 2013-04-17 | 2015-09-03 | Apeiron Data Systems | Method and apparatus for accessing multiple storage devices from multiple hosts without use of remote direct memory access (rdma) |
| CN104023244A (en) * | 2014-05-29 | 2014-09-03 | 深圳市云宙多媒体技术有限公司 | Method and apparatus for slicing stream media data in CDN system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106951380A (en) * | 2017-03-17 | 2017-07-14 | 山东浪潮商用系统有限公司 | A kind of client, service end, data transmission method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105163204B (en) | 2018-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107171978A (en) | Multi-channel data circulation acquisition system and method for gigabit Ethernet | |
| CN109379305B (en) | Data issuing method, device, server and storage medium | |
| CN108093063A (en) | Big file multithreading FTP method for uploading | |
| JP4988487B2 (en) | Data transfer method, apparatus, and program | |
| CN114726676A (en) | Method for processing redundant message in CAN bus dual-channel backup | |
| CN104602032A (en) | Video playing processing method, playing application proxy device and playing server | |
| CN103034581A (en) | Embedded system trace debugging method and device | |
| CN105163204A (en) | Real-time streaming media file slicing system and method | |
| CN105208004A (en) | Data input method based on OBD equipment | |
| CN111163172A (en) | Message processing system, method, electronic device and storage medium | |
| CN102611760A (en) | File transmission method and system | |
| CN102421005A (en) | Embedded type based code stream analysis system | |
| CN102802041A (en) | Implement method for intelligent streaming media server supporting a plurality of real-time dynamic data sources | |
| CN117082073A (en) | File storage method, file downloading method, device, equipment and storage medium | |
| CN103152134B (en) | Receiving terminal based on Real-time Transport Protocol resets the method and system of voice packet | |
| CN103179449A (en) | Media file playing method, electronic device and virtual machine framework | |
| CN115941907A (en) | RTP data packet sending method, system, electronic equipment and storage medium | |
| CN104936006A (en) | Method, device and system for transmitting program information table | |
| CN116074197A (en) | Transmission method and device | |
| CN204887208U (en) | Concatenation video data's system and device | |
| CN105451100A (en) | Method and device for playing video streams | |
| CN108023660B (en) | A kind of optical transport network business access method and device | |
| CN109413485B (en) | Data caching method and device | |
| CN115080491B (en) | PCI bus data acquisition system based on FPGA | |
| CN102710512A (en) | Cross-platform stream generator and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A real-time slicing system and method for streaming media files Effective date of registration: 20220622 Granted publication date: 20180323 Pledgee: Qilu bank Limited by Share Ltd. Ji'nan Zhang Zhuang sub branch Pledgor: SHANDONG TAIXIN ELECTRONICS Co.,Ltd. Registration number: Y2022980008497 |