KR101336585B1 - Systme and method for providing adaptive streaming service - Google Patents

Abstract

According to an embodiment, there is provided a content generating method for an adaptive streaming service, the method including: receiving a content list for adaptive streaming and content conversion information of the content included in the content list from a content management server; Receiving an original file of content stored in a storage server based on the content list; Storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer; Generating TS segments of each of the content files when coded content files are generated for each bitrate included in the conversion information; And reporting the conversion result of the content list to the content management server, and transmitting the TS segments to a data center server.

Description

System and method for adaptive streaming service {SYSTME AND METHOD FOR PROVIDING ADAPTIVE STREAMING SERVICE}

The present invention relates to a system for adaptive streaming service, and to a method and apparatus for generating content for adaptive streaming service.

Recently, the smooth delivery of content has become an important issue due to the increase in the number of users using the online content, and the adaptive streaming that the bit rate of the content is smoothly changed according to the available transmission bandwidth or the user's device performance is changed. (Adaptive Streaming) technology has been proposed.

1 is a diagram for explaining an overview of adaptive streaming.

Referring to FIG. 1, the server 110 stores the same video encoded for each bitrate in a predetermined length. At this time, the shape divided into a predetermined length means a fragment file (fragment or segment).

The receiver 120 periodically checks the variable reception environment in step 130 and requests the server 110 to play the video having the most appropriate bit rate at the check point.

In steps 101 and 102, the server 110 may provide configuration information of the corresponding content to the receiver 120 in the form of metadata. At this time, the configuration information of the content includes the location of the fragment file, compression ratio, time information and the like.

Prior arts related to adaptive streaming include Korean Patent Publication No. 10-2012-0015254 (Adaptive Streaming Transmission Method), Korean Patent Publication No. 10-2011-0120836 (Adaptive Streaming Control of Digital Content) and Korean Patent Application Publication 10- 2011-0053178 (Adaptive streaming method and apparatus) and the like are disclosed.

These prior arts describe in detail transmission techniques associated with adaptive streaming and control techniques for adaptive streaming.

However, the prior arts do not specifically present a method of generating content for an adaptive streaming service.

In addition, the prior art has a problem that does not provide the efficiency and scalability of the system for providing an adaptive streaming service.

An object of the present invention is to provide a method and apparatus for generating content that can be effectively linked with a content management server, a transcoder, and a data center (adaptive streaming delivery system).

In addition, the present invention is to provide a method and apparatus for generating content that can increase the efficiency of transcoding.

In addition, the present invention is to provide the scalability of the system through a system capable of independent operation of the transcoder and segmenter for adaptive streaming.

In addition, the present invention is to provide a content generating method and apparatus that can increase the efficiency of the content generation process through step-by-step error processing.

In addition, the present invention is to provide a system and method for an adaptive streaming service capable of providing an efficient clip service.

 Content generation method for an adaptive streaming service according to an embodiment of the present invention, receiving a content list for the adaptive streaming (Adaptive streaming) and the conversion information of the content included in the content list from the content management server; Receiving an original file of content stored in a storage server based on the content list; Storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer; Generating TS segments of each of the content files when coded content files are generated for each bitrate included in the conversion information; And reporting the conversion result of the content list to the content management server, and transmitting the TS segments to a data center server.

Content generation apparatus for an adaptive streaming service according to an embodiment of the present invention, the conversion information for receiving the content list for the adaptive streaming (Adaptive streaming) and the conversion information of the content included in the content list from the content management server Receiving unit; A file receiving unit receiving an original file of content stored in a storage server based on the content list; A control unit for storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer; And a segmenter generating TS segments of each of the content files when coded content files are generated for each bitrate included in the conversion information.

The controller reports a result of the conversion of the content list to the content management server, and transmits the TS segments to a data center server.

System for adaptive streaming service according to an embodiment of the present invention, the content management server; Receiving a content list for adaptive streaming and conversion information of the content included in the content list from the content management server, and if the content files coded for each bit rate included in the conversion information are generated, the content A content generating device for generating TS segments of each of the files and transmitting the TS segments to a data center server; A transcoder for generating coded content files for respective bitrates included in the conversion information; And a data center server providing an adaptive streaming service to a receiver using the TS segments.

The present invention enables effective linkage with content management servers, transcoders and data centers (adaptive streaming delivery systems).

In addition, the present invention can increase the efficiency of transcoding, and provides scalability of the system through a system capable of independent operation of the transcoder and the segmenter for adaptive streaming.

In addition, the present invention can increase the efficiency of the content generation process through the step-by-step error processing, it is possible to provide an efficient clip service.

1 is a diagram for explaining an overview of adaptive streaming.
2 shows a system for an adaptive streaming service according to an embodiment of the present invention.
3 illustrates a configuration of an apparatus for generating content for an adaptive streaming service according to an embodiment of the present invention.
4 is a flowchart illustrating a content generation method for an adaptive streaming service according to an embodiment of the present invention.
5 is a flowchart illustrating a specific example of step 430 of FIG. 4.
6 illustrates a user interface for interworking with a content management server according to an embodiment of the present invention.
FIG. 7 illustrates an example of an information display window provided in the user interface of FIG. 6.
8 is a diagram for explaining a segment according to one embodiment of the present invention;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 shows a system for an adaptive streaming service according to an embodiment of the present invention.

Referring to FIG. 2, the system 200 for the adaptive streaming service includes a content management server 210, a content generating device 220, a storage server 230, a transcoder 240, a watch folder 250, and data. Center server 270 and receiver 260 are included.

The content management server 210 may be, for example, a Contents Management System (CMS) of a Video on Demand (VOD) service system. The content management server 210 manages all content for adaptive streaming of the DASH standard. That is, the content management server 210 provides various information such as location information of the content for adaptive streaming, supported standards, and the like.

The content generation device 220 receives a content list for adaptive streaming and conversion information of the content included in the content list from the content management server, and performs an operation according to an embodiment of the present invention.

The content generation device 220 may perform the agent function 221 and the segmenter function 223.

Specific features and operations of the content generating apparatus 220 will be described in detail with reference to FIGS. 3 to 8.

The storage server 230 stores the original file that is the target of the adaptive streaming, and provides the original file to the content generating device 220.

The transcoder 240 converts the original file into various bitrates according to the setting information provided from the content generating device 220. That is, the transcoder 240 may generate coded content files for respective bitrates included in the conversion information of the content provided from the content management server 210.

The watch folder 250 is a storage that can be referred to by a trans coder and a segmenter, and can store an original file or a TS (transport stream) file of the original file. In this case, the original file is a file that requires transcoding, and the TS (Transport Stream) file of the original file may be a TS file or a transcoded file.

In addition, the watch folder 250 may store files converted by various bitrates by the transcoder 240.

Meanwhile, in FIG. 2, the content generation device 220, the transcoder 240, and the watch folder 250 may be configured as one device or may be independent devices. That is, when the specific system is composed of the content management server 210, storage server 230, transcoder 240, watch folder 250, data center server 270 and receiver 260, the content generating device ( 220 may be added in the form of an application for ensuring effective interworking or expansion of the transcoder 240, the content management server 210, and the data center server 270.

The data center server 270 refers to a server that provides adaptive streaming directly to the receiver 260. For example, the data center server 270 may be a server provided in an internet data center (IDC).

That is, the data center server 270 can provide the adaptive streaming service to the receiver 260 using TS segments.

The data center server 270 may provide the receiver 260 with a clip service for the original file by using metadata about TS segments. In this case, the clip service means serving only a partial section of the original file. For example, a particular corner of the entire program may be provided as a clip service.

3 illustrates a configuration of an apparatus for generating content for an adaptive streaming service according to an embodiment of the present invention.

Referring to FIG. 3, the content generating apparatus for the adaptive streaming service includes a conversion information receiver 310, an original file receiver 320, a controller 330, and a segmenter 340. In this case, the segment 340 may be configured as an independent device. The content generating device may further include an I / O port 350 that performs file input / output and TCP / IP communication functions.

The conversion information receiver 310 receives a content list for adaptive streaming and conversion information of the contents included in the content list from the content management server. In this case, the content list request may be performed by the controller 330.

The original file receiving unit 320 receives the original file of the content stored in the storage server based on the content list. In this case, the request of the original file may be performed by the controller 330.

The control unit 330 stores the original file or a TS file of the original file in a watch folder that can be referenced by a trans coder 240 and a segmenter 340. Save it.

In addition, the controller 330 may control the overall operation of the content generating device, and may include at least one processor configured to perform the agent function 221 of FIG. 2. Therefore, even if there is no separate description below, the agent function 221 is performed by the controller 330.

The controller 330 may report the conversion result of the content list to the content management server and transmit the TS segments to the data center server. That is, the controller 330 may control the I / O port 350 for report and file transfer.

The controller 330 may execute a user interface for interworking with the content management server and control the transcoder according to the setting information input through the user interface. A detailed configuration example of the user interface will be described in detail with reference to FIG. 6.

The controller 330 processes the error in each step through the exception processing for each content generation process, thereby increasing the efficiency of the content generation process.

That is, the controller 330 may receive a source file, generate coded content files for each bitrate included in the conversion information, generate TS segments of each of the content files, and generate the TS segments. It is possible to determine whether there is an error for each process transmitted to the data center server, store information about each process before the error occurs, and process the error for each process.

For example, if an error occurs in one process, the controller 330 stores the error information. If a job having the same program identifier occurs, the controller 330 may refer to the stored error information and ignore the already successful step and perform the job from the step where the error occurs.

The segmenter 340 generates TS segments of each of the content files when coded content files are generated for each bitrate included in the conversion information.

The segmenter 340 generates TS segments having a preset length and generates metadata indicating the configuration information of the content including the TS segments. In this case, efficient clip service can be provided by generating indexing information including the frame position information of the TS.

Specific examples of the segments generated by the segmenter 340 will be described with reference to FIG. 8.

4 is a flowchart illustrating a content generation method for an adaptive streaming service according to an embodiment of the present invention.

The method illustrated in FIG. 4 may be performed by the content generating device of FIG. 3.

Referring to FIG. 4, in step 410, the device receives a content list for adaptive streaming and conversion information of content included in the content list from a content management server.

In step 410, providing a user interface for interworking with a content management server, setting a content address and a request address of the conversion information, and setting a report address for reporting a conversion result for the content list. And a request period of the content list and the conversion information. That is, the controller 330 may set information for performing step 410 according to the information input through the interface of FIG. 6.

In this case, the conversion information may include bitrates for adaptive streaming, resolution information, a video frame rate, or information indicating whether transcoding is necessary.

Of course, the conversion information may further include additional information, and may further include various information shown in [Table 2].

The device may receive XML generated from the content management server using the schema described in Table 1 below. That is, the Agent function 221 of FIG. 2 may access a CMS to receive a list of contents to be converted, and access the designated URL through the UI to receive the list.

[Table 1]

Description of each element of XML in [Table 1] is as described in [Table 2].

[Table 2]

Meanwhile, the agent function 221 of FIG. 2 includes parsing XML transmitted from a server to generate information necessary for conversion and performing a series of processes required for actual conversion. When the agent function 221 is executed, a timer (not shown) is driven at a cycle designated by the user, and the controller 330 may request a list from the server.

In operation 420, the device receives an original file of content from a storage server. For example, if the representation is set to transcode to a specific bitrate, the device may copy the original media file from the designated folder in the local system or subnet network to the watch folder configured for transcoding. Also, if the transcoding item is set to bypass, the original media file can be copied to the watch folder set up for the segmentation step. In this case, "representation" means an indicator indicating how many kinds of adaptive streaming are performed. For example, referring to 710 in FIG. 7, the number of representations of the corresponding content is three, and the first representation indicates that no transcoding is required. In operation 430, the device stores the original file or the transcoded file of the original file in a watch folder that can be referred to by a trans coder or a segmenter.

At this time, the transcoder periodically monitors the watch folder to determine whether there is an original file for transcoding.

Operation 430 may include the process illustrated in FIG. 5 according to whether transcoding is required.

In operation 440, when coded content files are generated for each bitrate included in the conversion information, the device generates TS segments of each of the content files. For example, the controller 330 of FIG. 3 may monitor the watch folder periodically to recognize that the transcoding for each representation is completed by the transcoder. In some cases, since transcoding may take several tens of minutes or more, the controller 330 may perform efficient task management through the monitoring function of the watch folder.

Finally, when content generation for the adaptive streaming service is completed, the device may report it to the content management server and upload the generated content to the data sensor server.

That is, in operation 450, the device reports the result of the conversion of the content list to the content management server and transmits the TS segments to the data center server.

For example, the Agent function 221 of FIG. 2 may generate a conversion result for each program id when all the operations of the requested list are completed, and report the conversion result to the CMS by HTTP Post method. Therefore, effective interworking with the data management server is possible through the agent function 221.

In this case, [Table 3] shows an example of a schema for reporting.

[Table 3]

In [Table 3], the description of each element of XML is as described in [Table 4].

[Table 4]

Meanwhile, the agent function 221 of FIG. 2 may include copying the result files for each program id, which have been converted, to a designated location using a CustomActionScript value, or transmitting them to an FTP server of an external network such as IDC.

5 is a flowchart illustrating a specific example of step 430 of FIG. 4.

Referring to FIG. 5, in step 531, the device determines whether transcoding of the original file is necessary with reference to the conversion information. Whether to transcode the original file may be provided from the content management server, or may be determined by the controller 330. For example, when the original file provided by the storage server is a file coded for each bitrate, the controller 330 may determine that transcoding is not necessary. In addition, whether transcoding is required may be determined based on information input by a user. That is, the representation may be added according to the user's setting, and if there is no file corresponding to the added representation, the controller 330 may determine that transcoding is necessary.

If transcoding is required, the device may store the original file in a watch folder for a transcoder in step 533, and provide the transcoder setting information to the transcoder in step 535. In this case, the configuration information is transformation information for the adaptive streaming service. If transcoding is not needed, the device stores the original file in the watch folder for the segmenter in step 537. The segmenter 340 of FIG. 3 may periodically monitor the watch file to detect whether segmentation is necessary.

6 illustrates a user interface for interworking with a content management server according to an embodiment of the present invention.

The user interface 600 shown in FIG. 6 may be provided to the user to set up the Agent function 221. Accordingly, the controller 330 may perform the agent function 221 according to the information input through the user interface 600.

The user interface 600 includes a connection information panel 610, a control panel 620, a conversion information display panel 630, a media present description description (MPD) information setting panel 640, a watch folder setting panel 650, and segment information. And a setting panel 660.

The access information panel 610 sets a content address and a request address of the conversion information, sets a reporting address for reporting a conversion result for the content list, and sets a request period of the content list and the conversion information. It is a panel.

The control panel 620 is a panel for operation of starting, stopping, etc. of the agent function 221.

The conversion information display panel 630 includes a window 633 for displaying a transcoding progress state or a conversion result, and a window 631 for displaying conversion information provided from the content management server or inputting conversion information by a user. It may include.

The MPD (Media Presentation Description) information setting panel 640 is a panel capable of recording various metadata. The receiver using the adaptive streaming service can look at the metadata and decide which version of the representation to choose according to its communication environment or hardware specifications.

The watch folder setting panel 650 provides a window in which a watch folder can be set (ie, a storage path).

In this case, the watch folder may include a first watch folder 651 for monitoring the existence of the original file in the transcoder and a second watch folder 653 storing the result file converted by the transcoder. . The second watch folder may be periodically monitored by the segmenter 340 of FIG. 3. Thus, in FIG. 6, 653 is denoted as "Segmenter." In this case, the controller 330 may periodically monitor the second watch folder 653 to determine whether transcoding is completed.

The segment information setting panel 660 provides a window for setting generation information of TS segments. That is, the segmenter 340 may generate a TS segment according to the information input to the segment information setting panel 660. Users can specify a folder to store segmented temporary files so that they can manage the result of manual conversion when an unexpected error occurs. There may also be an option to drive the process of creating a segment with a socket.

On the other hand, if the conversion information and the previously stored setting information is different, the user interface 600 may provide an information display window 700 for changing the setting of the transcoder.

FIG. 7 illustrates an example of an information display window provided in the user interface of FIG. 6.

7 shows an example of an information display window 700 for changing a setting of a transcoder. If the setting information input by the user and the transcoding setting information included in the conversion information are different, the information display window 700 may be displayed. In general, the conversion information does not need to be re-set every time since the conversion information is often not changed according to the service policy. However, if this value is changed due to a change in the service policy, the device will notify that it is different from the previously stored configuration information and cause the transcoder to be reset.

Referring to FIG. 7, the number of Representations for MPD is three, and an example 710 indicating that content for 1M bps and 700K bps should be converted through a transcoder is shown. The information displayed as 710 allows the user to modify the transcoder's settings to create 1M and 700K content.

8 is a diagram for explaining a segment according to one embodiment of the present invention;

The delivery format defined in the MPEG DASH standard includes the ISO-based media file format and the MPEG-2 Transport Stream standard, and is mainly focused on the case of providing services using the contents of the MPEG-2 TS format. Explain.

The segmenter 340 may be driven by directly calling a process or may be operated as an independent process using a socket. Therefore, interworking with multi-bit rate encoder and future expansion are possible.

The segmenter 340 may basically receive an MPEG-2 TS file and generate an initialization segment 810, segment files 820, 830, 840 divided into a given length, and metadata representing content configuration information. In addition, index information for Clip MPD may be generated.

Each segment starts with an I frame on a video basis for random access. In addition, an initialization segment including only PAT (Program Association Table) and PMT (Program Map Table) packets, which are initial information required when the UE attempts to play using the Clip MPD, may be generated. The Clip MPD may include section information for a Clip service using index information. The index information may be transmitted to the terminal in the form of an index segment. In this case, the Clip MPD may describe section information in units of time. Clip MPD can be used for more accurate section playback than general MPD.

The segmenter 340 may perform content conversion and conversion status inquiry by transmitting XML using a TCP / IP socket. At this time, the example of XML to be transmitted is as shown in [Table 5], and description of each element is as described in [Table 6].

[Table 5]

TABLE 6

The methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

Claims (12)

delete Receiving a content list for adaptive streaming and content conversion information of the content included in the content list from a content management server;
Receiving an original file of content stored in a storage server based on the content list;
Storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer;
Generating TS segments of each of the content files when coded content files are generated for each bitrate included in the conversion information; And
Reporting the conversion result of the content list to the content management server, and transmitting the TS segments to a data center server;
Receiving the content list and the conversion information of the content included in the content list,
Providing a user interface for interworking with the content management server;
Setting a request address of the content list and the conversion information, and setting a report address for reporting a conversion result for the content list; And
Setting a request period of the content list and the conversion information;
Content generation method for adaptive streaming service. Receiving a content list for adaptive streaming and content conversion information of the content included in the content list from a content management server;
Receiving an original file of content stored in a storage server based on the content list;
Storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer;
Generating TS segments of each of the content files when coded content files are generated for each bitrate included in the conversion information; And
Reporting the conversion result of the content list to the content management server, and transmitting the TS segments to a data center server;
The storing of the original file or a TS file of the original file may include:
Determining whether transcoding of the original file is necessary with reference to the conversion information;
If transcoding of the original file is necessary, storing the original file in a watch folder for a transcoder and providing setting information of the transcoding to the transcoder; And
If the transcoding is not required, including the step of storing a transport stream (TS) file of the original file in the watch folder for the segmenter,
Content generation method for adaptive streaming service. Receiving a content list for adaptive streaming and content conversion information of the content included in the content list from a content management server;
Receiving an original file of content stored in a storage server based on the content list;
Storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer;
Generating TS segments of each of the content files when coded content files are generated for each bitrate included in the conversion information; And
Reporting the conversion result of the content list to the content management server, and transmitting the TS segments to a data center server;
Generating TS segments of each of the content files includes:
Generating TS segments of a preset length; And
Generating metadata representing configuration information of content including the TS segments;
The metadata includes section information for providing a clip service by using indexing information.
Content generation method for adaptive streaming service. 5. The method of claim 4,
The conversion information,
Including bitrates for adaptive streaming, resolution information, video frame rate, or information indicating whether transcoding is needed,
Content generation method for adaptive streaming service. delete A conversion information receiver configured to receive a content list for adaptive streaming and content conversion information of the content included in the content list from a content management server;
A file receiving unit receiving an original file of content stored in a storage server based on the content list;
A control unit for storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer; And
When the coded content files are generated for each of the bitrates included in the conversion information, a segmenter for generating TS segments of each of the content files is included.
The control unit reports the conversion result of the content list to the content management server, transmits the TS segments to a data center server,
The controller executes a user interface for interworking with the content management server,
The user interface includes:
A connection information panel for setting a request address of the content list and the conversion information, a report address for reporting a conversion result for the content list, and setting a request period of the content list and the conversion information;
A watch folder setting panel capable of setting the watch folder;
A conversion information display panel displaying the conversion information and the transcoding progress state; And
A segment information setting panel for setting generation information of the TS segments;
Content generation device for adaptive streaming service. The method of claim 7, wherein
The user interface includes:
If the conversion information and the previously stored setting information is different, providing an information display window for changing the setting of the transcoder,
Content generation device for adaptive streaming service. A conversion information receiver configured to receive a content list for adaptive streaming and content conversion information of the content included in the content list from a content management server;
A file receiving unit receiving an original file of content stored in a storage server based on the content list;
A control unit for storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer; And
When the coded content files are generated for each of the bitrates included in the conversion information, a segmenter for generating TS segments of each of the content files is included.
The control unit reports the conversion result of the content list to the content management server, transmits the TS segments to a data center server,
The watch folder includes a first watch folder for monitoring the existence of the original file in the transcoder and a second watch folder for storing the result file converted by the transcoder,
The controller periodically monitors the second watch folder to determine whether transcoding is completed.
Content generation device for adaptive streaming service. A conversion information receiver configured to receive a content list for adaptive streaming and content conversion information of the content included in the content list from a content management server;
A file receiving unit receiving an original file of content stored in a storage server based on the content list;
A control unit for storing the original file or a transport stream (TS) file of the original file in a watch folder to which a trans coder and a segmenter can refer; And
When the coded content files are generated for each of the bitrates included in the conversion information, a segmenter for generating TS segments of each of the content files is included.
The control unit reports the conversion result of the content list to the content management server, transmits the TS segments to a data center server,
The control unit,
Receiving the original file, generating coded content files for each bitrate included in the conversion information, generating TS segments of each of the content files, and transmitting the TS segments to a data center server Determining whether there is an error for each process, storing information about each process before the error occurred and processing the error for each process,
Content generation device for adaptive streaming service. delete A content management server;
Receiving a content list for adaptive streaming and conversion information of the content included in the content list from the content management server, and if the content files coded for each bit rate included in the conversion information are generated, the content A content generating device for generating TS segments of each of the files and transmitting the TS segments to a data center server;
A transcoder for generating coded content files for respective bitrates included in the conversion information; And
A data center server providing an adaptive streaming service to a receiver using the TS segments;
The data center server,
Providing the receiver with a clip service for the original file using the metadata for the TS segments, wherein the clip service serves only a part of the original file.
System for Adaptive Streaming Service.

Images