KR101718127B1 - Content packaging system and streaming method for context aware streaming service - Google Patents

Abstract

Disclosed are a content packaging system and a streaming method for a context recognition streaming service. The system includes: an adaptive streaming server which has trans-coding and segmenting functions for a context recognition-base adaptive streaming service upon completion of generating content or upon external input by applying an adaptive video streaming technology to provide a seamless video service in networks and increase experience quality of a user, and which is configured to convert the video content into an adaptive streaming format, analyze context information on a network, a player, and the content, trans-code the video content, trans-code the video content based on the context information, perform a segmentation on the trans-coded contents, generate a meta data indicating content information and an URL of the segmented contents, and insert and transfer context information including meta data and identifier (ID) of the video content completed in the trans-coded segmenting; and a context recognition-based adaptive video streaming player configured to secure quality of media service (QoS/QoE) by collecting context information on a terminal, the network, and the content, analyze a server network feature, information on the player, and a content feature in the meta data, and request a segment having proper quality for performing seamless streaming through network recognition, player recognition, and content recognition based on a measured network bandwidth, playable content list, and the content feature.

Description

[0001] The present invention relates to a content packaging system and a streaming method for a context-aware streaming service,

The present invention relates to a content packaging system and a streaming method for a context-aware streaming service, and more particularly, to a content packaging system and a streaming method for a context-aware streaming service in which adaptive streaming services prevent contention , The maximum bandwidth of the server, the minimum bandwidth, the maximum number of playback devices (the number of playback devices, the number of playback devices, and the number of playback devices) , A reproduction apparatus measurement bandwidth), and a system for converting an original content into an adaptive video streaming format, and a network system for increasing quality of service (QoS) , And content-aware video streaming And a content packaging system and a streaming method for a context-aware adaptive video streaming service providing the system.

Recently, video contents or video streaming services are steadily increasing as the spread of smart devices in smartphones and tablets is increasing. Cisco's Cisco Visual Networking Index (VNI) report, published by Cisco, reports that worldwide IP traffic is expected to reach 164 exabytes per year in 2019, and video-related traffic in 2019 is estimated at about 118 exabytes, . Video service providers are developing technologies that can efficiently deliver video data to minimize video traffic and improve user experience.

With the rapid spread of smart terminals, IP traffic is increasing even more. Since the smart terminal has various environments such as the characteristics and resolution of the connected network, efficiency will be degraded if the same video is transmitted from the server. In case of the high quality video, if the users view the same video, Efficiency will be reduced. In order to prevent this, researches have been actively conducted on technologies for video services such as providing devices using MVO (Mobile Video Optimization) technology or transmitting videos in a HAS (HTTP Adaptive Streaming) method to efficiently prevent waste of bandwidth have.

When the overload traffic occurs in the video streaming service providing system more than the network capacity, the video quality of service (QoS) drops due to packet delay, packet loss, jitter, The quality of the user experience to be watched is lowered.

In order to solve this problem, Korean Patent Registration No. 10-118284 of Prior Art 1 discloses "an apparatus and method for providing a smart streaming service using complex situation information ", and is connected to a plurality of unit service servers providing a unit service through a network The smart streaming service providing apparatus provides at least one unit service suitable for a complex situation for a current user among a plurality of unit service servers by using complex situation information including information on a user, a user terminal and a unit service A service path selector for selecting at least one unit service server for the selected service server information and generating service path information indicating a combination of the selected at least one unit service server, Unit service provided And provides a smart streaming service to the user.

Korean Patent Laid-Open Publication No. 10-2013-0063413 of Prior Art 2 discloses a " method and apparatus for traffic control using adaptive streaming in a multimedia content transmission system ", and in order to prevent traffic preemption by a client, And a method for controlling traffic between clients.

Korean Patent Registration No. 10-156951 of Prior Art 3 discloses "Adaptive real-time transcoding method and streaming server for this ", and the setting value of the transcoding operation in the media streaming service is adaptively changed according to the network environment And an adaptive real-time transcoding method for improving quality of service by minimizing image disconnection in an environment such as a mobile device, and a streaming server therefor.

An adaptive real-time transcoding method is a real-time transcoding method for sequentially transmitting segments of segmented and transcoded media data to a client end through a network in a streaming server, the streaming transcoding method comprising: Determining the play-back buffer filling degree of the client terminal by comparing the elapsed time from the time point; Determining an image quality of a media data segment not transmitted to the client end based on the determined play-back buffer filling degree; And transcoding the media data segment that has not been transmitted according to the determined image quality.

Recently, as demand for video streaming service has increased, adaptive video streaming technology using network recognition technology has emerged in order to provide seamless video and improve user experience quality in a bandwidth limited heterogeneous network.

The adaptive video streaming server divides video of various bit rates into segment units and stores the URL and video information of each segment as metadata. The adaptive video streaming playback apparatus receives the metadata in the initial streaming session and analyzes the metadata to request a segment suitable for the network situation.

 However, the existing adaptive video streaming service considers only the bandwidth measurement value and the buffer of the playback device in selecting the quality, so there is a possibility that the bandwidth wastage or the video disconnection phenomenon may occur because the content characteristic and playback device characteristic are not considered. A bandwidth wastage problem occurs when the playback apparatus requests a video that exceeds the pixel and bit rate that it can represent. Video discontinuity has a high bit rate in the case of a frame with a large amount of change, resulting in a high delay in receiving the segment, resulting in a discontinuity. There is a need for a technique for providing seamless streaming service using contents, playback apparatuses, and network features in order to improve the quality of a user's experience using a video streaming service.

(001) Patent registration No. 10-118284, Registration date 2012.09.07 (002) Patent Publication No. 10-2013-0063413, publication date 2013.06.14 (003) Patent registration No. 10-156951, Registration date 2015.11.10

SUMMARY OF THE INVENTION An object of the present invention is to improve user experience quality by using a packaging system that converts content into an adaptive video streaming format in consideration of content characteristics, playback apparatus characteristics, and network characteristics. To this end, in the process of converting the content into the adaptive streaming service format, the content metadata, the playback system, and the packaging system that applies the information considering the bandwidth of the streaming server to the content metadata are analyzed, Based adaptive streaming service, which provides a streaming service method for determining an image of a content-based streaming service.

It is another object of the present invention to provide a method of content packaging and streaming for context aware streaming services.

In order to achieve the object of the present invention, a content packaging system for a context-aware adaptive streaming service may be implemented by applying adaptive video streaming technology, such as transcoding and segmentation for adaptive streaming services upon completion of content creation or context- And transcoding the video content after analyzing the context information of the network, the playback apparatus, and the content by converting the content into an adaptive streaming format, transcoding based on the context information, and performing the segmentation of the transcoded contents And generates metadata for displaying contents information and a URL of each segmented contents, and inserts context information including an identifier (ID) and meta data of the transcoded segmented video content into an adaptive video Streaming server; Network, and contents through the wired / wireless network and analyzing the network characteristic of the server of the metadata, the reproduction device itself information, and the content characteristic through the network to determine the network bandwidth Based adaptive video streaming playback apparatus for requesting segments of an appropriate quality for seamless streaming based on content attributes, a list of reproducible contents, and quality of service (QoS / QoE) ,
The metadata includes the network information of the server including the URL of the server for the context-aware adaptive streaming service, the maximum bandwidth of the server, the minimum bandwidth, and the maximum connectable number of playback devices, and the bit rate, frame rate, And playback apparatus information including a maximum resolution, a minimum resolution, and a playback apparatus type of the playback apparatus,
The status information includes an IP address and network information of a router connected to the server and a network, an IP address and playback apparatus information of the playback apparatus, a content ID, and content information,
The context-aware adaptive video streaming playback apparatus includes a playback device characteristic including a type of playback device, a resolution of the playback device, a device type, a resolution, a main storage device performance, and a central processing device performance and a content ID, a segment size, , A content characteristic including a frame rate, and a network characteristic of a server including a URL of the server, a maximum bandwidth of the server, a minimum bandwidth, and a number of reproducible devices connectable.

In accordance with another aspect of the present invention, there is provided a content packaging and streaming method for a context-aware adaptive streaming service, comprising: (a) applying an adaptive video streaming technology to an adaptive video streaming server, It includes transcoding and segmentation functions for perception based adaptive streaming services, transcodes video contents after analyzing context information of network, playback device, and contents by converting them into adaptive streaming format, After segmenting the transcoded contents, metadata for displaying the contents information and the URL of each segmented contents is generated, and the metadata of the transcoded segmented video contents and the identifier (ID) To insert and deliver context information 1 System; And (b) context-aware adaptive video streaming playback apparatus collects context information of terminal, network, and contents through a wired / wireless network and analyzes network characteristics, playback device information, and content characteristics of the metadata server, (QoS / QoE) by requesting segment of appropriate quality to perform seamless streaming based on network bandwidth, reproducible content list, and content characteristics measured through the playback apparatus and the content, , ≪ / RTI >
The metadata includes network information of the server including the URL of the server for the context-aware adaptive streaming service, the maximum bandwidth of the server, the minimum bandwidth, and the maximum number of connectable playback devices, and the bit rate, frame rate, And reproduction apparatus information including a maximum resolution, a minimum resolution, and a reproduction apparatus type of the reproduction apparatus,
The status information includes an IP address and network information of a router connected to the server and a network, an IP address and playback apparatus information of the playback apparatus, a content ID, and content information,
The context-aware adaptive video streaming playback apparatus includes a playback device characteristic including a type of playback device, a resolution of the playback device, a device type, a resolution, a main storage device performance, and a central processing device performance and a content ID, a segment size, , A content characteristic including a frame rate, and a network characteristic of a server including a URL of the server, a maximum bandwidth of the server, a minimum bandwidth, and a number of reproducible devices connectable.

According to the present invention, the content packaging system and the streaming method for the context-aware adaptive streaming service can prevent the streaming phenomenon and improve the user's perceived quality by determining the proper quality of the playback device based on the content characteristics, network characteristics, Can be improved. Also, when the content is converted into the adaptive video streaming format, the content is converted in consideration of the playback device, the network characteristics of the server, and the content characteristics, thereby providing the optimum quality content suitable for the user environment.

Conventionally, the adaptive video streaming service considers only the bandwidth measurement value and the buffer of the playback apparatus when selecting the quality, so that the bandwidth waste or the video disconnection phenomenon may occur because the content characteristic and the characteristics of the playback apparatus are not considered. In order to solve this problem, the present system can adaptively transcodize and segment content based on content characteristics, playback apparatus characteristics, and network characteristics, and stream the prepared content in the playback apparatus, thereby improving the user's perceived quality . In the course of this technology, adaptive transcoding function, segmentation function, and contextual information insertion function are configured in the server, and the playback device analyzes the situation information and constructs a function to adaptively determine the quality.

Due to the generalization of smart devices, demand for video streaming services in various network environments is rapidly increasing. In 2013, video traffic in the United States accounted for 37.05% of all downstream traffic at Netflix, a leading provider of video streaming services, and YouTube, which accounts for one-third of all Internet users, accounts for 17.85% Traffic. Video streaming over the network is expected to continue to grow in size, and video traffic is expected to increase sharply as 4K content is delivered. The LTE-A service, which supports the 150Mbps transmission rate, and the 5G service, which supports at least 10 times to 1000 times faster speed in the near future, are expected to improve the video streaming service provisioning environment. However, since the server of the provider providing the video service uses limited network resources, the quality of the service may decrease when the user views the high quality image. As a result, it is expected that the network optimization technology for processing the video traffic of the explosion and the video streaming service area for adaptively controlling the quality of the contents according to the network condition are expected to be improved.

1 is a view for explaining a streaming service providing environment including a conventional streaming server, a client terminal, and a source media.
2 is a block diagram of a context-aware adaptive video streaming service according to the present invention.
3 is a flowchart illustrating a packaging method of the adaptive video streaming server in FIG.
Figure 4 is a context-based adaptive video streaming metadata configuration diagram according to the present invention.
5 is a flowchart illustrating a streaming method of the adaptive video streaming playback apparatus in FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a conceptual diagram of a context-aware adaptive video streaming service according to the present invention.

The content packaging system and the streaming method for the context-aware streaming service of the present invention can prevent the waste of the network bandwidth and the video disruption in the adaptive streaming service, thereby improving the quality of the user experience by improving the quality of the content (bit rate, frame rate, Size, playback device characteristics (resolution, codec performance, device type, main storage performance, central processing capability), and network characteristics (server maximum bandwidth, minimum bandwidth, A packaging system for converting an original content into an adaptive video streaming format in consideration of a content, and a network, a playback device, and a content to increase quality of service (QoS) Cognitive-based video streaming service provided Method and system therefor.

The content packaging system and the streaming method for the context aware streaming service according to the present invention apply content characteristics, playback apparatus characteristics, and network characteristics in a process of converting contents into an adaptive streaming format in order to perform streaming based on context information, And analyzing it in the device and requesting the server of the appropriate quality segment.

First, the context-aware adaptive video streaming server of the present invention includes a context information analysis module for recognizing a content characteristic, a network characteristic, and a playback device characteristic, A content segmentation module for performing a metadata generation operation for segmenting contents transcoded with various qualities according to quality and defining information of the contents, a content segmentation module for assigning content attributes, And a situation information insertion module for inserting the situation information such as the characteristics of the reproduction apparatus and the characteristics of the reproduction apparatus.

Secondly, the context-aware adaptive video streaming playback apparatus of the present invention is characterized in that the context-aware adaptive video streaming playback apparatus includes a playback apparatus characteristic analyzing apparatus for analyzing characteristics of a playback apparatus such as a resolution of a playback apparatus, a main storage capability, a central processing unit performance, A cognitive module, a metadata analysis module for analyzing and analyzing metadata after requesting and receiving the metadata in which content information is defined in order to stream content at the beginning of a streaming session, and a segment size, a bit rate, a frame A network aware module that measures bandwidth each time a segment is requested and received, and a segment size, bit rate, and frame rate that are supported by the playback device based on the measured network bandwidth When it is lower than this bandwidth, request a segment of appropriate quality It characterized in that the request module is configured as a segment.

B) Function and action

2 is a block diagram of a context-aware adaptive video streaming service according to the present invention.

A content packaging system for adaptive streaming service based on context awareness

To provide seamless video service in the network and apply adaptive video streaming technology to enhance user experience quality, it includes transcoding and segment function for adaptive streaming service based on context recognition upon completion of content creation or external input, And then transcodes the video contents after analyzing the context information of the network, the playback apparatus, and the contents, transcodes based on the context information, segments the transcoded contents, An adaptive video streaming server 100 for generating metadata for displaying content information and a URL, and for inserting and transmitting context information including an identifier (ID) and meta data of the video content in which the transcoded segment has been completed; And

Network, and contents through the wired / wireless network and analyzing the network characteristics of the server of the meta data, the playback device itself information, and the content characteristics to determine the network bandwidth, Based on the context-aware adaptive video streaming playback apparatus 200 that requests quality-of-service (QoS) / quality-of-service (QoS) .

The adaptive video streaming and playback apparatus 200 may be a mobile communication terminal, a smart phone, a tablet PC, an IPTV terminal (STB + TV), or the like.

The adaptive video streaming server 100 includes a context information analysis module 110, a context information insertion module 120, a content transcoding module 130, and a content segmentation module 140.

The context information analysis module 110 includes a network characteristic recognition function for analyzing a maximum bandwidth, a minimum bandwidth, and a maximum number of playback devices that can be connected to the server, a frame rate, a bit rate, and a bit rate of content that has been transcoded and segmented, A content characteristic recognition function for analyzing a size per unit segment, and a playback device characteristic analyzing type of playback devices, such as maximum resolution, minimum resolution, and types of playback devices pre-input so that the playback device can play back content of appropriate quality Cognitive function.

The context information insertion module 120 adds context information (a network identifier (a router IP address of a network of the server), a playback device identifier (an IP address of the playback device), a content identifier Content ID (VID, Video ID))] is inserted. The insertion of the context information is performed at the time when the content is completely segmented and the metadata is generated.

The content transcoding module 130 transcodes relatively low quality contents from the highest quality original content considering the network characteristics, content characteristics, and playback device characteristics analyzed by the context information analysis module 110. [

The content segmentation module 140 segments the transcoded content and generates metadata indicating content information and a URL of each segmented content.

The context-aware adaptive video streaming playback apparatus 200 includes a playback device capability recognition module 210, a content feature recognition module 220, a network recognition module 230, a metadata analysis module 240, and a segment request module 250).

The playback device characteristic recognition module 210 requests and receives metadata from the server at the beginning of the streaming session and analyzes the resolution, the device type, and the codec performance of the playback device to determine a quality of video exceeding the resolution and codec performance of the playback device. And generates a list of the excluded contents. During streaming, main storage performance and central processing unit performance are monitored to remove content that is difficult to render from the list so that it can not be requested.

The content property recognition module 220 analyzes the segment size, the bit rate, and the frame rate based on the analyzed metadata information.

The network aware module 230 measures a bandwidth by a size of a segment and a delay occurring upon reception each time a segment is requested and received during streaming.

The metadata analysis module 240 requests and receives metadata of a content at the beginning of a streaming session and stores the metadata in a buffer.

The segment request module 250 determines whether the segment request message is interrupted based on the network bandwidth measured by the network aware module 230, the content list reproducible in the playback device characteristic recognition module 210, and the content characteristic analyzed in the content characteristic recognition module 220 Request a segment of appropriate quality to perform streaming without.

C) Embodiment

FIG. 3 is a flowchart of a method of packaging an adaptive video streaming server in a context-aware adaptive streaming service according to the present invention.

Referring to FIG. 3, the method of packaging an adaptive video streaming server according to the present invention includes, in step S11, a maximum bandwidth, a minimum bandwidth, and a maximum playback A network characteristic recognition function for analyzing the number of devices, a content characteristic recognition function for analyzing a frame rate, a bit rate, a size per unit segment, and the like of a content that has been transcoded and segmented, And analyzes the status information by performing a playback device characteristic recognition function analyzing the type of the playback devices, the maximum resolution, the minimum resolution, and the like of the playback devices input in advance. In step S12, the content transcoding module 130 performs transcoding based on the context information. In step S13, the content segmenting module 140 segments the transcoded content according to the function of the content segmenting module 140 and generates metadata for displaying information of the content. The analyzed status information is inserted into the metadata generated according to the function of the context information insertion module 120 in step S14.

FIG. 4 is a metadata format generated when the adaptive video streaming server 100 changes the original content to the context-aware adaptive video streaming format in the context-aware adaptive streaming service according to the present invention.

Referring to FIG. 4, the metadata includes network information, playback apparatus information, and content information, and is configured in XML format.

The metadata includes the server's network information (the URL of the server, the maximum bandwidth of the server, the minimum bandwidth, the maximum number of connectable playback devices), the content information (the bit rate of the content, the frame rate, , And playback apparatus information (maximum resolution, minimum resolution, playback apparatus type of playback apparatus).

The context information includes the IP address and network information of the server and the router connected to the network, the IP address and playback apparatus information of the playback apparatus, the content ID, and the content information.

The adaptive video streaming playback apparatus 200 performs a function of receiving metadata and analyzing its characteristics.

The adaptive video streaming server 100 inserts context information for the context aware adaptive streaming service into the metadata including the context aware adaptive streaming service information.

The context-aware adaptive video streaming and playback apparatus 200 may be configured to provide a context-based adaptive video streaming playback apparatus 200 that is capable of providing a context-based adaptive video streaming playback apparatus 200 that includes a playback device capability (type of playback device, resolution of the playback device, device type, resolution, Segment size, bit rate, frame rate), and the network characteristics of the server (URL of the server, maximum bandwidth of the server, minimum bandwidth, and number of connectable devices).

(Resolution, main memory function, central processing unit performance, device type, codec performance), the network characteristics of the server (the maximum value of the server), the metadata analyzed by the context-aware adaptive streaming playback apparatus 200 (Segment size, bit rate, frame rate), and the measured bandwidth, based on the determined bandwidth, bandwidth, minimum bandwidth, and number of connectable playback devices.

FIG. 5 is a flowchart of a streaming method of the context-aware adaptive video streaming playback apparatus 200 according to the present invention.

5, in step S21, the metadata of the content requested by the metadata analysis module 240 of the adaptive video streaming playback apparatus 200 is received And analyzing network characteristics, content characteristics, and playback apparatus characteristics. In step S22, the bit rate, the frame rate, and the segment size of the content are analyzed according to the function of the content characteristic recognition module 220. [ In step S23, the resolution, the device type, and the codec performance of the playback apparatus are analyzed at the beginning of the streaming session according to the functions of the playback apparatus characteristic or module 210 to generate a list of contents excluding quality content exceeding the performance of the playback apparatus do. In step S24, a requested segment is received during streaming according to the function of the network aware module 230, and a network bandwidth is measured based on a delay and a segment size, which are generated each time a segment is received. In steps S25 and S26, the segment quality of the content is determined according to the function of the segment request module 250, and a segment of the determined quality is requested. In step S27, it is determined whether the video being played back has been completed. If the video is not finished, the main storage device performance and the central processing unit performance are monitored according to the characteristics of the playback device characteristic or module 240, Remove from the list and re-measure the network bandwidth according to the requested segment.

A content packaging and streaming method for a context-aware streaming service of the present invention comprises the steps of: (a) transforming an adaptive video streaming server into a transcoder for an adaptive streaming service based on context- Coding and segmenting functions and transforming the content into an adaptive streaming format to transcoding the video content after analyzing the context information of the network, the playback device, and the content, transcoding based on the context information, And generates metadata for displaying contents information and a URL of each segmented contents after performing the segmentation, and inserts and transmits context information including metadata and an identifier (ID) of the video content in which the transcoded segmentation has been completed Stage 1; And (b) context-aware adaptive video streaming playback apparatus collects context information of terminal, network, and contents through a wired / wireless network and analyzes network characteristics, playback device information, and content characteristics of the metadata server, (QoS / QoE) by requesting segment of appropriate quality to perform seamless streaming based on network bandwidth, reproducible content list, and content characteristics measured through the playback apparatus and the content, .

The first step includes: (a1) a network characteristic recognition function for analyzing the maximum bandwidth, the minimum bandwidth, and the maximum number of playback apparatuses connectable to the server by the situation information analysis module, the content of the content that has been transcoded and segmented A content characteristic recognition function for analyzing a frame rate, a bit rate, a size per unit segment, and a maximum resolution, a minimum resolution, and a type of playback apparatus in pre-input playback apparatuses so that a playback apparatus can play back an appropriate quality content Performing a playback device characteristic recognition function for analyzing the playback device characteristic; (a2) inserting additional context information into the metadata of the content that has been transcoded and segmented by the context information insertion module, and embedding the context information is performed at the time when the content is completed up to the segmentation and the metadata is generated; (a3) transcoding relatively low quality contents in the highest quality original content considering the network characteristics, content characteristics, and playback device characteristics analyzed by the context information analysis module by the content transcoding module; And (a4) segmenting the content transcoded by the content segmenting module and generating metadata indicating content information and a URL of each segmented content.

The step (b1) includes the steps of (b1) requesting and receiving metadata from the server at the beginning of the streaming session by the module of the playback apparatus characteristic, analyzing the resolution, the device type, and the codec performance of the playback apparatus, A step of generating a list of contents excluding video of exceeding quality, and monitoring main storage performance and central processing unit performance during streaming to remove content that is difficult to render from a list so that it can not be requested; (b2) analyzing the segment size, the bit rate, and the frame rate based on the metadata information analyzed by the content property recognition module; (b3) measuring a bandwidth by a size of a segment and a delay occurring upon reception each time a segment is requested and received during a streaming operation by the network aware module; (b4) requesting and receiving metadata of the content at the beginning of the streaming session by the metadata analysis module, and storing the metadata in the metadata buffer; And (b5) performing seamless streaming based on the network bandwidth measured by the network recognition module by the segment request module, the list of contents reproducible by the playback device characteristic module, and the content characteristics analyzed by the content property recognition module ≪ / RTI > and requesting a segment of a suitable quality to do so.

The metadata includes at least one of network information of a server for a context-aware adaptive streaming service (URL of a server, maximum bandwidth of a server, minimum bandwidth, maximum number of connectable playback devices), content information (a bit rate of a content, ), And playback apparatus information (maximum resolution, minimum resolution, playback apparatus type of playback apparatus).

The status information includes an IP address and network information of a router connected to the server and a network, an IP address and playback device information of the playback device, a content ID, and content information.

This system has studied context aware monitoring technology such as network, terminal, and contents, and adaptive context aware streaming technology. It is a technology to recognize and analyze situation information related to media delivery and reproduction such as network, terminal, and contents. Streaming technology that adjusts the quality and transmission rate of contents adaptively to surrounding situation information, and QoS / QoE technology that guarantees service quality.

Context-aware lifestyle media content packaging, delivery, and active expression technology development, for example, analyze the requirements of lifemedia content packaging and delivery technologies to provide content packaging technologies for lifemedia content delivery and multimedia for multi- And designed and developed transmission technology.

In addition, adaptive content packaging and delivery technology has been developed to collect and analyze context information of terminals, networks, and contents to guarantee QoS of life media services.

As described above, the method of the present invention can be implemented as a program and recorded on a recording medium (CD-ROM, RAM, ROM, memory card, hard disk, magneto-optical disk, storage device, etc.) Lt; / RTI >

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood that various modifications and changes may be made without departing from the scope of the present invention.

100: adaptive streaming video server 110: situation information analysis module
120: Context information insertion module 130: Content transcoding module
140: Content Segmenting Module
200: adaptive video streaming playback device
210: playback device characteristic recognition module 220: content characteristic recognition module
230: Network aware module 240: Metadata analysis module
250: Segment request module

Claims (13)

A transcoding and a segment function for an adaptive streaming service based on context recognition upon completion of content generation by applying adaptive video streaming technology or context recognition based on context input upon external input, and converting the adaptation streaming format into an adaptive streaming format, After the analysis, the video content is transcoded, the content is transcoded based on the context information, the transcoded contents are segmented, the metadata for displaying the content information and the URL of each segmented content is generated, An adaptive video streaming server for inserting and transmitting context information including metadata and metadata (ID) of the coded segmented video content; And
Network, and contents through the wired / wireless network and analyzing the network characteristics of the server of the meta data, the playback device itself information, and the content characteristics to determine the network bandwidth, A context-aware adaptive video streaming playback device for requesting a segment of a playable content and a segment of an appropriate quality for performing seamless streaming based on content characteristics to guarantee quality of service (QoS / QoE)
The metadata includes network information of the server including the URL of the server for the context-aware adaptive streaming service, the maximum bandwidth of the server, the minimum bandwidth, and the maximum number of connectable playback devices, and the bit rate, frame rate, And reproduction apparatus information including a maximum resolution, a minimum resolution, and a reproduction apparatus type of the reproduction apparatus,
The status information includes an IP address and network information of a router connected to the server and a network, an IP address and playback apparatus information of the playback apparatus, a content ID, and content information,
The context-aware adaptive video streaming playback apparatus includes a playback device characteristic including a type of playback device, a resolution of the playback device, a device type, a resolution, a main storage device performance, and a central processing device performance and a content ID, a segment size, , A content characteristic including a frame rate, and a network content characteristic of a server including a URL of the server, a maximum bandwidth of the server, a minimum bandwidth, . The method according to claim 1,
The adaptive video streaming server
Network characteristics that analyze the server's maximum bandwidth, minimum bandwidth, and the maximum number of playback devices that can connect to the server, content that analyzes the frame rate, bit rate, and size per segment of content that has been transcoded and segmented A characteristic recognition function, and a playback device characteristic analyzing type of playback devices, such as a maximum resolution, a minimum resolution, and the like in a pre-input playback device so that the playback device can play back an appropriate quality content. module;
The context information insertion module inserts additional context information into the metadata of the transcoded and segmented contents, and the context information insertion module executes the context information insertion module when the content is segmented and the metadata is generated.
A content transcoding module for transcoding relatively low quality content in the highest quality original content considering network characteristics, content characteristics, and playback device characteristics analyzed by the situation information analysis module; And
A content segmentation module for segmenting the transcoded content and generating metadata indicative of content information and a URL of each segmented content;
And a content packaging system for context aware adaptive streaming service. The method according to claim 1,
The context-aware adaptive video streaming playback apparatus
The server requests and receives metadata from the server at the beginning of the streaming session and analyzes the resolution, the device type, and the codec performance of the playback apparatus to generate a list of contents excluding video having a quality exceeding the resolution and the codec performance of the playback apparatus, A playback device characteristic module that monitors the main storage device performance and the central processing device performance during streaming to remove from the list contents that are difficult to perform rendering operations;
A module for analyzing a segment size, a bit rate, and a frame rate based on the analyzed metadata information;
A network aware module that measures bandwidth by the size of a segment and the delay that occurs upon reception each time a segment is requested and received during streaming;
A metadata analysis module for requesting and receiving metadata of contents at the beginning of a streaming session and storing the metadata in the metadata buffer; And
Requesting a segment of a proper quality for seamless streaming based on the network bandwidth measured by the network recognition module, the playback device characteristic list, the content list reproducible by the module, and the content characteristic analyzed by the content characteristic recognition module A segment request module;
And a content packaging system for context aware adaptive streaming service. delete delete The method according to claim 1,
The adaptive video streaming server
Context-based adaptive streaming service, context information for context-aware adaptive streaming service is inserted into metadata including information of context-aware adaptive streaming service. delete The method according to claim 1,
(The resolution, the main storage device function, the central processing unit performance, the device type, the codec performance), the network characteristics of the server (the maximum bandwidth of the server, the minimum Wherein the optimal video quality is determined based on the content characteristics (segment size, bit rate, frame rate), and the measured bandwidth. . (a) an adaptive video streaming server includes a transcoding and segmenting function for adaptive streaming service based on adaptive video streaming technology and upon completion of content creation or context recognition upon external input, and is converted into an adaptive streaming format After analyzing the status information of the network, the playback apparatus and the content, the video content is transcoded, the content is transcoded based on the context information, and the content information and URL of each segmented content are displayed after segmenting the transcoded contents And a step of inserting and transmitting context information including an identifier (ID) and meta data of the video content in which the transcoded segment has been completed. And
(b) context-aware adaptive video streaming playback device collects context information of terminal, network, and contents through wired / wireless network and analyze network characteristic, playback device self information and contents characteristic of metadata server, (QoS / QoE) by requesting segments of appropriate quality to perform seamless streaming based on network bandwidth, reproducible content list, and content characteristics measured through device awareness and content awareness Comprising two steps,
The metadata includes network information of the server including the URL of the server for the context-aware adaptive streaming service, the maximum bandwidth of the server, the minimum bandwidth, and the maximum number of connectable playback devices, and the bit rate, frame rate, And reproduction apparatus information including a maximum resolution, a minimum resolution, and a reproduction apparatus type of the reproduction apparatus,
The status information includes an IP address and network information of a router connected to the server and a network, an IP address and playback apparatus information of the playback apparatus, a content ID, and content information,
The context-aware adaptive video streaming playback apparatus includes a playback device characteristic including a type of playback device, a resolution of the playback device, a device type, a resolution, a main storage device performance, and a central processing device performance and a content ID, a segment size, Content content for content-aware adaptive streaming services that analyze the network characteristics of the server, including the content characteristics including the frame rate, and the URL of the server, the maximum bandwidth of the server, the minimum bandwidth, Streaming method. 10. The method of claim 9,
In the first step,
(a1) a network characteristic recognition function for analyzing a maximum bandwidth, a minimum bandwidth, and a maximum number of playback devices that can be connected to the server by a situation information analysis module, a frame rate and a bit rate of content that has been transcoded and segmented A content characteristic recognition function for analyzing the size per unit segment, and a playback device for analyzing the type of playback devices, such as maximum resolution, minimum resolution, and types of playback devices pre-input so that the playback device can play back content of appropriate quality Performing a characteristic recognition function;
(a2) inserting additional context information into the metadata of the content that has been transcoded and segmented by the context information insertion module, and embedding the context information is performed at the time when the content is completed up to the segmentation and the metadata is generated;
(a3) transcoding relatively low quality contents in the highest quality original content considering the network characteristics, content characteristics, and playback device characteristics analyzed by the context information analysis module by the content transcoding module; And
(a4) segmenting the content transcoded by the content segmenting module and generating metadata indicating content information and a URL of each segmented content;
A content packaging and streaming method for context aware adaptive streaming service. 10. The method of claim 9,
The second step
(b1) a playback device characteristic recognition module for requesting and receiving metadata from the server at the beginning of the streaming session, and analyzing the resolution, the device type, and the codec performance of the playback device, A step of generating a list of contents excluding videos and monitoring the performance of the main storage device and the performance of the central processing unit during streaming to remove contents that are difficult to be rendered from the list so that they can not be requested;
(b2) analyzing the segment size, the bit rate, and the frame rate based on the metadata information analyzed by the content property recognition module;
(b3) measuring a bandwidth by a size of a segment and a delay occurring upon reception each time a segment is requested and received during a streaming operation by the network aware module;
(b4) requesting and receiving metadata of the content at the beginning of the streaming session by the metadata analysis module, and storing the metadata in the metadata buffer; And
(b5) performing seamless streaming based on the network bandwidth measured by the network recognition module by the segment request module, the list of contents reproducible by the playback device characteristic module, and the content characteristic analyzed by the content property recognition module Requesting a segment of an appropriate quality;
A content packaging and streaming method for context aware adaptive streaming service. delete delete

Images