KR20170065915A

KR20170065915A - Streaming equipment supporting real-time multi-media transcoding with distributed processing system and general purpose graphic processing unit computing

Info

Publication number: KR20170065915A
Application number: KR1020150172281A
Authority: KR
Inventors: 박중언
Original assignee: 박중언
Priority date: 2015-12-04
Filing date: 2015-12-04
Publication date: 2017-06-14

Abstract

The present invention relates to a service for streaming various multimedia streaming contents provided through a wired / wireless communication network such as the Internet in real time by encoding and transcoding all the devices, and a system therefor. The client includes a personal computer (PC) A step of transmitting information of a specific moving picture to a web server of a service, a step of returning division information of a suitable moving picture by the web site, a step of dividing the moving picture according to the meta data received from the server, Uploading a divided moving image to a plurality of distributed servers specified in the metadata, and allowing the servers constituting the distributed processing system to individually encode and transcode divided videos using hardware acceleration using a GPU So that the personal computer, the notebook A mobile device (Android, ISO) and hardware devices that are suitable for splitting, service transcoded stream content from any device accessible to a web browser device.

Description

TECHNICAL FIELD [0001] The present invention relates to a real-time transcoding supporting streaming apparatus and a real-time transcoding supporting real-time multi-media transcoding system using general-purpose GPU technology,

The present invention relates to a system and an apparatus for a system capable of streaming various multimedia streaming contents provided through a wired / wireless communication network such as the Internet through all the apparatuses in real time through encoding and transcoding, Real-time streaming technology for multimedia contents, and GPGPU technology.

The service of the present invention includes a step in which a client transmits information of a specific moving picture through a personal computer (PC) to a web server of the service through a web browser, and a step in which the web server returns divided information of the moving image Dividing the moving picture according to the metadata received from the server by the client and uploading the divided moving picture to a plurality of distributed servers specified in the metadata, Encoding and transcoding the divided moving pictures using hardware acceleration using the GPU so that all the devices accessible to the web browser such as personal PC, notebook, mobile device (Android, ISO) If the streaming content is split or transcoded properly, A comprise.

In recent years, the Internet speed of the wired / wireless network, that is, the transmission bandwidth, has been increased, and there is an increasing tendency that the users can stream multimedia files and the like in real time. In this case, streaming is performed in such a manner that audio data or video data (moving image data) having a large size are not entirely downed and executed but are transmitted in real time in succession to a plurality of files. In order to listen to or display such audio files or video files in a streaming format, some application software must be embedded in the client's device. However, in order to exchange multimedia information with users having different terminals, it is necessary not only to solve the transmission speed problem of the communication network but also to exchange multimedia information in different ways according to characteristics of various terminals. In other words, if the file is not a file that has already been converted into a format corresponding to the device, that is, a file owned by an individual may not be reproduced according to the device. This is a difference in the multimedia reproduction method of the device. The difference in extension, picture quality, and codecs causes this problem. In order to solve this problem, the multimedia contents are converted according to the characteristics of the terminal, and the technology is referred to as transcoding.

A distributed processing system refers to a system that enables distributed processing. It refers to a system in which functions that were conventionally processed or controlled by a central processing unit are distributed to a plurality of processing units, or distributed to a fat that was concentrated in the central processing unit. It is used to distribute the risk from the destruction due to the scalability of the system and the dispersion of the resources, or as a reason for accomplishing the task at a high speed by distributing large work.

A GPU (GPUGPU) is a general purpose graphics processing unit (GPU) that uses the power of a powerful GPU to process general data as well as graphics processing. Parallel processing and 3D graphics processing are similar. In 3D graphics, processing such as pixel coordinates, rendering, video encoding, and image scaling are similar to general purpose parallel processing in that many data are quickly computed using multicore or accelerators. GPGPU is a GPGPU that utilizes this similarity to use powerful GPU performance for data parallel processing such as general signal processing, physical simulation, financial prediction, and biological calculation.

(Transcoder Department) KR10-0876017B1 (Transcript section)

Vetro, Anthony, Charilaos Christopoulos, and Huifang Sun. "Video transcoding architectures and techniques: an overview." Signal Processing Magazine, IEEE 20.2 (2003): 18-29. Ho, Chi-Wang. "Fast video transcoding and graphics hardware acceleration." (2006).

The present invention is applicable to electronic devices capable of playing various videos such as personal computers, notebook computers, mobile devices, navigation devices, and the like, because it is possible to reproduce only multimedia contents in the form supported by devices. It is aimed at solving problems that require a process.

The present invention relates to a method and system for a client to transmit information of a specific moving picture through a personal computer (PC) to a web server through a web service operated by the service, The method comprising the steps of: dividing a moving image according to meta data received from the server and uploading a divided moving image to a plurality of distributed servers specified in the meta data; Encoding and transcoding the divided moving pictures using hardware acceleration so that all devices accessible to a web browser such as a personal computer, a notebook computer, a mobile device (Android, ISO) It consists of a step of receiving divided and transcoded streaming contents. There are those characterized by that machine to run the software.

The present invention realizes the process of converting a multimedia file into a format suitable for a device for reproducing the content and providing all of the processes by streaming it in a web browser. Thus, in general, a user of the multimedia content has a multimedia file And a multimedia file format corresponding to a device supported by the PC through the PC in order to view the multimedia file, for example, an extension such as .mp4, .avi, a codec, a picture quality, etc. The process can be omitted. In addition, the multimedia content consumer can watch multimedia files that he / she has in his / her personal computer or contents to be shared by other consumers in real time from all the devices he / she desires and can watch them. When the transcoding of all the files ends, Can be merged into a single file and downloaded.

FIG. 1 is a flow chart
2 is a structural view of an overall system used in the present invention;

The present invention will now be described in detail with reference to the accompanying drawings.

2 shows an example in which a personal PC 101 is connected to a schedule server 102 to upload a multimedia file to a plurality of distributed processing servers 103 and various electronic apparatuses 104 (PC, notebook, mobile, etc.) FIG. 3 is a block diagram illustrating a process of streaming or downloading encoded multimedia content from the distributed processing server or distributed merge server 105. The personal computer transmits information about the multimedia content to the schedule server, It returns specification and upload command of multimedia file to personal PC so that information can be processed in distributed processing servers in real time. The specification includes what size the video should be divided into and which distributed processing server it should be uploaded to. The personal PC receives the specification and divides the video as it is by time, and uploads the files sequentially to the set of distributed processing servers according to the upload command received from the schedule server. Here, the distributed processing server receives a piece of the existing multimedia file and transcodes the target video into a target video. In this process, the distributed processing server must have a GPU device installed therein. Based on the server's load condition, it performs transcoding faster than CPU-based encoding through CPU-based transcoding or GPGPU operation. GPGPU technology is supported by hardware such as Nvidia's nvenc or Intel's quick sync. When the transcoding ends, each of the distributed processing servers informs the schedule server that the work of the transcoded video is completed, and accordingly the schedule server transmits the upload command for the subsequent video to the personal PC again. Here, the consumer of the multimedia contents (hereinafter referred to as " content consumer ") using various devices receives the specification for the streaming playback from the schedule server. This specification is similar to the specification that the schedule server sent to the personal PC and contains information about which distributed content server has been uploaded to the distributed processing server. After the content consumer's device receives this information, each transcoded video is continuously played back. This process is based on the HLS protocol for multimedia content playback, and chrome, Windows, Safari, and Android mobile browsers can run without any problems in the web browser. Through the above process, the user can stream the multimedia contents even if the entire contents are not uploaded, and can share the contents with others through the url.

Here, when the user wishes to download a merged file rather than streaming, a streaming file divided into a plurality of files is transmitted to the merging server, merged into a single file in accordance with the order, To be downloaded via a web connection.

Next, in the case of FIG. 1, this process is shown. The step (1) of uploading the specification of the multimedia contents to the schedule server and the step (2) of interpreting and returning the schedule contents to the schedule server are executed. Here, the header part of the multimedia contents is checked, It is determined whether the upload (4) of the multimedia file divided according to whether the multimedia file is (3) and the transcoding (5) using the GPGPU operation should be executed. As a result, the device 6 of the content consumer shows a process of streaming the multimedia contents from the distributed servers. Then, if the content consumer desires (7) the files can be merged and downloaded from the merge server (8)

1: Upload the specification of multimedia contents (information of video and sound file) to schedule server
2. Confirm that the content was uploaded in the past through the specification of multimedia contents.
3: Branching according to whether content was uploaded in the past
4: Split and upload files from personal PC
5: Transcoding using GPGPU operation
6: Content users receive streaming multimedia content
7: Branch according to whether or not to download transcoded multimedia contents
8: Collect files from the distributed processing server to the merge server, and merge them into one file to provide downloading to the user
101: Personal PC
102: a schedule server 102;
103: One or more distributed processing servers (103)
104: Various electronic devices (104) (PC, notebook, mobile, etc.)
105: merge server

Claims

A step of transcoding and streaming multimedia contents (video, sound source) existing in a personal PC by uploading to a server,
A step of dividing the moving image into time units and uploading the divided moving images to a plurality of distributed servers in the uploading step,
Performing transcoding through the GPGPU technique in the process of transcoding the multimedia contents in the transcoding process,
Wherein the multi-media file is streamed after the content consumer's device (all devices connectable to the web browser) has been transcoded after the division in the distributed servers, and the multi-media file is streamed through the general purpose GPU technology Streaming device supporting multimedia real-time transcoding

The method according to claim 1,
Checking whether contents uploaded by the personal PC are overlapped with contents that have been uploaded and transcoded for a predetermined period in the transcoding process;
If the uploaded content does not overlap with the previously requested content, transmitting the content on the web, transcoding the content in real time, and transmitting the content to the device of the content consumer;
Wherein when a transmission stop request of the content content occurs while the personal pc is transmitting the transcoded content, the transcoding priority of the content is lowered, and the content is transcoded to the end and then stored in the server. Streaming device

3. The method of claim 2,
In the uploading process, a multimedia content file is divided into variable time units according to a predetermined upload schedule in consideration of the performance and efficiency of the distributed processing servers and the internet situation of the user, Real-time transcoding and streaming device including uploading process

3. The method of claim 2,
Simultaneously using the GPU when the speed is prioritized according to the degree of load of the CPU and the GPU device of the always distributed processing server and the preference of the content user in the process of transcoding the GPU device;
And performing transcoding using only the CPU device when the quality is important.

The method according to claim 1,
When the content consumer wants to receive the converted file as a file, not as a streaming, in the step of uploading and transcoding the file to the distributed processing server, transferring the divided file to the merge server;
Merging a plurality of files divided for streaming in a merging server into one file;
And transmitting the converted data to a user through a web connection to a file. The streaming device supports real-time transcoding.