KR100802091B1 - Method and system for multi-outputing multimedia data - Google Patents

Abstract

A method and a system for multi-outputting multimedia data are provided to convert at least one multimedia data into multimedia data with at least one encoding type by an encoding unit, thereby receiving multimedia data with a single bit rate and outputting at least one multimedia data with various bit rates. A method for multi-outputting multimedia data comprises the following steps of: receiving real-time broadcasting data with a single bit rate(210); reproducing the real-time broadcasting data into at least one real-time broadcasting data(240); converting the reproduced real-time broadcasting data into different formats(250); and encoding the converted real-time broadcasting data by using plural codec(270).

Description

Method and system for multi-outputting multimedia data

1 is a view briefly illustrating a process of transmitting multiple output multimedia data to a terminal according to an embodiment of the present invention.

2 is a flowchart illustrating a multiple output method of moving image data according to an exemplary embodiment of the present invention.

3 is a diagram illustrating a frame reconstructing video data by selectively selecting a frame of video data according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating a multiple output method of voice data according to an exemplary embodiment of the present invention.

Figure 5 is a block diagram showing the configuration of a multiple output system according to an embodiment of the present invention.

The present invention relates to a method and system for multiple output of multimedia data. More particularly, the present invention relates to a method for transmitting and receiving a multimedia data and a variety of bit rates, resolutions, frame rates and encoding types. The present invention relates to converting and outputting a plurality of multimedia data having a.

Recently, a server providing video content uses various video compression methods to provide high capacity content to a terminal connected through a communication network. In this case, since the bit rate of the video is compressed using a fixed bit rate designated by the content providing server or the terminal, the same quality can be obtained by receiving one video data.

One video output having the same quality according to one video input has a limitation on its application field when several users who want to simultaneously use different communication environments.

In addition, when the state of the communication network worsens according to the movement of the location of the same user, inconvenience may occur to a user who wants to watch a video in real time due to a decrease in transmission speed of video data.

In addition, when the video encoding codec type on the server side and the decoding codec type on the client side are different, there is a problem in that the video transmitted to the terminal cannot be played.

Currently, this problem is solved through the construction of new equipment, but there is a problem that the construction of a new system is expensive.

In order to solve the above-described problems, the present invention proposes a method and system for multiple output of one or more multimedia data having various bit rates by receiving multimedia data having a single bit rate.

Another object of the present invention is to provide a method and system for multiple output of multimedia data encoded with one or more codecs for perfect reproduction of multimedia data transmitted to a terminal.

It is still another object of the present invention to receive a multimedia data having a single bit rate in one system without constructing an additional system, and to convert the multimedia data having one or more multimedia data having various resolutions and frame rates and outputting the multimedia data. And to provide a system.

Still other objects of the present invention will be readily understood through the following description of the embodiments.

In order to achieve the above object, according to an aspect of the present invention, the multiple output method of the multimedia data performed in the multiple output system comprises the steps of: (a) receiving multimedia data having a single bit rate; (b) replicating the multimedia data into one or more multimedia data; (c) converting the copied multimedia data into different formats; And (d) encoding the converted multimedia data using a plurality of codecs.

According to another aspect of the present invention, for multiple output of multimedia data performed in a multiple output system, a program of instructions that can be executed by a digital processing apparatus is tangibly embodied and can be read by a digital processing apparatus. A method comprising: (a) receiving multimedia data having a single bit rate; (b) replicating the multimedia data into one or more multimedia data; (c) converting the copied multimedia data into different formats; And (d) encoding the converted multimedia data using a plurality of codecs.

According to another aspect of the present invention, a multiple output system includes a data receiver for receiving multimedia data having a single bit rate; (b) a data replication unit for replicating the multimedia data into one or more multimedia data; (c) a data format converter for converting the copied multimedia data into different formats; And (d) an encoding unit for the converted multimedia data using a plurality of codecs.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing the drawings, similar reference numerals are used for similar elements.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

 Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, the same reference numerals will be used for the same means regardless of the reference numerals in order to facilitate the overall understanding.

1 is a diagram briefly illustrating a process of transmitting multiple output multimedia data to a terminal according to an exemplary embodiment of the present invention.

As shown in FIG. 1, the multiple output system 100 receives input multimedia data having a single bit rate, converts the multimedia data into a plurality of video data having different formats, and outputs the same to the streaming server 110. The streaming server 110 receiving the multimedia data transmits the received multimedia data to the terminal 130 connected through the communication network 120. Here, the multimedia data may include at least one of video data and audio data. In addition, the transmission of the multimedia data may be made in a streaming manner. Hereinafter, the operation of the multiple output system 100 will be briefly described by dividing the case where the multimedia data is the video data or the audio data.

The multiple output system 100 may convert the video data having a single bit rate into a plurality of video data encoded with different bit rates, resolutions, frame rates, and various codecs and output the same to the streaming server 110. Here, the video data having a single bit rate input to the multiple output system 100 may be a signal input from an analog / digital video camera or a broadcast signal such as a terrestrial broadcast or a DMB signal, but the present invention is not limited thereto.

In addition, the multiple output system 100 may convert voice data having a single bit rate into a plurality of voice data encoded by various codecs and output the converted voice data to the streaming server 110. Here, the voice data input to the multiple output system 100 may be a signal input as an independent signal or mixed with video data. When the voice data is a mixed signal with the video data, the multiple output system 100 may separate the voice data from the video data, and the separated voice data may be converted into a plurality of voice data encoded by various codecs to be used in a streaming server ( 110) may be output. In addition, the video or audio data output to the streaming server 110 may be packetized. The multiple output method of video and audio data will be described in detail with reference to FIGS. 2 and 3.

The communication network 120 may be a wired / wireless communication network, and since the description of the communication network 120 is somewhat distance from the present invention, detailed description thereof will be omitted.

The terminal 130 may be applied without limitation as long as the terminal includes a communication means and is capable of transmitting and receiving video and audio data with the communication network. That is, a cellular phone, a PCS phone, a PDA phone and the like are typical examples, but the present invention is not limited thereto.

In FIG. 1, the streaming server 110 is illustrated as a separate device. However, according to an exemplary embodiment of the present invention, the streaming server 110 may be a component of the multiple output system 100. In this case, the multiple output system 100 may perform the function of the streaming server.

2 is a flowchart illustrating a multiple output method of moving image data according to an exemplary embodiment of the present invention.

Referring to FIG. 2, in operation 210, the multiple output system 100 receives video data having a single bit rate. Since the input video data may be input through various media, the present invention is not limited to a specific media. For example, the video data may be a signal directly input from an analog or digital camera. In this case, the input video data may be converted into a plurality of video data having different formats and then transmitted in real time to the connected terminal 130 through the communication network 120. In addition, the video data may be a broadcast signal such as a terrestrial broadcast or a DMB signal that is directly received in real time. In this case, in order to receive the broadcast signal, the multiple output system 100 should have an analog tuner or a digital tuner. In addition, the video data may be data that is input in advance and stored in the data storage of the multiple output system 100.

In operation 220, the multiple output system 100 determines whether the input video data is in an analog format. If the video data is determined to be in an analog format, the process proceeds to step 230, and the video data is converted into a digital format.

In operation 240, the multiple output system 100 replicates the input video data into one or more video data. Here, the copied video data may have the same bit rate as the input data or may have different bit rates. In addition, the duplicated video data may be at least one of RGB and YCbCr data formats. In addition, the number of copies of the video is not limited, but may be determined according to the number of terminals that want to stream live video.

In operation 250, the multiple output system 100 may convert the resolution of the copied video. Here, the resolution conversion may be to convert the size of the duplicated video data based on the maximum frame size data of the duplicated data format (eg, RGB, YCbCr data format, etc.). In addition, the conversion of the resolution may be performed both of the pixel resolution and image resolution conversion, or only one of the two.

Pixel resolution (= bit resolution) is the number of colors used to make a pixel. For example, 1 bit represents the information that a pixel contains in black and white. In addition, 8 bits can express 256 colors of 8 powers of 2, and 24 bits can express 1677.777,216 colors of 2 powers of 2. Therefore, the plurality of duplicate video data may be changed to various data through color resolution conversion. Of course, the bit rate of the video data will be different according to the pixel resolution conversion.

The image resolution refers to how many pixels a single moving image is composed of and closely related to the capacity of moving image data. The higher the pixel resolution, there is an advantage of expressing a high-definition video image, but the number of pixels per inch increases the data capacity is larger. Therefore, the plurality of moving image data may be converted into data having various bit rates suitable for the purpose through image resolution conversion. For example, if the maximum bit rate of the input video data is 1024 and image resolution is converted to 8 channels, 64, 128, 192, 256, 320, 384, 448, 512, 576, 640, 704, 768, 832 , 896, 960, and 1024 can be converted into video data having a bit rate.

If the pixel resolution change and the image resolution change are applied at the same time, the video data having more various bit rates may be obtained. That is, even if the duplicated video has the same pixel resolution, each video data may have a different bit rate when the image resolution is superimposed.

In operation 260, the multiple output system 100 selectively reconstructs the video data by selectively selecting a frame of the video data whose resolution is converted. That is, a video having a different bit rate by selecting at least one video data among a plurality of video data whose resolution is converted, and selectively selecting and reconstructing a specific frame capable of constructing a video independently included in the selected video data Data can be obtained. FIG. 3 illustrates a frame in which video frames are reconstructed by selectively selecting frames of video data, and an identification code 310 represents video data in which frames are not reconstructed. The identification code 320 indicates moving picture data configured by selecting only an odd number frame among the moving picture data frames. That is, the even frame of the video data is removed. Therefore, the bit rate of the video data can be reduced to 50%. Identification code 330 denotes a frame of video data corresponding to a multiple of three, identification code 340 denotes a frame of video data corresponding to a multiple of four, identification code 350 denotes a frame of video data corresponding to a multiple of five, and identification code 360 indicates that frames of video data corresponding to multiples of six are removed. Therefore, the bit rate can be lowered corresponding to removing frames from moving image data. Of course, the frame reconstruction of the video data shown in FIG. 3 is only an example and the present invention is not limited thereto. In addition, it is obvious that video data reconstructing a frame should be able to independently compose an image.

In operation 270, the multiple output system 100 encodes video data reconstructed using a plurality of codecs. In this case, video data having the same resolution, frame rate, etc. can be encoded using different codecs. Therefore, since the data transmitted to the terminal 130 cannot be reproduced because the codec type does not match, the communication resource can be saved. In addition, the user of the terminal 130 can eliminate the risk of paying unnecessary communication fees and information usage fee. In addition, since the bit rate of the video data can be adjusted according to the option of the encoding codec, it is possible to obtain video data having various bit rates. That is, even after encoding video data having the same bit rate, the bit rate may be different according to encoding options. Here, the codec may be DivX, Mpeg4, Xvid, WMV, X246, and the like, but the present invention is not limited thereto. In addition, the number or type of codecs mounted in the multiple output system 100 may be variously selected according to the state of the communication network 120 or the request of the user of the terminal 130.

In addition, the multiple output system 100 may include a multi-encoder including a plurality of codecs. In this case, the multi-encoder may drive threads for each codec to encode a plurality of video data at the same time.

In operation 280, the multiple output system 100 may packetize the plurality of encoded video data and transmit the packetized data to the streaming server 110.

4 is a flowchart illustrating a multiple output method of voice data according to an exemplary embodiment of the present invention.

Referring to FIG. 4, in operation 410, the multiple output system 100 receives voice data having a single bit rate. Since the input voice data may be input through various media, the present invention is not limited to a specific media. For example, the voice data may be a signal directly input through a voice recognition microphone of an analog or digital camera. In this case, the input voice data may be converted into one or more voice data having different formats and then transmitted in real time to the connected terminal 130 through the communication network 120. In addition, the voice data may be a broadcast signal such as a terrestrial broadcast or a DMB signal that is directly received in real time. In this case, in order to receive the broadcast signal, the multiple output system 100 should have an analog tuner or a digital tuner capable of receiving a voice signal. Also, the voice data may be data input in advance and stored in the data storage of the multiple output system 100.

Also, the voice data may be a signal mixed with video data input to the multiple output system 100. In this case, the multiple output system 100 needs to separate the voice data from the video data in order to convert the voice data into a plurality of voice data having different formats. Thus, the multiple output system 100 may include a demultiplexer Demux that separates the mixed signals.

In operation 420, the multiple output system 100 determines whether the input voice data is in an analog format. If the voice data is determined to be in an analog format, step 430 is performed to convert the voice data into a digital format and then step 440 is performed.

The voice data converted to the digital format may be in a pulse code modulation format. PCM is a digital coding method that converts the instantaneous magnitude of an analog signal into a code string of fixed length. This is a typical method of converting an analog signal with temporal continuity into a discrete javascript: winPopup ('1', '9549') "digital signal. In general, sampling and sampling an analog signal only by a clock period is necessary. After that, YPERLINK "javascript: winPopup ('1', '1463')" is quantized and represented by a numerical value, and the encoding method is represented by a binary bit string corresponding to the value. If you sample at a frequency that is more than twice the frequency of the highest: winPopup ('1', '16843') "signal, the sample contains all the information the original signal has. Therefore, in the telephone, the 8-bit code is converted to 8KHz speed every second, and the speed is 64kbps. In the audio of TV broadcasting, the 16-bit code of the stereo two channel is converted to 48KHz speed and becomes 1.536kbps.

In operation 440, the multiple output system 100 replicates the input voice data into one or more voice data. Here, the duplicated voice data may have the same bit rate as the input data or may have different bit rates. In addition, although the number of copies of the audio data is not limited, it may be desirable to coincide with the number of duplicate video data corresponding to the audio data.

In operation 450, the multiple output system 100 encodes the copied speech data using a plurality of codecs. In this case, voice data having the same bit rate can also be encoded using different codecs. Therefore, since the data transmitted to the terminal 130 cannot be reproduced because the codec type does not match, the communication resource can be saved. In addition, the user of the terminal 130 can eliminate the risk of paying unnecessary communication fees and information usage fee. In addition, since the bit rate of the encoded voice data can be adjusted according to the option of the codec, it is possible to obtain voice data having more various bit rates. That is, even after encoding the voice data having the same bit rate, the bit rate may vary depending on the encoding option. In addition, the number or type of codecs mounted in the multiple output system 100 may be variously selected according to the state of the communication network 120 or the request of the user of the terminal 130. In addition, the multiple output system 100 may include a multi-encoder including a plurality of codecs. In this case, the multi-encoder may drive a thread for each codec in order to simultaneously encode a plurality of voice data.

In operation 460, the multiple output system 100 may packetize and transmit the encoded plurality of voice data to the streaming server 110. In this case, the streaming server 110 receiving the packetized voice data may transmit the mixed voice data and the corresponding video data into a mixed signal to the terminal 130 connected through the communication network 120. In addition, the video and audio data may be separately transmitted to the terminal 130. In this case, the terminal 130 may play the video by synchronizing the video data and the voice data.

5 is a block diagram illustrating a configuration of a multiple output system according to an exemplary embodiment of the present invention.

As shown in FIG. 5, the multiple output system 100 includes a controller 510, a data receiver 520, an AD converter 530, a data replicater 540, a data format converter 550, and data storage. The module 560 may include an encoder 570, a packetizer 580, and an interface 590.

The controller 510 is configured to convert the input video and audio data into a plurality of video and audio data having various formats. The data receiver 520, the AD converter 530, the data replicater 540, and the data format converter 550, a data storage unit 560, an encoding unit 570, and the like.

The data receiver 520 receives multimedia data having a single bit rate. As described above, the input multimedia data may be input through various media. Here, the input multimedia data may include at least one of video data and audio data. The input multimedia data may include a demultiplexer (Demux) for separating the video data and the audio data when the input multimedia data is a mixed signal of the video data and the audio data. Here, the demultiplexer may be included as individual components of the multiple output system 100.

The AD converter 530 determines whether the input multimedia data is a digital format or an analog format, and when the data is determined to be an analog format, converts the analog format data into the digital format data. Of course, if the input multimedia data is digital data, the AD converter 530 may be excluded from the components of the multiple output system 100.

The data replication unit 540 replicates the multimedia data into one or more multimedia data. The data replica unit 540 may configure a direct show filter to obtain as many outputs as the required specification. The duplicated multimedia data may be at least one of RGB and YCbCr data formats. In addition, the duplicated multimedia data may have the same bit rate as the input data. That is, the data replication unit 540 may perform a function of increasing only the number of identical multimedia data.

The data format converter 550 is a component that converts the copied multimedia data bit rate, resolution, and frame. Among the bit rate converter 551, the resolution converter 552, and the frame rate converter 553. It may include at least one. The multimedia data may include at least one of video data and audio data. Hereinafter, the video data will be described in detail as an example.

The bit rate converter 551 converts the bit rate of the copied video data. In FIG. 5, the bit rate converter 551 is represented as a component of the data format converter 550. However, the bit rate converter 551 may be a component of the data copy unit 540 to perform a function of converting a bit rate in a data copy process. have.

The resolution converting unit 552 converts the resolution of the copied video data, respectively. The resolution converter 552 receives data of the maximum frame size of the duplicated data format (for example, RGB, YCbCr data format, etc.) to meet the output requirements of various video data, and then sizes it for each output setting. It can be converted into and stored in each ring buffer. That is, the resolution converter 552 may perform a function of converting the size of the copied video data based on the maximum frame size data of the copied data format.

In addition, the conversion of the resolution may be performed both of the pixel resolution and image resolution conversion, or only one of the two. In this case, the resolution converter 552 may convert both the pixel resolution and the image resolution of the video data, or may perform only one of the two conversions as necessary. For example, if the input video data is a color image but a black and white image is required, this can be obtained by converting the pixel resolution. Of course, pixel resolution conversion may also be made to have a color image different from the input color image. However, it is obvious that the pixel resolution conversion cannot be higher than the maximum resolution of the input video.

The frame rate converter 553 selects at least one video data from among the plurality of video data, and selectively selects and reconstructs a specific frame capable of constituting an independent video included in the selected video data, thereby reconstructing different bit rates. Performs a function of generating moving image data. The frame rate converter 553 receives data at a maximum input frame rate in order to satisfy various video frame rate output requirements, and stores the data in each ring buffer (not shown) to fit each output setting. It may include a frame rate selector (not shown) for providing a frame rate. A detailed description of the reconstruction of the frame is omitted since it has been described above.

The data storage unit 560 stores various programs for controlling the operation of the multiple output system 100 according to the present invention. In addition, the above-described components may perform a function of a buffer for temporarily storing data for data transmission between the components, and may be preferably a ring buffer.

The encoding unit 570 converts one or more multimedia data into multimedia data having one or more encoding types. Therefore, it is impossible to decode the data transmitted to the terminal 130, thereby preventing waste of communication resources. Of course, it is obvious that data encoded and transmitted to the terminal 130 should be encoded in a type that can be decoded by a decoder included in the terminal 140. In addition, the encoder 570 may include a multi-encoder supporting one various codec type. In this case, the multi-encoder may drive threads for each codec in order to simultaneously encode a plurality of video and audio data.

The packetizer 580 performs a function of packetizing each data in order to transmit a plurality of encoded video and audio data to the streaming server 110.

The interface unit 590 is a component for transmitting and receiving data with the streaming server 110. As described above, when the multiple output system 100 performs the function of the streaming server 110, the interface unit 590 may perform a function of transmitting and receiving data with the terminal 130 through the communication network 120.

All components of the multiple output system 100 shown in FIG. 5 need not necessarily be implemented in hardware, and some components (for example, the data replica unit 540 and the data format converter 550). It is obvious that may be implemented in the form of an application

Preferred embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. Additions should be considered to be within the scope of the following claims.

As described above, the method and system for multiple output of multimedia data according to the present invention have the effect of receiving multimedia data having a single bit rate and outputting one or more multimedia data having various bit rates.

In addition, the multiple output method and system of multimedia data has the effect that the output of the multimedia data encoded in one or more codecs.

In addition, the multiple output method and system of multimedia data can be output by converting the multimedia data having a single bit rate from one system into one or more multimedia data having various resolutions and frame rates without constructing an additional system. There is.

Claims (15)

In the multiple output method of the multimedia data performed in the multiple output system, (a) receiving real time broadcast data having a single bit rate; (b) replicating the real time broadcast data into one or more real time broadcast data; (c) converting the copied real-time broadcast data into different formats; And (d) encoding the converted real-time broadcast data using a plurality of codecs. The method according to claim 1, Step (c) is a method of multiple output of multimedia data, characterized in that for converting at least one of bit rate, resolution and frame rate. The method according to claim 2, The duplicated real-time broadcast data is at least one of RGB and YCbCr data formats, and when converting the resolution, step (c) determines the size of the replicated real-time broadcast data based on the maximum frame size data of the data format. Multiple output method of the multimedia data, characterized in that for converting. The method according to claim 2, In the case of converting the frame rate, the step (c) may include selecting at least one real time broadcast data from the replicated real time broadcast data, and selectively selecting a specific frame included in the selected real time broadcast data. Reconstructing the multi-output method of the multimedia data, characterized in that it comprises a. The method according to claim 1, And converting the real-time broadcast data into a digital format prior to the step (b) when the received real-time broadcast data is in an analog format. delete The method according to claim 1, The multiple output system is connected to a streaming server, and further comprising the step of packetizing (packetizing) the encoded real-time broadcast data to the streaming server multiple output method of multimedia data. The method according to claim 1, The real-time broadcast data includes at least one of video data and audio data, wherein the steps (b) to (d) are performed independently on the video data and the audio data. For the multiple output of the multimedia data performed in the multiple output system, a program of instructions that can be executed by the digital processing device is tangibly embodied and can be read by the digital processing device. (a) receiving real time broadcast data having a single bit rate; (b) replicating the real time broadcast data into one or more real time broadcast data; And (c) converting the copied real-time broadcast data into different formats; And (d) encoding the converted real-time broadcast data using a plurality of codecs. In a multiple output system, a data receiving unit for receiving real-time broadcast data having a single bit rate; (b) a data copying unit for copying the real-time broadcast data into one or more real-time broadcast data; (c) a data format converter for converting the copied real-time broadcast data into different formats; And and (d) an encoding unit using the plurality of codecs to convert the converted real-time broadcast data. The method according to claim 10, The data format converter comprises: a bit rate converter for converting a bit rate of the copied real-time broadcast data; A resolution converter for converting the resolution of the copied real-time broadcast data; And a frame rate converter for converting a frame rate of the replicated real-time broadcast data. The method according to claim 11, The duplicated real time broadcast data is at least one of RGB and YCbCr data formats, and the resolution converter converts the size of the duplicated real time broadcast data based on the maximum frame size data of the data format. Multiple output system. The method according to claim 11, When converting the frame rate, the frame rate converter selects at least one real time broadcast data from the replicated real time broadcast data, and selectively selects a specific frame included in the selected real time broadcast data to provide real time broadcast data. Multiple output system of multimedia data, characterized in that reconstruction. The method according to claim 10, And the AD converting unit converting the real time broadcasting into a digital format when the received real time broadcasting data is in an analog format. The method according to claim 10, The multiple output system is connected to a streaming server, the multiple output system for multimedia data, characterized in that it further comprises a packetizing unit for packetizing the encoded real-time broadcast data transmitted to the streaming server.

Images