KR100891672B1 - Apparatus for processing a mix signal and method thereof - Google Patents

Abstract

The present invention relates to a method and apparatus for processing a mixed signal. To this end, the present invention comprises the steps of independently obtaining the first mix signal or the additional information from the multiplexed first mix signal and the additional information; Obtaining a user mix parameter; And generating a remix signal using the first mix signal or the additional information and the user mix parameter, wherein the first mix signal includes one or more source signals, and the additional information is a source signal to be remixed. And a relationship with the first mix signal.

Mix Signal, Side Information, Multiplexing, Identification Information, Remix Signal

Description

Method and apparatus for processing mixed signal {APPARATUS FOR PROCESSING A MIX SIGNAL AND METHOD THEREOF}

1 is a block diagram of an apparatus for encoding a first remix signal according to an embodiment of the present invention.

FIG. 2 is a detailed block diagram of the first remix signal encoding apparatus of FIG. 1 when using a stereo signal. FIG.

3 is a domain for processing a media signal according to an embodiment of the present invention.

4 is a block diagram of a second remix signal encoding apparatus according to an embodiment of the present invention.

5 is a block diagram of a first remix signal decoding apparatus according to an embodiment of the present invention;

FIG. 6 is a detailed view of the first remix signal decoding apparatus of FIG. 5 when using a stereo signal. FIG.

7 is a block diagram of a second remix signal decoding apparatus according to an embodiment of the present invention.

8A is a block diagram illustrating a combination of a conventional encoding device and a remix signal encoding device according to an embodiment of the present invention.

8B is a block diagram of a second remix signal decoding apparatus according to an embodiment of the present invention used in combination with a conventional decoding apparatus.

9 is a detailed block diagram of a remix signal decoding apparatus according to an embodiment of the present invention.

10 is a block diagram of a decoding apparatus for independently outputting a mixed signal and additional information according to an embodiment of the present invention.

11 is a block diagram of a decoding apparatus for generating a remix signal using a mix signal received from a user according to an embodiment of the present invention.

12 is a detailed block diagram of the additional information extracting unit shown in FIG. 11;

13 and 14 are graphs showing a method of modifying additional information according to an embodiment of the present invention.

15 is a diagram illustrating a modified example of a mixed signal according to an embodiment of the present invention.

16 illustrates a multiplexer and a demultiplexer according to an embodiment of the present invention.

17 illustrates a signal multiplexed with a mix signal and additional information according to an embodiment of the present invention.

18 is a flowchart illustrating a method of generating a remix signal by independently extracting a mixed signal or additional information according to an embodiment of the present invention.

19 is a view showing the configuration of a first example of a first remix signal encoding apparatus according to an embodiment of the present invention;

20 is a configuration diagram of a first example of a first remix signal decoding apparatus according to an embodiment of the present invention.

21 is a diagram showing a procedure of a first example of a first remix signal encoding method according to an embodiment of the present invention.

FIG. 22 is a diagram showing a procedure of a first example of a first remix signal decoding method according to an embodiment of the present invention; FIG.

23 is a diagram showing the configuration of a second example of a first remix signal encoding apparatus according to an embodiment of the present invention;

24 is a diagram showing the configuration of a second example of a first remix signal decoding apparatus according to one embodiment of the present invention;

25 is a configuration diagram of a third example of the first remix signal encoding apparatus according to the embodiment of the present invention;

FIG. 26 is a diagram showing the configuration of a third example of a first remix signal decoding apparatus according to an embodiment of the present invention; FIG.

FIG. 27 is a view showing a procedure of a second example and a third example of a first remix signal encoding method according to an embodiment of the present invention; FIG.

28 is a flow chart of a second example and a third example of a method of decoding a first remix signal according to an embodiment of the present invention.

29 is a diagram showing the configuration of a second remix signal encoding apparatus according to an embodiment of the present invention.

30 is a diagram illustrating a configuration of a second remix signal decoding apparatus according to an embodiment of the present invention.

31 is a flowchart of a second remix signal encoding method according to an embodiment of the present invention.

32 is a flowchart of a second remix signal decoding method according to an embodiment of the present invention.

33 is a diagram schematically illustrating a principle of extracting unique information from a mixed signal and the like.

34 is a diagram showing a data area of a recording medium storing additional information of a mix signal according to one embodiment of the present invention;

FIG. 35 illustrates a method of storing additional information by dividing a data area of a recording medium into a plurality of sessions according to an embodiment of the present invention. FIG.

FIG. 36 illustrates a method of storing additional information in the session of FIG. 35 according to an embodiment of the present invention. FIG.

FIG. 37 illustrates a method of randomly storing additional information in a data area of a recording medium according to an embodiment of the present invention. FIG.

FIG. 38 is a block diagram showing a reproducing apparatus for generating a remix signal by using a mix signal and additional information stored in a recording medium according to an embodiment of the present invention. FIG.

39 is a flowchart illustrating a method of storing additional information of a mix signal in a data area of a recording medium according to an embodiment of the present invention.

FIG. 40 illustrates a system for providing remix information after confirming an unidentified mix signal according to an embodiment of the present invention. FIG.

FIG. 41 is a detailed view of the system of FIG. 40 in accordance with an embodiment of the present invention. FIG.

42 illustrates a method of providing additional information according to a mix signal file according to an embodiment of the present invention.

43 is a block diagram illustrating a method of generating a playlist of mix signals according to an embodiment of the present invention.

44 is a flowchart illustrating a cleaning method according to an embodiment of the present invention.

45 is a flowchart illustrating a method of providing additional information after confirming an unidentified mix signal according to an embodiment of the present invention.

The present invention relates to a method and apparatus for processing a mixed signal. To date, stereo signals are most commonly generated and most widely used by consumers. In recent years, multichannel signals have been increasingly used. However, there is a limitation that the mixed signal is processed only in the channel signal unit, not in the source signal unit constituting the mix signal. Therefore, when processing the mixed signal in the channel signal unit, there is a problem that only a specific source signal constituting the mixed signal can not be processed independently. For example, while watching a movie, it is impossible to increase the volume of background music while keeping the volume of actors' voices constant.

In addition, conventionally, since the mixed signal and the additional information are multiplexed and transmitted, there is a problem in that the mixed signal and the additional information cannot be independently extracted.

In order to solve the above problems, an object of the present invention is to provide a signal processing method and apparatus for a user to independently transmit a mix signal and additional information.

Another object of the present invention is to provide a signal processing method and apparatus for generating a remix signal by independently extracting a mixed signal or additional information.

It is also an object of the present invention to provide a signal processing method and apparatus for modifying additional information according to a new mix signal.

In addition, the present invention provides a signal processing method and apparatus that can improve the quality of the reproduction and remix signal of the media signal by checking whether each of the separately existing mix signal (or source signal) and additional information match each other. Its purpose is to.

In addition, the present invention provides a signal processing apparatus and method that can match additional information to a mix signal (or source signal) already widely distributed and possessed by a consumer by circulating additional information containing unique information. The purpose is.

It is also an object of the present invention to provide a signal processing method for storing additional information generated by using a mix signal and a source signal on a recording medium.

Further, an object of the present invention is to provide a method and apparatus for acquiring additional information related to the mixed signal after confirming an unidentified mix signal.

In order to achieve the above object, the present invention includes the steps of independently obtaining the first mix signal or the first side information from the multiplexed first mix signal and the first side information; Obtaining a user mix parameter; Generating a remix signal using the first mix signal or the first additional information and the user mix parameter, wherein the first mix signal includes one or more source signals, and the first additional information is remixed. It provides a signal processing method characterized in that the relationship between the source signal to be and the first mix signal.

In addition, to achieve the above object, the present invention comprises the steps of obtaining a mix signal comprising at least one source signal; Acquiring additional information indicating a relationship between the source signal to be remixed and the mix signal among the source signals; It provides a signal processing method comprising the step of multiplexing the mixed signal and the additional information.

In addition, to achieve the above object, the present invention comprises the steps of obtaining a mix signal comprising at least one source signal; Generating side information using the mix signal and a source signal to be remixed among the source signals; And independently storing or transmitting the mixed signal and the additional information, wherein the additional information indicates a relationship between the source signal to be remixed and the mixed signal.

In addition, in order to achieve the above object, the present invention comprises the steps of generating additional information using a mix signal comprising one or more source signals; Generating identification information and inserting the identification information into at least one of the mix signal and the additional information, wherein the identification information is information indicating whether the mix signal matches the additional information. Provide a treatment method.

In addition, to achieve the above object, the present invention comprises the steps of obtaining a mix signal including at least one source signal and additional information of the mix signal; Obtaining first identification information from the mix signal and obtaining second identification information from the side information; Obtaining a user mix parameter; And generating a remix signal by using the additional information, the user mix parameter, and the mix signal when the first identification information and the second identification information coincide with each other. .

In addition, in order to achieve the above object, the present invention includes a core decoding unit for extracting first identification information from a mix signal including one or more source signals; An additional information decoding unit which extracts second identification information from the additional information; An identification information reading unit for generating a control signal by determining whether the first identification information and the second identification information match each other; And a remix rendering unit configured to generate a remix signal using the additional information, the mix signal, and control information obtained from a user according to the control signal.

In addition, to achieve the above object, the present invention provides a mixed signal storage unit for storing the first mixed signal obtained from the multiplexed first mix signal and the first additional information; An additional information storage unit which stores the first additional information obtained from the multiplexed first mix signal and the first additional information; And a remix rendering unit configured to generate a remix signal using the first mix signal, the first additional information, and the control information obtained from the user.

In addition, in order to achieve the above object, the present invention provides an additional information generation unit for generating additional information using a mix signal including at least one source signal and the source signal to be remixed; And a signal transmission unit for independently transmitting the mixed signal and the additional information, wherein the additional information indicates a relationship between the source signal to be remixed and the mixed signal.

In addition, in order to achieve the above object, the present invention provides an additional information generating unit for generating additional information using a mix signal including one or more source signals; An identification information generation unit for generating identification information; And an additional information encoding unit for inserting the identification information into the additional information, wherein the identification information indicates whether the mix signal matches the additional information.

In addition, to achieve the above object, the present invention includes the steps of extracting the unique information from the mix signal comprising one or more source signals; And inserting the unique information into the additional information related to the mixed signal, wherein the unique information is information for distinguishing the mixed signal from another signal.

In addition, to achieve the above object, the present invention includes the steps of obtaining the unique information of the unidentified mix signal including one or more source signals; Identifying the mix signal using the unique information; And obtaining additional information related to the mixed signal, wherein the unique information is information for distinguishing the mixed signal from other signals, and the additional information is a source signal to be remixed among the source signals and the mix. Provided are a signal processing method which indicates a relationship with a signal.

In addition, to achieve the above object, the present invention includes the steps of obtaining from the user unique information of the unidentified mix signal including one or more source signals; Identifying the mix signal in a database corresponding to the mix signal using the unique information; Providing additional information regarding the identified mix signal to the user, wherein the unique information is information for distinguishing the mix signal from other signals, and the additional information is to be remixed among the source signals. It provides a signal processing method characterized in that the relationship between the source signal and the mix signal.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention that can specifically realize the above object will be described.

The present invention provides an algorithm that can process a mix signal in a unit of a source signal. When the mix signal is processed in units of source signals, a wide variety of effects can be produced. For example, while watching a movie, it is possible to increase only the volume of the background music while keeping the volume of the actors' voices constant. In the present invention, the source signal refers to one or more sources (eg, pianos) constituting the mix signal. Processing in source signal units means that in processing a mix signal, characteristics (eg, localization, gain) associated with a particular source signal constituting the mix signal are " individually ". It can be modified. By “individually” it is meant that modifying the properties associated with a particular source does not affect the properties of other sources or has only a small impact that is difficult to perceive. The mix signal refers to a signal composed of one or more source signals, and includes a mix signal and a video signal. In the present invention, a small amount of side information is transmitted as well as a typical mix signal. The remix signal may be generated using the additional information and the mix signal.

1 is a block diagram of a first remix signal encoder according to an embodiment of the present invention. The first remix signal encoder includes an additional information generator 103 and an additional information encoder 105.

Referring to FIG. 1, the additional information generator 103 generates additional information 104 using a typical mix signal 101 and a source signal 102 constituting the mixed signal. The mix signal 101 may be a mono, stereo and multi-channel audio signal. The source signal 102 may be some or all of the source signals constituting the mix signal 101. The additional information 104 refers to information used to process the mixed signal in source signal units. The additional information 104 includes mix parameters for remixing the mix signal. The mix parameter may include an encoder mix parameter generated using a source signal in an encoder, and optionally, a blind mix parameter generated using only a mix signal. Examples of the mix parameter may include a gain value and a subband power for each source signal. A detailed definition and generation method for the additional information 104 is described in FIG. 2. The present invention also includes generating the additional information 104 using only the source signal 102 constituting the mix signal. The side information encoding unit 105 encodes the generated side information 104 to generate an encoded side information signal 106. The mix signal 101 and the side information signal 106 are transmitted to a decoding apparatus.

FIG. 2 is a detailed block diagram of the first remix signal encoding apparatus of FIG. 1 when the mixed signal is a stereo signal. As described above, the mixed signal used in the present invention may be a mono, stereo and multichannel mixed signal, but for convenience, the mixed signal will be described based on the stereo signal 201.

및

는 상기 스테레오 신호를 구성하는 소스 신호들의 합으로 표현될 수 있다. 여기서, n은 타임 인덱스를 의미한다. 따라서, 상기 스테레오 신호(201)는 아래의 [수학식 1]과 같이 표현될 수 있다.The stereo signal 201

And

May be expressed as a sum of source signals constituting the stereo signal. Here, n means time index. Therefore, the stereo signal 201 may be expressed as Equation 1 below.

은 소스 신호들을 나타낸다.

및

는 각각의 소스 신호에 대한 진폭 패닝(amplitude panning) 및 게인(gain)을 결정하는 값이다. 모든

들은 서로 독립적이다. 상기

는 모두 순수한 소스 신호이거나, 또는 순수한 소스 신호에 약간의 잔향(reverberation) 및 효과음 신호성분(sound effect signal components)을 포함할 수 있다. 예를 들면, 특정한 잔향 신호성분은 2개의 소스 신호, 즉, 왼쪽 채널로 믹스된 신호와 오른쪽 채널로 믹스된 신호로 표현될 수 있다.Here, I is the number of source signals included in the stereo signal,

Represents source signals.

And

Is a value that determines the amplitude panning and gain for each source signal. all

They are independent of each other. remind

Are all pure source signals, or may include some reverberation and sound effect signal components in the pure source signal. For example, the specific reverberation signal component may be represented by two source signals, that is, a signal mixed with the left channel and a signal mixed with the right channel.

It is an object of the present invention to modify a stereo signal comprising the source signal such that M (0 <= M <= I) source signals are remixed. The source signals may be remixed into a stereo signal with different gain factors. The remix signal may be expressed as Equation 2 below.

및

는 리믹스되는 M개의 소스 신호들에 대한 새로운 게인 팩터들이다. 상기

및

는 디코더 단에서 제공될 수 있다. 이 경우에, 부가정보생성부(206)는 스테레오 신호(201) 및 M개의 소스 신호(202)를 이용하여 부가 정보(207)를 생성할 수 있다. here,

And

Are new gain factors for the M source signals to be remixed. remind

And

May be provided at the decoder stage. In this case, the additional information generator 206 may generate the additional information 207 using the stereo signal 201 and the M source signals 202.

에 대한 접근 없이, [수학식 1]로 표현되는 통상적인 믹스 신호가 주어지는 경우에, [수학식 2]로 표현되는 리믹스 신호를 지각적으로 모방하는 것을 목적으로 한다.As described above, an object of the present invention is to remix the stereo signal in the unit of the source signal when given a conventional stereo signal and some additional information. As in the present invention, it is not possible to completely generate the remix signal represented by Equation 2 from the mixed signal represented by Equation 1 using a very small amount of additional information. Thus, the present invention provides the respective source signals

It is aimed to perceptually mimic the remix signal represented by [Equation 2], given an ordinary mix signal represented by [Equation 1] without access to.

및

로 표시된다. 여기서 k는 서브밴드 신호들의 시간 인덱스(time index)이다. 유사하게, M개의 소스 신호들(202)의 서브밴드 신호들(205)은

,

,...,

로 표시된다. 명료한 표현을 위해, 서브밴드(주파수) 인덱스를 사용하지 않았다.Referring to FIG. 2, a stereo signal 201 and M source signals 202 included in the stereo signal 201 are input to a first remix signal encoding apparatus. The stereo signal 201 may be delayed to some extent to be synchronized with the side information and used directly as an output signal. To generate the additional information, the stereo signal 201 and the source signals 202 are decomposed into subband-specific signals 204 and 205 in the time-frequency domain through the filter bank 203. That is, the stereo signal 201 and the source signal are processed in the time-frequency domain, which will be described later with reference to FIG. 3. The subband-specific signal 204 is similarly processed at the center frequency of each subband. At a particular frequency, the subband pair 204 of the stereo signal 201

And

Is displayed. Where k is the time index of the subband signals. Similarly, the subband signals 205 of the M source signals 202 may be

,

, ...,

Is displayed. For clarity, no subband (frequency) index is used.

를 생성한다. 또한, 상기 부가정보생성부(206)는 스테레오 신호(201)의 서브밴드 쌍(204)을 이용하여, 서브밴드별로 게인 팩터

및

를 생성한다. 상기 게인 팩터

및

는 외부에서 직접 주어질 수 있다. 상기 서브밴드별 숏-타임 서브밴드 파워 및 게인 팩터를 이용하여 서브밴드별 부가 정 보(207)가 생성된다. 상기 부가정보생성부(206)는 상기 숏-타임 서브밴드 파워 및 게인 팩터들 이외에 상기 스테레오 신호에 관련된 다른 정보를 부가 정보(207)로 생성할 수 있다. 부가정보인코딩부(208)는 상기 서브밴드별 부가정보(207)를 이용하여 부호화된 부가 정보 신호(209)를 생성한다. Given the subband signals 205 of the source signals 202, the side information generator 206 may perform short-time subband power for each subband,

Create In addition, the additional information generator 206 uses a subband pair 204 of the stereo signal 201 to obtain a gain factor for each subband.

And

Create The gain factor

And

Can be given directly from the outside. Additional information 207 for each subband is generated using the short-time subband power and gain factor for each subband. The additional information generator 206 may generate other information related to the stereo signal as additional information 207 in addition to the short-time subband power and gain factors. The additional information encoding unit 208 generates an additional information signal 209 encoded using the additional information 207 for each subband.

및

는 고정적이 될 것이다. 만일

및

가 시간 k에 따라 가변적이라면, 상기 게인 팩터들은 시간의 함수로 생성될 것이다. 상기 게인 팩터들은 직접 양자화 및 부호화되지 않고, 먼저 양자화 및 부호화에 더 적합한 다른 값들로 전환될 수 있다. 또한,

는 스테레오 신호(201)의 서브밴드 파워에 상대적인 값으로 정규화될 수 있다. 이것은 스테레오 신호를 효율적으로 부호화하기 위해 통상적인 인코딩 장치가 이용되는 경우에, 본 발명을 상대적으로 변화에 강하도록 만들어준다. 예를 들면,

및

는 아래의 [수학식 3]으로 표현되는 게인 및 데시벨(dB) 단위의 레벨차로 전환되어 전송될 수 있다. For many stereo signals 201, the gain factor

And

Will be fixed. if

And

If is variable over time k, the gain factors will be generated as a function of time. The gain factors are not directly quantized and coded, but may first be converted to other values more suitable for quantization and coding. Also,

Can be normalized to a value relative to the subband power of the stereo signal 201. This makes the present invention relatively resistant to changes when conventional encoding devices are used to encode stereo signals efficiently. For example,

And

May be converted into a level difference in units of gain and decibel (dB) expressed by Equation 3 below, and then transmitted.

는 부가 정보로서 직접 부호화되는 것이 아니라, 아래의 [수학식 4]로 표현되는 스테레오 신호에 상대적으로 정의된 값으로 변환되어 전송될 수 있다. Also,

Is not directly encoded as additional information, but may be converted into a value defined relative to the stereo signal represented by Equation 4 below and transmitted.

는 아래의 [수학식 5]와 같이 계산될 수 있다. To produce short-time subband power, the present invention uses single-pole averaging. In other words,

May be calculated as shown in Equation 5 below.

Here, α∈ [0,1] determines the time-constant of the estimation window (estimation window) which decreases exponentially as shown in Equation 6 below.

는 서브밴드 샘플링 주파수를 나타낸다. 예를 들면, T=40 ms를 이용할 수 있다. 이하에서,

는 숏-타임 평균(short-time averaging)을 나타낸다. 만일

및

가 주어지지 않는다면, 상기

및

는 부가정보생성부(206)에서 생성될 필요가 있다.

이므로,

는 아래의 [수학식 7]과 같이 계산된다.here,

Denotes a subband sampling frequency. For example, T = 40 ms can be used. In the following,

Denotes short-time averaging. if

And

If is not given,

And

Needs to be generated in the additional information generation unit 206.

Because of,

Is calculated as shown in Equation 7 below.

는 아래의 [수학식 8]과 같이 계산된다.Similarly,

Is calculated as shown in Equation 8 below.

3 illustrates a domain for processing a mix signal according to an embodiment of the present invention. As described above, the mix signal and the side information are processed as subband-specific signals in the time-frequency domain as shown in FIG. Subband-specific signals in the time-frequency domain are perceptually derived. For example, a signal for each subband may be generated by using a short time fourier transform (STFT) having a sine wave analysis window and a sine analysis and synthesis window having a length of about 20 ms. In this case, the STFT coefficients may be grouped such that one group has a bandwidth that is about twice the equivalent rectangular bandwidth (ERB).

4 is a block diagram of a second remix signal encoding apparatus according to an embodiment of the present invention. The second remix signal encoding apparatus includes a downmixing unit 402, an additional information generating unit 403, and an additional information encoding unit 406.

Referring to FIG. 4, the downmixing unit 402 generates a sum signal 404 by adding a plurality of source signals 401. Unlike the first remix signal encoding apparatus, the second remix signal encoding apparatus transmits the sum signal 404 instead of the stereo signal. The additional information generator 403 generates the additional information 405 using the source signals 401. The additional information 405 includes subband power and gain factor corresponding to each source signal. In addition, the additional information 405 may include a parameter corresponding to a delay in the remix renderer. Similar to the first remix signal encoding apparatus, the additional information 405 may be converted into another value more suitable for quantization and encoding and transmitted. The additional information encoding unit 406 generates an encoded additional information signal 407 using the generated additional information 405. The generated sum signal 404 and the side information signal 407 are transmitted to the decoding apparatus. The present invention also includes an encoding apparatus that does not have a downmixing unit 402. In this case, the source signals 401 are not converted to the sum signal 404, and each source signal 401 is transmitted directly.

5 is a block diagram of an apparatus for decoding a first remix signal according to an embodiment of the present invention. The first remix signal decoding apparatus includes a side information decoder 503 and a remix renderer 505.

Referring to FIG. 5, the mix signal 501 and the additional information signal 502 are input to the first remix signal decoding apparatus. The mix signal 501 may be a mono, stereo or multichannel mix signal. The additional information decoding unit 503 decodes the additional information signal 502 to generate additional information 504. The additional information 504 includes a gain factor and a subband power of source signals included in the transmitted mixed signal 501. The remix renderer 505 may input a user-mix parameter 506 generated using control information directly provided by the user. The remix renderer 505 generates the remix signal 507 using the mix signal 501, the transmitted additional information 504, and the user mix parameter 506. A detailed description of the method of generating the remix signal will be described later with reference to FIG. 6. The remix signal 507 is generated as an Eq-channel mix signal having the same number of channels as the number of channels of the transmitted mix signal, or an upchannel mix signal having more channels than the number of channels of the mix signal. (Up-channel mix signal) can be generated.

FIG. 6 is a detailed diagram of the first remix signal decoding apparatus of FIG. 5 when using a stereo signal. As described above, the transmitted mixed signal may be a mono, stereo and multichannel mixed signal, but will be described with reference to the stereo signal 601 for convenience.

및

로 표현된다. 부가정보디코딩부(605)는 전송된 부가 정보 신호(602)를 복호화하여, 서브밴드별 부가 정보(606)를 생성한다. 또한, 리믹스 렌더링부(607)에 사용자가 제공하는 제어 정보를 이용하여 생성된 사용자 믹스 파라미터(608)가 입력될 수 있으며, 상기 사용자 믹스 파라미터(608)는 서브밴드별로 제공될 수 있다. 전술한 것처럼, 상기 부가 정보(606)는 리믹스 될 M개의 소스 신호에 대한 서브밴드별 게인 팩터(

및

) 및

로 표현되는 서브밴드 파워를 포함한다. 리믹스 렌더링부(607)는 서브밴드별로 생성된 스테레오 신호(604), 전송된 부가 정보(606) 및 사용자 믹스 파라미터(608)를 이용하여, 서브밴드별 리믹스 신호(609),

및

를 생성한다. 상기 리믹스 신호(609)를 생성하는 방법은 아래에서 더욱 상세하게 기술된다. 상기 리믹스 신호(609)는 역필터뱅크(610)를 통해 시간 도메인(time domain)의 스테레오 신호(611),

및

로 변환된다. Referring to FIG. 6, the stereo signal 601 is decomposed into a subband-specific signal 604 in the time-frequency domain through the filter bank 603. As shown in FIG. 6, the subband-specific signal 604 at a particular frequency

And

It is expressed as The additional information decoding unit 605 decodes the transmitted additional information signal 602 to generate additional information 606 for each subband. In addition, a user mix parameter 608 generated using control information provided by a user may be input to the remix renderer 607, and the user mix parameter 608 may be provided for each subband. As described above, the additional information 606 is a subband-specific gain factor for M source signals to be remixed.

And

) And

It includes the subband power represented by. The remix rendering unit 607 may use the stereo signal 604 generated for each subband, the additional information 606 transmitted, and the user mix parameter 608, and the remix signal 609 for each subband,

And

Create The method of generating the remix signal 609 is described in more detail below. The remix signal 609 is a stereo signal 611 in the time domain through the inverse filter bank 610,

And

Is converted to.

는 서브밴드별 소스 신호

로 교체된다. 즉, 서브밴드별 믹스 신호(604)는 아래의 [수학식 9]과 같이 표현될 수 있다. A method of generating the remix signal 609 generated by the remix renderer 607 is as follows. Equations 1 and 2 are also valid for the signals 604 and 609 for each subband. In this case, the source signal

Is the subband-specific source signal

Is replaced by. That is, the mix signal 604 for each subband may be expressed by Equation 9 below.

The subband remix signal 609 may be expressed by Equation 10 below.

및

가 주어지면, 아래의 [수학식 11]와 같이 서로 다른 게인들을 가지는 서브밴드별 리믹스 신호(609)가 상기 서브밴드별 믹스 신호(604)의 선형 조합으로 추정될 수 있다.To generate the remix signal 609, least squares estimation may be used. Per subband mix signal 604,

And

Given by Equation 11 below, the subband remix signal 609 having different gains may be estimated as a linear combination of the subband mix signals 604.

,

,

및

는 가중 팩터들(weighting factors)이다. 이때, 생성되는 추정 에러(estimation error)는 아래의 [수학식 12]과 같이 정의될 수 있다.here,

,

,

And

Is the weighting factors. In this case, the generated estimation error may be defined as shown in Equation 12 below.

,

,

및

는 평균제곱오차(mean square error),

및

가 최소가 되도록 서브밴드별로 생성될 수 있다. 이때, 추정 에러,

및

가

및

에 직교(orthogonal)될 때, 상기 평균제곱오차가 최소가 된다는 것을 이용할 수 있다. 생성되는

및

는 아래의 [수학식 13]과 같 이 표현될 수 있다.The weighting factors,

,

,

And

Is the mean square error,

And

May be generated for each subband such that is minimized. In this case, the estimation error,

And

end

And

When orthogonal to, it can be used that the mean square error is minimized. Generated

And

Can be expressed as Equation 13 below.

,

및

는 직접 생성될 수 있지만,

및

은 전송된 부가 정보(606)(예를 들면,

,

,

) 및 사용자가 제공하는 제어 정보(608)(예를 들면, 게인 팩터

및

)를 이용하여, 아래의 [수학식 14]와 같이 생성될 수 있다.here,

,

And

Can be generated directly,

And

Is transmitted additional information 606 (e.g.,

,

,

) And control information 608 provided by the user (e.g., gain factor

And

) Can be generated as shown in Equation 14 below.

및

가 아래의 [수학식 15]와 같이 생성될 수 있다. Similarly,

And

May be generated as shown in Equation 15 below.

및

는 아래의 [수학식 16]과 같이 표현될 수 있다. here,

And

May be expressed as Equation 16 below.

If the phases of the mix signal 604 are coherent or nearly synchronized with each other, a value expressed by Equation 17 below approaches 1.

In this case, the weights may be expressed as Equation 18 below.

및

)를 이용하여 각각의 소스 신호를 독립적으로 리믹스하여 생성된 리믹스 신호와 유사하게 들린다.The subband remix signal 609 generated as described above is converted into the remix signal 611 of the time-domain through the inverse filter bank 610 as described above. The remix signal 611 may generate a user mix parameter generated using control information provided by a user.

And

It sounds similar to the remix signal generated by independently remixing each source signal with

So far, the focus has been on remixing two-channel stereo signals. However, as described above, the present invention is not limited to stereo signals, but may be extended to remixing multichannel mixed signals, for example, 5.1 channel mixed signals. Those skilled in the art can remix multichannel mix signals, similar to the stereo signals described herein. In this case, Equation 11 may be written as Equation 19 below.

Optionally, one of the channels of the mix signal can be left without remixing. For example, for a 5.1 surround channel, it is possible to apply remixing only to the front channel without modifying the two back channels. In this case, a two or three channel remix algorithm is applied to the front channel.

7 is a block diagram of a second remix signal decoding apparatus according to an embodiment of the present invention. The second remix signal decoding apparatus includes an additional information decoding unit 703, a spatial information integration unit 705, and a remix rendering unit 707.

Referring to FIG. 7, the sum signal 701 of the source signals and the additional information signal 702 are input to the second remix signal decoding apparatus. The additional information decoding unit 703 decodes the additional information signal 702 to generate additional information 704. The additional information 704 includes a gain factor, a delay constant, a subband power, and the like. The additional information integrator 705 separates the sum signal 701 into a plurality of source signals 706 by using the additional information 704. The remix renderer 707 may generate the remix signal 709 using the source signals 706. In this case, the remix renderer 707 may generate the remix signal 709 using the mix parameter transmitted as additional information. In addition, the remix renderer 707 may selectively generate the remix signal 709 using the user mix parameter 708 generated by using control information provided by the user.

8A is a block diagram illustrating a combination of a conventional encoding apparatus and a remix signal encoding apparatus according to an embodiment of the present invention. The mixed signal 801 may be encoded by the conventional encoding apparatus 803 and converted into the encoded mixed signal 805. The mix signal 801 may be a channel-specific signal or a source signal. The conventional encoding device 803 includes not only conventional encoding devices such as AAC, MP3 encoder, etc., but also encoding devices to be developed in the future. The remix signal encoding apparatus 804 according to the present invention generates the additional information signal 806 using the mixed signal 801 and the source signal 802 included in the mixed signal. The multiplexer 807 generates the bitstream 808 using the encoded mix signal 805 and the side information signal 806. As described above, the additional information signal 806 may be inserted into an auxiliary data area in a conventional mix signal format to be compatible with conventional devices.

8B is a block diagram of a combination of a conventional decoding device and a remix signal decoding device according to an embodiment of the present invention. The demultiplexer 810 separates the encoded mix signal 811 and the side information signal 812 from the transmitted bitstream 809. The conventional decoding device 813 then decodes the encoded mix signal 811 to produce a mix signal 814 that can be used in the remix signal decoding device 815 according to the present invention. The conventional decoding device 813 includes not only a conventional encoding device such as an AAC, an MP3 decoder, etc. but also an encoding device to be developed in the future. The mix signal 814 may be a channel-specific signal or a source signal. The remix signal decoding apparatus 817 according to the present invention may convert the mix signal 814 into the remix signal 816 using at least one of the additional information signal 812 and the user mix parameter 817.

9 is a detailed block diagram of a remix signal decoding apparatus according to an embodiment of the present invention. Referring to FIG. 9, the remix signal decoding apparatus includes a mixed signal decoder 901, a parameter generator 902, and a remix renderer 908. It may optionally include an effector (911). The parameter generator 902 may include a blind mix parameter generator 903, a user mix parameter generator 904, and a remix parameter generator 905. The remix parameter generation unit 905 may include an equimix parameter generation unit 906 and may optionally include an upmix parameter generation unit 907. In addition, the remix renderer 908 may include an equimix renderer 909 and optionally include an upmix renderer 910.

The mixed signal decoding unit 901 decodes the encoded mixed signal transmitted from the encoding end to generate a mixed signal. The parameter generator 902 receives additional information and user control information (or configuration information) transmitted from an encoding stage. The user control information is not transmitted at the encoder stage but may be generated at the decoder stage. The user mix parameter generator 904 generates a user mix parameter by using user control information. The additional information transmitted from the encoder stage may include an encoder mix parameter. In addition, the blind mix parameter generator 903 may generate a blind mix parameter using the mix signal. The encoder mix parameter and the blind mix parameter are alternatively input to the remix parameter generator 905.

The remix parameter generator 905 generates a remix parameter using additional information and a user mix parameter. The remix parameter may be generated to be applied to a channel of the remix signal. Equimix parameter generation unit 906 included in the remix parameter generation unit 905 generates a remix parameter used to generate a remix signal having the same channel number as the number of channels of the mix signal, the remix parameter generation unit 905 The upmix parameter generation unit 907, which may be included in the control unit, generates a remix parameter used to generate a remix signal having a larger number of channels than the number of channels of the mixed signal. The remix parameter is input to the remix renderer 908.

Equimix renderer 909 included in the remix renderer 908, using the remix parameter and the mix signal, having an equal number of channels equal to the number of channels of the mix signal (Eq-channel remix signal ) The upmix renderer 910, which may be included in the remix renderer 908, uses more channels than the number of channels of the mix signal by using the remix parameter and the mix signal generated by the upmix parameter generator 907. Generate an up-channel remix signal having a number. The upmix renderer 910 may generate an upchannel remix signal using the remix signal generated by the Equichannel renderer 909.

Accordingly, the decoding apparatus may output the mixed signal transmitted from the encoding stage as it is, output as an equal channel remix signal, or output as an up channel remix signal. Optionally, the remix renderer may give various effects to the remixed signal by using information provided from the effector 911.

10 is a block diagram of a decoding apparatus for independently outputting a mixed signal and additional information according to an embodiment of the present invention. Referring to FIG. 10, the decoding apparatus includes a demultiplexer 1001, a mixed signal storage unit 1002, an additional information storage unit 1004, and a remix renderer 1006. In the present invention, the additional information refers to information indicating a relationship between the source signal to be remixed and the mix signal, or a relationship between the source signals to be remixed among the source signals included in the mix signal.

The demultiplexer 1001 parses the mixed signal and the additional information and sends them to the mixed signal storage 1002 and the additional information storage 1004, respectively. The mix signal storage unit 1002 and the additional information storage unit 1004 independently store the mix signal and the additional information received from the demultiplexer 1001. When the user wishes to use the mixed signal 1003 or the additional information 1005, the signal decoding apparatus may output the mixed signal 1003 or the additional information 1005 from the mixed signal storage unit 1002 or the additional information storage unit 1004. Extract and output independently.

When the user requests the remix signal 1007, the decoding apparatus generates and outputs the remix signal 1007 using the mix signal 1003, additional information, and the user mix parameter. The user mix parameter may be generated using control information received from a user. The decoding apparatus may output the remix signal 1007 or directly output the mix signal 1003 or additional information 1005 according to a user's request. The user may generate the remix signal 1007 using the output mix signal 1003 or additional information 1005 and the new mix signal or new additional information.

11 is a block diagram of a decoding apparatus for generating a remix signal using a mix signal received from a user according to an embodiment of the present invention. Referring to FIG. 11, the decoding apparatus includes a mix signal input unit 1102, an additional information extractor 1103, and a remix renderer 1006.

The decoding apparatus stores additional information received from the encoding apparatus or the additional information providing server. The decoding apparatus may directly generate and store additional information about the mixed signal. The decoding apparatus receives a mix signal 1101 from a user using the mix signal input unit 1102. The additional information extracting unit 1103 searches whether there is a same mix signal as the mix signal 1101 received from the user. When there is a same mix signal as the mix signal 1101 input by the user, the additional information extracting unit 1103 extracts the additional information signal for the mix signal therefrom, and sends the extracted additional information to the remix rendering unit 1006.

When the additional information extractor 1103 does not have the same mix signal as the mix signal 1101 received from the user, the additional information extractor 1103 searches for a mix signal having a certain common point. The additional information extracting unit 1103 extracts a mix signal most similar to the mix signal 1101 received from the user among the mixed signals having a common point, and extracts additional information on the extracted mix signal. The additional information extractor 1103 may adjust the mixed signal 1101 input by the extracted additional information, but may adjust the mixed signal 1101 input by the user when there is a difference in time sync or speed. Transform additional information.

The remix rendering unit 1006 outputs the remix signal 1107 using the mix signal received from the mix signal input unit 1102 and the additional information extracting unit 1103 and additional information or modified additional information. If there is no mix signal having a certain point in common with the mix signal 1101 input from the user, the additional information extracting unit 1103 directly generates additional information about the input mix signal 1101 and remixes the rendering unit 1006. It is also possible to reproduce only the mix signal 1101 received from the user without sending to or using additional information.

FIG. 12 is a detailed block diagram of the additional information extraction unit 1103 shown in FIG. Referring to FIG. 12, the additional information extracting unit 1103 includes a comparing unit 1203 and an additional information modifying unit 1204.

The decoding apparatus receives a new mix signal 1202 from a signal providing server or a user. The comparator 1203 compares the mix signal 1201 stored in the decoding apparatus with the new mix signal 1202 received from the user or the signal providing server. When the stored mix signal 1201 and the new mix signal 1202 are the same, the decoding apparatus may use additional information about the stored mix signal 1201 as additional information about the new mix signal. When the mixed signal 1201 and the new mixed signal 1202 have a slight difference in time sync or playback speed, the signal decoding apparatus may add additional information about the stored mixed signal 1201 to the new mixed signal 1202. It can be transformed into additional information about. That is, the signal decoding apparatus compares the stored mix signal 1201 and the new mix signal 1202 and modifies the additional information by using the additional information modifying unit 1204 when the two mixed signals are not the same.

A method of modifying the additional information will be described with reference to FIGS. 13 to 15. The additional information transformation unit 1204 outputs the modified additional information. The decoding apparatus remixes the new mix signal using the mixed signal received from the user and the modified additional information.

13 and 14 are graphs showing a method of modifying additional information according to an embodiment of the present invention. The decoding apparatus receives and stores the mix signal 1201 and additional information 1301 thereof from the encoding apparatus or a separate server. The decoding apparatus may receive the mixed signal 1201 and directly generate and store additional information 1301 about the mixed signal 1201. The mixed signal 1201 and additional information 1301 thereof stored in the decoding apparatus are illustrated in FIGS. 13 and 14.

In FIG. 13, it is assumed that the mixed signal stored in the decoding apparatus and additional information thereof are in the form of a compressed signal such as an MP3 file due to the efficiency of transmission and storage. For example, it is assumed that the decoding apparatus receives and stores a mixed signal 1201 of "November rain" and additional information 1301 thereof, as an MP3 file from the encoding apparatus. When a user has a song "November rain" that is not remixed as a lossless CD signal, the user may reproduce the lossless CD signal as a remix signal by using additional information stored in the decoding apparatus.

The additional information about the "November rain" song stored in the decoding apparatus is an MP3 file, and since the signal to be remixed by the user is a CD signal, the additional information stored in the MP3 file should be transformed into additional information suitable for the CD signal. The decoding apparatus extracts the additional information 1301 stored in order to remix the new mixed signal 1202 and converts the additional information 1301 into the new additional information 1302. In FIG. 13, the mix signal 1202 to be newly remixed is time delayed than the original mix signal 1201. MP3 files often omit the idle section 1303 at the front and end of the mix signal in order to increase the compression ratio. Therefore, the decoding apparatus must generate new additional information 1302 by time delaying the additional information 1301 which is an MP3 file and the rest period 1303.

Referring to FIG. 14, the new mix signal 1202 that the user intends to remix has a lower frequency than the mix signal 1201 stored in the decoding apparatus. That is, the new mix signal 1202 is extended on the time axis than the stored mix signal 1201. Therefore, the decoding apparatus must modify the additional information 1301 stored in the signal decoding apparatus to match the new mix signal 1202. The decoding apparatus compares the stored mix signal 1201 with the new mix signal 1202 and transforms the additional information 1301 into additional information 1302 corresponding to the new mix signal. The decoding apparatus may increase the additional information 1301 in terms of time to generate a new mix signal 1302. The signal decoding apparatus remixes the new mix signal 1202 using the modified side information 1302.

15 is a diagram illustrating a modified example of a mixed signal according to another embodiment of the present invention. Referring to the upper figure of FIG. 15, the original mix signal 1201 includes a piano signal 1501, a violin signal 1502, and a vocal signal 1503 recorded at a position as shown. In this case, it is assumed that the new mix signal 1202 is a signal recorded at a modified position as shown in the lower figure of FIG. 15. The decoding apparatus compares the mixed signal 1201 stored in the decoding apparatus with the new mixed signal 1202 that the user intends to remix. Since the new mix signal 1202 is a signal in which the positions of the source signals included in the original mix signal 1201 are modified and recorded, the additional information 1302 for the new mix signal 1202 must also be modified.

In the upper and lower views of FIG. 15, the violin signal 1502 has the same position, and only the piano signal 1501 and the vocal signal 1503 have changed positions, so that the decoding apparatus adds additional information about the violin signal 1502. In this case, new additional information 1302 can be generated by changing only the additional information for the piano signal 1501 and the additional information for the vocal signal 1503.

16 illustrates a multiplexer and a demultiplexer according to an embodiment of the present invention. Referring to FIG. 16, the multiplexing apparatus 1601 receives and multiplexes a mix signal and additional information transmitted independently. The multiplexer 1601 may exist separately from an encoding device or a decoding device. For example, when the encoding device independently outputs the mixed signal and the additional information thereof, the multiplexing device 1601 may be included in the decoding device or positioned in front of the decoding device to multiplex the mixed signal and the additional information independently transmitted from the encoding device. Two signals can be managed as one signal.

The demultiplexer 1602 parses and separates the mixed signal and the additional information when the mixed signal and the additional information are transmitted together as one signal. When the user wants to use the mix signal or additional information independently, the user may separate the mix signal and the additional information by using the demultiplexer 1602. The demultiplexing device 1602 may also exist separately from the signal encoding device or the signal decoding device.

17 illustrates a signal multiplexed with a mix signal and additional information according to an embodiment of the present invention. Referring to FIG. 17, the multiplexing unit included in the signal encoding apparatus or the signal decoding apparatus or the multiplexing apparatus independent of the signal encoding and decoding apparatus multiplexes the mixed signal and the additional information about the mixed signal into a form 1701 summed simply. Or multiplexing into a form 1702 including additional information about the mix signal in an ancillary data portion of the mix signal. In addition, the multiplexer or multiplexer may generate the multiplexed signal 1702 by combining the mix signal and the additional information in units of frames or every predetermined unit.

18 is a flowchart illustrating a method of independently generating a mixed signal or additional information and generating a remixed signal according to an embodiment of the present invention. Referring to FIG. 18, the decoding apparatus receives a first mix signal and additional information about the same, separates them, and stores them (S1801). The decoding apparatus receives a second mix signal from the user (S1802). The decoding apparatus determines whether there is a same mix signal as the second mix signal among the first mix signals (S1803). When the same first mix signal as the second mix signal is stored in the decoding device, the decoding device extracts additional information about the first mix signal (S1807). The decoding apparatus generates a remix signal using the second mixed signal and the extracted additional information (S1809). If there is no signal identical to the second mix signal among the first mix signals, the decoding apparatus determines whether there is a first mix signal having a common point in common with the second mix signal among the first mix signals (step 1904). If there is no first mix signal having a certain point in common with the second mix signal, the decoding apparatus directly generates additional information about the second mix signal (S1808). The decoding apparatus generates a remix signal using the second mixed signal and the newly generated additional information (S1809). If there is a first mixed signal having a common bit rate, a level, a waveform, a capacitance, and the like, the decoding apparatus extracts the first mixed signal that is most similar to the second mixed signal (S1805). The decoding apparatus transforms the additional information about the first mixed signal into additional information about the second mixed signal (S1806). The decoding apparatus generates a remix signal using the second mix signal and the modified side information (S1809).

19 is a diagram illustrating a configuration of a first example of a first remix signal encoding apparatus according to an embodiment of the present invention. A second example and a third example will be described later in conjunction with FIGS. 23 and 25. The first example of the first remixed signal encoding apparatus includes an additional information generator 1803, an identification information generator 1905, a core encoder 1906, and an additional information encoder 1904.

The additional information generation unit 1903 generates additional information from the mix signal 1901 and the source signal 1902. The identification information generation unit 1905 generates identification information. In this case, the identification information is information that is equally assigned to each other to indicate whether the mixed signal and the additional information are matched, and may be random codes generated randomly, and metadata of the mixed signal 1901 or the source signal 1902. It may be a code including, or any code and metadata code may be combined. In the case of randomly generated random code, it may be at least tens of bits to thousands of bits. Here, the metadata may be information including a composer, an album name, a performer, a record producer, a remixable instrument, and the like, but the present invention is not limited thereto. The identification information may be inserted in the additional information, and thus the additional information in which the identification information is inserted may be used independently.

' 등)을 생성한다. 부가정보인코딩부(1904)는 식별정보생성부(1905)에 의해 생성된 식별 정보를 부가 정보에 삽입하여, 식별 정보가 삽입된 부가 정보(si')를 생성한다.The core encoding unit 1906 inserts the identification information generated by the identification information generation unit 1905 into the mix signal 1901 and inserts the mixed signal (in which the identification information is inserted).

', Etc.) The additional information encoding unit 1904 inserts the identification information generated by the identification information generation unit 1905 into the additional information to generate the additional information si 'into which the identification information is inserted.

20 is a configuration diagram of a first example of a first remix signal decoding apparatus according to an embodiment of the present invention. The first remix signal decoding apparatus includes a core decoder 2001, an additional information decoder 2002, an identification information reader 2003, and a remix renderer 2004.

' 등)에서 제1 식별 정보를 추출한다.여기서 믹스 신호(

' 등)는 도 19와 함께 설명된 제1 리믹스 신호 인코딩 장치의 제1 예의 코어인코딩부(1906)에 의해 생성된 것일 수 있다. 부가정보디코딩 부(2002)는 부가정보(si')에서 제2 식별 정보를 추출한다. 여기서, 부가 정보(si')는 마찬가지로 도 19와 함께 설명된 제1 리믹스 신호 인코딩 장치의 제1 예의 부가정보인코딩부(1904)에 의해 생성된 것일 수 있다.The core decoding unit 2001 is a mixed signal (

Extract the first identification information from the mix signal, etc.

Etc.) may be generated by the core encoding unit 1906 of the first example of the first remix signal encoding apparatus described with reference to FIG. 19. The additional information decoding unit 2002 extracts the second identification information from the additional information si '. Here, the additional information si 'may be generated by the additional information encoding unit 1904 of the first example of the first remix signal encoding apparatus described with reference to FIG. 19.

The identification information reading unit 2003 determines whether the first identification information extracted by the core decoding unit 2001 and the second identification information extracted by the additional information decoding unit 2002 coincide with each other, and as a result, Generate a control signal. If they do not coincide with each other, a control signal of non-reproducibility may be generated, and if they coincide with each other, a control signal of reproducibility may be generated.

등)를 생성할 수 있다.The remix renderer 2004 generates a remix signal using additional information according to the control signal generated by the identification information reader 2003. The additional information may be additional information decoded by the additional information decoding unit 2002, and the mixed signal may be a mixed signal decoded by the core decoding unit 2001. The remix renderer 2004 generates a remix signal in this way, and remixes each source constituting the source signal to remix the signal (

Etc.) can be generated.

21 is a diagram illustrating a procedure of a first example of a first remix signal encoding method according to an embodiment of the present invention. The order of the first example of the first remix signal encoding method shown in FIG. 21 may be implemented by the first remix signal encoding apparatus shown in FIG. 19. Referring to FIG. 21, first, additional information is generated using a mix signal and a source signal (S2101). Then, it is determined whether to generate random identification information (S2102). If it is determined that the identification information is generated randomly (YES in S2102), the identification information is generated by generating a code at random or randomly (S2103).

If it is determined in step S2102 that random identification information is not generated (No in S2102), metadata of the mixed signal or the source signal (eg, composer, album name, performer, record producer, remixable instrument) And so on) (S2104). The method of collecting or acquiring the metadata may be extracted from the mixed signal or may be provided by accessing the information provider server, but the present invention is not limited thereto. Then, identification information is generated using the metadata collected in step S2104 (S2105). In this case, an arbitrary code randomly generated in step S2103 and the identification information generated in step S2105 may be combined. The identification information generated in steps S2103 and S2105 is inserted into the mix signal and the additional information, respectively (S2106).

22 is a diagram illustrating a procedure of a first example of a method of decoding a first remix signal according to an embodiment of the present invention. The order of the first example of the method of decoding the first remix signal illustrated in FIG. 22 may be implemented by the first remix signal decoding apparatus illustrated in FIG. 20.

First, a mix signal and additional information are received (S2201). The mix signal may be a mix signal including identification information, and the additional information may be information including identification information. Then, the first identification information is extracted from the mix signal received in step S2201, and the second identification information is extracted from the additional information (S2202). Then, it is determined whether the first identification information and the second identification information extracted in step S2202 coincide with each other (S2203). If the first identification information and the second identification information do not coincide with each other, it is determined that the mix signal and the additional information do not match with each other and the procedure is terminated (No in S2203). As a result of the determination in step S2203, when the first identification information and the second identification information match each other (YES in S2203), since the mix signal and the additional information match each other, a remix signal is generated using the additional information (S2204). . In this case, step S2204 may be a step of generating a remix signal by remixing each source constituting the source signal.

FIG. 23 is a diagram illustrating a configuration of a second example of an apparatus for encoding a first remix signal according to an embodiment of the present invention. Referring to the difference from the first example described with reference to FIG. 19, in the first example, additional information is generated from the mix signal 1901 and the source signal 1902. In FIG. 2, the source signal 2301 is downmixed by the downmixing unit 2302 to generate a sum signal, and additional information is extracted in the process of downmixing the source signal 2301. Hereinafter, a second example will be described in detail with reference to FIG. 23.

Referring to FIG. 23, a second example of an apparatus for encoding a first remix signal according to an embodiment of the present invention may include a downmixing unit 2301, an additional information generating unit 2303, an identification information generating unit 2306, and a core. An encoding unit 2304 and an additional information encoding unit 2305 are included.

The downmixing unit 2302 generates a sum signal S (n) by downmixing a source signal 2301 including one or more sources. This performs a function substantially similar to the downmixing unit 402 described with reference to FIG. 4. The additional information generator 2303 generates additional information from a source signal 2301 which is composed of one or more sources. The additional information may include a subband power and a gain factor corresponding to each source signal, and the additional information may include a parameter corresponding to a delay in the remix renderer.

Since the identification information generation unit 2306 is a component that generates identification information, and is substantially similar to the identification information generation unit 1905 of the first example illustrated in FIG. 19, a detailed description thereof will be omitted. The core encoding unit 2304 inserts the identification information generated by the identification information generation unit 2306 into the sum signal S (n) to generate a sum signal S (n) 'including the identification information. The additional information encoding unit 2305 inserts the identification information generated by the identification information generation unit 2306 into the additional information to generate additional information si 'including the identification information.

24 is a diagram illustrating a configuration of a second example of the apparatus for decoding a first remix signal according to an embodiment of the present invention. Compared with the first example described above with reference to FIG. 20, instead of receiving a mix signal and additional information including identification information, a sum signal S (n) 'including identification information and additional information are received, Except for the difference that the received sum signal S (n) 'is divided into a plurality of source signals by the side information integrating unit 2401, it is similar.

Referring to FIG. 24, a second example of a first remix signal decoding apparatus according to an embodiment of the present invention may include an additional information integrating unit 2401, a core decoding unit 2403, an additional information decoding unit 2402, and identification information. The reader 2404 and the remix renderer 2405 are included.

)로 분리하는 것으로서, 도 7과 함께 설명된 부가정보통합 부(705)와 거의 유사한 기능을 수행한다.The side information integrating unit 2401 receives the sum signal S (n) ', and uses one or more sources (ie, a plurality of source signals) by using the side information decoded by the side information decoding unit 2402. (

), And performs a function substantially similar to the additional information integrating unit 705 described with reference to FIG. 7.

)로부터 제1 식별정보를 추출한다. 부가정보디코딩부(2402)는 부가 정보로부터 제2 식별 정보를 추출한다. 식별정보판독부(2402)는 코어디코딩부(2403)에 의해 추출된 제1 식별 정보 및 부가정보디코딩부(2402)에 의해 추출된 제2 식별 정보가 서로 일치하는지 여부를 판단하여 제어 신호를 발생시킨다. 리믹스렌더링부(2404)는 식별정보판독부(2404)의 제어 신호에 따라 부가 정보를 이용하여 소스 신호를 재생한다. 이와 같이 소스 신호를 재생하는 데 있어서, 소스 신호를 이루는 각 소스(각 소스 신호들)별로 리믹싱하여 리믹스 신호(

등)를 생성할 수 있다.The core decoding unit 2403 may include one or more source signals (

Extracts the first identification information. The additional information decoding unit 2402 extracts second identification information from the additional information. The identification information reading unit 2402 generates a control signal by determining whether the first identification information extracted by the core decoding unit 2403 and the second identification information extracted by the additional information decoding unit 2402 match each other. Let's do it. The remix rendering unit 2404 reproduces the source signal using the additional information according to the control signal of the identification information reading unit 2404. As described above, in reproducing the source signal, the remix signal (remixed for each source (each source signal) constituting the source signal)

Etc.) can be generated.

25 is a configuration diagram of a third example of a first remix signal encoding apparatus according to an embodiment of the present invention. Referring to the difference from the second example described with reference to FIG. 23, in the second example, the source signal 2301 is downmixed by the downmixing unit 2302 to generate a sum signal, whereas in the third example, the source signal is generated. The only difference is that the signal 2301 is not downmixed and the identification information is inserted as it is, and the other contents are similar. Hereinafter, with reference to FIG. 25, the 3rd example is demonstrated centering on difference with a 2nd example.

A third example of the first remixed signal encoding apparatus includes an additional information generator 2502, an identification information generator 2505, a core encoder 2504, and an additional information encoder 2503. The additional information generation unit 2502, the identification information generation unit 2505, and the additional information encoding unit 2503 are the additional information generation unit 2303, the identification information generation unit 2306, and the second example described in FIG. Since the additional information encoding unit 2305 is almost similar to each other, a description thereof will be omitted.

))에 식별 정보를 삽입한다.The core encoding unit 2504 may include one or more sources (ie, source signals) of a source signal 2501 composed of a plurality of sources.

Insert identification information in)).

FIG. 26 illustrates a configuration of a third example of a first remix signal decoding apparatus according to an embodiment of the present invention. FIG. Referring to a difference from the third example described with reference to FIG. 24, in the second example, the sum signal S (n) is separated into individual source signals by the additional information integrating unit 2401, while the third In the example, since the sum signal S (n) is not received but the individual source signal 2601 is received, there is only a difference in that there is no additional information integrating unit 2401. Soy. That is, a third example of the first remix signal decoding apparatus according to an embodiment of the present invention includes a core decoder 2601, an additional information decoder 2602, an identification information reader 2608, and a remix renderer 2608. Which is almost similar to the core decoding unit 2403, the additional information decoding unit 2402, the identification information reading unit 2404, and the remix rendering unit 2405 in the second example described with reference to FIG. Since it is a component, a description thereof will be omitted.

FIG. 27 is a diagram illustrating a procedure of a second example and a third example of a first remix signal encoding method according to an embodiment of the present invention. FIG. The order of the second example and the third example of the first remix signal encoding method illustrated in FIG. 27 may be implemented by the second example and the third example of the first remix signal encoding apparatus illustrated in FIGS. 23 and 25, respectively. . Referring to FIG. 27, first, one or more source signals are downmixed to generate a sum signal (only in the case of the second example) (S2701). Then, additional information is generated using one or more source signals of S2701 (S2702). Then, the same steps as the steps S2102 to S2105 in the first example described with reference to FIG. 21 are performed (S2703 to S2706). Then, the identification information generated in steps S2704 and S2706 is inserted into the sum signal (one or more source signals in the third example) and the additional information, respectively (S2707).

28 is a flowchart illustrating a second example and a third example of a method of decoding a first remix signal according to an embodiment of the present invention. The order of the second example and the third example of the method of decoding the first remix signal shown in FIG. 28 may be implemented by the second example and the third example of the first remix signal decoding apparatus shown in FIGS. 24 and 26, respectively. .

Referring to FIG. 28, a sum signal (one or more source signals in the third example) and additional information are received (S2801). First identification information is extracted from the sum signal (or one or more source signals), and second identification information is extracted from the additional information (S2802). Then, the sum signal is reproduced under the condition (No in S2803) that the first identification information and the second identification information coincide. As described above, in reproducing the source signal, the remix signal may be generated by remixing each source (each source signal) constituting the source signal.

29 is a diagram illustrating a configuration of a second remix signal encoding apparatus according to an embodiment of the present invention. In the first remix signal encoding apparatus according to an embodiment of the present invention, the identification information is inserted into the mixed signal (or sum signal, the source signal) and the additional information, respectively, but the second remix signal encoding apparatus will be described later. In this case, no information is inserted into the mix signal (or sum signal or source signal), and predetermined information is inserted only in the additional information.

Referring to FIG. 29, a second remix signal encoding apparatus according to an embodiment of the present invention includes a unique information extractor 2902 and an additional information encoder 2907.

The unique information extracting unit 2902 extracts unique information from the mixed signal 2901 (or the sum signal and the source signal). Here, the unique information refers to information that can distinguish unique signals appearing only in a specific mix signal from the mixed signals and other signals as unique information. For example, it may be a value of a sample of a specific section of the mix signal, and may include a length of a sample and a value of a sample of a particular section of the mix signal, but the present invention is not limited thereto.

33 is a diagram schematically illustrating a principle of extracting unique information from a mixed signal and the like, and is an example of extracting continuous sample values from a mixed signal and the like. For example, if the unique information is 'sample length' and 'the value of three consecutive samples from the point three seconds from the start', the mix signal has a sampling frequency of 44.1KHz and a total time of 3: 12.45. In this case, the length of the sample is as follows.

(3 * 60 + 12.45) [sec] * 44100 [1 / sec] = 8487045

From the point three seconds after the start, the values of the first sample are 50 (L1) and 196 (R1), and the values of the second sample are 5421 (L2) and 4515 (R2). If the value of the first sample is 18542 (L3) and 15487 (R3), the unique information is "8487045, 50 (L1), 196 (R1), 5421 (L2), 4515 (the combination of the sample length and the sample value). R2), 18542 (L3), 15487 (R3) ". Referring to FIG. 29 again, the remaining components will be described.

The additional information encoding unit 2907 inserts the unique information of the specific mix signal 2901 extracted by the unique information extracting unit 2902 into the corresponding additional information si, so that the additional information si includes the unique information (si). Create ')

30 is a diagram illustrating a configuration of a second remix signal decoding apparatus according to an embodiment of the present invention. Referring to FIG. 30, the second remix signal decoding apparatus includes a unique information extractor 3002, an additional information encoder 3003, an identification information reader 3004, and a remix renderer 3005.

The unique information extraction unit 3002 extracts first unique information from the mixed signal (or the sum signal and the source signal). The method of extracting the first unique information may be the same as the method of extracting the unique information by the unique information extractor 3002 of the encoding apparatus of FIG. 29. The additional information encoding unit 3003 extracts the second unique information from the additional information si 'including the unique information. The identification information reading unit 3004 determines whether the first unique information extracted by the unique information extracting unit 3002 and the second unique information extracted by the additional information encoding unit 3003 match to generate a control signal. Let's do it. The remix rendering unit 3005 reproduces the mixed signal (or the sum signal, the source signal) using the additional information according to the control signal of the identification information reading unit 3004.

31 is a flowchart of a second remix signal encoding method according to an embodiment of the present invention. FIG. 31 may be implemented by the second remix signal encoding apparatus shown in FIG. 29. First, a mix signal (or sum signal, source signal) and additional information are received (S3101). Then, the unique information is extracted from the mixed signal (or sum signal, source signal) received in step S3101 (S3102). The unique information extracted in step S3102 is inserted into the additional information received in step S3101 (S3103).

32 is a flowchart of a method for decoding a second remix signal according to an embodiment of the present invention. 32 may be implemented by the second remix signal decoding apparatus illustrated in FIG. 30. First, a mix signal (or a sum signal, a source signal) is received (S3201). Then, the first unique information is extracted from the mixed signal (or the sum signal and the source signal) received in step S3201 (S3202). In operation S3203, the second unique information is extracted from the additional information received in step S3201. Then, it is determined whether or not the first unique information received in step S3202 and the second unique information received in step S3203 match, and if it matches (YES in S3204), the mixed signal (or sum) is used by using additional information. Signal and source signal) (S3205). Of course, in reproducing the mixed signal (or the sum signal and the source signal), the remix signal may be generated by remixing each source constituting the source signal.

34 shows a data area of a recording medium storing additional information of a mix signal according to an embodiment of the present invention. In the present invention, the recording medium refers to a medium capable of storing information. For example, a CD (Compact Disc), a DVD (Digital Versatile Disc), a BD (Blu-ray Disc), and the like. The recording medium includes a lead in area, a lead out area, and a data area. Environment setting information about information stored in the data area may be stored in the lead-in area, and a mix signal and data about the mix signal may be stored in the data area. In addition, the above-described mix signal and additional information that can be extracted or used independently of each other can also be independently stored in the recording medium. Referring to FIG. 34, the additional information 3404 for the mix signal may be stored in the data area 3402 of the recording medium, and the configuration information 3403 for the additional information may be stored in the management area 3401. . The management area 3401 may exist in the data area of the recording medium or in the lead-in area. In the following, a method of storing additional information is described in more detail.

35 is a diagram for a method of storing additional information by dividing a data area of a recording medium into a plurality of sessions according to an embodiment of the present invention. Referring to FIG. 35, a data area of a recording medium may be divided into a plurality of areas, for example, a plurality of sessions 3501, 3502, and 3503. Mix signals and additional information may be stored in each of the sessions. For example, the mixed signal 1 may be stored in session 1 3501, the additional information data of the mixed signal may be stored in session 2 3502, and the mixed signal 2 may be stored in session 3 3503.

Within each session there may be a lead-in area and a lead-out area. In this case, the environment setting information for the additional information may be stored in the lead-in area. Accordingly, the decoding apparatus may read the configuration information in the lead-in area and extract additional information in the data area. There may be a recordable area 3504 in which the mixed signal and the additional information data are not stored. If additional information is needed, after creating a specific area in the recordable area 3504, additional information may be stored in the generated area.

36 illustrates a method of storing additional information in the session of FIG. 35 according to an embodiment of the present invention. The session may be divided into a plurality of regions, for example, data tracks, so that mixed signals and additional information may be stored in each data track. Referring to FIG. 36, session 1 may be divided into a plurality of data tracks, and a mix signal and additional information data may be stored in each data track. For example, additional information data 1 may be stored in data track 1 3601, mix signal 1 may be stored in data track 2 3602, and mix signal M may be stored in another data track 3603. Session 2 has only one data track 3604, and additional information data 2 may be stored in the data track 3604.

37 illustrates a method of randomly storing additional information in a data area of a recording medium according to an embodiment of the present invention. Referring to FIG. 37, additional information used to generate a remix signal using the mix signal may be randomly stored in the data area. That is, unlike creating a specific area and storing additional information in the specific area as shown in FIG. 36, the additional information is randomly stored by finding a recordable area in the data area. For example, the additional information is added to the recordable areas 3702, 3703 and 3704 after finding the recordable areas 3702, 3703 and 3704 randomly located in the data area composed of a plurality of clusters in the data area. Information can be stored. Environment setting information for the additional information may be stored in a specific area 3701 within the management area. In this case, the environment setting information may be stored in the form of a file. The decoding apparatus may extract configuration information about the additional information, for example, the type and location of the additional information, from the management area, and extract additional information randomly stored in the data area using the configuration information.

FIG. 38 is a block diagram illustrating a reproducing apparatus generating a remix signal by using a mix signal and additional information stored in a recording medium according to an embodiment of the present invention. The playback apparatus includes a bitstream detector 3801, a system memory 3804, an inverse modulator 3805, an error corrector 3808, a microprocessor 3810, a user control input unit 3811, a display unit 3812 ), A remix rendering unit 3809, and a digital / analog (D / A) converter 3815.

Referring to FIG. 38, the bitstream detector 3801 detects a bitstream 3800 from a recording medium, and separates a mix signal 3902 and additional information 3803 from the bitstream 3800. The system memory 3804 stores the additional information 3403 separated from the bitstream 3800. The mix signal 3802 is inversely modulated by the inverse modulator 3805, and the inversely modulated signal 3808 corrects an error generated during the transmission and decoding process by the error corrector 3809. The error corrected signal 3808 is input to the remix rendering unit 3809. The microprocessor 3810 extracts the additional information 3803 stored in the system memory 3804 and inputs it to the remix renderer 3809. In addition, the microprocessor 3810 may input the user control information 3913 input through the user control information input unit 3811 to the remix renderer 3809. In addition, the microprocessor 3810 may control the display unit 3812 to receive the user control information 3818, and may control the inverse modulator 3805 and the error correction unit 3907. . The remix renderer 3809 may generate a remix signal using the additional information 3803, the user control information 3713, and the mix signal 3808 input by the microprocessor 3810. The number of remixed source signals may be equal to or smaller than the total number of source signals included in the mix signal. The D / A converter 3815 then converts the digital mix signal remixed by the remix renderer 3809 into an analog signal 3816. Although FIG. 38 illustrates playback with a stereo signal, the present invention is not limited thereto and includes playback with a multichannel mixed signal.

39 is a flowchart illustrating a method of storing additional information of a mix signal in a data area of a recording medium according to an embodiment of the present invention. Referring to FIG. 39, first, additional information is generated using the mix signal and the source signal (S3901). In this case, the source signal may be a source signal included in the mix signal. The generated additional information is then quantized and encoded, and the encoded additional information is stored in the recording medium. If the recording medium is a recording medium capable of random recording (YES in S3902), the additional information may be randomly stored in an unrecorded cluster in the data area of the recording medium (S3804). If the recording medium is not a recording medium capable of random recording (NO in S3902), the additional information may be stored in a specific area within the data area of the recording medium. Next, the environment setting information for the additional information is stored in the management area of the recording medium (S3905). The present invention includes storing the environment setting information at the same time as the additional information or storing the additional information before the additional information.

40 illustrates a system for providing remix information after confirming an unidentified mix signal according to an embodiment of the present invention. The system includes a client device 4001 and a server 4002 and a remix server 4003.

Referring to FIG. 40, the client device 4001 extracts the unique information 4004 of the unconfirmed mix signal, and transmits the extracted unique information 4004 to the server 4002. In the present invention, the client device 4001 refers to a computer system that connects to a server system through a communication network, requests a server for main tasks or information, and receives a result thereof. For example, an example of the client device 4001 is a user's PC connected to the Internet. In the present invention, the server refers to a computer system for providing main information or performing work through a communication network. 40 shows an example of a CDDB server provided by Gracenote, but the present invention is not limited to the CDDB server. The unique information 004 includes a fingerprint of a mix signal, a table of contents (TOC), a file name, a track length, text information, hash information, and the like. Further, the unique information 4004 can be any information that can be used to distinguish the mix signal from other mix signals.

The server 4002 may check the unconfirmed mix signal by using the unique information 4004. At this time, the server 4002 may check the unconfirmed mix signal using a database stored in the server 4002 in addition to the unique information 4004. The server 4002 then provides the client device 4001 with acknowledgment 4005 for the unconfirmed mix signal. In this case, the server 4002 may provide the client device 4001 with information related to the mix signal in addition to the confirmation information 4005. For example, if the mix signal is a song, the related information may include a singer of the song, an album title in which the song is recorded, a performer, and the current degree of popularity of the song. The remix server 4003 may provide additional information 4006 for the identified mix signal. The additional information may include a gain value for each source signal of the mixed signal, a subband power, and the like. The client device may generate a remix signal using the additional information and control information provided directly by the user.

FIG. 41 is a block diagram illustrating in more detail the system of FIG. 40 in accordance with an embodiment of the present invention. FIG. Referring to FIG. 41, an unconfirmed mix signal 4101 is input to the client device 4102. The unconfirmed mix signal 4101 may be stored in a recording medium or provided through a communication network such as the Internet. The client device 4102 may extract at least one of unique information, for example, ID 4106, fingerprint 4107, table of contents 4108 and file name 4109 of the mix signal from the unidentified mix signal. Can be. The unique information 4106, 4107, 4108, and 4109 shown in FIG. 41 are exemplary, and other unique information may be extracted in addition to the shown unique information. The extracted information is then sent to the recognition server 4103. The recognition server 4103 may check whether the unique information 4106, 4107, 4108 and 4109 of the unconfirmed mix signal matches the unique information stored in the CDDB 1104 (4110, 4111, 4112 and 4113). In this case, the recognition server 4103 may check the unconfirmed mix signal 1101 in a multi-step process. For example, first, it is checked whether or not the ID matches the ID in the CDDB 4104 using only the ID 4106 of the unconfirmed mix signal 4101 (4110). If the unchecked mix signal is confirmed, the checking process is terminated. However, if the unconfirmed mix signal is not confirmed, the verification process may be performed using other information of the unconfirmed mix signal 4101, for example, the fingerprint 4107 of the unconfirmed mix signal.

If the recognition server 4103 confirms the unconfirmed mix signal, it provides the confirmation information 4114 to the client device 4102. In this case, as described above, the recognition server 4103 may provide other information related to the unconfirmed mix signal 4101 from the CDDB 4104 in addition to the confirmation information 4114. If the recognition server 4103 fails to check the unconfirmed mix signal 4101, the information about the unconfirmed mix signal 4101 may be stored in the CDDB 4104 or in a separate storage device 4115. In addition, the recognition server 4103 not only provides the client device with confirmation information 4114 regarding the unconfirmed mix signal 4101, but also extracts information 4106, 4107, 4108 and 4109 for the unconfirmed mix signal 4101. Can be stored in the CDDB 4104. In this case, a cleansing process for the extracted information 4106, 4107, 4108, and 4109 may be applied. The cleaning process will be described later with reference to FIG. 14. After confirming the mix signal, the recognition server 4103 may extract the remix information about the mix signal from the remix database 4105 and provide it to the client device 4102. A method of providing remix information is described below with reference to FIG. 42. The remix information may be provided with acknowledgment information 4114 for the unconfirmed mix signal 4101, or if the client device requests after acknowledgment information 4114 is provided.

42 illustrates a method of providing additional information according to a mix signal file according to an embodiment of the present invention. Referring to FIG. 42, the mixed signal file may be classified into at least three groups according to whether additional information is provided. The first group consists of first mix signal files (file 1, file 2, file 3, 4202) having remix information from the beginning, and the second group consists of second mix signal files which are later provided with additional information. (File 4, file 5, 1203), and the third group consists of third mix signal files (file 6, file 7 to file N, 4204) that have not yet been provided with additional information.

When the mixed signal files are classified as described above, the first method of providing additional information is to provide additional information at once for all of the third audio files constituting the third group. A second method of providing additional information is to provide additional information in groups to the third mix signal files. That is, after grouping the units for providing additional information in advance, the additional information is provided for each group to the client device. In this case, since the additional information is provided in units of a predetermined group, the additional information may be repeatedly provided in some of the remix signal files 4202 and 4203 that already have the additional information. A third method of providing additional information is to provide additional information for each file in the third mixed signal file. The first method, the second method, and the third method may be provided with additional information when the user requests through the client device. In addition, additional information may be automatically provided when the client device is connected to the recognition server.

43 is a block diagram illustrating a method of generating a playlist of mixed signals according to an embodiment of the present invention. Unique information is extracted to identify an unidentified mix signal, and the unidentified mix signal is identified using the unique information. In this case, the playlist of the unidentified mix signal may be generated using the unique information. Referring to FIG. 43, unique information 4301 of an unconfirmed mix signal is input to an interface table 4302. The interface table 4302 may be configured of a plurality of interfaces. For example, it may include an interface 1 for TOC information of an unconfirmed mix signal, an interface 2 for album name information, an interface N for track name information, and the like. The interface filter 4303 cleans and provides unique information provided from the user. The cleaning method is described in detail in FIG. 44. The interface processor 4304 matches and merges unique information provided from the user, for example, TOC, album name, and track name information with information (TOC, album name, track name) stored in the database 4305. If the unique information 4301 is new unique information that is not stored in the database 4305, a new playlist may be generated using the unique information.

44 is a flowchart illustrating a cleaning method according to an embodiment of the present invention. The cleaning method may be performed by an interface filter. In the present invention, the cleansing method refers to determining whether a name representing specific information has a valid spelling. For example, when the album name of a particular singer is "My Choice", when the user inputs the album name as "mychoice", it means to judge that it is recognized as "My Choice." Referring to FIG. 44, first, new unique information about an unconfirmed mix signal is input (S4401). Then, it is determined whether the spelling of the new unique information is valid (S4402). At this time, by comparing the unique information stored in the database such as CDDB, it is possible to determine whether the spelling of the new unique information is valid. If the spelling is valid, it is determined whether the spelling is valid enough to be recorded in a conventional record already existing (S4404). If it is determined to be sufficiently valid, the new unique information is added to the conventional record (S4405). If it is determined that it is not valid enough, a new unique information is generated separately (S4406). Then, the unique information is stored in a database (S4407). By using the data stored using the above-described cleansing method, even when the user inputs inaccurate unique information, the user can recognize the correct unique information.

45 is a flowchart illustrating a method of providing additional information after confirming an unidentified mix signal according to an embodiment of the present invention. Referring to FIG. 45, first, an unidentified mix signal is input (S4501). The client device extracts first unique information from the unconfirmed mix signal (S4502). The first unique information may be transmitted to a recognition server to confirm the unconfirmed mix signal. The recognition server compares the first unique information with second unique information stored in a database such as a CDDB (S4503). If the recognition server can confirm the unconfirmed mix signal (YES in S4504), the confirmation information and the additional information are extracted (S4505). Then, the extracted information is transmitted to the client device (S4506). The additional information may be transmitted to the client device together with the confirmation information as described above. The additional information may also be transmitted to the client device when the user requests after transmitting the confirmation information. If the recognition server cannot confirm the unconfirmed mix signal (S4504), the recognition server transmits a message to the client device indicating that the unacknowledged mix signal cannot be confirmed (S4507).

Although the present invention has been described in detail with reference to some embodiments, the above embodiments are presented for the purpose of understanding the present invention, and the scope of the present invention is not limited to the above embodiments. Those skilled in the art will understand that various modifications are possible without departing from the scope of the technical idea of the present invention, and the scope of the present invention should be interpreted by the appended claims.

As described above, the signal processing method and apparatus according to the present invention may adjust the mix signal for each source signal, independently transmit the mix signal and the additional information, and may modify the additional information to match the new mix signal. have.

In addition, in the signal processing method and apparatus according to the present invention, when the mixed signal (or source signal) and the additional information corresponding thereto are present in separate files, the mixed signal (or source signal) and the additional information that exist separately are respectively present. Since it is possible to confirm with certainty that s match each other, it is possible to improve the generation quality of the remix signal.

In addition, the signal processing method and apparatus according to the present invention provides a convenient effect of providing additional information suitable for the mixed signal using a communication network such as the Internet after confirming an unidentified mixed signal.

Claims (34)

Independently obtaining the first mix signal or the first side information from the multiplexed first mix signal and the first side information; Obtaining a user mix parameter; And Generating a remix signal using the first mix signal or the first additional information and the user mix parameter, And the first mixed signal includes one or more source signals, and wherein the first additional information indicates a relationship between a source signal to be remixed and the first mixed signal. The method of claim 1, wherein the signal processing method is Obtaining a second mix signal from a user; And If the first mix signal and the second mix signal are not the same, transforming the first additional information into second additional information about the second mix signal, and The generating of the remix signal may include generating a remix signal using the second additional information, the user mix parameter, and the second mix signal. The method of claim 2, wherein the modifying step And modifying a time sync or period of the first additional information. The method of claim 2, wherein generating the remix signal And aligning time synch of the second additional information with the second mixed signal by using timing information included in at least one of the second additional information and the second mixed signal. . The method of claim 1, wherein the signal processing method is Obtaining a second mix signal from a user; And Generating a remix signal using the first additional information, the user mix parameter, and the second mix signal when the first mix signal and the second mix signal are the same. . The method according to claim 2 or 5, Whether the first mix signal and the second mix signal are the same is determined using identification information indicating whether the mix signal and the additional information match. Obtaining a mix signal comprising one or more source signals; Acquiring additional information indicating a relationship between the source signal to be remixed among the source signals and the mixed signal; And And multiplexing the mix signal and the additional information. The method of claim 7, wherein The multiplexing simply combines the mixed signal and the additional information, includes the additional information in an additional area of the mixed signal, combines the mixed signal and the additional information in one packet unit, or And embedding the additional information in a non-perceptual region. Obtaining a mix signal comprising one or more source signals; Generating side information using the mix signal and a source signal to be remixed among the source signals; And Storing or transmitting the mix signal and the additional information independently; And the additional information indicates a relationship between the source signal to be remixed and the mix signal. 10. The method of claim 9, wherein the storing step And independently recording the mixed signal and additional information in a recordable area of a recording medium. The method of claim 10, wherein the recording step Generating a first area and a second area in the recordable area, storing the mixed signal in the first area, and storing the additional information in the second area. . The method of claim 10, wherein the recording step And randomly storing the additional information in the recordable area. Generating side information using a mix signal including one or more source signals; And Generating identification information and inserting the identification information into at least one of the mix signal and the additional information; The identification information is a signal processing method, characterized in that the information indicating whether the mixed signal and the additional information. The method of claim 13, Wherein the identification information comprises one or more of randomly generated random codes and codes including metadata of the mix signal. Obtaining a mix signal including at least one source signal and additional information of the mix signal; Obtaining first identification information from the mix signal and obtaining second identification information from the side information; Obtaining a user mix parameter; And And generating a remix signal using the additional information, the user mix parameter, and the mix signal when the first identification information and the second identification information coincide with each other. A core decoding unit extracting first identification information from a mix signal including one or more source signals; An additional information decoding unit which extracts second identification information from the additional information; An identification information reading unit for generating a control signal by determining whether the first identification information and the second identification information match each other; And And a remix rendering unit configured to generate a remix signal using the additional information, the mix signal, and control information obtained from a user according to the control signal. A mix signal storage unit for storing the first mix signal obtained from the multiplexed first mix signal and the first side information; An additional information storage unit which stores the first additional information obtained from the multiplexed first mix signal and the first additional information; And And a remix renderer configured to generate a remixed signal using the first mixed signal, the first additional information, and the control information obtained from the user. 18. The apparatus of claim 17, wherein the signal processing apparatus A mix signal input unit to obtain a second mix signal from a user; And And an additional information transformation unit configured to transform the first additional information into second additional information about the second mixed signal. And the remix renderer generates a remix signal using the second mixed signal and the second additional information. An additional information generator configured to generate additional information using a mix signal including one or more source signals and a source signal to be remixed; And Including a signal transmission unit for transmitting the mix signal and the additional information independently, And the additional information indicates a relationship between the source signal to be remixed and the mix signal. An additional information generator configured to generate additional information using a mix signal including one or more source signals; An identification information generation unit for generating identification information; And And an additional information encoding unit to insert the identification information into the additional information, wherein the identification information indicates whether the mix signal matches the additional information. The apparatus of claim 20, wherein the signal processing device is And a core encoding unit inserting the identification information into the mix signal. Extracting unique information from a mix signal comprising one or more source signals; And Including the unique information in the additional information associated with the mix signal, The unique information is a signal processing method, characterized in that the information that can be distinguished from the mixed signal and other signals. The method of claim 22, The unique information includes a signal value of a specific section of the mixed signal, or a length of a sample and a value of a sample of a specific section. Obtaining unique information of an unidentified mix signal comprising one or more source signals; Identifying the mix signal using the unique information; And Acquiring additional information related to the mix signal; The unique information is information for distinguishing the mixed signal from other signals, and the additional information indicates a relationship between the source signal to be remixed among the source signals and the mix signal. The method of claim 24, The unique information includes at least one of fingerprint information, text information, track length information, table of contents (TOC) information, and hash information of the mixed signal. The method of claim 24, wherein the acquiring the additional information When the user requests the mix signal, acquiring additional information about all the mix signals requested by the user. The method of claim 26, The additional information is obtained by a predetermined group. The method of claim 24, wherein the acquiring the additional information When the user requests the mix signal, acquiring only a mix signal having no additional information among the mix signals requested by the user. The method of claim 24, wherein the acquiring the additional information And when the computer used by the user of the mixed signal and the server providing the additional information are connected, the additional information is automatically acquired. The method of claim 29, And the additional information is obtained with respect to a mixed signal having no additional information among the mixed signals existing in the user's computer. The method of claim 24, wherein the signal processing method is Obtaining a user mix parameter; And And generating a remix signal using the additional information, the mix signal, and the user mix parameter. Obtaining unique information of an unidentified mix signal including one or more source signals from a user; Identifying the mix signal in a database corresponding to the mix signal using the unique information; And Providing the user with additional information regarding the identified mix signal, The unique information is information for distinguishing the mixed signal from other signals, and the additional information indicates a relationship between the source signal to be remixed among the source signals and the mix signal. 33. The method of claim 32, wherein said checking step Identifying the mix signal using the unique information of one of the unique informations, and identifying the mix signal using the other unique information if it is impossible to verify. 34. The method of claim 33, wherein the signal processing method Generating a playlist of the mix signal using the unique information and the database.

Images