KR20080100312A - Apparatus and method for inputting a key command - Google Patents

Abstract

An apparatus and a method for inputting a key command are provided to display information with regard to a source signal related to a mix signal, thereby enabling a user to check the information all the time. A shortcut key registration command is received(S110). One key among a plurality of keys, one source of a plurality of sources, and one function of at least one function are selected(S120,S140). The selected function is matched with the selected key with regard to the selected source and stored(S160). The sources comprise at least one between a source of an audio signal and a source of a video signal. At least one function includes sound removal or ambience adjustment.

Description

Key input device and input method {APPARATUS AND METHOD FOR INPUTTING A KEY COMMAND}

The present invention relates to an input device and an input method, and more particularly, to an input device and an input method capable of inputting necessary commands for controlling a mix signal.

In general, stereo signals are most commonly generated and most widely used by consumers. In recent years, multichannel signals have been increasingly used. However, there is a limitation that the mixed signal is processed in the channel signal unit, not in the source signal unit constituting the mix signal. Therefore, when processing the mixed signal in the channel signal unit, there is a problem that only a specific source signal constituting the mixed signal can not be processed independently. For example, while watching a movie, it is impossible to increase the volume of background music while keeping the volume of actors' voices constant.

In addition, in order for a user to independently process and remix a mixed signal (or a composite object signal) by source, that is, by a specific source signal, the user may increase or decrease the volume level for each source signal (the sound level may be set to 0 at all). Erasing), the relative position of the source signal must be adjusted. However, the conventional remote control only has to adjust the volume level of the entire mix signal, there is a problem that can not adjust the volume level or ambience of each of the source signals included in the mix signal.

Also, in order for a user to remix a mixed signal (or a composite object signal) by source, that is, by source signal, the user should know what source signals are included in the mixed signal. For example, if the mix signal is a music file, the user must know if the source signals associated with the music file are piano, violin, flute, or the like. However, in the related art, only the information of the mixed signal (or the composite object signal) may be displayed, but there is a problem in which the information of the source signals related to the mixed signal is not displayed.

The present invention has been made to solve the above problems, the input device and input method that can adjust the volume level or ambience (relative position) for each source signal included in the mixed signal, such as video signal and audio signal The purpose is to provide.

Still another object of the present invention is to provide a method and apparatus for displaying an interface of a mixed signal that can display information related to a source signal (or an object signal) associated with the mixed signal (or a composite object signal) so that a user can always check. To provide.

In order to achieve the above object, the input device according to the present invention, the input unit; A control unit for converting an input signal received through the input unit into a menu display command for each source, and outputting a menu display screen for each source based on source information corresponding to a mix signal according to the menu display command for each source; And an input device including a display on which the menu display screen for each source is output.

According to the present invention, the apparatus further includes a pointing device, and the controller may convert the input signal received through the pointing device into a level adjustment command for each source.

According to the present invention, the direction shift key may be further included, and the controller may convert the input signal received through the direction shift key into a level adjustment command for each source.

According to another aspect of the invention, the input unit; A controller converting an input signal received through the input unit into a menu display command for each source; And a wireless communication unit for transmitting the command converted by the controller to an external device.

According to the present invention, the wireless communication unit is for receiving data on a menu screen for each source from the external device, and may further include a display on which the menu screen for each source is displayed.

According to another aspect of the invention, the input unit; There is provided an input device including a control unit for converting an input signal received through the input unit into a voice muting command and outputting control information on the mix signal based on the voice muting command.

According to another aspect of the invention, the input unit; And a control unit for converting an input signal received through the input unit into a voice level adjustment command and outputting control information on the mix signal based on the voice level adjustment command.

According to another aspect of the invention, the input unit; A control unit for converting an input signal received through the input unit into an ambience screen display command and outputting an ambience screen based on source information corresponding to the mix signal according to the ambience screen display command; And a display for outputting the ambience screen.

According to the present invention, the apparatus further includes a pointing device, wherein the controller converts an input signal received through the pointing device into an ambience adjustment command and outputs control information on the mixed signal based on the ambience adjustment command. It may be.

According to another aspect of the invention, the input unit; A control unit for converting an input signal received through the input unit into a source mute command and outputting control information on the mix signal based on the source mute command, wherein the source mute command is included in the mix signal. An input device is provided which is a command for preventing a specific source signal from being reproduced.

According to another aspect of the invention, the step of receiving a shortcut key registration command; Selecting one of the plurality of keys, one of the plurality of sources, and one of the one or more functions; And matching and storing the selected function with the selected key with respect to the selected source, wherein the plurality of sources comprises one or more of a source of an audio signal and a source of a video signal. The above functions are provided with an input method comprising one or more of muting and ambience adjustment.

According to the present invention, the selecting step may be a step in which one of the numeric keys is selected.

According to another aspect of the invention, the input unit for selecting one of the plurality of keys, one of the plurality of sources, and one of the one or more functions; A memory unit for storing command information for each key; And a controller for matching the selected function with respect to the selected source to the selected key by the input unit and storing the selected function in the memory unit, wherein the plurality of sources include one of an object of an audio signal and an object of a video signal. One or more functions are provided, and an input device including one or more of mute and ambience adjustment is provided.

The interface display method according to the present invention comprises the steps of receiving a specific mix signal from the user; And querying source signal information corresponding to the mix signal to display the list of source signals on a display, wherein the display is maintained while the mix signal is selected.

According to the present invention, the source signal information may be extracted from additional information corresponding to the mixed signal.

According to the present invention, the list of source signals may be one or more of an instrument name, a singer name, and a character name of a source signal included in the mix signal.

According to the present invention, a step of receiving one source from the list of the source signal from the user; And further displaying metadata regarding the selected source.

According to the present invention, the metadata may be extracted from additional information corresponding to the mixed signal, and may include one or more of a musical instrument performer name and a production date of the source signal.

According to the present invention, a step of receiving one source from the list of the source signal from the user; The method may further include displaying a volume level adjustment screen for the selected source.

According to the present invention, a step of receiving one source from the list of the source signal from the user; And further displaying an equalizer adjustment screen for the selected source.

According to the present invention, a step of receiving one source from the list of the source signal from the user; And further displaying an ambience adjustment screen for the selected source.

According to another aspect of the invention, the input unit for selecting one of the plurality of mixed signals; A controller which inquires source signal information corresponding to the mixed signal and displays a list of the source signals; And a display for displaying the list of the source signals, wherein the display is provided with an interface display device of the mixed signals which is maintained while the mixed signals are selected.

According to the present invention, the apparatus further includes a second display, wherein the input unit is for selecting one source of the list of the source signals, and the controller is configured to include metadata for the selected source, a volume level adjustment screen, and an equalizer. At least one of an adjustment screen and an ambience adjustment screen may be displayed on the second display.

According to the present invention, the display may display a list of the source signals by blinking a plurality of light emitting devices.

According to the present invention, the display and the second display may be composed of one panel.

According to an aspect of the present invention, since the volume level or ambience (relative position) can be adjusted for each source signal included in the mixed signal such as the video signal and the audio signal, the user can easily remix the mixed signal. Can be.

According to another aspect of the present invention, since the user can mute only the human voice or adjust the volume level of the voice among the sources included in the mixed signal, the user can use the input device (remote control) while the song file is being played. Very simply mute only the singer's voice and listen to the accompaniment music.

According to another aspect of the present invention, after a user frequently registers a source (e.g. piano) that is frequently remixed as a shortcut key to a specific key (e.g., number 1 key), the user can use the shortcut key to adjust level or ambience for each source. In the case of adjustment, the user can remix very conveniently using an input device (remote control) set to his or her taste.

According to another aspect of the present invention, since information on the source signal (or object signal) associated with the mix signal (or composite object signal) is still displayed on the screen, the user can play or remix the mix signal. You can see which sources are included in the mix signal.

According to another aspect of the present invention, while the mix signal is being reproduced or remixed, the user can always check what sources (such as per-instrument audio signals) are included for each mix signal, so that the level can be adjusted by source. Before adjusting the ambience, there is no need to perform a procedure to determine which sources are in the mix.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

In particular, the term 'input unit' or 'key' in the present specification should be understood as a means for inputting a specific input signal, and is not limited to input methods such as a button key and a touch sensor.

1 is a block diagram of a first remix signal encoder according to an embodiment of the present invention. The first remix signal encoder includes an additional information generator 103 and an additional information encoder 105.

Referring to FIG. 1, the additional information generator 103 generates additional information 104 using a typical mix signal 101 and a source signal 102 constituting the mixed signal. The mix signal 101 may be a mono, stereo, and multi-channel audio signal. The source signal 102 may be some or all of the source signals constituting the mix signal 101. The additional information 104 refers to information used to process the mixed signal in source signal units. The additional information 104 includes mix parameters for remixing the mix signal. The mix parameter may include an encoder mix parameter generated using a source signal in an encoder, and optionally, a blind mix parameter generated using only a mix signal. Examples of the mix parameter may include a gain value and a subband power for each source signal. A detailed definition and generation method for the additional information 104 is described in FIG. 2. The present invention also includes generating the additional information 104 using only the source signal 102 constituting the mix signal. The side information encoding unit 105 encodes the generated side information 104 to generate an encoded side information signal 106. The mix signal 101 and the side information signal 106 are transmitted to a decoding apparatus.

FIG. 2 is a detailed block diagram of the first remix signal encoding apparatus of FIG. 1 when the mixed signal is a stereo signal. As described above, the mixed signal used in the present invention may be a mono, stereo, and multi-channel audio signal, but for convenience, it will be described with reference to the stereo signal 201.

및

는 상기 스테레오 신호를 구성하는 소스 신호들의 합으로 표현될 수 있다. 여기서, n은 타임 인덱스를 의미한다. 따라서, 상기 스테레오 신호(201)는 아래의 [수학식 1]과 같이 표현될 수 있다.The stereo signal 201

And

May be expressed as a sum of source signals constituting the stereo signal. Here, n means time index. Therefore, the stereo signal 201 may be expressed as Equation 1 below.

은 소스 신호들을 나타낸다.

및

는 각각의 소스 신호에 대한 진폭 패 닝(amplitude panning) 및 게인(gain)을 결정하는 값이다. 모든

들은 서로 독립적이다. 상기

는 모두 순수한 소스 신호이거나, 또는 순수한 소스 신호에 약간의 잔향(reverberation) 및 효과음 신호성분(sound effect signal components)을 포함할 수 있다. 예를 들면, 특정한 잔향 신호성분은 2개의 소스 신호, 즉, 왼쪽 채널로 믹스된 신호와 오른쪽 채널로 믹스된 신호로 표현될 수 있다.Here, I is the number of source signals included in the stereo signal,

Represents source signals.

And

Is a value that determines the amplitude panning and the gain for each source signal. all

They are independent of each other. remind

Are all pure source signals, or may include some reverberation and sound effect signal components in the pure source signal. For example, the specific reverberation signal component may be represented by two source signals, that is, a signal mixed with the left channel and a signal mixed with the right channel.

It is an object of the present invention to modify a stereo signal comprising the source signal such that M (0 <= M <= I) source signals are remixed. The source signals may be remixed into a stereo signal with different gain factors. The remix signal may be expressed as Equation 2 below.

및

는 리믹스되는 M개의 소스 신호들에 대한 새로운 게인 팩터들이다. 상기

및

는 디코더 단에서 제공될 수 있다. 이 경우에, 부가정보생성부(206)는 스테레오 신호(201) 및 M개의 소스 신호(202)를 이용하여 부 가 정보(207)를 생성할 수 있다. here,

And

Are new gain factors for the M source signals to be remixed. remind

And

May be provided at the decoder stage. In this case, the additional information generator 206 may generate the additional information 207 using the stereo signal 201 and the M source signals 202.

에 대한 접근 없이, [수학식 1]로 표현되는 통상적인 믹스 신호가 주어지는 경우에, [수학식 2]로 표현되는 리믹스 신호를 지각적으로 모방하는 것을 목적으로 한다.As described above, an object of the present invention is to remix the stereo signal in the unit of the source signal when given a conventional stereo signal and some additional information. As in the present invention, it is not possible to completely generate the remix signal represented by Equation 2 from the mixed signal represented by Equation 1 using a very small amount of additional information. Thus, the present invention provides the respective source signals

It is aimed to perceptually mimic the remix signal represented by [Equation 2], given an ordinary mix signal represented by [Equation 1] without access to.

및

로 표시된다. 여기서 k는 서브밴드 신호들의 시간 인덱스(time index)이다. 유사하게, M개의 소스 신호들(202)의 서브밴드 신호들(205)은

,

,...,

로 표시된다. 명료한 표현을 위해, 서브밴드(주파수) 인덱스를 사용하지 않았다.Referring to FIG. 2, a stereo signal 201 and M source signals 202 included in the stereo signal 201 are input to a first remix signal encoding apparatus. The stereo signal 201 may be delayed to some extent to be synchronized with the side information and used directly as an output signal. To generate the additional information, the stereo signal 201 and the source signals 202 are decomposed into subband-specific signals 204 and 205 in the time-frequency domain through the filter bank 203. That is, the stereo signal 201 and the source signal are processed in the time-frequency domain, which will be described later with reference to FIG. 3. The subband-specific signal 204 is similarly processed at the center frequency of each subband. At a particular frequency, the subband pair 204 of the stereo signal 201

And

Is displayed. Where k is the time index of the subband signals. Similarly, the subband signals 205 of the M source signals 202 may be

,

, ...,

Is displayed. For clarity, no subband (frequency) index is used.

를 생성한다. 또한, 상기 부가정보생성부(206)는 스테레오 신호(201)의 서브밴드 쌍(204)을 이용하여, 서브밴드별로 게인 팩터

및

를 생성한다. 상기 게인 팩터

및

는 외부에서 직접 주어질 수 있다. 상기 서브밴드별 숏-타임 서브밴드 파워 및 게인 팩터를 이용하여 서브밴드별 부가 정보(207)가 생성된다. 상기 부가정보생성부(206)는 상기 숏-타임 서브밴드 파워 및 게인 팩터들 이외에 상기 스테레오 신호에 관련된 다른 정보를 부가 정보(207)로 생성할 수 있다. 부가정보인코딩부(208)는 상기 서브밴드별 부가정보(207)를 이용하여 부호화된 부가 정보 신호(209)를 생성한다. Given the subband signals 205 of the source signals 202, the side information generator 206 may perform short-time subband power for each subband,

Create In addition, the additional information generator 206 uses a subband pair 204 of the stereo signal 201 to obtain a gain factor for each subband.

And

Create The gain factor

And

Can be given directly from the outside. Subband-specific additional information 207 is generated using the short-time subband power and gain factor for each subband. The additional information generator 206 may generate other information related to the stereo signal as additional information 207 in addition to the short-time subband power and gain factors. The additional information encoding unit 208 generates an additional information signal 209 encoded using the additional information 207 for each subband.

및

는 고정적이 될 것이다. 만일

및

가 시간 k에 따라 가변적이라면, 상기 게인 팩터들은 시간의 함수로 생성될 것이다. 상기 게인 팩터들은 직접 양자화 및 부호화되지 않고, 먼저 양자화 및 부호화에 더 적합한 다른 값들로 전환될 수 있다. 또한,

는 스테레오 신호(201)의 서브밴드 파워에 상대적인 값으로 정규화될 수 있다. 이것은 스테레오 신호를 효율적으로 부호화하기 위해 통상적인 인코딩 장치가 이용되는 경우에, 본 발명을 상대적으로 변화에 강하도록 만들어준다. 예를 들면,

및

는 아래의 [수학식 3]으로 표현되는 게인 및 데시벨(dB) 단위의 레벨차로 전환되어 전송될 수 있다. For many stereo signals 201, the gain factor

And

Will be fixed. if

And

If is variable over time k, the gain factors will be generated as a function of time. The gain factors are not directly quantized and coded, but may first be converted to other values more suitable for quantization and coding. Also,

Can be normalized to a value relative to the subband power of the stereo signal 201. This makes the present invention relatively resistant to changes when conventional encoding devices are used to encode stereo signals efficiently. For example,

And

May be converted into a level difference in units of gain and decibel (dB) expressed by Equation 3 below, and then transmitted.

는 부가 정보로서 직접 부호화되는 것이 아니라, 아래의 [수학식 4]로 표현되는 스테레오 신호에 상대적으로 정의된 값으로 변환되어 전송될 수 있다. Also,

Is not directly encoded as additional information, but may be converted into a value defined relative to the stereo signal represented by Equation 4 below and transmitted.

는 아래의 [수학식 5]와 같이 계산될 수 있다. To produce short-time subband power, the present invention uses single-pole averaging. In other words,

May be calculated as shown in Equation 5 below.

Here, α∈ [0,1] determines the time-constant of the estimation window (estimation window) which decreases exponentially as shown in Equation 6 below.

는 서브밴드 샘플링 주파수를 나타낸다. 예를 들면, T=40 ms를 이용할 수 있다. 이하에서,

는 숏-타임 평균(short-time averaging)을 나타낸다. 만일

및

가 주어지지 않는다면, 상기

및

는 부가정보생성부(206)에서 생성될 필요가 있다.

이므로,

는 아래의 [수학식 7]과 같이 계산된다.here,

Denotes a subband sampling frequency. For example, T = 40 ms can be used. In the following,

Denotes short-time averaging. if

And

If is not given,

And

Needs to be generated in the additional information generation unit 206.

Because of,

Is calculated as shown in Equation 7 below.

는 아래의 [수학식 8]과 같이 계산된다.Similarly,

Is calculated as shown in Equation 8 below.

3 illustrates a domain for processing an audio signal according to an embodiment of the present invention. As mentioned above, the audio signal and the additional information are processed as subband-specific signals in the time-frequency domain as shown in FIG. Subband-specific signals in the time-frequency domain are perceptually derived. For example, a signal for each subband may be generated by using a short time fourier transform (STFT) having a sine wave analysis window and a sine analysis and synthesis window having a length of about 20 ms. In this case, the STFT coefficients may be grouped such that one group has a bandwidth that is about twice the equivalent rectangular bandwidth (ERB).

4 is a block diagram of a second remix signal encoding apparatus according to an embodiment of the present invention. The second remix signal encoding apparatus includes a downmixing unit 402, an additional information generating unit 403, and an additional information encoding unit 406.

Referring to FIG. 4, the downmixing unit 402 generates a sum signal 404 by adding a plurality of source signals 401. Unlike the first remix signal encoding apparatus, the second remix signal encoding apparatus transmits the sum signal 404 instead of the stereo signal. The additional information generator 403 generates the additional information 405 using the source signals 401. The additional information 405 includes subband power and gain factor corresponding to each source signal. In addition, the additional information 405 may include a parameter corresponding to a delay in the remix renderer. Similar to the first remix signal encoding apparatus, the additional information 405 may be converted into another value more suitable for quantization and encoding and transmitted. The additional information encoding unit 406 generates an encoded additional information signal 407 using the generated additional information 405. The generated sum signal 404 and the side information signal 407 are transmitted to the decoding apparatus. The present invention also includes an encoding apparatus that does not have a downmixing unit 402. In this case, the source signals 401 are not converted to the sum signal 404, and each source signal 401 is transmitted directly.

5 is a block diagram of an apparatus for decoding a first remix signal according to an embodiment of the present invention. The first remix signal decoding apparatus includes a side information decoder 503 and a remix renderer 505.

Referring to FIG. 5, the mix signal 501 and the additional information signal 502 are input to the first remix signal decoding apparatus. The mix signal 501 may be a mono, stereo or multichannel audio signal. The additional information decoding unit 503 decodes the additional information signal 502 to generate additional information 504. The additional information 504 includes a gain factor and a subband power of source signals included in the transmitted audio signal 501. The remix renderer 505 may input a user-mix parameter 506 generated using control information directly provided by the user. The remix renderer 505 generates the remix signal 507 using the mix signal 501, the transmitted additional information 504, and the user mix parameter 506. A detailed description of the method of generating the remix signal will be described later with reference to FIG. 6. The remix signal 507 is generated as an Eq-channel mix signal having the same number of channels as the number of channels of the transmitted mix signal, or an upchannel mix signal having more channels than the number of channels of the mix signal. (Up-channel mix signal) can be generated.

FIG. 6 is a detailed diagram of the first remix signal decoding apparatus of FIG. 5 when using a stereo signal. As described above, the transmitted mixed signal may be a mono, stereo, and multichannel audio signal, but for convenience, the stereo signal 601 will be described.

및

로 표현된다. 부가정보디코딩부(605)는 전송된 부가 정보 신호(602)를 복호화하여, 서브밴드별 부가 정보(606)를 생성한다. 또한, 리믹스 렌더링부(607)에 사용자가 제공하는 제어 정보를 이용하여 생성된 사용자 믹스 파라미터(608)가 입력될 수 있으며, 상기 사용자 믹스 파라미터(608)는 서브밴드별로 제공될 수 있다. 전술한 것처럼, 상기 부가 정보(606)는 리믹스 될 M개의 소스 신호에 대한 서브밴드별 게인 팩터(

및

) 및

로 표현되는 서브밴드 파워를 포함한다. 리믹스 렌더링부(607)는 서브밴드별로 생성된 스테레오 신호(604), 전송된 부가 정보(606) 및 사용자 믹스 파라미터(608)를 이용하여, 서브밴드별 리믹스 신호(609),

및

를 생성한다. 상기 리믹스 신호(609)를 생성하는 방법은 아래에서 더욱 상세하게 기술된다. 상기 리믹스 신호(609)는 역필터뱅크(610)를 통해 시간 도메인(time domain)의 스테레오 신호(611),

및

로 변환된다. Referring to FIG. 6, the stereo signal 601 is decomposed into a subband-specific signal 604 in the time-frequency domain through the filter bank 603. As shown in FIG. 6, the subband-specific signal 604 at a particular frequency

And

It is expressed as The additional information decoding unit 605 decodes the transmitted additional information signal 602 to generate additional information 606 for each subband. In addition, a user mix parameter 608 generated using control information provided by a user may be input to the remix renderer 607, and the user mix parameter 608 may be provided for each subband. As described above, the additional information 606 is a subband-specific gain factor for M source signals to be remixed.

And

) And

It includes the subband power represented by. The remix rendering unit 607 may use the stereo signal 604 generated for each subband, the additional information 606 transmitted, and the user mix parameter 608, and the remix signal 609 for each subband,

And

Create The method of generating the remix signal 609 is described in more detail below. The remix signal 609 is a stereo signal 611 in the time domain through the inverse filter bank 610,

And

Is converted to.

는 서브밴드별 소스 신호

로 교체된다. 즉, 서브밴드별 믹스 신호(604)는 아래의 [수학식 9]과 같이 표현될 수 있다. A method of generating the remix signal 609 generated by the remix renderer 607 is as follows. [Equation 1] and [Equation 2] are also valid for the subband signals 604 and 609. In this case, the source signal

Is the subband-specific source signal

Is replaced by. That is, the mix signal 604 for each subband may be expressed by Equation 9 below.

The subband remix signal 609 may be expressed by Equation 10 below.

및

가 주어지면, 아래의 [수학식 11]와 같이 서로 다른 게인들을 가지는 서브밴드별 리믹스 신호(609)가 상기 서브밴드별 믹스 신호(604)의 선형 조합으로 추정될 수 있다.To generate the remix signal 609, least squares estimation may be used. Per subband mix signal 604,

And

Given by Equation 11 below, the subband remix signal 609 having different gains may be estimated as a linear combination of the subband mix signals 604.

,

,

및

는 가중 팩터들(weighting factors)이다. 이때, 생성되는 추정 에러(estimation error)는 아래의 [수학식 12]과 같이 정의될 수 있다.here,

,

,

And

Is the weighting factors. In this case, the generated estimation error may be defined as shown in Equation 12 below.

,

,

및

는 평균제곱오차(mean square error),

및

가 최소가 되도록 서브밴드별로 생성될 수 있다. 이때, 추정 에러,

및

가

및

에 직교(orthogonal)될 때, 상기 평균제곱오차가 최소가 된다는 것을 이용할 수 있다. 생성되는

및

는 아래의 [수학식 13]과 같이 표현될 수 있다.The weighting factors,

,

,

And

Is the mean square error,

And

May be generated for each subband such that is minimized. In this case, the estimation error,

And

end

And

When orthogonal to, it can be used that the mean square error is minimized. Generated

And

May be expressed as Equation 13 below.

,

및

는 직접 생성될 수 있지만,

및

은 전송된 부가 정보(606)(예를 들면,

,

,

) 및 사용자가 제공하는 제어 정보(608)(예를 들면, 게인 팩터

및

)를 이용하여, 아래의 [수학식 14]와 같이 생성될 수 있다.here,

,

And

Can be generated directly,

And

Is transmitted additional information 606 (e.g.,

,

,

) And control information 608 provided by the user (e.g., gain factor

And

) Can be generated as shown in Equation 14 below.

및

가 아래의 [수학식 15]와 같이 생성될 수 있다. Similarly,

And

May be generated as shown in Equation 15 below.

및

는 아래의 [수학식 16]과 같이 표현될 수 있다. here,

And

May be expressed as Equation 16 below.

If the phases of the mix signal 604 are coherent or nearly synchronized with each other, a value expressed by Equation 17 below approaches 1.

In this case, the weights may be expressed as Equation 18 below.

및

)를 이용하여 각각의 소스 신호를 독립적으로 리믹스하여 생성된 리믹스 신호와 유사하게 들린다.The subband remix signal 609 generated as described above is converted into the remix signal 611 of the time-domain through the inverse filter bank 610 as described above. The remix signal 611 may generate a user mix parameter generated using control information provided by a user.

And

It sounds similar to the remix signal generated by independently remixing each source signal with

So far, the focus has been on remixing two-channel stereo signals. However, as described above, the present invention is not limited to stereo signals, but may be extended to remixing multichannel audio signals, for example, 5.1 channel audio signals. Those skilled in the art can remix multichannel audio signals, similar to the stereo signals described herein. In this case, Equation 11 may be written as Equation 19 below.

Optionally, one of the channels of the mix signal can be left without remixing. For example, for a 5.1 surround channel, it is possible to apply remixing only to the front channel without modifying the two back channels. In this case, a two or three channel remix algorithm is applied to the front channel.

7 is a block diagram of a second remix signal decoding apparatus according to an embodiment of the present invention. The second remix signal decoding apparatus includes an additional information decoding unit 703, a spatial information integration unit 705, and a remix rendering unit 707.

Referring to FIG. 7, the sum signal 701 of the source signals and the additional information signal 702 are input to the second remix signal decoding apparatus. The additional information decoding unit 703 decodes the additional information signal 702 to generate additional information 704. The additional information 704 includes a gain factor, a delay constant, a subband power, and the like. The additional information integrator 705 separates the sum signal 701 into a plurality of source signals 706 by using the additional information 704. The remix renderer 707 may generate the remix signal 709 using the source signals 706. In this case, the remix renderer 707 may generate the remix signal 709 using the mix parameter transmitted as additional information. In addition, the remix renderer 707 may selectively generate the remix signal 709 using the user mix parameter 708 generated by using control information provided by the user.

8A is a block diagram illustrating a combination of a conventional encoding apparatus and a remix signal encoding apparatus according to an embodiment of the present invention. The mixed signal 801 may be encoded by the conventional encoding apparatus 803 and converted into the encoded mixed signal 805. The mix signal 801 may be a channel-specific signal or a source signal. The conventional encoding device 803 includes not only conventional encoding devices such as AAC, MP3 encoder, etc., but also encoding devices to be developed in the future. The remix signal encoding apparatus 804 according to the present invention generates the additional information signal 806 using the mixed signal 801 and the source signal 802 included in the mixed signal. The multiplexer 807 generates the bitstream 808 using the encoded mix signal 805 and the side information signal 806. As described above, the additional information signal 806 may be inserted into an auxiliary data area in a conventional mix signal format to be compatible with conventional devices.

8B is a block diagram of a combination of a conventional decoding device and a remix signal decoding device according to an embodiment of the present invention. The demultiplexer 810 separates the encoded mix signal 811 and the side information signal 812 from the transmitted bitstream 809. The conventional decoding device 813 then decodes the encoded mix signal 811 to produce a mix signal 814 that can be used in the remix signal decoding device 815 according to the present invention. The conventional decoding device 813 includes not only a conventional encoding device such as an AAC, an MP3 decoder, etc. but also an encoding device to be developed in the future. The mix signal 814 may be a channel-specific signal or a source signal. The remix signal decoding apparatus 817 according to the present invention may convert the mix signal 814 into the remix signal 816 using at least one of the additional information signal 812 and the user mix parameter 817.

9 is a detailed block diagram of a remix signal decoding apparatus according to an embodiment of the present invention. Referring to FIG. 9, the remix signal decoding apparatus includes a mixed signal decoder 901, a parameter generator 902, and a remix renderer 908. It may optionally include an effector (911). The parameter generator 902 may include a blind mix parameter generator 903, a user mix parameter generator 904, and a remix parameter generator 905. The remix parameter generation unit 905 may include an equimix parameter generation unit 906 and may optionally include an upmix parameter generation unit 907. In addition, the remix renderer 908 may include an equimix renderer 909 and optionally include an upmix renderer 910.

The mixed signal decoding unit 901 decodes the encoded mixed signal transmitted from the encoding end to generate a mixed signal. The parameter generator 902 receives additional information and user control information (or configuration information) transmitted from an encoding stage. The user control information is not transmitted at the encoder stage but may be generated at the decoder stage. The user mix parameter generator 904 generates a user mix parameter by using user control information. The additional information transmitted from the encoder stage may include an encoder mix parameter. In addition, the blind mix parameter generator 903 may generate a blind mix parameter using the mix signal. The encoder mix parameter and the blind mix parameter are alternatively input to the remix parameter generator 905.

The remix parameter generator 905 generates a remix parameter using additional information and a user mix parameter. The remix parameter may be generated to be applied to a channel of the remix signal. Equimix parameter generation unit 906 included in the remix parameter generation unit 905 generates a remix parameter used to generate a remix signal having the same channel number as the number of channels of the mix signal, the remix parameter generation unit 905 The upmix parameter generation unit 907, which may be included in the control unit, generates a remix parameter used to generate a remix signal having a larger number of channels than the number of channels of the mixed signal. The remix parameter is input to the remix renderer 908.

Equimix renderer 909 included in the remix renderer 908, using the remix parameter and the mix signal, having an equal number of channels equal to the number of channels of the mix signal (Eq-channel remix signal ) The upmix renderer 910, which may be included in the remix renderer 908, uses more channels than the number of channels of the mix signal by using the remix parameter and the mix signal generated by the upmix parameter generator 907. Generate an up-channel remix signal having a number. The upmix renderer 910 may generate an upchannel remix signal using the remix signal generated by the Equichannel renderer 909.

Accordingly, the decoding apparatus may output the mixed signal transmitted from the encoding stage as it is, output as an equal channel remix signal, or output as an up channel remix signal. Optionally, the remix renderer may give various effects to the remixed signal by using information provided from the effector 911.

10 is a diagram illustrating a configuration of an input device according to an embodiment of the present invention, and FIG. 11 is an example of a state in which an input device according to an embodiment of the present invention is implemented. 10 and 11, the input apparatus 1000 (hereinafter, the input apparatus 1000) according to an embodiment of the present invention is connected to the first remix signal decoding apparatus 500 and the first input unit ( 1110 (source menu key), second input unit 1120 (voice mute key), third input unit 1130 (voice adjustment key), fourth input unit 1140 (ambience adjustment key), fifth input unit 1150 (First source key 1150a (piano key)), second source key 1150b (violin key), direction movement key 1160a, pointing device 1160b, numeric key 1170, memory unit 1200, The controller 1300 and the display 1400 are included.

First, since the first remix signal decoding apparatus 500 has the same configuration as the first remix signal decoding apparatus described with reference to FIG. 5, a detailed description of the components will be omitted. Hereinafter, each component of the input apparatus 1000 will be described in detail.

The first input unit 1110 (source menu key) is an input device in which the input signal is converted into a menu display command for each source by the controller 1300. The menu for each source is a screen that displays a list of sources included in a specific mix signal, and the volume level can be adjusted for each source while the menu for each source is displayed. An example of a screen (menu display screen for each source) displayed after the first input unit (source menu key) is input is shown in FIG. 12. Here, the menu display screen for each source may be displayed on the display 1400 of the first interface device 550. The first input unit 1110 (source menu key) may be implemented as a toggle button key or a touch sensor that repeats command execution and cancellation according to the number of pressing, but the present invention is not limited thereto.

The second input unit 1120 (voice mute key) is an input device in which the input signal is converted into a voice mute command by the controller 1300. The voice muting command is a command for causing the voice level of a person to be zero among the sources included in the specific mix signal. An example of a screen displayed after the second input unit (voice mute key) is input is shown in FIG. 13. The second input unit 1120 (voice mute key) may also be implemented as a toggle-type button key or a touch sensor that repeats command execution and cancellation according to the number of pressing, but the present invention is not limited thereto.

The third input unit 1130 (voice adjustment key) is an input device in which the input signal is converted into a voice level adjustment command by the controller 1300. The voice level adjustment command is a command for increasing or decreasing only the level of a voice of a person among sources included in a specific mix signal. An example of a screen displayed after the third input unit (voice control key) is input is shown in FIG. 14. The second input unit 1120 (voice mute key) is also for inputting a level up command and a level down command, and includes two button keys, a jog shuttle, two direction jog buttons, two direction touch scrolls, two touch sensors, The touch wheel may be implemented, but the present invention is not limited thereto.

The fourth input unit 1140 (ambience adjustment key) is an input device in which the input signal is converted into an ambience display command by the controller 1300. The ambience screen is a screen in which the relative positions of the sources included in the specific mix signal are displayed, and the positions of the sources can be changed using the direction movement key 1160a or the pointing device 1160b. An example of a screen (ambience screen) displayed after the fourth input unit (ambience adjustment key) is input is illustrated in FIG. 15. The fourth input unit 1140 (voice mute key) may also be implemented as a toggle-type button key or a touch sensor that repeats command execution and cancellation according to the number of pressing, but the present invention is not limited thereto.

The fifth input unit 1150 is an input device in which the input signal is converted into a source mute command by the controller 1300. The source mute command is a command for preventing a source signal corresponding to a specific musical instrument from being reproduced. The fifth input unit 1150 may be, for example, a first source key 1150a (piano key) for making a level of a source signal corresponding to 'piano' to almost zero, or corresponds to 'violin'. It may be a second source key 1150b (violin key) for making the level of the source signal nearly zero. An example of the screen displayed after the first soski (piano key) is input from the fifth input unit is shown in FIG. 16, and the example of the screen displayed after the second soski (violin key) is input from the fifth input unit. An example is shown in FIG. 17. The first and second soskies of the fifth input unit 1150 may also be implemented as a toggle-type button key or a touch sensor in which command execution and cancellation are repeated according to the number of times of pressing, but the present invention is not limited thereto.

The direction movement key 1160a is an input device in which the input signal is converted into a command regarding direction movement by the controller 1300. The direction movement command may be a specific source level adjustment command in a state where a menu screen for each source is displayed, and a position adjustment command of a specific source in a state where an ambience screen is displayed. The direction movement key 1160a may be implemented with four button keys, four touch sensors, four-direction touch scroll, and a touch wheel, but the present invention is not limited thereto.

The pointing device 1160b is an input device whose input signal is converted into a command about positioning by the controller 1300. The command for positioning may be a specific source level adjustment command in the state of displaying the menu screen for each source, and the position adjustment command of a specific source in the state of displaying the ambience screen, similar to the direction movement key 1160a. The pointing device 1160b may be implemented with a mouse, a trackball, a touch pad, a touch screen, a touch panel (and a stylus pen), but the present invention is not limited thereto.

Numeric key 1170 is an input device in which the input signal is converted by the controller 1300 into a command relating to numeric input. The command relating to the number input may be a command for selecting a specific source matching the number while the menu screen for each source or the ambience screen is displayed. For example, when "1. Voice, 2. Piano, 3. Violin, 4. Flute" is displayed on the menu screen for each source, when the user selects "No. 3 key" among the numeric keys 1170, 3 Violin that matches Burn is chosen. The numeric key 1170 may be implemented with ten button keys, ten touch sensors, a touch panel, and the like, but the present invention is not limited thereto.

The memory unit 1200 stores command information for each key. Command information for each key means each input unit (first input unit 1110, second input unit 1120, etc.) (including numeric keys 1170) and corresponding commands (menu display command for each source, voice muting command, etc.). It means. Meanwhile, a user may newly store or change command information for each key through a shortcut key registration process. A detailed description of the shortcut key registration process will be described later with reference to FIG. 21. The memory unit 1200 further stores data about a menu screen for each source, a voice muting screen, a voice adjusting screen, an ambience adjusting screen, and the like.

The controller 1300 converts the input signals received from the input units 1110, 1120, 1130, 1140, 1150, etc. into respective commands based on the command information for each key stored in the memory 1200. In detail, the input signal received through the first input unit 1110 is converted into a menu display command for each source, and the input signal received through the second input unit 1120 is converted into a voice muting command and then based on the voice muting command. Outputs control information 506 for the mixed signal, converts the input signal received through the third input unit 1130 into a voice level adjustment command, and converts the input signal received through the fourth input unit 1140 into ambience. The display signal is converted into a command, and the input signal received through the fifth input unit 1150 is converted into a source mute command.

Also, the controller 1300 may display an interface screen based on the source information si received from the first remix signal decoding apparatus 500 according to the input of the input units 1110 and 1140. For example, when a menu display command for each source is input through the first input unit 1110, a menu for each source is displayed on the display 1400 based on the source information si, and the fourth input unit 1140 is used. When the ambience screen display command is input, the ambience screen is displayed based on the source signal information si corresponding to the mixed signal.

In addition, the controller 1300 outputs the control information 506 for the mixed signal based on the command through the input unit 1120, 1130, 1140, and the like, so as to be input to the first remix signal decoding apparatus 500. Since the control information 506 has been described above with reference to FIG. 5, a detailed description thereof will be omitted. In detail, when the menu screen for each source is displayed on the display, the controller 1300 converts an input signal received through the pointing device 1160b or the direction movement key 1160a into a source level adjustment command and ambience. When the screen is displayed on the display, the input signal received through the pointing device 1160b or the direction movement key 1160a is converted into an ambience adjustment command. The controller 1300 may refer to command information for each key stored in the memory 1200 in the process of converting the input signals into the corresponding command. The control information 506 for the mixed signal can be output based on the converted command (source level adjustment command, ambience adjustment command, and the like).

The display 1400 is a display device on which a menu screen for each source or an ambience screen is displayed under the control of the controller 1300. Furthermore, screens (FIGS. 13, 14, 16, 17, etc.) displayed after each input unit (eg, the first input unit 1110) may be displayed.

18 is a diagram illustrating a configuration of an input device according to another embodiment of the present invention. Referring to FIG. 18, in another embodiment of the present invention, the input apparatus 2000 (hereinafter, the input apparatus 2000) is associated with the first remix signal decoding apparatus 500 and the first interface apparatus 550. First input unit 2110 (source menu key), second input unit 2120 (voice mute key), third input unit 2130 (voice adjustment key), fourth input unit 2140 (ambience adjustment key), fifth Input unit 2150 (first source key 2150a (piano key)), second source key 2150b (violin key), direction key 2160a, pointing device 2160b, numeric key 2170, memory unit 2200, a controller 2300, a display 2400, and a wireless communication unit 2500. Among the components, except for the controller 2300 and the wireless communication unit 2500 are almost the same as the components of the same name among the components of the embodiment of the present invention described with reference to FIGS. Is omitted.

In addition, since the first remix signal decoding apparatus 500 has the same configuration as the first remix signal decoding apparatus described with reference to FIG. 5, a detailed description of the components will be omitted.

The first interface device 550 provides an interface from the first remix signal decoding device 500 to the input device 2000. The first interface device 550 includes a wireless communication unit 552, a memory unit 554, and an interface control unit 556. And a display unit 558.

The wireless communication unit 552 of the first interface device 550 is a device for wireless communication with the input device 2000. The wireless communication method is not limited to the infrared communication method. The memory unit 554 stores data relating to a menu screen for each source, a voice muting screen, a voice adjusting screen, an ambience adjusting screen, and the like. The interface controller 556 displays the interface screen based on the source information si received from the first remix signal decoding apparatus 500, and the first remix signal decoding apparatus based on the command received from the input apparatus 2000. The control information 506 is input to 500. Since the control information 506 has been described above with reference to FIG. 5, a detailed description thereof will be omitted. The display 558 is a display device on which an interface screen is displayed under the control of the interface controller 556. When the display 2400 is provided in the input device 2000, the display 558 of the first interface device 550 is not an essential component.

Hereinafter, the control unit 2300 and the wireless communication unit 2500 of the components of the input device 2000 will be described.

The control unit 2300 converts an input signal received through the first input unit 2110 into a menu display command for each source, converts an input signal received through the second input unit 2120 into a voice muting command, and a third input unit. The input signal received through the 2130 is converted into a voice level adjustment command, the input signal received through the fourth input unit 2140 is converted into an ambience display command, and the input received through the fifth input unit 2150. Convert the signal to a source mute command. In addition, when the menu screen for each source is displayed on the display, the controller 2300 converts an input signal received through the pointing device 2160b or the direction movement key 2160a into a level adjustment command for each source, and displays an ambience screen. In the state indicated by, the input signal received through the pointing device 2160b or the direction movement key 2160a is converted into an ambience adjustment command. The controller 2300 may refer to command information for each key stored in the memory unit 2200 in the process of converting the input signals into the corresponding command.

The wireless communication unit 2500 transmits the command converted by the control unit 2300 to an external device (particularly, the first interface device 550). In addition, when the first interface device 550 transmits data about a menu screen for each source or data about an ambience screen, the wireless communication unit 2500 receives the data.

19 is a diagram illustrating a configuration of a second remix signal decoding apparatus and a second interface apparatus to which an input apparatus is linked according to an embodiment of the present invention. Referring to FIG. 19, an input apparatus 1000 is associated with a first remix signal decoding apparatus 500. Since the first remix signal decoding apparatus 500 has been described above with reference to FIG. 5, a detailed description thereof will be omitted. The second interface device 750 receives the source information si from the second remix signal decoding device 700, not the first remix signal decoding device 500, and controls the second remix signal decoding device 700. Except for entering 708, its components 752, 754, 756, 758 are almost identical to the same-named components 552, 554, 556, 558 of the first interface device 550, respectively, Description thereof will be omitted.

20 is a diagram illustrating a configuration of a second remix signal decoding apparatus and a second interface apparatus to which an input apparatus is linked according to another embodiment of the present invention. Referring to FIG. 20, an input device 2000 is associated with a second remix signal decoding device 700 and a second interface device 750. Since the second remix signal decoding apparatus 700 has been described above with reference to FIG. 7, a detailed description thereof will be omitted. The second interface device 750 receives source information si from the second remix signal decoding device 700, not the first remix signal decoding device 500, and controls the second remix signal decoding device 700. Except for inputting information 708, the components 752, 754, 756, 758 are almost identical to the same-named components 552, 554, 556, 558 of the first interface device 550, respectively. The description thereof will be omitted.

21 is a diagram illustrating a procedure of an input method according to an embodiment of the present invention. Referring to FIG. 21, when a user selects a shortcut key registration, the input device receives a shortcut key registration command (step S110). An example of a screen displayed after a shortcut key registration command is input is illustrated in FIG. 22. Next, the user selects a key (eg, No. 1 key) to be used as a shortcut from among a plurality of keys (eg, numeric keys) provided in the input device (step S120). The input device displays a list of sources that can be used for the mixed signal (step S130). For example, the sources that can be used for the mixed signal may be a voice audio signal or an instrument-specific audio signal (voice, piano, violin, flute, etc.). Then, the user selects a source to be matched with a shortcut key by selecting one of the list of sources (step S140). For example, you can select a piano. Then, the user selects a function (eg, mute) to be used as a shortcut among one or more functions (eg, mute and ambience adjustment) (step S150). When the user selects a key, a source, and a function through steps S120, S140, and S150, the input device stores the selected key, the selected source, and the selected function as shortcut key registration information (step S160). For example, the mute command of the piano signal is matched with the 1st key and stored. Then, when the first key is input, the input device converts the input signal of the first key into a mute command of the piano signal.

FIG. 23 is a diagram illustrating a configuration of an interface display device according to an exemplary embodiment. FIG. 24A to 24B illustrate examples of an interface display device according to an embodiment of the present invention. 23, 24A, and 24B, the interface display apparatus 3000 according to an exemplary embodiment of the present invention is connected to the first remix signal decoding apparatus 500, and includes an input unit 3100 and a controller 3200. , A first display 3300a and a second display 3300b. Here, the first remix signal decoding apparatus 500 includes an additional information decoding unit 503 and a remix rendering unit 505. The first remix signal decoding apparatus 500 is similar in structure and function to the first remix signal decoding apparatus described with reference to FIG. 5. Therefore, detailed description thereof will be omitted.

The input unit 3100 is an input device for selecting one of a plurality of mixed signals. Here, the mixed signal may be the channel-specific audio signal 501 described above with reference to FIG. 5. The mixed signal 501p selected by the input unit 3100 and the additional information signal 502p of the mixed signal 501p are input to the first remix signal decoding apparatus 500 among the plurality of mixed signals. The input unit 3110 may also be for selecting one of the sources included in the mixed signal, and further, a command regarding level adjustment of the source signal, and a level adjustment (equalizer adjustment) for each subband of the source signal. It may be for inputting a command and a command relating to ambience adjustment of the source signal. The input unit 3110 may be implemented not only by a pointing device such as a mouse, a trackball, a touch pad, but also by a direction movement key and a touch wheel, and of course, may be implemented as a remote controller using wireless communication such as infrared communication.

The controller 3200 inquires the source signal information si corresponding to the mixed signal 501p selected by the input unit 3100, and then, based on the source signal information si, a list of source signals (hereinafter, a list of sources). ) Is displayed on the first display 3300a. Here, the source signal information si is information about a source signal included in the mixed signal 501p selected by the input unit 3110 and may be information including an instrument name of each source signal. It may also be information of the source signal 102 described above with reference to FIG. On the other hand, the source signal information si may further include metadata (instrument player name, production date, etc.). The source signal information si may be received by the controller 3200 from the additional information decoder 503 of the first remix signal decoding apparatus 500. Here, the list of sources may include one or more of an instrument name, a singer name, and a character name of the source signal 502p.

The control unit 3200 further includes various commands for remixing from the input unit 3100 (commands for adjusting the level of the source signal, commands for adjusting the level of each subband of the source signal, and commands for adjusting the ambience of the source signal). And the like), the command is converted into the control information 506 and input to the remix rendering unit 505. Since the control information 506 may be the same as the control information 506 described with reference to FIG. 5 and the control information 608 described with reference to FIG. 6, the detailed description thereof will be omitted.

The first display 3300a is a display in which a list of sources is displayed under the control of the controller 3200. The list of sources displayed on the first display 3300a is continuously displayed on the first display 3300a while the mix signal is selected. While the mix signal is selected. For example, it means that the selected mix signal is being reproduced or being remixed (level adjustment, ambience adjustment, etc.). If another mix signal is selected by the user, a list of sources matching the other mix signal is displayed on the first display 3300a. The first display 3300a may be implemented as an LCD or the like, or may be implemented as a matrix of a plurality of light emitting devices, but the present invention is not limited thereto. When the first display 3300a is implemented with a plurality of light emitting devices, a list of sources is displayed by whether the plurality of light emitting devices blinks.

The second display 3300b is a display in which metadata, a volume level adjustment screen, an equalizer adjustment screen, an ambience adjustment screen, and the like are displayed under the control of the controller 3200. 25 to 28 are examples of screens displayed on the first display and the second display when a specific source is selected. FIG. 25 illustrates the metadata of the selected source (1.voice) displayed on the second display 3300b when '1.voice' is selected from the source list displayed on the first display 3300a, and FIG. 26 illustrates the selected source. The volume level adjustment screen of (1. AUDIO) is shown on the second display 3300b. 27 shows an equalizer adjustment screen (subband level adjustment screen) of the selected source (3. violin) displayed on the second display 3300b, and FIG. 28 shows an ambience adjustment screen of the selected source (2. piano). 2 is displayed on the display 3300b. 25 to 28, it can be seen that even if the screen displayed on the second display 3300b is continuously changed, the list of sources is still displayed on the first display 3300a.

On the other hand, since the second display 3300b and the first display 3300a are not required to be mechanically or mechanically separated, the second display 3300b and the first display 3300a may be implemented as one panel. Of course you can.

29 is a diagram illustrating a configuration of an interface display device according to another embodiment of the present invention. Referring to the drawings, the interface display device 4000 according to another exemplary embodiment of the present invention includes an input unit 4100, a controller 4200, a first display 4300a, and a second display 4300b, and a second remix. It is associated with the signal decoding apparatus 700. Here, the first remix signal decoding apparatus 700 includes a side information decoding unit 703, a side information integration unit 705, and a remix rendering unit 707, and decodes the second remix signal described with reference to FIG. 7. Since the configuration and functions of the apparatus are almost the same, a detailed description thereof will be omitted.

Meanwhile, the interface display device 4000 according to another exemplary embodiment of the present invention is compared with the interface display apparatus 3000 according to an exemplary embodiment of the present invention, instead of the first remixed signal decoding apparatus 500, the second remixed signal. The only difference is that the composite object signal 701p is inputted instead of the mixed signal 501p, and the components 4100, 4200, 4300a, and 4300b are connected to the decoding apparatus 700. Since the interface display device 4100 according to the exemplary embodiment is almost the same as each of the components 4100, 4200, 4300a, and 4300b of the same name, a description thereof will be omitted.

30 is a diagram illustrating a procedure of an interface display method according to an embodiment of the present invention. The term mixed signal used below should be understood as a concept including the concept of a composite object signal. The interface display method according to an embodiment of the present invention may be performed by the interface display device 3000 according to an embodiment of the present invention described above, or the interface display device 2000 according to another embodiment of the present invention. It may also be performed by.

 Referring to FIG. 30, first, the interface display apparatus displays information on one or more mix signals that are already stored or may be transmitted as a list of mix signals on the display (step S210). Then, the user selects a specific mix signal to be reproduced or remixed from the list of mix signals displayed in step S210 by using the input device (step S220). Then, the interface display device extracts source signal information corresponding to the mixed signal from the additional information corresponding to the mixed signal selected in step S220 (step S230).

The interface display device constructs a list of sources based on the source signal information extracted in operation S230 (operation S240). Then, the interface display device displays a list of sources on the first display (S250).

The user checks the list of sources displayed on the first display and selects one of them (step S260). Then, the interface display apparatus displays the metadata (volume level adjustment screen, equalizer adjustment screen, ambience adjustment screen, etc.) of the source selected in step S260 on the second display (step S270).

Then, when the selection of the mixed signal selected in step S220 is terminated (for example, when the user terminates playback of the mixed signal or another mix signal is selected) (YES in step S280), step S250 End the display of the list of sources started from (S290).

As described above, although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited thereto and is intended by those skilled in the art to which the present invention pertains. Of course, various modifications and variations are possible within the scope of equivalents of the claims to be described.

1 is a block diagram of an apparatus for encoding a first remix signal according to an embodiment of the present invention.

FIG. 2 is a detailed block diagram of the first remix signal encoding apparatus of FIG. 1 when using a stereo signal. FIG.

3 is a domain for processing a mix signal according to an embodiment of the present invention.

4 is a block diagram of a second remix signal encoding apparatus according to an embodiment of the present invention.

5 is a block diagram of an apparatus for decoding a first remix signal according to an embodiment of the present invention.

FIG. 6 is a detailed view of the first remix signal decoding apparatus of FIG. 5 when using a stereo signal. FIG.

7 is a block diagram of a second remix signal decoding apparatus according to an embodiment of the present invention.

8A is a block diagram illustrating a combination of a conventional encoding apparatus and a remix signal encoding apparatus according to an embodiment of the present invention.

8B is a block diagram of a second remix signal decoding apparatus according to an embodiment of the present invention used in combination with a conventional decoding apparatus.

9 is a detailed block diagram of a remix signal decoding apparatus according to an embodiment of the present invention.

10 is a configuration diagram of an input device according to an embodiment of the present invention.

11 is an example of how an input device is implemented according to an embodiment of the present invention.

12 is an example of a screen displayed after a first input unit (source menu key) is input.

13 is an example of a screen displayed after a second input unit (voice mute key) is input.

14 is an example of a screen displayed after the third input unit (voice control key) is input.

15 is an example of a screen displayed after the fourth input unit (ambience adjustment key) is input.

16 is an example of a screen displayed after a first soski (piano key) is input from the fifth input unit.

17 is an example of a screen displayed after the second soski (violin key) of the fifth input unit is input.

18 is a block diagram of an input device according to another embodiment of the present invention.

FIG. 19 illustrates a configuration of a first remix signal decoding apparatus to which an input apparatus is connected according to an embodiment of the present invention. FIG.

FIG. 20 is a diagram illustrating a configuration of a second remix signal decoding device and a second interface device to which an input device is linked according to another embodiment of the present invention; FIG.

21 is a flowchart of an input method according to an embodiment of the present invention.

22 is an example of a screen displayed after a shortcut key registration command is input.

23 is a block diagram of an interface display device according to an embodiment of the present invention.

24A and 24B illustrate examples of an interface display device according to an embodiment of the present invention.

FIG. 25 is an example of a screen displayed on a first display and a second display when a specific source is selected. FIG.

FIG. 26 is another example of a screen displayed on a first display and a second display when a specific source is selected. FIG.

27 is another example of a screen displayed on the first display and the second display when a specific source is selected.

28 is another example of a screen displayed on the first display and the second display when a specific source is selected.

29 is a configuration diagram of an interface display device according to another embodiment of the present invention.

30 is a flowchart of an interface display method according to an embodiment of the present invention.

Claims (3)

Receiving Shortcut Registration Command Selecting one of the plurality of keys, one of the plurality of sources, one of the one or more functions, and Matching and storing the selected function with respect to the selected source to the selected key; The plurality of sources comprises at least one of a source of an audio signal and a source of a video signal, The one or more functions include one or more of muting and ambience adjustment. The method of claim 1, The step of selecting, And a step of selecting one of the numeric keys. Input for selecting one of a plurality of keys, one of a plurality of sources, and one of more than one function A memory unit for storing command information for each key; A control unit for matching the selected function with respect to the selected source to the selected key by the input unit and storing the selected function in the memory unit; The plurality of sources comprises one or more of an object of an audio signal, and an object of a video signal, The one or more functions include one or more of muting and ambience adjustment.

Images