CN101583921A - Apparatus and method for inputting a command, method for displaying user interface of media signal, and apparatus for implementing the same, apparatus for processing mix signal and method thereof - Google Patents

Abstract

An apparatus for inputting commands required for controlling a mix signal and method thereof are disclosed. The present invention includes an input unit, a control unit converting an input signal received via the input unit to a per-source menu display command, the control unit controlling a per-source menu display image to be outputted based on a source information corresponding to a mix signal in accordance with the per-source menu display command, and a display for outputting the per-source menu display. Accordingly, a volume level is adjusted per a source signal included in such a mix signal as a video signal, an audio signal, and the like or an ambience (relative position) is adjusted. And, a user is always able to confirm information on a source signal (or object signal) associated with a mix signal (or synthetic object signal).

Description

The apparatus and method of input command, the method for the user interface of display media signal and implement device thereof, the devices and methods therefor of processing mixed signal

Technical field

The present invention relates to input media and method thereof, and relate more specifically to import the devices and methods therefor of the required order of control mixed signal.The present invention relates to be used to show the devices and methods therefor at the interface of mixed signal.Although the present invention is applicable to the application of broad range, be particularly useful for being provided for interface such as mixed signals such as sound signal and vision signals to the user.And, the present invention relates to be used to handle the devices and methods therefor of mixed signal.

Background technology

Generally speaking, the user is the most frequent and generate and use stereophonic signal widely.Recently, multi-channel signal tends to be commonly used.Yet, to not being by the source signal cell processing but being provided with restriction by the mixed signal of sound channel signal cell processing.So, in situation, can not handle the particular source signal that constitutes mixed signal independently by sound channel signal cell processing mixed signal.For example, only improve the volume of background music when when watching film, can not remain unchanged in the volume of performer's voice.

In addition, in order to handle independently according to the source---promptly according to the particular source signal---and to mix mixed signal (or synthetic object signal) again, the user must improve or reduce the relative position of volume level (or quiet by rank being made as 0) or adjusting source signal according to source signal.

Summary of the invention

Technical matters

Yet, only can regulate total volume level of mixed signal according to the telepilot of correlation technique, but can not regulate the volume level of the source signal that comprises in mixed signal or its surrounding environment.

In addition, in order to mix mixed signal (or synthetic object signal) again according to the source, the user must know in the corresponding mixed signal to comprise which class source signal---promptly according to source signal---.For example, comprise in the situation of music file that whether the user must know the source signal that is associated with music file corresponding to piano, violin, flute etc. in mixed signal.Yet, in correlation technique, only show information about mixed signal (or synthetic object signal).So the problem of appearance is the information that does not show the content of the information of indicating the source signal that is associated with mixed signal.

Technical scheme

Therefore, the present invention relates to a kind of devices and methods therefor of having eliminated one or more owing to the required order of the input control mixed signal of the limitation of correlation technique and the problem that shortcoming causes basically, the devices and methods therefor that shows the interface of mixed signal, and the devices and methods therefor of handling mixed signal.

An object of the present invention is to provide a kind of input media and method thereof, can regulate volume level according to being included in by it, perhaps by its scalable surrounding environment (relative position) such as the source signal in the mixed signal of vision signal, sound signal etc.

Another object of the present invention provides a kind of devices and methods therefor that is used to show the interface of mixed signal, the user can show information by it, so that can check this information constantly about the source signal (or object signal) that is associated with mixed signal (or synthetic object signal).

Another object of the present invention provides a kind of devices and methods therefor that is used to show the interface of mixed signal, can provide information about the source signal (or object signal) that is associated with mixed signal (or synthetic object signal) via graphic user interface (GUI) by it.

Another object of the present invention provides the devices and methods therefor at the interface that is used to show mixed signal, and the image of the source signal that is associated with mixed signal (or synthetic object signal) by its expression can be shown by differently changing by the time in such as mixed signals such as sound signal, vision signal (or synthetic object signal) process in reproduction.

Another object of the present invention provides signal that a kind of source signal in being included in mixed signal do not utilize similar source signal in the situation of individualism and generates method according to the supplementary of source signal.

Another object of the present invention provides a kind of method and device thereof that utilizes mixed signal to generate supplementary in demoder, and wherein this supplementary is used for mixing this mixed signal again.

Another object of the present invention provides a kind of devices and methods therefor that customer-furnished source signal is replaced the included particular source signal of mixed signal that is used for.

Another object of the present invention provides a kind of devices and methods therefor that is used for processing signals, can utilize source signal to revise mixed signal by its user.

Another object of the present invention provides a kind of devices and methods therefor that is used for processing signals, can pass through source signal unit controls mixed signal by its user.

Another object of the present invention provides a kind of devices and methods therefor that is used for processing signals, can receive the specific mixed information again that provides server to transmit by mixed information again by its user.

Another object of the present invention provides a kind of devices and methods therefor that is used for processing signals, and the mixed information again that is generated by the user by it can be uploaded to mixed information again provides server.

Another purpose of the present invention provides a kind of devices and methods therefor that is used for processing signals, by it can receive or the generating portion source signal from the mixed signal of its eliminating.

Other features and advantages of the present invention will be set forth in the following description, and partly will be apparent from describe, and perhaps can know from the practice of the present invention.Purpose of the present invention and other advantage can be realized and obtained by the structure of specifically noting in printed instructions and claims and the accompanying drawing.

In order to realize these purposes with other advantage and according to purpose of the present invention, as this paper imbody and broadly described, input media according to the present invention comprises: input block; Control module, it will convert the menu display commands according to the source via the input signal that input block receives to, and this control module is controlled the menu display image according to the source that will export according to the menu display commands according to the source based on the source information corresponding to mixed signal; And be used to export the display that the menu according to the source shows.

Preferably, this input media also comprises positioning equipment, and control module will convert the energy level regulating command according to the source via the input signal that positioning equipment receives to.

Preferably, this input media also comprises directionkeys, and control module will convert the energy level regulating command according to the source via the input signal that directionkeys receives to.

In order further to realize these purposes with other advantage and according to purpose of the present invention, input media according to the present invention comprises: input block; Control module, it will convert the menu display commands according to the source via the input signal that input block receives to; And wireless communication unit, its order with the control module conversion sends to external unit.

Preferably, this wireless communication unit receives about the data according to the menu image in source from external unit, and also can comprise the display that is used to show according to the menu image in source.

In order further to realize these purposes with other advantage and according to purpose of the present invention, input media according to the present invention comprises: input block; And control module, it will convert voice mute command or the regulating command of voice energy level via the input signal that input block receives to, and control module is based on the control information of described voice mute command or the regulating command of voice energy level output about mixed signal.

In order further to realize these purposes with other advantage and according to purpose of the present invention, input media according to the present invention comprises: input block; Control module, it will convert the ambient image display command via the input signal that input block receives to, and control module is controlled the ambient image that will export according to the single display command of ambient image based on the source information corresponding to mixed signal; And display, described ambient image is output to display.

Preferably this input media also comprises positioning equipment or directionkeys, and control module will convert the environment regulating command to via the input signal that positioning equipment or directionkeys receive, then based on the control information of environment regulating command output about mixed signal.

In order further to realize these purposes with other advantage and according to purpose of the present invention, input media according to the present invention comprises: input block; Control module, it will convert source sound mute command via the input signal that input block receives to, control module is based on the control information of sound mute command output in source about mixed signal, and wherein sound mute command in source makes particular source signal included in the mixed signal not by playback.

In order further to realize these purposes with other advantage and according to purpose of the present invention, input method according to the present invention comprises: receive shortcut and deposit order; Select among in a plurality of keys, multiple source and at least one or a plurality of function; And store by matching selected key at the selected function in selected source, wherein a plurality of described sources comprise at least one in audio signal source and the video signal source, and wherein at least one function comprises that sound is quiet, environment is regulated and at least one in regulating of energy level.

Preferably, when selecting, select in a plurality of numerical keys.

In order further to realize these purposes and other advantage and according to purpose of the present invention, input media according to the present invention comprises: input block is used for selecting among of a plurality of keys, multiple source and at least one or a plurality of function; Storage unit is used for storing the command information about each of a plurality of keys; And control module, it will match selected key at the selected function in selected source, control module is stored the result of coupling in storage unit, wherein multiple source comprises at least one in sound signal object and the object video signal, and wherein at least one function comprises that sound is quiet, environment is regulated and at least one in regulating of energy level.

In order further to realize these purposes and other advantage and, comprise according to the method for the interface of demonstration mixed signal of the present invention: select the specific blend signal according to purpose of the present invention; And show the tabulation of source signal by the information of the relevant source signal corresponding to mixed signal of inquiry, wherein when selecting mixed signal, keep demonstration.

Preferably, can extract from supplementary about the information of source signal corresponding to mixed signal.

Preferably, the tabulation of source signal comprises at least one in the characteristic of the source signal that musical instrument title, player's name and mixed signal are included.

Preferably, this method can further comprise: select single source from the source signal tabulation; And the further metadata that shows at selected source.

More preferably, metadata is extracted from the supplementary corresponding to mixed signal, and can comprise in musical instrument, player's name and the product data of source signal at least one.

Preferably, this method also can comprise from source signal tabulation selection single source; And further demonstration is regulated image at the volume level in selected source.

Preferably, this method also can comprise from source signal tabulation selection single source; And demonstration is regulated image at the balanced device in selected source.

Preferably, this method also can comprise from source signal tabulation selection single source; And demonstration is regulated image at the environment in selected source.

In order further to realize these purposes and other advantage and,, comprising: the input block that is used to select one of a plurality of mixed signals according to a kind of device that is used to show the interface of mixed signal of the present invention according to purpose of the present invention; Control module, its by inquiry about show the tabulation of source signal corresponding to the information of the source signal of mixed signal; And the display that is used to show the tabulation of source signal, wherein when selecting mixed signal, keep demonstration.

Preferably, device also comprises second display, and wherein input block selects single source and control module to show that at second display metadata, volume level at selected source regulate image, balanced device and regulate image and environment and regulate the image at least one from the tabulation of source signal.

Preferably, whether display can exist the tabulation that shows source signal by the flicker of a plurality of luminescent devices.

More preferably, the display and second display can be constructed with single panel.

In order further to realize these purposes with other advantage and according to purpose of the present invention, a kind of method at the interface of mixed signal that shows according to the present invention comprises: select the specific blend signal; And by inquiry about showing icon based on information corresponding to source signal about source signal corresponding to the information of the source signal of mixed signal.

Preferably, the information about source signal is to extract from the supplementary corresponding to mixed signal.

Preferably, this method also can comprise the metadata of extraction corresponding to mixed signal.And this icon can comprise the image that mates metadata.

More preferably, metadata is to extract from the supplementary corresponding to mixed signal, and can comprise Instrumentalist's name of source signal, at least one in singer's name.

Preferably, this method also can comprise if receive fill order about one of icon, then shows corresponding to the energy level of the source signal of selected icon to regulate image.

Preferably, this method also can comprise if receive the order of regulating about energy level, then change the shape of selected icon according to the energy level through regulating.And the shape of selected icon comprises at least one in the interior position of size, color, brightness and image.

Preferably, this method also can comprise if select one of icon, then shows the balanced device image corresponding to the source signal of selected icon.

More preferably, this method also can comprise if receive energy level regulating command according to sub-band, then mixes this mixed signal again by the sub-band energy level of regulating corresponding to the source signal of selected icon.

Preferably, this method also can comprise if select one of icon, then shows the environment adjusting image corresponding to the source signal of selected icon.And environment is regulated the signal relative position of image demonstration according to the source.

Preferably, this method also can comprise if receive the order of regulating about environment, then change the shape of selected icon.And the shape of selected icon can comprise in size, color and the brightness at least one.

Preferably, this method also can comprise if receive signal about the environment regulating command, then mixes this mixed signal again by the relative position of regulating corresponding to the source signal of selected icon.And, can determine relative position according to the position and the Virtual User position in another source.

In order further to realize these purposes and other advantage and,, comprising: the input block that is used to select one of a plurality of mixed signals according to a kind of device that is used to show the interface of mixed signal of the present invention according to purpose of the present invention; Control module, it is based on the icon that shows about the information with the corresponding source signal of the selected mixed signal of input block corresponding to source signal; And display unit, be used to show icon corresponding to source signal.

Preferably, this device also can comprise the storage unit of storage according to the view data of icon.And this icon can comprise the view data that is stored in the storage unit.

In order further to realize these purposes and other advantage and according to purpose of the present invention, the method according to the interface of demonstration mixed signal of the present invention comprises: receive the playback command about mixed signal; And if change by the time corresponding to the energy level of the source signal of mixed signal, then by changing the shape that shape shows the image of source signal by the time, wherein the shape of image comprises at least one in the position in size, color, brightness and the image.

Preferably, the energy level of source signal comprises the energy level according to sub-band of source signal.And demonstration can comprise the shape of the image that partly changes source signal.

Preferably, show that the image size comprise the source signal except that the source signal that has high level at specific timing point is set to 0.

Preferably, image can mate the metadata corresponding to mixed signal.

In order further to realize these purposes and other advantage and according to purpose of the present invention, the device according to the interface of demonstration mixed signal of the present invention comprises: the input block that is used to import the playback command of mixed signal; Control module, if change by the time corresponding to the energy level of the source signal of mixed signal, then control module is by changing the shape that shape is controlled the image of the source signal that will show by the time; And display unit, be used to show image corresponding to source signal, wherein the shape of image comprises at least one in the interior position of size, color, brightness and image.

In order to realize that further these purposes are with other advantage and according to purpose of the present invention, provide the processing signals method of server implementation according to of the present invention by the mixed information again that is connected to user terminal via communication network, comprising: by user terminal requests mixed information again; And the mixed information again of being asked sent to user terminal, wherein again mixed information comprise source signal included in mixed signal, the mixed signal, be used for according to source signal control mixed signal hybrid parameter, be used for the extended hybrid signal of extended hybrid mixed signal and be used to represent the icon of source signal or at least one of diagram.

Preferably, mixed information comprises the modified mixed signal that generates by exclusive segment source signal from the included source signal of mixed signal again.

More preferably, if user terminal requests sends modified mixed signal, then method also comprises: the user can be selected will be from the source signal of mixed signal eliminating; And generate the modified mixed signal of having got rid of selected source signal, wherein when emission, modified mixed signal is sent to user terminal.

Preferably, send and to comprise that then mixed information sends to user terminal again if mixed information is again paid.

More preferably, mixed information provides server to be connected to banking institution or mobile communication service provider via communication network again, and payment is carried out in the following manner: to user terminal requests user end certification information, send to banking institution or mobile communication service provider comes request authentication by authentication information with user terminal input, if and user end certification finishes, then ask payment by payment information being sent to banking institution or mobile communication service provider.

In order to realize that further these purposes are with other advantage and according to purpose of the present invention, provide the processing signals method of the user terminal enforcement of server according to of the present invention by be connected to again mixed information via communication network, comprising: provide server to ask mixed information again by visiting again mixed information; Mixed information provides server will to provide the payment information of server requests to send to again by mixed information again; And if pay, then provide server to receive mixed information again from mixed information again, wherein again mixed information comprise the source signal that comprises in mixed signal, the mixed signal, be used for according to source signal control mixed signal hybrid parameter, be used for the extended hybrid signal of extended hybrid mixed signal and be used to represent the icon of source signal or at least one of diagram.

In order to realize that further these purposes are with other advantage and according to purpose of the present invention, the mixed information again that is connected to user terminal via communication network according to the present invention provides server, comprise: Transmit-Receive Unit, it has the mixed information again of user terminal requests, and this Transmit-Receive Unit sends to user terminal with the mixed information again of being asked; Database Unit, the mixed information again of being asked is extracted in its request in response to user terminal; The payment processes unit, if the use of mixed information will be paid again, then the payment processes cell processing is about the payment of mixed information use again; And control module, its control is by the mixed information again that will send to user terminal of user terminal requests, wherein again mixed information comprise the source signal that comprises in mixed signal, the mixed signal, be used for according to source signal control mixed signal hybrid parameter, be used for the extended hybrid signal of this mixed signal of extended hybrid and be used to represent the icon of source signal or at least one of diagram.

In order to realize that further these purposes are with other advantage and according to purpose of the present invention, be connected to again the user terminal that mixed information provides server according to of the present invention by communication network, comprise: communication unit, it provides server requests mixed information again to mixed information again, and this communication unit receives the mixed information again of being asked; The user interface that is used for receiving control information; Hybrid rending unit again, it utilizes mixed information and control information to mix the source signal that is included in the mixed signal more again; And control module, it is by controlling the decomposite source signal of wanting that comprises in the user terminal control mixed signal all sidedly, wherein again mixed information comprise the source signal that comprises in mixed signal, the mixed signal, be used for according to source signal control mixed signal hybrid parameter, be used for the extended hybrid signal of extended hybrid mixed signal and be used to represent the icon of source signal or at least one of diagram.

Should be understood that above general description and the following detailed description are exemplary and explanat, and aim to provide further explanation as the present invention for required protection.

Beneficial effect

According to one embodiment of present invention, can regulate volume level, perhaps scalable surrounding environment according to being included in such as the source signal in the mixed signals such as vision signal, sound signal.Therefore, the user is convenient to mix mixed signal again.

According to another embodiment of the invention, only remove human speech or only regulate the volume level of voice in the source that can from mixed signal, comprise.Therefore, the user can only listen accompaniment music by the voice that utilize input equipment (telepilot) to remove the singer simply in the process of playback of music file.

According to another embodiment of the invention, the frequent decomposite source of user (for example is registered as particular key the user, numerical key #1) behind the shortcut, when the user utilized shortcut to regulate energy level or regulate environment according to the source, the user was convenient to utilize input equipment (for example telepilot) to carry out the mixing again of being arranged to be fit to user's taste.

According to another embodiment of the invention, because be presented on the screen, so the user can reproduce or mix in the process of this mixed signal again and check which kind of source is included in the mixed signal about the information of the source signal (or object signal) that is associated with mixed signal (or synthetic object signal) is held.

According to another embodiment of the invention, because the user always can reproduce or mix and check in the process of this mixed signal which kind of source (according to the sound signal of musical instrument etc.) is included in the mixed signal, confirms which kind of source is included in the process in the mixed signal so there is no need to carry out before regulating energy level according to the source or regulating environment.

According to another embodiment of the invention, because be presented on the screen, so the user can reproduce or mix in the process of this mixed signal again and check which kind of source is included in the mixed signal about the information of the source signal (or object signal) that is associated with mixed signal (or synthetic object signal) is held.

According to another embodiment of the invention, because the user always can reproduce or mix and check in the process of this mixed signal which kind of source (according to the sound signal of musical instrument etc.) is included in the mixed signal, confirms which kind of source is included in the process in the corresponding mixed signal so there is no need to carry out before regulating energy level according to the source or regulating environment.

And in signal processing method according to the present invention, the user receives from mixed information again and the mixed information again that server sends is provided and uses it.

In addition, in signal processing method according to the present invention and device, provide and use the modified mixed signal of wherein having got rid of the particular source signal.

In addition, in signal processing method according to the present invention, the user generates or revise mixed information can upload to the mixed information again of correspondence again that mixed information provides server then.

Accompanying drawing is described

Be included in this to provide further understanding of the present invention, and in this application combined and constitute its a part of accompanying drawing embodiments of the present invention are shown, it can be used to explain principle of the present invention with instructions.

In the accompanying drawings:

Fig. 1 is the block diagram of first signal processing apparatus according to an embodiment of the invention;

Fig. 2 is the detailed diagram of first signal processing apparatus shown in Figure 1 in using the situation of stereophonic signal;

Fig. 3 is the territory figure that is used to handle media signal according to an embodiment of the invention;

Fig. 4 is the block diagram of secondary signal treating apparatus according to an embodiment of the invention;

Fig. 5 is the block diagram of the 3rd signal processing apparatus according to an embodiment of the invention;

Fig. 6 is the detailed diagram of the 3rd signal processing apparatus shown in Figure 5 in using the situation of stereophonic signal;

Fig. 7 is the block diagram of the 4th signal processing apparatus according to an embodiment of the invention;

Fig. 8 is the block diagram of the combining and configuring of general encoding device according to an embodiment of the invention and signal processing apparatus;

Fig. 9 is the block diagram of the combining and configuring of general solution decoding apparatus according to an embodiment of the invention and signal processing apparatus;

Figure 10 is the block diagram of the 5th signal processing apparatus according to an embodiment of the invention;

Figure 11 is the block diagram of input media according to an embodiment of the invention;

Figure 12 is the exemplary plot of input media according to an embodiment of the invention;

Figure 13 is in the exemplary plot of importing the image that first input block (source Menu key) shows afterwards;

Figure 14 is in the exemplary plot of importing the image that second input block (the quiet key of voice) shows afterwards;

Figure 15 is in the exemplary plot of importing the image that the 3rd input block (voice adjusting key) shows afterwards;

Figure 16 is in the exemplary plot of importing the image that the 4th input block (environment adjusting key) shows afterwards;

Figure 17 is the exemplary plot of the image that shows afterwards at the first source key (piano key) of importing the 5th input block;

Figure 18 is the exemplary plot of the image that shows afterwards at the second source key (violin key) of importing the 5th input block;

Figure 19 is the block diagram of input media according to another embodiment of the invention;

Figure 20 is first block diagram of mixed signal decoding device again that interconnects to input media according to an embodiment of the invention;

Figure 21 is second block diagram of mixed signal decoding device and second contact surface equipment again that interconnects to input media according to another embodiment of the invention;

Figure 22 is the process flow diagram according to the input method of the embodiment of the invention;

Figure 23 is the exemplary plot of the image of demonstration after importing the shortcut registration command;

Figure 24 is the block diagram of interface display apparatus according to an embodiment of the invention;

Figure 25 A and Figure 25 B are the exemplary plot of the realization of interface display apparatus according to an embodiment of the invention;

Figure 26 is the exemplary plot of the image that shows on first display and second display when selecting particular source;

Figure 27 is another exemplary plot of the image that shows on first display and second display when selecting particular source;

Figure 28 is another exemplary plot of the image that shows on first display and second display when selecting particular source;

Figure 29 is another exemplary plot of the image that shows on first display and second display when selecting particular source;

Figure 30 is the block diagram of interface display apparatus according to another embodiment of the invention;

Figure 31 is the process flow diagram according to the interface display method of the embodiment of the invention;

Figure 32 is the block diagram of interface display apparatus according to an embodiment of the invention;

Figure 33 A to Figure 33 D is the exemplary plot of the realization of interface display apparatus according to an embodiment of the invention;

Figure 34 is the block diagram of interface display apparatus according to another embodiment of the invention;

Figure 35 A and Figure 35 B are the process flow diagrams of interface display method according to an embodiment of the invention;

Figure 36 A is the exemplary plot that shows on it according to the screen of the icon of the source signal of specific blend signal;

Figure 36 B is wherein according to the exemplary plot of the image of the icon representation metadata of the source signal of specific blend signal;

Figure 37 A is the exemplary plot that energy level is regulated image;

Figure 37 B is the exemplary plot of image of revising the shape of icon on it according to the energy level through regulating;

Figure 38 is the exemplary plot of balanced device image (regulating image according to the sub-band energy level);

Figure 39 is the exemplary plot that environment is regulated image (relative position adjusting image);

Figure 40 is the block diagram of interface display apparatus according to still another embodiment of the invention;

Figure 41 is the block diagram of interface display apparatus according to still a further embodiment;

Figure 42 is the process flow diagram of interface display method according to another embodiment of the invention;

Figure 43 is the exemplary plot of the screen that changes pro rata of the energy level of the size of its epigraph and source signal;

Figure 44 is the exemplary plot of the screen that changes pro rata of the energy level of the brightness of its epigraph and source signal;

Figure 45 and Figure 46 are the exemplary plot that only shows the screen of the image that has high level in the source signal on it;

Figure 47 is the synoptic diagram that system is provided according to the mixed information again of the embodiment of the invention;

Figure 48 is the block diagram that server is provided according to the mixed information again of the embodiment of the invention;

Figure 49 is the block diagram that the module of server is provided according to the mixed information again of the embodiment of the invention;

Figure 50 provides server that the process flow diagram of the method for mixed information is provided again according to the embodiment of the invention from mixed information again;

Figure 51 provides the process flow diagram of the method for mixed information according to the embodiment of the invention to user terminal again;

Figure 52 be according to the embodiment of the invention will be again mixed information be sent to the process flow diagram that mixing again provides the method for server from the user;

Preferred forms

Embodiments of the present invention

Detailed now the preferred embodiments of the present invention with reference to its example shown in the drawings.

At first, in the disclosure, term " input block " or " key " are construed as importing the device of specific input signal, and are not limited only to such as input systems such as button, touch sensors.

Mixed signal of the present invention comprises sound signal, vision signal etc., and also can be understood to include the synthetic object signal.

The invention provides and to pass through the algorithm that source (object) signal element is handled mixed signal.By in the situation of source signal cell processing mixed signal, can generate various effects considerablely.For example, when watching film, the user might maintain fixing energy level by the volume with the actor/actress voice and only improve the volume of background music.In the present invention, source signal comprises at least one source (for example, piano) that constitutes mixed signal.And, represent can when handling mixed signal, " separately " revise with the characteristic (for example, location, gain etc.) of the particular source signal correction connection that constitutes mixed signal by the source signal cell processing." separately " expression and the modification of the characteristic of particular source signal correction connection do not influence the characteristic of other source signal, and perhaps the influence to the characteristic of other source signal is difficult to perceive.For clear and be described easily for the purpose of, adopt stereophonic signal as an example.And, should understand the present invention and be not limited only to stereophonic signal.In the present invention, the form (for example, PCM, MP3, MPEG-AAC) of undersized supplementary and general mixed signal is transmitted.Therefore, can utilize mixed signal and supplementary to generate mixed signal again.

Fig. 1 is the block diagram of first signal processing apparatus according to an embodiment of the invention.

With reference to Fig. 1, first signal processing apparatus comprises supplementary generation unit 103 and supplementary coding unit 105.

Supplementary generation unit 103 utilizes the source signal 102 of general mixed signal 101 and formation mixed signal to generate supplementary 104.

Mixed signal 101 can comprise monophony, stereo or multi-channel audio signal.

Source signal 102 can comprise part or all of the source signal that constitutes mixed signal 101.

And supplementary 104 is illustrated in by source signal unit employed information when handling mixed signal.Supplementary 104 comprises the hybrid parameter that is used for mixing again this mixed signal.Hybrid parameter comprises the scrambler hybrid parameter that utilizes source signal to generate by scrambler, and optionally comprises blind (blind) hybrid parameter that only utilizes mixed signal to generate.The yield value of each source signal, sub-band power etc. can be the examples of hybrid parameter.Concrete definition and generation method at supplementary 104 will be described in Fig. 2.

The present invention includes and only utilize the source signal 102 that constitutes mixed signal to generate the method for supplementary 104.

And supplementary coding unit 105 generates encoded auxiliary information signal 106 by the supplementary 104 that is generated is encoded.Mixed signal 101 and auxiliary information signal 106 are sent to decoding device.

Fig. 2 is the detailed diagram of first signal processing apparatus shown in Figure 1 in using the situation of stereophonic signal.Mentioned in the description as the front, mixed signal used in the present invention can comprise monophony, stereo or multi-channel audio signal.For the purpose of clear and convenient, adopt stereophonic signal 201 as an example.

Can be with stereophonic signal 201 x ₁(n) and x ₂(n) be expressed as the source signal that constitutes stereophonic signal and, ' n ' index instruction time wherein.Therefore, stereophonic signal 201 can be expressed as formula 1.

[formula 1]

${\tilde{x}}_1\left(n\right)=\underset{i=1}{\overset{I}{\mathrm{\Σ}}}{a}_i\widetilde{s_i}\left(n\right)$

${\tilde{x}}_2\left(n\right)=\underset{i=1}{\overset{I}{\mathrm{\Σ}}}{b}_i\widetilde{s_i}\left(n\right)$

In this case, the number of included source signal in ' I ' indication stereophonic signal, and ' s _i(n) ' indication source signal.And, ' a _i' and ' b _i' be respectively to be used for determining that the amplitude of each source signal moves the value of (panning) and gain.Each ' s _i(n) ' be independently.Each ' s _i(n) ' can be pure source signal, maybe can comprise the pure source signal that adds little reverberation and sound effect component of signal to it.For example, specific reverb signal component can be represented as two source signals, promptly is mixed into the signal and the signal that is mixed into R channel of L channel.

The objective of the invention is to revise the stereophonic signal that comprises source signal, so that mix M source signal (0≤M≤I) again.Can utilize different gain factors that source signal is mixed to stereophonic signal again.Mixed signal again can be expressed as formula 2.

[formula 2]

${\tilde{y}}_1\left(n\right)=\underset{i=1}{\overset{M}{\mathrm{\Σ}}}{c}_i\widetilde{s_i}\left(n\right)+\underset{i=M+1}{\overset{I}{\mathrm{\Σ}}}{a}_i\widetilde{s_i}\left(n\right)$

${\tilde{y}}_2\left(n\right)=\underset{i=1}{\overset{M}{\mathrm{\Σ}}}{d}_i\widetilde{s_i}\left(n\right)+\underset{i=M+1}{\overset{I}{\mathrm{\Σ}}}{b}_i\widetilde{s_i}\left(n\right)$

In formula 2, ' c _i' and ' d _i' be the new gain factor of wanting a decomposite M source signal.' c _i' and ' d _i' can provide by decoder end.In this case, supplementary generation unit 206 can utilize stereophonic signal 201 and M source signal 202 to generate supplementary 207.

Description as the front is mentioned, the objective of the invention is to mix this general stereophonic signal again by the source signal unit when providing general stereophonic signal and less supplementary.

It is impossible utilizing the supplementary of minute quantity fully to generate the mixed signal again that is expressed as formula 2 by the mixed signal that is expressed as formula 1.

So, do not visiting each source signal s _i(n) under the situation, in the situation that provides the general mixed signal that is expressed as formula 1, the objective of the invention is to imitate the mixed signal that is expressed as formula 2 perceptually.

With reference to Fig. 2, M included in general stereophonic signal 201 and the stereophonic signal 201 source signal 202 is input to first signal processing apparatus.Stereophonic signal 201 is delayed with synchronous with supplementary, can directly be used as output signal then.

In order to generate supplementary, stereophonic signal 201 and source signal 202 resolve in time-frequency domain according to sub-band signal 204 and 205 by bank of filters 203.Particularly, in time-frequency domain, handle stereophonic signal 201 and source signal 202.And, after a while with interpretation time-frequency field.

On the centre frequency of each sub-band, handle similarly according to sub-band signal 204.The sub-band of the stereophonic signal 201 on the characteristic frequency is represented as x to 204 ₁(k) and x ₂(k).In this case, ' k ' is the time index of each sub-band signal.Similarly, the sub-band signal 205 of M source signal 202 is represented as S ₁(k), S ₂(k) ..., S _M(k).For the sake of clarity, do not use sub-band (frequency) index.

If provide the sub-band signal 205 of source signal 202, then 206 generations of supplementary generation unit are according to the power of the sub-band in short-term E{s of sub-band _i ²(k) }.

And supplementary generation unit 206 utilizes the sub-band of stereophonic signal 201 to the 204 gain factor a that generate according to sub-band _iAnd b _iDirectly provide gain factor a from the outside _iAnd b _iUtilization generates supplementary 207 according to sub-band according to the power of sub-band in short-term of sub-band with according to the gain factor of sub-band.

Supplementary generation unit 206 can generate the different information that are associated with stereophonic signal, as supplementary 207 and sub-band power and gain factor in short-term.

And supplementary coding unit 208 utilizes the supplementary 207 according to sub-band to generate encoded auxiliary information signal 209.

For a plurality of stereophonic signals 201, gain factor a _iAnd b _iShould fix.If gain factor a _iAnd b _iCan change according to time k, then will generate gain factor as the function of time.Replace directly quantizing and encoding, gain factor can be transformed into and be more suitable for the different value that quantizes and encode.

And, E{s _i ²(k) } can be normalized to the value relevant with the sub-band power of stereophonic signal 201.If general encoding device is used for encoded stereo signal effectively, this makes the present invention resist variation strongly.For example, can be with a _iAnd b _iBe transformed into the gain and decibel (dB) unit energy level difference that are expressed as formula 3, transmit then.

[formula 3]

$g_i={10\log }_{10}(a_{\mathrm{<figure-callout\; id="2"\; label="i"\; filenames="A2007800496020062H1.png,A2007800496020065H1.png"\; state="\{\{state\}\}">i</figure-callout>}}^2+b_i^2)$

$l_i=20{\log }_{10}\frac{b_i}{a_i}$

And the replacement direct coding is a supplementary, E{s _i ²(k) } can be transformed into the value that defines about stereophonic signal, it is represented as formula 4, transmits then.

[formula 4]

$A_i\left(k\right)=10\mathrm{lo}{g}_{10}\frac{E\left\{s_i^2\left(k\right)\right\}}{E\left\{x_1^2\left(k\right)\right\}+E\left\{x_2^2\left(k\right)\right\}}$

In order to generate in short-term, the present invention uses one pole average.That is, can be with E{s _i ²(k) } be calculated as formula 5.

[formula 5]

$E\left\{s_i^2\left(k\right)\right\}=\mathrm{\&alpha;}{s}_i^2\left(k\right)+(1-\mathrm{\&alpha;})E\left\{s_i^2(k-1)\right\}$

In formula 5, α ∈ [0,1] determines the time constant of the estimating window that reduces as formula 6 indexes.

[formula 6]

$T=\frac{1}{\mathrm{\&alpha;}{f}_s}$

In formula 6, f _sRefer to the sub-band sample frequency.For example, can use T=40ms.

In the following description, E{} refers to short-time average.If do not provide a _iAnd b _i, then they need generate by supplementary generation unit 206.Because $E\left\{s_i\left(n\right){\stackrel{\&OverBar;}{x}}_1\left(n\right)\right\}=a_{i}E\left\{s_i^2\left(n\right)\right\},$ So can calculate a by formula 7 _i

[formula 7]

$a_i=\frac{E\left\{\widetilde{s_i}\left(n\right){\tilde{x}}_1\left(n\right)\right\}}{E\left\{{\widetilde{s_i}}^2\left(n\right)\right\}}$

Similarly, can calculate b by formula 8 _i

[formula 8]

$b_i=\frac{E\left\{\widetilde{s_i}\left(n\right){\tilde{x}}_2\left(n\right)\right\}}{E\left\{{\widetilde{s_i}}^2\left(n\right)\right\}}$

Fig. 3 illustrates the territory that is used to handle media signal according to an embodiment of the invention.

Description as the front is mentioned, and sound signal and supplementary are treated to the signal according to sub-band in as shown in Figure 3 the time-frequency domain.

Generate in the time-frequency domain signal according to sub-band perceptually.For example, can use the signal of STFT (Short Time Fourier Transform) generation of synthetic window according to sub-band with sinusoidal analysis and about 20ms.In this case, can have approximately than the mode of the bandwidth of the big twice of ERB (equivalent rectangular bandwidth) with a group and organize into groups the STFT coefficient.

Fig. 4 is the block diagram of secondary signal treating apparatus according to an embodiment of the invention.

With reference to Fig. 4, reduction mixed cell 406 is by generating multiple source signals 401 additions and signal.Different with first signal processing apparatus, the secondary signal treating apparatus transmits and signal 404 and do not transmit stereophonic signal.

Supplementary generation unit 403 utilizes source signal 401 to generate supplementary 405.Supplementary 405 comprises sub-band power and the gain factor corresponding to each source signal.And supplementary 405 can comprise the parameter corresponding to the delay in the hybrid rending unit again.Be similar to the situation in first signal processing unit, supplementary 405 can be transmitted by being transformed into the different value that is more suitable for quantizing and encodes.

The supplementary 405 that the utilization of supplementary coding unit is generated generates auxiliary information signal 407.

What generated is sent to decoding device with signal 405 and the auxiliary information signal 407 that is generated.

The present invention also comprises the encoding device of failing to have reduction mixed cell 402.In this case, source signal 401 is not transformed into and signal 404, but directly transmits it.

Fig. 5 is the block diagram of the 3rd signal processing apparatus according to an embodiment of the invention.

With reference to Fig. 5, the 3rd signal processing apparatus according to an embodiment of the invention comprises supplementary decoding unit 503 and hybrid rending unit 505 again.

Mixed signal 501 and auxiliary information signal 502 are imported into the 3rd signal processing apparatus.Mixed signal 501 can comprise monophony, stereo or multi-channel audio signal.

Supplementary decoding unit 503 generates supplementary 504 by decoding auxiliary information signal 502.Supplementary 504 comprises the gain factor and the sub-band power of source signal included in the sound signal 501 of transmission.

User's hybrid parameter 506 that the control information that utilization is directly provided by the user generates can be imported into hybrid rending unit 505 again.

Hybrid rending unit 505 uses mixed signal 501, the supplementary 504 that is transmitted and user's hybrid parameter 506 to generate mixed signal 507 again again.Be used to generate again the details of the method for mixed signal after a while with reference to Fig. 6 explanation.

Again mixed signal 507 be generated as its Taoist monastic name equal the mixed signal that transmitted the sound Taoist monastic name be equal to the sound channel mixed signal, perhaps can be generated as the expansion sound channel mixed signal of its Taoist monastic name greater than the sound Taoist monastic name of mixed signal.

Fig. 6 is the detailed diagram of the 3rd signal processing apparatus shown in Figure 5 in using the situation of stereophonic signal.Mentioned in the description as the front, the mixed signal that is transmitted can comprise monophony, stereo or multi-channel audio signal.For convenience's sake, suppose that the mixed signal that is transmitted comprises stereophonic signal 601.

With reference to Fig. 6, stereophonic signal 601 is broken down in time-frequency domain according to sub-band signal 604 via bank of filters 603.The signal 604 according to sub-band on characteristic frequency is expressed as x respectively ₁(k) and x ₂(k).

The supplementary 606 that the auxiliary information signal 602 that supplementary decoding unit 605 is transmitted by decoding generates according to sub-band.

The user's hybrid parameter 608 that utilizes customer-furnished control information to generate can be imported into hybrid rending unit 607 again.And, can provide user's hybrid parameter 608 according to sub-band.

Description as the front is mentioned, and supplementary 606 comprises the gain factor a that is expressed as according to sub-band _iAnd b _iSub-band power and want the E{s of a decomposite M source signal _i ²(k) }.

Hybrid rending unit 607 uses the 609 (y of mixed signal again that the stereophonic signal 604 that generates according to sub-band, the supplementary 606 that is transmitted and user's hybrid parameter 608 generate according to sub-band again ₁(k), y ₂(k)).Detailed description is generated again the method for mixed signal 609.Mixed signal 609 is transformed into stereophonic signal (y via inverse filterbank 610 in time domain again ₁, y ₂) 611.

Following explanation is generated the method for mixed signal 609 again by mixed cell 607 again.

At first, 2 pairs of formula 1 and formula are effective according to sub-band signal 604 and 609.In this case, by source signal s according to sub-band _i(k) replace source signal s _i(n).

[formula 9]

$x_1\left(k\right)=\underset{i=1}{\overset{I}{\mathrm{\&Sigma;}}}{a}_i{s}_i\left(k\right)$

$x_2\left(k\right)=\underset{i=1}{\overset{I}{\mathrm{\&Sigma;}}}{b}_i{s}_i\left(k\right)$

Mixed signal again 609 according to sub-band can be represented as formula 10.

[formula 10]

$y_1\left(k\right)=\underset{i=1}{\overset{M}{\mathrm{\&Sigma;}}}{c}_i{s}_i\left(k\right)+\underset{i=M+1}{\overset{I}{\mathrm{\&Sigma;}}}{a}_i{s}_i\left(k\right)$

$y_2\left(k\right)=\underset{i=1}{\overset{M}{\mathrm{\&Sigma;}}}{d}_i{s}_i\left(k\right)+\underset{i=M+1}{\overset{I}{\mathrm{\&Sigma;}}}{b}_i{s}_i\left(k\right)$

In order to generate again mixed signal 609, can use least square to estimate.If provide mixed signal (x according to sub-band ₁(k), x ₂(k)) 604, the mixed signal again 609 according to sub-band that then has different gains as shown in Equation 11 can be estimated as the linear combination according to the mixed signal 604 of sub-band.

[formula 11]

${\hat{y}}_1\left(k\right)=w_{11}\left(k\right)x_1\left(k\right)+w_{12}\left(k\right)x_2\left(k\right)$

${\hat{y}}_2\left(k\right)=w_{21}\left(k\right)x_1\left(k\right)+w_{22}\left(k\right)x_2\left(k\right)$

In formula 11, w ₁₁(k), w ₁₂(k), w ₂₁(k) and w ₂₂(k) be weight factor respectively.In this case, the evaluated error that is generated can be defined as formula 12.

[formula 12]

$e_1\left(k\right)=y_1\left(k\right)-{\hat{y}}_1\left(k\right)=y_1\left(k\right)-w_{11}\left(k\right)x_1\left(k\right)-w_{12}\left(k\right)x_2\left(k\right)$

$e_2\left(k\right)=y_2\left(k\right)-{\hat{y}}_2\left(k\right)=y_2\left(k\right)-w_{21}\left(k\right)x_1\left(k\right)-w_{22}\left(k\right)x_2\left(k\right)$

Can generate weight factor w according to sub-band ₁₁(k), w ₁₂(k), w ₂₁(k) and w ₂₂(k), so that square error E{e ₁ ²And E{e (k) } ₂ ²(k) } minimize.For this reason, can use such fact: work as e ₁(k) and e ₂(k) respectively with x ₁(k) and x ₂(k) square error is minimized during quadrature.The w that is generated ₁₁(k) and w ₁₂(k) can be represented as formula 13.

[formula 13]

$w_{11}=\frac{E\left\{x_2^2\right\}E\left\{x_1{y}_1\right\}-E\left\{x_1{x}_2\right\}E\left\{x_2{y}_1\right\}}{E\left\{x_1^2\right\}E\left\{x_2^2\right\}-E^2\left\{x_1{x}_2\right\}}$

$w_{12}=\frac{E\left\{{x_{1}x}_2\right\}E\left\{x_1{y}_1\right\}-E\left\{x_1^2\right\}E\left\{x_2{y}_1\right\}}{E^2\left\{x_1{x}_2\right\}-E\left\{x_1^2\right\}E\left\{x_2^2\right\}}$

In formula 13, can directly generate E{x ₁ ², E{x ₂ ²And E{x ₁x ₂.Yet, can utilize supplementary 606 (for example, the E{s that is transmitted _i ², a _i, b _i) and customer-furnished control information 608 (for example, gain factor c _iAnd d _i) generate E{x by formula 14 ₁y ₁And E{x ₂y ₁.

[formula 14]

$E\left\{x_1{y}_1\right\}=E\left\{x_1^2\right\}+\underset{i=1}{\overset{M}{\mathrm{\&Sigma;}}}{a}_i(c_i-a_i)E\left\{s_i^2\right\}$

$E\left\{x_2{y}_1\right\}=E\left\{x_1{x}_2\right\}+\underset{i=1}{\overset{M}{\mathrm{\&Sigma;}}}{b}_i(c_i-a_i)E\left\{s_i^2\right\}$

Similarly, can generate w by formula 15 ₂₁And w ₂₂

[formula 15]

$w_{21}=\frac{E\left\{x_2^2\right\}E\left\{x_1{y}_2\right\}-E\left\{x_1{x}_2\right\}E\left\{x_2{y}_2\right\}}{E\left\{x_1^2\right\}E\left\{x_2^2\right\}-E^2\left\{x_1{x}_2\right\}}$

$w_{22}=\frac{E\left\{{x_{1}x}_2\right\}E\left\{x_1{y}_2\right\}-E\left\{x_1^2\right\}E\left\{x_2{y}_2\right\}}{E^2\left\{x_1{x}_2\right\}-E\left\{x_1^2\right\}E\left\{x_2^2\right\}}$

In formula 15, E{x ₁y ₂And E{x ₂y ₂Can be represented as formula 16.

[formula 16]

$E\left\{x_1{y}_2\right\}=E\left\{x_1{x}_2\right\}+\underset{i=1}{\overset{M}{\mathrm{\&Sigma;}}}{a}_i(d_i-b_i)E\left\{s_i^2\right\}$

$E\left\{x_2{y}_2\right\}=E\left\{x_2^2\right\}+\underset{i=1}{\overset{M}{\mathrm{\&Sigma;}}}{b}_i(d_i-b_i)E\left\{s_i^2\right\}$

If the phase place of mixed signal 604 is relevant each other or be almost relevantly, the value that then is expressed as formula 17 is near 1.

[formula 17]

$\mathrm{\&phi;}=\frac{E\left\{x_1{x}_2\right\}}{\sqrt{E\left\{x_1^2\right\}E{\{x}_2^2\}}}$

In this case, weight table can be shown formula 18.

[formula 18]

$w_{11}=\frac{E\left\{x_1{y}_1\right\}}{E\left\{x_1^2\right\}}$

w ₁₂＝w ₂₁＝0

$w_{22}=\frac{E\left\{x_2{y}_2\right\}}{E\left\{x_2^2\right\}}$

Description as the front is mentioned, and more than the mixed signal again 609 according to sub-band of Sheng Chenging is transformed into mixed signal 611 via inverse filterbank 610 again in time-frequency domain.

Mixed signal 611 sounds and is similar to the mixed signal of utilizing user's hybrid parameter ci that customer-furnished control information generates and di to mix source signal more independently to be generated again again.

So far mainly handled the mixing again of 2 channel stereo signal.Yet mentioned as the description of front, the present invention is applicable to the mixing again of multi-channel audio signal, for example, and 5.1 channel audio signal and stereophonic signal.Those skilled in the art it is evident that and can mix multi-channel audio signal again to be similar to the mode that is applied to the described stereophonic signal of the disclosure.If like this, formula 11 can be rewritten as formula 19.

[formula 19]

${\hat{y}}_1\left(k\right)=\underset{c=1}{\overset{C}{\mathrm{\&Sigma;}}}{w}_{1c}\left(k\right)x_c\left(k\right)$

${\hat{y}}_2\left(k\right)=\underset{c=1}{\overset{C}{\mathrm{\&Sigma;}}}{w}_{2c}\left(k\right)x_c\left(k\right)$

...

${\hat{y}}_C\left(k\right)=\underset{c=1}{\overset{C}{\mathrm{\&Sigma;}}}{w}_{\mathrm{Cc}}\left(k\right)x_c\left(k\right).$

Optionally, specific one can be kept perfectly in the sound channel of mixed signal, and is not mixed again.For example, mix the preceding sound channel that is applied to 5.1 surround channels again, and sound channel is not modified after two.For this reason, with 2 or 3 sound channels again hybrid algorithm be applied to preceding sound channel.

Fig. 7 is the block diagram of the 4th signal processing apparatus according to an embodiment of the invention.

With reference to Fig. 7, the 4th signal processing apparatus according to an embodiment of the invention comprises that supplementary decoding unit 703, spatial information unify unit 705 and hybrid rending unit 707 again.

Source signal be imported into the 4th signal processing apparatus with signal 701 and auxiliary information signal 702.

Supplementary decoding unit 703 generates supplementary 702 by decoding auxiliary information signal 704.Supplementary 704 comprises gain factor, delay constant, sub-band power etc.

Supplementary is unified unit 705 and is utilized supplementary 704 to be divided into multiple source signals 706 with signal 701.

Hybrid rending unit 707 can utilize source signal 706 to generate mixed signal 709 again again.In this case, hybrid rending unit 707 can utilize the entrained hybrid parameter of supplementary to generate mixed signal 709 again again.

And hybrid rending unit 707 user's hybrid parameter 708 that can utilize customer-furnished control information to generate generates mixed signal 709 again again.

Fig. 8 is the block diagram of the combining and configuring of general encoding device according to an embodiment of the invention and signal processing apparatus.

With reference to Fig. 8, mixed signal 801 can be transformed into encoded mixed signal 805 by being encoded by general encoding device 803.Mixed signal 801 can comprise according to sound channel signal or source signal.And general encoding device 803 is included in the scrambler of following exploitation and such as the conventional scrambler of AAC, MP3 scrambler etc.

The code device of mixed signal again 804 according to the present invention utilizes source signal included in mixed signal 801 and this mixed signal 802 to generate auxiliary information signal 806.

Multiplexing Unit 807 utilizes encoded mixed signal 805 and auxiliary information signal 806 to generate bit stream 808.Description as the front is mentioned, and auxiliary information signal 806 can be inserted in the ancillary data area in the conventional mixed signal form to have the compatibility with conventional equipment.

Fig. 9 is the block diagram of the combining and configuring of general solution decoding apparatus according to an embodiment of the invention and signal processing apparatus.

With reference to Fig. 9, divide and the bit stream 901 that is transmitted is divided into encoded mixed signal 903 and auxiliary information signal 904 with unit 902.

Subsequently, general solution decoding apparatus 905 generates the mixed signal 906 that can be used for according to the decoding device of mixed signal again 907 of the present invention by the encoded mixed signal 903 of decoding.And general solution decoding apparatus 905 is included in the demoder of following exploitation and such as the conventional demoder of AAC, MP3 decoding device etc.Mixed signal 906 can comprise according to sound channel signal or source signal.The decoding device of mixed signal again 907 according to the present invention can utilize in auxiliary information signal and the user's hybrid parameter 908 at least one that mixed signal 906 is transformed into mixed signal 909 again.

Figure 10 is the block diagram of the 5th signal processing apparatus according to an embodiment of the invention.

With reference to Figure 10, the 5th signal processing apparatus according to an embodiment of the invention comprises mixed signal decoding unit 1001, parameter generating unit 1002 and hybrid rending unit 1008 again.Randomly, the 5th signal processing apparatus can comprise effector 1011.

Parameter generating unit 1002 can comprise blind hybrid parameter generation unit 1003, user's hybrid parameter generation unit 1004 and hybrid parameter generation unit 1005 again.

Hybrid parameter generation unit 1005 comprises and is equal to hybrid parameter generation unit 1006 again, and can randomly comprise extended hybrid parameter generating unit 1007.

Hybrid rending unit 1008 comprises and is equal to hybrid rending unit 1009 again, and can randomly comprise extended hybrid rendering unit 1010.

Mixed signal decoding unit 1001 generates mixed signal by decoding by the encoded mixed signal that coding side transmits.

Parameter generating unit 1002 receives supplementary and the subscriber control information (or configuration information) that is transmitted by coding side.And subscriber control information can generate from decoder end, rather than is transmitted by encoder-side.

User's hybrid parameter generation unit 1004 utilizes subscriber control information to generate user's hybrid parameter.And the scrambler hybrid parameter can be included in the supplementary that is transmitted by encoder-side.

Blind hybrid parameter generation unit 1003 can utilize mixed signal to generate blind hybrid parameter.Scrambler hybrid parameter or blind hybrid parameter can optionally be input to hybrid parameter generation unit 1005 again.

Hybrid parameter generation unit 1005 utilizes supplementary and user's hybrid parameter to generate hybrid parameter more again.Can generate the hybrid parameter again of the sound channel that is applicable to again mixed signal.

The included hybrid parameter generation unit 1006 that is equal to is created on and generates the hybrid parameter again that uses when its Taoist monastic name equals the mixed signal again of sound Taoist monastic name of mixed signal in the hybrid parameter generation unit 1005 again.

And extended hybrid parameter generating unit 1007 is created on the hybrid parameter again that uses when generating its Taoist monastic name greater than the mixed signal again of the sound Taoist monastic name of mixed signal.Hybrid parameter is input to hybrid rending unit 1008 more again.

Again in the hybrid rending unit 1008 included be equal to hybrid rending unit 1009 utilize again hybrid parameter and mixed signal generate its Taoist monastic name equal mixed signal the sound Taoist monastic name be equal to sound channel mixed signal again.

Can be included in extended hybrid rendering unit 1010 in the hybrid rending unit 1008 utilizes the hybrid parameter again that generated by extended hybrid parameter generating unit 1007 and mixed signal to generate its Taoist monastic name greater than the expansion sound channel of the sound Taoist monastic name of mixed signal mixed signal more again.Extended hybrid rendering unit 1010 can be utilized by the mixed signal again that is equal to 1009 generations of sound channel rendering unit and generate expansion sound channel mixed signal again.

Therefore, the 5th signal processing apparatus is in statu quo exported the mixed signal that is transmitted by coding side, mixed signal is outputed to be equal to sound channel again in the mixed signal, or mixed signal is outputed to the expansion sound channel again in the mixed signal.Randomly, use the information that is provided by effector 1011, the hybrid rending unit can give mixed signal various effects again again.

Figure 11 is the block diagram of input media according to an embodiment of the invention, and Figure 12 is the exemplary plot of input media according to an embodiment of the invention.

With reference to Figure 11 and Figure 12, input media 1000 according to an embodiment of the invention and first mixed signal decoding device 500 interconnection again, and comprise first input block (source Menu key) 1110, second input block (the quiet key 1120 of voice), the 3rd input block (voice adjusting key) 1130, the 4th input block (environment adjusting key) 1140, the 5th input block (the first source key 1150a, piano key) 1150, the second source key (violin key) 1150b, directionkeys 1160a, positioning equipment 1160b, numerical key 1170, storage unit 1200, control module 1300 and display 1400.

Because first again mixed signal decoding device 500 have the identical configuration of describing with earlier in respect of figures 5 of the decoding device of mixed signal again, so omit the details of its element in the following description.And the element of input media 1000 will be explained as follows in detail.

At first, first input block (source Menu key) the 1110th, input equipment, its input signal converts menu display commands according to the source to by control module 1300.In this case, according to the menu in source be the image of the source tabulation that is used for showing that the specific blend signal comprises.So, when the menu that shows according to the source, can regulate volume level etc. according to the source.Figure 13 is illustrated in the example images of the image (according to the menu display image in source) that shows afterwards of input first input block (source Menu key).In this case, the menu display image according to the source can be presented on the display 1400 of first interface equipment 550.First input block (source Menu key) 1110 can be realized with triggering type button or touch sensor, pushes the counting iterated command by its basis and carries out or cancellation, and this can not be construed as limiting each realization of the present invention.

Second input block (the quiet key of voice) the 1120th converts its input signal to by control module 1300 input equipment of voice mute command.In this case, the voice mute command is that the energy level of the human speech in the source that comprises of specific blend signal is set to 0 order.Figure 14 is illustrated in the example of importing the image that second input block (the quiet key of voice) shows afterwards.Second input block (the quiet key of voice) 1120 can be realized with triggering type button or touch sensor, pushes the counting iterated command by its basis and carries out or cancellation, and this can not be construed as limiting each realization of the present invention.

The 3rd input block (voice adjusting key) the 1130th converts its input signal to by control module 1300 input equipment of voice energy level regulating command.In this case, the regulating command of voice energy level is rising or the order that reduces the energy level of the human speech in the included source of specific blend signal.Figure 15 is illustrated in the example of importing the image that the 3rd input block (voice adjusting key) shows afterwards.The 3rd input block (voice adjusting key) 1130 is configured to import energy level rising order or energy level reduces order, and available a pair of button, slow motion shuttle, 2 realize that to slow motion button, 2 in touching spool, a pair of touch sensor, touch-wheel etc. the present invention is not limited.

The 4th input block (environment adjusting key) the 1140th converts its input signal to by control module 1300 input equipment of ambient image display command.In this case, ambient image shows the relative position in source included in the specific blend signal, realizes the position in each source to utilize directionkeys 1160a or positioning equipment 1160b.Figure 16 is illustrated in the example of importing the image (ambient image) that the 4th input block (environment adjusting key) shows afterwards.The 4th input block (environment adjusting key) 1140 can be realized with triggering type button or touch sensor, carries out or cancellation according to the compression number iterated command by it, and this can not be construed as limiting each realization of the present invention.

The 5th input block 1150 is the input equipments that its input signal converted to source sound mute command by control module 1300.In this case, sound quiet key in source is the order of forbidding corresponding to the source signal playback of particular instrument.For example, the 5th input block 1150 can comprise the energy level corresponding to the source signal of " piano " almost is set to 0 first source key (piano key) 1150a, or will almost be set to 0 the second source key (violin key) 1150b corresponding to the energy level of the source signal of " violin ".Figure 17 is illustrated in the example of the image that the first source key (piano key) of importing the 5th input block shows afterwards.And Figure 18 is illustrated in the example of the image that the second source key (violin key) of importing the 5th input block shows afterwards.

Each available triggering type button or touch sensor in the first and second source keys of the 5th input block 1150 are realized, carry out or offset according to the compression number iterated command by it, and this can not be construed as limiting each realization of the present invention.

Directionkeys 1160a converts its input signal to the input equipment that is used for the order that direction moves by control module 1300.In this case, under the state that shows according to the menu image in source, being used for the order that direction moves can be specific source energy level regulating command.Perhaps, under the state of display environment image, being used for the order that direction moves can be the position adjustments order of ad-hoc location.Directionkeys 1160a can wait and realize with four buttons, four touch sensors, four-way touch spool, touch-wheels, and each realization of the present invention is not limited thereto.

Positioning equipment 1160b is the input equipment that its input signal is converted to the order that is used for the position appointment by control module 1300.Be similar to directionkeys 1160a, under the state of demonstration according to the menu image in source, the order that is used for the position appointment can be the order of particular source energy level.Perhaps, under the state of display environment image, the order that is used for the position appointment can be the position adjustments order of particular source.And positioning equipment 1160b can use mouse, tracking ball, touch pad, touch-screen, touch panel realizations such as (input pens), and each realization of the present invention is not limited thereto.

Numerical key 1170 is the input equipments that its input signal converted to the order that is used for the numeral input by control module 1300.In this case, under the state that shows according to the menu image in source or ambient image, the order that is used for the numeral input can be the order that is used to select mate the particular source of respective digital.For example, show in the situation of " 1. voice, 2. piano, 3. violin, 4. flute " on according to the menu image in source that " the key #3 " if of user-selected number keyboard 1170, then " violin " of coupling numeral 3 is selected.Numerical key 1170 can wait and realize with 10 buttons, 10 touch sensors, touch panels, and each realization of the present invention is not limited thereto.

Various types of command informations according to key are stored in the storage unit 1200.In this case, represent each input block (first input block 1110, second input block 1120 etc.) (included numerical key 1170) according to the command information of key and corresponding to the order of input block (according to the menu display commands in source, voice mute command etc.).Simultaneously, the user makes according to the command information of key and can store in new ways or revise by the shortcut enrollment process.And, will explain the details of shortcut enrollment process with reference to Figure 22 after a while.In addition, can further be stored in the storage unit 1200 about the data of regulating image, environment adjusting image etc. according to the quiet image of menu image, voice, the voice in source.

Control module 1300 will convert corresponding order from the input signal of each reception input block 1110,1120,1130,1140 and 1150 to based on each command information according to key of being stored in the storage unit 1200.Particularly, control module 1300 will convert the menu display commands according to the source via the input signal that first input block 1110 receives to.Control module 1300 will convert the voice mute command to via the input signal that second input block 1120 receives, then based on the control information 506 of voice mute command output about mixed signal.Control module 1300 will convert the regulating command of voice energy level to via the input signal that the 3rd input block 1130 receives.Control module 1300 will convert the ambient image display command to via the input signal that the 4th input block 1140 receives.And control module 1300 will convert source sound mute command to via the input signal that the 5th input block 1150 receives.

According to input via input block 1110,1140 etc., control module 1300 based on from first again the source information (si) that receives of mixed signal decoding device 500 interface image can be shown.For example, in via the situation of first input block, 1110 inputs according to the menu display commands in source, control module 1300 shows on display 1400 based on the menu of source information (si) control according to the source.In the situation via the 4th input block 1140 input environment image display command, control module 1300 shows based on the source signal information (si) corresponding with the mixed signal image that controls environment.

Based on the order via input block 1120,1130,1140 etc., control module 1300 outputs are about the control information 506 of mixed signal, control this control information 506 then and are imported into the first mixed signal decoding device 500 again.In above description, described control information 506, and omitted its details in the following description with reference to figure 5.Particularly, under the state of demonstration according to the menu image in source on the display, control module 1300 will convert the energy level regulating command according to the source via the input signal that positioning equipment 1160b or directionkeys 1160a receive to.Under the state of display environment image on the display, control module 1300 will convert the environment regulating command to via the input signal that positioning equipment 1160b or directionkeys 1160a receive.In the process that input signal is converted to corresponding order, control module 1300 can reference memory unit 1200 in the command information according to key of storage.And control module 1300 can be based on through order (for example, according to the energy level regulating command in source, the environment regulating command etc.) output of the conversion control information 506 about mixed signal.

Display 1400 is the display devices that show menu image according to the source, ambient image etc. under the control of control module 1300 thereon.In addition, can be presented on the display 1400 having imported each image (in Figure 14, Figure 15, Figure 17, Figure 18 etc.) that input block (first input block 1110 etc.) shows afterwards.

Figure 19 is the block diagram of input media according to another embodiment of the invention.

With reference to Figure 19, the input media 2000 according to another embodiment of the invention (being called " input media 2000 " hereinafter) and first mixed signal decoding device 500 and 550 interconnection of first interface equipment again.And this input media 2000 comprises first input block (source Menu key), 2110, second input block (the quiet key of voice) the 2120, the 3rd input block (voice adjusting key) the 2130, the 4th input block (environment adjusting key) the 2140, the 5th input block (the first source key 2150a (piano key)), 2150, the second source key (violin key) 2150b, directionkeys 2160a, positioning equipment 2160b, numerical key 2170, storage unit 2200, control module 2300, display 2400 and wireless communication unit 2500.Except that control module 2300 and wireless communication unit 2500, the element with same names that these elements and earlier in respect of figures 11 and Figure 12 describe omits its details much at one in the following description.

First again mixed signal decoding device 500 have the identical configuration of describing with earlier in respect of figures 5 of the decoding device of mixed signal again, so omit its details in the following description.

Simultaneously, first interface equipment 550 is the equipment that the interface is provided to input media 2000.And first interface equipment 550 comprises wireless communication unit 552, storage unit 554, interface control unit 556 and display unit 558.

The wireless communication unit 552 of first interface equipment 550 is the equipment that carries out radio communication with input media 2000.In this case, wireless communication unit 552 adopts one of various communication systems such as infrared communication system.In storage unit 554, can store about regulate the data of image, environment adjusting image etc. according to the quiet image of menu image, voice, the voice in source.Interface control unit 556 is based on from first source information (si) the display interface image that receive of mixed signal decoding device 500 again.And, interface control unit 556 based on the order that receives from input equipment 2000 to first mixed signal decoding device 500 input control informations 506 again.Described control information 506, will omit its details in the following description with reference to figure 5.Display 558 is display devices of display interface image thereon under the control of interface control unit 556.If input media 200 is provided with display 2400, display 558 optional elements of first interface equipment 550 then.

Control module 2300 in the respective element of description below input media 200 and wireless communication unit 2500.

At first, control module 2300 will convert the menu display commands according to the source via the input signal that first input block 2110 receives to.Control module 2300 will convert the voice mute command to via the input signal that second input block 2120 receives.Control module 2300 will convert the regulating command of voice energy level to via the input signal that the 3rd input block 2130 receives.Control module 2300 will convert the ambient image display command to via the input signal that the 4th input block 2140 receives.And control module 2300 will convert source sound mute command to via the input signal that the 5th input block 2150 receives.Under the state of demonstration according to the menu image in source on the display, control module 2300 will convert the energy level regulating command according to the source via the input signal that positioning equipment 2160b or directionkeys 2160a receive to.Under the state of display environment image on the display, control module 2300 will convert the environment regulating command to via the input signal that positioning equipment 2160b or directionkeys 2160a receive.In that above-mentioned input signal converts in the process of corresponding order with each, control module 2300 stored in can reference memory unit 2200 according in the command information of key each.

Wireless communication unit 2500 will send to external unit (first interface equipment 550 particularly) by the order of control module 2300 conversions.Send about in according to the data of the menu image in source or the situation about the data of ambient image at first interface equipment 550, wireless communication unit 2500 receives the data that sent.

Figure 20 is second block diagram of mixed signal decoding device and second contact surface equipment again that interconnects to input media according to an embodiment of the invention.

With reference to Figure 20, input media 1000 is interconnected to the first mixed signal decoding device 500 again.Because described the first mixed signal decoding device 500 again, so omit its details in the following description with reference to figure 5.Second contact surface equipment 750 is not from the first mixed signal decoding device 500 but from the second mixed signal decoding device 700 reception sources information (si) more again.And, all the other elements 752,754,756 and 758 of second contact surface 750 respectively with the element 552,554,556 and 558 of front first interface equipment 550 much at one, omit its details in the following description.

Figure 21 is second block diagram of mixed signal decoding device and second contact surface equipment again that interconnects to input media according to another embodiment of the invention.

With reference to Figure 21, input media 2000 is interconnected to second mixed signal decoding device 700 and the second contact surface equipment 750 again.Because described the second mixed signal decoding device 700 again, so omit its details in the following description with reference to figure 7.Second contact surface equipment 750 is not from the first mixed signal decoding device 500 but from the second mixed signal decoding device 700 reception sources information (si) more again, then control information 708 is input to the second mixed signal decoding device 700 again.And, all the other elements 752,754,756 and 758 of second contact surface 750 respectively with the element 552,554,556 and 558 of front first interface equipment 550 much at one, omit its details in the following description.

Figure 22 is the process flow diagram according to the input method of the embodiment of the invention.

With reference to Figure 22, if the user selects the shortcut registration, then input media receives shortcut registration command [S 110].Figure 23 is illustrated in the example of importing the image that shows after the shortcut registration command.Subsequently, the user selects the key (for example, key #1) [S120] as shortcut from a plurality of keys that offer input media.Input media shows the source tabulation [S130] that can be used for mixed signal.For example, each source that can be used for mixed signal comprise voice audio signals, according to the sound signal (voice, piano, violin, flute etc.) of musical instrument.If like this, then the user is by selecting a source [S140] of selecting to mate shortcut from the tabulation of source.For example, the user can select piano.Subsequently, the user selects a function (for example, sound is quiet) to be used for shortcut from least one or a plurality of function (for example, sound is quiet, environment adjusting etc.).Therefore, if the user selects this key, this source and this function via step S120, S140 and S150, then input media is stored as shortcut information [S160] with selected key, selected source and selected function.For example, input media is stored them in the mode of the sound mute command of piano signal being mated key #1.If like this, then in the situation of enter key #1, input media converts the input signal of key #1 to the sound mute command of piano signal.

Figure 24 is the block diagram of interface display apparatus according to an embodiment of the invention, and Figure 25 A and Figure 25 B are the exemplary plot of the realization of interface display apparatus according to an embodiment of the invention.

With reference to Figure 24, Figure 25 A and Figure 25 B, interface display apparatus according to an embodiment of the invention 300 is interconnected to the first mixed signal decoding device 500 again.And interface display apparatus 3000 comprises input block 3100, control module 3200, the first display 330a and the second display 3300b.In this case, first again mixed signal decoding device 500 comprise supplementary decoding unit 503 and hybrid rending unit 505 again, and have the decoding device of mixed signal again configuration and the function of describing with earlier in respect of figures 5 much at one, therefore omit its details in the following description.

Input block 3100 is input equipments of selecting one of a plurality of mixed signals.In this case, mixed signal can comprise the sound signal of describing with reference to figure 5 501 according to sound channel.Mixed signal 501p that is selected from a plurality of mixed signals by input block 3100 and the auxiliary information signal 502p of mixed signal 501p are imported into the first mixed signal decoding device 500 again.Input block 3100 can be configured to select one of source included in the mixed signal, and can further be arranged to import order that the energy level that is used for source signal regulates, the energy level according to sub-band that is used for source signal regulates the order of (balanced device adjustings) and is used for the order of the environment adjusting of source signal.Input block 3100 usable direction keys, touch-wheel etc. and realize such as positioning equipments such as mouse, tracking ball, touch pads.And, will also be understood that input block 3100 can realize with the telepilot that uses the radio communication such as infrared communication.

Control module 3200 inquiries are corresponding to the source signal information (si) of the mixed signal 501p of input block 3100 selections, based on source signal information (si) source of configuration signal tabulation (being called the source tabulation hereinafter), demonstration source tabulation on the first display 3300a then.In this case, source signal information (si) is the information about the source signal that comprises among the input block 3100 selected mixed signal 501p, and can be the information that comprises the musical instrument title etc. of each source signal.In addition, source signal information (si) can be the information about the source signal 102 of earlier in respect of figures 1 description.Simultaneously, source signal information (si) can further comprise metadata (Instrumentalist's name, making date etc.).Simultaneously, source signal information (si) can be from first information that receives of the supplementary decoding unit 203 of mixed signal decoding device 500 again by control module 3200.In this case, source tabulation can comprise at least one in musical instrument title, singer's title and the characteristic of source signal 502p.

In the situation that receives from input block 3100 about one of decomposite various command (order that the order that the energy level according to sub-band that be used for order that the energy level of source signal regulates, is used for source signal is regulated, the environment that is used for source signal are regulated), control module 3200 becomes corresponding command conversion control information 506, is entered into hybrid rending unit 505 more then.In this case, control information that control information 506 can be described with earlier in respect of figures 5 or the control information of describing with reference to figure 6 608 are identical, therefore should will omit its details in the following description.

The first display 3300a is the display of demonstration source tabulation thereon under the control of control module 3200.When selecting mixed signal, the first display 3300a is gone up the source tabulation that shows keep being presented on the first display 3300a.In this case, " when selecting mixed signal " expression " selected mixed signal is played or mixing (energy level adjusting, environment adjusting etc.) again ".If the user selects different mixed signals, then on the first display 3300a, show the source tabulation of the mixed signal that coupling is different.In this case, the first display 3300a can realize that each realization of the present invention is not limited thereto with the matrix of LCD (LCD) or a large amount of luminescent devices.In the situation that the first display 3300a realizes with a large amount of luminescent devices, can come the tabulation of demonstration source by a large amount of luminescent devices that glimmer.

The second display 3300b is the display that display element data on it, volume level are regulated image, balanced device adjusting image, environment adjusting image etc.Figure 26 to 29 is illustrated in the example images that shows respectively when selecting particular source on first or second display.In Figure 26, select to be illustrated in the situation that the second display 3300b goes up the metadata that shows selected source (1. voice) the situation of " 1. voice " in the source tabulation that shows from the first display 3300a.In Figure 27, be illustrated in the situation that the second display 3300b goes up the volume level adjusting image that shows selected source (1. voice).In Figure 28, be illustrated in the second display 3300b and go up the situation that the balanced device that shows selected source (3. violin) is regulated image (energy level according to sub-band is regulated image).In Figure 29, be illustrated in the situation that the second display 3300b goes up the environment adjusting image that shows selected source (2. piano).Figure 26 to 29 is compared mutually, keep changing, also can be observed the source tabulation and keep being presented on the first display 3300a even the second display 3300b goes up the image that shows.

Simultaneously, because the second display 3300b and the first display 3300a do not need mechanically or be separated from each other textural, can realize with single panel so should be appreciated that the second display 3300b and the first display 3300a.

Figure 30 is the block diagram of interface display apparatus according to another embodiment of the invention.

With reference to Figure 30, interface display apparatus 4000 according to another embodiment of the invention comprises input block 4100, control module 4200, the first display 4300a and the second display 4300b, and is interconnected to the second mixed signal decoding device 700 again.In this case, second again mixed signal decoding device 700 comprise that supplementary decoding unit 703, supplementary unify unit 705 and hybrid rending unit 707 again.And, second again mixed signal decoding device 700 have second mixed signal decoding device configuration and the function of describing with earlier in respect of figures 7 much at one again, so omit its details in the following description.

Simultaneously, interface display apparatus 4000 is according to another embodiment of the invention compared with front interface display apparatus 4000 according to an embodiment of the invention, difference only is that it interconnects to second mixed signal the decoding device 700 rather than first mixed signal decoding device 500 more again, also is to import synthetic object signal 701p rather than mixed signal 501p.Therefore element with same names 4100,4200,4300a and the 4300b of its respective element 4100,4200,4300a and 4300b and front interface display apparatus 4100 according to an embodiment of the invention omit its details much at one in the following description.

Figure 31 is the process flow diagram according to the interface display method of the embodiment of the invention.The term of Shi Yonging " mixed signal " should be understood to include the notion of synthetic object signal at first, in the following description.And interface display method can be implemented by interface display apparatus 3000 according to an embodiment of the invention or other interface display apparatus 2000 according to another embodiment of the invention according to an embodiment of the invention.

With reference to Figure 31, interface display apparatus shows that on display this information has been stored maybe and can have been sent about the tabulation [S210] as mixed signal of the information of at least one or a plurality of mixed signals.If like this, the user utilizes input equipment to select will play or decomposite specific blend signal [S220] from the mixed signal tabulation that shows at step S210.If like this, interface display apparatus is from corresponding to the source signal information of extracting the supplementary of the mixed signal of selecting at step S220 corresponding to mixed signal.Then, interface display apparatus is from extracting the source signal information [S230] corresponding to mixed signal corresponding to the supplementary of the mixed signal of selecting at step S220.

Interface display apparatus is based on the source signal information configuration source tabulation of extracting at step S230.Subsequently, interface display apparatus demonstration source tabulation [S250] on first display.

The source tabulation that shows on customer inspection first display is selected one [S260] then from the tabulation of source.If like this, then interface display apparatus is presented at the metadata (regulating image, balanced device adjusting image, environment adjusting image etc. according to the volume level that is provided with) in the source of step S260 selection on second display.

Subsequently, after the selection of the mixed signal that step S220 selects is finished (for example, when the user stops the playback of corresponding mixed signal or selects another mixed signal), be to stop [S290] from being shown in of source tabulation that step S250 begins.

Figure 32 is the block diagram of interface display apparatus according to an embodiment of the invention.

With reference to Figure 32, interface display apparatus 5100 according to an embodiment of the invention comprises input block 5110, storage unit 5120, control module 5130 and display 5140, and is interconnected to the first mixed signal decoding device 500 again.In this case, first again mixed signal decoding device 500 comprise supplementary decoding unit 503 and hybrid rending unit 506 again.And, first again mixed signal decoding device 500 have first mixed signal decoding device configuration and the function of describing with earlier in respect of figures 5 much at one again, so omit its details in the following description.

Input block 5110 is input equipments of selecting one of a plurality of mixed signals.In this case, mixed signal can comprise the mixed signal (according to the sound signal of sound channel) 501 that earlier in respect of figures 5 is described.Mixed signal 501p that is selected from a plurality of mixed signals by input block 5110 and the auxiliary information signal 502p of selected mixed signal 501p are imported into the first mixed signal decoding device 500 again.The order that order that the energy level according to sub-band that input block 5110 can be configured to import order that the energy level that is used for source signal regulates, be used for source signal is regulated and the environment that is used for source signal are regulated.Input block 5110 usable direction keys, touch-wheel etc. and realize such as positioning equipments such as mouse, tracking ball, touch pads.And input block 5110 can be realized such as the telepilot of radio communications such as infrared communication with using certainly.

Storage unit 5120 is memory devices of wherein storing according to the view data of icon.Particularly, category and the key word corresponding to icon can be stored in the storage unit 5120 together.And, utilizing view data, icon not only can be represented as text also can be represented as image.

Control module 5130 inquiries are corresponding to the source signal information (si) of the mixed signal 501p that is selected by input block 5110, then based on the icon of source signal information (si) demonstration corresponding to source signal.In this case, source signal information (si) is the information about the source signal that comprises among the input block 5110 selected mixed signal 501p, and can be the information that comprises the musical instrument title etc. of each source signal.In addition, source signal information (si) can be the information about the source signal 102 of earlier in respect of figures 1 description.Simultaneously, source signal information (si) can further comprise metadata (Instrumentalist's name, singer name etc.).Simultaneously, source signal information (si) can be from first information that receives of the supplementary decoding unit 203 of mixed signal decoding device 500 again by control module 5130.

Simultaneously, utilize in the storage unit 5120 view data of storage, also can be represented as text or image corresponding to the icon of source signal.

In the situation that receives from input block 5110 about one of decomposite various command (order that the order that the energy level according to sub-band that be used for order that the energy level of source signal regulates, is used for source signal is regulated, the environment that is used for source signal are regulated), control module 5130 becomes corresponding command conversion control information 506, is entered into hybrid rending unit 505 more then.In this case, control information that control information 506 can be described with earlier in respect of figures 5 or the control information of describing with reference to figure 6 608 are identical, therefore will omit its details in the following description.

And display 5140 is the display devices that show thereon under the control of control module 5130 corresponding to the icon of source signal.

Figure 33 A to Figure 33 D is the exemplary plot of the realization of interface display apparatus according to an embodiment of the invention.

At first, Figure 33 A illustrates interface display apparatus according to an embodiment of the invention, and it is loaded into first in the portable terminal again in the fuselage of mixed signal interface equipment 500.Input block 5110 usefulness that Figure 33 B illustrates interface display apparatus 5100 according to an embodiment of the invention are connected to the first mouse realization of mixed signal decoding device 500 again by lead or felt pen.And, can be observed display 5140 and be and as input block 5110, be wired to first monitor of mixed signal decoding device 500 again.Figure 33 D illustrate input equipment 5110 usefulness with first again mixed signal decoding device 500 telepilot that carries out radio communication realize, although the display 5140 of interface display apparatus according to an embodiment of the invention 5100 is wired to the first mixed signal decoding device 500 again.With reference to Figure 33 D, the situation that can be observed input block 5110 similar Figure 33 C of interface display apparatus 5100 according to an embodiment of the invention realizes with telepilot.And, also observe display 5140 and be provided with telepilot.Therefore, interface display apparatus 5100 according to an embodiment of the invention and first again mixed signal decoding device 500 can be implemented as various configurations.

Figure 34 is the block diagram of interface display apparatus according to another embodiment of the invention.

With reference to Figure 34, interface display apparatus 5200 according to another embodiment of the invention comprises input block 5210, storage unit 5220, control module 5230 and display 5240, and is interconnected to the second mixed signal decoding device 700 again.In this case, second again mixed signal decoding device 700 comprise that supplementary decoding unit 703, supplementary unify unit 705 and hybrid rending unit 707 again.And, second again mixed signal decoding device 700 have second mixed signal decoding device configuration and the function of describing with earlier in respect of figures 7 much at one again, so omit its details in the following description.

Simultaneously, interface display apparatus 5200 is according to another embodiment of the invention compared with front interface display apparatus 5100 according to an embodiment of the invention, difference only is that it interconnects to second mixed signal the decoding device 700 rather than first mixed signal decoding device 500 more again, also is to import synthetic object signal 701p rather than mixed signal 501p.Its respective element 5210,5220,5230 and 5240 and the element with same names 5100,5120,5130 and 5140 of front interface display apparatus 5110 according to an embodiment of the invention much at one, therefore omit its details in the following description.

Figure 35 A and Figure 35 B are the process flow diagrams of interface display method according to an embodiment of the invention.The term of Shi Yonging " mixed signal " should be understood to include the notion of synthetic object signal at first, in the following description.And interface display method according to an embodiment of the invention can be implemented by interface display apparatus 5100 according to an embodiment of the invention or other interface display apparatus 5200 according to another embodiment of the invention.

With reference to Figure 35 A, interface display apparatus shows that on display this information has been stored maybe and can have been sent about the tabulation [S410] as mixed signal of the information of at least one or a plurality of mixed signals.If like this, the user utilizes input equipment to select to play or to know the specific blend signal [S420] of its source signal information from the mixed signal tabulation that shows at step S410.If like this, then interface display apparatus is from corresponding to the source signal information of extracting the supplementary of the mixed signal of selecting at step S420 corresponding to mixed signal.Then, interface display apparatus is from extracting the source signal information [S430] corresponding to mixed signal corresponding to the supplementary of the mixed signal of selecting at step S420.In the metadata of mixed signal was included in situation in the source signal information that step S430 extracts, interface display apparatus extracted metadata [S440] from source signal information.

Subsequently, interface display apparatus is based on the icon [S450] of the source signal information query of extracting at step S430 corresponding to source signal.In this case, icon usable text or image configurations.Extract in the situation of metadata at step S440, can inquire the image of the metadata that coupling is extracted.Icon in step S450 inquiry is presented at [S460] on the display then.Figure 36 A illustrates on it example that shows according to the screen of the icon of the source signal of specific blend signal.With reference to Figure 36 A, comprise that in source signal information the icon that corresponds respectively to piano, violin, singer (women), flute shows in the situation of " piano, violin, singer (women), flute " on screen.Therefore, by interface display method according to an embodiment of the invention, show the icon of specific blend signal by step S410 to S450.Figure 36 B illustrates wherein the example according to the image of the icon representation metadata of the source signal of specific blend signal.With reference to Figure 36 B, metadata included in source signal information comprises in " pianist: Chung Myung-Hoon " and " singer's: ChoSoo-Mee " the situation, comprises the photo of Chung Myung-Hoon and comprises the photo of Cho Soo-Mee corresponding to the icon of singing music corresponding to the icon of piano.

In the following description, explain in execution by the specific process afterwards in the icon of above-mentioned steps demonstration.

With reference to Figure 35 B, if the user is chosen in one of icon that step S450 shows, imports fill order to special icon then, then interface display apparatus receives the fill order [S510] to selected icon.To the fill order of icon, promptly the process of implementing in the situation of execution icon can be according to setting and difference.And, three kinds of situations of description below (energy level adjusting, balanced device adjusting, environment are regulated).

Be configured to energy level in the fill order of icon and regulate in the situation of (volume adjustings) and (in step S520, be "Yes"), show energy level adjusting image [S522] corresponding to the source signal of the icon of carrying out among the step S510.Figure 37 A is the exemplary plot that energy level is regulated image.With reference to Figure 37 A, in the situation that " flute " icon in four icons altogether is performed, the control lever that can regulate the energy level (volume) of flute is displayed on the screen.The user can be by utilizing the positioning equipment on the screen shown in Figure 37 A or utilizing the mobile control levers such as directionkeys of keyboard to import the order of regulating at the energy level of particular source signal (for example, flute).In case receive the order of regulating at energy level (being "Yes" in step S524), the shape of icon just changes [S526] according to the energy level of being regulated.In this case, the shape of icon is corresponding at least one the notion that comprises in shape, color and the brightness.Figure 37 B is the exemplary plot of image of revising the shape of icon on it according to the energy level through regulating.With reference to Figure 37 B, when the energy level of flute is adjusted to when high, the size that can be observed corresponding to the icon of flute increases.Subsequently, be converted to control information, mixed [S550] again in the mixed signal that step S420 selects by energy level regulating command with step S524 input.In this case, control information is to be imported into first mixed signal interface equipment or second information of mixed signal decoding device more again, and has made an explanation in the description of interface display apparatus according to an embodiment of the invention.So, will omit its details in the following description.

Be configured to balanced device in the fill order of icon and regulate in the situation of (energy level according to sub-band is regulated) and (in step S530, be "Yes"), show that the energy level of the source signal of the icon of carrying out corresponding to step S510 is regulated image [S532].Figure 38 is the exemplary plot of balanced device image (regulating image according to the sub-band energy level).In Fig. 3, be illustrated in altogether in the situation that " piano " in four icons be performed, wherein show screen, to regulate the balanced device of piano according to the control lever of sub-band.The user can import the order of regulating according to the sub-band energy level at particular source signal (for example piano) to utilize positioning equipment to move according to the mode of sub-band control lever on screen shown in Figure 38.In case receive at the order of regulating according to the sub-band energy level (being "Yes" in step S534), the shape of icon is just according to the partly change of being regulated [S536] according to the sub-band energy level.For example, in the situation that the energy level of low-frequency band is raised, can grow dark gradually corresponding to the brightness of the part of icon left part.Subsequently, be converted to control information according to the regulating command of sub-band energy level, mixed [S550] again in the mixed signal that step S420 selects by what step S534 was imported.

Be configured to environment in the fill order of icon and regulate in the situation of (relative position adjustings) and (in step S540, be "Yes"), show the environment adjusting image (relative position adjusting image) [S542] of the source signal of the icon of carrying out corresponding to step S510.Figure 39 is the exemplary plot that environment is regulated image (relative position adjusting image).In Figure 39, be illustrated in execution altogether in the situation of " piano " icon in four icons, the screen that shows the relative position of piano on it is shown, so that the environment of piano can be conditioned.The user can import the order of regulating at the environment of particular source signal (for example, piano) by using mobile icons such as positioning equipment on the screen shown in Figure 39, directionkeys.In case receive the order of regulating at environment (being "Yes" in step S544), the shape of icon just changes [S546] according to the environment of being regulated.For example, in the situation of relative position through regulating of source signal, can increase the brightness of corresponding icon near user's (audience) position.Subsequently, be converted to control information, mixed [S550] again in the mixed signal that step S420 selects by the environment regulating command that will import among the step S544.

Figure 40 is the block diagram of interface display apparatus according to still another embodiment of the invention.

With reference to Figure 40, interface display apparatus 6100 according to still another embodiment of the invention comprises input block 6110, storage unit 6120, control module 6130 and display 6140, and is interconnected to the first mixed signal decoding device 500 again.In this case, first again mixed signal decoding device 500 comprise supplementary decoding unit 503 and hybrid rending unit 506 again.And, first again mixed signal decoding device 500 have first mixed signal decoding device configuration and the function of describing with earlier in respect of figures 5 much at one again, so omit its details in the following description.

Input block 6110 is input input equipments at the playback command of mixed signal.And, input block 6110 usable direction keys, touch-wheel etc. and realize such as positioning equipments such as mouse, tracking ball, touch pads.

Storage unit 6120 is memory devices of wherein storing according to the image of source signal.For example, can in storage unit 6120, store according to musical instrument image (piano image, violin image, flute image etc.) and according to player's photo (photo of the photo of Chung Myung-Hoon, Cho Soo-Mee etc.).

The mode that control module 6130 changes by the time when changing by the time according to the energy level corresponding to the source signal of mixed signal is controlled the shape of the image of the source signal that will show.In this case, image can comprise based on from first again mixed signal decoding device 500 supplementary coding unit 503 or again the source signal information (si) that receives of hybrid rending unit 505 from the image according to source signal of storage unit 6120 inquiries.And, can be from being received from first energy level by the time of extraction source signal the source signal energy level information (si) of the unit of hybrid rending again 505 of mixed signal decoding device 500 again.

For example, total reproduction time corresponding to 3 minutes 45 seconds situation in, at each energy level of each second detection resources signal (piano, violin, flute) from play start time (t=0 divided 0 second) to the time that finishes playing (t=3 divided 45 seconds), and the shape of correspondence image (piano image, violin image, flute image) (position in size, color, brightness, the image etc.) is so change the ground demonstration.In the high situation of the energy level of specific timing point piano (violin etc.), can increase the size of piano image (violin image etc.).In the high situation of the energy level of specific timing point piano (violin etc.), can increase the brightness of piano image (violin image etc.).

And display 6140 is the display devices that show on it corresponding to the image of source signal.

Figure 41 is the block diagram of interface display apparatus according to still a further embodiment.

With reference to Figure 41, interface display apparatus 6200 according to still a further embodiment comprises input block 6210, storage unit 6220, control module 6230 and display 6240, and is interconnected to the second mixed signal decoding device 700 again.In this case, second again mixed signal decoding device 700 comprise that supplementary decoding unit 703, supplementary unify unit 705 and hybrid rending unit 707 again.And, second again mixed signal decoding device 700 have second mixed signal decoding device configuration and the function of describing with earlier in respect of figures 7 much at one again, so omit its details in the following description.

Simultaneously, interface display apparatus 6200 is according to still a further embodiment compared with front interface display apparatus 6100 according to still another embodiment of the invention, difference only is that it interconnects to second mixed signal the decoding device 700 rather than first mixed signal decoding device 500 more again, also is to import synthetic object signal 701 rather than mixed signal 501.Therefore the element of its respective element and front interface display apparatus 6100 according to still another embodiment of the invention omits its details much at one in the following description.

Figure 42 is the process flow diagram of interface display method according to another embodiment of the invention.The term of Shi Yonging " mixed signal " should be understood to include the notion of synthetic object signal at first, in the following description.And the interface display apparatus 6100 that interface display method according to an embodiment of the invention can be by according to still another embodiment of the invention or other interface display apparatus 6200 are according to still a further embodiment implemented.

With reference to Figure 42, if the user utilizes the playback command of input equipment input at the specific blend signal, then interface display apparatus receives the order of being imported [S610].Subsequently, interface display apparatus receives the source signal information [S620] corresponding to mixed signal.Interface display apparatus is then based on the image [S630] of the source signal information query that receives in step S620 corresponding to each source signal.

Subsequently, if the playback of mixed signal begins (in step S640 for "Yes"), then interface display apparatus detects source signal energy level corresponding to the source signal of the mixed signal energy level of sub-band (or according to) by the time.Subsequently, according to the energy level of being inquired in step S640 (according to the energy level of sub-band), interface display apparatus changes and is presented at the shape (position in size, color, brightness, the screen etc.) of the image of inquiring among the step S630.Figure 43 is the exemplary plot of the screen that changes pro rata of the energy level of the size of its epigraph and source signal.Observe the image size among Figure 43, if current reproduction time is " t1 ", can be observed then that each energy level of musical instrument is low except that women singer, and women singer's energy level is a height according to object.If current reproduction time is " t2 ", then can be observed the energy level that women singer's energy level only is lower than all the other musical instruments.If current reproduction time is " t3 ", the energy level that then can be observed only women singer and piano is for high.Figure 44 is the exemplary plot of the screen that changes pro rata of the energy level of the brightness of its epigraph and source signal.With reference to Figure 44, be the timing point of t1, t2 or t3 in the current time, can be observed according to the various variations of the brightness of image of object and change according to the energy level of source signal.

Simultaneously, can change size according to the variation of the energy level of source signal corresponding to the image of source signal.Particularly, only be presented at the image that specific timing point has the source signal of high level, and be made as 0 and do not show the image of all the other source signals by size with all the other source signals.Figure 45 and Figure 46 are the exemplary plot that only shows the screen of the image that has high level in the source signal on it.With reference to Figure 45, when playing beginning back reproduction time and be t1, the energy level of piano in four source signals altogether for the highest.Therefore, can observe the picture drop-out of other source signal (violin, singer, flute) and only piano image (photo of pianist ChungMyung-Hoon) be presented on the screen.When reproduction time is t2, singer's (women) energy level in four source signals altogether for the highest.Therefore, only can observing, singer (women) image (photo of singer Cho Soo-Mee) shows on screen.With reference to Figure 46, during t1 after reproduction time is to play beginning, in the middle of the 3rd image that can observe the singer who is in high level is placed in.When reproduction time is t2, in the middle of first image that can observe the singer who is in high level is placed in.

In the situation that image changes according to the energy level according to sub-band of source signal, can partly change the shape of the image of source signal.For example, transverse axis by making image corresponding to the frequency axis of source signal and the Z-axis that also makes source signal corresponding to the energy level axle, if if the energy level of low-frequency band be high and the energy level of high frequency band for high, then the left part list of image is shown thin and the right part list of image is shown slightly.More than step S650 of Xie Shiing and S660 continue to stop [S670] up to the playback of mixed signal.

Can provide mixed information again to the user by the server (be called again mixed information hereinafter server is provided) that is used to provide mixed information.Mixed information provides server can provide in the mode of getting rid of some source signal from the mixed signal that comprises multiple source signals through revising mixed signal again.Particularly, suppose that mixed signal comprises multiple source signals, mixed information provides server that modified mixed signal can be provided again, and at least one in the source signal of formation mixed signal got rid of from this modified mixed signal.Hereinafter, get rid of some source signal by the multiple source signals from be included in the original mixed signal and the mixed signal that generates is called as modified mixed signal to distinguish mutually with the original mixed signal.Provide in the situation that server provides modified mixed signal at mixed information again, the user can receive and listen to modified signal before receiving mixed signal.After the modified mixed signal of user's uppick,, then can provide server requests to send original mixed signal to mixed information again comprising institute's active signal if the user attempts listening to the original mixed signal of therefrom having got rid of arbitrary source signal.

Mixed information provides server to provide free mixed information again to the user again, or the partly or entirely mixed information again of charge can be provided to the user.Provide server to provide in the situation of mixed information again of charge to the user at mixed information again, the user pays, receives accordingly then mixed information again for mixed information again.Mixed information provides server to provide the free modified mixed signal or the original mixed signal of charge to the user again.Followingly explain modified mixed signal that user wherein provides server to receive to generate by getting rid of some source signal from mixed signal from mixed information again, use the method for the modified mixed signal that is received then with reference to Figure 47 to 52, and the method for wherein when mixed information again provides the mixed information again that server provides paying, paying.

Figure 47 is the synoptic diagram that system is provided according to the mixed information again of the embodiment of the invention.

With reference to Figure 47, mixed information provides that system comprises user terminal 7001, mixed information provides server 7002, banking institution 7003 and mobile communication service provider 7004 more again.

The user need mixed signal or source signal and about the supplementary of source signal so that mix source signal again.User's hybrid parameter that the blind hybrid parameter that supplementary comprises the scrambler hybrid parameter that generated by encoding device, generated by decoding device, the control information that utilizes the user to import generate etc.

The user can be by regulating source signal included in decomposite mixed signal via the icon of each source signal of adjustings such as user interface (not shown) expression included in the user terminal 7001.The user can change the feature of the size of source signal or position, sound etc. in the mode of the icon of regulating the expression source signal.Icon can comprise Emoticons (emoticon), singer or the Instrumentalist's of the human sensation of expression the photo of photo, musical instrument or picture etc.In the following description,---comprise the source signal of mixed signal, each sound source, according to the extended hybrid parameter of the hybrid parameter of source signal control mixed signal, extended hybrid mixed signal, be used to represent the icon of source signal etc.---is called as mixed information again to mix one group of required information of mixed signal again according to source signal.

The user utilizes user terminal 7001 to visit mixed information again server 7002 is provided.In this case, user terminal 7001 comprise can carry out wire/wireless communication with other user terminal and can also generate mixed signal such as user PC (kneetop computer, desktop computer etc.), portable terminal (mobile phone etc.), PDA (personal digital assistant), PMP equipment such as (portable multimedia players).

User terminal 7001 selects to provide from mixed information the more specific mixed information again of server 7002.Again the mixed information mixed information again that provides server 7002 in the database (not shown), to search for to select by the user, extract the mixed information again that searches then.Mixed information provides server 7002 that the mixed information again that is extracted is sent to user terminal again.

Mixed information provides server 7001 that the modified mixed signal that is generated by source signal eliminating predetermined origin signal included in the specific part included or mixed signal from mixed signal can be provided again.For example, if the user attempts listening to the Piano Trio " Memory of Great Artist " (great artistical memory) that is utilized piano, violin and violoncello by tchaikovsky's composition, then the user can listen to modified mixed signal before listening to its mixed signal.Provide in the situation of modified mixed signal of server 7002 request Piano Trios " Memory of Great Artist " to mixed information again the user, mixed signal provides server 7002 to extract modified mixed signal from database again, " the Memory of Great Artist " that has promptly therefrom got rid of the violoncello signal sent to the user with what provide through revising mixed signal then.In the modified mixed signal of " Memory of Great Artist " is not stored in situation in the database, mixed information provides server mixed signal to be modified as various forms by getting rid of the included predetermined origin signal (that is, piano signal, violin signal, violoncello signal) of mixed signal again.

Mixed information provides the server 7002 can be to get rid of the mode of particular source signal at random or to ask to generate modified mixed signal according to the user from the included source signal of mixed signal again.If user request generates modified mixed signal by getting rid of the piano signal from the included source signal of mixed signal, then again the mixed information modified mixed signal that provides server to generate only to comprise violin and violoncello signal, then the signal that is generated is sent to the user.

The user provides server 7002 to receive modified mixed signal, listen to the modified mixed signal that is received then from mixed information again.After listening to modified mixed signal, if the user attempts listening to mixed signal, then the user provides server 7002 requests to send the mixed signal of " Memory of GreatArtist " to mixed information again.The user can utilize modified mixed signal or the mixed signal that user terminal 7001 is listened to provides server 7002 to receive from mixed information again.The user can be with call or the tinkle of bells of mixed signal as the user terminal 7001 such as portable terminal.And the user can be with the background music as homepage etc. such as mixed signal.And the user can generate through decomposite mixed signal in the mode of regulating mixed signal according to source signal by supplementary or the modified mixed signal that provides server 7002 to receive about mixed signal from mixed information again.

In some cases, mixed information provides server 7002 that all or part of mixed information again of paying can be provided again.Mixed information other mixed information again of providing server 7002 that free mixed information substantially again can be provided and paying can being provided again.In the situation that the mixed information use will be paid again, mixed information provides server 7002 request users payments again.For payment processes, mixed information provides whether server 7002 can be authorized user with the inspection user to user terminal 7001 request authentication information again.Provide the request of server 7002 in response to mixed information again, the user profile that the user will be used to authenticate is input to user terminal 7001.Mixed information provides server 7002 to come whether authenticated is authorized user by the user profile that receives user's input from user terminal 7001 again.

Attempt using Credit Card Payments again in the situation of mixed information usage charges the user, mixed information provides server 7002 by user profile being sent to the affirmation that comes request user authorization whether to exist such as banking institution such as credit card company, banks again.Banking institution 7003 checks that whether users are the authorized users subscribed, corresponding results are sent to mixed information then again server 7002 is provided in banking institution.Then, mixed information provides server 7002 request banking institution 7003 to pay mixed information usage charges more again.If like this, then banking institution 7003 extracts mixed information usage charges again from user's account, notifies mixed information to provide server 7002 to make payment then again.Banking institution 7003 transfers to the account that mixed information provides server 7002 with the usage charges of being extracted of mixed information more in real time or periodically again.Want by payment by the transfer of accounts again in the situation of mixed information usage charges the user, banking institution 7003 notify again mixed information provide server 7002 users again the mixed information usage charges pay again mixed information and provide on the account of server 7002.Receive the notice finished of payment from banking institution 7003 after, again the mixed information mixed information again that provides server 7002 to extract to select by the user, then the mixed information again that is extracted is sent to user terminal 7001.

Mixed information provides server 7002 to provide mixed information again to user terminal 7001 again, and user terminal 7001 can in statu quo be listened to.Yet, user terminal 7001 can with user's modification again the mode of mixed information use mixed information again.In this case, user terminal 7001 can comprise and is used to handle decomposite signal decoding equipment.

The user receives with supplementary or source signal that separates with supplementary and mixed signal, can utilize user terminal 7001 to mix source signal more then.Only provide server 7002 to receive the situation of mixed signals from mixed information again at user terminal 7001, user terminal 7001 directly generates about the supplementary of mixed signal, can utilize the supplementary that is generated to regulate mixed signal according to source signal then.The user generates through decomposite mixed signal by regulating mixed signal by source signal adjusting mixed signal, can provide server 7002 with uploading to mixed information through decomposite mixed signal then again.And the user generates and to be used to the representing icon of source signal or the icon that provides server 7002 to receive from mixed information again is provided, and the icon that institute generates or revises can be uploaded to mixed information then again server 7002 is provided.In this case, mixed information comprises icon that generates/revise and upload through decomposite mixed signal, by the user of being uploaded by the user etc. again.

Mixed information provides server 7002 to be stored in (not shown) in the database with what the user utilized that user terminal 7001 uploads through decomposite mixed signal again.If second user different with the front user asks to send through decomposite mixed signal, then mixed information provides server will send to second user terminal through decomposite mixed signal in mode free or that pay again.Mixed information provides server 7002, front the user of the decomposite mixed signal of transmission from one channel to another, icon etc. on the server 7002 to be provided and to attempt using second user through decomposite signal, icon etc. to pay mixed information usage charges again according to preset protocol to mixed information more again.Sending in the situation of decomposite mixed signal to second user charges, mixed information provides server 7002 to pay by said method request second user again.And mixed information provides server 7002 predetermined portions of the prepaid mixed information again of second user usage charges can be paid the front provides the decomposite mixed signal of transmission from one channel to another, icon etc. on user from the server 7002 to mixed information more again.

The user can utilize such as user terminals such as mobile phone 7001 and pay mixed information usage charges again.If the user provides the number of the user terminal of server 7002 inputs such as mobile phone etc. to mixed information again, then mixed information provides server 7002 that the number of user's user terminal 7001 is sent to the Verification Number that mobile communication service provider 7004 and request are used for authentification of user again.Provide the request of server 7002 in response to mixed information again, mobile communication service provider 7004 sends to mixed information with Verification Number again server 7002 and user terminal is provided.The user is input to mixed information with the Verification Number that is received again server 7002 is provided.If the Verification Number by user's input mates the Verification Number that receives from mobile communication service provider 7004, then mixed information provides server 7002 to determine that users are authorized users again.In determining the situation that the user is authorized to, mixed information provides server 7002 request mobile communication service providers 7004 to pay mixed information usage charges more again.If like this, mobile communication service provider 7004 normal usage charges of adding mixed information usage charges again to user terminal 7001 then.If paid mixed information usage charges again, then mobile communication service provider 7004 notifies mixed information to provide server 7002 to pay again.After the notice that the reception payment is finished, mixed information provides server 7002 that user-selected mixed information is again sent to user terminal 7001 again.

Subsequently, the user utilizes the mixed information again that is received to generate through decomposite mixed signal.The user can wait by size, position, the tone that utilizes user terminal 7001 to regulate source signal and make the mixed signal uniqueness.The user can utilize user terminal 7001 to upload to mixed information through decomposite mixed signal again server 7002 is provided.As mentioned above, second user's download by other user upload to again mixed information provide server 7002 through decomposite mixed signal, can use then downloaded through decomposite mixed signal.

Figure 48 is the block diagram that server is provided according to the mixed information again of the embodiment of the invention.

With reference to Figure 48, mixed information provides server 7002 to comprise storage system 7001, CPU (central processing unit) (CPU) 7104, input-output apparatus 7108 and communication facilities 7109 again.The register of the interim storage that CPU (central processing unit) 7104 comprises the ALU (ALU) 7105 that is used to carry out calculating, be used for data and order and be used to control again the controller 7107 that mixed information provides the operation of server 7002.Storage system 7001 comprises: the high-speed main memory 7102 with the storage medium configuration such as random-access memory (ram) and ROM (read-only memory) (ROM); Has supplementary storage such as long-term storage medium configuration such as floppy disk, hard disk, band, CD-ROM, flash memory; And the equipment that is used to store data that utilizes other electricity, magnetic or optical storage media.Primary memory 7102 can comprise video display memory, is used for the tabulation via display device demonstration such as mixed signal or modified mixed signal, icon etc.Input-output apparatus 7108 comprises keyboard, mouse and such as physics transducers such as touch-screen and microphones.And communication facilities 7109 can comprise the network interface that is used for carrying out with user terminal 7001 or the equipment such as the RF transceiver antenna wire/wireless communication.

Figure 49 is the block diagram that the module of server is provided according to the mixed information again of the embodiment of the invention.

With reference to Figure 49, mixed information provides server 7002 to comprise again: the transceiver processing module 7213 that is used for the communication between process user terminal 7001, banking institution 7003 and the mobile communication service provider 7004; Storage and management comprise the database management module 7214 of mixed information again such as mixed signal, modified mixed signal; Generate the mixed signal modified module 7215 of modified mixed signal; And in the situation that mixed information will be paid again, verify the bill the processing module 7216 whether user is authorized to, this bill processing module 7216 is handled payment.

Mixed information provides the configured in one piece of server to be explained as follows by above application module again.

Mixed information provides server can use various operating systems (abbreviating OS hereinafter as) as the OS of system at first, again.OS is by providing high-level command to control the operation of each application module 7206 to application programming interfaces (abbreviating API hereinafter as) 7201.Mixed information provides server to comprise high-level command processing unit 7202 again, corresponding each application module 7204 of sign in its high-level command that is provided according to API 7201, the corresponding high-level command of high-level command processing unit 7202 decodings, high-level command processing unit 7202 will offer the relevant position through the order of decoding.The operation of application module 7204 is controlled in the order that application module control module 7203 is provided according to high-level command processing unit 7202.Particularly, whether high-level command processing unit 7202 signs the application module 7204 corresponding to the high-level command that provides via API 7201 is provided.If the application module 7204 corresponding to the high-level command that provides via API 7201 is provided, then high-level command processing unit 7202 command decode that is provided is become can be by the order of respective application module 7204 identifications, the order through decoding will be sent to corresponding map unit or control messages transmission then.

Therefore, application module control module 7203 comprises the map unit 7205,7207,7209 that is respectively applied for transmitting-receiving processing module 7213, database management module 7214, mixed signal modified module 7215 and bill processing module 7216 and 7211 and the interface unit 7206,7208,7210 and 7212 that is respectively applied for transmitting-receiving processing module 7213, database management module 7214, mixed signal modified module 7215 and bill processing module 7216.

The high-level command that is communicated with user terminal 7202, banking institution 7003 or mobile communication service provider 7004 by high-level command processing unit 7202 being used for of providing is provided transmitting-receiving processing module map unit 7205, and with the command mapping that provided to the device level that can handle by transmitting-receiving processing module 7213, then the order through mapping will be offered transmitting-receiving processing module 7213 via transmitting-receiving processing module interface unit 7206.

Database management module map unit and database management module interface unit 7208 storage mixed signal or modified mixed signals are extracted the signal of being stored then the situation that receives mixed signal request or modified mixed signal request from user terminal 7001.The high-level command that is used to use database management module 7214 that is provided by high-level command processing unit 7202 is provided database management module map unit 7207, and with the command mapping that provided to the device level order, then the order through mapping will be offered database management module 7214 via database management module interface unit 7208.

Wait the modified mixed signal of request and need to revise in the situation of mixed signal user, included predetermined origin signal generates modified mixed signal to mixed signal modified module 7215 in the mixed signal by getting rid of.Mixed signal modified module map unit 709 has the high-level command that applies via high-level command processing unit 7202, then extremely can be by the device level order of mixed signal modified module 7215 identifications with the command mapping that is provided.The device level order is offered mixed signal modified module 7215 via mixed signal modified module interface unit 7210.

Bill processing module 7216 checks whether the user is authorized user.If the user is an authorized user, then bill processing module 7216 is imposed mixed information usage charges again.Second user want to use by another user generate and upload in the situation of decomposite mixed signal, bill processing module 7216 mixed information again provide server 7002, on handle mixed information usage charges again between the user of the decomposite mixed signal of transmission from one channel to another and second user.Bill processing module map unit 7211 has the high-level command that applies via high-level command processing unit 7202, then extremely can be by the device level order of bill processing module interface unit 7216 identifications with the command mapping that is provided.The device level order is offered bill processing module 7216 via bill processing module interface unit 7212.

Figure 50 provides server that the process flow diagram of the method for mixed information is provided again according to the embodiment of the invention from mixed information again.

With reference to Figure 50, the user utilizes user terminal 7001 to visit mixed information again server 7002 is provided.Mixed information provides server 7002 to have the mixed information of being selected by user terminal 7001 again [S701] again.Mixed information provides server 7002 free dispach (FD) of mixed information again of user's selection can be arrived user terminal 7001 again.And mixed information provides server 7002 also the mixed information again of user's selection can be sent to user terminal 7001 with paying again.The mixed information mixed information again that provides server 7002 to determine that users select is freely or [S703] that pay again.If the mixed information again that the user selects will be paid, then mixed information provides server 7002 to ask payment [S705] to the user again.For payment, mixed information provides server 7002 can carry out authentification of user to confirm whether the user is authorized user again.Mixed information provides the user authentication information that server 7002 can ask to be used for to user terminal 7001 inputs authentification of user again, such as credit number, account number, social security number, password (Personal Identification Number) etc.If the user utilizes user terminal 7001 input authentication information, then mixed information provides server 7002 that the user authentication information of user's input is sent to banking institution 7003, mobile communication service provider 7004 etc. again, and request confirms whether the user is authorized to then.

Banking institution 7003 or mobile communication service provider 7004 are searched in the database (not shown) by mixed information again and user authentication information that server 7002 sends are provided, corresponding results are notified to mixed information then again server 7002 is provided.

If the user is confirmed as being authorized to, then mixed information provides server 7002 that payment information is sent to banking institution 7003 or mobile communication service provider 7004 and asks to pay again.Mixed information provides server 7002 can comprise mixed signal modification unit (not shown) again.(be "Yes" in step S707) if pay, then mixed information provides whether the server mixed information again that 7002 definite users select is by getting rid of the modified mixed signal [S709] that the assigned source signal generates again.If the mixed information again of user's special use is modified mixed signal, then mixed information provides server 7002 to utilize mixed signal to revise unit modification mixed signal or extracts previously stored modification signal [S711] again.Mixed information provides server 7002 that modified mixed signal is offered user terminal 7001[S715 again].If the mixed information again that the user selects is not modified mixed signal, then mixed information provides server 7002 to extract previously stored mixed information again [S713] again.And mixed information provides server 7002 that the mixed information again that is extracted is offered user terminal 7001[S715 again].

Figure 51 is the process flow diagram that the method for mixed information is provided to user terminal according to the embodiment of the invention again.

With reference to Figure 51, the user utilizes user terminal 7001 to visit mixed information again server 7002[S801 is provided].The user utilizes user terminal 70001 to select customizing messages [S803] from the mixed information again that mixed information provides server 7002 to provide again.As mentioned above, mixed information comprises the icon and the Emoticons of mixed signal, modified mixed information, source signal, supplementary, expression source signal again.And mixed information comprises that uploading to mixed information by other user provides mixed information again of server 7002 etc. again again.User terminal 7001 determines whether the mixed information again that the user selects is [S805] that will pay.If the mixed information again that the user selects will be paid, then the user pays mixed information usage charges [S807] again.In this case, the mixed information usage charges can be according to the type or the changes such as size, bit rate of mixed information more again.For example, attempt only receiving in the situation of particular source signal the payable usage charges of lacking than the situation that receives the mixed signal that comprises the particular source signal of user the user.In the user receives about the supplementary of mixed signal or the situation about the supplementary of the source signal that is not included in mixed signal, can change by the amount of user's payment.After finishing payment, the user provides server 7002 to receive mixed information [S809] from mixed information more again.

Figure 52 incites somebody to action mixed information according to the embodiment of the invention to be sent to the process flow diagram that mixes the method that server is provided again from the user again.

With reference to Figure 52, the user utilizes user terminal 7001 to receive mixed information again.Mixed information can be by provide the encoding device the server 7002 to send such as mixed information more again.User terminal 7001 can comprise hybrid rending unit (not shown) again, and it utilizes mixed information and control information to mix source signal included in the mixed signal more again.Comprise again in the situation of hybrid rending unit that at user terminal 7001 user can utilize user terminal 7001 to utilize mixed signal, source signal and supplementary thereof directly to generate mixed information again.And, the new mixed information again [S901] of the generation of mixed information again that the user can also be stored in the user terminal 7001 by utilizing the hybrid rending unit to revise again.Particularly, user's size, position, tone that can generate by utilizing mixed information again that the user has to regulate source signal waits decomposite mixed signal.In addition, the user can revise the icon or the Emoticons of expression source signal or can directly generate icon etc.The user sends the mixed information again that is generated and provides server 7002[S903 so that it is uploaded to mixed information again].Mixed information provides server 7002 that the new mixed information again that the user uploads is stored in the database again.If second user wants the mixed information again stored, then again mixed information provide server 7002 from database extract the mixed information of wanting again, the mixed information again that will extract then sends to second user terminal.

Industrial applicibility

Therefore, the present invention is applicable to the input equipment of media signal player, telepilot etc.And the present invention is applicable to the interfacial level controller of media signal player, telepilot etc.In addition, the present invention is applicable to media signal information-providing server etc.

Although this paper has described with illustration the present invention with reference to the preferred embodiments of the present invention, those skilled in the art will know and can make various modifications and distortion in the present invention and can not break away from the spirit and scope of the present invention.Therefore, the present invention is intended to contain modification of the present invention and the distortion that falls in claims and the equivalence techniques scheme scope thereof.

Claims (33)

1. input media comprises:

Input block;

Control module, it will convert the menu display commands according to the source via the input signal that described input block receives to, and described control module is exported based on the source information corresponding to mixed signal according to the menu display image in source according to described menu display commands control according to the source; And,

Be used to export the display of described menu display image according to the source.

2. input media as claimed in claim 1 is characterized in that, also comprises positioning equipment or directionkeys, and wherein said control module will convert the energy level regulating command according to the source via the input signal that described positioning equipment or directionkeys receive to.

3. input media comprises:

Input block;

Control module, it will convert the menu display commands according to the source via the input signal that described input block receives to; And,

Wireless communication unit, its order with described control module conversion sends to external unit.

4. input media comprises:

Input block; And

Control module, it will convert voice mute command or the regulating command of voice energy level to via the input signal that described input block receives, and described control module is based on described voice mute command or the voice energy level regulating command output control information about mixed signal.

5. input media comprises:

Input block;

Control module, it will convert the ambient image display command to via the input signal that described input block receives, and described control module controls environment image based on the source information output corresponding to mixed signal according to the single display command of described ambient image; And

Display, described ambient image is output to described display.

6. input media as claimed in claim 5, it is characterized in that, also comprise positioning equipment or directionkeys, wherein said control module will convert the environment regulating command to via the input signal that described positioning equipment or directionkeys receive, then based on the control information of described environment regulating command output about described mixed signal.

7. input method comprises:

Receive the shortcut registration command;

Select among in a plurality of keys, multiple source and at least one or a plurality of function; And

Match selected key by the selected function that will be used for selected source and store,

Wherein a plurality of described sources comprise at least one in audio signal source and the video signal source, and wherein at least one function comprises that sound is quiet, environment is regulated and at least one in regulating of energy level.

8. input media comprises:

Input block is used for selecting among of a plurality of keys, multiple source and at least one or a plurality of function;

Storage unit is used for storing the command information about each of a plurality of described keys; And

Control module, its selected function with selected source matches selected key, and described control module is stored the result of described coupling in described storage unit,

Wherein a plurality of described sources comprise at least one in sound signal object and the object video signal, and wherein at least one function comprises that sound is quiet, environment is regulated and at least one in regulating of energy level.

9. method that shows the interface of mixed signal comprises:

Select the specific blend signal; And

Show the tabulation of source signal by the information of inquiring relevant source signal corresponding to described mixed signal,

Wherein when selecting mixed signal, keep described demonstration.

10. method as claimed in claim 9 is characterized in that, is to extract from the supplementary corresponding to described mixed signal about the information of described source signal.

11. method as claimed in claim 9 is characterized in that, the tabulation of described source signal comprises at least one in the characteristic of the source signal that musical instrument name, singer's name and mixed signal are included.

12. method as claimed in claim 9 is characterized in that, also comprises:

Select single source from described source signal tabulation; And

Further show at the volume level in selected source and regulate image.

13. method as claimed in claim 9 is characterized in that, also comprises:

Select single source from described source signal tabulation; And

Demonstration regulates image at the balanced device in selected source or environment is regulated image.

14. a device that is used to show the interface of mixed signal comprises:

Be used to select the input block of one of a plurality of mixed signals;

Control module, it shows the tabulation of source signal corresponding to the information of the source signal of described mixed signal by inquiry; And

Be used to show the display of the tabulation of described source signal,

Wherein when selecting mixed signal, keep described demonstration.

15. device as claimed in claim 14 is characterized in that, also comprises second display,

Wherein said input block is selected the source from the tabulation of described source signal, and

Wherein said control module shows that on described second display metadata at selected source, volume level regulate image, balanced device and regulate image and environment and regulate in the image at least one.

16. a method that shows the interface of mixed signal comprises:

Select the specific blend signal; And

Show icon corresponding to described source signal corresponding to the information of the source signal of described mixed signal based on the information of described source signal by inquiry.

17. method as claimed in claim 16 is characterized in that, the information of described source signal is to extract from the supplementary corresponding to described mixed signal.

18. method as claimed in claim 16 is characterized in that, also comprises:

If receive fill order, then show energy level adjusting image corresponding to the source signal of selected icon to one of described icon.

19. method as claimed in claim 18 is characterized in that, also comprises:

If receive the order of regulating at energy level, then change the shape of selected icon according to energy level through regulating,

Wherein the shape of selected icon comprises at least one in the interior position of size, color, brightness and described image.

20. method as claimed in claim 16 is characterized in that, also comprises:

If selected one of described icon, then show balanced device image corresponding to the source signal of selected icon.

21. method as claimed in claim 20 is characterized in that, also comprises:

If receive the order of regulating at according to the energy level of sub-band, then mix described mixed signal again by the sub-band energy level of regulating corresponding to the source signal of selected icon.

22. method as claimed in claim 16 is characterized in that, also comprises if select one of described icon, then shows the environment adjusting image corresponding to the described source signal of selected icon,

Wherein said environment is regulated the signal relative position of image demonstration according to the source.

23. a device that is used to show the interface of mixed signal comprises:

Be used to select the input block of one of a plurality of mixed signals;

Control module, it is based on showing icon corresponding to source signal with the information of the corresponding source signal of the selected described mixed signal of described input block; And

Display unit is used to show the icon corresponding to described source signal.

24. a method that shows the interface of mixed signal comprises:

Reception is at the playback command of described mixed signal; And

If the energy level corresponding to the source signal of described mixed signal changed by the time, then by changing the shape that shape shows the image of described source signal by the time,

The shape of wherein said image comprises at least one in the interior position of size, color, brightness and described image.

25. a device that is used to show the interface of mixed signal comprises:

Be used to import input block at the playback command of described mixed signal;

Control module, if change by the time corresponding to the energy level of the source signal of described mixed signal, then described control module changes the shape that shape is controlled the image of the described source signal that will show by ask on time; And

Display unit is used to show the image corresponding to described source signal,

The shape of wherein said image comprises at least one in the interior position of size, color, brightness and described image.

26. one kind provides the method for the processing signals of server implementation by the mixed information again that is connected to user terminal via communication network, comprising:

By user terminal requests mixed information again; And

The mixed information again of being asked is sent to described user terminal,

Wherein said mixed information again comprises the source signal that comprises in mixed signal, the described mixed signal, be used for according to source signal control described mixed signal hybrid parameter, be used for the extended hybrid signal of the described mixed signal of extended hybrid and be used to represent the icon of described source signal or at least one of Emoticons.

27. method as claimed in claim 26 is characterized in that, described mixed information again comprises the modified mixed signal that generates by exclusive segment source signal from the included source signal of described mixed signal.

28. method as claimed in claim 27 is characterized in that, if described user terminal requests sends modified mixed signal, then described method also comprises:

The user can be selected will be from the source signal of described mixed signal eliminating; And

Generate the modified mixed signal that selected source signal is excluded,

Wherein when emission, described modified mixed signal is sent to user terminal.

29. each the described method as in the claim 26 to 28 is characterized in that, described transmission comprises if described mixed information is again paid, then described mixed information is again sent to described user terminal.

30. method as claimed in claim 29 is characterized in that, described mixed information again provides server to be connected to banking institution or mobile communication service provider via described communication network, and

Wherein said payment is carried out in the following manner: to described user terminal requests user end certification information, send to banking institution or mobile communication service provider comes request authentication by authentication information with user terminal input, if and user end certification finishes, then ask payment by payment information being sent to banking institution or mobile communication service provider.

31. the method for a processing signals of being implemented by the user terminal that is connected to mixed information via communication network again and provides server comprises:

Provide server to ask mixed information again by visiting described mixed information again;

To provide the payment information of server requests to send to described mixed information again by described mixed information again server will be provided; And

If pay, then provide server to receive described mixed information again from described mixed information again,

Wherein said mixed information again comprises the source signal that comprises in mixed signal, the described mixed signal, be used for according to source signal control described mixed signal hybrid parameter, be used for the extended hybrid signal of the described mixed signal of extended hybrid and be used to represent the icon of described source signal or at least one of Emoticons.

32. a mixed information again that is connected to user terminal via communication network provides server, comprising:

Transmit-Receive Unit, it has the mixed information again of described user terminal requests, and described Transmit-Receive Unit sends to user terminal with the mixed information again of being asked;

Database Unit, the mixed information again of being asked is extracted in its request in response to described user terminal;

The payment processes unit, if the use of mixed information will be paid again, the payment that then described payment processes cell processing is used about described mixed information again; And

Control module, it controls the mixed information again that will send to described user terminal by described user terminal requests,

Wherein said mixed information again comprises the source signal that comprises in mixed signal, the described mixed signal, be used for according to source signal control described mixed signal hybrid parameter, be used for the extended hybrid signal of the described mixed signal of extended hybrid and be used to represent the icon of described source signal or at least one of Emoticons.

33. one kind is connected to the user terminal that mixed information provides server by communication network again, comprising:

Communication unit, it provides server requests mixed information again to described mixed information again, and described communication unit receives the mixed information again of being asked;

The user interface that is used for receiving control information;

Hybrid rending unit again, it utilizes described mixed information again and described control information to mix the source signal that is included in the mixed signal again; And

Control module, it controls the decomposite source signal of wanting that comprises in the described mixed signal by controlling described user terminal all sidedly,

Wherein said mixed information again comprises the source signal that comprises in mixed signal, the described mixed signal, be used for according to source signal control described mixed signal hybrid parameter, be used for the extended hybrid signal of the described mixed signal of extended hybrid and be used to represent the icon of described source signal or at least one of Emoticons.

Images