JP2008306372A - Acoustic signal control device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an acoustic signal control device which allows intuitive selection of a wanted acoustic signal from among the acoustic signals input from a plurality of acoustic sources. <P>SOLUTION: A combination device 3 in which a tactile sense and vibration sense presenting device 3a, presenting tactile and vibration sense stimulation based on acoustic signals input from a plurality of acoustic sources, is combined and integrated with an operation device 3b to be operated for commanding a specified process to acoustic signals, is provided for each of a plurality of acoustic sources. A signal processing part 1 and a drive part 2 control the tactile and vibration sense stimulation presented by the tactile sense and vibration sense presenting device 3a. A sound output control part 4 makes an output device 400 output the sound based on the acoustic signal. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an acoustic signal control apparatus that controls acoustic signals input from a plurality of acoustic sources.

In a sound output device such as a television receiver, a hearing aid, or an acoustic signal editor, a user listens to a sound based on a plurality of acoustic signals output from the sound output device, and performs a predetermined operation on a specific acoustic signal. May be instructed to perform the above process (for example, a process of outputting only sound based on one acoustic signal or a process of adjusting the volume of sound based on the acoustic signal).
Three specific examples are given below.

The first is simultaneous viewing of television broadcasting. For example, news programs often begin at the same time at multiple broadcast stations. When viewers have specific news that they are interested in, they don't know which broadcast station will broadcast the specific news first. Can only wait for the broadcast. However, it may miss the desired news.
Therefore, a method of mounting a tuner capable of simultaneously receiving television broadcast signals of a plurality of channels on a television receiver so that a viewer can watch a plurality of programs simultaneously becomes effective. At this time, if the characteristics of audio output are made different among a plurality of programs, the audio of each program can be easily heard (see, for example, Patent Document 1).
However, even if the viewer can hear the content of the desired news by the technique of Patent Document 1, it is difficult to grasp which channel it corresponds to. Therefore, for example, when a viewer wants to view only a desired program among a plurality of programs being viewed, it is difficult to instantaneously select a channel of the desired program. Therefore, an operation device such as a switch that allows the user to intuitively select a desired program channel is required.

The second is output switching of the separated signal. With the recent development of signal separation technology, it is becoming possible to separate the voices of a plurality of speakers in real time even in the sound environment of daily life. For example, in a hearing aid having a signal separation function, it is possible to automatically separate and extract the voices of a plurality of speakers. At this time, if the hearing aid is configured so that the speaker characteristics can be stored and only the voice of the speaker selected by the user can be output based on the characteristics (see, for example, Patent Document 2), The user can hear only the voice of the desired speaker by selecting the desired speaker from the speakers whose characteristics are stored in the hearing aid.
However, in the technique disclosed in Patent Document 2 or the like, the voice of a speaker in which features are stored can be output, but the voice of an arbitrary speaker cannot be output. In addition, even if it is configured so that the sound output by an operation device such as a switch can be switched for each arbitrary speaker, it is up to the user's intention to determine the voice of a plurality of speakers. The part cannot be automated. Therefore, an operation device that allows the user to intuitively select a desired speaker is required.

The third is editing of an acoustic signal using an acoustic signal editor such as a mixing console. For example, there is a 4ch music source, ch-1 has a drum music source, ch-2 has a vocal music source, ch-3 has a piano music source, and ch-4 has a bass guitar music source. And For example, an operator (user) of the sound signal editing device operates an operation device such as a volume control knob corresponding to each music source to adjust the sound volume based on the sound signal from the desired music source. It has become. The acoustic signal editor outputs a sound obtained by taking a weighted average of four types of acoustic signals whose volumes are adjusted. As a result, the final balanced music is created using the acoustic signal editor.
However, when there are a plurality of music sources, it is difficult to reliably select an operation device corresponding to the music source of the sound whose volume is to be adjusted. Therefore, an operation device that allows the user to intuitively select the music source of the sound whose volume is to be adjusted is required.

  Here, when a user selects a channel of a desired program, selects a desired speaker, or selects a music source of a sound whose volume is to be adjusted, that is, an acoustic signal input from a plurality of acoustic sources. When one acoustic signal is selected from among the above, the simplest method is to sequentially switch the acoustic signals to be output one by one with an operation device such as a switch.

  In addition, the most popular method of converting an acoustic signal into a tactile stimulus or a vibration stimulus and giving it to a human is a method of transmitting a bass part directly to the body, not from the ear, such as body sonic. In addition, ideas have been proposed in which a vibration is transmitted to the fingertip so that a rhythmic feeling of music can be experienced or a voice emotion is transmitted by vibration (see, for example, Patent Documents 3 to 5).

In addition, as an idea to integrate an operation device such as a switch and a tactile / vibration presentation device, a vibration is transmitted to a user that a key provided on a mobile phone or the like has been reliably pressed (for example, Patent Document 6). Refer to the touch panel for confirming the operation of the touch panel to the user by vibration (for example, refer to Patent Document 7). Vibration is required when rotary input is required in an input unit including a rotary switch, push switch, slide switch, and push button switch. What is reported to the user (see, for example, Patent Document 8) has been proposed.
Japanese Patent Laying-Open No. 2005-210349 JP 2000-12597A JP-A-8-19078 JP 2006-14255 A JP 2006-47640 A JP 2003-5893 A JP-A-9-161602 JP 2004-70505 A

  However, the method of switching the acoustic signals to be output one by one with an operation device such as a switch in order may output important sound while the switch is turned off. There is a concern that it will be missed.

  In addition, in the techniques such as Body Sonic and Patent Documents 3 to 5, although sound can be transmitted by vibration, each acoustic signal input from a plurality of sound sources cannot be identified by vibration. It cannot be used when one acoustic signal is selected from acoustic signals input from a source.

  In addition, in the techniques of Patent Documents 6 to 8 and the like, although it is possible to convey the necessity of operation confirmation and input by vibration, it is not possible to identify each of the acoustic signals input from a plurality of acoustic sources by vibration. This method cannot be used when one acoustic signal is selected from acoustic signals input from a plurality of acoustic sources.

  An object of the present invention is to provide an acoustic signal control device capable of intuitively selecting a desired acoustic signal from acoustic signals input from a plurality of acoustic sources.

In order to solve the above-mentioned problem, the invention described in claim 1
A tactile / vibratory sensation presentation device for presenting tactile / vibratory sensation based on respective acoustic signals input from a plurality of acoustic sources, and operated when instructing to perform predetermined processing on the acoustic signal A manipulation device and a coupling device integrated and coupled to each of the plurality of acoustic sources,
Tactile / vibration sense presentation control means for controlling the tactile / vibration sense stimulus presented by the tactile / vibration sense presentation device;
Output control means for causing the output device to output sound based on the acoustic signal;
It is characterized by providing.

The invention described in claim 2
The acoustic signal control device according to claim 1,
The tactile / vibration sensation presentation control means obtains an intensity signal representing a temporal change in intensity of the acoustic signal and a smoothed intensity signal obtained by smoothing the intensity signal, and the intensity signal is the smoothed intensity signal. The tactile / vibration sensation presentation device starts presentation of the tactile / vibration sensation when it becomes larger, and the presentation is continued for a predetermined time.

The invention described in claim 3
The acoustic signal control device according to claim 2,
The intensity signal is an intensity signal of a prediction error signal in linear prediction analysis.

The invention according to claim 4
The acoustic signal control device according to claim 2,
The intensity signal is an intensity signal of an aperiodic component.

The invention described in claim 5
In the acoustic signal control device according to any one of claims 1 to 4,
The tactile / vibration presentation control means includes a tactile / vibration presentation device based on a tactile / vibration stimulus based on a baseband signal and / or an amplitude-modulated signal that is amplitude-modulated to a preset frequency. It is characterized by presenting olfactory stimuli.

The invention described in claim 6
In the acoustic signal control device according to any one of claims 1 to 5,
The tactile / vibration presentation control means causes the tactile / vibration presentation device corresponding to the acoustic signal with the strongest auditory stimulus based on the acoustic signal to present the tactile / vibration stimulation in a certain time. .

The invention described in claim 7
In the acoustic signal control device according to any one of claims 1 to 5,
A time axis expansion / contraction means for expanding and contracting the time axis of the acoustic signal;
The tactile / vibration presentation control means causes the tactile / vibration presentation device to present a tactile / vibration stimulus based on an acoustic signal whose time axis is expanded and contracted by the time axis expansion / contraction means.

The invention according to claim 8 provides:
A tactile / vibratory sensation presentation device for presenting tactile / vibratory sensation based on respective acoustic signals input from a plurality of acoustic sources, and operated when instructing to perform predetermined processing on the acoustic signal A manipulation device and a coupling device integrated and coupled to each of the plurality of acoustic sources,
Tactile / vibration sense presentation control means for controlling the tactile / vibration sense stimulus presented by the tactile / vibration sense presentation device;
Output control means for causing the output device to output sound based on the acoustic signal;
With
The tactile / vibration presentation control means obtains an intensity signal of a prediction error signal in linear prediction analysis representing a temporal change in intensity of the acoustic signal, and a smoothed intensity signal obtained by smoothing the intensity signal. When the intensity signal becomes larger than the smoothed intensity signal, the tactile / vibration presentation device uses the tactile / vibration sensation based on the intensity signal and / or amplitude modulation amplitude-modulated to a preset frequency. The present invention is characterized in that presentation of a tactile / vibration stimulus based on a signal is started and the presentation is continued for a predetermined time.

According to the present invention, in the acoustic signal control device, a tactile / vibration sense presentation device that presents a tactile / vibration sense stimulus based on respective acoustic signals input from a plurality of acoustic sources, A tactile sensation / vibration provided by a tactile sensation / vibration sensation presentation device provided with a coupling device that is integrated and combined with an operation device that is operated when instructing to perform processing is associated with each of the plurality of acoustic sources. Tactile / vibration sense presentation control means for controlling the sense stimulus, and output control means for causing the output device to output a sound based on the acoustic signal.
That is, a tactile / vibration presentation device corresponding to each of the acoustic signals input from a plurality of acoustic sources is provided, and a tactile / vibration stimulus based on the corresponding acoustic signal is presented from each of the tactile / vibration presentation devices. Therefore, the user can intuitively select a desired acoustic signal from acoustic signals input from a plurality of acoustic sources.

"Example"
Hereinafter, the best mode of an acoustic signal control apparatus according to the present invention will be described in detail with reference to the drawings. The scope of the invention is not limited to the illustrated example.

  FIG. 1 is a block diagram showing a functional configuration of the acoustic signal control device 100, and FIG. 2 shows a signal flow in the acoustic signal control device 100.

  The acoustic signal control device 100 is, for example, a device incorporated in a television receiver or the like, and is connected to a tuner 200 and an amplifier 300 of the television receiver, for example, as shown in FIG.

  Specifically, for example, as shown in FIG. 1, the acoustic signal control apparatus 100 includes a signal processing unit 1 connected to the tuner 200, a drive unit 2, a tactile / vibration sense presentation device 3 a, and an operation device 3 b. The coupling device 3 is integrated and coupled, the sound output control unit 4 connected to the amplifier 300, the control unit 5, and the like.

[Tuner]
The tuner 200 is, for example, a tuner that can simultaneously receive a plurality of channels of television broadcast signals.
Specifically, the tuner 200 includes an antenna 200a as shown in FIGS. 1 and 2, for example. The tuner 200 receives, for example, a television broadcast signal related to a plurality of programs broadcast on a plurality of channels from a television broadcast wave received by the antenna 200a, separates an acoustic signal from the television broadcast signal, and Each of the sound signals related to the plurality of programs is input to the sound signal control apparatus 100 independently. That is, the tuner 200 is a sound signal input device that has a plurality of sound sources and inputs sound signals from the plurality of sound sources to the sound signal control device 100.

  For example, the tuner 200 shown in FIG. 2 inputs sound signals related to four TV programs from the first TV program to the fourth TV program to the sound signal control apparatus 100 (signal processing unit 1) as sound signals related to a plurality of programs. It has become.

[Signal processing section]
The signal processing unit 1 performs predetermined acoustic signal processing (for example, FIG. 3) on the acoustic signal input from the tuner 200 according to the control signal input from the control unit 5, for example, and outputs the acoustic signal as a sound. While outputting to the control part 4, the tactile sense / vibration sense stimulus based on an acoustic signal is shown to the tactile sense / vibration sense presentation device 3a via the drive part 2. FIG.

For example, the signal processing unit 1 illustrated in FIG. 2 includes a first signal processing unit to a fourth signal processing unit. The first signal processing unit is configured to receive an acoustic signal related to the first TV program. The second signal processing unit is configured to receive an audio signal related to the second TV program. The third signal processing unit is configured to receive an acoustic signal related to the third TV program. The fourth signal processing unit is configured to receive an acoustic signal related to the fourth TV program.
For example, in the signal processing unit 1 illustrated in FIG. 2, each of the first signal processing unit to the fourth signal processing unit performs acoustic signal processing (for example, FIG. 3) to generate an acoustic signal (x (t)). Is output to the sound output control unit 4 and a signal (f ₂ (n _B )) for driving the tactile / vibration sensation presentation device 3 a is output to the drive unit 2.

<Acoustic signal processing>
A specific example of the acoustic signal processing by the signal processing unit 1 will be described with reference to the flowchart of FIG.

Here, it is assumed that one acoustic signal input from the tuner 200 is x (t). Acoustic signal x (t) is a digital signal at the sampling frequency F _S, the sampling number t. That is, for example, when F _S = 44100 Hz, t = 44100 represents “after 1 second”. Hereinafter, the length on the time axis is represented by a sampling number.
The acoustic signal x (t) is processed for each block for a predetermined time. The block length is set to T _N, and the interval (time interval) between the start points of adjacent blocks is set to T _S, and T _S <T _N is set so that the preceding and succeeding blocks overlap. Hereinafter, description will be made assuming that T _N = 1470 and T _S = 245. Incidentally, the block number when arranged in order to block time and n _B.

First, the signal processing unit 1 initializes each variable, for example. That is, the signal processing unit 1, for example, “0” for the block number n _B , “0” for the count, “0” for f ₁ (−1), “0” for f ₂ (−1), P _A ( −1) is set to “0” (step S1).

Next, the signal processing unit 1 generates, for example, an acoustic signal x (t) for one block (T _S n _B ≦ t <T _S n _B + T _N ) and an analysis buffer y (t) (0 ≦ t <T _N )) (step S2).

Next, for example, the signal processing unit 1 performs linear prediction analysis on the analysis buffer y (t) (0 ≦ t <T _N ) to obtain linear prediction coefficients a ₁ , a ₂ ,..., A _K ( Step S3). Here, K is the order of linear prediction. Hereinafter, explanation will be made assuming that K = 20.

Then, the signal processing unit 1 is, for example, linear prediction coefficients a _1, a 2, _..., with a _K, to predict T _S samples in the center of one block to determine the sequence of prediction error. That is, using linear prediction coefficients a ₁ , a ₂ ,..., A _K , y (t) in the analysis buffer y (t) (0 ≦ t <T _N ) ((T _N −T _S ) / 2 ≦ t <(T _N + T _S ) / 2) is predicted, and a series of prediction errors is obtained. Then, the signal processing unit 1 calculates, for example, the sum of squares of this prediction error sequence (prediction error energy (that is, the intensity signal of the prediction error signal in the linear prediction analysis representing the temporal change in the intensity of the acoustic signal)). to which is referred to as intensity signal _{P R (n B)} (step S4).
The intensity signal P _R (n _B ) takes a larger value as the volume of the voice is larger, but is not proportional to the volume, but greatly increases in the consonant part. It also increases greatly at the start of the vowel part. Therefore, at the timing when the intensity signal P _R (n _B) increases sharply, if it is possible to present a tactile and vibratory sensation stimuli, humans it is possible to associate the stimulus with sound relatively easily.

Next, the signal processing unit 1 creates, for example, a smoothed intensity signal P _A (n _B ) obtained by smoothing the intensity signal P _R (n _B ) (step S5). Specifically, for example, when the time constant of smoothing is T _A , the signal processing unit 1 uses δ defined by δ = 1−exp (−T _S / T _A ) and uses P _A ( By calculating n _B ) = (1-δ) P _A (n _B −1) + δP _R (n _B ), the smoothed intensity signal P _A (n _B ) is created. Smoothing intensity signal P _A (n _B), by going to follow slowly intensity signal P _R (n _B), so a signal representing the local average energy intensity signal P _R (n _B) Yes. Hereinafter, the description will be made assuming that T _A = 882 (corresponding to 20 milliseconds).

Next, the signal processing unit 1, for example, sets the first threshold signal P _H (n _B ) to “a signal obtained by increasing P _A (n _B ) by 1 dB”, and the second threshold signal P _L (n _B ) to “P _A ( A signal obtained by reducing n _B ) by 5 dB is set (step S6).
If the intensity signal P _R (n _B ) greatly exceeds the smoothed intensity signal P _A (n _B ), the prediction error energy has increased rapidly, so that it can be estimated that it is a consonant part or a vowel part at the start time. If the signal P _R (n _B ) is significantly lower than the smoothed intensity signal P _A (n _B ), it can be estimated that it is a silent part or an ongoing vowel part. In order to perform this estimation, two threshold signals (first threshold signal P _H (n _B ) and second threshold signal P _L (n _B )) were provided. The first threshold signal P _H (n _B ) is not limited to a signal obtained by increasing P _A (n _B ) by 1 dB, and is arbitrary as long as it is equal to or greater than the smoothing intensity signal P _A (n _B ). Further, the second threshold signal P _L (n _B ) is not limited to a signal obtained by reducing P _A (n _B ) by 5 dB, and may be arbitrary as long as it is equal to or less than the smoothed intensity signal P _A (n _B ).

Then, the signal processing unit 1 is, for example, the intensity signal _{P R (n B)} is greater determines whether or not than the first threshold signal _{P H (n B)} (step S7).

In step S7, when the intensity signal _{P R (n B)} is determined to be larger than the first threshold signal _{P H (n B)} (step S7; Yes), the signal processing unit 1 includes, for example, the signal _{f 1 (n B} ) Is set to “1” (step S8), and the process proceeds to step S12.

On the other hand, if it is determined in step S7 that the intensity signal P _R (n _B ) is not greater than the first threshold signal P _H (n _B ) (step S7; No), the signal processing unit 1 performs, for example, the intensity signal P _It is determined whether or not _R (n _B ) is smaller than the second threshold signal P _L (n _B ) (step S9).

When it is determined in step S9 that the intensity signal P _R (n _B ) is smaller than the second threshold signal P _L (n _B ) (step S9; Yes), the signal processing unit 1 performs, for example, the signal f ₁ (n _B ) Is set to “0” (step S10), and the process proceeds to step S12.

On the other hand, when it is determined in step S9 that the intensity signal P _R (n _B ) is not smaller than the second threshold signal P _L (n _B ) (step S9; No), the signal processing unit 1 performs, for example, the signal f _{1 (n B)} to set the _{"f 1 (n B -1)} " ( step S11).
That is, signal _{f 1 (n B)} is a binary signal, the intensity signal _{P R (n B)>} to "1" when a first threshold signal _{P H (n B),} the intensity signal _{P R} This is a signal that becomes “0” when (n _B ) <second threshold signal P _L (n _B ), and continues the previous value (f ₁ (n _B −1)) when it is neither. Therefore, the rising edge of the signal f ₁ (n _B ) (that is, the time when f ₁ (n _B ) = 0 is switched to f ₁ (n _B ) = 1) is synchronized with the consonant part or the vowel part at the start time.

Then, the signal processing unit 1 is, for example, is _{f 1 (n B -1) =} 0, f 1 (n B) = 1, f 2 (n B -1) = 0 and the count> _{T M} / _{T S} Whether or not (step S12).
T _M is a condition provided so as not to switch to f ₂ (n _B ) = 1 unless f ₂ (n _B ) = 0 continues for a predetermined time (T _M ) or longer. This can prevent the in about fast human imperceptible from f ₂ (n _B) = 0 switching to _{f 2 (n B) = 1} . In the following description, it is assumed that T _M = 2205 (corresponding to 50 milliseconds).

If it is determined in step S12 that f ₁ (n _B −1) = 0, f ₁ (n _B ) = 1, f ₂ (n _B −1) = 0 and count> T _M / T _S (step S12) Yes), that is, the signal f ₁ (n _B ) is switched from “0” to “1” from the previous time to the current time, the previous value (f ₂ (n _B −1)) is “0”, and When it is determined that the count> _{T M} / _{T S,} the signal processing unit 1, the signal _{f 2 (n B)} "1", and sets "0" to the count (step S13), and the processing in step S17 Transition.

On the other hand, in step _{S12, f 1 (n B -1} ) = 0, f 1 (n B) = 1, f 2 (n B -1) = 0 and the count> _{T M} / _{T S} not equal it is determined (step S12; No), ie, at _{least one} of f ₁ (n _B −1) = 0, f ₁ (n _B ) = 1, f ₂ (n _B −1) = 0 and count> T _M / T _S If it is determined that one of not satisfied, the signal processing unit 1 is, for _{example, f 2 (n B -1)} = 1 and the count = _T determines whether a _P / _{T S} (step S14).
_TP is a condition provided for switching to f ₂ (n _B ) = 0 when f ₂ (n _B ) = 1 continues for a predetermined time (T _P ). As a result, stimulation can be continued for a time convenient for human sensing. In the following description, it is assumed that T _M = 2205 (corresponding to 50 milliseconds).
Here, it seems that it is better to make the stimulation time proportional to the length of the vowel part or consonant part, but human fingertips are not so high in detection ability for stimulation, so when the stimulation time is short Can not feel the stimulus. Therefore, it is better to set the stimulation time to a time convenient for human sensing than to make it proportional to the length of the vowel part or the consonant part.

If it is determined in step S14 that f ₂ (n _B −1) = 1 and count = T _P / T _S (step S14; Yes), the signal processing unit 1 sets, for example, “f ₂ (n _B ) to“ “0” and “0” are set to the count (step S15), and the process proceeds to step S17.

On the other hand, in step _{S14, f 2 (n B -1} ) = 1 and the count = _{T P} / _{T S} not equal it is determined (step S14; No), the signal processing unit 1 includes, for example, the _{f 2 (n B)} “F ₂ (n _B −1)” and “count + 1” are set to the count (step S16).

Next, the signal processing unit 1 outputs, for example, the signal f ₂ (n _B ) to the driving unit 2, and the acoustic signal x (t) for one block (T _S n _B −T _D ≦ t <T _S n outputs _B -T _D + _{T n)} to the sound output control unit 4 (step S17), sets the _"n B +1" to _{n B} (step S18), and repeatedly performs the processes in and after step S2.

Here, the acoustic signal is outputted to the sound output control unit _{4 x (t) (T S} n B -T D ≦ t <T S n B -T D + T N) , the analysis buffer y (t) (0 ≦ Compared with the acoustic signal x (t) stored in t <T _N ) (T _S n _B ≦ t <T _S n _B + T _N ), it is delayed by T _D.
This is to correct the time difference between the response of “auditory” and “tactile sensation / vibration” in humans. Specifically, tactile and vibration senses are insensitive compared to auditory senses, and even if stimulated at the same time, tactile and vibration senses are sensed later. Therefore, better results are often obtained when the auditory stimulus (that is, the acoustic signal x (t)) is output later than the tactile / vibration sense stimulus by a predetermined time (T _D ). Moreover, processing of the audio signal x (t) since the block length is performed for each block of T _N, it is also often necessary time correction that depends on the block length T _N. Therefore, these two, including the correction, the acoustic signal x to be output to the sound output control section _{4 (t) (T S n} B -T D ≦ t <T S n B -T D + T N), analysis buffer y (t) only (0 ≦ t _{<T n)} to the stored sound signal _{x (t) (T S n} B ≦ t <T S n B + T n) T D than is delaying.

<Example of waveform>
FIG. 4 shows an example of the waveform of each signal when the signal processing unit 1 applies the acoustic signal processing (FIG. 3) to the acoustic signal x (t) relating to the voice “The gray-haired grandmother wears a cane”. .
4A shows the waveform of the input acoustic signal x (t), and FIG. 4B shows the intensity signal P _R (n _B ), the first threshold signal P _H (n _B ), and the second threshold signal P _{L. (n B)} of the waveform, FIG. 4 (c) signals _{f 1 (n B)} of the waveform, FIG. 4 (d) the waveform of the signal _{f 2 (n B),} FIG. 4 (e) the first amplitude modulation signal The waveform of f ₃ (n _B ) (described later), FIG. 4 (f) is the waveform of f ₁ (n _B ) −f ₂ (n _B ) (described later), and FIG. 4 (g) is the second amplitude modulation signal f _4. The waveform of (n _B ) (described later) and FIG. 4 (h) are the waveforms of the signal f ₅ (n _B ) (described later).

According to FIG. 4C, when the intensity signal P _R (n _B )> the first threshold signal P _H (n _B ), the signal f ₁ (n _B ) is set to “1”, and the intensity signal P _R When (n _B ) <second threshold signal P _L (n _B ), the signal f ₁ (n _B ) is reset to “0”. Furthermore, a predetermined difference (for example, the first threshold signal P _H (n _B ) is set to “P _A (n _B ) between the first threshold signal P _H (n _B ) and the second threshold signal P _L (n _B ). _B 1) is increased by 1 dB ”, and when the second threshold signal P _L (n _B ) is set to“ signal by which P _A (n _B ) is decreased by 5 dB ”, there is a difference of 6 dB), and therefore the signal f ₁ Hysteresis exists in the change of (n _B ), and therefore, it is possible to suppress the signal f ₁ (n _B ) from changing in an unstable manner.

Further, according to FIG. 4D, when the signal f ₁ (n _B ) is set to “1”, the signal f ₂ (n _B ) becomes “1” only for a predetermined time (T _P ). After that, it becomes “0”. After becoming “0”, the signal f ₂ (n _B ) does not become “1” for a predetermined time (T _M ). By doing so, it is possible to avoid complex fluctuations that humans cannot feel with their fingertips.

According to FIG. 4, the signal f ₂ (n _B ) is a consonant and a strong vowel (“ha”, “ku”, “tsu”, “aunt”, “ga”, “tsu”, “tsu”, It can be seen that a good signal as intended was obtained.

[Drive part]
The driving unit 2 drives the tactile / vibration presentation device 3a according to the signal f ₂ (n _B ) input from the signal processing unit 1, for example.

For example, the drive unit 2 illustrated in FIG. 2 includes a first drive unit to a fourth drive unit. The first drive unit drives the corresponding tactile / vibration presentation device 3a according to the signal f ₂ (n _B ) input from the first signal processing unit. The second drive unit drives the corresponding tactile / vibration presentation device 3a according to the signal f ₂ (n _B ) input from the second signal processing unit. The third drive unit drives the corresponding tactile / vibration presentation device 3a according to the signal f ₂ (n _B ) input from the third signal processing unit. The fourth driving unit drives the corresponding tactile / vibration presentation device 3a according to the signal f ₂ (n _B ) input from the fourth signal processing unit.

Specifically, for example, when the signal f ₂ (n _B ) of f ₂ (n _B ) = 0 is input, the drive unit 2 presents the tactile sense / vibration sense so as not to present the tactile sense / vibration sense stimulus. The device 3a is controlled, and when the signal f ₂ (n _B ) of f ₂ (n _B ) = 1 is input, the tactile / vibration sensation presentation device 3a is controlled so as to present a tactile sensation / vibration sensation.

Here, for example, the drive unit 2 applies the tactile / vibration sense stimulus based on the baseband signal (f ₂ (n _B )) and the first amplitude modulation signal f ₃ (n _B ) to the tactile sense / vibration presentation device 3a. One of the tactile and vibration sense stimuli based on the above is presented.
The tactile / vibration sense stimulus based on the baseband signal is, for example, a tactile sense / vibration sense stimulus based on the signal f ₂ (n _B ) input from the signal processing unit 1.
The tactile / vibration stimulus based on the first amplitude modulation signal f ₃ (n _B ) is, for example, a signal obtained by amplitude-modulating the signal f ₂ (n _B ) input from the signal processing unit 1 to a preset frequency. It is a tactile / vibration stimulus based on this. Here, for example, when the tactile sense / vibration sense stimulus is a stimulus by vibration, the frequency set in advance is set to about 50 to 150 Hz which is easy for humans to sense as vibration.

As a result of the experiment, in the case of vibration exceeding 20 Hz, the human fingertip could hardly discriminate the frequency. Tactile and vibration sensations were found to be much less sensitive to frequency discrimination than hearing.
However, the human fingertip is clear about the tactile / vibration sense stimulus based on the baseband signal (f ₂ (n _B )) and the tactile / vibration sense stimulus based on the first amplitude modulation signal f ₃ (n _B ). Could be identified. By using this, the consonant part detected by the acoustic signal processing (FIG. 3) and the vowel part at the start time point are presented by tactile / vibration sense stimulation based on the baseband signal (f ₂ (n _B )), and superimposed on it. In addition, if a tactile / vibratory stimulus based on the second amplitude modulation signal f ₄ (n _B ) due to vibration of 50 to 150 Hz is presented, a tactile / vibratory stimulus based on the signal f ₅ (n _B ) may be presented. it can. Specifically, for example, f ₁ (n _B ) −f ₂ (n _B ) shown in FIG. 4F is amplitude-modulated to a frequency of 50 to 150 Hz, and the second amplitude modulation shown in FIG. generates a signal _{f 4 (n B),} and, by adding the signal _{f 2 (n B)} to the second amplitude modulation signal _{f 4 (n B),} the signal _{f 5} (n that shown in FIG. 4 (h) _B ) can be generated. By presenting the tactile / vibration stimulus based on the signal f ₅ (n _B ), the stimulus can be presented even for the duration of the signal f ₁ (n _B ), and more to the human fingertip. Can give information.
In addition, as shown here, the method of creating FIG. 4 (f) as f ₁ (n _B ) −f ₂ (n _B ) is merely an example, and the scope of the present invention is not limited thereto. .

  The tactile / vibration sense presentation control means for controlling the tactile / vibration sense stimulus presented by the tactile / vibration sense presentation device 3a includes, for example, a signal processing unit 1 and a drive unit 2.

[Coupling device]
The coupling device 3 includes, for example, a tactile / vibration sensation presentation device 3a that presents a tactile / vibration sensation based on each acoustic signal input from a tuner 200 having a plurality of acoustic sources, and a user responds to the acoustic signal. The operation device 3b that is operated when instructing to perform a predetermined process is integrated and coupled, and is provided corresponding to each of a plurality of acoustic sources.

For example, the four coupling devices 3 shown in FIG. 2 correspond to the sound sources of the first TV program to the fourth TV program.
Then, the coupling device 3 corresponding to the sound source of the first TV program causes the user to perform a predetermined process on the tactile / vibration presentation device 3a driven by the first driving unit and the sound signal related to the first TV program. And an operation device 3b for instructing.
The coupling device 3 corresponding to the sound source of the second TV program instructs the tactile / vibration presentation device 3a driven by the second drive unit and the user to perform predetermined processing on the sound signal related to the second TV program. Operating device 3b.
The coupling device 3 corresponding to the sound source of the third TV program instructs the tactile / vibration presentation device 3a driven by the third drive unit and the user to perform predetermined processing on the sound signal related to the third TV program. Operating device 3b.
The coupling device 3 corresponding to the sound source of the fourth TV program instructs the tactile / vibration presentation device 3a driven by the fourth drive unit and the user to perform predetermined processing on the sound signal related to the fourth TV program. Operating device 3b.

Specifically, the tactile / vibration presentation device 3a presents a stimulus that can be sensed by a tactile / vibration sense of a human body (finger) such as a vibration stimulus or an electrical stimulus.
The operation device 3b is, for example, a push button type switch, and outputs an operation signal to the sound output control unit 4 via the control unit 5 when operated (pressed) by the user, for example. It has become.

For example, as shown in FIGS. 2 and 5, the coupling device 3 is formed by surrounding a tactile / vibration sense presentation device 3 a that is a stimulus presentation portion with an operation device 3 b that is a stimulus non-presentation portion. When 3b is operated, the tactile / vibration presentation device 3a also moves together with the operation device 3b. Therefore, even if the operation device 3b is operated, the finger pressure on the tactile / vibration presentation device 3b hardly fluctuates, and thus the human fingertip is presented without being affected by whether or not the operation device 3b is operated. It can sense tactile and vibration stimuli.
For example, according to FIG. 5, the four coupling devices 3... Are operated (pressed) by the thumb, index finger, middle finger, and ring finger, respectively, and the middle finger presses the coupling device 3 (operation device 3 b). is doing.

  Here, for example, when the user selects a program when there is a program that the user wants to view independently among a plurality of programs (first TV program to fourth TV program) that the user is viewing at the same time, the operation device 3b To be operated.

[Sound output controller]
The sound output control unit 4 performs a predetermined process on the acoustic signal x (t) input from the signal processing unit 1 as an output control unit in accordance with the control signal input from the control unit 5, for example, to the amplifier 300. By outputting, the output device 400 is caused to output sound based on the acoustic signal.
Here, the predetermined processing is, for example, only the sound signal related to the program selected by the operation of the operation device 3b by the user from among the sound signals related to the plurality of programs input from the tuner 200 via the signal processing unit 1. This is a process of outputting to the output device 400 via the amplifier 300.

Specifically, for example, when a program is not selected by the user, the sound output control unit 4 outputs acoustic signals related to a plurality of programs input from the tuner 200 to the output device 400.
On the other hand, the sound output control unit 4 is input from the tuner 200, for example, when a program is selected by the user, that is, when an operation signal is input from the operation device 3b via the control unit 5. Among the sound signals related to a plurality of programs, the sound signal related to the selected program is output to the output device 400.

[Amplifier]
For example, the amplifier 300 amplifies the acoustic signal input from the sound output control unit 4 and outputs the amplified signal to the output device 400.

[Output device]
The output device 400 is, for example, a speaker device, and outputs a sound based on an acoustic signal input from the amplifier 300, for example.

[Control unit]
For example, as shown in FIG. 2, the control unit 5 includes a CPU (Central Processing Unit) 51, a RAM (Random Access Memory) 52, a storage unit 53, and the like.

  For example, the CPU 51 performs various control operations according to various processing programs for the acoustic signal control device 100 stored in the storage unit 53.

  The RAM 52 includes, for example, a program storage area for expanding a processing program executed by the CPU 51, a data storage area for storing input data, a processing result generated when the processing program is executed, and the like.

  The storage unit 53 is, for example, a system program that can be executed by the acoustic signal control device 100, various processing programs that can be executed by the system program, data that is used when these various processing programs are executed, and arithmetic processing performed by the CPU 51. The processing result data and the like are stored. The program is stored in the storage unit 53 in the form of a computer readable program code.

  For example, as shown in FIG. 1, the storage unit 53 stores a signal processing program 53a, a sound output control program 53b, and the like.

For example, the signal processing program 53a inputs a control signal to the signal processing unit 1 and performs predetermined acoustic signal processing (for example, FIG. 3) on the acoustic signal input from the tuner 200, thereby generating the acoustic signal. A function of causing the sound output control unit 4 to output the signal f ₂ (n _B ) based on the acoustic signal to the drive unit 2 is realized by the CPU 51.

  The sound output control program 53b has, for example, a function of inputting a control signal to the sound output control unit 4, performing a predetermined process on the acoustic signal input from the signal processing unit 1, and causing the amplifier 300 to output the function. Make it happen.

According to the acoustic signal control apparatus 100 of the present invention described above, based on the respective acoustic signals (acoustic signals relating to the first TV program to the fourth TV program) input from the tuner 200 having a plurality of acoustic sources, tactile sensation / vibration is performed. A coupling device 3 in which a tactile / vibration presentation device 3a that presents a sensation stimulus and an operation device 3b that is operated when instructing to perform a predetermined process on the acoustic signal are integrated and combined with a plurality of acoustic devices. The signal processing unit 1 and the driving unit 2 that control the tactile / vibratory sensation presented by the tactile / vibration sensation presentation device 3a and the sound based on the acoustic signal are output to the output device 400. And a sound output control unit 4. Then, the signal processor 1 and the drive unit 2 use the intensity signal P _R (n _B ) representing the temporal change of the intensity of the acoustic signal and the smoothed intensity signal P _A (smoothed from the intensity signal P _R (n _B ) ( n _B ), and when the intensity signal P _R (n _B ) becomes larger than the smoothed intensity signal P _A (n _B ), the tactile / vibration sense presentation device 3a presents the tactile / vibration sense stimulus And the presentation is continued for a predetermined time ( _TP ).
That is, a tactile / vibration presentation device 3a corresponding to each acoustic signal input from the tuner 200 is provided, and a tactile / vibration stimulus based on the corresponding acoustic signal is presented from each tactile / vibration presentation device 3a. Therefore, the user can intuitively select the sound signal related to a desired program from the sound signals related to a plurality of programs input from the tuner 200.
In addition, since the operation device 3b to be operated is known by tactile / vibration sense stimulation, the user does not need to look at the operation device 3b during operation, and does not need to take his eyes off the screen when viewing a TV program.

  Further, according to the acoustic signal control apparatus 100, the intensity signal is an intensity signal of a prediction error signal in linear prediction analysis. Therefore, the timing of the tactile / vibration sense stimulation presented by the tactile / vibration presentation device 3a can be substantially synchronized with the timing of the consonant part and the vowel part at the start time, so that the timing is close to the timing of human perception. Thus, the tactile / vibration sensation can be presented, and the user can easily associate the sound with the tactile / vibration sensation.

In addition, according to the acoustic signal control device 100, the signal processing unit 1 and the driving unit 2 send the baseband signal (signal f ₂ (n _B ) input from the signal processing unit 1) to the tactile / vibration presentation device 3a. One of the tactile / vibration sense stimulus based on the above and the tactile / vibration sense stimulus based on the first amplitude modulation signal f ₃ (n _B ) amplitude-modulated to a preset frequency can be presented. Further, the tactile / vibration presentation device 3a is amplitude-modulated to a tactile / vibration stimulus based on a baseband signal (signal f ₂ (n _B ) input from the signal processing unit 1) and a preset frequency. The signal processing unit 1 and the tactile / vibratory stimulus based on the second amplitude modulation signal f ₄ (n _B ) (ie, the tactile / vibratory sense stimulus based on the signal f ₅ (n _B )) are presented. Since the drive part 2 can also be comprised, more information can be shown to a user's fingertip.

  The present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the gist thereof.

<< Modification 1 >>
In the embodiment, in the acoustic signal processing (FIG. 3) by the signal processing unit 1, the intensity signal of the prediction error signal in the linear prediction analysis is used as the intensity signal P _R (n _B ) representing the temporal change of the intensity of the acoustic signal. The method, that is, the method using the sum of squares of the prediction errors has been shown, but the intensity signal P _R (n _B ) representing the temporal change in the intensity of the acoustic signal may be, for example, the square sum of the acoustic signal itself. Good.

Specifically, for example, instead of steps S3 and S4 of the audio signal processing by the signal processing unit 1 of the embodiment (FIG. 3), T _S sample values at the center of one block (i.e., analysis buffer The sum of squares of y (t) (sample value of (T _N −T _S ) / 2 ≦ t <(T _N + T _S ) / 2) of y (t) (0 ≦ t <T _N )) The acoustic signal energy) may be obtained and used as the intensity signal P _R (n _B ).

Here, FIG. 6 shows an example of the waveform of each signal when the acoustic signal processing of the first modification is applied to the acoustic signal x (t) relating to the voice “The gray-haired grandmother wears a cane”.
6A shows the waveform of the input acoustic signal x (t), and FIG. 6B shows the intensity signal P _R (n _B ), the first threshold signal P _H (n _B ), and the second threshold signal P _L. (n _B ) waveform, FIG. 6C shows the waveform of the signal f ₁ (n _B ), FIG. 6D shows the waveform of the signal f ₂ (n _B ), and FIG. 6E shows the first amplitude modulation signal. It is a waveform of f ₃ (n _B ).

In the example of the waveform of each signal when the acoustic signal processing of the embodiment (FIG. 3) is applied (FIG. 4), the signal f ₂ (n _B ) is “aunt” at the beginning of “grandmother” In the example of the waveform of each signal when the acoustic signal processing of the first modification is applied (FIG. 6), the signal f ₂ (n _B ) The sound signal energy in the middle of the word "" has responded to the part of "Ms." That is, the modification 1 is inferior to the embodiment in terms of the timing at which a person feels audibly.
However, with regard to “Hakuhatsu” and “On the foot”, in the first modification, the signal f ₂ (n _B ) shows the same reaction as in the example, suggesting that it is sufficiently practical. Is done.

  According to Modification 1 described above, even with a simple configuration that does not use the linear prediction analysis method, tactile / vibration sensation can be presented at a timing close to the timing of human perception. The user can easily associate the sound with the tactile / vibration stimulus.

<< Modification 2 >>
The method of not using the intensity signal of the prediction error signal in the linear prediction analysis as the intensity signal P _R (n _B ) representing the time change of the intensity of the acoustic signal is not limited to the first modification, and the intensity time of the acoustic signal The intensity signal P _R (n _B ) representing the change may be, for example, an aperiodic component intensity signal.

Specifically, for example, instead of steps S3 and S4 of the acoustic signal processing (FIG. 3) by the signal processing unit 1 of the embodiment, the signal waveforms of two different time intervals having a length of about 10 milliseconds are used. The energy of the difference waveform may be obtained and used as the intensity signal P _R (n _B ).

  Even when the acoustic signal processing of the second modification is applied, the consonant part and the vowel part at the start time can be detected, which suggests that it is sufficiently practical as a substitute for the linear prediction analysis method.

  According to the modified example 2 described above, even with a simple configuration that does not use the linear prediction analysis method, it is possible to present tactile / vibratory sensation at a timing close to the timing of human perception. The user can easily associate the sound with the tactile / vibration stimulus.

<< Modification 3 >>
The acoustic signal control device 100 is not limited to a device incorporated in a television receiver or the like, and may be incorporated in a hearing aid or the like, for example, like the acoustic signal control device 100J shown in FIGS. .

FIG. 7 is a block diagram showing a functional configuration of the acoustic signal control device 100J, and FIG. 8 shows a signal flow in the acoustic signal control device 100J.
The acoustic signal control device 100J differs from the acoustic signal control device 100 (FIGS. 1 and 2) of the embodiment only in the configuration of the acoustic signal input device (tuner 200), for example. Therefore, only different parts will be described, and other common parts will be described with the same reference numerals.

  Specifically, for example, as shown in FIG. 7, the acoustic signal control device 100J includes a signal processing unit 1 connected to a hearing aid system 200J with a signal separation function, a drive unit 2, and a tactile / vibration sense presentation device 3a. The coupling device 3 is formed by integrating the operation device 3b, the sound output control unit 4 connected to the amplifier 300, the control unit 5, and the like.

[Hearing aid system with signal separation function]
The hearing aid system with signal separation function 200J is a hearing aid system that can separate, for example, acoustic signals relating to the voices of a plurality of speakers for each speaker.
Specifically, the hearing aid system 200J with a signal separation function includes a plurality of microphones 200aJ as shown in FIGS. 7 and 8, for example. The signal separation function-equipped hearing aid system 200J separates, for each speaker, acoustic signals related to the voices of a plurality of speakers received by a plurality of microphones 200aJ, for example, and each of the acoustic signals related to the voices of the plurality of speakers. Are separately input to the acoustic signal control device 100J. That is, the hearing aid system 200J with a signal separation function is a sound signal input device that has a plurality of sound sources and inputs sound signals from the plurality of sound sources to the sound signal control device 100J.

For example, the hearing aid system 200J with a signal separation function shown in FIG. 8 sends acoustic signals relating to the voices of four speakers to the acoustic signal control device 100J (signal processing unit 1) as acoustic signals relating to the voices of a plurality of speakers. It comes to input.
And each of the acoustic signal regarding the voice of four speakers is inputted into the 1st signal processing part-the 4th signal processing part of signal processing part 1, for example.

According to the acoustic signal control apparatus 100J of Modification 3 described above, each acoustic signal (acoustic signal related to the speech of four speakers) input from the hearing aid system 200J with a signal separation function having a plurality of acoustic sources is used. Based on this, a coupling device in which a tactile / vibration presentation device 3a that presents a tactile / vibration stimulus and an operation device 3b that is operated to instruct to perform a predetermined process on an acoustic signal are combined and integrated. 3 corresponding to each of a plurality of acoustic sources, a signal processing unit 1 and a driving unit 2 for controlling a tactile / vibration sense stimulus presented by the tactile / vibration sense presentation device 3a, and a sound based on the acoustic signal. And a sound output control unit 4 to be output by the output device 400. Then, the signal processor 1 and the drive unit 2 use the intensity signal P _R (n _B ) representing the temporal change of the intensity of the acoustic signal and the smoothed intensity signal P _A (smoothed from the intensity signal P _R (n _B ) ( n _B ), and when the intensity signal P _R (n _B ) becomes larger than the smoothed intensity signal P _A (n _B ), the tactile / vibration sense presentation device 3a presents the tactile / vibration sense stimulus The presentation is continued for a predetermined time.
That is, a tactile / vibration presentation device 3a corresponding to each of the acoustic signals input from the hearing aid system 200J with a signal separation function is provided, and the tactile / vibration based on the corresponding acoustic signal is received from each of the tactile / vibration presentation devices 3a. Since the auditory stimulus can be presented, the user intuitively selects the acoustic signal related to the desired speech from the acoustic signals related to the speech of the plurality of speakers input from the hearing aid system 200J with a signal separation function. be able to.
Further, since the operation device 3b to be operated is known by tactile / vibration sense stimulation, the user does not need to look at the operation device 3b at the time of operation, and does not need to keep an eye on the conversation partner or the like.

<< Modification 4 >>
Further, the acoustic signal control device 100 may be incorporated in an acoustic signal editor such as a mixing console, for example, like the acoustic signal control device 100K shown in FIGS. 9 and 10.

FIG. 9 shows a block diagram showing a functional configuration of the acoustic signal control device 100K, and FIG. 10 shows a signal flow in the acoustic signal control device 100K.
The acoustic signal control device 100K is, for example, one of the configurations of the acoustic signal input device (tuner 200) and the coupling device 3 compared to the acoustic signal control device 100 (FIGS. 1 and 2) of the embodiment. Only the configuration of the sound output control unit 4 and a part of the configuration of the control unit 5 are different. Therefore, only different parts will be described, and other common parts will be described with the same reference numerals.

  Specifically, for example, as shown in FIG. 9, the acoustic signal control device 100K includes a signal processing unit 1 connected to the music source input device 200K, a drive unit 2, a tactile / vibration sense presentation device 3a, and an operation device. It is configured to include a coupling device 3K in which 3bK is integrally coupled, a mixer 4K connected to the amplifier 300, a control unit 5K, and the like.

[Music source input device]
The music source input device 200K is a device that can input acoustic signals from a plurality of music sources such as a drum music source, a vocal music source, a piano music source, and a bass guitar music source.
Specifically, for example, as shown in FIGS. 9 and 10, the music source input device 200 </ b> K inputs each of the acoustic signals from a plurality of music sources to the acoustic signal control device 100 </ b> K independently. That is, the music source input device 200K is a sound signal input device that has music sources as a plurality of sound sources and inputs sound signals from the plurality of music sources to the sound signal control device 100K.

For example, the hearing aid system 200K with a signal separation function shown in FIG. 10 uses, as an acoustic signal from a plurality of music sources, acoustic signals from four types of music sources, a first music source to a fourth music source, as an acoustic signal control device. Input to 100K (signal processing unit 1).
Each of the acoustic signals from, for example, four types of music sources is input to the first signal processing unit to the fourth signal processing unit of the signal processing unit 1.

[Coupling device]
The coupling device 3K is, for example, a combination of a tactile / vibration presentation device 3a and an operation device 3bK that is operated when the user instructs the acoustic signal to perform predetermined processing. It is provided for each of a plurality of music sources.

For example, the four coupling devices 3K shown in FIG. 10 correspond to each of the first music source to the fourth music source.
Then, the coupling device 3K corresponding to the first music source causes the tactile / vibration presentation device 3a driven by the first drive unit and the user to perform predetermined processing on the acoustic signal from the first music source. And an operation device 3bK for instructing.
The coupling device 3K corresponding to the second music source instructs the tactile / vibration presentation device 3a driven by the second driving unit and the user to perform predetermined processing on the acoustic signal from the second music source. Operation device 3bK.
The coupling device 3K corresponding to the third music source instructs the tactile / vibration presentation device 3a driven by the third driving unit and the user to perform predetermined processing on the acoustic signal from the third music source. Operation device 3bK.
The coupling device 3K corresponding to the fourth music source instructs the tactile / vibration presentation device 3a driven by the fourth driving unit and the user to perform predetermined processing on the acoustic signal from the fourth music source. Operation device 3bK.

  Specifically, the operation device 3bK is, for example, a slide-type variable resistor. For example, when operated (slided) by the user, the operation signal is sent to the sound output control unit 4 via the control unit 5K. It is designed to output.

  For example, as shown in FIG. 10, the coupling device 3K is formed by surrounding the tactile / vibration sensation presentation device 3a that is the stimulus presentation portion with the operation device 3bK that is the stimulus non-presentation portion, and the operation device 3bK operates the operation device 3bK. Then, the tactile / vibration presentation device 3a also moves together with the operation device 3bK. Therefore, even if the operation device 3bK is operated, the finger pressure on the tactile / vibration sensation presentation device 3b hardly fluctuates, so that the human fingertip is presented without being affected by the presence or absence of the operation of the operation device 3bK. It can sense tactile and vibration stimuli.

  Here, the operation device 3bK is, for example, when the user wants to adjust the volume among a plurality of sounds (sounds based on acoustic signals from the first music source to the fourth music source) that the user is listening to at the same time. In addition, it is operated when the sound is selected and the volume is adjusted.

[mixer]
In accordance with the control signal input from the control unit 5K, the mixer 4K performs, for example, an output control unit on the acoustic signal input from the signal processing unit 1 and outputs the acoustic signal to the amplifier 300. The output device 400 outputs a sound based on the above.
Here, the predetermined processing, for example, adjusts the volume of the sound signal from the plurality of music sources input from the music source input device 200K via the signal processing unit 1 according to the operation of the operation device 3bK by the user, and This is a process of taking a weighted average of the sound signal whose volume has been adjusted and outputting it to the output device 400 via the amplifier 300.

[Control unit]
For example, as shown in FIG. 9, the control unit 5K includes a CPU 51, a RAM 52, a storage unit 53K, and the like.

  For example, as shown in FIG. 9, the storage unit 53K stores a signal processing program 53a, a sound output control program 53bK, and the like.

  For example, the sound output control program 53bK causes the CPU 51 to realize a function of inputting a control signal to the mixer 4K, performing a predetermined process on the acoustic signal input from the signal processing unit 1, and outputting the signal to the amplifier 300. .

According to the acoustic signal control device 100K of Modification 4 described above, the acoustic signals (from the first music source to the fourth music source) input from the music source input device 200K having a plurality of music sources. The tactile / vibration presentation device 3a for presenting a tactile / vibration stimulus and the operation device 3bK operated when instructing to perform predetermined processing on the acoustic signal. The signal processing unit 1 and the drive unit 2 that control the haptic / vibratory sensation presented by the haptic / vibratory sensation presentation device 3a, and the coupling device 3K coupled to each of the plurality of acoustic sources, And a sound output control unit 4 that causes the output device 400 to output a sound based on the signal. Then, the signal processor 1 and the drive unit 2 use the intensity signal P _R (n _B ) representing the temporal change of the intensity of the acoustic signal and the smoothed intensity signal P _A (smoothed from the intensity signal P _R (n _B ) ( n _B ), and when the intensity signal P _R (n _B ) becomes larger than the smoothed intensity signal P _A (n _B ), the tactile / vibration sense presentation device 3a presents the tactile / vibration sense stimulus The presentation is continued for a predetermined time.
That is, a tactile / vibration presentation device 3a corresponding to each acoustic signal input from the music source input device 200K is provided, and a tactile / vibration stimulation based on the corresponding acoustic signal is received from each tactile / vibration presentation device 3a. Therefore, the user can intuitively select an audio signal input from a desired music source from among the audio signals input from a plurality of music sources of the music source input device 200K. it can.
Further, since the operation device 3bK to be operated is known by tactile / vibration sense stimulation, the user does not need to look at the operation device 3bK during the operation.

<< Modification 5 >>
As described above, humans do not have so much discrimination ability with respect to tactile and vibration sense stimuli. Therefore, by devising the examples and modified examples 1 to 4, a tactile sense / vibration sense stimulus having a synchronism with an acoustic signal and identifiable by a human is presented. However, humans are still confused when multiple sounds are generated simultaneously and multiple stimuli are presented simultaneously. Therefore, for example, like the acoustic signal control device 100L shown in FIG. 11 and FIG. 12, it is preferable to prevent confusion by making it difficult for a plurality of tactile and vibration sense stimuli to be presented simultaneously.

FIG. 11 is a block diagram showing a functional configuration of the acoustic signal control device 100L, and FIG. 12 shows a signal flow in the acoustic signal control device 100L.
Note that the acoustic signal control device 100L is, for example, a part of the configuration of the signal processing unit 1 and a part of the configuration of the control unit 5 compared to the acoustic signal control device 100 (FIGS. 1 and 2) of the embodiment. And only the difference. Therefore, only different parts will be described, and other common parts will be described with the same reference numerals.

  Specifically, for example, as illustrated in FIG. 11, the acoustic signal control device 100L includes a signal processing unit 1L connected to the tuner 200, a driving unit 2, a tactile / vibration sense presentation device 3a, and an operation device 3b. The coupling device 3 is integrated and coupled, the sound output control unit 4 connected to the amplifier 300, the control unit 5, and the like.

[Signal processing section]
The signal processing unit 1L performs, for example, predetermined acoustic signal processing on the acoustic signal input from the tuner 200 in accordance with the control signal input from the control unit 5L, and outputs the acoustic signal to the sound output control unit 4. At the same time, the tactile / vibration sensation based on the acoustic signal is presented to the tactile / vibration presentation device 3a via the drive unit 2.

For example, the signal processing unit 1L illustrated in FIG. 12 includes a first signal processing unit to a fourth signal processing unit, and a maximum smoothed intensity signal determination unit 11L.
For example, in the signal processing unit 1 </ b> L illustrated in FIG. 12, each of the first signal processing unit to the fourth signal processing unit performs acoustic signal processing and outputs the acoustic signal x (t) to the sound output control unit 4. In addition, a signal f ₂ (n _B ) for driving the tactile / vibration presentation device 3 a is output to the drive unit 2.

Specifically, the signal processing unit 1L, for example, an intensity signal representing the time variation of the intensity of the acoustic signal P _R (n _B), the intensity signal P _R (n _B) was smoothed smoothing intensity signal P _A (n _B ), and the maximum smoothed intensity signal P _A (n) where the intensity signal P _R (n _B ) has the maximum value among the smoothed intensity signals P _A (n _B ) of the respective acoustic signals. When it becomes larger than _B ), the presentation of the tactile / vibration sensation by the tactile / vibration presentation device 3a is started via the drive unit 2, and the presentation is continued for a predetermined time ( _TP ).

More specifically, in the acoustic signal processing by the signal processing unit 1L, for example, the processing of steps S1 to S5 of the acoustic signal processing (FIG. 3) by the signal processing unit 1 of the embodiment is executed, and then the maximum smoothing is performed. The intensity signal determination unit 11L sets the maximum value of the smoothed intensity signal P _A (n _B ) among the smoothed intensity signals P _A (n _B ) of each acoustic signal generated in step S5 as the maximum value. As a smoothing intensity signal P _A (n _B ), instead of step S6, the first threshold signal P _H (n _B ) is increased by “1 dB from the maximum smoothing intensity signal P _A (n _B ). The signal “is set, and the second threshold signal P _L (n _B )“ the signal obtained by reducing the maximum smoothed intensity signal P _A (n _B ) by 5 dB ”is set. The process of S18 is executed.

[Control unit]
For example, as illustrated in FIG. 11, the control unit 5L includes a CPU 51, a RAM 52, a storage unit 53L, and the like.

  For example, as illustrated in FIG. 11, the storage unit 53L stores a signal processing program 53aL, a sound output control program 53b, and the like.

For example, the signal processing program 53aL inputs a control signal to the signal processing unit 1L, performs predetermined acoustic signal processing on the acoustic signal input from the tuner 200, and sends the acoustic signal to the sound output control unit 4. The CPU 51 realizes a function of outputting the signal f ₂ (n _B ) based on the acoustic signal to the driving unit 2 while outputting the signal.

According to the acoustic signal control unit 100L modification 5 described above, the signal processing unit 1L and the drive unit 2, an intensity signal representing the time variation of the intensity of the acoustic signal P _R (n _B), the intensity signal P _R ( and n _B) a smoothed smoothing intensity signal P _a (n _B), the calculated intensity signal P _R (n _B) is the largest among the smoothing intensity signal P _a of the audio signal (n _B) When the value becomes larger than the maximum smoothed intensity signal P _A (n _B ) having a value, presentation of the tactile / vibratory sensation stimulus by the tactile / vibration presentation device 3a is started, and the presentation is performed for a predetermined time (T _P ) It is supposed to continue.
Therefore, f ₂ (n _B ) = 1 is unlikely to occur except for an acoustic signal having the maximum auditory stimulus, and thus it is difficult for tactile and vibration sense stimuli to be presented at the same time, thereby suppressing user confusion. Can do.
On the other hand, if there is an acoustic signal with an auditory stimulus that is almost equivalent to the largest auditory stimulus, tactile / vibratory stimuli based on the acoustic signal are also presented, so the user's selection range should be limited too easily. There is no.

In Modification 5, the intensity signal P _R (n _B ) representing the temporal change in intensity of the acoustic signal may be the sum of squares of the acoustic signal itself as in Modification 1, or Modification 2 As described above, the intensity signal may be an aperiodic component.
Further, in the fifth modification, the acoustic signal control device 100L may be provided in a hearing aid or the like connected to the hearing aid system 200J with a signal separation function, for example, like the acoustic signal control device 100J in the third modification. As in the acoustic signal control device 100K of the fourth modification, the acoustic signal editing device or the like may be provided by connecting to the music source input device 200K.

In addition, if the confusion can be suppressed by making it difficult for a plurality of tactile and vibration sensation stimuli to be presented simultaneously, the signal processing unit 1L and the driving unit 2 may have a certain time (for example, T _P At + T _M ), the tactile / vibratory sensation presentation device 3a corresponding to the acoustic signal with the strongest auditory stimulation based on the acoustic signal may be presented.
Specifically, for example, when the tactile / vibration presentation device 3a corresponding to the acoustic signal with the strongest auditory stimulus operates (when f ₂ (n _B ) = 1), a predetermined time (for example, T _P + T _M ) may be controlled so that the other tactile / vibration presentation devices 3a... Are not operated.

<< Modification 6 >>
The method for suppressing human confusion caused by the simultaneous presentation of a plurality of tactile and vibration sense stimuli is not limited to the fifth modified example. For example, as in the acoustic signal control device 100M shown in FIGS. A technique may be used in which the time axis of the acoustic signal is expanded and contracted so that a plurality of tactile / vibratory sensations are not presented simultaneously.

FIG. 13 is a block diagram showing a functional configuration of the acoustic signal control device 100M, and FIG. 13 shows a signal flow in the acoustic signal control device 100M.
Note that the acoustic signal control device 100M is different from the acoustic signal control device 100 of the embodiment (FIGS. 1 and 2) in that a time axis expansion / contraction unit 6M is added and a part of the configuration of the control unit 5 is used. And only the difference. Therefore, only different parts will be described, and other common parts will be described with the same reference numerals.

  Specifically, for example, as shown in FIG. 13, the acoustic signal control device 100M includes a time axis expansion / contraction unit 6M connected to the tuner 200, a signal processing unit 1, a driving unit 2, and a tactile / vibration sensation presentation device. The coupling device 3 is formed by integrating the 3a and the operation device 3b, the sound output control unit 4 connected to the amplifier 300, the control unit 5, and the like.

The time axis expansion / contraction unit 6M uses the general time axis expansion / contraction technology (Time Scale Modification technology) as the time axis expansion / contraction means according to the control signal input from the control unit 5M, for example. The time axis of the signal is expanded and contracted and output to the signal processing unit 1.
Accordingly, the signal processing unit 1 and the drive unit 2 cause the tactile / vibration presentation device 3a to present a tactile / vibration sense stimulus based on an acoustic signal whose time axis is expanded / contracted by the time axis expansion / contraction unit 6M, thereby controlling sound output. The unit 4 causes the output device 400 to output a sound based on the acoustic signal whose time axis is expanded and contracted by the time axis expanding and contracting unit 6M.

For example, the time axis expansion / contraction unit 6M illustrated in FIG. 13 expands / contracts the time axis of the audio signal related to the first TV program to the fourth TV program input from the tuner 200, and the first signal processing unit to the fourth signal processing unit 1 of the signal processing unit 1. Output to the signal processor.
As a result, the tactile / vibration presentation device 3a corresponding to the sound signals related to the first TV program to the fourth TV program is tactile / vibration based on the sound signals related to the first TV program to the fourth TV program whose time axis is expanded and contracted. Will be presented, and the output device 400 will output sounds based on the acoustic signals related to the first TV program to the fourth TV program whose time axis is expanded and contracted.

  Specifically, the time axis expansion / contraction unit 6M detects, for example, a sound part (sound part) of an acoustic signal, and if there is a region where the sound part overlaps between a plurality of sound signals, the sound part The time axis of the non-sound area (silent part) is expanded and contracted so that there is no overlapping area.

Here, a specific example of the expansion and contraction of the time axis of the acoustic signal will be described with reference to FIG.
FIG. 15 shows, for example, the waveform of the acoustic signal related to the first TV program and the waveform of the acoustic signal related to the second TV program. FIG. 15A shows before the time axis is expanded and contracted, and FIG. 15B shows after the time axis is expanded and contracted.

According to FIG. 15A, it can be seen that the sound of the first TV program and the sound of the second TV program overlap each other in the area indicated by the oblique lines.
On the other hand, according to FIG. 15B, the sound of the silent portion of the sound signal related to the first TV program is expanded and the sound of the silent portion of the sound signal related to the second TV program is shortened. It can be seen that there is no longer a region where the sound of the second TV program overlaps.

[Control unit]
As shown in FIG. 13, for example, the control unit 5M includes a CPU 51, a RAM 52, a storage unit 53M, and the like.

  For example, as illustrated in FIG. 13, the storage unit 53M stores a signal processing program 53a, a sound output control program 53b, a time axis expansion / contraction program 53cM, and the like.

  The time axis expansion / contraction program 53cM, for example, causes the CPU 51 to realize a function of extending a time axis of an acoustic signal input from the tuner 200 by inputting a control signal to the time axis expansion / contraction unit 6M.

According to the acoustic signal control device 100M of the modification 6 described above, the time axis expansion / contraction unit 6M that expands / contracts the time axis of the acoustic signal input from the tuner 200 is provided. The vibration sense presentation device 3a is caused to present a tactile / vibration sense stimulus based on an acoustic signal whose time axis is expanded and contracted by the time axis expansion and contraction unit 6M.
That is, if there is a region where the sound part overlaps between a plurality of sound signals, the time axis is expanded and contracted so that there is no region where the sound part overlaps, so that a plurality of f ₂ (n _B ) = 1 simultaneously. The tactile sense / vibration sense stimulus is not presented at the same time, and the user's confusion can be suppressed.

In Modification 6, the intensity signal P _R (n _B ) representing the temporal change in intensity of the acoustic signal may be the sum of squares of the acoustic signal itself as in Modification 1, or Modification 2 As described above, the intensity signal may be an aperiodic component.
Further, in the sixth modification, the acoustic signal control device 100M may be provided in a hearing aid or the like connected to the hearing aid system 200J with a signal separation function, for example, like the acoustic signal control device 100J in the third modification. As in the acoustic signal control device 100K of the fourth modification, the acoustic signal editing device or the like may be provided by connecting to the music source input device 200K.

  In Examples and Modifications 1 to 6, the acoustic signal control devices 100, 100J to 100M, the acoustic signal input device (the tuner 200, the hearing aid system 200J with a signal separation function, the music source input device 200K, etc.), the amplifier 300 and the output device 400 do not need to be separate, and may be integrated.

  Further, in the embodiments and the first to sixth modifications, the number of coupling devices 3 is not limited to four, and is arbitrary as long as it is plural and corresponds to the number of acoustic sources. Of course, the number of signal processing units (first signal processing unit ...) in the signal processing units 1 and 1L, the number of driving units (first driving unit ...) in the driving unit 2, etc. are changed accordingly. The

It is a block diagram which shows the functional structure of the acoustic signal control apparatus of an Example. It is a figure which shows the flow of the signal in the acoustic signal control apparatus of an Example. It is a flowchart which shows the acoustic signal process by the signal processing part of the acoustic signal control apparatus of an Example. It is a figure which shows the example of the waveform of each signal at the time of the signal processing part of the acoustic signal control apparatus of an Example applying the acoustic signal process with respect to the acoustic signal regarding the audio | voice that "granny of gray hair attaches a cane". It is a figure which shows the coupling device of the acoustic signal control apparatus of an Example. It is a figure which shows the example of the waveform of each signal when the signal processing part of the acoustic signal control apparatus of the modification 1 applies an acoustic signal process with respect to the acoustic signal regarding the audio | voice that a "granny of gray hair attaches a cane". . It is a block diagram which shows the functional structure of the acoustic signal control apparatus of the modification 3. It is a figure which shows the flow of a signal in the acoustic signal control apparatus of the modification 3. It is a block diagram which shows the functional structure of the acoustic signal control apparatus of the modification 4. It is a figure which shows the flow of the signal in the acoustic signal control apparatus of the modification 4. It is a block diagram which shows the functional structure of the acoustic signal control apparatus of the modification 5. It is a figure which shows the flow of a signal in the acoustic signal control apparatus of the modification 5. It is a block diagram which shows the functional structure of the acoustic signal control apparatus of the modification 6. It is a figure which shows the flow of a signal in the acoustic signal control apparatus of the modification 6. It is a figure which shows the specific example about expansion / contraction of the time axis | shaft of the acoustic signal by the signal expansion-contraction part of the acoustic signal control apparatus of the modification 6.

Explanation of symbols

1,1L signal processor (tactile / vibration presentation control means)
2 Drive unit (tactile / vibration presentation control means)
3 Coupling device 3a Tactile / vibration presentation device 3b, 3bK Operation device 4 Sound output control unit (output control means)
4K mixer (output control means)
6M Time axis expansion / contraction part (Time axis expansion / contraction means)
100, 100J, 100K, 100L, 100M Acoustic signal control device 400 Output device

Claims (8)

A tactile / vibratory sensation presentation device for presenting tactile / vibratory sensation based on respective acoustic signals input from a plurality of acoustic sources, and operated when instructing to perform predetermined processing on the acoustic signal A manipulation device and a coupling device integrated and coupled to each of the plurality of acoustic sources,
Tactile / vibration sense presentation control means for controlling the tactile / vibration sense stimulus presented by the tactile / vibration sense presentation device;
Output control means for causing the output device to output sound based on the acoustic signal;
An acoustic signal control device comprising: The acoustic signal control device according to claim 1,
The tactile / vibration sensation presentation control means obtains an intensity signal representing a temporal change in intensity of the acoustic signal and a smoothed intensity signal obtained by smoothing the intensity signal, and the intensity signal is the smoothed intensity signal. An acoustic signal control apparatus characterized by starting presentation of the tactile / vibration sensation by the tactile / vibration presentation device and continuing the presentation for a predetermined time. The acoustic signal control device according to claim 2,
The acoustic signal control apparatus, wherein the intensity signal is an intensity signal of a prediction error signal in linear prediction analysis. The acoustic signal control device according to claim 2,
The acoustic signal control device, wherein the intensity signal is an intensity signal of an aperiodic component. In the acoustic signal control device according to any one of claims 1 to 4,
The tactile / vibration presentation control means includes a tactile / vibration presentation device based on a tactile / vibration stimulus based on a baseband signal and / or an amplitude-modulated signal that is amplitude-modulated to a preset frequency. An acoustic signal control device characterized by presenting a sense of stimulus. In the acoustic signal control device according to any one of claims 1 to 5,
The tactile / vibration presentation control means causes the tactile / vibration presentation device corresponding to the acoustic signal with the strongest auditory stimulus based on the acoustic signal to present the tactile / vibration stimulation in a certain time. Acoustic signal control device. In the acoustic signal control device according to any one of claims 1 to 5,
A time axis expansion / contraction means for expanding and contracting the time axis of the acoustic signal;
The tactile / vibration presentation control unit causes the tactile / vibration presentation device to present a tactile / vibration stimulus based on an acoustic signal whose time axis is expanded and contracted by the time axis expansion and contraction unit. Control device. A tactile / vibratory sensation presentation device for presenting tactile / vibratory sensation based on respective acoustic signals input from a plurality of acoustic sources, and operated when instructing to perform predetermined processing on the acoustic signal A manipulation device and a coupling device integrated and coupled to each of the plurality of acoustic sources,
Tactile / vibration sense presentation control means for controlling the tactile / vibration sense stimulus presented by the tactile / vibration sense presentation device;
Output control means for causing the output device to output sound based on the acoustic signal;
With
The tactile / vibration presentation control means obtains an intensity signal of a prediction error signal in linear prediction analysis representing a temporal change in intensity of the acoustic signal, and a smoothed intensity signal obtained by smoothing the intensity signal. When the intensity signal becomes larger than the smoothed intensity signal, the tactile / vibration presentation device uses the tactile / vibration sensation based on the intensity signal and / or amplitude modulation amplitude-modulated to a preset frequency. An acoustic signal control device characterized by starting presentation of a tactile / vibration stimulus based on a signal and continuing the presentation for a predetermined time.

Images