CN102333266B

CN102333266B - Audio-signal processing apparatus, method, program and microphone apparatus

Info

Publication number: CN102333266B
Application number: CN201110146890.3A
Authority: CN
Inventors: 北泽雄司; 浅田宏平
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2010-06-01
Filing date: 2011-05-25
Publication date: 2016-06-15
Anticipated expiration: 2031-05-25
Also published as: SG176404A1; KR20110132247A; JP2011254188A; TW201218785A; EP2393305B1; EP2393305A2; CN102333266A; BRPI1102464A2; US9485569B2; US20110293102A1; EP2393305A3; US8699718B2; US20140177851A1; JP5593851B2

Abstract

The present invention discloses audio-signal processing apparatus, method, program and microphone apparatus. A kind of audio-signal processing apparatus comprises: slide detection part, the voice signal collected by microphone is transfused to slide detection part, and the judgement of slide detection part slip sound signal components in input audio signal by utilizing process judges that beginning and the end of slide, slip sound signal components are by microphone originally slide generation with it or near it; And function unit, this function unit the slide determined by slide detection part to terminate period during, perform for slide arrange predetermined control process.

Description

Audio-signal processing apparatus, method, program and microphone apparatus

Technical field

It relates to the voice signal collected by microphone detects audio-signal processing apparatus and the audio signal processing method of user operation input. Further, it relates to program for realizing audio-signal processing apparatus and audio signal processing method. In addition, it relates to provide the microphone apparatus of voice signal to audio-signal processing apparatus.

Background technology

In various electronics, operated key, keyboard, mouse, operation board, touch panel etc. are used as the equipment for inputting user operation.

Usually, these operating equipments are mounted according to the function of electronics. On the other hand, depend on function or the use of electronics, it is desirable to make the number of operated key little as far as possible, or make it possible to carry out being easy to use and operate efficiently.

The anexamined patent application gazette No.2008-166897 of Japan above-mentioned discloses the technology of the equipment that microphone is used as operation input. Disclosed in the anexamined patent application gazette No.2008-166897 of Japan this technology by user finger microphone and near rap be identified as operation input. For this reason, the waveform of the voice signal collected by microphone when user knocks microphone is identified by waveform relevant treatment.

Summary of the invention

As, in the anexamined patent application gazette No.2008-166897 of above-mentioned Japan, the ability that microphone is also used as input unit can contribute to the number of the operated key reduced on equipped case and improve operability.

Such as, as the operation on portable music player, it is assumed that microphone is attached to the situation of the earphone portion that user wears. Portable music player is placed on pocket, the Bao Dengzhong of clothes by user usually. If user can by performing predetermined operation near the microphone ground that knocks in earphone portion, then this can exempt the trouble that portable music player is taken out by user.

On the other hand, owing to " knocking " is detected, although the action equivalent with the gesture (such as, broadcasting/time-out/record/electric power on/off) of " pressing button is once " therefore can be carried out, but above-mentioned technology is not suitable for " operating gesture that the time that button is pressed is more important ".

Such as, above-mentioned technology is not suitable for " performing the operation of F.F. during playback when a button is depressed " as fast-forward playback, or the action of such as " when pressing button change playback tone or playback speed " and so on.

When the operation that operation amount is relevant, such as, in the situation of " advances " of volume raise/lower and cursor or menu selected portion, can be used to perform these operate although knocking, but to knock in some cases be inconvenient. Such as, for the operation species of the operating component being applicable to such as rotating disk or sliding bar and so on, it is inconvenient for knocking.

Such as, when by, when knocking operational applications in volume raise/lower, the operator scheme that can expect is knocked by every single time to make volume raise (or reduction) rank. So, in order to significantly raise (reduction) volume fast, when knocking operation, it is necessary to perform to knock many times, so that be difficult to carry out fast operating. In addition, the operation produced is neither directly perceived also to be not easy to use.

Although it is favourable for using microphone as input unit and allowing to be operated by knocking of carrying out in the above described manner, but such operation input pattern is not suitable for the operation of some kinds of such as operate continuously and so on and the relevant operation of operation amount.

Wish to utilize microphone carry out even operate continuously as input unit or specify the operation of operation amount, so that the operation input pattern utilizing microphone can be used effectively.

Audio-signal processing apparatus comprises according to an embodiment of the invention: slide detection part, the voice signal collected by microphone is transfused to slide detection part, and the judgement of slide detection part slip sound signal components in input audio signal by utilizing process judges that beginning and the end of slide, slip sound signal components are by microphone originally slide generation with it or near it; And function unit, this function unit the slide determined by slide detection part to terminate period during, perform for slide arrange predetermined control process.

In addition, as judgement process, slide detection part, when the time that the energy level of slip sound signal components is equal to or higher than the first level continue for the very first time or is longer, judges that slide starts.

In addition, as judgement process, slide detection part, when the energy level of slip sound signal components continue for for the 2nd time lower than time of the 2nd level or be longer, judges that slide terminates.

In addition, slide detection part utilizes finger or Slide tool judgement processes to perform at the microphone slip sound signal components that originally rotational sliding movement with it or near it produces.

In addition, the voice signal of multiple sound channel is transfused to slide detection part, and slide detection part for by performing judgement process by the voice signal that the voice signal of multiple sound channel is added and obtain each other.

Alternatively, the voice signal of multiple sound channel is transfused to slide detection part, and slide detection part performs judgement process for each of voice signal of multiple sound channel, and judges beginning and the end of slide for each sound channel.

Alternatively, the voice signal of multiple sound channel is transfused to slide detection part, and slide detection part is by performing the process of the sound channel judgement for determining to include the sound channel of slip sound signal components from the voice signal of multiple sound channel, and the judgement for the signal by being added each other by the slip sound signal components from multiple sound channel or subtract each other and obtain processes, judge beginning and the end of slide, and determine to be performed the sound channel of slide.

In addition, slide detection part is also from the voice signal detection slide direction inputted, and function unit the slide determined by slide detection part to during the period terminated, performing the predetermined control process that arranges for the slide direction detected by slide detection part.

In addition, slide detection part is also from the voice signal detection slide position inputted, and function unit the slide determined by slide detection part to during the period terminated, performing the predetermined control process that arranges for the slide position detected by slide detection part.

In addition, audio-signal processing apparatus also comprises microphone, and the voice signal collected by microphone is transfused to slide detection part.

A kind of microphone apparatus according to disclosure embodiment comprises: microphone; And the guiding parts that slide, this slip guiding parts are formed on the vicinity of microphone and guide slide position.

In addition, a kind of microphone apparatus according to disclosure embodiment comprises: microphone; And directivity sound source parts, directionality sound source parts are arranged near microphone, and depend on slide direction and produce different sound signal components.

In addition, a kind of microphone apparatus according to disclosure embodiment comprises: microphone; And multiple slip sound source parts, these multiple slip sound source parts are arranged near microphone, and produce different sound signal components when slide is performed.

A kind of audio signal processing method according to disclosure embodiment comprises: by utilize by the slip sound signal components in the voice signal that microphone is collected judgement process judge slide and end, slip sound signal components be by microphone originally with it or near it slide generation; And from slide to terminate period during, perform for slide arrange predetermined control process.

Program according to disclosure embodiment makes arithmetic processing device perform the beginning of slide and the judgement of end and the program of predetermined control process.

As above embodiment of the present disclosure makes it possible to microphone is used for input operation and detects continuous print by simple sound signal processing or have the input operation of operation amount.

Therefore, user performs such predetermined operation, as finger waits slip campaign on microphone or near it, that is, make the contact microphones such as finger or near it while in the way of drawing track, make the operation of finger maintenance movement.

In this case, the sound that motion of sliding produces is collected by microphone. Therefore, the voice signal being input to audio-signal processing apparatus from microphone comprises the sound signal components (slip sound signal components) of the sound produced by this slip campaign. Therefore, the beginning of slide and terminate to be determined from energy level or the amplitude of this slip sound signal components. Therefore, operate continuously or operation amount can be identified from the time length of slide. , it is possible to the slide on microphone or near it is identified as operate continuously or there is the operation of operation amount, namely and perform corresponding control treatment.

Accompanying drawing explanation

Fig. 1 is the block diagram of the basic configuration according to disclosure embodiment;

Fig. 2 A and 2B is each naturally according to the explanation figure of the slide of disclosure embodiment;

Fig. 3 is the schema of the base conditioning according to disclosure embodiment;

Fig. 4 is the explanation figure of the NC earphone according to embodiment;

Fig. 5 is the block diagram of the NC earphone according to embodiment;

Fig. 6 is the block diagram of the configuration example I of the slide detection part according to embodiment;

Fig. 7 is the explanation figure of the voice signal processed in slide detection part according to embodiment;

Fig. 8 is the schema of the process in the slide detection part according to embodiment;

Fig. 9 is the explanation figure that the slide start/end undertaken by slide detection part according to embodiment judges;

Figure 10 is the block diagram of the configuration Example II of the slide detection part according to embodiment;

Figure 11 is the block diagram of the configuration Example II I of the slide detection part according to embodiment;

Figure 12 is the schema of the process in the slide detection part in the configuration Example II I according to embodiment;

Figure 13 A and 13B is each naturally according to the explanation figure comprising the configuration guided of sliding of embodiment;

Figure 14 A and 14B is each naturally according to the explanation figure of the configuration comprising directivity sound source parts of embodiment;

Figure 15 A to 15C is each naturally according to the explanation figure of the example of the directivity sound source parts of embodiment;

Figure 16 is the block diagram of the detection configuration of the slip direction according to embodiment;

Figure 17 is the schema of the process in the situation of the detection configuration of the slip direction according to embodiment;

Figure 18 A and 18B is each naturally according to the explanation figure of the frequency response characteristic relative to slip direction of embodiment;

The explanation figure that Figure 19 A and 19B respectively determines according to the slip direction of embodiment naturally;

The explanation figure of another example that Figure 20 A and 20B respectively determines according to the slip direction of embodiment naturally;

Figure 21 A and 21B is each naturally according to the explanation figure comprising the configuration of guiding with directivity sound source parts of sliding of embodiment; And

Figure 22 A and 22B is each naturally according to the explanation figure of the configuration comprising multiple slip sound source parts of embodiment.

Embodiment

Below, embodiment of the present disclosure will be described in the following order.

<1. basic configuration and process>

[configuration of 2-1:NC earphone]

[2-2: slide detection part (configuration example I)]

[2-3: slide detection part (configuration Example II)]

[2-4: slide detection part (configuration Example II I)]

8. program

<1. basic configuration and process>

First, the basic configuration as embodiment of the present disclosure will be described.

The disclosure assumes such system, this system use be installed in equipment and for collect sound microphone as the sensors controlling the various operations of equipment function input for being performed.

As in the anexamined patent application gazette No.2008-166897 of above-mentioned Japan, proposed allow by knock microphone or near it (microphone or near it on knock) switch or the system of each function of ON/OFF. But, in the function of various equipment, exist and need the function specifying concrete time span in real time and be suitable for the function of assigned operation amount. By simulating typical switch, these functions are corresponding to the operation keeping pressing press button to reach the scheduled time. With regard to this, it is unsuitable for operating these functions based on the operator scheme knocking microphone.

Therefore, embodiment of the present disclosure provides and makes it possible to be undertaken operating by " slide " inputting thus make finger wait touch microphone or being moved near it simultaneously, thus is suitable for operate continuously or specifies the user interface of the operation of operation amount.

It relates to the detection algorithm of the operation input undertaken by this slide for detecting, and the mechanism being associated with this detection algorithm. Detection algorithm according to disclosure embodiment makes it possible to utilize the process resource reduced to obtain detected result by the process of only execution process and such as frequency axle analysis not performing to need a large amount of calculating and so on a timeline.

Embodiment described below represents the various electronics being provided with the audio-signal processing apparatus that the operation adopting above-mentioned configuration to carry out inputs to be identified by slide.

Fig. 1 shows the basic configuration according to embodiment.

Fig. 1 shows sound signal processing parts 1, microphone 4, amplifier of microphone 5, A/D converter 6 and conventional processing system 7.

Sound signal processing parts 1 comprise slide detection part 2 and function unit 3. Sound signal processing parts 1 are corresponding to the audio-signal processing apparatus according to disclosure embodiment. Sound signal processing parts 1 are such as made up of central processing unit (CPU) or digital signal processor (DSP).

Voice signal collected by microphone 4 was amplified by amplifier of microphone 5 in A/D converter 6 before analog to digital conversion. Then, the voice signal being converted to numerary signal is transfused to conventional processing system 7 and voice signal processing element 1.

Term conventional processing system 7 used herein refers to the processing element for the function being usually associated with the voice signal in the electronics from microphone 4 input audio signal.

In consumer electronics are equipped, microphone 4 has been provided for various object. Alternatively, the microphone 4 of separation can be connected to consumer electronics equipment.

The example of such consumer electronics equipment comprise sound writing function and picture record function be equipped with digital camera, the signal conditioning package of IC register, the such as Personal Computer with function of voice communication and so on, mobile equipment, and de-noising earphone (hereinafter referred to " NC earphone ").

In often kind of the electronics of these kinds, according to its function setting for the treatment system of microphone input audio signal.

Such as, when having the equipment of the function being recorded in recording medium by sound, perform such as sound record compression, constitute the conventional processing system 7 shown in Fig. 1 for the parts of the coding that records and the process that is recorded to recording medium and so on.

When carrying out communicating (such as portable phone) and have the equipment of function sending voice signal, the parts performing such as process for the compression, coding and the transmission that send and so on constitute the conventional processing system 7 shown in Fig. 1.

This literary composition, when the NC earphone that reference drawing 3 further describes, performs the function part of denoising Processing corresponding to conventional processing system 7 below.

Conventional processing system 7 performs process for the voice signal inputted according to these functions.

Sound signal processing parts 1 perform the detection of the slide for institute's input audio signal, thus detect the operation input that user carries out.

First, slide detection part 2 detects beginning and the end of the slide of user by means of only the process on time axle.

Specifically, when the time that the energy level of the slip sound signal components of institute's input audio signal is equal to or higher than the first level has continued to reach the very first time or is longer, slide detection part 2 judges that slide starts. Now, slide detection part 2 exports slip to function unit 3 and starts to detect signal SdetS.

After starting to be determined, when the energy level of slip sound signal components continued to reach the 2nd time lower than time of the 2nd level, slide detection part 2 judges that slide terminates. Now, slide detection part 2 exports slip detection of end signal SdetE to function unit 3.

That is, from determination time only that is defined as of playing end be confirmed as slide sustained periods of time.

As will be described later, slide and start to detect signal SdetS and slip detection of end signal SdetE and can take the various signal form expected. It can be two independent signal wires that slip starts to detect signal SdetS and slip detection of end signal SdetE, but can for allowing function unit 3 identify the beginning of slip and any signal of end.

Function unit 3 is equipped with the function at least performing control treatment according to the user operation in electronics. When function unit 3 start to detect based on sliding the beginning that signal SdetS identifies slide detected by slide detection part 2 time, function unit 3 starts to carry out the predetermined control process for this slide is arranged.

When function unit 3 is detected by slide detection part 2 based on the end that slip detection of end signal SdetE identifies slide, function unit 3 terminates the control treatment just performed.

Alternatively, function unit 3 is detecting the length of signal SdetS to the period of slip detection of end signal SdetE by from sliding, that is, the length of the period of the lasting slide of user performs predetermined control process while being identified as operation amount.

Owing to performed control treatment changes for various electronics, therefore the example of control treatment will be described in the description of the specific embodiment of electronics below. Such as, when having the equipment of function of playback of music data etc., it is conceivable that volume raise/lower control, fast-forward playback or return move back playback controls etc. Such as, by user, microphone 4 performed the volume etc. that slide realizes raise/lower playback sound.

Fig. 2 A and 2B illustrates how to perform slide.

Fig. 2 A shows Personal Computer 100. In Personal Computer 100, such as, microphone 4 is arranged in shell close in the smooth part of keyboard.

As shown in enlarged view, user utilizes the Slide tool of finger or such as form of a stroke or a combination of strokes telltale and so on to perform slide to draw track on microphone 4 or near it.

The sound that slide produces is collected by microphone 4, and is provided to the slide detection part 2 according to configuration as shown in Figure 1. Slide detection part 2 judges the start/end of slide by the amplitude or energy level (absolute value of amplitude) observing the slip sound signal components of institute's input audio signal.

Fig. 2 B shows a part for the earphone (in-ear phone) 200 being such as equipped with the microphone 4 for de-noising object. Earphone 200 has headphone driver 201 and inserts the earplug (earpiece) 202 of the part in its ear as user. Microphone 4 is arranged on the side relative with earplug 202, that is, be arranged on the position that microphone 4 can collect external voice.

User utilize finger wait execution on microphone 4 and near draw the such slide of track.

In the same manner as described above, the sound that slide produces is collected by microphone 4, and is provided to the slide detection part 2 of track configuration as shown in Figure 1.Slide detection part 2 judges the start/end of slide by the amplitude or energy level (absolute value of amplitude) observing the slip sound signal components of institute's input audio signal.

As mentioned above, it is necessary, such as, slide is that user utilizes the touches such as finger and draws such operation of track continuously on microphone 4 or near it.

Although it should be noted that Fig. 2 A and 2B depicts linear sliding operation, but user can perform circle (rotation) slide.

Linear sliding operation only can maintain the short period, result, and user may not perform desired control in some cases. In such cases, if such as making user perform circular motion of sliding around microphone 4, then user can easily continue slide.

Basic configuration according to disclosure embodiment is as described above with reference to Figure 1. That is, input audio signal from microphone 4 is transfused to sound signal processing parts 1, and sound signal processing parts 1 are by determining, and slide detects user operation. When detecting that having carried out operation inputs, it is performed according to the predetermined control process of this operation.

Fig. 3 shows the process of the base conditioning according to embodiment.

In the sound signal processing parts 1 being transfused to microphone input audio signal as shown in Figure 1, such as step F 2 always, judge whether slide starts. This is the process in slide detection part 2. Then, if it is determined that the slide as user operation input starts, then process and proceed to F3 from step F 2, and the control treatment according to operation input is activated as the process in function unit 3.

In step F 4, as the process in slide detection part 2, judge whether the slide of user terminates. Then, if it is determined that slide terminates, then process and proceed to F5 from step F 4, and the action according to operation input performed by function unit 3 terminates.

Below, embodiment is described the concrete example using de-noising earphone (NC earphone) as electronics.

Also the example of other electronics will be described below.

[configuration of 2-1:NC earphone]

The de-noising earphone (NC earphone) 10 that Fig. 4 schematically shows the equipment of the music playback by being connected to such as portable electronic device 20 and so on and used.

The data of such as music and so on that media player 20 playback is recorded on internal record medium, and export two sound channels to the NC earphone 10 connected, i.e. the voice signal of L and R sound channel.

NC earphone 10 comprises earphone parts 11 and de-noising parts 14.

Earphone parts 11 have loud speaker 13L and 13R of L and R sound channel in each speaker housings corresponding with the left and right ear of user.

When this example, so-called feedforward denoising Processing is performed. Microphone 12L and 12R is provided to collect respectively the external voice of the outside from left and right speaker housings.

It should be noted that earphone parts 11 can not be the type with speaker housings as shown in this figure, and can be the in-ear phone type shown in Fig. 2 B, or earmuff type. In this example, any type in these types can be used, as long as microphone 12L and 12R is set up.

In addition, NC earphone 10 is not limited to perform the NC earphone of feedforward denoising Processing, and can be the NC earphone performing feedback denoising Processing.

De-noising unit 14 is connected to the earphone portion 11 being provided with microphone 12L and 12R as above.

Noise reducing sound signal is mixed into the voice signal of the playback of music etc. provided from media player 20 by de-noising unit 14, thus exports, from each of loud speaker 13L and 13R, the voice signal reducing external noise.

In brief, fall to make an uproar and perform as follows.

It is attached to each external noise collecting arrival user's ear via speaker housings of microphone 12L and 12R of speaker housings. From by, the voice signal of each external noise collected of microphone 12L and 12R, de-noising unit 14 is created on acoustically anti-phase with external noise noise reducing sound signal. Then, the voice signal of the noise reducing sound signal generated and playback of music etc. is combined to by de-noising unit 14, and the voice signal obtained is supplied to loud speaker 13L and 13R each.

Therefore, comprise the component anti-phase with external noise from each sound exported of loud speaker 13L and 13R. Therefore, this anti-phase component with spatially cancel each other out via the external noise of the actual leakage of speaker housings, result as user in the sense of hearing perceive, external noise component be reduced and the original output sound of playback of music arrival ear.

The inside configuration example of de-noising unit 14 figure 5 illustrates.

De-noising unit 14 has amplifier of microphone 31L and 31R, A/D converter 32L and 32R, the main processing components 33 formed by DSP or CPU, stores parts 40, power amplifier 42L and 42R and A/D converter 41L and 41R.

Main processing components 33 is equipped with de-noising parts 34, gain elements 35, totalizer 36L and 36R, slide detection part 37, function unit 38 and equalizer 39.

First, voice signal from the playback of music etc. of media player 20 is processed as follows.

Playback voice signal SA-L and SA-R of L and R sound channel is provided as so-called earphone from media player 20 and exports.

Playback voice signal SA-L and SA-R is converted to numerary signal by A/D converter 41L and 41R respectively. Then, in equalizer 39, these voice signals are through the correction of such as amplitude-correction of frequency characteristic or phase-frequency characteristic or the sound mass calibration both them and so on.

Treatment for correcting in equalizer 39 is performed based on the control signal SG3 from function unit 38. Such as, the appointment etc. of frequency response characteristic is undertaken by control signal SG3.

In equalizer 39, have passed through playback voice signal SA-L and SA-R of sound mass calibration be added with noise reducing sound signal by totalizer 36L and 36R respectively, and it is provided to power amplifier 42L and 42R respectively.

Power amplifier 42L and 42R can be made up of digital amplifier respectively, or can be made up of D/A transmodulator and Simulation scale-up device.

Output from power amplifier 42L and 42R is used as the actuate signal of loud speaker 13L and 13R, and the sound based on playback voice signal SA-L and SA-R exports from loud speaker 13L and 13R respectively.

On the other hand, above-mentioned denoising Processing performs as follows.

Voice signal SmL and SmR collected by microphone 12L and 12R is amplified by amplifier of microphone 31L and 31R in de-noising unit 14, and is then converted into numerary signal in A/D converter 32L and 32R respectively.

Digitized sound signal SmL and SmR exported from A/D converter 32L and 32R is provided to de-noising parts 34. De-noising parts 34 are configured to generate the digital filter of noise reducing sound signal in feed-forward mode above-mentioned. The filter factor that de-noising parts 34 utilize the control signal SG1 of origin self-acting control parts 38 to specify carrys out each the execution filtering to voice signal SmL and SmR, thus generates the noise reducing sound signal of L and R sound channel.

The noise reducing sound signal of L and the R sound channel generated is provided to gain elements 35. Gain elements 35 gives gain to the noise reducing sound signal of L and R sound channel, and wherein, the control signal SG1 of gain factor origin self-acting control parts 38 specifies.

Then, the noise reducing sound signal of L and R sound channel is provided to totalizer 36L and 36R from gain elements 35, and is added with playback voice signal SA-L and SA-R as above respectively.

When to export playback sound from loud speaker 13L and 13R based on playback voice signal SA-L and SA-R being added into noise reducing sound signal by this way respectively, just exercise decrease of noise functions as above.

De-noising unit 14 in this example be also equipped with detect by microphone 12L, 12R or near it on slide and the function of user operation that carries out.

Voice signal SmL and SmR collected by microphone 12L and 12R respectively is also provided to slide detection part 37.

When being described in more detail configuration and the action of slide detection part 37 below, this slide detection part 37 by means of only the process on time axle detect user microphone 12L, 12R and near slide. Specifically, when the energy level of the slip sound signal components in institute input audio signal SmL, SmR be continued above preset value reach the very first time or longer time, slide detection part 37 judges that slide starts. Then, in order to notify the beginning of the operation input of user, slide detection part 37 exports slip to function unit 38 to start to detect signal SdetS.

In addition, after slide starts, when the energy level of slip sound signal components has continued to reach for the 2nd time lower than preset value or be longer, slide detection part 37 judges that slide terminates. Then, in order to notify the end of the operation input of user, slide detection part 37 exports slip detection of end signal SdetE to function unit 38.

Function unit 38 controls each parts of de-noising unit 14 by control signal SG1 above-mentioned, SG2 and SG3. In addition, function unit 38 can also transmit control signal SG4 to media player 20.

In this example, especially, function unit 38 is equipped with the function that the slide according to user performs control treatment. That is, function unit 38 during such as starting to detect the period that the slide that signal SdetS and slip detection of end signal SdetE grasps just is being performed by sliding, and performs the predetermined control process set by this slide. Such as, in response to the operation inputted by slide being detected, function unit 38 operates input information as control signal SG4 to media player 20 transmission.

Store parts 40 memory control unit part 38 perform control treatment time with reference to information. Such as, store parts 40 and store the information relevant with the filter factor in de-noising parts 34 and equalizer 39 etc.

In this embodiment, function unit 38 performs predetermined control according to the slide of user. Real-time stepless control is suitable for this control treatment. It it is the example of such control below assuming.

First, send the order as control signal SG4 it is conceivable that to media player 20, thus to make media player 20 perform the action below such as.

-carry out controlling, during the slide period, the playback position that user is desired when listening to sound to perform FF (F.F.)/REW (return and move back).

-carry out controlling only during the slide period, to close playback and close de-noising (carrying out controlling to be switched to being suitable for carrying out the state of the session terminated immediately).

-control is used for only closing de-noising function during the slide period with the auxiliary operation listening to surrounding environment sound.

-carry out controlling as operation amount, volume is adjusted to by the length of slide period volume position desired by user up or down.

-carry out controlling as operation amount, playback speed is adjusted to by the length of slide period playback speed desired by user up or down.

-carry out controlling as operation amount, playback tone is adjusted to by the length of slide period playback tone desired by user up or down.

-carry out controlling with multiple contents of sequentially replay segment such as music or video and so on during the slide period, that is, such action is controlled: allow user partly watching or carrying out searching for sequentially in the content while listening to content and the moment playing back content that stops at slide.

For example, it is assumed that slide is the operation relevant with the action of media player 20, then function unit 38 performs the process sending necessary order to media player 20 during the slide period detected by slide detection part 37.

As will be described later, when the slide on the slide that will detect by different way on microphone 12L and microphone 12R, it is possible to assign two kinds of operations. In this case, such as, the slide assumed on microphone 12L refers to that volume raises and slide on microphone 12R refers to that volume reduces, so function unit 38 detects slide in response to slide detection part 37, perform to send " volume rising " or the process of " volume reduction " to media player 20.

In addition, as will be described later, it is also possible to distinguish operation according to slip direction, sliding position etc. In addition, distinguish the combination with left and right microphone 12L and 12R based on these, it is possible to multiple operation is set in the way of distinguishing out. Equally, in this case, function unit 38 sends predetermined command in response to each detecting in these slides to media player 20.

In order to realize de-noising function, it is necessary to microphone 12L and 12R is installed as far as possible near ear. For this reason, usually microphone 12L and 12R is installed near ear. Therefore, if such as during travelling frequently etc., user can by simply microphone 12L, 12R are performed slide control media player 20 action and without the need to the main body of media player 20 is taken out, then be very easily for user.

Also it is conceivable that making function unit 38 in response to the detection of slide to perform the internal control of de-noising unit 14.

Such as, function unit 38 can be configured in response to slide, by utilizing the control of control signal SG1 to switch the filter factor of de-noising parts 34. Such as, it is also possible to control such action: during the slide period in shorter time unit sequentially the switching filter factor so that user can select the filter characteristic being suitable for current condition.

Generally speaking, even if being regarded as frequency response characteristic, noise environmental characteristics also can depend on the environment of such as each different positions of airport, station platform, train inside, factory etc. and greatly change. Therefore, as the filter characteristic made an uproar for falling, it is desirable to use be suitable for the optimum filter characteristic of each different noise environmental characteristics. For this reason, user is allowed by being switched to by microphone 12L, 12R execution slide and to select the most suitable filter characteristic to be favourable.

In addition, function unit 38 can be configured in response to slide that the control of control signal SG2 switches the gain factor of gain elements 35 by utilizing. This allows user, and by being easy to, operation regulates de-noising level in any way.

In addition, function unit 38 can be configured in response to slide being detected, by utilizing the control of control signal SG3 to change the filter factor in equalizer 39. Such as, it is also possible to control such action: during the slide period, in units of the short time, sequentially switch equalization characteristic, so that user can select preferred characteristics. This allows user to select sound mass calibration state by easy operation. Such as, advantageously, various predeterminated frequency characteristic is stored in stores in parts 40 in advance, and allow user sequentially to apply the balancer characteristic providing preferred sound quality and select suitable characteristic at the end of slide.

[2-2: slide detection part (configuration example I)]

Below, configuration and the action of slide detection part 37 will be described. Here, first configuration example I shown in Fig. 6 described.

This configuration example I represents such configuration example, wherein, detects slide in the way of total from voice signal SmL and SmR of microphone 12L and 12R.

This slide detection part 37 comprises totalizer 51, low-pass filter 52, definitely value circuit 53, low-pass filter 54 and judges processing element 55.

Each voice signal SmL and SmR from microphone 12L and 12R is added in totalizer 51, and is transfused to low-pass filter 52. The limiting frequency of low-pass filter 52 is set to fc1. This limiting frequency fc1 is set to the frequency for extracting slip sound signal components. When being attached to the earphone outer covering being moulded with resin mold in each of microphone 12L and 12R, such as, this limiting frequency is provided to extract the frequency of the sound signal components produced when pointing and draw track on resin material. Therefore, it is determined that limiting frequency fc1 is suitable for the resin types just used. Certainly, also there is the situation that the assembly being made up of metallic substance or other material is used in around microphone 12L and 12R. Therefore, filter characteristic be the material according to microphone 12L and 12R itself or around it use material determine.

During slide, the slip sound produced near microphone is the main component in voice signal SmL and SmR. However, it should be noted that voice signal SmL and SmR also comprises the noise of wider bandwidth, such as ground unrest and surrounding environment noise. First, therefore, utilize low-pass filter 52 to extract slip sound signal components.

Generally speaking, the sound signal components of the sound that motion of sliding produces has higher energy in low frequency. Therefore, it is conceivable that utilizing low-pass filter 52 to extract slip sound signal components. But, depend on made land used material, also it is conceivable that using the bandpass filter with predetermined pass band.

In any situation, first the frequency band meeting the slip sound signal components with high-energy level is extracted just.

From low-pass filter 52 export voice signal SmL and SmR phase plus signal slip sound signal components in absolute value circuit 53 by absolute value.

The signal S being converted into the energy level representing voice signal SmL, SmR in absolute value circuit 53 by the signal S0 after absolute value via low-pass filter 54, and be transfused to and judge processing element 55.The limiting frequency fc2 of low-pass filter 54 is set to the frequency for signal S0 is converted to envelope signal.

Judge that processing element is for signal S, detected the start/end of slide below by described process. Then, as detected result, judge that processing element exports slip to function unit 38 and starts to detect signal SdetS and slip detection of end signal SdetE.

The action of above-mentioned slide detection part 37 is described with reference to Fig. 7 to Fig. 9.

Fig. 7 shows the example of the waveform of the signal S0 when slide is performed and signal S.

As mentioned above, it is necessary, low-pass filter 52 extracts slip sound signal components. Owing to having the amplitude of positive/negative value as the output of the low-pass filter 52 of slip sound signal components, therefore in order to equally negative amplitude is defined as energy level, used by the signal S0 of absolute value in absolute value circuit 53.

As shown in the figure, during the slide period, the energy level (amplification level of the slip sound signal components after absolute value) of signal S0 becomes high.

It should be noted, however, that the slide of user is unstable, and track is drawn and is not necessarily undertaken by constant speed and strength. Therefore, amplitude changes in very little time scale.

By this is represented the signal S for encapsulating by low-pass filter 54, it is possible to easily the period that high-energy level continues is defined as the slide period.

From, this signal S, judging that processing element 55 determines the slide period shown in the drawings, that is, to the period controlled according to the function of this slide by control object execution.

Fig. 8 be judge processing element 55 from signal S, determine slide and the schema of process that terminates.

Judge processing element 55 for the signal S inputted to perform the slide shown in Fig. 8 determine process.

First, in step F 101, judge that processing element 55 judges that whether the level of signal S is higher than threshold value TH1.

Fig. 9 shows waveform and the threshold value TH1 and TH2 of signal S. Threshold value TH1 is the threshold value whether energy level for judging signal S increases. On the other hand, threshold value TH2 is the threshold value whether energy level for judging signal S reduces.

In step F 101, the value of institute input signal S is by sequentially compared with threshold value TH1. If it is determined that the value of signal S is equal to or less than threshold value TH1, then as the judgement processing element 55 indicated by " R " returns step F 101, and next input value of signal S is by compared with threshold value TH1.

When the value of signal S exceedes threshold value TH1, judge that processing element 55 proceeds to step F 102.

In step F 102, judge that first counter Cn1 is reset to 0 by processing element 55, and make to start counting.

Then, when increasing progressively counter Cn1 in step F 103, judge that processing element 55 performs the judgement in step F 104 and F105.

In step F 104, judge that processing element 55 judges whether the value of signal S is greater than threshold value TH1.

In step F 105, judge that processing element 55 judges whether the value of counter Cn1 reaches very first time THtm1.

Very first time THtm1 is predetermined time interval as shown in Figure 9. It is set to for determining that the increase occurred in the energy of signal S is not instantaneous but time of the lasting increase of energy level of producing due to slide.

If detecting that in step F 104 signal S is lower than threshold value TH1, then judge that the increase of the energy level detected in step F 101 is instantaneous increase instead of causes by slide, and as indicated by " R ", judge that processing element 55 returns step F 101.That is, judge that slide not yet starts.

On the other hand, judging in step F 105 that the value of counter Cn1 has reached the situation of very first time THtm1 is the situation judging that the energy level of signal S is greater than the state of threshold value TH1 and has continued.

Now, judge that processing element 55 proceeds to step F 106, and determine that slide starts. Then, judge that processing element 55 exports slip to function unit 38 and starts to detect signal SdetS.

After judging that slide has started, judge that processing element 55 proceeds to step F 107, and start to judge the end of slide.

First, in step F 107, judge processing element 55 by signal S compared with threshold value TH2, and judge whether signal S becomes lower than threshold value TH2.

As shown in Figure 9, such as, threshold value TH2 is set to the level more lower slightly than threshold value TH1. This threshold value TH2 is the value that the energy level for judging signal S reduces.

When signal S becomes to be less than threshold value TH2, judge that this is used as the possibility indicating slide and terminating by processing element 55, and proceed to step F 108.

In step F 108, judge that counter Cn2 is reset to 0 by processing element 55, and make to start counting.

Then, when increasing progressively counter Cn2 in step F 109, judge that processing element 55 performs the judgement in step F 110 and F111.

In step F 110, judge that processing element 55 judges whether the value of signal S becomes lower than threshold value TH2.

In step F 111, judge that processing element 55 judges whether the value of counter Cn2 reached for the 2nd time THtm2.

2nd time THtm2 was predetermined time interval as shown in Figure 9. It is set to the reduction that energy for judging signal S occurs be not instantaneous but slide terminate after time of lasting reduction of energy level.

If detecting that in step F 110 signal S not yet becomes lower than threshold value TH2, then judge that the reduction of the energy level detected in step F 107 is instantaneous reduction instead of terminates to cause because of slide, and as indicated by " Q ", judge that processing element 55 returns step F 107. That is, judge that slide not yet terminates.

Such as, the energy level that Fig. 9 shows signal S after slip starts temporarily is reduced to the state under threshold value TH2, such as period tmA. In this case, period tmA is the period being shorter than for the 2nd time THtm2. In such a case, this reduction be confirmed as slide during the temporary transient reduction of level.

The slip campaign that slide performed by user is not necessarily regular. As mentioned above, motion of sliding does not perform by fixing strength with constant speed. In addition, due to during sliding the finger instantaneous stopping of the slip campaign caused such as be obstructed be often generation.

For this reason, it is unsuitable for judging that slide terminates once the reduction of the energy level observing signal S. Therefore, the 2nd time THtm2 was set up, and if occurring that the period reduced was less than for the 2nd time THtm2, then judged that slide not yet terminates.

On the other hand, judging in step F 111 that the value of counter Cn2 has reached the situation of the 2nd time THtm2 is the situation judging that the energy level of signal S is less than the state of threshold value TH2 and has continued.

Now, judge that processing element 55 proceeds to step F 112, and determine that slide terminates. Then, judge that processing element 55 exports slip detection of end signal SdetE to function unit 38.

Such as, in fig .9, the energy level at signal S drops to when assigning for the 2nd time of threshold value TH2, and the state of energy level decline continue for for the 2nd time Thtm2 or longer.In this case, then judge that slide terminates.

In the slide detection part 37 of this example, judge that processing element 55 is by above with reference to the start/end judging slide in the way of described in figure 8. This permission function unit 38 identifies the period that slide is just being performed, so that can carry out controlling based on the slide as operate continuously or the operation specifying operation amount.

In addition, in slide detection part 37, judge that processing element 55 judges the start/end of slide by observing the increase/reduction of energy level on a timeline. This increase making it possible to easily determine slide and resource can not being caused.

When slide is performed, the energy level (amplitude) of the voice signal (slip sound signal components) of the predetermined frequency band in microphone input signal increases. Therefore, by monitoring the energy of slip sound signal components, it is possible to detect slide by judging the increase/reduction of energy, and without the need to performing wave form analysis.

This makes it possible to reduce the processing load for detecting operation, and thus reduces costs. Especially, when the small-sized equipment with less resource of the de-noising unit 14 and so on of such as NC earphone 10, it is possible to it is very favorable for performing necessary check processing by such simple action.

In order to process irregular user operation, it is necessary to the check processing of executable operations input always. Therefore, being the signal processing having on the time axle of a small amount of calculating due to this check processing, such check processing is suitable as the process being always performed.

In addition, owing to this check processing is simple, the time needed for the starting or terminate of slide of therefore detecting is shortened, thus enables the action of the device with good response.

When this example, even if the instantaneous reduction that there is the energy level of signal S because of the instantaneous stopping etc. slided, also immediately this can not be used as the end of slide.

Such as, though when stopping a little while due to finger during sliding process, irregular noise mixing etc. and make energy level temporarily reduce the very short time, if energy level increases immediately after reducing, then judge that slide is just lasting.

Therefore, when detecting user operation, it is possible in a satisfactory manner and the end of operation detected as desired by the user like that. That is, user does not need to pay close attention to too much and carries out careful slip campaign, thus allows to be easy to operation.

Configuration example I according to Fig. 5, user can perform slide in any one of left and right microphone 12L and 12R.

Therefore, such as, when a hand is taken the thing carried out such as handbag and so on, it is possible to use another unoccupied hand easily to perform slide, because herein is provided the operability of raising.

Then, slide being detected in this way in response to slide detection part 37, function unit 38 performs control according to the operation type being assigned to this slide, such as control discussed above.

If function unit 38 will send is used for controlling the order of the action of media player 20, then user can travel frequently wait during keep media player 20 be in pocket or in wrapping while operate this media player 20.

In addition, the working method owing to using makes slip campaign utilize finger etc. to carry out, therefore, it is possible to control media player 20 or de-noising unit 14 intuitively.

In addition, pattern owing to using makes to slide to move and carries out near microphone 12L, 12R or its, as long as therefore having the Signal Processing Element of (cheap) microphone and such as CPU/DSP and so on arbitrarily, even if not using the special sensor of such as touch sensing device and so on, can also realizing, this contributes to reducing costs.

In addition, in the NC earphone 10 of this example, earphone parts 11 are equipped with microphone 12L and 12R due to de-noising function. Owing to microphone 12L and 12R can be utilized to perform slide, therefore without the need to being provided for operating the additional sensors equipment of input. This configuration example also is suitable for reducing costs in this connection, and also can not cause the increase of the component count forming this device.

Although in the example depicted in fig. 5, it is synthesized from voice signal SmL and SmR of microphone 12L and 12R of L and R sound channel respectively and determines slide, such as, but only one of voice signal of these sound channels (voice signal SmL) can also be inputted low-pass filter 52. In this case, only the microphone 12L in corresponding sound channel is used to slide.

[2-3: slide detection part (configuration Example II)]

With reference to Figure 10, the slide detection part 37 as configuration Example II is described.

Configuration Example II is L sound channel and R sound channel, and namely microphone 12L and 12R can be assigned to the example of different operating.

Such as, this configuration example makes the slide on microphone 12L can be assigned to volume rising, and the slide on microphone 12R can be assigned to volume reduction.

As shown in Figure 10, slide detection part 37 adopts the slide detection configuration of two separate lines being used for L sound channel and R sound channel.

That is, low-pass filter 52L, definitely value circuit 53L, low-pass filter 54L and judge that processing element 55L is arranged for the voice signal SmL from microphone 12L. In addition, low-pass filter 52R, definitely value circuit 53R, low-pass filter 54R and judge that processing element 55R is arranged for the voice signal SmR from microphone 12R.

Owing to the action of low-pass filter 52L with 52R, definitely value circuit 53L with 53R and low-pass filter 54L with 54R is with the low-pass filter 52 according to above-mentioned configuration I, definitely value circuit 53 is identical with the action of low-pass filter 54, therefore removes from and repeat to describe.

Judge the process of each start/end that such as can perform judgement slide as shown in Figure 8 of processing element 55L and 55R.

Time when slide being detected for the signal S obtained from voice signal SmL, judge that processing element 55L exports slip to function unit 38 and starts to detect signal SdetS (L), and at the end of slide being detected, judge that processing element 55L exports slip detection of end signal SdetE (L) to function unit 38.

Time when slide being detected for the signal S obtained from voice signal SmR, judge that processing element 55R exports slip to function unit 38 and starts to detect signal SdetS (R), and at the end of slide being detected, judge that processing element 55R exports slip detection of end signal SdetE (R) to function unit 38.

Function unit 38 can start based on slip to detect signal SdetS (L) and slip detection of end signal SdetE (L), and slide and start to detect signal SdetS (R) and slip detection of end signal SdetE (R) identifies two kinds of operations and inputs. Such as, therefore, volume raise/lower control above-mentioned etc. can operate input according to these and perform.

According to configuring Example II as above, it is possible to according to making for switching two kinds of operations left and right microphone 12L and 12R, so that this kind of configuration is suitable for the operability of raising user.

[2-4: slide detection part (configuration Example II I)]

Next, figure 11 illustrates configuration Example II I. In this example, the same with above-mentioned configuration Example II, L sound channel and R sound channel, namely microphone 12L and 12R can be assigned to different operating. When above-mentioned configuration Example II, slide detection part 37 simply is mounted with two-way slide check processing system, and therefore the load in this configuration is bigger. Configuration Example II I can reduce the load of configuration.

In configuration Example II I, slide detection part 37, for the voice signal by being added each other or subtract each other and obtain by the slip sound signal components from multiple sound channel, performs the sound channel judgement process for determining to comprise the sound channel of slip sound signal components from voice signal SmL and SmR of multiple sound channel and slide start/end judgement process. Slide and the sound channel performing slide thereon thus can be detected.

In this case, as shown in figure 11, the voice signal SmL from microphone 12L is transfused to low-pass filter 52L, and the sound signal components that slides is extracted by limiting frequency fc1.

Voice signal SmR from microphone 12R is transfused to low-pass filter 52R, and the sound signal components that slides is extracted by limiting frequency fc1.

The output of low-pass filter 52L is provided to absolute value circuit 56L and subtractor 59.

The output of low-pass filter 52R is provided to absolute value circuit 56R and subtractor 59.

Absolute value circuit 56L is by the absolute value of output of low-pass filter 52L, and the output obtained is supplied to subtractor 57. Absolute value circuit 56R is by the absolute value of output of low-pass filter 52R, and the output obtained is supplied to subtractor 57.

Therefore, as the output of subtractor 57, there is difference in the energy level between the respective slip sound signal components of voice signal SmL and SmR of left and right acoustic channels.

The output of subtractor 57 is converted to envelope signal by the low-pass filter 58 with limiting frequency fc2, and is provided to and judges processing element 55.

Judging in processing element 55, when performing slide on microphone 12L or 12R, its can by judge envelope signal be just or as bear detect slide microphone 12L and 12R which on be performed.

Each slip signals component in voice signal SmL and SmR extracted by low-pass filter 52L and 52R is through subtraction process in subtractor 59, and its difference is extracted.

When slide is performed on one of microphone 12L and 12R, the energy from the slip signals component of the voice signal of the microphone being performed slide increases. Therefore, as the output of subtractor 59, occurred that the energy caused because of slide increases component.

This output of subtractor 59 by absolute value, is converted to envelope signal S by the low-pass filter 54 with limiting frequency fc2, and is provided to and judges processing element 55 in absolute value circuit 53.

Judge processing element 55 for signal S to perform slide judgement process, and export to function unit 38 according to the judgement process for signal S that slip starts to detect signal SdetS, slip detection of end signal SdetE and L sound channel/R sound channel judges signal D-LR.

The judgement processing example in judgement processing element 55 in this case as performed in the way of as shown in figure 12.

It is noted that in fig. 12, the process identical with the process in above-mentioned Fig. 8 represents by identical step number, and removes from and repeat to describe.

In the process shown in Figure 12, in step F 101 to F106, by with Fig. 8 in identical in the way of judge the beginning of slide.

Then, if judging to slide in step F 106 starts, then judge that processing element 55 performs L/R in step F 130 and judges.

That is, it is just or for negative judging at this moment from the signal of the low-pass filter 58 shown in Figure 11. When the configuration that the absolute value signal of R sound channel as shown in figure 11 is subtracted from the absolute value signal of L sound channel, if the signal from low-pass filter 58 is just, the sound channel then paid close attention to is confirmed as L sound channel, and if this signal is negative, then the sound channel paid close attention to is confirmed as R sound channel.

This L/R judges it is the process being performed on detection which in microphone 12L and 12R of slide. Then, judge that L sound channel/R sound channel that processing element 55 exports instruction L/R judged result to function unit 38 judges signal D-LR.

Therefore, when detecting that slide starts, slide and start detect signal SdetS and judge that signal D-LR is provided to function unit 38.

Next, judge processing element 55 by with Fig. 8 in identical in the way of in step F 107 to F111, judge the end of slide.

Then, if it is determined that slide terminates, then in step F 112, judge that processing element 55 exports slip detection of end signal SdetE to function unit 38.

When above-mentioned configuration Example II I, function unit 38 can start based on slip detect signal SdetS, slip detection of end signal SdetE and judge signal D-LR, identify two kinds of operation inputs by being used separately microphone 12L and 12R, thus such as allow to perform volume raise/lower control etc. according to these operation inputs.

Therefore, equally according to above-mentioned configuration Example II I, it is possible to according to making for switching two kinds of operations microphone 12L and 12R, so that this configuration is suitable for improving the operability of user. In addition, compared with configuration Example II, it is possible to reduce the load in the configuration of slide detection part 37. Specifically, only single judgement processing element 55 contributes to reduction process (resource) load with regard to enough facts.

It is noted that it is conceivable that using totalizer to replace subtractor 59.

Next, the slip guiding using description to guide slide position is arranged on the embodiment of microphone side. This embodiment is used as the embodiment according to microphone apparatus of the present disclosure.

The mode performing slide on microphone 4 is shown in Fig. 2 A and 2B above. Described above is in this case, slide simply describes the such operation of track in the region forming microphone 4.

As a comparison, Figure 13 A and 13B each illustrates guiding 8 of sliding and is arranged on the configuration near microphone 4.

Similar with Fig. 2 A, Figure 13 A shows the situation that microphone 4 is arranged in the prospective region on the housing of Personal Computer 100.

When Figure 13 A, the slip guiding 8 with annular shape is formed on around microphone 4.

Similar with Fig. 2 B, Figure 13 B also shows a part for the earphone (in-ear phone) 200 being such as equipped with the microphone 4 for de-noising object.Equally, in this case, the slip guiding 8 with annular shape is formed on around microphone 4.

Guiding 8 of sliding can be simply any structure part that can be identified in sense of touch by user. Such as, guiding 8 of sliding is formed with convex or concave shape (projectedorrecessedshape), so that user can be guided point the slide carried out. That is, guiding 8 of sliding can be to allow the user object of moveable finger etc. and any structure of installing smoothly in a circular manner while recognizing guiding 8 of sliding.

Although when Figure 13 A and 13B above-mentioned, spill groove, that is, endless groove is formed in the situation around microphone 4, but can also form convex (rail-like) ring.

Mentioning above, if user makes slide in a rotative pattern (in the way of drawing a circle), then slide is easy. With regard to this, such as, if the slip guiding 8 with annular shape is set up in this way, then user can more easily perform to rotate slide. That is, when user utilize Fingertip touch slide guiding 8 while pivoting finger time, the motion obtained becomes slide.

Then, when user performs to rotate slide under the guiding of guiding 8 of sliding, such as, user will more easily continue the slide long period.

In addition, arranging of guiding 8 of sliding can eliminate these situations, and wherein, user performs slide in the position away from microphone 4 and therefore can not suitably determine this operation, or user does not know to carry out slide where.

Although having illustrated the annular slip guiding 8 rotating slide for guiding in this example, but guiding 8 of sliding can have linear or curved shape. Alternatively, guiding 8 of sliding can have the cut annular shape of part or straight line shape.

In addition, as the embodiment of microphone apparatus, Figure 14 A and 14B illustrates and depends on that the directivity sound source parts 9 of slide direction generation alternative sounds signal component are arranged on the example near microphone 4.

Similar with Fig. 2 A and 2B and Figure 13 A and 13B, Figure 14 A and 14B also respectively illustrates Personal Computer 100 and the example of earphone 200. In the drawings, part around microphone 4 is used as directivity sound source parts 9.

Directivity sound source parts 9 depend on that slide produces the material of alternative sounds or a part for structure.

Figure 15 A to 15C shows the example of directivity sound source parts 9. Such as, Figure 15 A show have produce by contacting with each other sound, cellulosic and there are the directivity sound source parts of the such material character of elasticity at root. It can be the material with such character, or can be the structure made according to mould etc.

In this case, assume that directivity sound source parts 9 have such character: such as shown in fig. 15b when performing slide to the right, easily contact with each other and easily produce sound, but when performing slide as shown in figure 15 c like that to the left, can not contact with each other and therefore, it is difficult to produce sound.

That is, the frequency response characteristic being produced sound depends on the direction of slide and changes. By this species diversity of sound detected between two directions, it is possible to perform different control treatment for each direction.

The example of directivity sound source parts 9 comprises uses the parts that the hair of such as pig hair and so on is made, the parts utilizing nylon, polypropylene, polyolefine, ABS, glass fibre, FRP etc. to be woven into spiral or cloth line form, and the parts being made up of the material of the material and so on that such as have passed through the processing of cloth line, the processing of cloth line makes the both sides of the fabric of the VELVET or velveting and so on such as not only made by hair or silk but also by cotton, regenerated fiber, cellulose acetate etc. fluff.

In addition, the structure being made up of the combination of the material of such as metal, rubber or resin and so on or these materials also can be manufactured to when depending on that its structural shape produces different sound when touching from different directions, and therefore can be used as directivity sound source parts 9.

The situation that although above-mentioned Figure 15 A to 15C relates in one direction and slides on the direction contrary with this direction, as mentioned above, it is necessary, but also it is conceivable that going out to depend on that slip direction produces the multiple materials and structures of alternative sounds.

Certainly, with regard to the slip direction making produced sound different, sound not only can be made as shown in Figure 15 A to 15C just to different between slip direction from reverse slip direction, but also can be different between X-direction and the Y-direction orthogonal from X-direction. In addition, it is possible to make sound different between X-direction, Y-direction and diagonal lines direction.

In addition, as shown in FIG. 20 A, it is also possible to make sound different between positive X-direction (X1), inverse X-direction (X2), positive Y-direction (Y1) and inverse Y-direction (Y2).

Figure 14 A and 14B each illustrates the situation producing alternative sounds between the slip in directivity sound source parts 9 slip in the X direction and Y-direction with such material or structure.

In this case, the sound produced when carrying out slidably reciprocating motion in the X direction from when carrying out in the Y direction slidably reciprocating motion between different. Therefore, such as, the slide detection part 2 shown in Fig. 1 is possible not only to the start/end judging slide, but also can judge that slide is performed in the X direction or in the Y direction. Function unit 3 can perform control treatment according to this judgement.

Therefore, when distinguishing between both consciously while of performing the slide in X-direction and the slide in Y-direction as user, it is possible to carry out different types of operation input.

Figure 16 shows the example being designed to detect the configuration of the sound signal processing parts 1 of slip direction when directivity sound source parts 9 are arranged near microphone 4, specifically, shows the configuration of slide detection part 2.

Figure 16 shows in detail the inside configuration of the slide detection part 2 from the basic configuration shown in Fig. 1.

In this case, by utilizing the judgement process of the slip sound signal components produced by slide, slide detection part 2 judges slide from institute's input audio signal and end, and the direction of detection slide.

Then, function unit 3 the slide determined by slide detection part 2 to during the period terminated, performing the predetermined control process that arranges for the slide direction detected by slide detection part.

This slide detection part 2 comprises low-pass filter 52, definitely value circuit 53, low-pass filter 54 and judges processing element 55. These assemblies can be considered to describe in configuration example I, II with III when above-mentioned NC earphone 10 those are identical.

That is, low-pass filter 52 extracts slip sound signal components from the voice signal utilizing microphone 4 to obtain. Although assume that low-pass filter here, but depend on material or the structure of directivity sound source parts 9, it is also possible to there is the situation being suitable for using bandpass filter.

This slip sound signal components by absolute value, is converted into envelope signal S by low-pass filter 54, and is provided to and judges processing element 55 in absolute value circuit 53.

Judge that processing element 55 is equipped with start/end check processing block 55a and slip direction detection block 55b.

Start/end check processing block 55a judges slide from signal S and end, and export slip according to this judgement to function unit 3 and start to detect signal SdetS and slip detection of end signal SdetE.

Slide detection part 2 is also equipped with bandpass filter 61-1,61-2,61-3 and 61-4, and absolute value circuit 62-1,62-2,62-3 and 62-4.

The passband central frequency of bandpass filter 61-1 is set as fc3.

The passband central frequency of bandpass filter 61-2 is set as fc4.

The passband central frequency of bandpass filter 61-3 is set as fc5.

The passband central frequency of bandpass filter 61-4 is set as fc6.

Absolute value circuit 62-1,62-2,62-3 and 62-4 detect block 55b by by making bandpass filter 61-1, the exporting absolute value of 61-2,61-3 and 61-4 and signal S1, S2, S3 and S4 of obtaining be supplied to the slip direction judged in processing element 55 respectively.

Slip direction detection block 55b observes the characteristic based on signal S1, S2, S3 and S4.

Such as, detect in block 55b in slip direction, pre-set the trend of frequency response characteristic for each slip direction. These are compared with S4 with signal S1, S2, S3, and according to the mode identical with pattern recognition, the direction corresponding with closest to characteristic is confirmed as slip direction. Then, slip direction is judged that signal Sd exports to function unit 3 by slip direction detection block 55b.

Comprise the process in the judgement processing element 55 of start/end check processing block 55a and slip direction detection block 55b as shown in figure 17.

It is noted that in fig. 17, the process identical with the process in above-mentioned Fig. 8 represents by identical number of steps, and removes from and repeat to describe.

In the process shown in Figure 17, in step F 101 to F106, as the process of start/end check processing block 55a side, determine the beginning of slide according to the mode identical with the situation of Fig. 8.

Then, if judging that slide starts in step F 106, and slide and start to detect signal SdetS and be output, then detect the process of block 55b side as slip direction, judge that processing element 55 judges slip direction in step F 140 and exports slip direction and judge signal Sd.

Slip direction detects block 55b by signal S1 to S4 compared with the frequency response characteristic pattern preset for each slip direction, and the pattern close according to the frequency response characteristic based on current demand signal S1 to S4 determines slip direction.

Figure 18 A and 18B and Figure 19 A and 19B respectively illustrates the example how determining slip direction.

Figure 18 A and 18B shows and performs frequency response characteristic when sliding when directivity sound source parts 9 are shackle button (hook-and-loopfastener) form respectively in positive dirction and reverse direction.

During sliding in the positive direction, the frequency peak indicated such as the peak 1 in Figure 18 A and peak 2 is observed. During sliding in reverse direction, the frequency peak indicated such as the peak 3 in Figure 18 B and peak 4 is observed. Such as by utilizing the difference according to the frequency response characteristic of slip direction to judge slip direction.

Figure 19 A and 19B schematically shows judgement process.

As shown in Figure 19 A, it is assumed that each passband central frequency fc3 to fc6 of bandpass filter 61-1 to 61-4 is set to 50Hz, 150Hz, 3KHz and 7KHz corresponding with 1 to the peak, peak 4 shown in Figure 18 A and 18B respectively.

As in Figure 19 B just to shown in gliding model pattern, for signal S1 to S4, frequency response characteristic is just being observed to peak 1 and peak 2 during sliding for making.

In addition, as shown in gliding model pattern reverse in Figure 19 B, for signal S1 to S4, frequency response characteristic is observed for making peak 3 and peak 4 during reverse slip.

Detecting in block 55b in slip direction, the model pattern corresponding with signal S1 to S4 is pre-arranged by this way.

Respective level according to the signal S1 to S4 inputted, judges, by pattern match, the model pattern that corresponding frequencies characteristic is close. Then, determine slip direction based on this result.

Such as, illustrated go out example in, the frequency response characteristic based on institute input signal S1 to S4 is considered to close to just to gliding model pattern. Therefore, slip direction is confirmed as positive dirction.

Although this example just to and reverse slip between distinguish, this is also applicable to the situation carrying out distinguishing between X-direction and Y-direction.

, as shown in FIG. 20 A, in addition this is also applicable in positive X-direction (X1), against the situation carrying out distinguishing between X-direction (X2), positive Y-direction (Y1) and the slide in Y-direction (Y2). Such as, as shown in fig. 20b, each corresponding with slip direction X1, X2, Y1 and Y2 frequency response characteristic model pattern is prepared in advance. Then, by judging the model pattern that the frequency response characteristic that obtains from institute input signal S1 to S4 is close, it is possible at slip direction X1, distinguish between X2, Y1 and Y2.

Although pattern match is based on utilizing four band levels of four bandpass filter 61-1 to 61-4 to perform in this example, but should restrictively this not explained. Need not say, in any situation, as long as different frequency response characteristic can be judged according to slip direction.

Such as, if significantly when slip direction is that positive dirction time-frequency band A peak value occurs and when slip direction is that reverse direction time-frequency band B peak value occurs, then can be provided for two bandpass filter of frequency band A and B. Optionally, it is possible to by utilizing five or more bandpass filter, frequency response characteristic is divided into five or more frequency bands and performs Frequency Response Matching.

In the step F 140 of Figure 17, slip direction detection block 55b such as judges slip direction by above-mentioned method for mode matching, and exports slip direction to function unit 3 and judge signal Sd.

Therefore, when when starting to be detected of slide, by the process in step F 106 and F140, sliding starts to detect signal SdetS and slip direction judges that signal Sd is provided to function unit 38.

Next, judge that processing element 55 judges the end of slide in the way of identical with the situation of Fig. 8 in step F 107 to F111.

Then, if it is determined that slide terminates, then judge that processing element 55 exports slip detection of end signal SdetE to function unit 38 in step F 112.

When slide detection part 2 starts to detect signal SdetS, slip detection of end signal SdetE based on slip and slip direction judges that signal Sd performs above-mentioned process, according to relative to the slip direction of microphone 4, function unit 38 can identify that multiple operation inputs. , it is possible to perform different control treatment according to these operation inputs, such as, therefore the such as control of volume raise/lower and so on.

Therefore, it is possible to carry out two or more operation inputs by the slide on single microphone 4.

In addition, when the slide on multiple microphone being distinguished from each other out as in the configuration Example II of above-mentioned NC earphone 10 and III, it is possible to perform a greater variety of operation.

In addition, if being independent as the slip sound on each direction in the four direction as shown in FIG. 20 A specifying axle, and when this sound can be carried out vector disaggregating treatment, such as, then can also detect four or more direction (slip on diagonal lines direction upwards).

If X/Y direction, four direction and multiple slip direction further can be determined, then slide can also be used for mouse operation or click equipment. In addition, it is also possible to slide is used for rolling operation.

Figure 21 A and 21B illustrates the situation being provided with slide guiding 8 and directivity sound source parts 9 separately.

Although Figure 21 A and 21B also respectively illustrates such as the Personal Computer 100 in Fig. 2 A and Fig. 2 B, Figure 13 A and Figure 13 B and Figure 14 A and 14B and earphone 200, but in Figure 21 A and 21B, guiding 8 of sliding is formed directivity sound source parts 9.

Such as, convex (rail-like) slip guiding 8 is formed on around microphone 4 with annular shape. Slide guiding 8 material or structure make directivity sound source parts 9 just to reverse on produce alternative sounds.

As indicated by arrow R1 and R2, user can carry out operation input while carrying out distinguishing between the slid clockwise and counterclockwise slip direction of guiding 8 of sliding.

Equally, when configuration above, slide detection part 2 can be configured to judge start/end and the slip direction of slide as in Figure 17.

Then, function unit 3 can perform control treatment according to slip direction. Such as, the convenience that the intuitive operation used in equipping can be strengthened user of the advance of volume raise/lower and sound channel/return or playing back content is comprised at common AV.

Although this example relates to the situation that guiding rotates the ring-type slip guiding 8 of slide, but guiding 8 of sliding can also have linear or curved shape. Alternatively, guiding 8 of sliding can have the cut annular shape of part or rectilinear shape. When each such slip guiding 8 is formed directivity sound source parts 9, so that it may with according to just inputting to carrying out multiple operation with reverse slip direction along guiding 8 of sliding.

Next, it is arranged on the embodiment near microphone 4 by describing the multiple slip sound source parts producing alternative sounds signal component when slide.

Such as, Figure 22 A shows the example that two ring-type slip sound source parts 8a and 8b are arranged on around microphone 4.

In addition, Figure 22 B shows two linear slip sound source parts 8a and 8b and is arranged on the example near microphone 4.

In these two kinds of situations, material and the shape of slip sound source parts 8a and 8b are different from each other, and produce different sound when sliding and be performed.

In this case, slide detection part 2 detects the position of slide from input audio signal. That is, the judgement process of the slip sound signal components produced by slide by utilizing, slide detection part 2 is from the voice signal inputted determines slide and end, and the position that detection slide is performed.

The position that is performed of detection slide refer to judge slide slip sound source parts 8a and 8b which on be performed. Owing to when slip is performed, slip sound source parts 8a and 8b produces alternative sounds, therefore equally in this case, it is possible to adopt configuration as shown in figure 16 and process.

Namely, it is possible to determine sliding position by the frequency response characteristic of the sound utilizing each slip sound source parts 8a and 8b to obtain is carried out pattern match. Then, according to the beginning of slide and the judgement of end, slide detection part 2 exports slip to function unit 3 to start to detect signal SdetS and slip detection of end signal SdetE, and export sliding position determine signal.

Can determine from sliding position due to function unit 3 signal identifies slide slip sound source parts 8a and 8b which on be performed, therefore function unit 3 can perform the different control treatment according to this identification. Such as, function unit 3 is such as performed the control that volume raises when slip sound source parts 8a operates, and is performed the control that volume reduces when slip sound source parts 8b operates.

Therefore, user can by selecting the sliding position near microphone 4 to carry out multiple operation input.

It is noted that can be combined based on the differentiation between this differentiation of sliding position, the differentiation based on slip direction described above and this external multiple microphone 4, multiple operation input can be carried out.

Although being described above each embodiment, as mentioned above, it is necessary, the disclosure also can be applicable to multiple electronics. Below, by illustrate the disclosure be applied to concrete electronics time configuration and advantage, its amendment etc.

First, it is arranged in the media player 20 shown in Fig. 4 it is conceivable that by sound signal processing parts 1 (slide detection part 2 and function unit 3).

That is, the function of de-noising unit 14 is structured in media player 20. In this case, media player 20 is the concrete device being provided with the sound signal processing parts 1 according to disclosure embodiment, and can provide the effect identical with above-mentioned NC earphone 10.

Microphone 4 in this situation can be installed in the Headphone device being connected, or can be the microphone equipment being separated with Headphone device being connected to microphone input termi-nal. Certainly, if microphone is structured in the main body of media player 20, then this microphone can be used.

When the sound record of such as IC register and so on is equipped, microphone 4 is set up, and therefore configuration as shown in Figure 1 can easily be implemented. In this case, record microphone level etc. is regulated it is conceivable that being used for by the slide on microphone 4.

In addition, the imaging equipment of many types of such as Digital Still Camera and video camera and so on also starts to be provided with microphone. The configuration shown in Fig. 1 is provided to make it possible to utilize microphone to carry out operation input to such imaging equipment.

Such as, when Digital Still Camera, it is used for performing rolling operation by slide it is conceivable that when playback or search captured images. When video camera, such as, put or camera zoom operation it is conceivable that slide being such as used for the object to be caught is carried out contracting.

When game machine, the slide on microphone 4 can be used to carry out the operation relevant with game.

When television set, the slide on microphone 4 can be used to carry out the rolling operation for channel selection, volume control operations etc.

Such as, equally, the disclosure also can be applicable to Personal Computer, mobile information treatment unit (personal digital assistant (PDA)), portable phone etc.

When the microphone being used for sound input being supplied to the equipment of these types, it is possible to by carrying out operation input in the enterprising line slip operation of microphone. Such as, by utilizing the stereophony microphone for communicating being arranged in Personal Computer or mobile PC, it is possible to carry out identifying operation by detection slide, and perform predefined process. Such as, it is conceivable that slide being assigned as mouse operation, some selection operation, rolling operation etc.

When portable phone, certainly it is provided with microphone. Therefore, by utilizing this microphone, the disclosure can be employed and not reinstall the burden of microphone apparatus. Such as, the disclosure can be suitably applied to rolling operation when searching in telephone number, address, sending destination title etc.

In addition, the disclosure also can be applicable to various communicator, audiovisual (AV) equipment, consumer-elcetronics devices etc.

In addition, as the kind of the operation undertaken by slide, it is conceivable that going out multiple example, such as, about the operation of recording/playback, the operation about sending/receiving, menu control operation, carriage return operation and power on/off operations.

, in many cases, in addition microphone is installed in very portable mobile equipment, such as NC earphone, media player, portable phone, mobile PC and portable game. Accordingly, it may be possible to remove from, to install the switch taking larger space be favourable.

It should be noted that due to such equipment be small-sized, the resource being therefore arranged on inner CPU or DSP of equipment is necessarily limited. From this background, it is desirable to detection algorithm is computationally light as much as possible.

Therefore, the energy that performs on a timeline according to embodiment is determined process and is detected slide and more effective without the need to performing the above-mentioned algorithm of frequency analysis etc.

For the operation species given by slide, except the microphone that is performed by slide, slip direction, sliding position etc. are distinguished, it is also possible to assign multiple operation by combining interrupted slide, slide interval etc.

In addition, when user performs slide by finger, it is different for referring to that abdomen performs slide from the slip sound utilizing nail tip to perform between slide to produce in utilization. That is, the frequency response characteristic of the slip sound signal components obtained is different. Therefore, these two kinds of situations can be distinguished from each other out by slide detection part 2 when determining slide. Therefore, also it is conceivable that according to the slide paid close attention to be utilize refer to that abdomen or nail perform assign different operations, thereby increase the kind of the operation undertaken by slide.

With regard to microphone, it is possible not only to adopt the microphone for other sound inputting function, and can provide special in the microphone of slide input. If can be provided for operating a large amount of microphones of input, then these microphones can be utilized to carry out multiple operation input.

Microphone for slide can be any one in stereophony microphone, monophonic microphone and multichannel microphone.

Incidentally, in the above-described embodiments, slide detection part 2 and 37 output slip starts to detect signal SdetS and slip detection of end signal SdetE.These signals can be taked to allow function unit 3,38 to identify the beginning of slide and any signal form of end.

Such as, slide and start to detect the signal that signal SdetS and slip detection of end signal SdetE can be H level pulse separately, or can be rise to H level when sliding and start and at the end of sliding, drop to the signal of the pulse of L level. That is, this pulse is the pulse turning into H level during the slide period continuously. Certainly, pulsed logic can be reversed.

In addition, signal form can for making high-frequency impulse be output with repeating during the slide period.

8. program

Program according to disclosure embodiment is the program making arithmetic processing device perform slide detecting step and rate-determining steps.

The judgement process of the slip sound signal components in the voice signal that slide detecting step is collected by microphone that is integrated or that connect separately by utilizing judges slide and end. Slip sound signal components be by microphone originally slide with it or near it produce.

The slide that rate-determining steps is determined in slide detecting step start to terminate period during perform for slide arrange predetermined control process.

Audio-signal processing apparatus according to disclosure embodiment is implemented as the function unit (arithmetic processing device) in often kind of above-mentioned various equipment, and operates based on such program. That is, the process in Fig. 3 and Fig. 8 (or Figure 12, Figure 17 etc.) is performed.

Such program can be recorded on the HDD as the recording medium in the equipment being implemented in such as Personal Computer and so on, the ROM having in the microcomputer of CPU, flash memory etc. in advance.

Alternatively, this program can temporarily or forever be stored (record) on removable recording medium, such as floppy disk, compact disc read write (CD-ROM), magneto-optic (MO) dish, DVD, Blu-ray disc, semiconductor memory or storage card. Such removable media can be provided as so-called encapsulation software.

Except be installed in Personal Computer etc. from removable media, program can also be downloaded from download website via the network of such as local area network (LAN) or Internet and so on.

According to embodiment of the present disclosure, it is possible to use microphone as operation input apparatus, identify operate continuously or can the operation of assigned operation amount, and perform corresponding control. Therefore, as the operation of operate continuously or assigned operation amount, user can utilize microphone to perform the operation etc. easily and intuitively operating, having good response, thus improves operability significantly.

In addition, the operation of usual driver plate easy to use or sliding bar can by utilizing microphone to perform, and this also suitably contributes to equipping the reduction of cost, the simplification etc. of device configuration.

The disclosure comprises the relevant theme of theme disclosed in the Japanese Priority Patent application JP2010-125501 submitted to Japan Office with on June 1st, 2010, and whole contents of this application are incorporated into this by reference.

The technician of this area it should be appreciated that various amendment, combination, sub-portfolio and change can be carried out according to design requirements and other factors, as long as they claims or its etc. jljl scope within.

Claims

1. an audio-signal processing apparatus, comprising:

Slide detection part, the voice signal collected by microphone is transfused to described slide detection part, and the judgement of described slide detection part slip sound signal components in input audio signal by utilizing process judges beginning and the end of slide, described slip sound signal components is by originally the slide generation with it or near it of described microphone;

Slide guiding parts, and described slip guiding parts are formed on the vicinity of described microphone and guide described slide;And

Function unit, described function unit the described slide judged by described slide detection part to during the period terminated, performing the predetermined control process that arranges for described slide,

Wherein, processing as described judgement, described slide detection part, when the time that the energy level of described slip sound signal components is equal to or higher than the first level continue for the very first time or is longer, judges that described slide starts, and

Wherein, processing as described judgement, described slide detection part, when the energy level of described slip sound signal components continue for for the 2nd time lower than time of the 2nd level or be longer, judges that described slide terminates.

2. audio-signal processing apparatus according to claim 1, wherein, described slide detection part utilizes finger or Slide tool described judgement processes to perform at the described microphone slip sound signal components that originally rotational sliding movement with it or near it produces.

3. audio-signal processing apparatus according to claim 1, wherein:

The voice signal of multiple sound channel is transfused to described slide detection part; And

Described slide detection part for by performing described judgement process by the voice signal that the voice signal of described multiple sound channel is added and obtain each other.

4. audio-signal processing apparatus according to claim 1, wherein:

Described slide detection part performs described judgement process for each in the voice signal of described multiple sound channel, and judges beginning and the end of described slide for each sound channel.

5. audio-signal processing apparatus according to claim 1, wherein:

Described slide detection part judges to include the sound channel judgement process of the sound channel of slip sound signal components by performing to be used for from the voice signal of multiple sound channel, and the judgement for the signal by being added each other by the slip sound signal components from multiple sound channel or subtract each other and obtain processes, judge beginning and the end of described slide, and judge to be performed the sound channel of described slide.

6. audio-signal processing apparatus according to claim 1, wherein:

Described slide detection part is also from the voice signal detection slide direction inputted; And

Described function unit the described slide judged by described slide detection part to during the period terminated, performing the predetermined control process that arranges for the described slide direction detected by described slide detection part.

7. audio-signal processing apparatus according to claim 1, wherein:

Described slide detection part is also from the voice signal detection slide position inputted; And

Described function unit the described slide judged by described slide detection part to during the period terminated, performing the predetermined control process that arranges for the described slide position detected by described slide detection part.

8. audio-signal processing apparatus according to claim 1, also comprises:

Microphone,

Wherein, the voice signal collected by described microphone is transfused to described slide detection part.

9. an audio signal processing method, comprising:

By utilize by the slip sound signal components in the voice signal that microphone is collected judgement process judge slide and end, described slip sound signal components by described microphone originally with it or near it slide generation;

Formed near described microphone and slide guiding parts and guide described slide by described slip guiding parts; And

From described slide to during the period terminated, performing the predetermined control process that arranges for described slide,

Wherein, process as described judgement, the time that the energy level at described slip sound signal components is equal to or higher than the first level continue for the very first time or longer time, judge that described slide starts, and

Wherein, process as described judgement, when the energy level of described slip sound signal components continue for for the 2nd time lower than time of the 2nd level or be longer, judge that described slide terminates.

10. a sound signal processing apparatus, comprising:

By utilizing by the judgement process of the slip sound signal components in the voice signal that microphone is collected judges slide and the device of end, described slip sound signal components is by originally the described slide generation with it or near it of described microphone;

Being formed near described microphone slides is guided parts and is guided the device of described slide by the described guiding parts that slide; And

From described slide to during the period terminated, performing the device of predetermined control process arranged for described slide,