WO2009102141A2

WO2009102141A2 - Apparatus and method for detecting impact sound and rhythm of impact sound

Info

Publication number: WO2009102141A2
Application number: PCT/KR2009/000633
Authority: WO
Inventors: Yong-Seog Son; Seung-Joo Ko
Original assignee: Pulsphere Co., Ltd
Priority date: 2008-02-14
Filing date: 2009-02-11
Publication date: 2009-08-20
Also published as: WO2009102141A3

Abstract

The present invention relates to an apparatus and a method for detecting an impact sound and the rhythm of the impact sound, and to a controlling operation of peripheral devices in accordance with the detected rhythm of the impact sound. The apparatus and method of the present invention comprise detecting an impact sound wherein the peak value of the sound inputted through a microphone is higher than a reference value (i.e., a threshold value), detecting the rhythm of the impact sound, and outputting a preset signal (or a control signal) corresponding to the rhythm, enabling the selective control of at least one of a plurality of peripheral devices.

Description

Apparatus and method for detecting an impact sound and its rhythm

The present invention relates to an apparatus and a method for detecting an impact sound and a rhythm caused by the impact sound, and controlling the operation of various peripheral devices preset according to the rhythm of the impact sound.

In general, a switch is used to turn on / off various electric devices.

The switch is used to control home appliances such as lighting, TV, and audio in a home. However, when the switch is fixed at a specific place or location, such as a light switch, the user must move to a specific place or location and then operate the switch. There was a hassle.

Accordingly, in recent years, a switch controlled by clapping (especially the number of claps) has been released, but the switch control method by clapping has a problem in that the recognition rate of clapping sounds falls in a place where there is a lot of noise. In other words, it is difficult to control the peripheral device because it is not easy to distinguish the applause from the noise.

In addition, since the applause sounds frequently occur in various situations (eg, when smiling and focusing attention) in daily life, there is a problem that the peripheral device can be controlled even by the unintentional applause.

In addition, as in the conventional technique of controlling a device by the number of claps, when there are many peripheral devices to be controlled or an operation to be controlled in one peripheral device increases, the number of claps corresponding to the number of the peripheral devices or the number of operations Since it should also be increased, it was difficult for the user to remember the number of claps corresponding to each peripheral device.

In addition, a device (e.g., a second peripheral) that operates by a large number of claps (e.g., five claps) and a device that operates by a small number of claps (e.g., three claps) When present together, when there was a clap sound for operating the first peripheral, there was a problem that the unintentional second peripheral can also be operated.

In addition, a conventional device for detecting an impact sound such as clapping requires a high performance microprocessor because a noise canceling circuit or a complex noise canceling algorithm needs to be applied in order to distinguish between the existing noise and the clapping sound. There was a problem of raising the unit price.

In addition, according to the characteristics of a microphone for detecting a shock sound, a device using one conventional microphone may have a large impact sound exceeding a sound pressure level that the microphone can detect or a minute that is less than the sound pressure level that the microphone can detect. When the impact sound was input, there was a difficulty in detecting the impact sound.

The present invention detects an impact sound having a peak value of a sound input through a microphone equal to or greater than a specific reference value (detection threshold value), determines a rhythm to which the impact sound is input, and determines a predetermined signal corresponding to the rhythm ( Or a control signal) to selectively control at least one of a plurality of peripheral devices.

In addition, the present invention adaptively sets a reference value (detection threshold) for the detection of the impact sound according to the magnitude and variation of the noise present in the surroundings, taking into consideration the average value of the input sound and the variance average value of the noise of the sound at the same time. The present invention provides a method and an apparatus for accurately distinguishing and recognizing impact sounds from ambient noise.

In addition, the present invention, in setting a reference value (detection threshold value) for the impact sound detection, it is possible to adaptively change the detection threshold setting magnification according to the amount of noise present in the surrounding, it is relatively less than usual depending on the surrounding situation It is an object of the present invention to provide a method and apparatus for recognizing the impact sound of a magnitude.

In addition, the present invention provides a method and apparatus for accurately recognizing impact sounds that have a long duration in a sounding space such as a bathroom, a staircase, or a corridor, by using a correlation according to a change in the peak value of an input sound. It is to.

In addition, the present invention allows the user to set a plurality of rhythm patterns desired by the user in addition to the impact sound rhythm patterns stored by default, and to control any one of a plurality of peripheral devices corresponding to each rhythm or a plurality of functions of a specific peripheral device. It is to provide a method and apparatus that can be.

In addition, the present invention allows the user to recognize all the impact sounds that can be generated using a specific object or the body of the person without any classification, so that the user can control the peripheral devices by generating the impact sound using the appropriate means according to the surrounding situation It is to provide a method and a device to make it.

It is also an object of the present invention to provide an apparatus and method for more accurately detecting an impact sound generated in a wide range of sound pressure level bands by using at least two microphones from ambient noise.

In addition, the present invention is to provide a device and a method for more accurately detecting a large impact sound or a fine impact sound by widening the bandwidth of the impact sound that can be detected using two or more microphones having different characteristics.

In addition, the present invention is to provide an apparatus and method for determining the impact sound by selectively using the input signal of a specific microphone of two or more microphones having different sound pressure level characteristics according to the surrounding situation.

The present invention also provides an apparatus and method for more accurately detecting impact sounds generated in a wide range of sound pressure level bands by using at least two microphones having different sound pressure level characteristics.

In addition, the present invention is to provide an apparatus and method for detecting the impact sound more accurately by selectively using a signal input from a microphone having a lower sensitivity when the impact sound is relatively larger than the ambient noise.

In addition, the present invention is to provide an apparatus and method for detecting the impact sound more accurately by selectively using a signal input from a microphone having a high sensitivity when a relatively small impact sound is input than usual.

An apparatus related to an embodiment of the present invention for realizing the above object includes a microphone for receiving an acoustic signal and converting it into an electrical signal; A memory configured to store a detection reference value set in consideration of a variance average value of noise and impact sound rhythm pattern information set corresponding to a plurality of peripheral devices for detecting the impact sound included in the acoustic signal; An AD conversion unit for sampling the sound signal input through the microphone and converting the sound signal into a digital value, an sound frame processing unit for dividing the sound signal converted into the digital value into predetermined frame units, and the impact sound included in the frame. An impact sound determination unit for detecting a time interval between the impact sounds, and a rhythm pattern composed of the number of the impact sounds and the time interval information, and a rhythm pattern matching the rhythm pattern and a plurality of rhythm patterns previously stored in the memory; And a control unit including a rhythm determination unit for detecting a signal and a signal output unit for outputting a predetermined control signal to a peripheral device corresponding to the matched rhythm pattern.

In addition, the apparatus related to an embodiment of the present invention for realizing the above object is an algorithm for processing at least two or more microphones having different characteristics, the characteristic information of each microphone, or a sound signal received simultaneously from each microphone; And a memory for storing the related information and the impact sound rhythm pattern included in each sound signal received from each microphone, and then the impact sound rhythm patterns of the sound signals are the same or only in one sound signal. And a control unit for controlling an operation of a peripheral device corresponding to the impact sound rhythm pattern when the same impact sound rhythm pattern is detected in the memory.

In addition, the method related to an embodiment of the present invention for realizing the above-described problem is to receive the sound signal and convert it to a digital value, the basic detection using the preset default magnification (T) according to the magnitude average value (Pa) The threshold value is calculated, the final setting magnification Tf is calculated by reflecting a weight W according to the dispersion degree of noise included in the sound signal in the basic setting magnification T, and the input sound signal is calculated. When it is greater than the detection threshold set by the final setting magnification Tf, it is determined that a shock sound is input, and a rhythm pattern including a shock sound included in one frame of the sound signal and a time interval between each shock sound is generated, and the generation It compares and detects whether the same rhythm pattern is already stored in the memory within the error range and the rhythm pattern of one impact sound. With respect to the peripheral device in response made to output a predetermined signal.

In addition, the method according to an embodiment of the present invention for realizing the above object is to receive at least two or more sound signals and process each, and to determine the sound signal of the impact sound is detected among the processed sound signals to the sound signal When the impact sound is detected only in any one of them, the peripheral device corresponding to the rhythm pattern of the impact sound is made. When the impact sound is detected in all of the sound signals, the impact sound rhythm pattern is detected from each sound signal and compared with each other. If the impact sound rhythm patterns of the sound signals are identical to each other, the peripheral device corresponding to the impact sound rhythm pattern is detected. To control. When the impact sound rhythm patterns of the respective sound signals are different from each other, it is detected whether a rhythm pattern corresponding to each impact sound rhythm pattern is stored in the memory, and the impact sound rhythm patterns of the respective sound signals are different from each other, and any impact sound rhythm is different. When only the pattern matches the impact sound rhythm pattern previously stored in the memory, the peripheral device corresponding to the impact sound rhythm pattern is controlled, and the impact sound rhythm patterns of the respective sound signals are different from each other, and the shock sound rhythm patterns of all the sound signals match. When the rhythm patterns are stored in the memory, the error processing operation is performed.

The present invention configured as described above has an effect of remarkably reducing the amount of calculation and power consumption by distinguishing the input shock sound by using the peak value of the impact sound in the acoustic frame.

In addition, the present invention by considering the average value of the input sound and the average of the dispersion of the sound at the same time, by adaptively setting the reference value (detection threshold) for detecting the impact sound according to the type and size of the noise present in the surroundings, There is an effect that can accurately recognize the impact sound from the ambient noise.

In addition, the present invention, in setting a reference value (detection threshold value) for the impact sound detection, it is possible to adaptively change the detection threshold setting magnification according to the amount of noise present in the surrounding, it is relatively less than usual depending on the surrounding situation It also has the effect of recognizing the impact sound of the magnitude.

In addition, the present invention has an effect of accurately recognizing the impact sound that appears long duration in the sound ring space, such as bathroom, stairs, corridors, using the correlation according to the change in the peak value change of the input sound.

In addition, the present invention allows the user to set a plurality of rhythms desired by the user in addition to the impact sound rhythm stored by default, and can control at least one of a plurality of peripheral devices corresponding to each rhythm or any one function of a plurality of specific peripheral devices. It is effective.

In addition, the present invention allows the user to recognize all the impact sounds that can be generated using a specific object or the body of the person without any classification, so that the user can control the peripheral devices by generating the impact sound using the appropriate means according to the surrounding situation It is effective.

In addition, the present invention constituted as described above has the effect of widening the bandwidth of the shock sound that can be detected by using two or more microphones having different characteristics for the impact sound detection, so that a large impact sound or a fine impact sound can be detected more accurately.

In addition, the present invention by using at least two or more microphones having different characteristics in order to detect the impact sound, it is effective to improve the impact sound recognition rate by selectively receiving and processing the input signal of a specific microphone according to the ambient noise environment have.

In addition, the present invention has the effect of improving the misunderstanding of the impact sound by using the input signal of the microphone that is easy to detect the impact sound according to the ambient noise environment of at least two microphones having different sound pressure level characteristics in detecting the impact sound. .

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram of an embodiment showing a configuration of an apparatus for detecting an impact sound and a rhythm of the impact sound according to the present invention.

Figure 2 is a block diagram of one embodiment showing a configuration for processing signals output from at least two microphones in accordance with the present invention.

Figure 3 is a block diagram of an embodiment showing the configuration of a device for detecting the impact sound and the rhythm of the impact sound in the signal received from the microphone according to the present invention.

4 to 7 are exemplary diagrams for explaining and comparing sound signals input from a plurality of microphones having different characteristics according to the present invention.

8 to 11 is an exemplary diagram of a graph for explaining the impact sound detection method according to the present invention.

12 is a flowchart for explaining a method of calculating a basic detection threshold value according to a default setting magnification by a size average value as an example related to the present invention.

13 is a flowchart illustrating a method of calculating a final setting magnification reflecting a weight according to a dispersion degree of noise in a basic setting magnification T as an example related to the present invention, and calculating a final detection threshold accordingly.

14 is a flowchart for explaining a method of determining an impact sound using a detection threshold set by a final setting magnification as an example related to the present invention.

FIG. 15 is a flowchart illustrating a method of outputting and controlling a preset control signal to a peripheral device corresponding to an input shock sound rhythm as an example related to the present invention; FIG.

16 is a flowchart illustrating a method of detecting an impact sound rhythm when receiving a plurality of sound signals as an example related to the present invention.

17 is an exemplary view for explaining a method of applying and using the apparatus according to the present invention.

Hereinafter, the apparatus and method for detecting the impact sound according to the present invention will be described. More specifically, the present invention receives an acoustic signal output through at least two microphones having different sound pressure level characteristics, and detects an impact sound by processing at least one input signal among the acoustic signals output from each microphone. The present invention relates to an apparatus and method for detecting a multi-channel impact sound.

In addition, in the present embodiment, when the impact sound is detected by using the signal output from at least one specific microphone as described above, as an application example, the rhythm pattern composed of the impact sound is detected, and according to the rhythm pattern of the impact sound, A method of controlling the operation of the peripheral device will be described together.

However, the detailed description of the well-known technology and its configuration which are determined to obscure the gist of the present invention will be omitted. In addition, in describing the present invention with reference to the drawings, components that perform the same function will be described with the same reference numerals.

The impact sound detected in the present invention means a sound generated by the impact, and means a sound generated when a sudden sudden force is applied to the object. The impact sound may be generated using a human body such as a hand, mouth, or foot, or may be generated by hitting an arbitrary object such as a ballpoint pen or a key against another object such as a floor, a wall, or a desk.

In the present invention, at least two microphones having different characteristics may be used. The characteristic of the microphone includes a characteristic related to the sound pressure sensitivity or the height of the sound pressure level. In the present embodiment, when the sound pressure sensitivity is high or low, the sensitivity may be large or small. In addition, the microphone may have a high sensitivity at a specific sound pressure level, or a specific sound pressure bandwidth. Therefore, by using two or more highly sensitive microphones at different bandwidths, the sound pressure bandwidth that can be detected by the device of the present embodiment can be widened.

Hereinafter, in the present embodiment, when using two or more microphones having different characteristics as described above, the impact sound detection device may detect the impact sound by processing a signal output from at least one microphone. In addition, each impact sound may be detected by simultaneously processing signals input from the two or more microphones. In addition, it is possible to detect the rhythm of the impact sound detected as described above and to control the corresponding peripheral device according to the detected rhythm.

Figure 1 is a block diagram of an embodiment showing the configuration of a device for detecting the impact sound and the rhythm of the impact sound according to the present invention, the device outputs a signal (or control signal) corresponding to the detected impact sound rhythm corresponding to You can control peripherals or their specific actions.

The device 100 for detecting the impact sound and the rhythm of the impact sound according to the present invention includes a communication unit 110, an input unit 120, an output unit 130, a memory 140, an interface unit 150, and a controller 160. ) And a power supply unit 170 and the like. However, not all illustrated components are essential components, and may be implemented by more components than the illustrated components, or by fewer components.

Hereinafter, the components will be described in detail.

The communication unit 110 may include one or more components for wired or wireless communication between the device 100 and the plurality of peripheral devices 200A to 200N of the present invention. For example, the wireless internet module 111 or the short range communication module 112 may be included. The wireless internet module 111 refers to a module for wireless internet access and may be internal or external. The short range communication module 112 refers to a module for short range communication, and includes Bluetooth, ultrasonic waves, radio frequency identification (RFID), ZigBee, infrared data association (IrDA), and ultra wideband (UWB). Can be used.

The input unit 120 is a component for receiving a sound and a key manipulation of a user, and a key for receiving a key 121 of a microphone for receiving a sound and a user's key manipulation for setting a rhythm pattern or a peripheral device corresponding to the rhythm pattern. It may include an input unit 122.

The microphone 121 receives an external sound signal by a microphone and processes the external sound signal into electrical sound data. In the present embodiment, the microphone 121 may include at least two

microphones

121a and 121b having different sound pressure level characteristics. For example, the first microphone 121a may have a high sound pressure level characteristic, and the second microphone 121b may have a low sound pressure level characteristic. If more microphones are provided, the sound pressure level can be further subdivided. In addition, the sound pressure level characteristics may be configured to partially overlap.

Here, the characteristics of each microphone may be implemented by the microphone itself, or may be implemented by adding a separate electric circuit to the microphone of the same characteristic. For convenience, the method of differently implementing the sound pressure level characteristics of the microphones is not highly related to the gist of the present invention, and a description thereof will be omitted.

The key input unit 122 generates a command for the user to control the operation of the device, and includes a key pad, a dome switch, a touch pad (constant voltage / capacitance type), a jog wheel, a jog switch, and the like. It may be configured as.

The output unit 130 is for outputting audio information for outputting an alarm or motion information or video information such as text or an image, and may include a display unit 131 and an alarm unit 132.

The display unit 131 may display information or an operation state processed by the apparatus 100 for detecting the impact sound and the rhythm of the impact sound of the present invention. For example, the operation state of the apparatus 100 may be displayed by a GUI (Graphic User Interface) method or may be displayed using a light emitting device (eg, an LED). There may be two or more display units 131 according to the configuration of the device. For example, a plurality of light emitting devices that output different colors according to an operating state (eg, a normal operating state or an error operating state) may be used. Data and control information for each operation state may be stored in the memory 140.

The alarm unit 132 outputs a sound signal by using an audio output device such as a speaker or a buzzer for event information or an operation state processed by the apparatus 100 of the present invention. The sound signal may be a simple sound effect or may be a guide message using a human voice. Examples of the event include a key input, an impact sound input, an error occurrence, and normal operation. Data and control information according to each event or operation state may be stored in the memory 140.

The memory 140 may store a program for processing and controlling the control unit 160, and input / output data (for example, information for detecting a shock sound, information about a shock sound rhythm, and corresponding to each impact sound rhythm). It can also perform a function for the temporary storage of the signal information to be output, information to be output according to the occurrence of the event or operation state. In addition, the memory 140 includes an algorithm for blocking input of a signal containing a lot of noise, or stopping processing of the signal, each of which is difficult to detect an impact sound among signals output from microphones having two or more characteristics. The microphone's characteristic information can be additionally stored.

The memory 140 may include at least one of a flash memory type, a hard disk type, various types of random access memory (RAM), and read-only memory (ROM). It may include a storage medium.

The interface unit 150 serves as an interface with all peripheral devices connected to the device 100 of the present invention. For example, a port for power connection, a port for wired / wireless data communication, a port for connecting an external display means or an input means or an actuator means, an audio input / output (I / O) port, and the like may be included.

The controller 160 typically controls the overall operation of the apparatus 100 for detecting the impact sound and the rhythm of the impact sound. For example, the peripheral apparatus or the device 100 itself controls the sound processing for detecting the impact sound from the input sound, the determination of the impact sound, the rhythm determination by the impact sound, and the determined rhythm of the impact sound. Here, the control of the device itself means switching the device to a standby mode or an active mode. The peripheral device may be controlled in the operation mode, but the peripheral device may not be controlled in the standby mode, and only a shock sound for switching to the operation mode may be recognized.

In addition, when at least two microphones are provided as in the present embodiment, the controller 160 may detect impact sounds by processing signals output from the microphones, respectively. However, when a lot of noise is contained in the signals, it is difficult to detect the impact sound, so that the input of the signal is interrupted or the processing of the signal is stopped, and the impact sound can be detected from a signal input from another microphone. That is, the impact sound is detected by selecting a signal output from a microphone having an appropriate characteristic (a characteristic that is easy to detect an impact sound) according to the ambient noise condition. As described above, by receiving and processing a sound signal including a shock sound which can be more clearly distinguished from the ambient noise, it is possible to increase the accuracy by reducing the misunderstanding of the shock sound.

The power supply unit 170 supplies power required for the operation of each component.

The various embodiments described herein may, for example, comprise separate software modules or hardware such as digital signal processors (DSPs) or programmable logic devices (PLDs) or microprocessors that perform one function or operation. Can be implemented. In this case, the software code may be stored in the memory 140 and executed by the controller 160.

Hereinafter, the operation of detecting the impact sound and the rhythm of the impact sound according to the present invention will be described in more detail with reference to the accompanying drawings.

Figure 2 is a block diagram of an embodiment showing a configuration for processing a signal output from at least two microphones in accordance with the present invention, each component shown in this may be configured as a separate hardware, the controller 160 It may be configured as one component within, or may be configured as a software module to be performed by the control unit 160.

As shown in the drawing, the controller 160 may receive signals output from at least two

microphones

121a and 121b through separate signal input ports. As such, when a signal output from each microphone is input through a separate signal input port, the controller 160 internally receives both signals output from both microphones through port switching, or is output from one microphone. The signal may be selectively input.

Alternatively, when the external switching unit 180 is provided, each microphone is connected to one side (input side) of the switching unit 180 and the other side (output side) is connected to a specific port of the controller 160. . In addition, the control unit 180 may output a control signal (or a switching signal) to the switching unit 180 to receive both signals output from both microphones, or to selectively receive only signals output from any one microphone.

In the present embodiment, the control unit 160 processes the signals received from the two

microphones

121a and 121b in parallel, but the processing method of each signal may be the same or slightly different. Only the processing method will be described.

As shown in the drawing, when the sound signal is input through the microphone 121, the controller 160 samples the sound signal at a specific frequency (for example, 8 KHz, 16 KHz) through the A / D converter 161. Then, as shown in FIG. 4, a digital value (for example, 0 to 64,000, or -32,000 to +32,000) according to the level (amplitude) of the input sound signal is converted and output. As shown, the higher the level of the signal is converted to a digital value having a larger value, and the lower the level of the signal is converted to a digital value having a smaller value.

In this case, when the sound pressure level characteristics of the

microphones

121a and 121b are different, the acoustic signals of the microphones output through the A / D converter 161 are also different. For example, FIGS. 5 to 7 compare sound signals detected by a highly sensitive (= sensitive) microphone 121a and a less sensitive (= sensitive) microphone 121b at a specific sound pressure level.

As shown in FIG. 5, when an impact sound (eg, clapping) is input in a quiet state, the sensitive microphone 121a detects the impact sound well at an appropriate level (301). However, under the same conditions, the insensitive microphone 121b is detected 302 at a relatively small level of impact sound. Therefore, in this case, the controller 160 may detect the impact sound by processing the signal output from the sensitive microphone 121a.

Also, as illustrated in FIG. 6, when a shock sound is input in a state where a specific noise (for example, a radio sound) 303 is present in the surroundings, the sensitive microphone 121a is distinguished by clapping with the impact sound 304 mixed with the ambient noise. (305). However, under the same conditions, the insensitive microphone 121b has a good applause (306) compared to the ambient noise. Therefore, in this case, the controller 160 may detect the impact sound by processing the signal output from the insensitive microphone 121b.

In other words, when the TV or radio is turned on or when several people are talking, when a shock sound relatively louder than the ambient noise is input, the controller 160 detects a dull micro shock sound at which the ambient noise is hardly input. Can be. At this time, the sensitive microphone, which is well inputted with the ambient noise, has a large dispersion value of the impact sound detection algorithm. Therefore, even if the maximum input value is input, the control unit 160 switches to a state in which it is not recognized as a shock sound, and thus misunderstanding due to noise is a source. Is blocked.

In addition, as shown in FIG. 7, when a shock sound is input in a place where a sound sounds, such as a bathroom or a corridor, the sensitive microphone 121a may not be distinguished how many impact sounds are due to the surrounding sound (307). However, in the same condition, the insensitive microphone 121b is sounded, but a signal capable of distinguishing a relatively shock sound is output (308). Therefore, in this case, the controller 160 may detect the impact sound by processing the signal output from the insensitive microphone 121b.

In other words, the microphone insensitive to a place where the ringing is severe, such as a bathroom or a corridor, does not input a shock sound thickly, so that the controller 160 may improve the recognition rate of the shock sound. That is, in the case of the single channel type impact sound detection method using one microphone, the non-impact sound such as voice and the impact sound such as clap have a strong tendency to be input in a similar waveform. There is a difficulty in accurately distinguishing the impact sound. However, the present embodiment allows the single channel type impact sound detection method to lower the probability of misrecognition that may occur in a noise environment. That is, the non-impact sound and the impact sound can be distinguished more accurately.

As described above, the present embodiment provides a multi-channel shock sound detection method as compared to the single-channel shock sound detection method, and compared to the single-channel shock sound detection method, a non-impact like voice (voice) in the surroundings. Even in the presence of noise, the insensitive microphone can be used to more accurately detect the impact sound that is input louder than the non-impact noise from the detected sound signal.

The sound frame processor 162 divides the sound signal converted into a digital value according to the level into frame units having a predetermined time interval (for example, 50 ms), and divides the sound signal having the maximum value in each frame into the sound of the corresponding frame. The peak value Pc is set. If the sound signal is unstable during the actual sound signal processing (for example, if there is ambient noise or if the power supply is unstable even if there is no ambient noise), the signal may be unstable. The difference value between may be used to detect an acoustic signal having the maximum value.

In the present exemplary embodiment, the controller 160 may control the sound frame processor 162 to sequentially process signals received from the

microphones

121a and 121b. For example, the signals input from each microphone are buffered in a specific area of the memory 140, and the frames of the sound signals received from the first microphone 121a and the frames of the sound signals received from the second microphone 121b are sequentially processed. Can be treated as

In this case, since the processing time required to process one frame by the controller 160 is about 20 ms and smaller than the size of one frame (eg 50 ms), that is, the frame processing time is a time interval of one frame (eg 50 ms). Since it is more than twice as fast, the signals received from the first and

second microphones

121a and 121b can be processed during the time interval of one frame (for example, 50 ms). That is, the sound peak value Pc can be detected in the corresponding frame of the sound signal received from each microphone for about the same time (for example, within 50 ms).

However, if the performance of the control unit 160 is poor, for example, if the processing time required to process one frame in the control unit 160 is about 30ms, for a time interval of one frame (for example, 50ms Cannot process two frames, i.e., the frame processing time is not more than twice as fast as the time interval of one frame (e.g., 50 ms), so that the second microphone 121b is used while buffering the signal of the first microphone 121a. ) And alternately process the signal of the first microphone 121a while buffering the signal of the second microphone 121.

Also, as illustrated in FIG. 8, the sound frame processing unit 162 calculates a magnitude average value Pa of the sound peak values Pc of each frame with respect to a predetermined number of frames (for example, 100). The predetermined frames for calculating the size average value Pa are each time a new frame is input, by excluding the frame inputted in time (oldest frame) and adding the new frame (current frame), Always maintain a constant number of frames (e.g. 100). For example, the magnitude average value Pa becomes larger or smaller in proportion to the magnitude of the ambient noise.

The frame processing as described above is performed on the signals output from the

microphones

121a and 121b, respectively. That is, the magnitude average value Pa of each signal output from each microphone is calculated.

Therefore, in the present invention, when the magnitude average value Pa is small, the basic setting magnification T of the reference value (detection threshold value) for detecting the impact sound is increased (e.g., 5-10 times the magnitude average value), and the magnitude average value Pa is obtained. In this case, the default setting magnification T of the reference value (detection threshold value) for the impact sound detection is made small (e.g., 2-3 times the magnitude average value). For example, as shown in FIG. 9, when the magnitude average value Pa is as small as 100, the default setting magnification T of the detection threshold is set to about 10, and when the magnitude average value Pa is as large as about 500, the basic value of the detection threshold is as follows. The setting magnification T is set to about 3.

The default preset magnification T can be set in advance by statistical values by experiment. However, the basic preset magnification T is applicable to the case where the ambient noise is always the same. Actually, the noise that may be present in the surroundings may have a large change range and a small change range as shown in FIG. 10. Noise N2 may be present in various ways.

Therefore, the magnitude average values Pa of the two noises N1 and N2 may be the same, but the degree of dispersion may be different.

Therefore, the sound frame processing unit 162 calculates a dispersion average value Da in order to determine how the sound peak value Pc of the current frame is dispersed from the calculated size average value Pa. That is, the variance average value Da determines whether the type of noise distributed in the surrounding is an impulsive noise having a large variation such as noise generated in a TV or a continuous noise having a small variation such as noise generated in a refrigerator. As described above, similarly to the size average value Pa, an update is performed for each frame by averaging the variance value of each frame with respect to a predetermined number of frames (for example, 100).

In this case, to calculate the variance value of each frame, one of any known variance equations using squares and roots may be used. However, in the present invention, the magnitude average value Pa and the acoustic peak value of the current frame may be used to reduce the calculation amount. It can be replaced by the difference from (Pc).

The variance average value Da increases according to the degree of change in the amount of ambient noise, that is, when the change in the amount of ambient noise is large (for example, the degree of watching TV), and the magnitude of the ambient noise does not change. If it is nearly constant (eg, talking to the Soggongon), the value is small.

Therefore, in the present invention, the variance average value Da is reflected when the detection threshold is set. That is, a weight W (1 = 1 (Da / Pa)) reflecting a ratio of the relative ratio of the variance average value Da to the size average value Pa is calculated, and the weight W is set as the default setting magnification of the detection threshold value. The value T * W multiplied by (T) is determined as the final set magnification (Tf = T * W) of the detection threshold. That is, the weight W also becomes large when the variance average value Da is large, and the weight W becomes small when the variance average value Da is small.

For example, assuming that the magnitude average value Pa is 100 and the variance average value Da is 100, the weight W = 1+ (Da / Pa) becomes 2, but the variance average value Da is 200, which is relatively large. If it is assumed, the weight (W = 1 + (Da / Pa)) is also increased to 3. Therefore, assuming that the basic set magnification T when the weight W is not set to 10, the final set magnification Tf of the threshold for the impact sound detection is determined by the weight (when the variance average value Da is large). When W = 3), it becomes 30, and when applying the weight (W = 2) when the variance average value Da is small, it becomes 20. That is, even when the magnitude average value (Pa) is the same, when the impact sound of 30 times or more of the magnitude average value (Pa) is input in the noise environment having a large change width, the impact sound is recognized. If a shock sound is input, it is recognized as a shock sound.

As described above, the present invention considers the magnitude average value Pa of the input sound and the dispersion average value Da of the sound at the same time, and the type of noise (degree of dispersion of noise) and the magnitude of the threshold for detecting the impact sound in the vicinity. By adaptively changing according to the change width, it is possible to accurately distinguish noise and impact sound according to the surrounding situation.

That is, when there is a noise (a noise having a large change in size) that is largely different from the size average value Pa in the vicinity, the final set magnification Tf of the detection threshold is set to be relatively larger, whereby the same size average value Pa is obtained. It should be recognized as a shock sound only when a relatively loud impact sound is input than when there is a noise having a small difference from the magnitude average value Pa (a constant noise with little change in magnitude). In the case where there is a noise (a constant noise with little change in size) that has little difference with the size average value Pa in the periphery, the final set magnification Tf of the detection threshold is set to be relatively smaller. It is possible to recognize the impact sound even if a relatively small impact sound is input than when there is a noise having a Pa) but a difference between the magnitude average value Pa and the noise having a large change in size.

The impact sound determination unit 163 sets a preset magnification ratio (Tf = T * W) of the final detection threshold value (Pc / Pa) obtained by dividing the acoustic peak value Pc of each frame by the magnitude average value Pa. If larger, the impact sound is judged to have started (exactly, it is determined that the sound which is likely to be the impact sound is input), and the impact sound input time is stored in a specific area of the memory 140.

For reference, assuming that there is no noise in the surroundings, the acoustic signal should not include ripple, but if the power supply is poor, the signal flow may wave like a wave, and in such a state, the acoustic peak value (Pc) Degree changes occur. Therefore, in the present invention, in order to avoid the influence of the wave phenomenon, as described above, the value Pc / Pa obtained by dividing the acoustic peak value Pc by the magnitude average value Pa is used as the acoustic peak value for determining the impact sound, and the detection threshold value is used. The impact sound is judged by comparison with the final setting magnification Tf for setting.

For example, as shown in FIG. 11, it is assumed that the acoustic peak value Pc of the current frame is 200, the magnitude average value Pa is 10, the weight W is 1.5, and the default setting magnification T without weight is 10. In this case, the final set magnification Tf is 15. Therefore, since the sound peak value Pc of the current frame divided by the magnitude average value Pa (Pc / Pa = 20) is greater than the final set magnification (Tf = 15) to which the weight (W) is applied, the impact sound input is started. To judge. When the impact sound larger than the final set magnification Tf becomes smaller near the magnitude average value Pa again within a predetermined number of predetermined frames, the sound is finally determined as the impact sound.

Then, time information of the frame determined as the impact sound (for example, the time of the frame determined as the impact sound, or the time interval of each frame determined as the impact sound) is sequentially stored in the specific region of the memory 140. In addition, the impact sound determination unit 163 determines that the rhythm input of the impact sound is terminated when the impact sound is no longer input for a predetermined time (for example, 500 ms) after the impact sound detection.

On the other hand, when the impact sound that is greater than or equal to the final set magnification Tf exceeds a predetermined number of frames, it may not be determined as a shock sound, and the number of frames (shock sound holding time) in which the shock sound may be maintained for determining the impact sound may be around. It can be set in consideration of the situation (e.g., a place with a ringing, a place without a ringing). For example, when the level of the impact sound is too large, such as the signal 307 output from the sensitive microphone 121a of FIG. 7, to exceed the predetermined number of frames, the impact sound may not be determined. In this case, however, the impact sound can be determined using the signal 308 output from the insensitive microphone 121b.

The rhythm determination unit 164 generates a rhythm pattern based on the currently input impact sound based on the number of impact sounds stored in the memory 140 and time information on the impact sound, and compares the rhythm pattern with previously stored rhythm patterns. The rhythm pattern is detected by comparing the rhythm patterns within an error range (for example, 5%) among a plurality of stored rhythm patterns. For example, referring to FIG. 4, assuming that the number of impact sounds is five (C1 to C5) and the time intervals t1 to t4 between each impact sound are 200, 400, 200, and 400 (ms), respectively. A rhythm pattern having a number of impact sounds is detected among the rhythm patterns, and a rhythm pattern having a time interval of the impact sound among the rhythm patterns is detected within a specific error range and a time interval of the input impact sound rhythm pattern.

On the other hand, the rhythm pattern may vary in the time (speed) according to the user. For example, the time intervals t1 to t4 between the impact sounds C1 to C5 may be increased to 160, 320, 160, and 320 (ms), or may be slowed to 230, 460, 230, and 460 (ms).

Accordingly, the rhythm determination unit 164 may perform an operation of adjusting the time signature to detect the rhythm pattern. That is, by increasing or decreasing the time interval of each of the input shock sounds at a predetermined rate, after matching the time interval of the pre-stored rhythm pattern (that is, the beat of the pre-stored rhythm pattern rhythm pattern) After matching, the same rhythm pattern can be detected within a certain error range. For example, when the total time interval of the stored rhythm pattern is 1200ms (200 + 400 + 200 + 400), the total time interval (960ms = 160 + 320 + 160 + 320) of the input shock sound is 1200ms. After expansion by a predetermined ratio, the time interval between each impact sound is compared with each time interval of the pre-stored rhythm pattern to determine whether it is the same rhythm pattern within an error range.

The signal output unit 165 outputs a predetermined signal (or control signal) corresponding to the rhythm pattern detected by the rhythm determination unit 164 to control the corresponding peripheral device. Alternatively, an internal operation of the apparatus 100 for detecting the impact sound and the rhythm of the impact sound according to the present invention may be controlled.

The above-described components may operate under the control of the controller 160.

12 to 16 are flowcharts for explaining the impact sound according to the present invention and a method of detecting the rhythm of the impact sound.

As shown in FIGS. 12 to 16, when the apparatus 100 according to the present invention is turned on, sound signals are input through the

microphones

121a and 121b, and the respective sound signals are converted into digital values and output. The controller 160 processes each digital value to determine whether an impact sound is input from each sound signal. The impact sound may be input in both signals or may be input in only one signal. In this case, the controller 160 may stop the processing of the acoustic signal in which the impact sound is not input, and the time for stopping the processing may be limited until the processing of the other sound signal is completed. That is, when the processing of the other sound signal is completed, it is possible to process the sound signal received from the two microphones again.

When the impact sound is detected in at least one of the two acoustic signals as described above, the controller 160 determines the rhythm of the impact sound and outputs a control signal corresponding to the impact sound rhythm to control the peripheral device.

Hereinafter, the method will be described in more detail.

12 is a flowchart for explaining a method of calculating a basic detection threshold value according to a basic setting magnification by a size average value as an example related to the present invention.

As shown in FIG. 12, when the sound signals are input from the two

microphones

121a and 121b, respectively, the controller 160 converts each sound signal into a digital value (S102), and converts each sound signal into a frame for a predetermined time. The sound peak value Pc having the maximum digital value in each frame is detected by dividing the data into units (S103). Then, the magnitude average value Pa of the acoustic peak value Pc of each frame is calculated for the predetermined predetermined frame (S104). In addition, a basic detection threshold value according to a preset default magnification T may be calculated using the magnitude average value Pa (S105).

The default setting magnification T may be stored in advance in the memory 140 as an experience value. Each of the values (eg, Pa, Pc, and T) may be separately detected and stored for each sound signal.

However, in the present invention, in order to increase the accuracy of the impact sound detection, the detection threshold value reflecting the variance average value Da of the noise is set.

FIG. 13 is a flowchart illustrating a method of calculating a final setting magnification reflecting a weight according to a dispersion degree of noise in a basic setting magnification T as an example related to the present invention, and calculating a final detection threshold accordingly.

As shown in FIG. 13, the controller 160 calculates the variance average value Da of the noise for each acoustic signal (S201), and uses the ratio of the variance average value Da to the magnitude average value Pa to determine the noise. The weight (W = 1 + (Da / Pa)) according to the change width is calculated (S202). Then, the calculated weight W is multiplied by the basic set magnification T to calculate a set magnification Tf for setting the final detection threshold (S203). That is, the final threshold for detecting the impact sound is determined by the final set magnification Tf.

The weight W = 1 + (Da / Pa) is a value in which the relative ratio Da / Pa of the variance average value Da with respect to the size average value Pa is reflected.

14 is a flowchart illustrating a method of determining an impact sound using a detection threshold set by a final setting magnification as an example related to the present invention.

As shown in FIG. 14, when the final setting magnification Tf for determining the detection threshold value is calculated for each sound signal, the controller 160 divides the sound peak value Pc of the current frame by the magnitude average value Pa. (Pc / Pa) is calculated (S301), and when the calculated value is larger than the final set magnification (Tf = T * W) ((Pc / Pa)> Tf), it is determined as an impact sound (S302, S303). In this case, the sound signal determined as the impact sound should not exceed a predetermined number of predetermined frames.

15 is a flowchart illustrating a method of outputting and controlling a predetermined control signal to a peripheral device corresponding to an input shock sound rhythm as an example related to the present invention.

Referring to FIG. 15, the controller 160 stores the number of impact sounds determined in each sound signal and time interval information between the impact sounds in the memory 140, and the impact sound rhythm pattern based on the number of impact sounds and the time interval information. Determine (S401).

In addition, the input shock sound rhythm pattern and the impact sound rhythm pattern previously stored in the memory 140 are compared (S402), and a rhythm pattern matching within an error range is detected (S403), and corresponds to the detected rhythm pattern. The peripheral device is controlled by outputting a signal (or a control signal) (S404).

As shown therein, the controller 160 receives a plurality of sound signals (S501) and processes the sound signals respectively (S502). In operation S503, an acoustic signal in which an impact sound is detected is determined from each acoustic signal. If an impact sound is detected only in any one of the acoustic signals (NO in S503), a rhythm pattern consisting of the impact sound detected in the one acoustic signal is detected using the method described with reference to FIG. The corresponding peripheral device is controlled (S512).

However, when the impact sound is detected in all of the plurality of sound signals (YES in S503), the impact sound rhythm pattern is detected in each sound signal (S504). The impact sound rhythm patterns of the respective acoustic signals are compared with each other (S505) to determine whether each impact sound rhythm pattern is the same rhythm pattern (S506). When the determined rhythm pattern of each sound signal is the same (YES in S506), the peripheral device is controlled by outputting a signal (or a control signal) corresponding to the rhythm pattern (S512). For example, when the impact sound is detected using a plurality of microphones having different characteristics as in the present invention, the number of impact sounds that can be detected in each sound signal may be different. As such, when the number of impact sounds is different, the rhythm pattern is also different. This is because the impact sound rhythm pattern detected from the sound signal output from each microphone may be different even if the sound signals input to each microphone are the same.

However, when the impact sound rhythm patterns of the sound signals determined above are different (NO in S506), the impact sound rhythm patterns compared to the impact sound rhythm patterns previously stored in the memory 140 are compared (S507), and the rhythms matched within the error range. It is detected whether there is a pattern (S508). If all of the rhythm patterns corresponding to the impulsive sound rhythm patterns of the respective sound signals are stored in the memory 140 (NO in S508), it is determined as an error and the preset error processing operation is performed (S509). The error processing operation outputs an error message (or alarm) through the output unit 130.

On the other hand, when the impact sound rhythm patterns of the determined sound signals are different from each other, and only one impact sound rhythm pattern matches the rhythm pattern stored in the memory 140 (YES in S508), the signal corresponding to the rhythm pattern (or A control signal) is output to control the peripheral device (S512).

Here, a plurality of impact sound rhythm patterns may be stored in the memory 140, and a plurality of impact sound rhythm patterns stored in the memory 140 may be set through the input unit 120, and then the impact sound rhythm pattern may be stored in the memory 140. In response to each impact sound rhythm pattern, a peripheral device or a specific peripheral device to be controlled may be set. In this case, a plurality of peripheral devices or operations may be simultaneously set for one rhythm pattern. In addition, the information for setting the rhythm pattern may be output through the output unit 130, or may transmit the information edited by the computer through the interface with the computer (PC) and store it in the memory 140.

As described above, the present invention uses an acoustic signal output from a microphone having a sensitive characteristic to detect an impact sound that is input as a very small sound (for example, applause of a child) in a very quiet place such as midnight. In addition, by using the acoustic signal output from the insensitive characteristic microphone, the impact sound (for example, the impact sound with a large fluctuation range) that comes in close proximity to the impact sound detection device can be detected more accurately than the conventional art.

As described above, the apparatus 100 for controlling the peripheral apparatus using the impact sound and the impact sound rhythm related to the present invention may be variously connected in various ways in a wireless or wired manner through the communication unit 110 or the interface unit 150 as shown in FIG. It may interface with the peripheral devices 200A to 200N at the same time, or may form a network with another plurality of devices 100.

In addition, depending on the rhythm pattern setting, a plurality of peripherals can be simultaneously controlled (e.g., lighting of several rooms are on / off at the same time), or a specific operation can be controlled by selecting one of a plurality of peripherals (e.g., lighting , TV, air conditioner, door lock, on / off respectively).

In the above, preferred embodiments of the present invention have been described with reference to the accompanying drawings.

Here, the terms or words used in the present specification and claims should not be construed as being limited to the common or dictionary meanings, but should be interpreted as meanings and concepts corresponding to the technical spirit of the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention, and do not represent all of the technical idea of the present invention, which can be replaced at the time of the present application It should be understood that there may be various equivalents and variations.

Claims

A microphone which receives an audio signal and converts the sound signal into an electrical signal;

A memory configured to store a detection reference value set in consideration of a variance average value of noise and impact sound rhythm pattern information set corresponding to a plurality of peripheral devices for detecting the impact sound included in the acoustic signal;

An AD conversion unit for sampling the sound signal input through the microphone and converting the sound signal into a digital value, an sound frame processing unit for dividing the sound signal converted into the digital value into predetermined frame units, and the impact sound included in the frame. An impact sound determination unit for detecting a time interval between the impact sounds, and a rhythm pattern composed of the number of the impact sounds and the time interval information, and a rhythm pattern matching the rhythm pattern and a plurality of rhythm patterns previously stored in the memory; And a control unit including a rhythm determination unit for detecting a signal, and a signal output unit for outputting a predetermined control signal to a peripheral device corresponding to the matched rhythm pattern.
The method of claim 1, wherein the control unit,

The sound frame processing unit detects an acoustic peak value Pc having a maximum digital value in each frame, calculates a magnitude average value Pa for the acoustic peak value Pc with respect to a predetermined predetermined frame, and sets the magnitude. A device for detecting an impact sound and a rhythm of the impact sound, characterized in that configured to calculate a basic detection threshold value for impact sound detection according to a preset default magnification T using an average value Pa.
The method of claim 2, wherein the control unit,

If the average size Pa is relatively small, the sound frame processing unit sets a relatively large default setting magnification T. If the size average value Pa is relatively large, the basic setting magnification T is set. A device for detecting an impact sound and a rhythm of the impact sound, which is set relatively small and stored in a memory.
The method of claim 2, wherein the control unit,

The sound frame processing unit calculates a variance average value Da of the noise included in the sound signal and uses the ratio Da / Pa of the variance mean value Da to the magnitude average value Pa to determine the change in noise. Calculates a weight (W) according to the sound, and multiplies the calculated weight (W) by a basic set magnification (T) to calculate a final set magnification (Tf) for determining the impact sound detection threshold. Device for detecting rhythm.
The method of claim 4, wherein the control unit,

An impact sound, characterized by calculating a weight (W = 1+ (Da / Pa)) reflecting a relative ratio Da / Pa of the variance average value Da to the magnitude average value Pa, by means of an acoustic frame processing unit; A device for detecting the rhythm of the impact sound.
The method of claim 5, wherein the control unit,

When the final setting magnification Tf for determining the detection threshold value is calculated through the impact sound determination unit, the value Pc / Pa obtained by dividing the acoustic peak value Pc of the current frame by the magnitude average value Pa is calculated. A device for detecting an impact sound and a rhythm of the impact sound, characterized in that the value Pc / Pa is compared with the final set magnification Tf to determine that the value Pc / Pa is larger than the impact sound.
The method of claim 6, wherein the control unit,

The impact sound determination unit, the device for detecting the impact sound and the rhythm of the impact sound, characterized in that the final determination as the impact sound when the sound signal determined as the impact sound does not exceed the predetermined number of predetermined frames.
The method of claim 1, wherein when the at least two microphones are configured,

Each microphone has a sound pressure sensitivity or a characteristic of the sound pressure level is different, the device for detecting the impact sound and the rhythm of the impact sound.
The method of claim 1, wherein the control unit,

When the microphone is configured with at least two, after detecting the impact sound rhythm pattern included in each sound signal received from each microphone, the impact sound rhythm pattern of each sound signal is the same or only one of the sound signal And when a shock sound rhythm pattern identical to the shock sound rhythm pattern previously stored in the memory is detected, controlling an operation of a peripheral device corresponding to the shock sound rhythm pattern.
The method of claim 9, wherein the control unit,

According to the noise condition of the surroundings, the input of the acoustic signal, which is difficult to detect the impact sound, is interrupted or the processing of the acoustic signal is stopped, and the impact sound is detected from the acoustic signal of another microphone which is easy to detect the impact sound. A device for detecting an impact sound and a rhythm of the impact sound.
The method of claim 9, wherein the control unit,

Each of the sound signals received from the at least two microphones is buffered in a specific area of the memory, and the sound signals received from the microphones are processed in sequence by dividing the sound signals received in predetermined frame units. Device for detecting rhythm.
Receiving a sound signal, converting the digital signal into a digital value, and calculating a basic detection threshold value using a preset default magnification T according to the magnitude average value Pa;

Calculating a final setting magnification (Tf) by reflecting a weight (W) according to the dispersion degree of noise included in the sound signal in a basic setting magnification (T);

Determining that an impact sound is input when the input sound signal is larger than a detection threshold set by the calculated final set magnification Tf;

Generating a rhythm pattern comprising a shock sound included in one frame of the sound signal and a time interval between each shock sound;

Comparing and detecting whether the same rhythm pattern is previously stored in the memory within the error range and the generated rhythm pattern, and outputting a predetermined signal to a peripheral device corresponding to the rhythm pattern if there is the same rhythm pattern; Method for detecting the impact sound and the rhythm of the impact sound comprising a.
The method of claim 12, wherein the determining of the impact sound comprises:

A value Pc / Pa obtained by dividing the acoustic peak value Pc of the current frame by the magnitude average value Pa is calculated, and the calculated value is larger than the final set magnification Tf ((Pc / Pa)> Tf), The impact sound and the method of detecting the rhythm of the impact sound characterized in that it is determined that the impact sound if not exceeding a predetermined number of predetermined frames.
The method of claim 12, wherein when at least two sound signals are input,

Receiving and processing each of the at least two sound signals;

Determining an acoustic signal in which an impact sound is detected among the processed acoustic signals;

Controlling a peripheral device corresponding to the rhythm pattern of the impact sound when the impact sound is detected only in one of the acoustic signals;

Detecting impact sound rhythm patterns in each sound signal and comparing them if they are identical to each other;

Controlling peripheral devices corresponding to the impact sound rhythm pattern when the impact sound rhythm patterns of the sound signals are the same;

Detecting whether a rhythm pattern corresponding to each impact sound rhythm pattern is stored in a memory when the impact sound rhythm patterns of the sound signals are different from each other;

Controlling peripheral devices corresponding to the impact sound rhythm pattern when the impact sound rhythm patterns of the sound signals are different from each other and only one impact sound rhythm pattern matches the impact sound rhythm pattern previously stored in the memory;

And executing an error processing operation when the impact sound rhythm patterns of the respective sound signals are different from each other and the rhythm patterns corresponding to the impulsive sound rhythm patterns of all the sound signals are previously stored in the memory. A method for detecting an impact sound and its rhythm.