WO2014088202A1 - Sound-processing system recognizing earphones for mobile terminal using sound pattern, method for recognizing mobile terminal earphones and method for processing input sound using same, method for automatically converting audio signal amplification output based on earphones/microphone set, and computer-readable recording medium therefor - Google Patents

Abstract

The present invention relates to a sound-processing system recognizing earphones for a mobile terminal using a sound pattern, comprising: a specific earphone recognizing module (310) which receives, by means of an audio processing unit (140), the click sound of a call switch button mounted on the earphones inputted by means of a microphone mounted on the earphones for the mobile terminal, recognizes specific earphones by searching a pre-stored sound pattern DB (330) on the basis of the click sound, and transmits the recognized specific earphone information as earphone search information; a sound-processing module (320) which receives earphone search information from the specific earphone recognizing module (320), processes a microphone input sound inputted by means of the microphone in a preset sound-processing scheme by interacting with the search information on the specific earphones, and outputs the processed result; and a sound pattern/set information DB which stores sound pattern information on the click sound of the call switch button mounted on the earphones in association with the specific earphone information. The microphone input sound of the earphones is processed and outputted in a preset manner according to the recognized specific input characteristics of the microphone of the earphones.

Description

Sound processing system for recognizing earphone for portable terminal using sound pattern, earphone recognition method for portable terminal using sound pattern, input acoustic processing method using same, ear microphone based automatic signal amplification output switching method and computer for the same Readable record carrier.

The present invention relates to a sound processing system for recognizing earphones for a portable terminal, an earphone recognition method, and an input sound processing method using the same. More particularly, the sound generated by the button operation of the earphone for a portable terminal equipped with a microphone is earphone. A sound processing system that recognizes the installation of a particular earphone by analyzing the sound pattern received through the microphone mounted in the microphone, the sound processing system for recognizing the earphone for the portable terminal using the acoustic pattern, the earphone recognition method for the portable terminal using the acoustic pattern and using the same An input sound processing method.

The present invention also relates to a technology for automatically switching the output after amplifying an audio signal in a mobile device to which an ear microphone is connected. More particularly, the present invention is an ear microphone used in conjunction with a mobile device through wired or wireless communication. Ear microphone set-based audio signal that outputs the amplified audio signal to earphone device through wireless network (3G, 4G, WIFI, etc.) according to the operation mode in amplifying and outputting external sound by using a set Amplification output automatic switching technology.

Recently, portable terminals such as smart phones are operating systems (Operating System), for example, OSs of smart phones are equipped with general-purpose OS such as Android, sea, iOS, etc., which are driven by the OS to perform specific functions and can be installed and deleted by the user. Various program types of applications (ie, also called APPs) are used. Through this, a web browser is installed so that various software (S / W) and programs can be installed and used directly, or Internet content can be used freely. Also, a file that can listen to or watch audio files and video files by a built-in program or app. It provides additional functions such as playback function and broadcast playback to meet changing user needs.

It is possible to use external earphones as well as a built-in speaker with an earphone interface for outputting audio played back from a portable terminal, and the earphone interface is a microphone and a function button, that is, a call to support a voice call according to a mobile communication function. The headset includes a headset plug that supports a plug-in earphone, such as a four-pole earphone, which performs a connection or termination operation and controls the activation of the microphone.

On the other hand, in an environment in which various types of applications (ie, also called APPs) of the portable terminal can be performed and an earphone with a voice input microphone is used, the microphone of the earphone goes beyond a simple call function. By processing the input sound according to a specific purpose, it is possible to implement an application of a function, such as a hearing aid application that meets the needs of various consumers output through the earphone. Accordingly, the portable terminal plays the role of a hearing aid.

However, as the most important matter in the implementation of the hearing aid application, the input sound is processed according to the performance of the microphone installed in the four-pole earphone, for example, the frequency characteristic, the signal-to-noise ratio, the impulse characteristic, the sensitivity, the impedance, the transient response, and the like. In order to implement hearing aid applications, dedicated earphones whose sensitivity (mV / Pa and dB / μbar) are larger than those of a conventional four-pole earphone can be used. High microphone sensitivity means that the microphone has a high output voltage for constant sound pressure.

In such a situation, various technologies such as the following Literatures 1 and 2, which recognize the mounting of earphones in a portable terminal, have been disclosed, but these are merely techniques for recognizing the mounting of earphones, and the performance of a microphone installed in an earphone, for example, a 4-pole earphone. In order to process input sound according to input characteristics, a technique for identifying a specific earphone having a specific performance is urgently required.

On the other hand, the hands-free technology using the ear microphone set for the existing mobile device can simply transmit the audio signal corresponding to the voice of the user input to the microphone to the counterpart device through the wireless network. In other words, the prior art ear microphone set simply receives a user's voice signal and transmits the voice signal to the other party through a wireless network. However, when not in a call, the ear microphone does not show any useful value. Accordingly, the external microphone and the user's audio signal is amplified by using the microphone of the ear microphone set, and the audio output is switched to the earphone part of the ear microphone set instead of the wireless network side for the telephone call. As a result, a technology development for providing a voice amplifier or a hearing aid function is required.

Therefore, the present invention provides a specific earphone for a portable terminal by using a sound pattern generated by the earphone itself, for example, a separate sound-only button or a click sound of a normal call switching button. An object of the present invention is to provide a sound processing system for recognizing, an earphone recognition method for a portable terminal using a sound pattern, and an input sound processing method using the same.

In addition, the present invention is a sound processing system for recognizing the earphones for hearing aids using a sound pattern, such as a click sound of the recognition button or the call conversion button generated in the process of using the earphone itself in the hearing aid earphone, a sound pattern in a simple manner An object of the present invention is to provide an earphone recognition method for a portable terminal using the same and an input sound processing method using the same.

Meanwhile, an object of the present invention is to amplify an ear microphone based audio signal for additionally supporting a function of a voice amplifier or a hearing aid through an audio amplification function in addition to a conventional hands free calling function using a hands free ear microphone set used in a mobile device. It is to provide output automatic switching technology.

In order to achieve the above object, in one aspect the present invention is a sound processing system for recognizing the earphone for a portable terminal using a sound pattern, the call conversion button mounted on the earphone input through the microphone mounted on the earphone of the portable terminal A specific earphone recognition module that receives a click sound through the audio processor 140 and searches a pre-stored sound pattern DB 330 based on this to recognize a specific earphone and transmits information of the recognized specific earphone as earphone search information. 310); The sound processing module 320 for receiving the search information of the earphone from the specific earphone recognition module 320 and processing the input sound of the microphone input through the microphone in conjunction with the search information of the specific earphone by a preset sound processing method (320). And a sound pattern / setting information DB for storing the sound pattern information of the click sound of the call conversion button mounted on the earphone in association with the specific earphone information, wherein the microphone input sound of the earphone is the microphone of the recognized specific earphone. According to the input characteristic of the characterized in that the processing in a predetermined manner and output.

In another aspect, the present invention is a sound processing system for recognizing earphones for a portable terminal using a sound pattern, the audio processing unit 140 for the click sound of the recognition-only button mounted on the earphone input through the microphone mounted on the earphone of the portable terminal. A specific earphone recognition module 310 for receiving a predetermined earphone and searching the pre-stored sound pattern DB 330 based on this to recognize a specific earphone and transmitting the recognized specific earphone information as earphone search information; The sound processing module 320 for receiving the search information of the earphone from the specific earphone recognition module 320 and processing the input sound of the microphone input through the microphone in conjunction with the search information of the specific earphone by a preset sound processing method (320). And a sound pattern / setting information DB for storing sound pattern information of a click sound of a recognition-only button mounted on the earphone in association with specific earphone information, and converting the microphone input sound of the earphone into the microphone of the recognized specific earphone. According to the input characteristic of the characterized in that the processing in a predetermined manner and output.

Preferably, the acoustic pattern includes one or more pieces of information of the waveform, amplitude, and frequency of the input sound.

In addition, the input characteristics of the microphone may include one or more of the frequency characteristics, signal-to-noise ratio, impulse characteristics, sensitivity, impedance, and transient response of the microphone.

In addition, preferably, the specific earphone recognition module 310 receives a click sound of an A / D converted call conversion button or a recognition only button from the audio processor 140 and extracts a sound pattern through a digital sound process. Extracting unit 311; An acoustic pattern search unit 312 for searching the acoustic pattern / setting information DB 330 to search for the same acoustic pattern as the extracted acoustic pattern and extracting earphone information associated with the earphone pattern as earphone search information; Earphone search information transmission unit 313 for transmitting the earphone search information to the sound processing module.

Here, the specific earphone recognition module 310 stores the sound pattern extracted from the pattern extractor 311 in the sound pattern / setting information DB 330 in association with the earphone information of the specific earphone. It is preferable to further include).

Further preferably, in the sound pattern / setting information DB 330, a processing method of the microphone input sound according to the input characteristic of the microphone of the earphone is stored as setting information in association with the earphone information, and the sound processing module 320 is the specific information. Earphone search information receiving unit 321 for receiving the search information of the earphone from the earphone recognition module 320; A microphone input sound setting unit 322 for retrieving specific setting information from the sound pattern / setting information DB 330 based on the earphone search information and setting a processing method of the microphone input sound accordingly; A microphone input sound processor 323 for processing a microphone input sound according to the set microphone input sound processing method; And a processing sound output unit 324 for outputting the processed microphone input sound.

In another aspect, the present invention provides a method of recognizing a earphone for a portable terminal using an acoustic pattern, the earphone insertion recognition step (S10) for recognizing the insertion of the earphone and the microphone and the call conversion button is installed on the interface of the portable terminal; A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the call conversion button through the microphone (S20); And a specific earphone recognition step S30 of recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound based on the extracted sound pattern of the click sound.

Furthermore, in another aspect, the present invention provides a method for recognizing a earphone for a portable terminal using a sound pattern, the earphone insertion recognition step (S10) of recognizing the insertion of the earphone with a microphone and a recognition-only button is installed on the interface of the portable terminal; A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the recognition-only button through the microphone (S20); And a specific earphone recognition step S30 of recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound based on the extracted sound pattern of the click sound.

Preferably, the method further includes a microphone input sound processing / output step S40 of processing the microphone input sound of the earphone in a preset manner according to the recognized specific earphone and outputting the same.

Here, in the microphone input sound processing / output step (S40), it is preferable to process and output the sound input through the microphone according to the recognized input characteristics of the microphone of the specific earphone.

In addition, preferably, by activating the microphone to receive and process the click sound of the call conversion button or the recognition-only button through the microphone to extract the sound pattern of the click sound to store in association with the information of the earphone used The method may further include inputting pattern information.

Further, the acoustic pattern preferably includes one or more pieces of information on the waveform, amplitude, and frequency of the input sound.

In addition, the input characteristics of the microphone may include one or more of the frequency characteristics, signal-to-noise ratio, impulse characteristics, sensitivity, impedance, and transient response of the microphone.

In another aspect, the present invention is an input sound processing method using a recognition method of the earphone for a portable terminal using the acoustic pattern, earphone insertion recognition step of recognizing the insertion of the earphone with a microphone and the call conversion button is installed on the interface of the portable terminal (S10) ); A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the call conversion button through the microphone (S20); A specific earphone recognition step (S30) of recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound based on the extracted sound pattern of the click sound; And a microphone input sound processing / output step (S40) for processing and outputting the microphone input sound of the earphone in a preset manner according to the recognized specific earphone, wherein the microphone input sound processing / output step (S40) is the recognition. According to the sensitivity of the microphone of the specific earphone, characterized in that for amplifying and outputting the sound input through the microphone.

On the other hand, the present invention is an input sound processing method using the recognition method of the earphone for the portable terminal using the acoustic pattern, earphone insertion recognition step of recognizing the insertion of the earphone with the microphone and the recognition dedicated button is installed on the interface of the portable terminal (S10) ); A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the recognition-only button through the microphone (S20); A specific earphone recognition step (S30) of recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound based on the extracted sound pattern of the click sound; And a microphone input sound processing / output step (S40) for processing and outputting the microphone input sound of the earphone in a preset manner according to the recognized specific earphone, wherein the microphone input sound processing / output step (S40) is the recognition. According to the sensitivity of the microphone of the specific earphone, characterized in that for amplifying and outputting the sound input through the microphone.

Preferably, it is preferable to output one or more messages of the insertion request message of the earphone and the message of the click of the call conversion button or the recognition only button.

Here, preferably, the earphone is a four-pole earphone.

Meanwhile, according to the present invention, the method for automatically converting an audio signal amplification output based on an ear microphone set includes connecting a data session with the ear microphone and a wired / wireless network, and checking whether the mobile device is in a call state from the status check of the network communication unit. Confirming the first step; A second step of the mobile device receiving an audio signal input to the microphone of the ear microphone and performing an amplification process according to a preset magnification when the call is not in a call state; And a third step of performing an audio amplification mode in which the mobile device transmits the amplified audio signal to the ear microphone and outputs the amplified audio signal to the earphone of the ear microphone set.

At this time, the audio signal amplification output automatic switching method according to the present invention, if the call state is determined, the mobile device transmits to the ear microphone set and outputs without amplifying the call audio signal received from the counterpart device through the wireless network. And a fourth step of receiving the audio signal input from the microphone from the ear microphone set and transmitting the audio signal from the microphone to the counterpart device through the wireless network without amplifying.

    In addition, the audio signal amplification output automatic switching method according to the present invention includes a fifth step of determining whether the mobile device is running a multimedia application; A sixth step of mixing the amplified audio signal with the multimedia audio signal being executed in the multimedia app and generating the mixed audio signal when the mobile device executes the multimedia app; And performing a multimedia mixing mode in which the mobile device transmits the mixed audio signal to the ear microphone set and outputs the mixed audio signal to the earphone of the ear microphone set.

On the other hand, the computer-readable recording medium according to the present invention is a program for performing the automatic microphone-based audio signal amplification output switching method as described above.

According to the present invention as described above, by using the sound generated from the earphone itself, the earphone equipped with a microphone used in the conventional portable terminal, for example, by using a sound pattern of the click sound of the call conversion button or the dedicated button for recognition of the portable terminal It is possible to provide a sound processing system for recognizing earphones, an earphone recognition method for a portable terminal using a sound pattern, and an input sound processing method using the same.

In a simple way, a hearing aid earphone is a sound processing system for recognizing hearing aid earphones using a sound pattern such as a call switching button or a recognition button that is generated during the use of the earphone itself, and a portable terminal using an acoustic pattern. By providing an earphone recognition method and an input sound processing method using the same, it is possible to implement a hearing aid application or system using an optimal portable terminal.

According to the ear microphone-based audio signal amplification output automatic switching method of the present invention, the following advantages can be obtained.

      First, in addition to the conventional hands-free calling function, the amplification function for the micro-input audio signal is additionally supported by using the microphone and earphone built in the hands-free ear microphone set used with the mobile device. It offers the convenience of enabling mobile devices as audio amplifiers.

     Second, without interrupting the multimedia (music) playback output in the non-call state by using the mobile device, the audio amplification output for the sound input from the microphone and the multimedia audio signal are mixed and output according to the user's choice By switching the sound to be heard at the same time while enjoying the sound playback, it is useful not only for the hearing loss but also for the general public on the streets, buses and trains.

Third, the user can freely select the multimedia sound source audio output or the multimedia sound source audio signal and the mixing output according to the audio amplification, and use the dedicated volume control to separately adjust the volume value for the amplified audio. do.

1 is a view schematically showing the configuration of a mobile terminal and a four-pole earphone to which the present invention is applied.

Figure 2 is a schematic view showing the configuration of a four-pole earphones equipped with a dedicated button for recognition to which the present invention is applied.

3 is a block diagram schematically illustrating a configuration of a portable terminal according to an exemplary embodiment of the present invention.

4 is a block diagram illustrating a sound processing system for recognizing earphones for portable terminals using sound patterns according to an embodiment of the present invention.

Figure 5 is a screen capture of the measurement results of the microphone input sound when clicking the call switch button of the various earphones used for recognition of a particular earphone according to an embodiment of the present invention.

6 is an enlarged view of the microphone input sound when the measured call conversion button is clicked.

7 is a view for explaining the extraction and comparison of the acoustic pattern data according to an embodiment of the present invention.

8 is a flowchart illustrating a method for recognizing earphones for a portable terminal of the present invention and an input sound processing method using the same.

9 is a detailed flowchart of an embodiment of an earphone recognition method for a portable terminal of the present invention and an input sound processing method using the same;

10 is a diagram showing an entire system in which an ear microphone based audio signal amplification output automatic switching method according to the present invention is implemented.

11 is a view showing the configuration of an ear microphone for applying the technology of the present invention.

12 illustrates a configuration of a mobile device to which the technology of the present invention is applied.

Figure 13 is a flow chart showing the overall flow of the ear microphone based audio signal amplification output automatic switching method according to the present invention.

14 is a flowchart illustrating an audio output switching operation when the mobile device is in a call state in the present invention.

15 is a flowchart illustrating an audio output switching operation when the mobile device is not in a call state in the present invention.

EMBODIMENT OF THE INVENTION Hereinafter, with reference to drawings, specific content for implementing this invention is demonstrated based on an Example.

These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be embodied in other embodiments without departing from the spirit and scope of the invention with respect to one embodiment.

In addition, it is to be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects.

<Sound processing system for recognizing earphone for portable terminal using sound pattern>

First, an embodiment of a sound processing system for recognizing earphones for a portable terminal using the sound pattern of the present invention will be described.

In the present embodiment, a conventional smart phone and a four-pole earphone are used as the portable terminal, but the smart phone is illustrated as an example of the portable terminal of the present invention, but the present invention is not limited thereto. As an ear, the present invention can be applied to any electronic device capable of outputting sound through an ear speaker and using earphones capable of inputting sound through a microphone.

In the case of the embodiment of Figure 1 illustrates a four-pole earphone as an example of the earphone, but the present invention is not limited to this, the wired method or wireless connection method having a remote control unit of any form including a call conversion button and a microphone, forms of various terminals The present invention can also be applied to a earphone.

In addition, despite the disclosure in the detailed description and claims to use the microphone input sound when the call conversion button and the call conversion button is clicked, but not limited to this, various types of buttons that can be mounted on the remote control of the earphone and the click of the corresponding button The present invention can also be applied to using a visual microphone input sound.

Accordingly, in the case of the embodiment of FIG. 2, as a modification of the four-pole earphone, the normal call switching button 210 is separately installed regardless of the microphone 211, and the recognition only button 213 and the microphone 211 are provided. In the form of four-pole earphones installed as a unit adjacent to each other, the sound is input to the microphone 211 when the recognition-only button 213 is clicked, and is used to recognize a specific earphone. The button is not necessarily limited to the call switching button, and various modifications are possible under conditions adjacent to the microphone.

In addition, the click sound or the click sound that is generated when the call switch button or the recognition-only button is clicked is not limited to the mechanical sound caused by the click of the button in the audible frequency range, and the sound of various audible or inaudible frequencies is called. When the switch button or recognition button is clicked, it can be generated not only mechanically but also electronically and used as the input sound of the microphone.

1 is a view schematically showing the configuration of a mobile terminal and a four-pole earphone to which the present invention is applied.

Referring to FIG. 1, a portable terminal to which the present invention is applied is detachable to the portable terminal main body 100 and the portable terminal main body 100, and includes a remote control 210 including a call switch button 211 and a microphone 212. It comprises a earphone 200 having a part, the portable terminal body 100 is provided with a headset connection terminal operable to insert the earphone.

In general, the earphone 200 having a remote controller 210 is used in the form of a four-pole earphone, and the four-pole earphone follows a standard called TRRs (Total Resource Requirements), which is a headset terminal standard for TRS. Divided by the CITA standard. The OMTP standard connector (European) has a Left-Right-Mic-Ground array, while the CITA standard connector (US) has a Left-Right-Ground-Mic array. In the case of FIG. 1, the plug 220 is a CITA method. The tip of the 4-pole (Tip-Ring-Ring-Sleeve) is Left, the first ring is Right, the second ring is Ground, and the last sleeve is a microphone signal terminal. Inside the plug, various terminals are configured to identify four-pole or three-pole earphones and detect detachment, and are connected between the microphone signal terminal and the GND terminal to switch the operation of the call switching button 211. Is connected may be configured to recognize the operation of the call switch button 211.

In the case of the embodiment of Figure 2 is a variation of the four-pole earphone is a conventional call switching button 210 is installed separately irrespective of the microphone 211, the recognition dedicated button 213 and the microphone 211 adjacent to a single This is a case where the four-pole earphone is configured to recognize the specific earphone by inputting the microphone 211 when the recognition-only button 213 is clicked in the form of the four-pole earphone installed as a unit. The remote control unit 210 is composed of only the call switching button 211, the microphone 212 is installed adjacent to the recognition dedicated button 213. Recognition-only button 213 may be configured to perform a function of providing the input sound of the microphone 211 by simply generating a mechanical sound when clicked without being connected to a separate circuit, according to an embodiment It may be configured to provide the input sound to the earphone microphone 211 as a click sound or a click sound, rather than a mechanical click sound of a button including a generation circuit, as a click sound or a click sound.

In the case of the embodiment of Fig. 2, a call switching button in a mobile terminal, for example, a current iPhone, which has a function of recognizing the start of a voice call and blocking the input of sound except voice, ie, filtering by input of the call switching button. In order to solve the problem that the earphone is not recognized because part of the generated sound is blocked when it is clicked, the present invention is a modified embodiment so that the specific earphone can be recognized even in the above portable terminal.

3 is a block diagram illustrating a structure of a portable terminal capable of recognizing earphones by using an acoustic pattern input through a microphone of an earphone according to an exemplary embodiment of the present invention.

The portable terminal 100 according to the embodiment of the present invention includes a control unit 110, a memory 120, an interface unit 130, an audio processing unit 140, an RF communication unit 150, a display unit 160, and the like. .

The controller 110 controls the overall operation of the portable terminal and the flow of signals or data between internal blocks of the portable terminal, and the CPU (not shown) and the memory 120 of the input / output peripheral of the portable terminal. Control the access to the memory 120 by another component block, and execute various software programs and / or applications stored in the memory 120 to execute various functions and additions for the mobile terminal 100. Perform the function.

In particular, the control unit 110 in the present invention recognizes the insertion of the earphone 200 connected to the interface unit 130, recognizes the operation of the call conversion key 211, the application form in the memory 120 It may be implemented to notify the sound processing system of the present invention which is stored and executed.

The memory 120 stores a sound processing system for recognizing earphones for a portable terminal using an acoustic pattern in an application form, and performs a method for recognizing earphones for a portable terminal using the acoustic pattern of the present invention and an input sound processing method using the same. The stored system is stored as one of a plurality of applications, the system for performing the input sound processing method of the application form of the present invention is a specific earphone recognition module 310, sound processing module 320, and the sound pattern / setting information DB 330 It is included as a basic configuration, is called according to the memory control command of the control unit 110 is performed in a smart phone, the earphone is notified of the operation of the insertion and call conversion button 211 of the earphone 200, the sound is input to the microphone Receives the sound and processes it.

The interface unit 130 provides connection means for allowing the earphone 200 to connect to the mobile terminal 100 to transmit and receive audio signals, thereby receiving the sound signal transmitted from the microphone MIC of the earphone 200. It provides a path for transmitting to the control unit 110, and provides a path for transmitting the sound signal transmitted from the portable terminal 100 to the earphone 200. It includes a headset connection terminal (not shown) that can be inserted into the earphone. The interface unit 130 detects that the earphone 200 is inserted, and is provided with a circuit and a terminal for transmitting a specific electric signal to the controller.

The audio processor 140 converts the acoustic data into an audible sound through the speaker SPK according to the control of the controller 110 and outputs the audio data, and converts the audio signal such as a voice received from the microphone MIC by A / D conversion. It converts the digital data into the control unit 110, processes the sound output from the control unit, and outputs the sound to an external output device such as an earphone through the interface unit 130.

The RF communication unit 150 converts an electrical signal into an electromagnetic wave and vice versa, an antenna system, an RF transceiver, one or more amplifiers, tuners, one or more oscillators, digital signal processors, for communicating with the communication network and other communication devices through the electromagnetic waves. Wireless communication is possible through various wireless networks, including a CODEC chipset, a subscriber identity module (SIM) card, a memory, and the like.

4 is a block diagram illustrating a sound processing system for recognizing earphones for a portable terminal using a sound pattern implemented in the form of an application for a portable terminal according to an embodiment of the present invention.

Referring to FIG. 4, a sound processing system for recognizing earphones for a portable terminal of the present invention includes a specific earphone recognition module 310, a sound processing module 320, and a sound pattern / setting information DB 330 as a basic configuration. According to the input characteristic of the microphone of the specific earphone, the microphone input sound of the earphone is processed in a predetermined manner and outputted to the earphone. The system can be used for a hearing aid using a portable terminal.

The specific earphone recognition module 310 receives a click sound of a call conversion button or a recognition dedicated button mounted on the earphone input through the microphone mounted on the earphone of the portable terminal through the audio processor 140, and stores the sound in advance. The pattern / setting information DB 330 is searched to recognize specific earphones, and the recognized specific earphones are transmitted as earphone search information.

The specific earphone recognition module 310 may include a pattern extractor 311, an acoustic pattern search unit 312, and an earphone search information transmission unit 313, and may include an acoustic pattern input unit 314.

According to the click of the call conversion button or the recognition-only button of the four-pole earphone, the audio input through the microphone A / D conversion in the audio processing unit 140 is transmitted to the specific earphone recognition module 310 through the control unit 110 The pattern extraction unit 311 receives this, and extracts a sound pattern by digitally processing the input digital sound.

In this case, A / D-converted PCM data can be used as it is, or processed data can be used as acoustic pattern data by processing the continuous PCM data in the form of increase or decrease, and A / D-converted data can be converted into FFT and / or wavelet conversion. Various known digital sound processing methods, such as one or more, may be used as the acoustic pattern data to increase its precision. For example, the digitally converted sound is filtered and removed by using an FFT transform or a wavelet transform, and the input sound signal is processed into a shape required for each information extraction unit, thereby converting the frequency converted sound information into a frequency. And / or by converting by sound pressure and extracting pattern information into data of frequency and / or sound pressure.

The sound pattern to the sound pattern data includes one or more information of the waveform, amplitude and frequency of the input sound, the amplitude of the sound input through the microphone according to the click of the call conversion button or recognition button of the earphone has a large difference In other words, when the loudness of the click sound or the sensitivity of the microphone of the call switching button or the recognition-only button has a large difference for each of the available four-pole earphones, only amplitude information can be extracted or used as acoustic pattern information as processed data.

The acoustic pattern data may be extracted from the pattern extractor 311 and stored in advance in association with the earphone information in the acoustic pattern / setting information DB 330. The acoustic pattern / setting information DB 330 may include a microphone of the earphone. The processing method of the microphone input sound according to the input characteristic is stored as setting information in association with the earphone information.

The sound pattern search unit 312 receives the sound pattern data extracted from the pattern extractor 311, searches the sound pattern / setting information DB 330, searches for the same sound pattern as the extracted sound pattern data, and searches for the specific sound pattern. Search for earphones. The search result is output to the earphone search information transmission unit 313 in the form of the identification number of the specific earphone.

Furthermore, the specific earphone recognition module 310 stores an acoustic pattern extracted from the pattern extractor 311 in the acoustic pattern / setting information DB 330 in association with earphone information of a specific earphone. It may be configured to store the sound pattern of the earphone used by the user in the sound pattern / setting information DB 330 in association with the specific earphone in the initial sound pattern, according to the embodiment, The administrator of the application may provide the input in advance.

The earphone search information transmitter 313 transmits the identification number of the specific earphone which is a search result to the sound processing module 320.

The sound processing module 320 receives the search information of the earphone from the specific earphone recognition module 310 and processes the input sound of the microphone input through the microphone in conjunction with the search information of the specific earphone by a preset sound processing method. Output

The sound processing module 320 includes an earphone search information receiving unit 321, a microphone input sound processing setting unit 322, a microphone input sound processing unit 323, and a processing sound output unit 324.

Earphone search information receiving unit 321 receives the search information of the earphone from the specific earphone recognition module 320, specifically receives the identification code of the specific earphone retrieved from the earphone search information transmission unit 313, microphone input sound Transfer to the setting unit 322.

The microphone input sound setting unit 322 retrieves the setting information associated with the sound pattern / setting information DB 330 based on the identification number of the earphone which is the earphone search information. Set it.

The microphone input sound processor 323 processes the microphone input sound and transmits the microphone input sound to the processed sound output unit 324 according to the processing method of the microphone input sound.

In determining the processing method of the microphone input sound, the input characteristic of the microphone of the recognized specific earphone is taken into consideration. The input characteristic of the microphone may include one or more of the microphone's frequency characteristic, signal-to-noise ratio, impulse characteristic, sensitivity, impedance, and transient response. According to an embodiment, the output characteristic of a recognized specific earphone may be considered. Can be.

FIG. 5 is a screenshot of measurement results of various input sounds used for recognizing a particular earphone according to an embodiment of the present invention, and FIG. 4B is an enlarged view of the measured various input sounds. 5 and 6 the corresponding earphones by clicking the call conversion button or the recognition-only button of the four kinds of general 4-pole earphones (①, ②, ③, ⑤) and hearing aid-only 4-pole earphones (⑤) currently on the market This is a screen capture of the meter display of the measurement results of the microphone input sound.

In the case of hearing aid dedicated 4-pole earphones (⑤), a microphone with a higher sensitivity than a 4-pole earphone is usually mounted, so that the measured amplitude of the input sound when clicked is larger than that of general 4-pole earphones (①, ②, ③, ⑤).

In addition to the difference in waveform, amplitude, and frequency of each input sound, as shown in FIG. 6, when the call switching button or the recognition only button is pressed (PUSH) and when the call is pressed according to the click of the call switching button or the recognition only button (PUSH) and glows. (RELEASE) A separate input sound is generated, and each of the input sounds of PUSH and RELEASE can be processed and used as a sound pattern, and in some cases, the two can be used together as a sound pattern. It may be.

 7 is a view for explaining the extraction and comparison of the acoustic pattern data according to an embodiment of the present invention. Referring to FIG. 7, in the generation and retrieval of actual acoustic pattern data, as shown in FIG. 5, in the extraction of the acoustic pattern of a sound input through a microphone at the click of a call switching button or a recognition-only button, respectively, as shown in FIG. 5. As shown in FIG. 7 (a), A / D conversion is performed by the audio processor 140 to convert the PCM data of the click sound of the call switch button as it is and store it as sound pattern information. It can be implemented in a way to compare with the PCM data, and as shown in Figure 7 (b), by increasing or decreasing the continuous PCM data as a separate data to use this as the acoustic pattern data section that actually generates or changes the input sound It can be implemented to identify specific earphones by analyzing / searching sound patterns based on.

In addition, by capturing PCM data for a certain time and analyzing the frequency band using FFT, the frequency bands of a specific pattern and the interval information or delay information of the specific sound are related to the specific earphone in the acoustic pattern / setting information DB 330. The specific earphone can be identified by comparing with the stored acoustic pattern data.

Normally, when the pattern conversion is received as shown in FIG. 7 (c) and PCM data is extracted before the pattern data is extracted according to the pre-set of the call conversion button or the recognition only button, it is recognized as a click of the call conversion button or the recognition only button. The sound pattern data is extracted from the extracted PCM data and compared with the stored sound pattern data, and may include an additional process for removing noise. When PCM data is received as an additional process for removing noise, PCM data from which noise is removed is extracted through the AND operator of the PCM data.

FIG. 7 (a) is an example of actual PCM data according to a click sound, and when the PCM data is stored as a sound pattern / setting information DB 330 as sound pattern data of a specific earphone as it is and compared, A / D converted PCM data Compares the previously stored sound pattern data without performing a separate digital sound processing such as FFT. In this case, although there is a difference in amplitude, the actual data form may have a small difference. Therefore, it is preferable to search for the case where the same earphone matches about 80%.

7 (b) is a numerical value of the actual PCM data in the form of increase and decrease, and when storing and retrieving the acoustic pattern / setting information DB 330 of the PCM data by using the increase and decrease values, and focusing on a specific section in which there is a change in sound. It is preferable to compare with.

In addition, in the case of click sound as shown in FIG. 7 (c), a specific interval between input sounds according to the physical characteristics of the button, for example, in case of having 0.028sec in case of FIG. 7 (c), based on the interval between specific sounds according to a click Sound pattern data can be generated and used to search for a specific earphone.

<Recognition method of earphone for portable terminal using sound pattern and sound processing method using same>

5 is a flowchart illustrating an earphone recognition method for a portable terminal and an input sound processing method using the same, and FIG. 6 is a detailed flowchart of an embodiment of an earphone recognition method for a portable terminal and an input sound processing method using the same.

The method of recognizing the earphone for a portable terminal using the acoustic pattern of the present invention and the sound processing method using the same are performed by the sound processing system for recognizing the earphone for the portable terminal described with reference to FIGS. 3 and 4. It demonstrates in the range which does not overlap below.

Referring to FIG. 8, in the recognition method of the earphone for a portable terminal using the acoustic pattern of the present invention, an earphone insertion recognition step of recognizing the insertion of an earphone having a microphone and a call conversion button or a recognition dedicated button installed on an interface of the portable terminal (S10) A microphone sound input / processing step (S20) for activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the call conversion button or a recognition only button through the microphone, and the extracted click A specific earphone recognition step (S30) of searching for a specific earphone having a sound pattern of the same click sound based on the sound pattern of the sound and recognizing the inserted earphone is performed.

In the method of recognizing the earphone for a portable terminal using the acoustic pattern of the present invention, the microphone input sound processing / output step (S40) for processing and outputting the microphone input sound of the earphone in a preset manner according to the recognized specific earphone It may be further included, and includes a microphone input sound processing / output step (S40) is defined as a sound processing method using the recognition method of the earphone for a portable terminal using the sound pattern.

In the earphone insertion recognition step (S10), the controller 110 detects the insertion of the earphone 200 from the interface unit 130 in which a circuit and a terminal are installed to detect that the earphone 200 is inserted and transmit a specific electrical signal to the controller. Receiving a signal and transmitting it to the application 300 of an embodiment of the present invention, it recognizes the insertion of the earphone and the microphone and the call conversion button or the dedicated button installed on the interface of the portable terminal. As shown in FIG. 6, when the application 300 of the embodiment of the present invention is executed, a four-pole earphone insertion message is visually or audibly outputted to the user through the display unit 160 or the audio processor 140. It can be performed including the step of inserting the 4-pole earphone.

The microphone sound input / processing step (S20) is performed by a specific earphone recognition module 310, and activates the microphone and receives the click sound of the call conversion button or the recognition-only button through the microphone to process the click sound. To extract the sound pattern, and as shown in Figure 6, the application requesting the activation of the microphone to the control unit 110, a button click message to click the call conversion button or the recognition-only button display unit 160 or audio processing unit It may be performed including the process of outputting visually or acoustically through 140. If the extraction and recognition of the sound pattern is unsuccessful by the click of the corresponding call conversion button or the recognition only button, the process of clicking the call conversion button or the recognition only button may be performed. Can be performed repeatedly upon success or up to a preset number of times.

The acoustic pattern includes one or more of the waveform, amplitude, and frequency of the input sound. When the amplitude of the sound input through the microphone has a large difference according to the click of the call switching button or the recognition only button of the earphone, that is, the click sound volume or the sensitivity of the microphone is available. If the polar earphone has a large difference, only the amplitude information can be extracted and used as the acoustic pattern information.

The specific earphone recognition step (S30) is a process of recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound based on the sound pattern of the extracted click sound. For example, the sound pattern search unit 312 searches for the same sound pattern among the sound patterns stored in the sound pattern / setting information DB 330, and identifies a specific earphone associated with the sound pattern. The identification number is assigned to the identified earphone. Outputs If the search is not successful as shown in FIG. 6, the recognition of the corresponding 4-pole earphone or the reinsertion message of the other earphone is output, and the earphone insertion recognition step S10 to a specific earphone recognition step S30 may be implemented. Can be.

In the microphone sound input / processing step (S20) and the specific earphone recognition step (S30), the acoustic pattern or sound pattern data of the microphone input sound by the call conversion button or the recognition-only button is clicked on the acoustic pattern or sound pattern data. The D-converted PCM data may be used as it is, or the processed data may be used as an acoustic pattern by processing the continuous PCM data in the form of increments. In particular, when using the processed data in the form of increase or decrease of PCM data as an acoustic pattern, the intermittent acoustic characteristics of the call conversion button or the recognition-only button click are taken into account, so that the section with the click sound is compared. It can increase the accuracy and efficiency. When searching, the sound pattern of the click of the call switch button or the recognition-only button has a relatively simple pattern. Therefore, it is preferable to search the same earphone when the PCM data or the processed data correspond approximately 80% in consideration of noise. Do.

In addition, as described above, the precision of the A / D-converted data may be used as acoustic pattern data using one or more various digital acoustic processing methods such as FFT and / or wavelet conversion. For example, the digitally converted sound is filtered and removed by using an FFT transform or a wavelet transform, and the input sound signal is processed into a shape required for each information extraction unit, thereby converting the frequency converted sound information into a frequency. And / or by converting by sound pressure, extracting pattern information into data of frequency and / or sound pressure. In the case of extracting and using the acoustic pattern by performing the FFT transform, the accuracy of the search can be improved by analyzing a specific frequency band and a specific delay of the click.

In addition, as a preliminary step, by activating the microphone and receiving the click sound of the call conversion button or the recognition-only button through the microphone to process the extracted sound pattern of the click sound in association with the information of the earphone used; The method may further include a step of inputting pattern information so that the user may store the sound pattern of the earphone used by the user in the sound pattern / setting information DB 330 in association with the sound pattern with a specific earphone. Therefore, this process may be omitted when the system, that is, the administrator of the application is inputted and provided in advance.

The microphone input sound processing / output step S40 is performed by the sound processing module 320 described above, and processes the microphone input sound of the earphone in a preset manner according to the recognized specific earphone and outputs it. In particular, it is preferable in a hearing aid application that the sound input through the microphone is processed according to the input characteristic of the microphone of the recognized specific earphone, and the input characteristic of the microphone is a frequency characteristic, a signal-to-noise ratio, an impulse characteristic of the microphone. , Sensitivity, impedance, or transient response. In addition, according to the embodiment, it may be preset to process the microphone input sound of the earphone in consideration of the output characteristics of the earphone.

As described above, the input sound processing method using the recognition method of the earphone for the portable terminal using the acoustic pattern is applied to the hearing aid application applied to the portable terminal in which the amplification of the sound is an important factor, so that the microphone input sound processing / output step ( S40) preferably amplifies and outputs the sound input through the microphone according to the sensitivity of the microphone of the recognized specific earphone.

In addition, as shown in Figure 9, the process of outputting the insertion request message of the earphone (610), the process of outputting a message of the click of the call conversion button or the recognition-only button (620), the button re-click message output process (633) ), One or more message output processes of the unrecognized / reinserted message output process 642 may be implemented, and each process of FIG. 9 may be provided to the user as a graphic or voice to be implemented as a user-friendly application.

<How to automatically switch amplification output based on ear microphone set>

Hereinafter, a method for automatically converting an audio signal amplification output based on the ear microphone set of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 10 is a diagram illustrating an entire system in which an ear microphone-based audio signal amplification output automatic switching technique according to the present invention is implemented. Referring to FIG. 10, the entire system in which the audio signal amplification output automatic switching technology is implemented is a wired or wireless ear microphone set 10 that is used by a user by using an ear, a mobile device 20 such as a smartphone or a smart pad, a wireless network ( 30), the counterpart device 40 corresponding to the call counterpart is configured.

The wireless network 30 may be a synchronous mobile communication network or an asynchronous mobile communication network. As an example of an asynchronous mobile communication network, there is a wideband code division multiple access (WCDMA) communication network. In this case, the wireless network 30 includes a radio network controller (RNC) and an asynchronous mobile switching center (MSC).

And the like. In addition to WCDMA, it is well known that it can be implemented in various wireless communication networks such as 3G, 4G, LTE, and WIFI.

11 is a view showing the internal configuration of the wired and wireless ear microphone 10 in the entire system of FIG. Referring to FIG. 11, the ear microphone 10 includes a microphone 11, an earphone 12, an MPU (Micro Processor Unit) 13, and a first local area communication unit 14. The ear microphone 10 is used for hands-free when using the mobile device 20 such that an audio amplification mode and a multimedia mixing mode in addition to the call mode are performed by the mobile device 20.

FIG. 12 is a diagram showing the configuration of the mobile device 20 in the overall system of FIG. Referring to FIG. 12, the mobile device 20 includes a second local area communication unit 21, an input / output unit 22, a control unit 23, an output switching unit 24, a network communication unit 25, a storage unit 26, System memory 27. The output switching unit 24 includes a call recognition module 24a, a call providing module 24b, an output switching module 24c, an audio amplification module 24d, and a multimedia module 24e.

First, the call recognition module 24a controls the second short-range communication unit 21 to connect a data session through the wired communication method or the short-range wireless communication method through the ear microphone 10 and the data cable. In this case, the short range wireless communication method may be performed using Bluetooth, Zigbee, WIMAX, WPAN, and the like.

Meanwhile, in one embodiment of the present invention, the call recognition module 24a automatically recognizes a call start situation (call / receive a call) and a call end situation (hang call), and according to each state, the ear microphone 10 It is preferable to connect the data set with the ear microphone 10 so as to start or stop the amplifying output for the audio signal input from the microphone 11 of the microphone 11 of the microphone 11. On the other hand, the mobile device 20 receives the recognition signal from the ear microphone 10 during physical coupling through the wired cable with the ear microphone 10 as a pre-process for connecting the ear microphone 10 and the data session. Thereafter, it is preferable to cause the call recognition module 24a to start operation.

The call recognition module 24a analyzes whether the mobile device 20 is in a call state with the counterpart device 40 through the wireless network 30 by checking the data transmission / reception state of the network communication unit 25. That is, the call recognition module 24a determines whether a call audio signal is received from the outside.

The call providing module 24b performs a special amplification on the audio signal input to the microphone 10 formed in the microphone set 10 when the call recognition module 24a determines that the mobile device 20 is in a call state. The second short range communication unit 21 is controlled to transmit the amplification stop message, which means not to, to the ear microphone 10 through a wired communication method or a short range wireless communication method.

When the call audio signal is received from the counterpart device 50 through the wireless network 40, the call providing module 24b receives an ear microphone set without performing an amplification process through a request for an output switching module 24c to be described later. 10) to control the second short-range communication unit 21 to transmit to the wired or wireless. Accordingly, the MPU 13 of the ear microphone 10 controls the first short-range communication unit 14 to receive a call audio signal without amplification process, and then controls the earphone 12 to output a call audio signal. Allow the mode to be performed. That is, when it is determined that the general call state is between the counterpart device 50 and the mobile device 20, the call providing module 24b does not perform an audio amplification mode with respect to the audio signal of the user input from the microphone 11. 12) the other party's call audio signal and the user's own audio signal are mixed so that the situation does not occur. In addition, the call providing module 24b preferably controls the network communication unit 25 to transmit the audio signal input from the microphone 11 to the counterpart device 40 through the wireless network 30.

The output conversion module 24c, when the mobile recognition spring 20 is not in the current call state as a result of the call recognition module 24a, amplifies the amplification start message for the audio signal input to the microphone 11 into a wired or wireless ear microphone. The second local area communication unit 21 is controlled to transmit to (10). In addition, the output switching module 24c controls the second short-range communication unit 21 to receive the audio signal input to the microphone 11 included in the ear microphone 10 from the ear microphone 10.

The output switching module 24c is a preliminary procedure for switching from the call mode to the audio amplification mode by the audio amplification module 24d described later or the multimedia mixing mode by the multimedia module 24e. Perform the amplification process according to the set magnification. The output switching module 24c analyzes whether the multimedia application is executed on the system memory 27, and notifies the audio amplification module 24d or the multimedia module 24e of the mode switching message according to the analysis result.

When the audio amplification module 24d determines that the multimedia application is not running as a result of the analysis of the output switching module 24c, the audio amplification module 24d receives a mode switching message from the output switching module 24c and then amplifies the output switching module 24c. The second local area communication unit 21 is controlled to transmit the audio signal to the ear microphone 10. Accordingly, the MPU 13 of the ear microphone 10 controls the first local area communication unit 14 to receive the amplified audio signal from the audio amplification module 24d, and then converts the amplified audio signal into the earphone 12 Outputs the audio amplification mode (or hearing aid mode).

When the multimedia module 24e determines that the multimedia application is running as a result of the analysis of the output switching module 24c, the multimedia module 24e receives the mode switching message from the output switching module 24c and then amplifies the audio signal by the output switching module 24c. And a process of mixing the multimedia audio signals running in the multimedia application. Thereafter, the multimedia module 24e controls the second local area communication unit 21 to transmit the mixed audio signal to the ear microphone 10. Accordingly, the MPU 13 of the ear microphone 10 controls the first local area communication unit 14 to receive the mixed audio signal from the audio amplification module 24d, and then stores the mixed audio signal in the earphone 12 ) To perform multimedia mixing mode.

Meanwhile, as described above, the mobile device 20 performs a general call mode by the call providing module 24b, an audio amplification mode by the audio amplification module 24d, or a multimedia mixing mode by the multimedia module 24e. When performing the operation, the reception volume control function for the audio signal input to the microphone 11 of the ear microphone 10 to the input / output unit 22 may be implemented.

That is, when the mobile device 20 is a smart phone, it is common in the art that multimedia reproduction output is supported in addition to the call audio signal output and the multimedia reproduction output is disconnected in the call mode. Accordingly, in the present invention, when the multimedia sound source or video is reproduced by the multimedia playback program (application) in the non-call mode, the amplification of the audio signal input to the microphone 11 is performed after mixing. Through this, it enables users to enjoy the multimedia functions and to listen to the external sound at the same time, so that not only deaf people but also the general public can be usefully used on the streets, buses and trains as needed.

In addition, the multimedia module 24e outputs the mixed audio signal from the ear microphone set 10 by using a call answer button or a call-stop button that can be implemented in the input / output unit 22 when outputting the mixed audio signal. It is desirable to provide the convenience of turning the output on and off.

Figure 13 is a flow chart showing the overall flow of the ear microphone based audio signal amplification output automatic switching method according to the present invention.

Step S11: First, the mobile device 20 connects the data session through the wired communication method using the ear microphone 10 and the data cable or through the short range wireless communication method. The wired communication may be performed by USB, UART, etc., and the short-range wireless communication may be performed by Bluetooth, Zigbee, WIMAN, WPAN, or the like.

Step S12: After step S11, the mobile device 20 analyzes whether the mobile device 20 is currently in a state of talking with the counterpart device 40 through the state check of the network communication unit 25. That is, it is analyzed whether the mobile device 20 is receiving a call audio signal.

Step S13: It is determined whether the mobile device 20 is in a current call state according to the analysis of step S12.

Steps S20 and S30: If the determination result of step S13 is a call state, the mobile device 20 performs a call state audio output switching operation. On the contrary, when the determination result of step S13 is not a call state, the mobile device 20 performs a non-call state audio output switching operation.

  Hereinafter, the call state audio output switching operation S20 will be described in detail with reference to FIG. 14, and the non-call state audio output switching operation S30 will be described in detail with reference to FIG. 6.

  14 is a flowchart illustrating an audio output switching operation when the mobile device is in a call state in the present invention.

Step S21: First, the mobile device 20 performs an amplification stop message, which means that the mobile device 20 does not amplify the audio signal input to the microphone 10 formed in the ear microphone 10. To send.

Step S22: After step S21, the mobile device 20 controls the network communication unit 25 to receive a call audio signal from the counterpart device 50 through the wireless network 40, and then, for the amplification process. The wired and wireless communication is transmitted to the ear microphone 10 without performing.

Step S23: After step S22, the ear microphone 10 performs a call mode by receiving a call audio signal and outputting the call audio signal to the earphone 12 without performing a special audio amplification process. In addition, when performing the call mode, the mobile device 20 receives an audio signal input from the microphone 11 from the ear microphone 10 and transmits the audio signal to the counterpart device 40 through the wireless network 30. It is preferable to control the network communication unit 25.

15 is a flowchart illustrating an audio output switching operation when the mobile device is not in a call state in the present invention.

Step S31: First, the mobile device 20 transmits an amplification start message for the audio signal input through the microphone 11 to the ear microphone 10 through a wired communication method or a short range wireless communication method.

Step S32: According to step S31, the mobile device 20 receives an audio signal input through the microphone 11 from the ear microphone 10.

Step S33: After step S32, the mobile device 20 performs an amplification process according to a preset magnification setting for the audio signal received from the ear microphone 10 in step S32.

Step S34: After step S33, the mobile device 20 analyzes whether a multimedia app (app) is running on the system memory 27. That is, the mobile device 20 determines whether an audio sound is generated by executing a multimedia application such as YouTube or TED.

Step S35: According to the analysis result of step S34, the mobile device 20 determines whether to run the multimedia application.

Step S36: When the multimedia application is executed as a result of the determination of step S35, the mobile device 20 performs the audio signal amplified in step S33 and the multimedia being executed on the multimedia application (for example, playing music). A process of mixing audio signals is performed.

Step S37: After step S36, the mobile device 20 transmits the audio signal mixed in step S36 to the ear microphone 10 through a wired communication method or a short range wireless communication method (S23).

Step S38: After step S37, the ear microphone 10 performs the multimedia mixing mode by outputting the audio signal mixed in the previous step S36 to the earphone 12 of the ear microphone 10.

Step S39: If the multimedia application is not running as a result of the determination in step S35, the mobile device 20 transmits the audio signal amplified in step S33 to the ear microphone 10 in a wired or wireless manner.

Step S40: After step S39, the ear microphone 10 performs the audio amplification mode (or hearing aid mode) by outputting the audio signal amplified in step S33 to the earphone 12.

The invention can also be embodied in the form of computer readable codes on a computer readable recording medium. At this time, the computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, which may be implemented in the form of a carrier wave (eg, transmission over the Internet). . The computer readable recording medium can also store and execute computer readable code in a distributed manner over networked computer systems. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers in the technical field to which the present invention belongs. As described above, embodiments of the present invention have been disclosed in the specification and drawings, although specific terms have been used, which are merely used in a general sense to easily explain the technical contents of the present invention and to help understanding of the present invention. It is not intended to limit the scope of the invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

[Description of Drawing Reference]

100: portable terminal 200: 4-pole earphone

110: control unit 120: memory

130: interface unit 140: audio processing unit

150: RF communication unit 160: display unit

300: application 310: specific earphone recognition module

320: sound processing module 330: sound pattern / setting information DB

       10: Ear Microphone 11: Microphone

       12: Earphone 13: MPU

       14: first local area communication unit 20: mobile device

       21: second local area communication unit 22: input and output unit

23: control unit 24: output switching unit

24a: call recognition module 24b: call providing module

      24c: output switching module 24d: audio amplification module

      24e: multimedia module 25: network communication unit

      26: storage unit 30: wireless network

      40: counterpart device

Claims (22)

1. In the sound processing system for recognizing the earphone for a portable terminal using the sound pattern,

   Click the sound of the call conversion button mounted on the earphone input through the microphone mounted on the earphone of the portable terminal through the audio processing unit 140 to search the pre-stored sound pattern DB 330 based on this to search for a specific earphone A specific earphone recognition module 310 that recognizes and transmits the recognized earphone information as earphone search information;

   The sound processing module 320 for receiving the search information of the earphone from the specific earphone recognition module 320 and processing the input sound of the microphone input through the microphone in conjunction with the search information of the specific earphone by a preset sound processing method (320). ); And

    And a sound pattern / setting information DB for storing the sound pattern information of the click sound of the call conversion button mounted on the earphone in association with specific earphone information, wherein the microphone input sound of the earphone is input characteristics of the microphone of the recognized specific earphone. Sound processing system for recognizing the earphone for a portable terminal using the sound pattern, characterized in that for processing in the predetermined manner according to the output.
2. In the sound processing system for recognizing the earphone for a portable terminal using the sound pattern,

   Receiving a specific earphone by searching the pre-stored sound pattern DB 330 based on the input sound of the recognition-only button mounted on the earphone input through the microphone mounted on the earphone of the portable terminal based on the audio processing unit 140 A specific earphone recognition module 310 that recognizes and transmits the recognized earphone information as earphone search information;

   The sound processing module 320 for receiving the search information of the earphone from the specific earphone recognition module 320 and processing the input sound of the microphone input through the microphone in conjunction with the search information of the specific earphone by a preset sound processing method (320). ); And

    And a sound pattern / setting information DB for storing sound pattern information of a click sound of a recognition-only button mounted on the earphone in association with specific earphone information, and inputting characteristics of the microphone of the recognized earphone to the microphone input sound of the earphone. Sound processing system for recognizing the earphone for a portable terminal using the sound pattern, characterized in that for processing in the predetermined manner according to the output.
3. The method according to claim 1 or 2,

   The sound pattern is a sound processing system for recognizing the earphone for a portable terminal using the sound pattern, characterized in that one or more of the waveform, amplitude and frequency of the input sound.
4. The method according to claim 1 or 2,

   The input characteristic of the microphone is a sound processing for recognizing earphones for a portable terminal using an acoustic pattern, characterized in that it comprises one or more of the microphone's frequency characteristics, signal to noise ratio, impulse characteristics, sensitivity, impedance, transient response (Transient Response) system.
5. The method according to claim 1 or 2,

   The specific earphone recognition module 310 may include a pattern extraction unit 311 which receives a click sound of an A / D converted button from an audio processor 140 and extracts a sound pattern through a digital sound process; An acoustic pattern search unit 312 for searching the acoustic pattern / setting information DB 330 to search for the same acoustic pattern as the extracted acoustic pattern and extracting earphone information associated with the earphone pattern as earphone search information; And an earphone search information transmitting unit (313) for transmitting the earphone search information to an audio processing module.
6. The method of claim 5,

   The specific earphone recognition module 310 stores an acoustic pattern input unit 314 for storing the acoustic pattern extracted from the pattern extractor 311 in the acoustic pattern / setting information DB 330 in association with earphone information of a specific earphone. Sound processing system for recognizing the earphone for a portable terminal using a sound pattern characterized in that it further comprises.
7. The method according to claim 1 or 2,

   In the sound pattern / setting information DB 330, a processing method of the microphone input sound according to the input characteristic of the microphone of the earphone is stored as setting information in association with the earphone information.

   The sound processing module 320 includes an earphone search information receiver 321 for receiving search information of the earphone from the specific earphone recognition module 320; A microphone input sound setting unit 322 for retrieving specific setting information from the sound pattern / setting information DB 330 based on the earphone search information and setting a processing method of the microphone input sound accordingly;

   A microphone input sound processor 323 for processing a microphone input sound according to the set microphone input sound processing method; And

   Sound processing system for recognizing the earphone for a portable terminal using a sound pattern, characterized in that it comprises a processing sound output unit for outputting the processed microphone input sound.
8. In the recognition method of the earphone for a portable terminal using an acoustic pattern,

   Earphone insertion recognition step (S10) for recognizing the insertion of the earphone and the microphone and the call conversion button is installed on the interface of the portable terminal;

   A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the call conversion button through the microphone (S20);

   Based on the extracted sound pattern of the click sound, a specific earphone recognition step (S30) for recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound is used. Recognition method of earphone for portable terminal.
9. In the recognition method of the earphone for a portable terminal using an acoustic pattern,

   Earphone insertion recognition step (S10) for recognizing the insertion of the earphone and the microphone and the recognition dedicated button is installed on the interface of the portable terminal;

   A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the recognition-only button through the microphone (S20);

   Based on the extracted sound pattern of the click sound, a specific earphone recognition step (S30) for recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound is used. Recognition method of earphone for portable terminal.
10. The method according to claim 8 or 9,

    The microphone input sound processing / output step (S40) of processing the microphone input sound of the earphone in a preset manner according to the recognized specific earphone further comprises the step of the earphone for a portable terminal using a sound pattern Recognition method.
11. The method of claim 10,

    The microphone input sound processing / output step (S40) is a method of recognizing the earphone for a portable terminal using a sound pattern, characterized in that for processing the sound input through the microphone according to the input characteristics of the microphone of the specific earphone recognized.
12. The method according to claim 8 or 9,

    And a pattern information input step of activating the microphone and inputting and processing the click sound of the button through the microphone, extracting the sound pattern of the click sound, and storing it in association with information of the used earphone. Recognition method of earphone for portable terminal using sound pattern.
13. The method according to any one of claims 8 to 12,

    Recognizing method of a portable terminal earphone using a sound pattern, characterized in that the sound pattern includes one or more of the waveform, amplitude and frequency of the input sound.
14. The method of claim 11,

    The input characteristic of the microphone may include one or more of a frequency characteristic, a signal-to-noise ratio, an impulse characteristic, a sensitivity, an impedance, and a transient response of the microphone.
15. In the input sound processing method using the recognition method of the earphone for a portable terminal using a sound pattern,

    Earphone insertion recognition step (S10) for recognizing the insertion of the earphone and the microphone and the call conversion button is installed on the interface of the portable terminal;

    A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the call conversion button through the microphone (S20);

    A specific earphone recognition step (S30) of recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound based on the extracted sound pattern of the click sound; And

    The microphone input sound processing / output step (S40) includes a microphone input sound processing / output step (S40) for processing and outputting the microphone input sound of the earphone in a preset manner according to the recognized specific earphone. Input sound processing method using the recognition method of the earphone for a portable terminal using a sound pattern, characterized in that for amplifying and outputting the sound input through the microphone according to the sensitivity of the microphone of the particular earphone.
16. In the input sound processing method using the recognition method of the earphone for a portable terminal using a sound pattern,

    Earphone insertion recognition step (S10) for recognizing the insertion of the earphone and the microphone and the recognition dedicated button is installed on the interface of the portable terminal;

    A microphone sound input / processing step of activating the microphone and extracting a sound pattern of the click sound by receiving and processing a click sound of the recognition-only button through the microphone (S20);

    A specific earphone recognition step (S30) of recognizing a specific earphone inserted by searching for a specific earphone having a sound pattern of the same click sound based on the extracted sound pattern of the click sound; And

    The microphone input sound processing / output step (S40) includes a microphone input sound processing / output step (S40) for processing and outputting the microphone input sound of the earphone in a preset manner according to the recognized specific earphone. Input sound processing method using the recognition method of the earphone for a portable terminal using a sound pattern, characterized in that for amplifying and outputting the sound input through the microphone according to the sensitivity of the microphone of the particular earphone.
17. The method of claim 16,

    An input acoustic processing method using a method of recognizing earphone for a portable terminal using a sound pattern, characterized in that for outputting one or more messages of the insertion request message of the earphone and the message of the click of a button.
18. The method according to claim 16 or 17,

    Input earphone processing method using the recognition method of the earphone for a portable terminal using a sound pattern, characterized in that the four-pole earphone.
19. A first step of the mobile device connecting a data session through an ear microphone and a wired / wireless network and confirming whether the mobile device is in a call state from the state check of the network communication unit;

    A second step of the mobile device receiving an audio signal input to the microphone of the ear microphone and performing an amplification process according to a preset magnification when the call is not in a call state;

    Performing an audio amplification mode in which the mobile device transmits the amplified audio signal to the ear microphone set and outputs the amplified audio signal to the earphone of the ear microphone set;

    Ear microphone set based audio signal amplification output automatic conversion method comprising a.
20. The method of claim 19,

    When the call is in the call state, the mobile device transmits and outputs the ear microphone set to the ear microphone set without amplifying the call audio signal received from the counterpart device through a wireless network, and outputs the audio signal input from the microphone. A fourth step of receiving from the microphone set and transmitting the same to the counterpart device through the wireless network without amplifying;

    Ear microphone set based audio signal amplification output automatic conversion method further comprising.
21. The method of claim 19,

    A fifth step of determining whether the mobile device is executing a multimedia application, performed between the second step and the third step;

    A sixth step of mixing the amplified audio signal with the multimedia audio signal being executed in the multimedia app and generating the mixed audio signal when the mobile device executes the multimedia app;

    Performing a multimedia mixing mode in which the mobile device transmits the mixed audio signal to the ear microphone set and outputs the mixed audio signal to the earphone of the ear microphone set; Ear microphone set based audio signal amplification output automatic conversion method further comprising.
22. 22. A computer-readable recording medium having recorded thereon a program for performing the method of automatically converting an ear microphone based audio signal amplifying output according to any one of claims 19 to 21.

Images