KR20110072363A - Method for processing plurality of external voices in sound processsing apparatus and sound processing apparatus thereof - Google Patents

Abstract

PURPOSE: A method for processing a plurality of external voice in a sound processor and the sound processor using the same are provided to offer a convenient function to a user with the clear division of a mixed voice. CONSTITUTION: A sound processor obtains a plurality of external voice(S1). A controller analyzes the spectral characteristic of the obtained external audio(S2). The sound processor discriminates the external voice in consideration of the spectral characteristic and location information(S3,S4). The controller performs the clustering of the discriminated external voice(S5). If the selection signal of the discriminated voice is generated, the controller reproduces only the discriminated voice with a sound output module(S6).

Description

TECHNICAL FIELD OF PROCESSING PLURALITY OF EXTERNAL VOICES IN SOUND PROCESSSING APPARATUS AND SOUND PROCESSING APPARATUS THEREOF

The present invention relates to a method of processing a plurality of external voices in a sound processing apparatus and a sound processing apparatus to which the same is applied.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

Such a mobile terminal basically has a function of acquiring and processing voice. For example, it will be a sound processing apparatus because it will have a function as a music recorder and a music recorder.

In order to support and increase the function of such a mobile terminal, it may be considered to improve the structural part and / or the software part of the terminal.

 The present invention is to provide a method and apparatus for more accurately separating the voice when receiving a plurality of sound sources.

According to an embodiment of the present invention, a method of processing a plurality of external voices in a sound processing apparatus includes analyzing spectral characteristics of the plurality of external voices; Discriminating each of the plurality of external voices based on the spectral characteristics; And clustering the distinguished voices.

According to an aspect of an embodiment of the present invention, the external voice processing method may further include presetting the number of the distinguished external voices.

According to an aspect of an embodiment of the present invention, the sound processing apparatus includes at least two microphones, and the external voice processing method may include obtaining location information of the plurality of external voices acquired through the at least two microphones. And discriminating the plurality of external voices based on the spectral characteristics, respectively, and distinguishing the plurality of external voices based on the spectral information and the location information. Can be.

According to an aspect of an embodiment of the present invention, the external voice processing method may further include obtaining the plurality of external voices through at least one of a microphone and a wireless communication unit of the sound processing apparatus.

According to an aspect of an embodiment of the present invention, the external voice processing method may further include providing a menu for inputting a name for each distinct voice.

According to an aspect of an embodiment of the present invention, the external voice processing method may further include reproducing only the distinguished voice when the selection signal for the distinguished voice is generated.

Another embodiment of the present invention provides a mobile communication terminal comprising: a microphone configured to obtain a plurality of external voices; And a controller configured to analyze the spectral characteristics of the plurality of external voices, distinguish the plurality of external voices based on the spectral characteristics, and cluster the distinguished voices.

According to an aspect of another embodiment of the present invention, the mobile communication terminal may further include a user input configured to set the number of the distinguished external voices.

According to an aspect of another embodiment of the present invention, the microphone is composed of at least two, the control unit, obtains the position information of the plurality of external voices obtained through the at least two microphones, and the spectral information and the Based on the location information, the plurality of external voices may be distinguished from each other.

According to an aspect of another embodiment of the present invention, the mobile communication terminal may further include a wireless communication unit for acquiring the plurality of external voices.

According to an aspect of another embodiment of the present invention, the mobile communication terminal further includes a voice output module, and the controller controls the voice to reproduce only the differentiated voice when a selection signal for the distinguished voice is generated. Output module can be controlled.

According to the present invention having the above-described configuration, it is possible to more clearly separate the mixed voice obtained from the plurality of sound sources, to provide a convenient function to the user.

EMBODIMENT OF THE INVENTION Hereinafter, the sound processing apparatus which concerns on this invention is demonstrated in detail with reference to drawings. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other.

The sound processing apparatus described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to digital TVs, desktop computers, etc., except when applicable only to the sound processing apparatus.

1 is a block diagram of a sound processing apparatus according to an embodiment of the present invention.

The sound processing apparatus 100 may include a wireless communication unit 110, a microphone 120, a user input unit 130, a display unit 140, a sound output module 150, a memory 160, an interface unit 170, and The controller 180 may be included. The components shown in FIG. 1 are not essential, so that a sound processing apparatus having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the sound processing apparatus 100 and the wireless communication system or between a network in which the sound processing apparatus 100 and the sound processing apparatus 100 are located. . For example, the wireless communication unit 110 may include a broadcast receiving module, a mobile communication module, a wireless internet module, a short range communication module and a location information module.

The broadcast receiving module receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast-Handheld (DVB-H). The digital broadcast signal may be received using a digital broadcasting system such as ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module may be configured to be suitable for not only the above-described digital broadcast system but also other broadcast systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 160.

The mobile communication module transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module refers to a module for wireless internet access and may be embedded or external to the sound processing apparatus 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module is a module for acquiring a location of the sound processing device, and a representative example thereof is a GPS (Global Position System) module.

The microphone 120 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module and output in the call mode. The microphone 120 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

In addition, at least two microphones may be mounted in the sound processing apparatus 100. The sound source received from the at least two microphones may be signal processed through a sound source program stored in the memory 160 to obtain a sound source having higher quality.

The user input unit 130 generates input data for the user to control the operation of the sound processing apparatus. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The display 140 displays (outputs) information processed by the sound processing apparatus 100. For example, when the sound processing apparatus is in a call mode, the UI (User Interface) or GUI (Graphic User Interface) related to the call is displayed. When the sound processing apparatus 100 is in a video call mode or a photographing mode, it displays a photographed and / or received image, a UI, or a GUI.

The display unit 140 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Two or more display units 140 may exist according to the implementation form of the sound processing apparatus 100. For example, the plurality of display units may be spaced apart or integrally disposed on one surface of the sound processing apparatus 100, or may be disposed on different surfaces, respectively.

When the display unit 140 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 140 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display 140 or a capacitance generated at a specific portion of the display 140 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display 140 is touched.

The sound output module 150 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 may also output a sound signal related to a function performed by the sound processing apparatus 100. The sound output module 150 may include a receiver, a speaker, a buzzer, and the like.

The memory 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The sound processing apparatus 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the sound processing apparatus 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the sound processing device 100, or transmits data inside the sound processing device 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The interface unit may be a passage through which power from the cradle is supplied to the sound processing apparatus 100 when the sound processing apparatus 100 is connected to an external cradle, or various command signals input from the cradle may be input by a user. It may be a passage that is delivered to the mobile terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the sound processing apparatus. The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

2 is a view for explaining the concept of the sound processing apparatus according to an embodiment of the present invention.

As shown, three speakers A, B, and C are positioned around the sound processing apparatus 100. If at least two microphones are installed in the sound processing apparatus 100, the location information of the speakers may be obtained, and the speakers may be distinguished based on the location information. However, since the positions of the speaker B and the speaker C are almost the same, the positional information of the speaker B and the speaker C may fall within an error range. In this case, the controller 180 of the sound processing apparatus 100 cannot distinguish between the speaker B and the speaker C only by the position information.

3 is a conceptual diagram illustrating a method of processing a plurality of external voices in a sound processing apparatus according to an embodiment of the present invention.

After receiving the speaker's voice in FIG. 2 and performing spectrum analysis, a spectral diagram as shown in FIG. 3 appears. 210 is the spectrum of speaker A, 220 is the spectrum of speaker B, 230 is the spectrum of speaker C, and 240 is the spectrum of speaker A. As shown in the figure, the characteristics of each speaker are different. By using this, the controller 180 can distinguish and recognize the voices between the respective speakers. On the other hand, the same speaker among the sections divided by the speaker is similar in the spectrum (210 and 240 in Figure 3). In this case, sections having similar spectral characteristics may be clustered.

4 is a flowchart illustrating a method of processing a plurality of external voices in an acoustic processing apparatus according to an embodiment of the present invention.

As shown, first, the sound processing apparatus 100 obtains a plurality of external voices (S1). The plurality of external voices may be obtained through the microphone 120 or may be obtained through the wireless communication unit 110 (ie, radio voice, mobile broadcast voice, etc.). The controller 180 analyzes the spectral characteristics of the obtained plurality of external voices (S2).

The sound processing apparatus may include at least two microphones. When acquiring the location information of the plurality of external voices acquired through the two microphones, the sound processing apparatus may be configured to consider both the spectral characteristics and the location information. External voices can be distinguished and recognized (S3, S4). Next, the controller 180 clusters the distinguished and recognized external voices (S5). At this time, the number of the distinguished external voices may be preset through the user input unit 130.

Next, when the selection signal for the distinguished voice is generated, the controller 180 controls the sound output module 150 to reproduce only the distinguished voice. Here, a menu for inputting a name for each distinguished voice may be further displayed on the display unit 140.

According to an embodiment of the present invention having the above-described configuration, it is possible to identify the voice generated from the same similar position. This identified voice can be selectively reproduced.

Hereinafter, an example of a sound processing apparatus to which the method for processing a plurality of external voices in the aforementioned flavor processing apparatus is applied will be described in detail with reference to FIG. 5.

5 is an image diagram illustrating an application example of a sound processing apparatus to which a method of processing a plurality of external voices is applied in a sound processing apparatus according to an embodiment of the present invention.

In this example, a case of reproducing a voice stored in the memory 160 will be described. It is apparent that the present invention is not limited thereto and may be applied to the case of playing a video.

5A shows the voice recorder screen 200. This voice recorder screen 200 includes a voice file list 201-203, a menu icon 204, a confirmation icon 205, and a previous icon 206.

When the user inputs one of the voice file lists 202 through the user input unit 130, as shown in FIG. 5B, the voice reproduction screen 210 is displayed on the display unit 140.

The audio playback screen 210 includes a progressive bar 211, a menu icon 212, and a playback control icon 213.

In this state, when the menu icon 212 is selected, as shown in FIG. 5C, the menu window 220 is displayed. In the menu window 220, a transmission icon 221, a deletion icon 222, and a play icon 223 for each voice are displayed.

When the transmission icon 221 is selected, a menu screen for transmitting the selected voice file is displayed on the display 140.

When the delete icon 222 is selected, the selected voice file is deleted.

When the play icon 223 for each voice is selected, as illustrated in FIG. 5D, a screen 230 for determining the number of voices to be distinguished may be displayed on the display 140. In this case, the user may determine the number of distinguishable speakers using the user input unit 130. In this example, it was limited to three people. In this way, by limiting the maximum number of people, the calculation burden of the controller 180 can be reduced. Or automatically, the voice file may be analyzed to determine the number of distinct voices.

Then, when analyzing the selected voice file, as shown in FIG. 5E, a menu screen 240 for each voice may be displayed on the display 140.

The voice menu screen 240 includes a first speaker menu 241, a second speaker menu 242, and a third speaker menu 243.

The first speaker menu 241 includes a first playback control icon 241-1 and a first progressive bar 241-2.

The second speaker menu 242 includes a second playback control icon 242-1 and a second progressive bar 242-2.

The third speaker menu 243 includes a third playback control icon 243-1 and a third progressive bar 243-2.

The user can listen to the desired speaker's voice through the playback control icon, and can check the current progress state and the state of the entire voice data through the progressive bar.

In addition, the user may input title information for each speaker menu through the user input unit 130. In addition, the spectral characteristics of the analyzed voice file are stored in the memory 160, and then when the user acquires the voice, if the speaker with the acquired voice pre-analyzed spectrum is present, the speaker automatically. The name of can be specified.

Further, according to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

 The method of processing a plurality of external voices in the above-described sound processing apparatus and the sound processing apparatus to which the same is applied may not be limitedly applied to the configuration and method of the above-described embodiments. All or part of each of the embodiments may be selectively combined to be implemented.

1 is a block diagram of a sound processing apparatus according to an embodiment of the present invention;

2 is a view for explaining the concept of a sound processing device which is an embodiment of the present invention.

3 is a conceptual diagram illustrating a method of processing a plurality of external voices in a sound processing apparatus according to an embodiment of the present invention.

4 is a flowchart illustrating a method of processing a plurality of external voices in an acoustic processing apparatus according to an embodiment of the present invention.

5 is an image of an application example of a sound processing apparatus to which a method of processing a plurality of external voices is applied in a sound processing apparatus according to an embodiment of the present invention.

Claims (11)

As a method of processing a plurality of external voices in a sound processing apparatus, Analyzing spectral characteristics of the plurality of external voices; Discriminating each of the plurality of external voices based on the spectral characteristics; And Clustering said distinct voices. The method of claim 1, And presetting the number of the distinguished external voices in advance. The method of claim 1, The sound processing device includes at least two microphones, Acquiring position information of the plurality of external voices acquired through the at least two microphones; Based on the spectral characteristics, the step of distinguishing each of the plurality of external voices, And discriminating each of the plurality of external voices based on the spectrum information and the location information. The method of claim 1, And a plurality of external voices are obtained through at least one of a microphone and a wireless communication unit of the sound processing device. The method of claim 1, And providing a menu for inputting a name for each distinguished voice. The method of claim 1, And reproducing only the distinguished voice when the selection signal for the distinguished voice is generated. A microphone configured to obtain a plurality of external voices; And And a controller for analyzing the spectral characteristics of the plurality of external voices, distinguishing the plurality of external voices based on the spectral characteristics, and clustering the distinguished voices, respectively. The method of claim 7, wherein And a user input configured to set the number of the distinguished external voices. The method of claim 7, wherein The microphone is composed of at least two, The control unit, And obtaining location information of the plurality of external voices acquired through the at least two microphones, and distinguishing the plurality of external voices based on the spectrum information and the location information, respectively. The method of claim 7, wherein And a wireless communication unit for acquiring the plurality of external voices. The method of claim 7, wherein Further includes a voice output module, The control unit, And when the selection signal for the discriminated voice is generated, controls the speech output module to reproduce only the discriminated speech.

Images