KR20010100166A - Telephone and Method for Converting Sound to Image and Displaying on screen of the Telephone - Google Patents

Abstract

The present invention relates to a call terminal and a method for displaying a sound conversion of a call terminal. Particularly, the apparatus of the present invention includes a receiver for receiving a call signal, a storage unit for storing call tone information, a call tone output unit for outputting a call tone, A color display unit for displaying a color image, and read out the ring tone information from the storage unit at the time of receiving the call signal through the receiver, and generates a ring tone through the ring tone output unit in response to the read ring tone information, and simultaneously reads the ring tone information read out. And a controller for acquiring the tone analysis information by displaying the tone analysis information and displaying a corresponding ring tone image on the color display unit in response to the acquired tone analysis information. Therefore, in the present invention, it is possible to give a pleasure to the user by improving the image quality of the product by displaying the image on the screen.

Description

{Telephone and Method for Converting Sound to Image and Displaying on screen of the Telephone}

The present invention relates to a call terminal and a method for displaying a sound conversion of a call terminal, and more particularly, to a ring tone or a caller's call sound of a portable mobile communication terminal.

Recently, various functions of mobile phones have been introduced along with the spread of mobile communication terminals (hereinafter referred to as mobile phones) called mobile phones, mobile phones, PCS phones, IMT-2000 phones, and the like.

As market competition intensifies among handset manufacturers and telecommunications service providers, research and development is actively conducted through competition between product merchandise and value-added services.

Additional features of the handset include the transmission of text messages, various ringtone services, and games.

In particular, in the case of a mobile phone, when a call tone, that is, a ringtone is fixed to one, when several mobile phones fixed to the same ringtone are adjacent to each other within the same space, the mobile phone often pulls out and checks each other's own mobile phone. have.

Therefore, mobile phones have been introduced that enable the user to select a variety of ringtones in response to the consumer's desire to have a unique ringtone unique to other mobile phones. In addition, recently, a technique of downloading a unique ringtone from a ringtone service provider and setting a ringtone or setting a human voice as a ringtone has been introduced.

Initially, ringtones were mainly composed of single channel buzzer, but recently, SMAF (Synthetic music Mobile Application Format) such as 4poly YAMAHA MA1, 16poly YAMAHA MA2 (MMF), etc. MIDI chord ringtones are also provided.

In addition, color screens such as full-color moving pictures, graphics, and animations are provided in 2.5 generations of CDMA 2000 1x mobile phones and 3rd generation mobile phones of IMT 2000.

However, until now, the ringtone or the call sound of the mobile phone could be detected only by hearing and could not visually feel the sound of the mobile phone.

SUMMARY OF THE INVENTION An object of the present invention is to provide a call terminal and a sound conversion display method capable of displaying a color image to visually feel a ring tone or a call sound of a call terminal such as a mobile phone in order to solve such a problem.

Another object of the present invention is to provide a call terminal and a sound conversion display method that can improve the merchandise of the call terminal by displaying the sound as an image in the call terminal.

It is still another object of the present invention to provide a call terminal and a sound conversion display method capable of displaying a character's sound turbidity and emotion index and the like as characters and color images by analyzing the other's sound during a call.

1 is a block diagram of a call terminal according to the present invention.

2 to 6 show correspondence tables of the tone analysis information and the image information for the synthesized ring tone in the MA2 format.

7 is a view showing a video display of the composite ring tone of the mobile phone according to the present invention.

8 is a flowchart for explaining a sound conversion method for synthesized ringtones according to the present invention.

Fig. 9 is a flowchart for explaining a sound conversion method of voice call sound according to the present invention;

Fig. 10 is a view showing the correspondence between the sound analysis information and the image information of the voice call tone according to the present invention and the video display thereof.

11 is an orthogonal color coordinate system displaying a color corresponding to each audible frequency when converting an audible frequency into a visible frequency according to the present invention;

12 to 15 are views showing various image display states of the ring tone according to the present invention.

Fig. 16 is a view showing a state in which a ring tone according to the present invention is expressed by a change in color illumination of a liquid crystal display panel.

FIG. 17 is a flowchart for explaining a method for displaying a call tone according to the present invention as an image; FIG.

18 is a view showing an example of an emotional index and the corresponding character according to the present invention.

Fig. 19 shows an example of the turbidity index and the corresponding character according to the present invention.

20 and 21 are diagrams showing an example of a call tone video display according to the present invention.

* Explanation of symbols for the main parts of the drawings *

100: transceiver 102: antenna

104: duplexer 106: receiver

108: frequency synthesis unit 110: decoder

112: encoder 114: transmitter

200: handset 202: voice processing unit

204: voice amplifier 206: speaker

208: microphone 210: voice synthesis unit

300: display unit 302: LCD driver

304: liquid crystal display panel 306: lighting unit

400: keypad 500: memory

600: control unit 602; Central Processing Unit

604: vocoder 606: sound image conversion unit

In order to achieve the above object, a communication terminal of the present invention includes a receiving unit for receiving a call signal, a storage unit for storing ring tone information, a ring tone output unit for outputting the ring tone, a color display unit for displaying a color image, When the call signal is received through the receiver, the call tone information is read from the storage unit, and the call tone information is generated through the call tone output unit in response to the read call tone information, and the read call tone information is analyzed in units of frames. And a controller for acquiring information and displaying a corresponding ring tone image in response to the acquired tone analysis information.

In the present invention, the ring tone information is information according to the composite sound mobile audio 2 format, and the control unit obtains information such as program change, channel volume, panport, note, and channel message from the mobile audio 2 information as sound analysis information. In response to the sound analysis information, the image information is converted into image information such as image shape, size, x-axis position, color and y-axis position, and number.

In the present invention, the ring tone information is voice information, and the control unit performs Fourier transform on the voice information, and obtains pitch (base frequency), formant frequency, energy of each formant frequency, etc. from the Fourier transformed signal as sound analysis information. In response to the obtained sound analysis information, the image is converted into image information such as color, number of images, y-axis position, and image size.

In addition, the communication terminal of the present invention includes a receiving unit for receiving a call signal, a storage unit for storing call tone information, a call tone output unit for outputting the call tone, a lighting unit, and a gradation display unit for displaying gradation information. And reading a ring tone from the storage unit when receiving a call signal through the receiving unit, generating a ring tone through the ring tone output unit in response to the read ring tone information, and analyzing the read ring tone information in a frame unit. And a controller for acquiring analysis information and displaying the illumination color of the corresponding lighting unit in response to the acquired sound analysis information.

In addition, the communication terminal of the present invention is a handset unit for inputting and outputting a call tone, a transceiver for transmitting and receiving the call tone signal, a color display for displaying a color image, and the input of the call tone signal through the handset or transceiver Detects and outputs or transmits an input call tone signal through the handset or a transceiver and simultaneously analyzes the input call tone signal to obtain tone analysis information, and transmits a call tone image corresponding to the obtained tone analysis information to the color display unit. And a control unit for displaying.

In the present invention, the control unit Fourier transform the call signal in units of frames, and obtains the pitch (fundamental frequency), the formant frequency, the energy of each formant frequency, etc. from the Fourier transformed signal as sound analysis information. In response, the image is converted into image information such as color, number of images, y-axis position, and image size.

In the present invention, the control unit obtains the energy of each frame in the unit of the call sound signal frame, and Fourier transform to obtain the pitch (base frequency), formant frequency, energy of each formant frequency, etc. from the Fourier transformed signal as sound analysis information The emotion index of the speaker is determined in response to the obtained sound analysis information, and the character information corresponding to the determined emotion index is displayed on the color display unit.

In the present invention, the control unit calculates the reference energy and reference frequency of the speaker based on the energy and pitch information, calculates the average energy and the average fundamental frequency in a predetermined time unit, and the average energy and average calculated for the reference energy and the reference frequency. The change of the speaker's emotion is judged according to the change rate of the fundamental frequency.

Also, in the present invention, the control unit obtains the energy of each frame from the call sound data in units of frames, and converts the Fourier transformed signal into pitch analysis information from the Fourier-converted signal to form the pitch (base frequency), the formant frequency, and the energy of each formant frequency as sound analysis information. The turbidity index of the speaker is determined in response to the acquired sound analysis information, and character information corresponding to the determined turbidity index is displayed on the color display unit.

In the call terminal image display method of the present invention includes a color display unit and generates a ring tone in response to receiving a call signal or in response to a call key input,

Read out the tone data, extract the tone analysis information of the ring tone according to the format of the read tone data, form the color image data corresponding to the read tone analysis information, and output the color image data to the output of the ring tone It synchronizes and displays a color image on the display part of the said telephone terminal.

In addition, the call tone image display method of the present invention, in a call terminal including a color display unit, receiving the call tone data of the other party, extracting the tone analysis information of the call tone from the received call tone data, and corresponds to the read tone analysis information A call tone image is formed, and the call tone image is displayed as a color image on the color display unit in synchronization with the output of the call tone.

In the present invention, the call tone image display includes a call tone image, an emotion index character, a turbidity character, and the like.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 shows a block configuration of a mobile phone according to the present invention.

The mobile phone includes a transceiver 100, a handset 200, a display 300, a keypad 400, a memory 500, and a controller 600.

The transceiver 100 receives the RF signal transmitted from the mobile communication base station to the receiver 106 through the antenna 102 and the duplexer 104. The receiver 106 extracts the CDMA signal by mixing the received RF signal with the frequency signal supplied from the frequency synthesizer 108 and provides the extracted CDMA signal to the decoder 110.

The decoder 110 demodulates the CDMA signal, restores the demodulated signal to the channel coded data, and decodes the recovered digital data by the CDMA decoding algorithm to provide the packet data to the controller 600.

The encoder 112 channel-codes the packet data provided from the controller 600 by the CDMA encoding algorithm and provides the channel-coded data to the transmitter 114.

The transmitter 114 converts the channel coded data into a CDMA signal, modulates the converted CDMA signal, mixes the modulated signal with a frequency signal provided by the frequency synthesizer 108, generates an RF signal, and generates a duplex 104 and It transmits to the air through the antenna 102.

The handset 200 forms the voice data and the ADPCM data provided by the controller 600 as analog voice signals in the voice processor 202 and outputs the formed analog voice signals through the voice amplifier 204 and the speaker 206. .

The handset 200 converts a voice signal input through the microphone 208 into digital voice data, that is, ADPCM data, and provides the converted voice data to the controller 600.

The handset unit 200 synthesizes the call tone data provided from the control unit 200 in the voice synthesizer 210 to form an analog call tone signal and outputs the formed call tone signal through the voice amplifier 204 and the speaker 206 as a ring tone. .

Here, the voice synthesis unit 210 processes voice tone data including voices composed of PCM or ADPCM data and MIDI tone data comprising computer synthesized sounds in MA1 or MA2 format to generate voice signals (eg, YMU759 from Yamaha, Japan). Chips) and the like.

The display unit 300 converts the image data provided from the controller 600 into LCD drive data in the LCD driver 302 and provides the image data to the LCD panel 304.

Here, the LCD panel 304 adopts a gray scale display or a color display system.

In the gradation display method, letters, numbers, icons, etc. are displayed on the screen by black and white gradations, and the color illumination unit 306 is adopted. The color illumination unit 306 provides color illumination to the liquid crystal display panel by a combination of red, green or red, green, and blue lamps, for example, light emitting diodes.

The keypad 400 constitutes a keypad of a general mobile phone and provides a key input signal to the controller. The keypad 400 may select a call sound image conversion display function, download a call sound data, or input a function key for selecting an image.

The memory 500 is comprised of memories such as a flash memory, a RAM, a ROM, a downloaded call sound data, and the like, stored in the flash memory, and a mobile phone operating program is implanted in the ROM.

The controller 600 includes a central processor 602, a vocoder 604, and a sound image converter 606.

The central processing unit 602 is composed of a microcomputer, an interface circuit, and the like to execute a mobile phone operating system.

The vocoder 602 inputs the packet data provided by the transceiver 100 to decode the compressed data by a QCELP decoding algorithm and decodes the expanded speech data into the speech processing unit 202 of the handset 200. To provide. In addition, the voice data provided from the handset 200 is compressed by the QCELP encoding algorithm to form packet data, and the formed packet data is provided to the encoder 112 of the transceiver 100.

In the QCELP algorithm, formant frequency information and pitch information of a speech signal are extracted as feature information of the speech signal, and the information is compressed and encoded. In the decoding process, an audio signal similar to the original sound is formed from the received formant frequency information and the pitch information.

The sound conversion unit 606 inputs call tone and call sound data to form corresponding image data by the sound conversion algorithm of the present invention, and provides the formed image data to the display unit 300 through the central processing unit 602.

Sound conversion algorithm according to the present invention is as follows.

1. Video conversion of synthesized ring tone in MA2 format

The sequence data of the MA2 format data provided by Yamaha consists of repetition of duration data of 1 to 2 bytes and event data of 2 to N bytes.

Event data is divided into control message, note message, NOP message, and exclusive message according to the data type.

The control message contains the channel code, control id, type code, setting value, etc. in the second and third bytes. According to the type code, it is divided into program change, octave shift, channel volume, pan port, and expression.

Program change is information that sets the instrument tone of the channel to any of 128 instrument tones. Octave shift is information for setting the amount of octave shift of a corresponding channel to any one of 10 shift amounts. The channel volume is information for setting the volume of the channel to one of 32 volume levels. Panport is information for setting the decibel value of each of the L and R stereo sound sources in any one of 44 steps in the stereo sound field. Expression is information for changing the volume of the channel while the music is playing.

Note messages include channel code, octave code, note code, and gate time code. The octave code has four levels of octave information: low, middle, middle, high and high. Note code has 12 scale information. The gate timecode has note length information of the corresponding note in the set scale.

Exclusive messages consist of two bytes of headcode, one byte of message size, one byte of maker ID, one byte of format ID, n bytes of data, and one byte of data end. Contains control information for

Therefore, the video conversion of the MIDI ring tone of the present invention corresponds the above-described music information to the image information as follows. The Y axis of the liquid crystal display screen corresponds to the pitch, that is, the frequency of sound, the X axis corresponds to the decibel value of the stereo sound source, and the sound analysis information and the image information are matched as shown in Table 1 below.

2 to 6 show correspondence tables of the tone analysis information and the image information of the synthesized ring tone.

Referring to FIG. 2, four octave ranges correspond to four luminance values, respectively. Referring to FIG. 3, each scale of the used octave range has a corresponding RGB value and corresponding colors, respectively. Referring to FIG. 4, pan port values having LR stereo values correspond to coordinate values on the X-axis on the screen, respectively. Referring to FIG. 5, the channel volume values correspond to image sizes, respectively. Referring to FIG. 6, program change values correspond to image shapes, respectively.

7 shows a video display of the composite ring tone of the mobile phone according to the present invention. Referring to FIG. 7, in the case where the four-poly synthesized ring tone consists of the ensemble of four-channel instruments of drum, grand piano, saxophone, and violin, the corresponding images of each instrument channel appear as a stereo sound field on the X-axis coordinates on the screen. In addition, it can be seen that the size of the color and image shape are different according to the frequency height of the sound frequency components of each channel on the Y-axis coordinate of the screen.

This image is displayed only for the duration of each MIDI note.

MA2 data Information Image Information Remarks Note message Octaves and Notes Pitch Y axis position, color, brightness 2 and 3 Gate value Length Image display time Control message Panpot Stereo source decibel value X axis position 4 Channel volume Sound pressure Display area of the image 5 Program change Musical instrument tone Type of image 6 Exclusive message Voice data Chord Image count 4Poly-4Image16Poly-16Image

8, the central processing unit 602 checks whether a call signal is received or whether there is a call key input (S100) If there is no call signal or no call key input, the call waiting state is maintained.

When the call signal is received in step S100 or the call key input is checked, the call sound data is read from the memory 500 and provided to the voice synthesis unit 210 and the sound conversion unit 606. Here, the call tone data is read by the user among various call tone data downloaded and stored in the memory 500 by the user (S102).

The sound image converter 606 checks whether the input call sound is a synthesized sound, that is, MA2 format (S104). If it is not in the MA2 format, the voice call tone data is recognized and the voice call tone processing routine is performed (S105). In the case of the MA2 format, the sound analysis information is extracted from the ring tone data by performing the above-described algorithm (S106). Subsequently, an image corresponding to the extracted sound analysis information is formed (S108).

When the formed image data is provided to the central processing unit 602 (S110), the central processing unit 602 converts the image data into RGB data and synthesizes the image data with other display data to provide the image data to the LCD driver 302 and the LCD panel 304. (S112).

The central processing unit 602 controls the image to be displayed in synchronization with the output of the ring tone.

In the sound image converter 606, the tables of FIGS. 2 to 6 may be pre-written as a lookup table to generate RGB data of a corresponding image by addressing sound analysis information.

2. Algorithm of Voice Call

Voice ring tone information consists of digital data sampled on the time base that is recorded as ADPCM or PCM data of human voice or natural sound and stored in memory and output as ring tone in response to call signal.

Yamaha's YMU759 chip includes the ability to play back a voice call made up of ADPCM data and output the voice.

Referring to FIG. 9, in the voice call tone format (S114), the sound image converter 606 converts the call tone information composed of ADPCM data into 16-bit PCM data (S116).

The converted PCM data is converted into frequency data through a fast Fourier transform (FFT) on a frame basis (S118).

Obtain the peak value and pitch (base frequency) of the frequency data every frame. Peak data are filtered by a filtering algorithm, and the filtered peak values are classified in order of energy magnitude, and then sampled to an appropriate number of peak values, for example, 30 or less (S120). Each sampled peak value signal includes the formant frequency of the audio signal of the corresponding frame. In addition, the pitch is detected in the frequency domain to obtain a fundamental frequency (S122). This signal calculates a corresponding visible frequency by means of a sound conversion algorithm (S124).

In operation S124, the sound conversion algorithm is defined by Equation 1 below.

----------------(One)

here, ego,

F is the visible frequency

F _l is the reference visible frequency,

The integer part of x is the octave value,

B _{F is} the luminance _{of the} color,

x * is the fractional part of x, the scale value within one octave,

f _i is the sampled audio frequency,

f _l is the reference audio frequency,

C is a constant It is a real number in the range.

As an example, the audible frequency f _i is 329.6 H _Z corresponding to a four octave 'mi' sound, the constant C represents a value of 0.29 by a reference frequency corresponding to 'red', and the lowest audible frequency f _{If l} and the lowest visible frequency F _l are set to 20 H _Z and 350 TH _Z , respectively, the visible frequency derived by the above formula is 441 TH _Z, and the luminance of the color to be obtained is 4.33 in proportion to the calculated x value. (43.3%) has a luminance value.

When the image size information corresponding to the color corresponding to the visible frequency obtained in operation S124 and the energy of each frequency is formed as image data, and the formed image data is provided to the central processing unit 602 (S126), the central processing unit 602 performs an image. The data is converted into RGB data and synthesized with other display data to provide image data to the LCD driver 302 and displayed on the LCD panel 304 (S128).

The central processing unit 602 controls the image to be displayed in synchronization with the output of the voice call tone.

10 shows an example of video display of a voice call tone. Referring to FIG. 10, a) is a sampled speech signal, b) is a frequency spectrum obtained by FFT (discrete fast Fourier transform), and c) is original images corresponding to peak values of frequency data displayed on the screen. will be.

In c), the size of the circle corresponding to each peak frequency is proportional to the energy of each frequency, and the color of the circle is determined by Equation (1). The overlapping part of the circles is represented by a mixed color of colors of each circle.

The color corresponding to each audio frequency has a color shown in the color coordinate system shown in FIG. 11 according to the octave and the scale.

12 to 15 show various examples of the video display of the synthesized ring tone or voice ring tone. 12 and 13 illustrate examples in which images corresponding to each sound frequency are disposed corresponding to the y-axis of the screen, and are displayed in an area proportional to the energy level of each sound frequency.

14 shows an example in which a mixture of all frequencies is displayed from a center of the screen and radially progresses to the edge of the screen as time passes.

15 is a combination of squares having different areas according to the energy level of each sound frequency to be displayed, and expresses an image constituting the entire screen in a Mondrian picture format.

In addition, various expressions such as a color bar shape and a mosaic shape may be modified within a night of the technical idea of the present invention.

Therefore, the mobile phone user can visually enjoy the ringtone not only by hearing, but also by the color image rhythmically changed according to the ringtone on the liquid crystal panel.

3. Color display of mobile phone ringtone by color lighting unit

In the above-described embodiment, a mobile phone having a color liquid crystal panel has been described, but it is possible to visually express a ring tone even for a mobile phone having a gray scale liquid crystal panel.

That is, the mobile phone includes an illumination unit 306 for illuminating the liquid crystal display panel 304. The illumination unit 306 is composed of illumination sources having at least two different colors to provide color illumination on the liquid crystal display panel 304. For example, color illumination is expressed by a combination of three color light emitting diodes of a red light emitting diode, a green light emitting diode, and a blue light emitting diode as an illumination source.

Therefore, in the present invention, in driving the color light emitting diode of the lighting unit 306, the ring tone is controlled by controlling the respective brightness of the color light emitting diode in response to the gain information of the RGB value corresponding to each sound obtained by the above-described algorithm. In response to this, as shown in FIG. 16, color illumination can be displayed on the LCD display window in which the illumination color is changed to a color of 65000 colors.

4. Video conversion algorithm of call sound

The video conversion display of the call sound expresses the voice of the mobile phone caller, that is, the call counterpart as an image, and at the same time, expresses the emotional state and the turbidity according to the voice analysis of the other party as a character.

Data decoded through the vocoder 604 is provided to the speech processing unit 202 as ADPCM data.

The sound image converter 606 of the present invention samples the output data of the vocoder 604 into PCM data by sampling 1024 samples in every frame unit (S130).

Average energy per frame ( To obtain (S132). Where Es is the energy of each sample value and N is the total number of samples (1024) in the frame.

When the energy difference is 6 dB compared with the average energy E _{a (j-1)} of the previous frame and the average energy E _aj of the current frame, it is detected that a signal exists (S134).

If there is a signal, that is, a call tone, the average energy of the first three frames is obtained to calculate the reference energy E _r . Subsequently, average energy AE _k of the next three frames is obtained (S136).

Next, fast Fourier transforms the sample values of each frame (S138). A pitch, that is, a fundamental frequency f _f , is obtained by using a known pitch algorithm from the Fourier transformed frequency data (S140).

4-1. Voice image shaping

The voice image is extracted by extracting the fundamental frequency (f _f ) of the voice and arranging a circle proportionally proportional to the energy of the extracted fundamental frequency (E _ff ) in the center of the voice screen region and superimposing the waveform on the time axis of the voice on the circumference. . The background color of the screen is displayed in a color corresponding to the fundamental frequency f _f . Here, the color corresponding to the fundamental frequency f _f is obtained by using Equation (1).

Thus, call tone image data is formed (S142).

4-2. Emotional Index Image Formation

The emotional index is increased by the excitement, so the sound pressure and the fundamental frequency change eventually. Therefore, in the present invention, the emotional index is calculated based on the obtained energy value for each frame and the fundamental frequency.

Subsequently, the reference frequency f _r is determined using the fundamental frequencies f _f1 , f _f2 and f _f3 of the initial three frames. The reference frequency is determined by the average fundamental frequency f _fa of three frames.

The average reference frequency is determined as the average of the remaining two fundamental frequencies by discarding the fundamental frequency having the maximum value among the fundamental frequencies of the three frames.

If the obtained average value exists in the range of 80 to 600 Hz, the obtained average value is determined as the reference frequency. If the average value is out of the range, the lowest frequency of the two fundamental frequencies is discarded, and the remaining one fundamental frequency is determined as the reference frequency f _r .

When the reference energy E _r and the reference frequency f _r are determined as described above, the average energy AE _k and the average fundamental frequency f _ak are obtained in the next three frame units.

The rate of change of the average energy (E rate = AE _k / E _r ) obtained with respect to the reference energy (E _r ) is obtained.

The rate of change of the average fundamental frequency (f rate = f _ak / f _r ) obtained for the reference frequency is obtained.

The emotion index is determined according to the energy change rate and the change rate of the fundamental frequency.

When the emotion index is determined as described above, character data corresponding to the emotion index is read as shown in FIG. 18 to form an emotion index image (S144).

The type of emotion index character may be determined by a user's selection.

Emotional Index Energy change rate Frequency change rate 10 13 or more 1.2 ~ 3 9 11-13 8 9 ~ 11 7 7-9 6 6 ~ 7 0.8 ~ 2 5 5 ~ 6 4 4 ~ 5 3 3 ~ 4 2 0.7-3 0.7-1.5 One 0-0.7 0.1-1.2

4-3. Turbidity Index Image Formation

In the present invention, the negative turbidity is expressed in proportion to the saturation of the color. In other words, the clear sound approaches one fundamental frequency, but the muddy sound includes many harmonic frequencies as well as the fundamental frequency.

Therefore, in the frequency spectrum per frame, the clear sound has a smaller number of sampled frequencies, and the cloudy sound has a higher sampled frequency. Therefore, since the number of corresponding colors is increased by Equation (1) at each frequency, the more the mixture thereof is, the less saturated the mixed color is.

By using Equation (1), RGB data f ₁ (RGB), F ₂ (RGB), F ₃ (RGB), ... of the peak values sampled for each frame are obtained. The RGB values are multiplied by the energy of each peak value by a gain, and the sum of the RGB values is obtained to obtain the total RGB value every frame.

T (RGB) = e ₁ f ₁ + e ₂ f ₂ + e ₃ f ₃ + ...

Where the energy value is a normalized value between 0 and 1.

The sum RGB value is a mixture of all colors corresponding to each frequency and has chroma information of the corresponding frame. Therefore, the maximum value MAX and minimum value MIN of each R value, G value, and B value are calculated | required from a total RGB value. Find the sum (SUM) and difference (DIF) of the maximum and minimum values. The sum (SUM) is divided by 510 to obtain a luminance value (LUM).

If the maximum and minimum values are the same, the saturation is zero.

If the luminance value (LUM) is more than 0.5, the saturation is determined by dividing the difference value (DIF) by the sum value (SUM) .If the luminance value (LUM) is less than 0.5, the saturation is determined by the difference value (DIF) (510-sum value (SUM)). Determine by dividing by).

As shown in the following Table 3, the turbidity index of 10 steps is expressed corresponding to the saturation of 10 steps.

When the turbidity index is determined as described above, character data corresponding to the turbidity index is read as shown in FIG. 19 to form turbidity image data (S146). The type of the displayed character may be determined by the user's selection.

If the sound image, emotion index image, and turbidity image are formed as described above, the sound image converter 606 provides these images to the central processing unit 602 (S148), and the central processing unit 602 synthesizes these images. A display screen is formed as one display screen as shown in FIGS. 20 and 21 on the liquid crystal display panel (S150).

saturation Turbidity Index 0 to 0.1 -2 0.1 to 0.2 -One 0.2 to 0.3 0 0.3 to 0.4 One 0.4 to 0.5 2 0.5 to 0.6 3 0.6 to 0.7 4 0.7 to 0.8 5 0.8 to 0.9 6 0.9 to 1.0 7

Referring to FIG. 20, a voice waveform of a caller is displayed in a circle on a light purple background corresponding to a fundamental frequency (5 octave B scale) in a call tone display area, and a character corresponding to an emotion index 7 is shown in an emotion index display area. The character corresponding to zero turbidity is displayed in the turbidity index display area.

Referring to FIG. 21, a voice waveform of a caller is displayed in a circle on a dark purple background corresponding to a fundamental frequency (three octave B scale) in a call tone display area, and a character corresponding to an emotion index 7 is shown in an emotion index display area. The character corresponding to the turbidity +2 is displayed in the turbidity index display area.

It can be seen that the voice waveform of FIG. 21 is displayed larger than the voice waveform of FIG. 20. Therefore, the user can visually see the loudness of the other party, and it can be seen that the brightness is different due to the difference between 5 octaves and 3 octaves. In addition, it is possible to know whether the current emotional state of the other party is excited or calm state, it is possible to know whether the voice of the other party is muddy or muddy through the character and the index.

5. Another embodiment of video conversion of a call tone

Formant frequency information and pitch frequency information extracted in the decoding process of the vocoder 104 are provided to the sound image converter 606, and the color corresponding to the formant frequency and pitch is calculated by Equation (1). can do. In this case, it is not necessary to perform the FFT process in the image changing unit 606.

In the above description of the preferred embodiment of the present invention, the present invention is not limited thereto, and various modifications and changes can be made within the scope of the claims, the detailed description of the invention, and the accompanying drawings. Naturally, it belongs to the range of.

For example, the image change unit may be configured as software by implanting a program in the control unit, and may be chipped into a separate custom semiconductor, or the call sound image conversion unit may be implemented in hardware as a custom semiconductor together with the voice synthesis unit.

As described above, in the present invention, by displaying a ring tone, that is, a ringtone visually on the screen visually as well as audible in the mobile phone, it is possible to improve the merchandise by adding a new additional function to the mobile phone.

In addition, since the caller's voice can be imaged to display an image, and the caller's emotion or the turbidity of the voice can be displayed, it is possible to provide additional enjoyment to the mobile phone users and to improve the productability of the product.

Claims (21)

Receiving unit for receiving a call signal; A storage unit for storing ring tone information; A ring tone output unit for outputting the ring tone; A color display unit for displaying a color image; And When the call signal is received through the receiver, the call tone information is read from the storage unit, and the call tone information is generated through the call tone output unit in response to the read call tone information, and the read call tone information is analyzed in units of frames. And a control unit for acquiring and displaying a corresponding ring tone image on the color display unit in response to the acquired tone analysis information. The method of claim 1, wherein the ring tone information is information according to the composite sound mobile audio 2 format, and the control unit converts information such as program change, channel volume, panport, note, and channel message among the mobile audio 2 information into sound analysis information. And converting the image into image information such as image shape, size, x-axis position, color and y-axis position, and number in response to the acquired sound analysis information. The method of claim 1, wherein the ring tone information is voice information, and the control unit performs Fourier transform on the voice information, and analyzes pitch (base frequency), formant frequency, energy of each formant frequency, etc. from the Fourier transformed signal. And converting the image into image information such as color, number of images, y-axis position, and image size in response to the obtained sound analysis information. Receiving unit for receiving a call signal; A storage unit for storing ring tone information; A ring tone output unit for outputting the ring tone; A gradation display unit including an illumination unit and displaying gradation information; And When the call signal is received through the receiver, the call tone information is read from the storage unit, and the call tone information is generated through the call tone output unit in response to the read call tone information, and the read call tone information is analyzed in units of frames. And a controller configured to display an illumination color of the corresponding lighting unit in response to the acquired tone analysis information on the gray scale display unit. The method of claim 4, wherein the ring tone information is information according to the composite sound mobile audio 2 format, and the control unit obtains program change, channel volume, and note as sound analysis information among the mobile audio 2 information, and responds to the obtained sound analysis information. Call terminal, characterized in that for converting the lighting color control information of the lighting unit. 5. The apparatus of claim 4, wherein the ring tone information is voice information, and the controller performs a Fourier transform on the voice information, and analyzes a pitch (base frequency), formant frequency, energy of each formant frequency, etc., from the Fourier transformed signal. Obtaining the information and the call terminal, characterized in that for converting the illumination color control information of the lighting unit in response to the obtained sound analysis information. A handset for inputting and outputting a call tone; Transmitting and receiving unit for transmitting and receiving the call sound signal; A color display unit for displaying a color image; And Detect the input of the call tone signal through the handset or the transceiver, and output or transmit the input call tone signal through the handset or the transceiver and simultaneously analyze the input call tone signal to obtain tone analysis information And a control unit for displaying a call tone image corresponding to tone analysis information on the color display unit. The apparatus of claim 7, wherein the controller performs a Fourier transform on the call tone signal in units of frames, and obtains pitch (base frequency), formant frequency, energy of each formant frequency, and the like from the Fourier transformed signal as tone analysis information. And converting the image into image information such as color, number of images, y-axis position, and image size in response to the received sound analysis information. The method of claim 7, wherein the control unit obtains the energy of each frame from the call tone signal in units of frames, and performs Fourier transform to sound pitch (base frequency), formant frequency, energy of each formant frequency, etc. from the Fourier transformed signal. And determining the emotion index of the speaker in response to the obtained tone analysis information and displaying character information corresponding to the determined emotion index on the color display unit. 10. The apparatus of claim 9, wherein the controller calculates a speaker's reference energy and reference frequency based on the energy and pitch information, calculates an average energy and an average fundamental frequency in units of a predetermined time, and calculates the reference energy and the reference frequency. Call terminal, characterized in that for determining the emotional change of the speaker according to the change rate of the average energy and the average fundamental frequency. The method of claim 10, wherein the reference frequency From the call sound detection, the maximum of the average fundamental frequencies of the first three frames is discarded and set as the average of the remaining two average fundamental frequencies. Call terminal, characterized in that. 11. The terminal of claim 10, wherein the previous time unit is three frames. The method of claim 7, wherein the control unit obtains the energy of each frame from the call tone signal in units of frames, and performs Fourier transform to sound pitch (base frequency), formant frequency, energy of each formant frequency, etc. from the Fourier transformed signal. And determining the turbidity index of the speaker in response to the obtained sound analysis information and displaying character information corresponding to the determined turbidity index on the color display unit. The terminal of claim 13, wherein the controller calculates the saturation of the integrated color per frame and calculates the turbidity in proportion to the obtained saturation level. In a communication terminal including a color display unit for generating a ring tone when receiving a call signal or in response to a call key input, Reading ring tone data; Extracting tone analysis information of a ring tone according to a format of the read ring tone data; Forming color image data corresponding to the read tone analysis information; And And displaying the color image data as a color image on the display unit of the call terminal in synchronization with the output of the call tone. In the call terminal comprising a lighting unit of the display unit and generating a ring tone in response to receiving a call signal or in response to a call key input, Reading ring tone data; Extracting tone analysis information of a ring tone according to a format of the read ring tone data; Forming illumination control data corresponding to the read sound analysis information; And And controlling the illumination color of the illumination unit of the display unit of the call terminal in response to the illumination control data. In a communication terminal including a color display unit, Receiving call tone data of the other party; Extracting tone analysis information of a call tone from the received call tone data; Forming a call tone image corresponding to the read tone analysis information; And displaying the call tone image as a color image on the color display unit in synchronization with the output of the call tone. 18. The method of claim 17, wherein the forming of the call tone image comprises obtaining the energy of each frame from the call tone data in units of frames, and performing Fourier transform to perform a Fourier transform on the pitch (base frequency), formant frequency, and energy of each formant frequency. And acquiring the back as the tone analysis information, and determining the emotion index of the speaker in response to the obtained tone analysis information, and displaying character information corresponding to the determined emotion index on the color display unit. Call sound image display method. 18. The method of claim 17, wherein the step of forming the voice tone data comprises obtaining the energy of each frame from the call tone data on a frame-by-frame basis, and performing Fourier transform to perform energy of a pitch (base frequency), formant frequency, and each formant frequency from the Fourier transformed signal. And acquiring, etc. as sound analysis information, and determining the speaker's turbidity index in response to the obtained sound analysis information, and displaying character information corresponding to the determined turbidity index on the color display unit. Call sound image display method of the call terminal. 18. The method of claim 17, wherein the forming of the call tone image comprises obtaining the energy of each frame from the call tone data in units of frames, performing Fourier transform to obtain a pitch (base frequency) from the Fourier transformed signal, and obtaining a color corresponding to the obtained fundamental frequency. And displaying the waveform of the call sound in a circular shape on the background color, and displaying the waveform in the color display part such that the circular size is proportional to the volume. A handset for inputting and outputting a call tone; Transmitting and receiving unit for transmitting and receiving the call sound signal; A color display unit for displaying a color image; And Detects the input of the call tone signal through the transceiver, outputs the input call tone signal to the handset, acquires formant frequency information and pitch information in the decoding process of the input call tone signal, and obtains the formant frequency. And a control unit for displaying a call tone image corresponding to the information and the pitch information on the color display unit.