KR100755824B1 - Apparatus of song-game for detecting pitch accuracy - Google Patents

Abstract

An apparatus for detecting the precision of a musical pitch is provided to output audio data in a music game, extract a frequency from voice data input from a user, and compare the frequency of the user with a frequency of melody data included in the audio data, thereby visually expressing the precision of a musical pitch. An apparatus for detecting the precision of a musical pitch includes a storing unit(11), a key input unit(12), an audio signal input unit(14), a voice frequency extracting unit(15), a control unit(17), and a display(13). The storing unit(11) stores audio data, and a selection number and video data corresponding to the audio data. The key input unit(12) receives the selection number. The audio signal input unit(14) receives an audio signal in a music game. The voice frequency extracting unit(15) extracts a voice frequency of a user from the audio signal from the audio signal input unit(14). The control unit(17) determines the movement of the first item of the music game according to the absolute pitch of the audio data and determines a movement direction of the second item of the music game by comparing the voice frequency of the user with a frequency of melody data included in the audio data. The display(13) provides a screen image synchronizing with the audio data, displays the movement of the first item according to the absolute pitch of the audio data, and marks the position of the second item according to information about a movement direction obtained from the control unit(17) on corresponding coordinates, thereby displaying the precision of a musical pitch.

Description

Song game apparatus having pitch accuracy detection function {Apparatus of song-game for detecting pitch accuracy}

1 is a configuration diagram of an embodiment of a song game device having a pitch accuracy detection function according to the present invention;

2 is a flowchart illustrating a method of detecting pitch accuracy in a song game apparatus according to the present invention;

3 is a diagram illustrating an embodiment of a song accompaniment / music performance service having a pitch accuracy detection function according to the present invention.

<Explanation of symbols for main parts of the drawings>

11: storage unit 12: key input unit

13 display unit 14 audio signal input unit

15: voice frequency extraction unit 16: audio signal output unit

17: control unit

The present invention relates to a song game apparatus having a pitch accuracy detection function, and more particularly, to a song game apparatus capable of pitch learning by detecting the accuracy of a pitch through a song game in a computer, a notebook, a portable terminal, and the like.

First, terms used in the present invention are defined as follows.

Melody (frequency band 100 ~ 6000Hz) means the sound that expresses the singer's voice as the instrument's sound, accompaniment (frequency band 20 ~ 20000Hz) means various sounds except the melody and the singer's voice (Frequency band is 20 to 20000 Hz) means a sound including melody, accompaniment, chorus and singer voice.

In addition, the audio data includes melody data and accompaniment data, AC3 (Audio Codec code 3), ADPCM (Adaptive Differential Pulse Code Modulation), PCM (Pulse Code Modulation), MP3 (MPEG Audio Layer-3), MIDI (MIDI: Musical) Data in audio format such as Instrument Digital Interface.

Generally speaking, accompaniment / musical performance refers to the sound of various musical instruments and specific sounds to help the singer.In addition to the development of electronics, accompaniment performed by many people through electronic processing devices is an electronic device. Has become a substitute.

Such an apparatus (electronic device) provides accompaniment by combining and signaling a specific song by digitizing sound source waveforms that digitize sound elements such as musical instruments constituting an accompaniment that does not contain human voice. In addition, by displaying the background image and the lyrics in accordance with the song accompaniment through the display means such as CRT on such a device, it is easy to see the karaoke that provides the service by encouraging the singer to check the lyrics. In addition, the song accompaniment / music performance function has become possible in the computer (PC), notebook, etc. due to the development of the network.

In general, at any frequency a frequency above one octave is about twice that frequency, and a frequency below one octave is about one half that frequency.

That is, since an octave consists of 12 notes, the 12th note is obtained by multiplying an arbitrary reference frequency by 1.06, and multiplying the result by 1.06 again, so that the note is one octave higher (the frequency is equal to the reference frequency). About twice).

Using these negative rules, MIDI uses the term note to express the height or frequency of a note numerically. Thus, notes expressed in MIDI can be converted to frequencies immediately. At this time, one note and the adjacent note is a semitone difference.

In this MIDI, all notes are represented by 128 (about 10.7 octaves), so the frequencies corresponding to these 128 notes can be measured and used for various purposes.

On the other hand, the melody data in the MIDI data includes note, velocity, and duration information. Here, the note is a numerical value corresponding to the height of the note, which is very easy to convert to frequency. Velocity represents a numerical value corresponding to the intensity of sound. The duration is a numerical value representing the negative duration and can be used for the time signature test. Of course, this information may be represented in other ways than MIDI.

Meanwhile, in the conventional song accompaniment / music performance apparatus, when the accuracy of the pitch is detected, the melody is directly extracted from the output music, the frequency is measured, and the accuracy of the pitch is detected by comparing with the user's voice frequency.

However, the actual music includes melody, accompaniment, chorus, and singer's voice, and it is not easy to extract only the melody having a frequency band such as the singer's voice.

Therefore, in the conventional song accompaniment / music performance, the accuracy of the pitch detection method has a problem that can not extract the melody efficiently.

In addition, the conventional method has a problem in that it is not possible to measure the pure melody frequency because it is not possible to extract the exact melody can not detect the accuracy of the correct pitch.

As such, since the pitch cannot be accurately detected through the conventional method, there is a problem in that it cannot be applied to a song game of pitch learning. Pitch learning game is expected to be able to combine education and entertainment of interest by providing usefulness to meet educational purpose.

The present invention has been proposed to solve the above problems, and an object thereof is to provide a song game apparatus capable of detecting the accuracy of a pitch through a song game of pitch learning in a computer, a notebook, a portable terminal, and the like.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided a song game apparatus having a pitch accuracy detection function, comprising: storage means for storing audio data and a song number and song game image data corresponding to the audio data; Key input means for receiving a selection number; Audio signal input means for receiving an audio signal during a song game; Voice frequency extraction means for extracting a user's voice frequency from the audio signal received through the audio signal input means; The movement of the first item of the song game is determined according to the absolute pitch of the audio data, and the voice frequency of the user extracted by the voice frequency extraction means is compared with the frequency of the melody data included in the audio data. Control means for determining a movement direction of a second game item of the song game; And under the control of the control means, provide a song game screen synchronized with the audio data, display the movement of the first game item according to an absolute pitch (pitch) of the audio data, and move from the control means. And display means for displaying the second game item on the position of the corresponding coordinates according to the direction information to display the accuracy of the pitch.

In this case, the audio data may include melody data in a MIDI format, and the melody data may include sound height information (frequency) and sound duration information.

Herein, the control means may compare the voice frequency of the user extracted by the voice frequency extraction means with the frequency of the melody data included in the audio data so that the accuracy of the pitch can be detected and the score can be calculated in real time.

The song accompaniment / music performance service device may be applied to any one of a video game device, a computer, a notebook, and a portable terminal.

On the other hand, in the song game apparatus according to an embodiment of the present invention, a method of detecting accuracy of a pitch includes: storing audio data and a song game program; Providing a song game screen synchronized with the audio data according to a user's request; Extracting a user's voice frequency from the audio signal in response to receiving an audio signal during a song game; The movement of the first item of the song game is determined according to the absolute pitch of the audio data, and the voice frequency of the user extracted by the voice frequency extraction means is compared with the frequency of the melody data included in the audio data. Determining a moving direction of a second game item of the song game; And display the movement of the first game item according to the absolute pitch of the audio data, and display the second game item at the position of the corresponding coordinate according to the movement direction information to display the accuracy of the pitch. Characterized in that it comprises a step.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of a song game apparatus having a pitch accuracy detection function according to the present invention.

In the song game apparatus having a pitch accuracy detection function according to the present invention, when a user (gamer) who wants to learn the basic pitch (pitch) through a song game utters (pitches) the pitch (pitch) through a song game, It automatically moves the game item to the coordinates corresponding to the pitch (pitched pitch) spoken through the frequency analysis of the absolute sound.

However, a song game apparatus having a pitch accuracy detection function according to the present invention is a video game device such as a game boy, wonder swan, game cube, playstation, xbox, portable small electronic entertainment device or computer, laptop, portable terminal. (Mobile communication terminals, PDAs, portable Internet terminals, etc.), it should be noted that the game through the pitch recognition as long as possible, regardless of its kind.

As shown in FIG. 1, a basic configuration of a song game apparatus having a pitch accuracy detection function according to the present invention will be described. Selection data and video data corresponding to audio data and audio data (particularly, video data of a song game) A storage unit 11 for storing the data, a key input unit 12 for receiving a selection number from the user, and image data stored in the storage unit 11 under the control of the controller 17 (video of a song game) Extracts a user's voice frequency from a display unit 13 for displaying data), an audio signal input unit (microphone, etc.) 14 for receiving an audio signal, and an audio signal input through the audio signal input unit 14 The audio frequency extracting unit 15 and the audio frequency stored in the storage unit 11 and the voice frequency of the user extracted by the audio frequency extracting unit 15 are included. Comparing the melody data to a control unit (17) for indicating the accuracy of the pitch and control (e.g., move a game item).

Here, the audio data (eg, MIDI data) may include melody data, and the melody data may include sound height information (frequency), sound intensity information, and sound duration information.

The storage unit 11 also stores a song game, and can also store and manage audio data by genre, singer, new song, country, and gender (male / female).

In particular, the controller 17 outputs the audio of the user input through the audio signal input unit 14 and the audio data stored in the storage unit 11 and the corresponding image data (the image data of the song game) together. The signal output unit 16 and the display unit 13 are controlled. In addition, the controller 17 controls the display unit 13 to display, in real time, the accuracy information of the detected pitch (that is, the number of times of allowing a goal).

That is, the controller 17 may detect the accuracy of the pitch by comparing the voice frequency of the user extracted by the voice frequency extractor 15 with the melody data included in the audio data stored in the storage 11. The accuracy of the pitch is then visually applied to the song game.

For example, when a user sings through a song game, the pitch of the speech is automatically displayed through the frequency analysis of the absolute sound and the absolute pitch of the song is displayed on the screen.

At this time, as an example of the screen display method, as shown in Figure 3, the item (eg, soccer ball) 31 of the system (Kicker) is moved in accordance with the absolute pitch (pitch) of the song, the user The user's item (Goal Keeper) 32 is moved according to the utterance pitch of the user.

Therefore, during a song game, if the pitch (pitch) is correct, the goalkeeper 32 may block the soccer ball 31 to avoid the mistake, and if the pitch (pitch) is incorrect, the goal is allowed. Play the song game in this way, but if the actual time exceeds the reference value, the penalty is performed. For example, the kicker (virtual person of the system, for example, 'No Hyunjung') hits the goalkeeper (user's goalkeeper, for example, 'Kim Jae-dong') with a hammer and outputs the voice 'try'.

In this way, the controller 17 compares the voice frequency of the user extracted by the voice frequency extraction unit 15 with the melody data included in the audio data stored in the storage unit 11, and based on the result of the pitch analysis, the game. The left and right moving directions of the item 32 in FIG. 3 are determined and notified to the display unit 13. Of course, it should be noted that in other game applications, the movement direction can be moved not only in the left and right directions, but also in the up, down, left and right coordinate values.

The display unit 13 displays the game item (32 in FIG. 3) at the corresponding coordinates based on the moving direction information (coordinate value) of the controller 17.

In summary, the controller 17 determines the movement of the first item (31 in FIG. 3) of the song game according to the absolute pitch (audio pitch) of the audio data, and determines the voice frequency of the user extracted by the voice frequency extractor 15. The moving direction of the second game item 32 of FIG. 3 is determined by comparing with the frequency of the melody data included in the audio data. Then, under the control of the control unit 17, the display unit 13 provides a song game screen synchronized with the audio data, and moves the first game item (31 in FIG. 3) according to the absolute pitch (pitch) of the audio data. Is displayed on the screen, and the second game item (32 in FIG. 3) is displayed on the screen at the position of the corresponding coordinate according to the movement direction information from the controller 17 to display the accuracy of the pitch.

For reference, the process of analyzing the pitch in the controller 17 will be described. For example, an autocorrelation method, a cepstrum method, a simple inverse filtering tracking (SIFT) hybrid method, or Korean Patent Application Publication No. 10-2004-10774 (name of the invention: a sound quality education service using a communication network) The pitch can be extracted and analyzed by various techniques, such as those shown in Method).

First, in response to an input of a music selection number from a user through the key input unit 12, the storage unit 11 selects corresponding audio data and outputs the audio data in synchronization with the corresponding video data (video data of a song game).

Then, the voice frequency of the user is extracted from the audio signal received through the audio signal input unit 14 using the voice frequency extractor 15.

The accuracy of the pitch is detected by comparing the extracted voice frequency with the height information (frequency) of the corresponding melody data.

To illustrate this with an example, first assume that the frequency of any reference sound is 2000 Hz (6 octaves).

Then, the frequency under one note is 2000Hz / 1.06 = 1880Hz, and the frequency above one note is 2000Hz * 1.06 = 2120Hz. At this time, the frequencies related to the octave of the reference sound are 62.5 Hz (1 octave), 125 Hz (2 octaves), 250 Hz (3 octaves), 500 Hz (4 octaves), 1000 Hz (5 octaves), 2000 Hz (6 octaves), 4000 Hz (7 Octave), 8000 Hz (8 octaves), 16000 Hz (9 octaves), and the like. Here, since the value (1.06) is an approximation, there may be a slight error.

When the frequency component extracted from the input voice is about 2000 Hz, there is no change in octave (6 octaves), and the difference is compared based on 2000 Hz.

On the other hand, when the extracted frequency component approaches one octave of several octaves, it compares how different the octaves are.

As a result of comparison, the smaller the difference, the more accurate the pitch.

The controller 17 determines the moving direction of the game item 32 in FIG. 3 based on the result of the pitch analysis and informs the display unit 13.

Meanwhile, the controller 17 may calculate the score in real time using the accuracy of the pitch.

Looking at this in more detail, first, as the music selection number is input from the user through the key input unit 12, the storage unit 11 selects the corresponding audio data and outputs it in synchronization with the corresponding image data.

Then, the voice frequency of the user is extracted from the audio signal received through the audio signal input unit 14 using the voice frequency extractor 15.

The controller 17 calculates a score by detecting the accuracy of the extracted voice frequency according to the corresponding melody data in the audio data stored in the storage 11.

That is, it is first determined whether the voice is input at the time of the voice input by using the negative delay time information (duration) of the corresponding melody data.

As a result of the determination, if the user's voice was input at the time of the voice input, it means that the beat was corrected. Therefore, the frequency was extracted from the user's voice and compared with the frequency of the melody data (sound height information) to detect the accuracy of the pitch. Assign corresponding scores.

As a result of determination, if the user's voice is not input at the time of the voice input, since the beat is wrong, the score is not assigned.

In addition, corresponding scores may be allocated using negative intensity information of the melody data. That is, the score may be allocated according to the accuracy of the voice of the user compared with the voice information of the melody data.

2 is a flowchart illustrating a method of detecting accuracy of a pitch in a song game apparatus according to the present invention.

First, audio data (eg, MIDI data) and a song game are stored in the storage unit (201).

Thereafter, when the song game is executed, the voice frequency is extracted according to the input of the audio signal (202 and 203).

Next, the accuracy of the pitch is detected by comparing the frequency of the corresponding melody data in the stored audio data with the extracted voice frequency (204). At this time, the accuracy of the pitch is visually applied to the song game. For example, when a user sings through a song game, the pitch of the speech is automatically displayed through the frequency analysis of the absolute sound and the absolute pitch of the song is displayed on the screen. In this case, as an example of a screen display method, as shown in FIG. 3, the item (eg, soccer ball) 31 of the system Kicker is moved according to the absolute pitch (pitch) of the song, and the user is moved. By allowing the user's item (Goal Keeper) 32 to be moved according to the utterance pitch of the utterance, if the pitch is correct during the song game, the goalkeeper 32 may block the soccer ball 31 to avoid a mistake. If the pitch is wrong, the goal is allowed.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

As described above, the present invention outputs audio data during a song game, thereby extracting a frequency from a voice input from a user, and visually expressing the accuracy of a pitch by comparing the frequency of the corresponding melody data included in the audio data.

As a result, a visual comparison between the pitch information input by the user and the reference pitch information can be performed, thereby improving the user's pitch (feel) more efficiently.

In addition, there are additional effects, such as being able to achieve both goals of play and pitch education at the same time.

Claims (6)

Storage means for storing audio data and song number and song game video data corresponding to the audio data; Key input means for receiving a selection number; Audio signal input means for receiving an audio signal during a song game; Voice frequency extraction means for extracting a user's voice frequency from the audio signal received through the audio signal input means; The movement of the first item of the song game is determined according to the absolute pitch of the audio data, and the voice frequency of the user extracted by the voice frequency extraction means is compared with the frequency of the melody data included in the audio data. Control means for determining a movement direction of a second game item of the song game; And Under the control of the control means, a song game screen synchronized with the audio data is provided, and the movement of the first game item is displayed on the screen according to the absolute pitch (pitch) of the audio data, and the direction of movement from the control means. And display means for displaying the second game item on the screen at the position of the corresponding coordinate according to the information to display the accuracy of the pitch. Song game device having a pitch accuracy detection function, which is applied to any one of a video game machine, a computer, a notebook, a portable terminal. The method of claim 1, The audio data includes melody data of the MIDI format, And said melody data includes pitch height information (frequency) and pitch duration information. The method of claim 1, The control means, A pitch accuracy detection function, characterized in that the voice frequency of the user extracted by the voice frequency extracting means is compared with the frequency of the melody data included in the audio data to detect the accuracy of the pitch and calculate the score in real time. Song game device having a. delete delete delete

Images