KR20060136103A - system for musical education - Google Patents

Abstract

The present invention provides an interactive multimedia music education system capable of self-learning. When the learner selects a score, the performance data programmed into the computer is played back, indicating the flow of the score. While the student plays the instrument while viewing the score on the computer screen, the instrument plays the instrument and saves it as a file. Using digital signal processing technology, the stored performance data is compared with the performance data programmed in the computer to discriminate the accuracy of the pitch and beat, and to mark out the error range. The present invention is a multimedia music education system that allows the learner to recognize the error of the performance sound to learn the ability to perform accurate performance by repeatedly learning the weak part.

STFT, instrument sound, music education learning

Description

Music Teaching System {system for musical education}

1 is a functional diagram of the entire system of the present invention.

2 is a flow chart schematically showing the operational sequence of the present invention.

<Description of the symbols for the main parts of the drawings>

10: score display unit

20: Check Process

30: performance evaluation unit

40: storage medium

50: input / output unit

51: headset

52: microphone

60: signal processing unit

The present invention is an interactive multimedia music education system, and more specifically, a learner samples a musical instrument played through a computer, and applies STFT (Short Time Fourier Transform) to the sampled musical instrument, and the pitch in the learner's performance. It is a repetitive learning system that discerns the beat's accuracy so that the pitch and beat can be played accurately to the score.

This system is the most important core of music education that is learned through user-computer interaction in terms of educational engineering for improving cognitive learning ability.

Unlike other educational markets, the music education market has the advantage of having few learners leaving and having continuous learning and continuity of learning. Music, unlike other educational markets, can consistently attract quality customers in terms of clear and fun motivation for learning.

The system for music education of the present invention is not only aimed at institutional education, but also includes young people in their 3s and 40s with some economic stability.

In particular, this class has a strong cultural desire that has not been achieved in the past, but educational media that use computers that can be studied anytime and anywhere are most suitable due to time constraints due to busy social life.

The present invention provides a music education system that allows the learner to autonomously learn music by selecting a music to learn by themselves using a computer without the help of an institute or a teacher, and judging and correcting his / her ability through a comparative analysis. The purpose is.

Another technical problem to be achieved by the present invention is to finally learn the vulnerable parts by recognizing the pitch and beat by using digital signal processing technology to learn the learner while watching the sheet music displayed on the screen to make the learner recognize it. The purpose is to acquire the ability to play accurate music.

According to the present invention, the learner plays along with the accompaniment of the built-in sound source according to the flow of the colored music on the monitor, and the performance is input to the computer and checked in the check module of the pitch and beat, and the part outside the error range is different in color. It is colored to enable the feedback of the vulnerable parts. The present invention is to classify the accuracy of the pitch by sampling the instrument sound played by the learner and applying the Short Time Fourier Transform to the sampled instrument sound by applying a complex technique of discriminating the accuracy of the beat in the learner's performance It provides an iterative learning system that allows you to play the piano correctly to the score.

1 is a functional diagram of the entire system of the present invention. As shown

A score display unit 10 for displaying a part to be played currently according to a user's selection, displaying an evaluation result output from the check process unit 20, and displaying a wrong part on the score;

A check process unit 20 for checking the wrong part of the pitch and beat by comparing the performance data stored in the storage medium unit 40 with the data of the actual instrument performance;

A performance evaluation unit 30 for displaying the evaluation result stored in the storage medium unit 40;

A storage medium unit 40 for storing the programmed performance data and the actual instrument performance data and storing the evaluation result output from the check process unit 20;

An input / output unit 50 for inputting performance data played by a user through a sound card and reproducing stored performance data;

And a signal processor 60 for recording the performance data input from the input / output unit 50 and reproducing the stored accompaniment sound and the recorded data.

The score display unit 10 displays the score on the computer screen, and displays the part to be played every hour by distinguishing and displaying 11 the color on each note. In addition, the time information and the pitch information is used as a criterion of the time signature and pitch check after the performance evaluation (21). When playing the performance sound recorded after the end of the performance, the part played differently from the score is displayed separately (12).

The signal processing unit 60 selectively plays back the accompaniment sound 61 through the headset 51 to the performer, and records the musical instrument played by the learner through the microphone 53 (62) and saves it as a file (43). The pitch is analyzed 22 based on the STFT. The pitch analysis information of the hour is stored 42 together with the time information and is also transmitted to the performance evaluation unit 31.

The check process portion 20 uses the STFT to determine the pitch and time information 21 of the notes to be played provided by the score display section 10 and the pitch information 43 of the notes played at each time analyzed by the signal processor 60. Comparing (22) and checking (22) and storing (42) whether a pitch has been entered within the error range for the period from the beginning to the end of the current data, and determining and displaying the level of the performance after the end of the performance (12). To check the accuracy of the beat, the time reference signal included in the accompaniment sound is detected by STFT and the beat accuracy is checked by comparing the pitch information analyzed every 10m / sec.

In the performance evaluation section 30, the recorded performance is displayed differently from the actual score while the recorded performance is played after the performance is finished (12) so that the user can simultaneously observe the performance data being played and the sheet music data to be played and recognize the wrong portion. help.

2 is a flowchart showing an operation procedure of the present invention.

When fingering is selected, the fingering output step 210 describing the instrument fingering according to each note and step 220 where the song name selection menu is displayed when the song name is selected, and fingering that shows the fingering for the notes on the score If you select the indicator output step 230 and listening to the song, the performance song output step 240 for playing the performance sound corresponding to the selected song and playing with the accompaniment, if you select the accompaniment sound of the selected song and the learner's performance sound is wrong It includes the evaluation step 250 to mark the point.

The fingering output step 210 includes a step 211 in which a sound selection menu is displayed and a fingering 212 for the sound selected in the step 211.

The fingertip output step 230 consists of a fingertip output step 231 showing fingerings for each note of the selected sheet music at a time.

The performance song output step 240 includes a performance song output step 241 for reproducing programmed performance data corresponding to the selected song.

The evaluation step 250 includes a corresponding accompaniment sound output step 251 for reproducing the accompaniment sound and a user performance sound score display step 252 for analyzing the play sound of the learner and displaying the score in the score, and the step 251 after the end of the performance. 252), a mismatched part display step 253 for displaying the wrongly played part on the score.

As described above, the present invention distinguishes pitch and beat by using digital signal processing technology to allow a learner to easily detect a wrong part in the performance, to judge his / her ability and to repeatedly learn the weak part, thereby finally performing accurate performance. Provides the effect of learning the ability to do so.

Claims (9)

A signal processing unit for extracting time information and pitch of the actual instrument performance data recorded through the microphone, and acoustically reproducing the performance data stored in the storage medium; A storage medium unit for storing performance data and evaluation results for each song; A check process unit for comparing a play data stored in the storage medium unit with data of a real instrument performance and checking a mismatched portion; A performance evaluation unit which is checked by the check process unit and displays the evaluation result stored in the storage medium unit; The music is characterized by including a sheet music display unit for outputting the sheet music to be played according to the user's selection, displaying the sheet music status of the performance sound according to the evaluation result stored in the storage medium, and displaying the wrong part on the sheet music during the performance. Teaching system. The method of claim 1, wherein the storage medium portion A music teaching system further comprising basic sound data necessary for playing performance data. The method of claim 1 or 2, wherein the storage medium portion Music teaching system, characterized in that embedded in a separate auxiliary storage device such as CD-ROM title. The musical score display unit of claim 1, wherein And a means for displaying the actual instrument performance data state in the form of sheet music, and displaying the basic sound of the performance data as the score, and if the pitch and beat of the basic performance data and the actual instrument performance data do not match. Music Teaching System. A performance song output step of displaying and outputting stored performance data when the performance song is selected; A fingering output step of displaying a fingering of the selected sound if fingering is selected; Selecting a finger index and displaying a finger index on the score of the selected song; When the evaluation is selected, the music teaching system comprising an evaluation step of displaying the wrong point by comparing the performance data of the instrument of the learner with the learner. The method of claim 5, wherein the music output step, Selecting a song name in the step of outputting the score of the corresponding song of the instrument on the monitor; A music teaching system comprising the steps of outputting the corresponding song through the speaker. The method of claim 5, wherein the fingering output step, When the sound is selected in the step, the music teaching system comprising the step of displaying the fingering of the sound on the screen. According to claim 5, Fingering table output step, When the music name is selected in the step, the music teaching system comprising the step of displaying the fingering of the song in the form of music notation on the screen. The method of claim 5, wherein the evaluation step, Displaying the score of the corresponding song on the display screen when the song name selection is completed in the step; Displaying a portion of the sheet music on which the current performance should be performed; Analyzing and displaying the performance data played by the learner on the score; A music learning system comprising the steps of displaying a part played incorrectly after a performance ends.

Images