KR20160101355A - Apparatus and method for providing a personalized training program based on analysis of playing pattern - Google Patents

Abstract

Provided is a device for providing a personalized training program based on the analysis of the playing pattern of a musical instrument player. The device for providing a personalized training program comprises: an analysis part for analyzing at least one characteristic value among tones, rhythm, tone colors, intensity, the whole tempo of music and playing proficiency based on the result of matching a reference data sequence, which has been generated by digitalizing either or both of a music score of interest and a sound wave to be achieved, and an input data sequence, which has been generated by digitalizing the playing sound wave of a player; and a guide part for providing a training program depending on the characteristic value. The analysis part can conduct at least one analysis among a basic analysis for representing the performance of the playing sound wave, a playing characteristics analysis for representing a personal playing habit caused by repeated errors, a playing level analysis for representing the degree of playing proficiency and a played musical instrument analysis for representing a playing pattern in consideration of the characteristics of a played musical instrument.

Description

[0001] APPARATUS AND METHOD FOR PROVIDING A PERSONALIZED TRAINING PROGRAM BASED ON ANALYSIS OF PLAYING PATTERN [0002]

The present invention relates to a technique of providing a customized training program based on analysis of a performance pattern of a musical instrument player, and more particularly to a method of analyzing a performance pattern of a musical instrument player through sonic analysis and providing a customized training program for performance improvement .

In general, a performance pattern analysis technique based on a sound wave analysis is a technique of comparing a sound source file stored in a digital file form with a performance file input from a performer, and providing the matching result. For example, the performance file of the player is matched based on the sound file stored in the form of a digital file, and the performance of the performance file is determined based on the degree of match of the pitch, beat, and intensity.

However, the existing performance pattern analysis is merely to provide electronic musical score using a digital sound source file, or to provide a result of simple musical score tracking and pitch analysis. Since it is limited to simple discrimination as to whether the performer has played with a music rack, there is a limitation in improving the performance of the performer. The training process also provides a more efficient training direction by analyzing the player's skill level and performance habits, since it is merely a simple repetition of the same music file stored or a predetermined program in a predetermined order regardless of the level of the player. I need to give.

According to one aspect of the present invention, there is provided a musical composition including at least one of a pitch data, a tone data, a pitch, a tempo, and a musical performance level based on a result of matching a reference data sequence obtained by digitizing at least one of a target musical score and a target sound wave, And a guide unit for providing a training program according to the feature value, wherein the analyzing unit is configured to perform a basic analysis of performance of a sound wave, a personal analysis There is provided an apparatus for providing a customized training program for analyzing at least one of analysis of performance characteristics, analysis of performance level indicating the degree of performance of a performance, and analysis of a performance musical instrument showing a performance pattern in consideration of characteristics of the performance musical instrument.

FIG. 1 is a block diagram illustrating an apparatus for providing a customized training program based on performance pattern analysis according to an embodiment.
2 is a view for explaining a performance pattern analysis process according to an embodiment.
3 is a diagram illustrating a target score according to an exemplary embodiment.
FIG. 4 is a diagram illustrating a result of a performance file matching analysis according to an exemplary embodiment.
FIG. 5 is a diagram illustrating a performance pattern analysis result according to an embodiment.
6 is a diagram illustrating a customized training program provided in accordance with an embodiment.
7 is a flowchart illustrating a method of providing a customized training program based on performance pattern analysis according to an exemplary embodiment.

In the following, some embodiments will be described in detail with reference to the accompanying drawings. However, it is not limited or limited by these embodiments. Like reference symbols in the drawings denote like elements.

Although the terms used in the following description have selected the general terms that are widely used in the present invention while considering the functions of the present invention, they may vary depending on the intention or custom of the artisan, the emergence of new technology, and the like.

Also, in certain cases, there may be terms chosen arbitrarily by the applicant for the sake of understanding and / or convenience of explanation, and in this case the meaning of the detailed description in the corresponding description section. Therefore, the term used in the following description should be understood based on the meaning of the term, not the name of a simple term, and the contents throughout the specification.

1 is a block diagram illustrating an apparatus 100 for providing a customized training program based on performance pattern analysis according to an embodiment.

The performance pattern analysis based personal training program providing apparatus 100 may include a database unit 110, a collection unit 120, an analysis unit 130, and a guide unit 140.

The database unit 110 may digitize at least one of the target score and the target sound wave and store the digitized data as a reference data sequence. The target musical score refers to information about a musical score of a music piece to be played, and the target sound wave refers to performance file information of a musician or an expert who played the music.

The collecting unit 120 may collect an input data sequence in which a player's playing sound wave is digitized. The playing sound wave can be used for pattern analysis by digitizing a performance file inputted from a player in real time or can be collected by digital conversion of a performance file of the player stored in advance.

The analysis unit 130 may compare and match the reference data sequence stored in the database unit 110 with the input data sequence collected in the collection unit 120. Based on the matching result, the analyzer 130 may analyze at least one feature value among a pitch, a beat, a tone, a pitch, a tempo of the entire song and a musical performance.

In addition, the analyzer 130 may provide analysis results by various methods such as basic analysis, performance analysis, performance level analysis, and performance instrument analysis based on the matching result. The basic analysis is a result of determining the performance of the playing sound wave, and the performance characteristic analysis is a result of determining a personal playing habit based on the repeated error of the player. The performance level analysis is a determination result of the degree of skill of the player, and the performance musical instrument analysis is an analysis result of a performance pattern in consideration of the characteristics of the musical instrument played by the player. The analyzer 130 may perform at least one of basic analysis, performance analysis, performance level analysis, and performance instrument analysis according to a player's selection.

The guide unit 140 may provide a customized training program for the player based on the analysis result of the feature value of the analyzer 130. [

The personalized training program providing apparatus 100 not only determines whether or not the performance has been performed in accordance with the pitch or pitch of the target sound wave or the like, but also grasps the performance characteristics and the level of the performer through analyzing the performance pattern of the performer, The user can provide a training program for supplementing the weak part of the player. In addition, analyzing two or more playing sound waves for the same piece of music can analyze the player's playing habits and performance patterns, and can provide a customized training program by moving away from simple repetition training.

2 is a view for explaining a performance pattern analysis process according to an embodiment.

The personalized training program providing apparatus 100 analyzes and reports a pattern of a musical instrument performance and presents a customized training program based on the analysis result. The personalized training program providing apparatus 100 collects and analyzes sound waves of the musical instrument performance to determine whether or not the musical instrument has been played Analysis of the performance pattern can provide analysis results on the improper playing habits of the performer and a training program that can complement them.

To this end, the personalized training program providing apparatus 100 performs the sound wave collection 210 and the score analysis 220. In the case of the sound wave collection 210, the player's sound wave 201 played by a player using a musical instrument and the target sound wave 202 related to the performance of a musician or an expert targeted by the player are converted into a digital file format and collected Means that. The musical score analysis 220 refers to a task of storing musical score related information of a musical piece to be played by a player in a digital format.

The operator sound wave 201 of the sound wave collected data 210 is matched to the reference sound data 202 as a result of the target sound wave 202 or the score analysis 220 as an input data sequence. In this sound wave matching process, the input data sequence for the player sound wave 201 is matched with the reference data sequence, which is at least one of the result of the target sound wave 202 and the score analysis 220, , The pitch, the tempo of the entire song, and the skill of the player.

Based on the result of the sound wave matching 230, the personalized training program providing apparatus 100 determines whether or not the player has played only the score or the target sound wave, Level. In the case of the performance pattern analysis 240, it may be performed in various manners such as basic analysis, performance analysis, performance level analysis, and performance instrument analysis.

The basic analysis is to provide a result of performing the performance of the playing sound wave by performing the pitch of the sound, the beat, the pitch, and the symbol analysis.

The performance characteristic analysis is a result of judging individual playing habits according to the player's repetitive errors, determining repeated errors as performance habits of the individual player, notifying the fact that the pitch or pitch of the notes is wrong, , The tendency of the beat to slow down, the pitch tends to decrease when playing the fourth finger, and the tendency to shorten when playing the last beat of a word. Analysis and provide.

The performance level analysis may be used to determine difficulty in providing a reporting and training program by determining the accuracy and skill level of the performance by matching the score and the playing sound wave of the performer as a result of determining the degree of skill of the player.

The analysis of the performance musical instrument is an analysis of a performance pattern that takes into account the characteristics of the musical instrument played by the performer. The performance musical instrument analysis is based on a determination of the type of musical instrument played by the performer, It means to analyze characteristics. For example, in the case of a keyboard musical instrument, the pitch of the sound is low and the correlation with the musical performance is low. On the other hand, since the pitch of the musical string is directly related to the musical skill, . ≪ / RTI >

The sound wave matching result 230 and the performance pattern analysis result 240 may be provided to the performer through the performance analysis report 250. In the performance analysis reporting step 250, a portion of the player's sound wave 201 that plays differently from the score may be detected and reported based on the pitch, beat, and phonetic symbols of the corresponding song, which are stored digitally. In addition, it is possible to analyze and report the pitch error, the beat error, the tempo error, and the like which are habitually repeated according to the performance characteristics of the performer, in a secondarily synthesized result of such detection.

The customized training program providing apparatus 100 may provide a training program that can supplement the player's playing habits or playing disadvantages based on the performance pattern analysis result 240 in addition to the performance analysis reporting 250, (260).

FIG. 3 is a diagram illustrating a target music score according to an exemplary embodiment. FIG. 4 and FIG. 5 are views illustrating analysis results of a performance file matching analysis and a performance pattern analysis result according to an exemplary embodiment.

3 can be stored in a digital file format and can be used for comparative matching with a playing sound wave input from a player. For example, in the customized training program providing apparatus 100, information about musical scores of a music such as 'Liebesleid' to be played by a player is digitized and stored, and the musical skill of the player is analyzed Can be used.

The result of analyzing the performance sound wave of the performer by matching with the target score or target sound wave may be provided as shown in FIGS. 4 and 5. FIG.

The personalized training program providing apparatus 100 may analyze and provide at least one of a pitch, a beat, a tone, a pitch, a tempo of the entire song, and a playing skill with respect to a playing sound wave of the player. For example, the analysis result may be provided by various methods such as basic analysis, performance analysis, performance level analysis, and player musical instrument analysis based on the matching result of the target music score and the playing sound wave of the player.

First, the basic analysis may be provided as shown in FIG. 4 as a result of determining the performance of the playing sound wave. 4, the accuracy of the pitch 410, the beat 420, the vibrato 430, the intensity 440, and the like with respect to the playing sound wave is determined based on information of the pre-stored score (FIG. 3) Can be provided.

The performance characteristics analysis, the performance level analysis, and the performance instrument analysis can be provided as shown in FIG. 5, and it is possible to determine the personal playing habit or the skill level of the player based on the repeated error of the player, As a result, it is possible to provide an analysis result of the performance pattern in consideration of the characteristics of the musical instrument played by the player, together with simple comments. In addition, the customized training program providing apparatus 100 may provide the results of the basic analysis, performance analysis, performance level analysis, and performance instrument analysis in various manners according to the player's selection.

6 is a diagram illustrating a customized training program provided in accordance with an embodiment.

Referring to FIG. 6, there is provided a training program for supplementing performance habits or playing disadvantages of a player based on a performance file matching analysis result and a performance pattern analysis result of FIGS. 4 and 5.

The personalized training program providing apparatus 100 may be provided with a training program meeting the level of the performer or a personalized training program that can correct habits or disadvantages according to the performance pattern of the performer, .

7 is a flowchart illustrating a method of providing a customized training program based on performance pattern analysis according to an exemplary embodiment.

In step 710, the database unit 110 may digitize at least one of the target score and the target sound wave and store the digitized data as a reference data sequence. Here, the target musical score refers to information about a musical score of a music piece to be played, and the target sound wave refers to performance file information of a musician or an expert who played the music.

In step 720, the collecting unit 120 may collect an input data sequence in which the player's playing sound wave is digitized. The played sound wave may be collected by digitizing the performance file inputted from the player in real time and using it for pattern analysis or digitally converting the performance file of the player stored in advance.

In step 730, the analyzer 130 may compare the reference data sequence stored in step 710 with the input data sequence collected in step 720. In step 730, the analyzer 130 may analyze at least one of a pitch, a tempo, a tone, a pitch, a tempo of a song, and a playing skill based on the matching result.

In step 730, analysis results may be provided by various methods such as basic analysis, performance analysis, performance level analysis, and player musical instrument analysis based on the matching result. The basic analysis is a result of determining the performance of the playing sound wave, and the performance characteristic analysis is a result of determining a personal playing habit based on the repeated error of the player. The performance level analysis is a determination result of the degree of skill of the player, and the performance musical instrument analysis is an analysis result of a performance pattern in consideration of the characteristics of the musical instrument played by the player. The analyzer 130 may perform at least one of basic analysis, performance analysis, performance level analysis, and performance instrument analysis according to a player's selection.

In step 740, the guide unit 140 may provide a customized training program for the player based on the result of the feature value analysis in step 730.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (1)

At least one of a pitch, a beat, a tone, a pitch, a tempo of a song, and a musical performance level based on a result of matching a reference data sequence obtained by digitizing at least one of a target musical score and a target sound wave and an input data sequence obtained by digitizing a musical performance sound of a performer An analysis unit for analyzing feature values; And
A guide part for providing a training program according to the feature value,
/ RTI >
The analyzing unit analyzes the performance of the musical instrument that represents the performance pattern of the performance of the performance musical instrument, and analyzes the performance of the musical instrument, And at least one of the plurality of training programs.

Images