CN101604486A - Musical instrument playing and practicing method based on speech recognition technology of computer - Google Patents
Musical instrument playing and practicing method based on speech recognition technology of computer Download PDFInfo
- Publication number
- CN101604486A CN101604486A CNA2008100388740A CN200810038874A CN101604486A CN 101604486 A CN101604486 A CN 101604486A CN A2008100388740 A CNA2008100388740 A CN A2008100388740A CN 200810038874 A CN200810038874 A CN 200810038874A CN 101604486 A CN101604486 A CN 101604486A
- Authority
- CN
- China
- Prior art keywords
- student
- melody
- computing machine
- sound
- practicing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses musical instrument playing and practicing method based on speech recognition technology of computer, the music score of Chinese operas is presented on the computer screen, the melody music score of Chinese operas is divided into some fragments such as phrase, single file, trifle, the student sends phonetic order to computing machine, computing machine utilizes the instruction of speech recognition technology recognizing voice, automatically play the content of selected melody fragment then, the content of these melody fragments comprises demonstration performance sound, explanation, literal, picture, fingering video, famous expert's concert video or the like.The student sends phonetic order to computing machine, the both hands that need when the student practises have been liberated, create the omnibearing musical instrument playing and practicing environment of literal, sound, picture and video simultaneously for the student, thereby really realize arbitrary with practicing, improved greatly with the efficient of practicing, and helped the student to grasp the performance of melody and the relevant knowledge of melody as early as possible.
Description
Affiliated technical field
The present invention relates to the field of speech recognition of computing machine, be meant a kind of method of carrying out musical instrument playing and practicing on computers by speech recognition technology especially.
Background technology
Follow to practice to be meant that the student listens demonstration trifle, single file and the phrase of a first melody repeatedly, in addition complete bent, compare by performance and demonstration song oneself, pinpoint the problems and constantly correction, finally grasp the method for playing skill.Therefore, in the learning process of various musical instruments (as piano, violin, urheen, Zheng etc.), the demonstration of following high-level personage is played to follow and is practiced, and improves beyond doubt and plays a shortcut of level.
The student plays the exercise except the demonstration of following Music Teacher and private tutor, and more time needs own exercise, but follows the object of white silk during own exercise.Though have number of C D, VCD and DVD to have detailed explanation and demonstration to play at present to various songs, practice but can't accomplish to follow when the limit listens demonstration song or limit to see demonstration Qu Zhifa, simultaneously since the student when playing various musical instrument, both hands are all occupied, can't vacate both hands various CD/VCD/DVD players are carried out playback operation.In addition, if the student constantly operates CD/VCD/DVD in the exercise process, the exercise meeting is constantly interrupted, and results of learning are had a greatly reduced quality.Even the student is in when exercise, the next door has the people to help to operate playback equipment, but because the uncertainty of playback position, and other people need expend a large amount of energy and times when exchanging accurate playback point with the student, and learning efficiency is had a greatly reduced quality equally.
Present existing application number is the patent of invention of 200710074389.4 (name is called " a kind of training mate method of music reading "), has proposed a kind of spectral method of reading easily.This method a first melody divide in single file, period, phrase and trifle, the pronunciation that utilization can be discerned the electronic pen of invisible two-dimensional codes is helped the student and is read spectrum.Grasp the incipient stage of playing a first melody skill but read to compose just, grasp really that a first melody need take much time and energy is being played in the exercise.And this patent still needs to operate electronic pen with hand, so still can not liberate student's both hands and carry out real effectively with practicing.
Summary of the invention
For solve that student's musical instrument plays with practicing problem, the invention provides a kind of method, traditional papery music score of Chinese operas is presented on the computer screen, and melody is divided into some fragments such as trifle, single file, phrase, the student only needs to send phonetic order to computing machine, computing machine will utilize speech recognition technology that phonetic order is discerned, and plays the content of selected melody fragment then automatically, follows the purpose of practicing thereby reach the liberation both hands.The content of these melody fragments can comprise plurality of kinds of contents such as demonstration performance sound, explanation, literal, picture, fingering video, famous expert's concert video, thereby practices environment for the student creates omnibearing following such as literal, sound, picture and video.
Technical scheme of the present invention is as follows:
The microphone of computing machine, loudspeaker and display are responsible for the input of voice command, the broadcast of sound, and the demonstration of the music score of Chinese operas, literal, picture and video respectively.The function of computer software is: the phonetic order that obtains the student by microphone, sound identification module identifies corresponding instruction, search for corresponding character/sound/contents such as picture/video according to instructing in the database by control module, deliver to display and loudspeaker respectively and play back.Student's phonetic order should be corresponding with trifle, single file, phrase, the complete bent instruction that upward identifies on the music score of Chinese operas.Like this, the student just can play the literal/sound/contents such as picture/video of arbitrary fragment according to the needs of self.
The invention has the beneficial effects as follows: the student who plays for learning instrument provides a kind of omnibearing with practicing environment, be that the student plays the music score of Chinese operas fragment (can comprise literal/sound/plurality of kinds of contents such as picture/video) that will learn by computing machine, follow white silk then, thereby reach the purpose of quick grasp playing technique.The student sends instruction by voice to computing machine, overcome tradition and can't liberate the drawback of student's both hands with white silk method, and classic method can't provide the defective of sound, literal, picture, video etc. simultaneously, real realization is arbitrary, following of stereo multi-dimensinal practiced, greatly improve, thereby help the student to grasp the playing skill of musical instrument and the relevant knowledge of melody as early as possible with the effect of practicing.
Description of drawings
The present invention will be described below in conjunction with drawings and Examples.
Fig. 1 is a system construction drawing.
Fig. 2 is a music score of Chinese operas application drawing example, and the selected music score of Chinese operas is the piano music by the bent romance reorganization of Beethovan's violin.
Embodiment
Hardware shown in Figure 1 comprises: microphone 1, main frame 2, loudspeaker 3, display 4, the software program in the main frame 2 mainly are made up of sound identification module 5, control module 6 and database 7.Display 4 (for example: on the top cover of piano or the place that can face substantially of eyes), can be clear that the phonetic order of mark on the music score of Chinese operas on the display and the music score of Chinese operas to guarantee the student is placed on the place that student's eyes can see.Another function of display is the contents such as literal, picture and video that show selected melody fragment.Microphone 1 is placed on the place nearer apart from the student mouth, so that obtain phonetic order clearly, can be according to physical condition from head microphone, and clip-on microphone or desk-top microphone are selected.Loudspeaker 3 need dispose preferably audio amplifier or earphone plays sound.Microphone 1 can adopt multiple mode to be connected with main frame with loudspeaker 3, comprises modes such as wired, wireless, bluetooth.
Software program in the main frame 2 is used to finish control and the management to the white silk system.Sound identification module 5 identifications are by the voice of microphone 1 input, and be converted into corresponding instruction to control module 6, control module 6 searches corresponding character/sound/contents such as picture/video according to instructing in the database 7 again, play sound to loudspeaker 3 by control module 6 then, and (perhaps) is by display 4 display texts/picture/video.
In the music score of Chinese operas application drawing shown in Figure 2, the music score of Chinese operas is presented on the computer display 4.Whole melody is divided into fragments such as full song, phrase, single file and trifle, and on the relevant position of the music score of Chinese operas, and these mark corresponding character are phonetic order to these fragments with the formal notation of symbol.Wherein, full song is a word marking: literal " romance " 8, and corresponding voice is " romance "; Phrase is that semicircular mark adds numeral, the ordering of this digitized representation phrase, and the phrase of mark has 3 among Fig. 2, is respectively " phrase 1 " 26, " phrase 2 " 32 and " phrase 3 " 37, corresponding voice is " phrase 1 ", " phrase 2 " and " phrase 3 "; The word marking that is designated of single file adds numeral, the ordering of digitized representation single file, and the single file of mark is 4 among Fig. 2, is respectively " row 1 " 23, " row 2 " 29, " row 3 " 38, " row 4 " 39, corresponding voice is " row 1 ", " row 2 ", " row 3 ", " row 4 "; Trifle bears obvious signs on the music score of Chinese operas, and with the box indicating with numeral, the ordering of this numeral trifle as required, has the trifle sign of demo content will be presented on the music score of Chinese operas, " trifle 3 " 20 for example, and corresponding voice is " trifle 3 ".
All sheet segment identification that mark comes out on the music score of Chinese operas, all comprise a content in literal/sound/picture/video at least, word content, sound-content, image content and video content are respectively with " literary composition " of being with circle, " sound " of band circle, " looking " expression of " figure " of band circle and band circle, their corresponding voice is respectively " literary composition ", " sound ", " figure " and " looking ".For example: the content of " phrase 2 " 32 comprises " sound " 31 and " looking " 33, and the content of " romance " 8 comprises " literary composition " 9, " sound " 10, " figure " 11 and " looking " 12.
In addition, the number of times that the N representative in 17 is play continuously " play N time " in literal, also is corresponding voice simultaneously, and for example phonetic order " is play 3 times ", and this order is convenient to the student and is repeated repeatedly to listen demonstration to strengthen training.Literal " time interval is provided with: 30 seconds " 18 also is a corresponding voice, be mainly used in interlude between twice broadcast is set, the student can also carry out the modification of phonetic order, the time interval of this order is played the time of training for the student, phonetic order " time be provided with: 40 seconds " for example, after then handling through main frame 2, the time interval that is presented on the screen is changed into 40 seconds.
Also being presented on the music score of Chinese operas of the literal/sound of music score relevant knowledge/picture/video content by symbol.For example: literal " Beethovan " 16 just comprises the content of " literary composition " 14, " figure " 13 and " looking " 15.
The student follows separately when practicing, watch the music score of Chinese operas of graphoscope 4 displayed map 2 earlier, then by microphone 1, send the phonetic order of music score of Chinese operas fragment to computing machine, for example: the student sends phonetic order " phrase 1 ", then main frame 2 navigates to the position of " phrase 1 " 26, the student is according to the literal around " phrase 1 " 26 then, sound, marks such as video, send the instruction of choosing content to computing machine by microphone 1, for example: send phonetic order " literary composition ", then the control module 6 of main frame 2 is searched for the Word message of preserving in database 7, show on graphoscope 4 then, the corresponding sound of literal plays back by loudspeaker 3 simultaneously; If phonetic order is " sound ", then the student needs further to send phonetic order, for example: " playing 5 times ", the sound of demonstrating is then play 5 times by loudspeaker 3, and each time interval is 30 seconds that are provided with in " time interval is provided with: 30 seconds " 18; If phonetic order is " looking ", then the control module 6 of computer control main frame 2 is searched for the video content of preserving in database 7, for example: computer search is to the fingering video of " phrase 1 " 26, and video content is play on graphoscope 4 then, and the video sound accompaniment is from loudspeaker 3 outputs.
There is training mate to instruct when practicing if the student follows, then can save microphone 1, and sound identification module 5 is inoperative.But the music score of Chinese operas on the training mate direct viewing display 4, as required directly with signs such as the melody fragment trifle on the mouse double-click music score of Chinese operas, single file, phrase, Quan Qu, control module 6 is called corresponding character/sound/picture/video according to order from database 7, play back by loudspeaker 3 and display 4.For example: training mate is double-clicked " literary composition " 9 on literal " romance " 8 next doors with mouse, and then the character introduction about romance directly is presented on the display 4, and the sound of literal can play back by loudspeaker 3; With " sound " 31 of mouse-click " phrase 2 " 32, click " playing N time " 17 then, then the demonstration sound of " phrase 2 " 32 is play N time by loudspeaker 6, the each broadcast 30 seconds that are spaced apart " time interval is provided with: 30 seconds " 18; With " looking " 24 of click " row 1 " 23, then the fingering video of first row plays back by display 4 and loudspeaker 3.The recognition accuracy problem that this embodiment can avoid speech recognition to bring, the situation of very suitable training mate instruction of papil.
According to student's needs, also can not use display 4, and only use loudspeaker 3 to play sound.The student uses the papery music score of Chinese operas to replace the music score of Chinese operas that shows on the display 4, the content of printing on the papery music score of Chinese operas is identical with content displayed on the computing machine, the student sends phonetic order by microphone 1 to main frame 2, and 2 of main frames play back the audio document of correspondence by loudspeaker 3.For example: the student viewing papery music score of Chinese operas, send phonetic order " phrase 3 ", then main frame 2 navigates to the position of " phrase 3 ", and the student sends phonetic order " sound " and " playing 2 times " then, and then the demonstration of phrase 3 is played by loudspeaker 3 and is play twice.The student sends phonetic order " Beethovan ", main frame 2 navigates to the position of literal " Beethovan " 16, the student sends phonetic order " literary composition " then, and then main frame 2 plays back the corresponding sound of introducing Beethovan's word content by loudspeaker 3.This embodiment can save display, saves floor area and cost, and can provide with practicing demonstration music and relevant literal explanation for the student.
Claims (4)
1, a kind of musical instrument playing and practicing method based on speech recognition technology of computer, it is characterized in that: computer speech identifies the phonetic order that the student sends, and plays literal, sound, picture, the video content of melody fragment automatically.
2, a kind of musical instrument playing and practicing method as claimed in claim 1 based on speech recognition technology of computer, it is characterized in that: the output device of described computing machine comprises loudspeaker and display, when the melody fragment has literal, picture, video wherein during a content, the output device of computing machine comprises loudspeaker and display; Have only sound-content when the melody fragment, the output device of computing machine can include only loudspeaker.
3, a kind of musical instrument playing and practicing method as claimed in claim 1 based on speech recognition technology of computer, it is characterized in that: the input equipment of described computing machine comprises microphone and mouse, the student can realize the phonetic order input to the microphone sounding, also can directly click the phonetic order sign realization instruction input of the music score of Chinese operas with mouse.
4, a kind of musical instrument playing and practicing method based on speech recognition technology of computer as claimed in claim 1, it is characterized in that: the described melody music score of Chinese operas is presented on the display of computing machine, perhaps is the music score of Chinese operas of papery.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100388740A CN101604486A (en) | 2008-06-12 | 2008-06-12 | Musical instrument playing and practicing method based on speech recognition technology of computer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100388740A CN101604486A (en) | 2008-06-12 | 2008-06-12 | Musical instrument playing and practicing method based on speech recognition technology of computer |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101604486A true CN101604486A (en) | 2009-12-16 |
Family
ID=41470201
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2008100388740A Pending CN101604486A (en) | 2008-06-12 | 2008-06-12 | Musical instrument playing and practicing method based on speech recognition technology of computer |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101604486A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103871295A (en) * | 2014-03-31 | 2014-06-18 | 王紫颐 | Multifunctional zither electronic music score device based on screen display |
| CN104700673A (en) * | 2015-03-10 | 2015-06-10 | 浙江商业职业技术学院 | 3D intelligent integrated learning machine |
| CN106205280A (en) * | 2016-09-07 | 2016-12-07 | 广州丰谱信息技术有限公司 | A kind of Interactive Dynamic colour shape meaning is released spectral method and is played teaching apparatus with musical instrument |
| CN107424476A (en) * | 2017-08-01 | 2017-12-01 | 上海破破飞网络科技有限公司 | A kind of instrumental music training mate system |
| CN108022464A (en) * | 2017-12-11 | 2018-05-11 | 大连高马艺术设计工程有限公司 | A kind of identification language describes and shows the learning aids system of corresponding picture |
| CN109471955A (en) * | 2018-11-12 | 2019-03-15 | 广东小天才科技有限公司 | The localization method of video clip calculates equipment and storage medium |
| WO2019186396A1 (en) * | 2018-03-24 | 2019-10-03 | Cheung Nam Pink Pandora | Systems and methods for music and moving image interaction |
| US10657943B2 (en) | 2016-01-15 | 2020-05-19 | Sunland Information Technology Co., Ltd. | Systems and methods for calibrating a musical device |
| CN112579818A (en) * | 2020-12-29 | 2021-03-30 | 玖月音乐科技(北京)有限公司 | Staff voice annotation method and system |
-
2008
- 2008-06-12 CN CNA2008100388740A patent/CN101604486A/en active Pending
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103871295B (en) * | 2014-03-31 | 2016-03-16 | 王紫颐 | A kind of multi-functional Zheng electronic score device based on screen display |
| CN103871295A (en) * | 2014-03-31 | 2014-06-18 | 王紫颐 | Multifunctional zither electronic music score device based on screen display |
| CN104700673A (en) * | 2015-03-10 | 2015-06-10 | 浙江商业职业技术学院 | 3D intelligent integrated learning machine |
| CN104700673B (en) * | 2015-03-10 | 2017-08-22 | 浙江商业职业技术学院 | The intelligent integrated learning machines of 3D |
| US11328618B2 (en) | 2016-01-15 | 2022-05-10 | Sunland Information Technology Co., Ltd. | Systems and methods for calibrating a musical device |
| US10657943B2 (en) | 2016-01-15 | 2020-05-19 | Sunland Information Technology Co., Ltd. | Systems and methods for calibrating a musical device |
| CN106205280A (en) * | 2016-09-07 | 2016-12-07 | 广州丰谱信息技术有限公司 | A kind of Interactive Dynamic colour shape meaning is released spectral method and is played teaching apparatus with musical instrument |
| CN106205280B (en) * | 2016-09-07 | 2022-06-07 | 广州丰谱信息技术有限公司 | Interactive dynamic color form and meaning music notation method and musical instrument playing trainer |
| CN107424476A (en) * | 2017-08-01 | 2017-12-01 | 上海破破飞网络科技有限公司 | A kind of instrumental music training mate system |
| CN108022464A (en) * | 2017-12-11 | 2018-05-11 | 大连高马艺术设计工程有限公司 | A kind of identification language describes and shows the learning aids system of corresponding picture |
| WO2019186396A1 (en) * | 2018-03-24 | 2019-10-03 | Cheung Nam Pink Pandora | Systems and methods for music and moving image interaction |
| GB2583277A (en) * | 2018-03-24 | 2020-10-21 | Nam Pink Pandora Cheung | Systems and methods for music and moving image interaction |
| CN109471955B (en) * | 2018-11-12 | 2021-09-17 | 广东小天才科技有限公司 | Video clip positioning method, computing device and storage medium |
| CN109471955A (en) * | 2018-11-12 | 2019-03-15 | 广东小天才科技有限公司 | The localization method of video clip calculates equipment and storage medium |
| CN112579818A (en) * | 2020-12-29 | 2021-03-30 | 玖月音乐科技(北京)有限公司 | Staff voice annotation method and system |
| CN112579818B (en) * | 2020-12-29 | 2021-08-13 | 玖月音乐科技(北京)有限公司 | Staff voice annotation method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Lems | New Ideas for Teaching English Using Songs and Music. | |
| CN101604486A (en) | Musical instrument playing and practicing method based on speech recognition technology of computer | |
| Stanyek | Forum on transcription | |
| US10262638B2 (en) | Interactive performance direction for a simultaneous multi-tone instrument | |
| CN109345905A (en) | A kind of interactive digital music lesson system | |
| Kojs | Notating action-based music | |
| CN102243817A (en) | Singing teaching system | |
| Sallis et al. | Live-Electronic Music | |
| Hamilton et al. | Social composition: Musical data systems for expressive mobile music | |
| US20120064498A1 (en) | Interactive system and method for musical instrument instruction | |
| Wallerstedt et al. | Playing by “the connected ear”: An empirical study of adolescents learning to play a pop song using Internet-accessed resources | |
| Acquilino et al. | Current state and future directions of technologies for music instrument pedagogy | |
| US20070261536A1 (en) | Method and system for processing music on a computer device | |
| Menzies et al. | A digital bagpipe chanter system to assist in one-to-one piping tuition | |
| CN201044131Y (en) | Electric tutorship accompany training system for music learning | |
| KR20140142794A (en) | Keyboard apparatus for music lesson | |
| US11308926B2 (en) | Method and system for composing music with chord accompaniment | |
| CN108091207A (en) | A kind of piano for blind | |
| KR101887668B1 (en) | System for foreign language study using rap song | |
| TWM484160U (en) | Music score playback system and tools for education with virtual 3d animation performing musical instruments | |
| Wang | Multimedia systems in music teaching of normal university | |
| CN101059911A (en) | A music reading and training method | |
| Han et al. | A Musical Performance Evaluation System for Beginner Musician based on Real-time Score Following. | |
| Kim | Tradition and Creativity in Korean Taegŭm Flute Performance | |
| Rockell | Incorporating music in CALL: An exploratory study establishing a protocol for computer assisted language learning incorporating music (CALLiM) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20091216 |