TWM484160U - Music score playback system and tools for education with virtual 3d animation performing musical instruments - Google Patents

Music score playback system and tools for education with virtual 3d animation performing musical instruments Download PDF

Info

Publication number
TWM484160U
TWM484160U TW103204484U TW103204484U TWM484160U TW M484160 U TWM484160 U TW M484160U TW 103204484 U TW103204484 U TW 103204484U TW 103204484 U TW103204484 U TW 103204484U TW M484160 U TWM484160 U TW M484160U
Authority
TW
Taiwan
Prior art keywords
virtual
music
playing
score
music score
Prior art date
Application number
TW103204484U
Other languages
Chinese (zh)
Inventor
Chung-Jung Hu
Original Assignee
Chung-Jung Hu
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chung-Jung Hu filed Critical Chung-Jung Hu
Priority to TW103204484U priority Critical patent/TWM484160U/en
Publication of TWM484160U publication Critical patent/TWM484160U/en

Links

Landscapes

  • Electrically Operated Instructional Devices (AREA)
  • Auxiliary Devices For Music (AREA)

Abstract

A music score playback system and tools for education with virtual 3D animation performing musical instruments is provided using an electronic device including personal computers, web platforms, mobile phones, tablet PCs, virtual 3D animation and multimedia module, a multi-functional music score playback system, a video and audio recording tool, and a music score editor. The main function of the system is to load music scores from music score database and to play the music score. The user interface of the music score system can be categorized into: lesson, music score playback, memo system, practice, video and audio recording, synchronized 3D animation playback with changeable viewing angles, and community sharing; a user can observe how the virtual 3D character's hands perform a musical instrument for a musical score over various viewing angles as the system plays a song. Furthermore, music scores can be edited and can be attached with notes and memos allowing users to more efficiently learn to play musical instruments.

Description

虛擬3D樂器演奏播放教學工具系統Virtual 3D instrument playing teaching tool system

本創作一種虛擬3D樂器演奏播放教學工具系統,特別是有虛擬3D人物或3D手於播放歌譜時同步演奏虛擬3D樂器,並可即時切換多種3D視角,教學筆記與便利貼也會在播放歌譜時同步顯示,可視為樂器的多功能電子樂譜和教學工具,讓使用者可以完整的學會演奏歌曲。This is a virtual 3D instrument playing and playing teaching tool system, especially when there are virtual 3D characters or 3D hands playing synchronized virtual 3D instruments while playing songs, and can instantly switch a variety of 3D perspectives. Teaching notes and sticky notes will also play the scores. Simultaneous display, which can be regarded as the instrument's multi-functional electronic scores and teaching tools, allows users to learn to play songs completely.

我國公告第M415382號新型專利一種傳統鋼琴之數位樂譜彈奏教學裝置,其功能為在鋼琴上加裝感應器,如此在演奏時使用者就可透過電子樂譜來比較自己彈的與樂譜有無差異。China's new patent No. M415382 is a digital piano music teaching device for traditional pianos. Its function is to install a sensor on the piano. When playing, the user can compare the difference between the bullet and the score through the electronic score.

傳統的紙本樂譜只有在文件上標示音符等音樂符號,後來有電腦軟體如Arobas Music的Guitar Pro(官方網站網址為http://www.guitar-pro.com)將樂譜電子化,藉此在播放樂譜同時電子設備可發出MIDI音樂,其另一主功能為可編輯電子樂譜。Traditional paper scores only include musical symbols such as notes on the document, and later computer software such as Guitar Pro of Arobas Music (official website http://www.guitar-pro.com) electronically digitizes the scores. While playing the score, the electronic device can emit MIDI music, and the other main function is the editable electronic score.

我國公告第M450030號新型專利一種樂器教學互動裝 置,並有樂器聲音的音樂資料庫,透過遊戲互動和感壓按扭來訓練辨認音感和相對應的樂器聲音。China's announcement of the new patent No. M450030, a musical instrument teaching interactive installation Set, and a music database of instrument sounds, through the game interaction and pressure button to train the recognition of the sound and the corresponding instrument sound.

我國公告第M470347號新型專利一種四弦琴教學系統,建構在一學習平台上,以其音樂資料庫中的歌曲,透過其獨特的簡化編排方法來學習如何在四弦琴指板上彈奏歌曲。China's new patent No. M470347, a ukulele teaching system, constructed on a learning platform, learns how to play songs on the ukulele fingerboards through its unique simplified arrangement method with songs in its music database. .

雖有許多樂器的教學影音系統和樂譜書籍,但是為了讓使用者更有效率的學習演奏樂器和更全面性的加強樂譜功能,本創作一種虛擬3D樂器演奏播放教學工具系統,此虛擬3D樂器演奏播放教學工具系統可用在個人電腦、網路平台、手機、平板電腦、PDA、電子書...等。Although there are many instruments for teaching audio-visual systems and music books, in order to allow users to learn more efficiently and more comprehensively enhance the score function, this virtual 3D instrument playing teaching tool system, this virtual 3D instrument playing The playback teaching tool system can be used in personal computers, online platforms, mobile phones, tablets, PDAs, e-books, and the like.

虛擬3D樂器演奏播放教學工具系統,主要內容有樂器及樂理教學內容、樂譜與音樂資料庫、和虛擬3D手演奏虛擬3D樂器的3D動畫影音多媒體資料庫。Virtual 3D instrument playing and playing teaching tool system, the main content is musical instrument and music theory content, music and music database, and virtual 3D hand playing virtual 3D musical instrument 3D animation video library.

樂譜系統主要功能有樂譜音樂播放器、錄影錄音工具、以及樂譜編輯器;從資料庫中選取歌曲後,可在歌曲的播放介面播放此歌譜的影音檔,於此同時,3D動畫會自動同步播放虛擬3D手演奏虛擬3D樂器,使用者可同時切換不同3D視角來從各個角度仔細觀察演奏方式以及技巧。The main functions of the music system are music music player, video recording tool, and music score editor. After selecting a song from the database, the video file of the song can be played in the song playing interface. At the same time, the 3D animation will automatically play synchronously. Virtual 3D hands play virtual 3D instruments, users can switch between different 3D angles to observe the playing style and skills from all angles.

使用者也可隨時開啟歌曲教學,學習該歌曲的重點;教學呈現方式可以是文字敘述、圖型、影片、和多媒體動畫等。The user can also open the song teaching at any time to learn the key points of the song; the teaching presentation mode can be text narrative, graphic, film, and multimedia animation.

使用者可在譜上做筆記和便利貼、或者是影音錄影後並與 社群分享自己的樂器演奏成果;使用者還可透過編輯器修改樂譜內容,讓學習者、演奏家、或老師可以更有效率的學習樂器、閱讀樂譜、和教學互動。Users can make notes and post-it notes on the spectrum, or after video and video recording The community shares its musical performances; users can modify the scores through the editor to allow learners, performers, or teachers to learn instruments, read scores, and teach interactions more efficiently.

1‧‧‧電子設備1‧‧‧Electronic equipment

2‧‧‧樂譜音樂資料庫2‧‧‧ music music library

3‧‧‧樂譜播放顯示介面3‧‧‧Music play display interface

4‧‧‧播放時間軸4‧‧‧Play timeline

5‧‧‧虛擬3D樂器演奏播放顯示區5‧‧‧Virtual 3D instrument playing display area

6‧‧‧3D視角切換區6‧‧‧3D viewing angle switching area

7‧‧‧樂譜音樂播放器7‧‧‧ music music player

8‧‧‧播放8‧‧‧Play

9‧‧‧停止9‧‧‧Stop

10‧‧‧電子節拍器10‧‧‧Electronic metronome

11‧‧‧音軌顯示控制器11‧‧‧Track display controller

12‧‧‧系統設定12‧‧‧System settings

13‧‧‧顯示/隱藏筆記13‧‧‧Show/Hide Notes

14‧‧‧播放變速控制14‧‧‧Play shift control

15‧‧‧錄音錄影15‧‧‧Video recording

16‧‧‧上傳分享影片影音檔16‧‧‧Upload and share video and audio files

17‧‧‧編輯樂譜17‧‧‧Editing scores

18‧‧‧電子調音器18‧‧‧Electronic tuner

19‧‧‧樂譜顯示區19‧‧‧ music score display area

20‧‧‧播放軸節拍球20‧‧‧ play shaft beat ball

21‧‧‧筆記區21‧‧‧Note Area

22‧‧‧播放樂譜功能模式22‧‧‧Play music function mode

23‧‧‧教學功能模式23‧‧‧ Teaching function mode

24‧‧‧筆記編輯功能模式24‧‧‧Note editing function mode

25‧‧‧練習功能模式25‧‧‧ practice function mode

26‧‧‧虛擬3D手26‧‧‧Virtual 3D hand

27‧‧‧虛擬3D樂器27‧‧‧Virtual 3D instruments

28‧‧‧演奏技巧與樂理教學等多媒體影音資料庫28‧‧‧Multimedia audio and video library such as playing skills and music theory teaching

29‧‧‧3D視角切換成正視圖29‧‧‧3D angle of view switched to front view

30‧‧‧3D視角切換成放大視圖30‧‧‧3D angle of view switched to magnified view

31‧‧‧3D視角切換成指板視圖31‧‧‧3D angle of view switched to fingerboard view

32‧‧‧3D視角切換成第一人稱視圖32‧‧‧3D perspective switched to first person view

33‧‧‧3D視角切換成背視圖33‧‧‧3D angle of view switched to back view

第1圖為本創作虛擬3D樂器演奏播放教學工具系統架構示意圖。The first picture is a schematic diagram of the system architecture of the virtual 3D instrument playing teaching tool.

第2圖為本創作四種模式與模式間的切換示意圖。Figure 2 is a schematic diagram of the switching between the four modes and modes of the creation.

第3圖為本創作三種3D視角切換示意圖。The third picture is a schematic diagram of three 3D viewing angles of the creation.

第4圖為本創作二種3D視角切換示意圖。Figure 4 is a schematic diagram of two types of 3D viewing angle switching.

首先,請參閱第1圖所示,本創作所設之一種虛擬3D樂器演奏播放教學系統工具,在一電子設備1上,此電子設備此系統可以是個人電腦、網路平台、手機、平板電腦、PDA、電子書...等。First, please refer to Figure 1, a virtual 3D instrument playing and playing teaching system tool is set up on an electronic device 1. The electronic device can be a personal computer, a network platform, a mobile phone or a tablet computer. , PDA, e-books, etc.

虛擬3D樂器演奏播放教學工具系統中的虛擬3D樂器可為任何樂器,如吉他、烏克麗麗、小提琴、鋼琴、木箱鼓、鼓、長笛...等,本範例圖以烏克麗麗為示範虛擬3D樂器;第1圖,先在樂譜音樂資料庫2中選取想學習的歌曲樂譜;在樂譜播放顯示介面3上主要有六大區塊:一為播放時間軸4,可顯示目前的樂譜小節;二為虛擬3D樂器演奏播放顯示區5,可觀看虛擬3D手26演奏虛擬3D樂器27;三為3D視角切換區6,可在虛擬3D環境中切換不同角度觀看3D手的演奏;四為 樂譜音樂播放器7,可操控樂譜播放8、停止9、電子節拍器10、音軌顯示控制器11、設定12、顯示/隱藏筆記13、播放變速控制14、錄音錄影15、上傳分享影片影音檔16、編輯樂譜17、和電子調音器18等相關輔助工具;五為樂譜顯示區19,可觀看樂譜並有播放軸節拍球20輔助數拍子;六為筆記區21,筆記和便利貼會在此區塊顯示。The virtual 3D instrument in the virtual 3D instrument playing teaching tool system can be any instrument, such as guitar, uklele, violin, piano, wooden drum, drum, flute, etc., this example picture is Ukuleli To demonstrate the virtual 3D instrument; first, first select the song scores to be learned in the music music database 2; there are mainly six blocks in the music play display interface 3: one is the play time axis 4, which can display the current Music score section; the second is a virtual 3D instrument playing display area 5, the virtual 3D hand 26 can be played to play the virtual 3D musical instrument 27; the third is the 3D view switching area 6, which can switch the different angles to watch the performance of the 3D hand in the virtual 3D environment; for Music music player 7, can control music score playback 8, stop 9, electronic metronome 10, audio track display controller 11, setting 12, display / hide notes 13, play shift control 14, recording video 15, upload and share video and audio files 16, editing music score 17, and electronic tuner 18 and other related auxiliary tools; five is the music score display area 19, can watch the music score and has a play axis beat ball 20 auxiliary number beat; six for the note area 21, notes and sticky notes will be here The block is displayed.

請參閱第2圖所示,在樂譜播放顯示介面上3主要還有四個模式可選擇:一為播放樂譜功能模式22,為播放樂譜的主要功能集;二為教學功能模式23,可切換至樂器演奏技巧與樂理教學等多媒體影音資料庫28;三為筆記編輯功能模式24,可編輯樂譜上的筆記和便利貼;四為練習功能模式25,為加強反複訓練樂譜中的段落樂句,如此,使用者可更全面性的學習樂器和演奏樂譜等歌曲;第2圖也示範了切換至教學模式的變化示意圖。Please refer to Figure 2, there are four main modes in the music display display interface: one is to play the music function mode 22, which is the main function set of the music score; the other is the teaching function mode 23, which can be switched to Musical instrument playing skills and music theory teaching and other multimedia audio and video library 28; three for note editing function mode 24, can edit notes and sticky notes on the score; fourth is the practice function mode 25, in order to strengthen the repeated training of paragraph phrases in the score, so Users can learn more musical instruments and play music scores in a more comprehensive way; Figure 2 also shows a schematic diagram of the changes to switch to teaching mode.

如第3圖所示,3D視角可切換成正視圖29,放大視圖30,指板視圖31。As shown in FIG. 3, the 3D viewing angle can be switched to the front view 29, the enlarged view 30, and the fingerboard view 31.

如第4圖所示,3D視角也可切換成第一人稱視圖32,和背視圖33...等;因此學習者可從各個角度觀察學習指法的演奏技巧。As shown in Fig. 4, the 3D angle of view can also be switched to the first person view 32, and the back view 33, etc.; therefore, the learner can observe the playing skills of the learning fingering from various angles.

本創作所有的增加與創新功能,為學習樂器的使用者提供更完善的學習、演奏、和閱讀樂譜的體驗,也為老師和學生間搭上更順暢的學習與溝通橋梁;上列所示之功能與實施方式 詳細說明本創作的一些具體內容與功能,但不是用以限制本創作之專利範圍,只要合乎本創作之功能應用下之變更與實施,應包含於本創作之專利範圍中。All of the creations and innovations of this creation provide a better learning, performance, and reading experience for the learner of the instrument, as well as a smoother learning and communication bridge between the teacher and the student; Function and implementation The specific contents and functions of this creation are described in detail, but are not intended to limit the scope of the patents of this creation. As long as the changes and implementations under the functional application of this creation are included in the scope of this creation patent.

1‧‧‧電子設備1‧‧‧Electronic equipment

2‧‧‧樂譜音樂資料庫2‧‧‧ music music library

3‧‧‧樂譜播放顯示介面3‧‧‧Music play display interface

4‧‧‧播放時間軸4‧‧‧Play timeline

5‧‧‧虛擬3D樂器演奏播放顯示區5‧‧‧Virtual 3D instrument playing display area

26‧‧‧虛擬3D手26‧‧‧Virtual 3D hand

27‧‧‧虛擬3D樂器27‧‧‧Virtual 3D instruments

6‧‧‧3D視角切換區6‧‧‧3D viewing angle switching area

7‧‧‧樂譜音樂播放器7‧‧‧ music music player

8‧‧‧播放8‧‧‧Play

9‧‧‧停止9‧‧‧Stop

10‧‧‧電子節拍器10‧‧‧Electronic metronome

11‧‧‧音軌顯示控制器11‧‧‧Track display controller

12‧‧‧系統設定12‧‧‧System settings

13‧‧‧顯示/隱藏筆記13‧‧‧Show/Hide Notes

14‧‧‧播放變速控制14‧‧‧Play shift control

15‧‧‧錄音錄影15‧‧‧Video recording

16‧‧‧上傳分享影片影音檔16‧‧‧Upload and share video and audio files

17‧‧‧編輯樂譜17‧‧‧Editing scores

18‧‧‧電子調音器18‧‧‧Electronic tuner

19‧‧‧樂譜顯示區19‧‧‧ music score display area

20‧‧‧播放軸節拍球20‧‧‧ play shaft beat ball

21‧‧‧筆記區21‧‧‧Note Area

Claims (6)

本創作一種虛擬3D樂器演奏播放教學工具系統,可在電腦、平板電腦、和行動裝置上使用;整合了電子樂譜播放器、教學講義、筆記便利貼、3D動畫樂器演奏、影片教學、和錄音錄影等功能,並將畫面切分成多個區塊,因此可在播放電子樂譜同時同步顯示、操作、和切換組合上述等功能;也使用虛擬3D人物或3D手於播放樂譜時同步演奏虛擬3D樂器,並可隨時切換多種3D視角;可視為樂器的多媒體電子樂譜和教學工具,讓使用者可以完整的學會演奏歌曲。 This virtual 3D instrument playing teaching tool system can be used on computers, tablets, and mobile devices; integrated electronic music player, teaching handouts, notes, post-it notes, 3D animation instruments, film teaching, and recording Such functions, and the screen is divided into a plurality of blocks, so that the functions of the above-mentioned functions can be simultaneously displayed, operated, and switched while playing the electronic scores; the virtual 3D characters or the 3D hands are also used to simultaneously play the virtual 3D instruments when playing the scores. It can switch a variety of 3D viewing angles at any time; it can be regarded as the multimedia electronic music score and teaching tools of the instrument, so that users can learn to play the song completely. 如申請專利範圍第1項所述虛擬3D樂器演奏播放教學工具系統,其中播放樂譜時,也提供了使用者加便利貼和筆記功能,並將其便利貼與筆記在播放樂譜時可同步顯示。 For example, in the virtual 3D instrument playing and playing teaching tool system described in claim 1, in which the music score is played, the user also adds a sticky note and a note function, and the sticky note and the note can be simultaneously displayed when the music score is played. 如申請專利範圍第1項所述虛擬3D樂器演奏播放教學工具系統,其中電子樂譜可編輯與更改樂譜上的音符和3D動畫等多媒體內容。 For example, the virtual 3D instrument playing teaching tool system described in claim 1 of the patent scope, wherein the electronic score can edit and change multimedia content such as notes and 3D animation on the score. 如申請專利範圍第1項所述虛擬3D樂器演奏播放教學工具系統,其中虛擬3D手所演奏的虛擬3D樂器可為任何樂器,如吉他、烏克麗麗、小提琴、鋼琴、木箱鼓、鼓、長笛。 For example, the virtual 3D musical instrument playing teaching tool system described in claim 1 of the patent scope, wherein the virtual 3D musical instrument played by the virtual 3D hand can be any musical instrument such as a guitar, an uklele, a violin, a piano, a wooden drum, and a drum. ,flute. 如申請專利範圍第1項所述虛擬3D樂器演奏播放教學工具系統,其系統中也包括了歌曲樂譜影音資料庫、相對應的3D動畫等多媒體資料庫、和歌曲與樂理的教學資料庫。 For example, the virtual 3D instrument playing and playing teaching tool system described in claim 1 of the patent scope also includes a music library of song music, a corresponding multimedia library such as 3D animation, and a teaching database of songs and music theory. 如申請專利範圍第1項所述虛擬3D樂器演奏播放教學工具系統,其中播放樂譜時,也整合了電子辨音器、電子調音器、和電子節拍器等功能。For example, the virtual 3D instrument playing and playing teaching tool system described in claim 1 of the patent application, in which the musical score is played, also integrates functions such as an electronic sound detector, an electronic tuner, and an electronic metronome.
TW103204484U 2014-03-17 2014-03-17 Music score playback system and tools for education with virtual 3d animation performing musical instruments TWM484160U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW103204484U TWM484160U (en) 2014-03-17 2014-03-17 Music score playback system and tools for education with virtual 3d animation performing musical instruments

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW103204484U TWM484160U (en) 2014-03-17 2014-03-17 Music score playback system and tools for education with virtual 3d animation performing musical instruments

Publications (1)

Publication Number Publication Date
TWM484160U true TWM484160U (en) 2014-08-11

Family

ID=51793789

Family Applications (1)

Application Number Title Priority Date Filing Date
TW103204484U TWM484160U (en) 2014-03-17 2014-03-17 Music score playback system and tools for education with virtual 3d animation performing musical instruments

Country Status (1)

Country Link
TW (1) TWM484160U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108810436A (en) * 2018-05-24 2018-11-13 广州音乐猫乐器科技有限公司 A kind of video recording method and system based on the He Zou of full-automatic musical instrument
CN110796923A (en) * 2018-08-03 2020-02-14 北京洲洋华乐科技有限公司 Digital piano score fingering marking and displaying technology

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108810436A (en) * 2018-05-24 2018-11-13 广州音乐猫乐器科技有限公司 A kind of video recording method and system based on the He Zou of full-automatic musical instrument
CN110796923A (en) * 2018-08-03 2020-02-14 北京洲洋华乐科技有限公司 Digital piano score fingering marking and displaying technology

Similar Documents

Publication Publication Date Title
US7754955B2 (en) Virtual reality composer platform system
CN103299334B (en) The mobile computer system of vertical integration
Gouzouasis et al. The future of music making and music education in a transformative digital world
Weing et al. PIANO: enhancing instrument learning via interactive projected augmentation
CN109377818B (en) Music score playing module assembly of digital music teaching system
Ruismäki et al. The iPad and music in the new learning environment
CN101604486A (en) Musical instrument playing and practicing method based on speech recognition technology of computer
Nolan SMARTer music teaching: Interactive whiteboard use in music classrooms
Zhukov Exploring the role of technology in instrumental skill development of Australian higher education music students
CN112053595A (en) Computer-implemented training system
Riley Music composition for iPad performance: Examining perspectives
TWM484160U (en) Music score playback system and tools for education with virtual 3d animation performing musical instruments
Šulentić Begić et al. The use of an interactive whiteboard in solfeggio teaching
Leong Globalization and technology in twenty-first-century education
Hart The tablet as a classroom musical instrument
Crow Music-related ICT in education
Bauer et al. Grounded tech integration using K–12 music learning activity types
Brunt et al. ‘Click, Play and Save’: The iGamelan as a Tool for Music-culture Sustainability
Hudáková et al. 10. DIDACTIC METHOD OF LEARNING DURING MUSIC LESSONS-APPLICABLE IN DISTANCE LEARNING.
Sanborn Airflute: A virtual flute and tutoring system
Albert Computar Technology As A Means Of Enhancing Music Composition: Problems And Prospects.
Chau Computer and Music Pedagogy
Muranda Preserving the nyunganyunga mbira tunes through teaching and learning of performance using Sibelius 7
Fauzy et al. Development of a Basic Music Theory Educational Game for Beginners
Douglas Affordances of Home Studio Jazz: Creation and Negotiation with the Digital Audio Workstation

Legal Events

Date Code Title Description
MM4K Annulment or lapse of a utility model due to non-payment of fees