WO2019186396A1 - Systems and methods for music and moving image interaction - Google Patents
Systems and methods for music and moving image interaction Download PDFInfo
- Publication number
- WO2019186396A1 WO2019186396A1 PCT/IB2019/052447 IB2019052447W WO2019186396A1 WO 2019186396 A1 WO2019186396 A1 WO 2019186396A1 IB 2019052447 W IB2019052447 W IB 2019052447W WO 2019186396 A1 WO2019186396 A1 WO 2019186396A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- visual
- playing
- archive
- sound
- speed
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B15/00—Teaching music
- G09B15/001—Boards or like means for providing an indication of chords
- G09B15/002—Electrically operated systems
- G09B15/003—Electrically operated systems with indication of the keys or strings to be played on instruments
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/155—User input interfaces for electrophonic musical instruments
- G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
- G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
Definitions
- the presently disclosed technology generally relates to music instrument training systems, and more specifically to systems and methods of music playing tools with visual and sound features.
- the student should be in control in deciding if they want to see the teacher play a certain part of music any time and any where. And the student should also be able to control the pace of the demonstration by the teacher. Additionally, the student can stop the teaching at a particular music playing interval to observe the hand or finger movements of the teacher.
- the present invention describes systems and methods of instructing students to play an music playing tool in one embodiment, a method is provided.
- the method can include importing a visual portion archive into a folder of a remote computing gadget, wherein the visual portion archive comprises visual portion of a second player playing the music playing tool and sound portion of the second player playing the music playing tool.
- the method can include playing the visual portion archive with the remote computing gadget and decreasing a visual speed of the visual portion, wherein while the visual speed of the visual portion has been decreased, the sound portion continues to remain in sound frequency.
- the music playing fool is one of a stringed music playing tool, a brass music playing tool, a reed music playing tool, a keyboard music playing tool, and a percussion music playing tool.
- the inventive method further includes increasing or decreasing the visual speed of the visual portion, wherein while the visual speed of the visual portion has been increased, the sound portion continues to remain in sound frequency.
- the method includes magnifying and slow motioning into a selected area of the visual portion, and wherein the selected area is the second player playing the music playing tool. Accordingly, methods can include magnifying away from the selected area of the visual portion.
- the method includes creating a repeating effect of a selected portion of the visual portion and sound portion.
- Added features include magnifying into a portion of visual portion of the repeating effect and performing at least one of increasing and decreasing a visual speed of the portion of the visual portion of the repeating effect.
- Some methods can include replaying the repeating effect.
- the repeating effect can be a first repeating effect, and methods can further include creating a second repeating effect of a second selected portion of the visual portion and sound portion. Accordingly, methods can include magnifying into a portion of visual portion of the second repeating effect and performing at least one of increasing and decreasing a visual speed of the portion of the visual portion of the second repeating effect.
- the method further allows creating a third repeating effect of a third selected portion of the visual portion and sound portion, creating a fourth repeating effect of a fourth selected portion of the visual portion and sound portion, creating a fifth repeating effect of a fifth selected portion of the visual portion and sound portion, and creating a sixth repeating effect of a sixth selected portion of the visual portion and sound portion.
- the methods also includes displaying, via a screen of the remote computing gadget, at least one repeating effect in a timeline that indicates song duration.
- This disclosure also includes a selMearn music system that includes a remote computing gadget and a selMearn console communicatively coupled to the remote computing gadget.
- the self-iearn console device can include an outer housing, a first button coupled to the housing, and a second button coupled to the outer housing in response to the first button being pressed, the remote computing gadget can be configured to play a visual portion archive comprising visual portion of a musician playing an music playing tool and sound portion of the musician playing the music playing tool.
- the remote computing gadget can be configured to decrease a visual speed of the visual portion such that while the visual speed of the visual portion has been decreased, the sound portion continues to remain in sound frequency in some embodiments, in response to the second button being pressed for a duration of time, the remote computing gadget can be configured to increase the visual speed of the visual portion such that while the visual speed of the visual portion has been increased, the sound portion continues to remain in sound frequency.
- the self-learn console can further include a third button coupled to the outer housing and a fourth button coupled to the outer housing in response to the third button being pressed, the remote computing gadget can be configured to start a repeating effect of a selected portion of the visual portion and sound portion. In response to the fourth button being pressed, the remote computing gadget can be configured to end a repeating effect of the selected portion of the visual portion and sound portion.
- the self-learn console can further include a fifth button coupled to the outer housing. In response to the fifth button being pressed for a first duration of time, the remote computing gadget can be configured to move from a first repeating effect to a second repeating effect.
- the remote computing gadget can be configured to dear the first repeating effect.
- the self-learn console can further include a sixth button coupled to the outer housing.
- the remote computing gadget can be configured to magnifying into a selected area of the visual portion.
- the selected area can be the musician playing the music playing tool.
- the remote computing gadget can be configured to magnifying away from the selected area of the visual portion.
- Embodiments of the self-learn console can further include a seventh button coupled to the outer housing and an eighth button coupled to the outer housing.
- the remote computing gadget can be configured to fast forward the visual portion archive in response to the eighth button being pressed, the remote computing gadget can be configured to fast rewind the visual portion archive.
- the disclosure also includes a self-learn console device that includes an outer housing, a first button coupled to the outer housing, and a second button coupled to the outer housing.
- a remote computing gadget can be configured to play a visual portion archive comprising visual portion of a musician playing an music playing tool and sound portion of the musician playing the music playing tool.
- the remote computing gadget can be configured to decrease a visual speed of the visual portion such that while the visual speed of the visual portion has been decreased, the sound portion continues to remain in sound frequency.
- the device further includes a third button coupled to the outer housing and a fourth button coupled to outer housing in response to the third button being pressed, the remote computing gadget can be configured to start a repeating effect of a selected portion of the visual portion and sound portion in response to the fourth button being pressed, the remote computing gadget can be configured to end a repeating effect of the selected portion of the visual portion and sound portion.
- the device can further include a fifth button coupled to the outer housing, a sixth button coupled to the outer housing, a seventh button coupled to the outer housing, and an eighth button coupled to the outer housing in response to the fifth button being pressed, the remote computing gadget can be configured to move from a first repeating effect to a second repeating effect.
- the remote computing gadget can be configured to magnifying into a selected area of the visual portion.
- the remote computing gadget can be configured to fast forward the visual portion archive.
- the remote computing gadget can be configured to fast rewind the visual portion archive.
- the seif-learn console can define a first row and a second row.
- the first row can include the first button, second button, fifth button, and sixth button.
- the second row can include the third button, fourth button, seventh button, and eighth button.
- the fifth button and the sixth button are both located between the first button and the second button, and the third button and the seventh button are both located between the fourth button and the eighth button.
- a music learning system allows instructing students to play a music playing tool, which comprises an outer housing and a computing device.
- the computer device may be a phone, computer, or any computer devices.
- the outer housing further includes a touch screen.
- a first button is coupled to the outer housing. A student may press the first button.
- the computing device is configured to play a visual portion archive with the remote computing gadget under a learning mode at regular speed, the visual portion archive comprising visual portion of a second player playing the music playing tool and sound portion of the second player playing the music playing tool, the first player resembling a student and second player resembling a teacher, wherein decreasing speed at various visual speed of the visual portion, wherein decreasing visual speed at a first location of the visual portion as instructed by the first player, a sound portion at a first location continues to remain in sound frequency; and decreasing visual speed at a second location of the visual portion as instructed by the first player, a sound portion at a second location continues to remain in sound frequency.
- a second button coupled to the outer housing may also be provided.
- the computing device may be configured to play the visual portion archive with the remote computing gadget under a practicing mode.
- the computer device may include playing the visual portion archive at a first decreased visual speed at the first location of the visual portion without instructed by the first player, the sound portion at the first location continues to remain in sound frequency; playing the visual portion archive at a second decreased visual speed at the second location of the visual portion without instructed by the first player, the sound portion at the first location continues to remain in sound frequency; and playing of the visual portion archive at all locations other than the first and second locations at the regular speed.
- FIG. 1 illustrates a block diagram of the system, according to an embodiment of the present invention.
- FIG. 2 illustrates an exemplary screen of a music learning system, according to an embodiment of the present invention.
- FIG. 3 illustrates a pop-up window showing a video archive import tool, according to an embodiment of the present invention.
- FIG. 4 illustrates an exemplary video archive import tool, according to an embodiment of the present invention.
- the system can be implemented via the remote computing gadget, and other devices, such as a self-learn music system, which will be described later.
- the user may load a visual portion archive on to the remote computing gadget through any suitable process, such as importing the visual portion archive from an external source.
- the user can then open the visual portion archive within the system.
- the visual portion archive can be initially selected from a local storage or database within the remote computing gadget via the user interface.
- the first user can be prompted to select the visual portion archive from the folder of the local database.
- the system comprises a user interface for enabling a user (i.e., the first user) to interact therewith, and a processor, which comprises a set of computer instructions wherein, the processor and the user interface are disposed in operative communication with one another.
- the processor can be divided into a plurality of processing modules including a visual speed module, a repeating effect module, a magnifying module, and a self-learn music system module. The utility of each of which will become apparent from the following body of text.
- the first user via the user interface can access the system over a communications network, such as, the internet.
- the user interface can be facilitated by a plurality of remote user terminals, which may include a remote computing gadget (e.g. a desktop computer, a laptop computer, a tablet, a smartphone, and the like).
- a remote computing gadget e.g. a desktop computer, a laptop computer, a tablet, a smartphone, and the like.
- the system which can be a computer application, can be initially installed within the remote computing gadget.
- the first user may import (e.g. download) the visual portion archive(s) from a visual portion hosting website. This can be performed by selecting a button (in the event of the visual portion hosting website) via the user interface. The selection results in an input URL field being opened. The first user can be prompted to enter the URL of the visual portion. Upon confirming the URL (by selecting a 'Close' button), the corresponding visual portion archive can be downloaded and saved to a local database of the remote computing gadget, while concurrently, the system can initiate processing of the selected visual portion archive.
- a button in the event of the visual portion hosting website
- the selection results in an input URL field being opened.
- the first user can be prompted to enter the URL of the visual portion.
- the corresponding visual portion archive can be downloaded and saved to a local database of the remote computing gadget, while concurrently, the system can initiate processing of the selected visual portion archive.
- the first user can be enabled to choose the quality of the sound portion and visual portion tracks of the visual portion being downloaded from a visual portion hosting website. More particularly, the first user can be enabled to choose between three qualities each for both sound portion and visual portion tracks.
- the three quality options for the visual portion track can include a high quality option, a medium quality option, and a low quality option.
- the three quality options for the sound portion track can include a high quality option, a medium quality option, and a low quality option it should be appreciated that the sound portion and visual portion track quality can be the quality as provided by the third party database.
- the quality level of the track can be processed to a level to optimize disk space. This process can make it easier to share the track with people who have lower bandwidth and/or slower Internet connections
- the method can further include creating a repeating effect, which can be initiated by assigning a start repeating effect point at any point along the length of the progress bar, assigning an end repeating effect point at any point along the length of the progress bar.
- the created repeating effect can thereby be displayed in the timeline to indicate to the user where the repeating effect occurs with respect to the rest of the song or project.
- the method can include saving the repeating effect defined by the assigned start and end repeating effect points.
- the method can also include creating multiple repeating effects.
- the disclosed system can further include a self-learn music system, which can be operated by a foot of the first user.
- the self-learn music system device includes a rectangular stepped structure with a pair of first and second steps.
- Each step can include a row of four buttons, each of which can be dedicated to one or two functions depending on how the buttons are pressed. For example, pressing a button briefly may invoke a function while long-pressing a button may invoke a different function in some embodiments, the first row can include a first button, a second button, a fifth button, and a sixth button.
- the second row can include a third button, a fourth button, a seventh buttons, and an eighth button. More specifically, the fifth and sixth buttons can both be located between the first and second buttons. As well, the third and seventh buttons can both be located between the fourth and eighth buttons.
- the first button can include a toggle button. Pressing the first button can result in the remote computing gadget playing a visual portion archive. As well, pressing the first button again can pause the visual portion archive from playing. Furthermore, pressing the second button can cause the visual speed of the visual portion archive to decrease while keeping the sound frequency of the musical music playing tool intact. Also, pressing the third button can assign a start repeating effect point and pressing the fourth button can assign an end repeating effect point where after, the first user can be prompted to save the repeating effect.
- the seif-learn music system module can include eight input fields.
- Each input field can represent a button on the self-learn music system, whereby each input field can be adapted to be assigned with a self-learn music system function. Pressing the respective self-learn music system button can correspond to the input field causing the processor to perform the function assigned to the corresponding input field. For example, if the first user has assigned play/ pause function to the input field that corresponds to the seventh buttons, then pressing on the seventh buttons causes the visual portion to either pause or play.
- Embodiments of the present invention can also be directed to a computer-implemented method for assisting a first user in learning a musical sequence. Methods can include decreasing the visual speed of a synchronized sound portion-visual portion output of a visual portion archive such that, the sound portion remains in sound frequency.
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB2009628.5A GB2583277A (en) | 2018-03-24 | 2019-03-26 | Systems and methods for music and moving image interaction |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201816362658A | 2018-03-24 | 2018-03-24 | |
US16/362,658 | 2018-03-24 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019186396A1 true WO2019186396A1 (en) | 2019-10-03 |
Family
ID=68062340
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2019/052447 WO2019186396A1 (en) | 2018-03-24 | 2019-03-26 | Systems and methods for music and moving image interaction |
Country Status (2)
Country | Link |
---|---|
GB (1) | GB2583277A (en) |
WO (1) | WO2019186396A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20060072112A (en) * | 2006-06-07 | 2006-06-27 | 엄태호 | Music creation technique using variation of shape and arrangement of the guard rail |
CN201294089Y (en) * | 2008-11-17 | 2009-08-19 | 音乐传奇有限公司 | Interactive music play equipment |
CN101604486A (en) * | 2008-06-12 | 2009-12-16 | 王涛 | Musical instrument playing and practicing method based on speech recognition technology of computer |
CN101937670A (en) * | 2010-08-05 | 2011-01-05 | 甄生明 | Method and device for displaying and making music |
JP2011022599A (en) * | 2010-09-06 | 2011-02-03 | Yamaha Corp | Device for reproducing information of musical performance |
CN105206136A (en) * | 2014-05-26 | 2015-12-30 | 南京专创知识产权服务有限公司 | Novel guitar learning method based on hand shape teaching |
-
2019
- 2019-03-26 GB GB2009628.5A patent/GB2583277A/en not_active Withdrawn
- 2019-03-26 WO PCT/IB2019/052447 patent/WO2019186396A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20060072112A (en) * | 2006-06-07 | 2006-06-27 | 엄태호 | Music creation technique using variation of shape and arrangement of the guard rail |
CN101604486A (en) * | 2008-06-12 | 2009-12-16 | 王涛 | Musical instrument playing and practicing method based on speech recognition technology of computer |
CN201294089Y (en) * | 2008-11-17 | 2009-08-19 | 音乐传奇有限公司 | Interactive music play equipment |
CN101937670A (en) * | 2010-08-05 | 2011-01-05 | 甄生明 | Method and device for displaying and making music |
JP2011022599A (en) * | 2010-09-06 | 2011-02-03 | Yamaha Corp | Device for reproducing information of musical performance |
CN105206136A (en) * | 2014-05-26 | 2015-12-30 | 南京专创知识产权服务有限公司 | Novel guitar learning method based on hand shape teaching |
Also Published As
Publication number | Publication date |
---|---|
GB2583277A (en) | 2020-10-21 |
GB202009628D0 (en) | 2020-08-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Yin et al. | Digital violin tutor: an integrated system for beginning violin learners | |
Howard et al. | The diversification of music teacher education: Six vignettes from a movement in progress | |
Lech et al. | Testing a novel gesture-based mixing interface | |
Tomlinson et al. | Auditory display in interactive science simulations: Description and sonification support interaction and enhance opportunities for learning | |
Comeau et al. | On-site and distance piano teaching: An analysis of verbal and physical behaviours in a teacher, student and parent | |
Ho et al. | Development of a computer‐based visualised quantitative learning system for playing violin vibrato | |
Yang | Modern piano teaching technologies: Accessibility, effectiveness, the need for pedagogues. | |
Zhang | Multi-sensory research of singing visualization in pre-school music education | |
Yu et al. | Promoting musical instrument learning in virtual reality environment: Effects of embodiment and visual cues | |
Kullenberg et al. | Learning and knowing songs: a study of children as music teachers | |
KR100894866B1 (en) | Piano tuturing system using finger-animation and Evaluation system using a sound frequency-waveform | |
Zhukov | Exploring the role of technology in instrumental skill development of Australian higher education music students | |
Theodorou et al. | ICTs and music in sensory and motor disabilities | |
US10971028B2 (en) | Systems and methods for music and moving image interaction | |
WO2019186396A1 (en) | Systems and methods for music and moving image interaction | |
US10593366B2 (en) | Substitution method and device for replacing a part of a video sequence | |
KR20030065259A (en) | Apparatus and method of learnning languages by sound recognition and sotring media of it | |
Konecki | Self-paced computer aided learning of music instruments | |
Ariga et al. | Strummer: An interactive guitar chord practice system | |
Ahlstrand et al. | Learning study-a model for practice-based research in a Swedish theatre classroom | |
Rasmussen | E-learning for choral conductors: a study of how e-learning can be used to change the way we teach and learn conducting | |
Yun et al. | Understanding the potential of music learning application as a tool for learning and practicing musical skills | |
Ernits et al. | Problems of music education for blind and visually impaired people in Estonia | |
Sasaki et al. | Impression‐oriented music courseware and its application in elementary schools | |
Huang et al. | The Effect of Computer-Assisted Instruction on Piano Education: An Experimental Study of Students of biological sciences |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19776499 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 202009628 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20190326 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19776499 Country of ref document: EP Kind code of ref document: A1 |