WO2005022509A1 - Device for displaying sheet music - Google Patents

Device for displaying sheet music Download PDF

Info

Publication number
WO2005022509A1
WO2005022509A1 PCT/IB2004/051546 IB2004051546W WO2005022509A1 WO 2005022509 A1 WO2005022509 A1 WO 2005022509A1 IB 2004051546 W IB2004051546 W IB 2004051546W WO 2005022509 A1 WO2005022509 A1 WO 2005022509A1
Authority
WO
WIPO (PCT)
Prior art keywords
music
sheet music
played
displayed
indicator
Prior art date
Application number
PCT/IB2004/051546
Other languages
French (fr)
Inventor
Ruediger J. Lange
Ronaldus M. Aarts
Martinus S. Nielen
Bartel M. Van De Sluis
Vincentius P. Buil
Frank A. Van Abeelen
Michel C. J. M. Vissenberg
Fransiscus J. Vossen
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2005022509A1 publication Critical patent/WO2005022509A1/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B15/00Teaching music
    • G09B15/02Boards or like means for providing an indication of notes
    • G09B15/023Electrically operated
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0008Associated control or indicating means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0033Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0041Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
    • G10H1/0058Transmission between separate instruments or between individual components of a musical system
    • G10H1/0066Transmission between separate instruments or between individual components of a musical system using a MIDI interface
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/366Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/005Non-interactive screen display of musical or status data
    • G10H2220/015Musical staff, tablature or score displays, e.g. for score reading during a performance.

Definitions

  • the invention relates to a device having a display screen and means for displaying sheet music on the display screen and having a means for advancing of the displayed sheet music.
  • Such a device is known from for instance the MusicPad Pro, an electronic device obtainable from Freehand Systems Inc. for displaying sheet music, see e.g. www.freehandsystems.com/musicpad_pro.html.
  • the device displays on an electronic display sheet music.
  • the sheet music can be entered into the device electronically.
  • Turning the pages has been a problem for musicians, especially for those still learning to play music.
  • the MusicPro Pad has a means for changing relatively easily the pages, by touching the screen, or by means of a foot pedal.
  • the known device offers a relative improvement in so far as turning the pages is concerned, there still remains room for improvement.
  • the device comprises a means for recording music while it is played, an analyzer/comparator for analyzing the recorded music to establish the temporal correspondence between with the recorded music and the displayed sheet music, for generating an indicator signal to indicate the temporal correspondence between the played music and the displayed music, means for advancing the displayed sheet music in dependence on the indicator signal.
  • an electronic equivalent of turning the pages is used, i.e. the musician must turn the page manually or by foot and by a deliberate action.
  • the device is provided with a recording and analyzing means which records the music as it is played and analyses the recorded music for comparing it to the displayed sheet music and establishing the temporal correspondence, i.e. which notes the musician has just played. Because of the indicator signal, the device is able to keep track of which part of the sheet music is played and to advance the sheet music accordingly.
  • the indicator signal may comprise a temporal position of the currently played music in the reference of the sheet music.
  • the device preferably also comprises a means to display an indicator on the displays screen to indicate the temporal correspondence between the played music and the displayed music. This enables the musician to know what part of the score he has just played or is playing. Usually, of course, the musician knows this even if it is not indicated, but it serves as a reminder for the musician. Also it serves as a pre-warning that the page will be advanced or turned. It supports the musician especially in situations that visual attention is switched between the musical instrument and the musical score, as apprentice players often do.
  • the sheet music is advanced by scrolling through the sheet music.
  • the sheet music is advanced page-by-page.
  • the means for recording comprise a microphone.
  • the means for recording could be or comprise a plug-in for plugging in an electronic musical instrument, in which case the analyzer would analyze the incoming signal on the basis of the electronic signal coming from the electronic musical instrument, in preferred embodiments the device comprises a microphone for recording the music.
  • Many instruments are not electronic, and if a cord is used between the device and the musical instrument the freedom of movement of the musician is restricted.
  • the plug-in is a wire-less plug-in, i.e. the signals are sent wireless, the restriction on the freedom of movement is of course less. Especially for apprentices use is often made of non-electrical instruments and it is preferred that the device comprises a microphone coupled to the analyzer.
  • a recording device having a means for electronically recording signals specific for one instrument (such as may be possible by sending electronic decoded signals from one instrument to the device) is preferred.
  • a preferred embodiment of the device thus has a microphone as well as means for electronically and preferably wireless recording of signals from musical instruments.
  • a device in accordance with the invention has a microphone or more than one it preferably comprises a means for recording a gauge set of musical data.
  • the device comprises means for establishing a gauge set of notes.
  • a musical instrument is played (as is often the case) with a fixed set of chords (such a for instance a chord instrument) analysis of the music played in strongly improved by making use of a gauge set of signals.
  • the device preferably comprises a learning mode in which a number of chords are hit on for example the piano or more in general played on an instrument. The so recorded musical data form a reference set of data.
  • the signals are analyzed and compared to the sheet music.
  • the device comprises means for displaying one or more difference indicators on the display. Analyzing the recorded sound enables to find the temporal correspondence, but also any difference between characteristics of the sheet music (tempo, loudness, etc. etc.) and the recorded music and to indicate them on the display screen. So the signal Ts may comprises several components for instance Is(t, note, loudness, spectral components etc). The t would then indicate the position in the sheet music.
  • Indicating different aspects may be done on a separate position by a separate indicator, however, preferably they are done on or near the displayed position/temporal indicator.
  • the device comprises a means for selection of the difference indicator(s) to be displayed. Too many displayed difference indicators might confuse the player or even discourage them. A teacher or the musician may thereby control and thereby emphasize those aspects he/she wishes the pupil to concentrate upon. E.g. only the loudness indicators are displayed. Also when use is made of a further display screen the teacher or the musician may monitor the errors made by the pupil.
  • the difference indicators may be displayed by a characteristic of the position indicator, for instance in the color (e.g.
  • the invention also relates to a system comprising a coupled set of more than one device as claimed.
  • Fig. 1 illustrates an embodiment of the basic display device on which a sheet of sheet music is displayed.
  • Fig. 2 illustrates some elements of a device in accordance with the invention.
  • Fig. 3 illustrates an embodiment of the device in accordance with the invention.
  • Fig. 4 illustrates a part of a further embodiment of the device in accordance with the invention.
  • the figs are not drawn to scale. Generally, identical components are denoted by the same reference numerals in the figs.
  • Fig. 1 illustrates a device in accordance with the invention.
  • the device 1 comprises a display screen 2 for displaying sheet music.
  • the device comprises means for importing or downloading sheet music data in electronic form. This may be done in any convenient or known matter, such as by a disk or CD-rom reader, or a link to the internet.
  • the device comprises a means for recording music while it is being played.
  • the recording means may be and in preferred embodiments is a microphone 3 (or more than one microphone) or a means for receiving music in an electronic form 6.
  • actuators which measure the produced sound, e.g. one or more sensors on the strings of an electrical guitar which could communicate wireless with the device (e.g. by Bluetooth technology).
  • the information on the music being played may thus be received as a sound wave via the microphone(s) 3, or electronically via an input 6.
  • Electronically the music may be received through a plug-in and via a wire connected to an electronic musical instrument or in a wireless manner.
  • the device may also comprise buttons for controlling various functions. The functions may also be controlled by means of a keyboard 5 enabling the user to communicate with the device.
  • the screen may be a touch screen.
  • a further microphone 4 may be provided, for better picking up the played music.
  • Fig. 2 illustrates more in detail various elements of the device in accordance with the invention.
  • the core of the device is formed by a recorder 3, 6 for recording music while it is being played, an analyzer/comparator 11 for analyzing the music with a standard derived from sheet music.
  • the comparator/comparator 11 may e.g. be realized as a set of audio processing algorithms running on a DSP.
  • the device comprises a means for providing sheet music data comparative to a piece of sheet music displayed on the screen 2 of the display 1.
  • the device may have an input 13 for providing data on sheet music. Using an input it is possible to download sheet music.
  • the device may have a built-in library with sheet music (different display devices may be sold, e.g. one which comprises the most popular classical music) or a means to insert a library, for instance on a disk or smart card, or a means to couple the device to a external library, e.g. via an internet link.
  • the comparator-comparator analyses and compares the music while it is being played with the data on the sheet music and provides an indicator signal Is.
  • the indicator signal Is is sent (as is visual data on the sheet music) to the means 15 for addressing the display.
  • the sheet music is displayed as well as (in preferred embodiments) an indicator 16, which indicates the temporal correspondence between the sheet music and the music being played (or actually which just has been played). In this manner the musician is able to know just where he/she is.
  • the page is turned. To this end the device may have means for indicating that a change of page is imminent, e.g. an arrow 17, which starts to flash when a page change is imminent.
  • the indicator 16 is a preferred embodiment, since within the broadest concept of the invention, turning or advancing of the sheet music may be performed automatically without an indicator being shown on the screen. In such circumstances it may be helpful if the device comprises the indicator 17 to indicate an imminent turning of the page. The musician is then not surprised by the fact that the page is turned. A similar function may be preferred in embodiments in which the musician or user has the option to prevent showing of the indicator 16.
  • the device comprises means for advancing the displayed sheet music in dependence on the indicator signal Is. Besides scrolling and turning pages, which are preferred embodiments, alternative solution embodiments are possible, such as showing a number of lines from the next page, when the current position approaches the end of a page.
  • the scrolling embodiment is a natural way to present the musical score, and is preferred over the sometimes somewhat clumsy turning of the pages.
  • Scrolling can be done in a number of ways, e.g. in one of the following ways: Smooth continuous scrolling in exactly the tempo the musician is currently playing. - Scrolling at the speed of the tempo as intended by the composer (by interpreting terms such as Andante, Moderato, Allegrissimo). The player is expected to keep up the playing speed with the scrolling. In this embodiment the speed is controlled to match as much as possible the intended speed. However, if the player would lack behind (plays to slow), the sheet music could advance so fast that the player looses track of the sheet music.
  • the signal Is is used to control the scrolling such that the sheet music does not advance so fast that the player looses track.
  • One way of accomplishing this is to have the central part of the display screen displaying the part of the music that is to be played. A difference in tempo between the intended and actual tempo will shift the part of the music that is played from the central part of the screen upwards or downwards.
  • the musician is playing is performed to prevent the player loosing track of the sheet music.
  • the position of the sheet music being played on the screen and changes of that position would then be an indication to the player of the difference between the intended tempo and his/her own tempo.
  • the part of the music he/she is playing should be displayed at the central (or any designated part) of the display screen. If he/she plays to slow or too fast, the part that is being played starts to drift away from its present position upwards or downwards. The player plays in the right tempo when the position of the line that is being played remains more or less steady on the screen. It may be preferred to shift the line ' being played to the center of the screen from time to time. - Scrolling in segments: line by line, or segment (# lines) by segment.
  • the means 15a to advance the sheet music (which may be done by scrolling the sheet music or by turning the page) may form a part of the addressing means or be indirectly or directly coupled to the addressing means or form a separate element.
  • Tt is also possible that a second indicator signal is provided derived from the indicator signal Is to advance the sheet music.
  • the device has in preferred embodiments a controller (19) to control the analyzer/comparator for controlling the function(s) of the indicator signal and/or the manner in which the indicator are shown on the display.
  • the analyzer is ordered to evaluate tempo and pitch only, and only the tempo indicator is displayed.
  • the indicator indicates the position vis-a-vis the sheet music, but in preferred embodiments more than one indicators 16 may be shown to indicate more differences or correspondences between characteristics of the sheet music and the music being played, such as tempo, loudness etc.
  • Via input means such as e.g. buttons or by means of remote control signals what is shown on the screen may be controlled.
  • the difference indicators may be displayed by a characteristic of the position indicator, for instance in the color (e.g. for the frequency: green is good, yellow is acceptable, red is off) and/or size (for instance for strength: the larger the size the loader one plays in respect of the "best” strength, and a certain standard size corresponds to the "best” choice) and/or form (for instance a shape which becomes the more asymmetric if one lags behind or runs ahead of the displayed music, where the shape is perfectly symmetric (round for instance) when one follows perfectly in step with the displayed music. This allows the pupil or the musician or the teacher to immediately see where there are deviations from the sheet music and in what sense.
  • a characteristic of the position indicator for instance in the color (e.g. for the frequency: green is good, yellow is acceptable, red is off) and/or size (for instance for strength: the larger the size the loader one plays in respect of the "best” strength, and a certain standard size corresponds to the "best” choice) and/or form (for instance a shape
  • the device comprises a control for controlling the display characteristics of the indicator on the display screen. Controlling may be done prior to analysis, in which case the analysis is only partial (for instance on only a limited number of characteristics or alternatively, the analysis may be complete, and in principle all data are collected and calculated but the control is performed at the display level, i.e. the indicator signal does not show everything so as not to confuse the musician.
  • Setting of the controller may be done by via the keyboard 5, or, in the case where a system of coupled devices is used, the teacher may, via the keyboard on his/her device, control the controller of the pupil's device.
  • the device preferably comprises a means 18 for storing the recorded music, the sheet music and the indicator signals. Storing the recorded music with indicator signals enables a replay of the music. Then the next time the musician plays, the indicator may already show passages which the musician found difficult to play, e.g. because the previous n times he failed playing them reasonably according to a particular criterion, and more specifically, which types of error the musician typically makes. In particular in such circumstances it is useful if the stored analysis/comparison data is complete, even if the indicator is simplified. It is then possible to record the music, including a full analysis, while concentrating during playing on one aspect (e.g. tempo). The stored music may be, via a controller, later replayed via a speaker 4.
  • the stored visual data is sent to the addressing means. This allows the musician to replay the stored music and select (via the control 19) which aspect or aspect(s) the indicator signal during replay is to indicate. So while recording the music and being able to immediately follow one aspect (tempo), the musician can thereafter follow just what errors are made in different aspects (e.g. tone) during a replay. During replay the different notes played may be made visible, wherein for instance the "well played” notes are, while the music is replayed, made green, while the "false notes” are made red. While listening to the music the pupil will immediately see which parts of the music are played correctly and where the errors were made.
  • the device does the following: Capture the sound (by means of a microphone or microphones 3) or the electronic signals corresponding to the sound (by an input 6) analyze the captured sound/electronic signals compare the results of the analysis to the sheet music (possibly in the form of an electronic file corresponding to the sheet music), the latter steps may be performed simultaneously.
  • the difference indicators may be displayed by a characteristic of the position indicator, for instance in the color (e.g. for the frequency: green is good, yellow is acceptable, red is off) and/or size (for instance for strength: the larger the size the loader one plays in respect of the "best” strength, and a certain standard size corresponds to the "best” choice) and/or form (for instance a shape which becomes the more asymmetric if one lags behind or runs ahead of the displayed music, where the shape is perfectly symmetric (round for instance) when one follows perfectly in step with the displayed music. This allows the pupil or the musician or the teacher to immediately see where there are deviations from the sheet music and in what sense.
  • a characteristic of the position indicator for instance in the color (e.g. for the frequency: green is good, yellow is acceptable, red is off) and/or size (for instance for strength: the larger the size the loader one plays in respect of the "best” strength, and a certain standard size corresponds to the "best” choice) and/or form (for instance a shape
  • - musical notation deviations can sometimes be indicated by musical notation. For instance, if the played music exactly differs a semitone from the musical score, this can be presented in musical notation (e.g. the played tone can be displayed in red and on top of the original note). In a similar way sharp/flat notes in the key of the musical piece can be reminded to the player if he forgets to play those.
  • - off-key notes notes that are played off-key (out of tune) require a non- musical notation to be displayed on the score.
  • - arrow up or down an arrow can indicate deviations in pitch.
  • the direction of the arrow indicates whether it is played too low or too high, whereas the length of the arrow can indicate the amount of deviation
  • note durations - musical notation: deviations in duration can be indicated with musical notation. For instance, if a half rest is played where a full rest is in the score, this can be presented in musical notation (see examples above), e.g., overlaid on top of the original rest in the score.
  • tempo - tempo indicator: if the overall tempo of a musical work is too low or too high this can be indicated by a tempo indicator at a side of the screen.
  • an indicator can show the difference between the played tempo and the tempo intended by the composer (e.g. +15 when played too fast, or -3 when played somewhat to slow).
  • the tempo may be identified by looking for tone onsets in the temporal domain where the audio power starts rising.
  • - moving line when the musician starts playing, a vertical line moving through the score can indicate the intended tempo to the musician.
  • the device comprises a means for remote control of these difference indicators, e.g. in the form of interaction means (input means) for controlling these indicators.
  • the input means can be soft on-screen controls, hard buttons, remote control, voice control, keyboard etc.
  • the device or system has means to select the parameters (indicators) for which feedback is required or desired.
  • the device or system could automatically present feedback on only those parameters that have the largest difference with the sheet music. The attention of the pupil would then be directed to those aspects of his/her play which need the most attention.
  • the system could also take account on how often the piece has been practiced already, and how long ago for the last time (e.g., in the beginning only info on note and duration deviations, and later on also tempo and note-intensity feedback when the player is more practiced on the piece).
  • the indicators may be displayed on the display screen which displays the sheet music, in alternative embodiments one display screen could be used for sheet music and annotations only and feedback could be provided on a further display screen (status screen). In an alternative embodiment visual feedback could be provided with indicators next to the display for displaying the sheet music, e.g. colored LEDs, each LED or each sets of LEDs indicating a difference particular.
  • a split screen i.e. one part of the display screen showing the sheet music, the other the indicators is also possible.
  • the user can touch on a particular position (providing the device, as in preferred embodiments has a touch screen) to playback music starting from that particular position and possible also to a particular position, i.e. by selecting the start and possibly also the end of the music to be played back.
  • a touch screen it is also possible by repeatedly touching the screen at the indication marks 16 to alter the indication marks, for instance change the characteristic from a tempo difference indication to a tone difference indication.
  • Figure 3 illustrates a preferred embodiment of lhc invention in which the display device comprises an output 18 for outputting electronic data on the sheet music and the indicator signal. The advantage of such an output is that it is possible to monitor a pupil.
  • the result would be a system of coupled devices, for instance one or more device 30 used by one or more pupils coupled to a "master device" 32 for a teacher.
  • a "master device" 32 for a teacher In figure 3 such a situation is illustrated.
  • An indicator 16 is displayed on the screen visible for the pupil.
  • This indicator on the display screen visible to the pupil displays only some of the results of the analysis, so as not to confuse the pupil so that he/she may concentrate on a particular aspect that needs his/her attention.
  • This aspect may be a pre-chosen one or the aspect which differs most from the standard.
  • the full analysis data is sent and displayed on a second display device for the teacher, schematically shown is a star on the right hand screen. This allows the teacher a full understanding of the progress (or regress) the pupil is making.
  • Figure 4 illustrates a part of a device in accordance with a preferred embodiment.
  • the analysis of the device is made relatively easier if use is made of gauge signals.
  • Most musical instruments produce a quite complex sound with overtones.
  • the device is able to record gauge tones. These gauge tones can be used in the analysis.
  • Figure 4 illustrates such a scheme.
  • the device comprises a gauge set by which a set of gauge music may be recorded. This gauge set is used in the analysis.
  • the recorded sound is not directly compared with the sheet music, but rather a MIDI file (or more in general any file format) is co-downloaded with the sheet music, or produced in the device when the sheet music is downloaded.
  • a MIDI file or more in general any file format
  • the Midi (or more in general an electronic file) file comprises the music as well as the spectral information for a particular instrument. It is the electronic file corresponding to the sheet music that is compared to the recorded music (or the recorded music is compared to the electronic file). Information obtained may comprises timing as well as notes as well as volume.
  • a user plays a few chords on a piano corrcclly (right tempo, right notes, r ⁇ _l ⁇ l L> ⁇ .l,'ic c etc.).
  • the stored spectral and temporal information is used as a gauge set of information.
  • One possible manner is e.g. an embodiment in which the device imports or creates on the basis of • the sheet music a Midi or other type of electronic file. This Midi will then comprise by necessity the spectral information of a particular instrument, e.g. a particular piano, or an 'average' piano. This will, however, not be the piano that is actually used, and the music will not be recorded in the manner as the particular device records the music played.
  • the device will notice differences between the information it has on file and the recorded music. This will even be the case if the player plays the music flawlessly and exactly as the same instrument with exactly the same tuning is used, simply because the music is played in a different room, the position of the microphone vis-a-vis the piano is different.
  • the device can correct for these differences, e.g. by changing the Midi file to take these differences into account (writing a new Midi file), or by creating a gauge set of error indicators or a gauge indicator signal which indicate a "correct" playing of the music.
  • any piece of hard -ware such a controller, advancer, recorder, any circuit or sub-circuit designed for performing a control, advance, recording as described as well as any piece of soft- ware (computer program or sub program or set of computer programs, or program code(s)) designed or programmed to control, advance, record in a cnrcl nce with the invention as well as any combination of pieces of hardware and software acting as such, alone or in combination, without being restricted to the above or below given exemplary embodiments.
  • one or more microphones 3 where within the concept of the invention a microphone is any sound wave recording device, may be used.
  • the analyzer 11 may comprise a sound-data- improvement means (such as an echo or reverberation canceller) or such a sound- improvement means may be provided in between the recorder 3, 6 (for instance one or more microphones) and the analyzer 11.
  • the analyzer may comprise for analyzing several function several filters, for instance a filter which passes those frequency ranges with which the tempo can best be identified, and other filters by which the tone may best be identified.
  • the device and system preferably comprise means adapt to different tunings of musical instruments. For instance, a violin may be tuned in Concert A (440Hz) or in an old classical tuning (438Hz).
  • the learning mode i.e. a mode in which a player plays a few chords and the recorded information is used to create a file.
  • a more straightforward manner would be a type of input device or program by which the player can identify the tuning (e.g. by typing "violin tuned in Concert A" on a key board connected or integrated into the device).
  • the device and system also has means for 'pitch control' tuning (beats per minute).
  • the device and system preferably has means to remember (store) the deviations of the last time played and show them when playing the piece another time. Alternatively, the system keeps a log of all the deviations that the player can view separately.
  • the system preferably has means to personalize these data (e.g. a means to tag these data with an electronic name). If multiple players use the device with the same piece of music this tagging will be useful. An apprentice does not always (re)start at the beginning of the music piece.
  • the system preferably has means to enable the user to indicate the position where he intends to start. This helps the system in finding the current po-.ili.in.
  • the device and s stem preferably has means for enabling a user to indicate that he wants to start recording from only a certain position. Repetitions in the musical score usually complicate the user's navigation through the sheet music (paging back and forward). Electronic music books are expected to contain the linear musical score exactly as how to be played.
  • the device and system preferably has means for 'Query by playing', i.e. playing a particular phrase of a music piece can also be used to retrieve its musical score, or a particular segment in the current musical score. Playing a tone or a particular tune on the instrument can be used to activate also a gauge set.
  • the device and system preferably also has means for a transposition of the sheet music (raising or lowering the notes).
  • the invention is also embodied in any computer program comprising program code means for performing a method in accordance with the invention when said program is run on a computer as well as in any computer program product comprising program code means stored on a computer readable medium for performing a method in accordance with the invention when said program is run on a computer, as well as any program product comprising program code means for use in a device or system in accordance with the invention, for performing the action specific for the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Auxiliary Devices For Music (AREA)

Abstract

A device (1) has a display screen (2) and means for displaying sheet music on the display screen. It has a means for advancing of the displayed sheet music, wherein the device comprises a means (3, 6) for recording music while it is played, an analyzer/comparator (11) for analyzing the recorded music to establish the temporal correspondence between the recorded music and the displayed sheet music, for generating an indicator signal Is to indicate the temporal correspondence between the played music and the displayed music, and means for advancing the displayed sheet music in dependence on the indicator signal Is.

Description

Device for displaying sheet music
The invention relates to a device having a display screen and means for displaying sheet music on the display screen and having a means for advancing of the displayed sheet music.
Such a device is known from for instance the MusicPad Pro, an electronic device obtainable from Freehand Systems Inc. for displaying sheet music, see e.g. www.freehandsystems.com/musicpad_pro.html. The device displays on an electronic display sheet music. The sheet music can be entered into the device electronically. Turning the pages has been a problem for musicians, especially for those still learning to play music. The MusicPro Pad has a means for changing relatively easily the pages, by touching the screen, or by means of a foot pedal. Although compared to real sheet music, it might be said that the known device offers a relative improvement in so far as turning the pages is concerned, there still remains room for improvement.
It is therefore an object of the invention to provide a more user-friendly device as described in the opening paragraph. To this end the device comprises a means for recording music while it is played, an analyzer/comparator for analyzing the recorded music to establish the temporal correspondence between with the recorded music and the displayed sheet music, for generating an indicator signal to indicate the temporal correspondence between the played music and the displayed music, means for advancing the displayed sheet music in dependence on the indicator signal. In the known device an electronic equivalent of turning the pages is used, i.e. the musician must turn the page manually or by foot and by a deliberate action. Although the manner in which this may be done (touching the screen or using a foot pedal) might possibly be less disturbing than the old-fashioned turning of the pages of the music book, it still distracts the musician and it is possible that more than one page is turned. The distraction may cause the musician (especially an apprentice) to loose track of the score. In the present invention this problem is resolved or at least strongly reduced. The device is provided with a recording and analyzing means which records the music as it is played and analyses the recorded music for comparing it to the displayed sheet music and establishing the temporal correspondence, i.e. which notes the musician has just played. Because of the indicator signal, the device is able to keep track of which part of the sheet music is played and to advance the sheet music accordingly. In its most basic form, the indicator signal may comprise a temporal position of the currently played music in the reference of the sheet music. The device preferably also comprises a means to display an indicator on the displays screen to indicate the temporal correspondence between the played music and the displayed music. This enables the musician to know what part of the score he has just played or is playing. Usually, of course, the musician knows this even if it is not indicated, but it serves as a reminder for the musician. Also it serves as a pre-warning that the page will be advanced or turned. It supports the musician especially in situations that visual attention is switched between the musical instrument and the musical score, as apprentice players often do. In an embodiment the sheet music is advanced by scrolling through the sheet music. Although this is a somewhat unorthodox manner of advancing the sheet music, it does have the advantage that the part that is actually played may be positioned at a fixed point or zone on the display screen, showing a past few lines and a few coming lines. In an embodiment of the invention the sheet music is advanced page-by-page. In a preferred embodiment the means for recording comprise a microphone. Although the means for recording could be or comprise a plug-in for plugging in an electronic musical instrument, in which case the analyzer would analyze the incoming signal on the basis of the electronic signal coming from the electronic musical instrument, in preferred embodiments the device comprises a microphone for recording the music. Many instruments are not electronic, and if a cord is used between the device and the musical instrument the freedom of movement of the musician is restricted. If the plug-in is a wire-less plug-in, i.e. the signals are sent wireless, the restriction on the freedom of movement is of course less. Especially for apprentices use is often made of non-electrical instruments and it is preferred that the device comprises a microphone coupled to the analyzer. On the other hand, when many instruments are used simultaneously, a recording device having a means for electronically recording signals specific for one instrument (such as may be possible by sending electronic decoded signals from one instrument to the device) is preferred. A preferred embodiment of the device thus has a microphone as well as means for electronically and preferably wireless recording of signals from musical instruments. When a device in accordance with the invention has a microphone or more than one it preferably comprises a means for recording a gauge set of musical data. It is sometimes in advance not known what instrument will be played, nor where the instrument is positioned in respect of the microphone. Preferably the device comprises means for establishing a gauge set of notes. When a musical instrument is played (as is often the case) with a fixed set of chords (such a for instance a chord instrument) analysis of the music played in strongly improved by making use of a gauge set of signals. To do so, the device preferably comprises a learning mode in which a number of chords are hit on for example the piano or more in general played on an instrument. The so recorded musical data form a reference set of data. The signals (whether audio signals recorded via a microphone or electronic signals receiver via a plug-in connected to an electronic musical instrument or via a wireless connection from an electronic musical instrument) are analyzed and compared to the sheet music. In preferred embodiments the device comprises means for displaying one or more difference indicators on the display. Analyzing the recorded sound enables to find the temporal correspondence, but also any difference between characteristics of the sheet music (tempo, loudness, etc. etc.) and the recorded music and to indicate them on the display screen. So the signal Ts may comprises several components for instance Is(t, note, loudness, spectral components etc). The t would then indicate the position in the sheet music. Indicating different aspects may be done on a separate position by a separate indicator, however, preferably they are done on or near the displayed position/temporal indicator. Preferably the device comprises a means for selection of the difference indicator(s) to be displayed. Too many displayed difference indicators might confuse the player or even discourage them. A teacher or the musician may thereby control and thereby emphasize those aspects he/she wishes the pupil to concentrate upon. E.g. only the loudness indicators are displayed. Also when use is made of a further display screen the teacher or the musician may monitor the errors made by the pupil. The difference indicators may be displayed by a characteristic of the position indicator, for instance in the color (e.g. for the frequency: green is good, yellow is acceptable, red is off) and/or size (for instance for strength: the larger the size the loader one plays in respect of the "best" strength, and a certain standard size corresponds to the "best" choice) and/or form (for instance a shape which becomes the more asymmetric if one lags behind or runs ahead of the displayed music, where the shape is perfectly symmetric (round for instance) when one follows perfectly in step with the displayed music. This allows the pupil or the musician or the teacher to immediately see where there are deviations from the sheet music and in what sense. These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter. The invention also relates to a system comprising a coupled set of more than one device as claimed.
In the drawings: Fig. 1 illustrates an embodiment of the basic display device on which a sheet of sheet music is displayed. Fig. 2 illustrates some elements of a device in accordance with the invention. Fig. 3 illustrates an embodiment of the device in accordance with the invention. Fig. 4 illustrates a part of a further embodiment of the device in accordance with the invention. The figs, are not drawn to scale. Generally, identical components are denoted by the same reference numerals in the figs.
Fig. 1 illustrates a device in accordance with the invention. The device 1 comprises a display screen 2 for displaying sheet music. To this end, although not explicitly shown here, the device comprises means for importing or downloading sheet music data in electronic form. This may be done in any convenient or known matter, such as by a disk or CD-rom reader, or a link to the internet. The device comprises a means for recording music while it is being played. The recording means may be and in preferred embodiments is a microphone 3 (or more than one microphone) or a means for receiving music in an electronic form 6. For instance, use could be made of actuators which measure the produced sound, e.g. one or more sensors on the strings of an electrical guitar which could communicate wireless with the device (e.g. by Bluetooth technology). The information on the music being played may thus be received as a sound wave via the microphone(s) 3, or electronically via an input 6. Electronically the music may be received through a plug-in and via a wire connected to an electronic musical instrument or in a wireless manner. The device may also comprise buttons for controlling various functions. The functions may also be controlled by means of a keyboard 5 enabling the user to communicate with the device. The screen may be a touch screen. A further microphone 4 may be provided, for better picking up the played music. Fig. 2 illustrates more in detail various elements of the device in accordance with the invention. The core of the device is formed by a recorder 3, 6 for recording music while it is being played, an analyzer/comparator 11 for analyzing the music with a standard derived from sheet music. The comparator/comparator 11 may e.g. be realized as a set of audio processing algorithms running on a DSP. To this end the device comprises a means for providing sheet music data comparative to a piece of sheet music displayed on the screen 2 of the display 1. The device may have an input 13 for providing data on sheet music. Using an input it is possible to download sheet music. Alternatively or in addition the device may have a built-in library with sheet music (different display devices may be sold, e.g. one which comprises the most popular classical music) or a means to insert a library, for instance on a disk or smart card, or a means to couple the device to a external library, e.g. via an internet link. The comparator-comparator analyses and compares the music while it is being played with the data on the sheet music and provides an indicator signal Is. The indicator signal Is is sent (as is visual data on the sheet music) to the means 15 for addressing the display. On the display screen the sheet music is displayed as well as (in preferred embodiments) an indicator 16, which indicates the temporal correspondence between the sheet music and the music being played (or actually which just has been played). In this manner the musician is able to know just where he/she is. When the end of the page is reached, the page is turned. To this end the device may have means for indicating that a change of page is imminent, e.g. an arrow 17, which starts to flash when a page change is imminent. The indicator 16 is a preferred embodiment, since within the broadest concept of the invention, turning or advancing of the sheet music may be performed automatically without an indicator being shown on the screen. In such circumstances it may be helpful if the device comprises the indicator 17 to indicate an imminent turning of the page. The musician is then not surprised by the fact that the page is turned. A similar function may be preferred in embodiments in which the musician or user has the option to prevent showing of the indicator 16. The device comprises means for advancing the displayed sheet music in dependence on the indicator signal Is. Besides scrolling and turning pages, which are preferred embodiments, alternative solution embodiments are possible, such as showing a number of lines from the next page, when the current position approaches the end of a page. The scrolling embodiment is a natural way to present the musical score, and is preferred over the sometimes somewhat clumsy turning of the pages. Scrolling can be done in a number of ways, e.g. in one of the following ways: Smooth continuous scrolling in exactly the tempo the musician is currently playing. - Scrolling at the speed of the tempo as intended by the composer (by interpreting terms such as Andante, Moderato, Allegrissimo). The player is expected to keep up the playing speed with the scrolling. In this embodiment the speed is controlled to match as much as possible the intended speed. However, if the player would lack behind (plays to slow), the sheet music could advance so fast that the player looses track of the sheet music. The signal Is is used to control the scrolling such that the sheet music does not advance so fast that the player looses track. One way of accomplishing this is to have the central part of the display screen displaying the part of the music that is to be played. A difference in tempo between the intended and actual tempo will shift the part of the music that is played from the central part of the screen upwards or downwards. When the upper part or the lower part of the screen is reached continuous scrolling of the sheet music in exactly the tempo the musician is playing is performed to prevent the player loosing track of the sheet music. The position of the sheet music being played on the screen and changes of that position would then be an indication to the player of the difference between the intended tempo and his/her own tempo. The part of the music he/she is playing should be displayed at the central (or any designated part) of the display screen. If he/she plays to slow or too fast, the part that is being played starts to drift away from its present position upwards or downwards. The player plays in the right tempo when the position of the line that is being played remains more or less steady on the screen. It may be preferred to shift the line'being played to the center of the screen from time to time. - Scrolling in segments: line by line, or segment (# lines) by segment. The means 15a to advance the sheet music (which may be done by scrolling the sheet music or by turning the page) may form a part of the addressing means or be indirectly or directly coupled to the addressing means or form a separate element. Tt is also possible that a second indicator signal is provided derived from the indicator signal Is to advance the sheet music. The device has in preferred embodiments a controller (19) to control the analyzer/comparator for controlling the function(s) of the indicator signal and/or the manner in which the indicator are shown on the display. For example the analyzer is ordered to evaluate tempo and pitch only, and only the tempo indicator is displayed. The indicator indicates the position vis-a-vis the sheet music, but in preferred embodiments more than one indicators 16 may be shown to indicate more differences or correspondences between characteristics of the sheet music and the music being played, such as tempo, loudness etc. Via input means, such as e.g. buttons or by means of remote control signals what is shown on the screen may be controlled. The difference indicators may be displayed by a characteristic of the position indicator, for instance in the color (e.g. for the frequency: green is good, yellow is acceptable, red is off) and/or size (for instance for strength: the larger the size the loader one plays in respect of the "best" strength, and a certain standard size corresponds to the "best" choice) and/or form (for instance a shape which becomes the more asymmetric if one lags behind or runs ahead of the displayed music, where the shape is perfectly symmetric (round for instance) when one follows perfectly in step with the displayed music. This allows the pupil or the musician or the teacher to immediately see where there are deviations from the sheet music and in what sense. However, too much information being shown on the display device may only lead to confusion on the part of the musician, therefore in preferred embodiments the device comprises a control for controlling the display characteristics of the indicator on the display screen. Controlling may be done prior to analysis, in which case the analysis is only partial (for instance on only a limited number of characteristics or alternatively, the analysis may be complete, and in principle all data are collected and calculated but the control is performed at the display level, i.e. the indicator signal does not show everything so as not to confuse the musician. Setting of the controller may be done by via the keyboard 5, or, in the case where a system of coupled devices is used, the teacher may, via the keyboard on his/her device, control the controller of the pupil's device. The device preferably comprises a means 18 for storing the recorded music, the sheet music and the indicator signals. Storing the recorded music with indicator signals enables a replay of the music. Then the next time the musician plays, the indicator may already show passages which the musician found difficult to play, e.g. because the previous n times he failed playing them reasonably according to a particular criterion, and more specifically, which types of error the musician typically makes. In particular in such circumstances it is useful if the stored analysis/comparison data is complete, even if the indicator is simplified. It is then possible to record the music, including a full analysis, while concentrating during playing on one aspect (e.g. tempo). The stored music may be, via a controller, later replayed via a speaker 4. The stored visual data is sent to the addressing means. This allows the musician to replay the stored music and select (via the control 19) which aspect or aspect(s) the indicator signal during replay is to indicate. So while recording the music and being able to immediately follow one aspect (tempo), the musician can thereafter follow just what errors are made in different aspects (e.g. tone) during a replay. During replay the different notes played may be made visible, wherein for instance the "well played" notes are, while the music is replayed, made green, while the "false notes" are made red. While listening to the music the pupil will immediately see which parts of the music are played correctly and where the errors were made. In short the device does the following: Capture the sound (by means of a microphone or microphones 3) or the electronic signals corresponding to the sound (by an input 6) analyze the captured sound/electronic signals compare the results of the analysis to the sheet music (possibly in the form of an electronic file corresponding to the sheet music), the latter steps may be performed simultaneously. - find the most probable position within the sheet music (indicator signal Is)) turn the page on the screen or, more in general, advance the sheet music in dependence on the position (indicator signal Is) within the sheet music optionally and preferably indicate the most probable current position on the displayed sheet music on the display (indicator 16) - optionally and preferably controllably indicate deviations (differences in note, timing, loudness etc) between the played music and the sheet music (different aspects of indicators signal) preferably as a characteristic of the indicator of current position (color, size, shape) - optionally and preferably have a play back mode, by which the recorded music may be made audible, while the sheet music and the indicators of errors (or of parts which were well played) are made visible. The difference indicators may be displayed by a characteristic of the position indicator, for instance in the color (e.g. for the frequency: green is good, yellow is acceptable, red is off) and/or size (for instance for strength: the larger the size the loader one plays in respect of the "best" strength, and a certain standard size corresponds to the "best" choice) and/or form (for instance a shape which becomes the more asymmetric if one lags behind or runs ahead of the displayed music, where the shape is perfectly symmetric (round for instance) when one follows perfectly in step with the displayed music. This allows the pupil or the musician or the teacher to immediately see where there are deviations from the sheet music and in what sense. Different aspects which may be indicated by indicators are e.g.: pitch (frequency): - musical notation : deviations can sometimes be indicated by musical notation. For instance, if the played music exactly differs a semitone from the musical score, this can be presented in musical notation (e.g. the played tone can be displayed in red and on top of the original note). In a similar way sharp/flat notes in the key of the musical piece can be reminded to the player if he forgets to play those. - off-key notes: notes that are played off-key (out of tune) require a non- musical notation to be displayed on the score. For example, one could make the off-key note played vibrate a little on the score in the direction of the deviation of the played note compared to the note in the score, or give it a red color. - arrow up or down: an arrow can indicate deviations in pitch. The direction of the arrow indicates whether it is played too low or too high, whereas the length of the arrow can indicate the amount of deviation, note durations: - musical notation: deviations in duration can be indicated with musical notation. For instance, if a half rest is played where a full rest is in the score, this can be presented in musical notation (see examples above), e.g., overlaid on top of the original rest in the score. tempo: - tempo indicator: if the overall tempo of a musical work is too low or too high this can be indicated by a tempo indicator at a side of the screen. Alternatively, an indicator can show the difference between the played tempo and the tempo intended by the composer (e.g. +15 when played too fast, or -3 when played somewhat to slow). The tempo may be identified by looking for tone onsets in the temporal domain where the audio power starts rising. - moving line: when the musician starts playing, a vertical line moving through the score can indicate the intended tempo to the musician. In preferred embodiments the device comprises a means for remote control of these difference indicators, e.g. in the form of interaction means (input means) for controlling these indicators. The input means can be soft on-screen controls, hard buttons, remote control, voice control, keyboard etc. In general, it is preferred that the device or system has means to select the parameters (indicators) for which feedback is required or desired. In an alternative embodiment the device or system could automatically present feedback on only those parameters that have the largest difference with the sheet music. The attention of the pupil would then be directed to those aspects of his/her play which need the most attention. Alternatively, the system could also take account on how often the piece has been practiced already, and how long ago for the last time (e.g., in the beginning only info on note and duration deviations, and later on also tempo and note-intensity feedback when the player is more practiced on the piece). The indicators may be displayed on the display screen which displays the sheet music, in alternative embodiments one display screen could be used for sheet music and annotations only and feedback could be provided on a further display screen (status screen). In an alternative embodiment visual feedback could be provided with indicators next to the display for displaying the sheet music, e.g. colored LEDs, each LED or each sets of LEDs indicating a difference particular. The use of a split screen, i.e. one part of the display screen showing the sheet music, the other the indicators is also possible. Furthermore when practicing a certain music piece, it can be helpful to record (i.e. make a record of) the played music inclusive partial or complete analysis results, and to play back certain parts of the recorded music. For instance in playback mode, the user can touch on a particular position (providing the device, as in preferred embodiments has a touch screen) to playback music starting from that particular position and possible also to a particular position, i.e. by selecting the start and possibly also the end of the music to be played back. Preferably when using a touch screen it is also possible by repeatedly touching the screen at the indication marks 16 to alter the indication marks, for instance change the characteristic from a tempo difference indication to a tone difference indication. Figure 3 illustrates a preferred embodiment of lhc invention in which the display device comprises an output 18 for outputting electronic data on the sheet music and the indicator signal. The advantage of such an output is that it is possible to monitor a pupil. The result would be a system of coupled devices, for instance one or more device 30 used by one or more pupils coupled to a "master device" 32 for a teacher. In figure 3 such a situation is illustrated. An indicator 16 is displayed on the screen visible for the pupil. This indicator on the display screen visible to the pupil, however, displays only some of the results of the analysis, so as not to confuse the pupil so that he/she may concentrate on a particular aspect that needs his/her attention. This aspect may be a pre-chosen one or the aspect which differs most from the standard. The full analysis data is sent and displayed on a second display device for the teacher, schematically shown is a star on the right hand screen. This allows the teacher a full understanding of the progress (or regress) the pupil is making. It can also he interesting for the pupil to view the full analysis data during playing or after he has played the piece, on his own display or with the teacher on the teacher's display. Figure 4 illustrates a part of a device in accordance with a preferred embodiment. The analysis of the device is made relatively easier if use is made of gauge signals. Most musical instruments produce a quite complex sound with overtones. By requesting a user to play a few notes for instance on a piano, or more in general on the instrument the user wants to play, the device is able to record gauge tones. These gauge tones can be used in the analysis. Figure 4 illustrates such a scheme. The device comprises a gauge set by which a set of gauge music may be recorded. This gauge set is used in the analysis. In a preferred embodiment the recorded sound is not directly compared with the sheet music, but rather a MIDI file (or more in general any file format) is co-downloaded with the sheet music, or produced in the device when the sheet music is downloaded. Each and every musical instrument does not just produce notes but more importantly spectral information, a piano sounds considerably different from a lute. The Midi (or more in general an electronic file) file comprises the music as well as the spectral information for a particular instrument. It is the electronic file corresponding to the sheet music that is compared to the recorded music (or the recorded music is compared to the electronic file). Information obtained may comprises timing as well as notes as well as volume. The above described gauge "learning mode" of the device can be advantageously used in combination with the production of a Midi file. In practice a user (could e.g. be a teacher) plays a few chords on a piano corrcclly (right tempo, right notes, rϊ_lιl L>ιι.l,'icc etc.). The stored spectral and temporal information is used as a gauge set of information. One possible manner is e.g. an embodiment in which the device imports or creates on the basis of • the sheet music a Midi or other type of electronic file. This Midi will then comprise by necessity the spectral information of a particular instrument, e.g. a particular piano, or an 'average' piano. This will, however, not be the piano that is actually used, and the music will not be recorded in the manner as the particular device records the music played. Thus, even if the player plays flawlessly, the device will notice differences between the information it has on file and the recorded music. This will even be the case if the player plays the music flawlessly and exactly as the same instrument with exactly the same tuning is used, simply because the music is played in a different room, the position of the microphone vis-a-vis the piano is different. By playing a few chords, or a small part of the sheet music, correctly on the piano that is actually being used, in the actual setting, the device can correct for these differences, e.g. by changing the Midi file to take these differences into account (writing a new Midi file), or by creating a gauge set of error indicators or a gauge indicator signal which indicate a "correct" playing of the music. This gauge set of error indicators or the gauge indicator signal will then form the bias and the error will be calculated on the basis of the gauge indicator signal. It will be clear that within the concept of the invention many variations are possible. It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. The invention resides in each and every novel characteristic feature and each and every combination of characteristic features. Reference numerals in the claims do not limit their protective scope. Use of the verb "to comprise" and its conjugations does not exclude the presence of elements other than those stated in the claims. Use of the article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The term "display screen" is e.g. used to denote any type of display, e.g. LCD, OLED, CRT etc. etc. Within the concept of the invention a 'means for controlling' and "means for advancing" as well as "means for recording" etc. etc. is to be broadly understood and to comprise e.g. any piece of hard -ware (such a controller, advancer, recorder), any circuit or sub-circuit designed for performing a control, advance, recording as described as well as any piece of soft- ware (computer program or sub program or set of computer programs, or program code(s)) designed or programmed to control, advance, record in a cnrcl nce with the invention as well as any combination of pieces of hardware and software acting as such, alone or in combination, without being restricted to the above or below given exemplary embodiments. In the embodiments shown one or more microphones 3, where within the concept of the invention a microphone is any sound wave recording device, may be used. Using more than one microphone enables a better sound recording and also enables sound- improvement techniques, per se known in the art of audio recording, such as echo- cancellation or reverberation suppression to be used. Echo's of the sound waves are recorded as well as the original sound wave, echo-cancellation techniques enables to filter the sound originated from the musical instrument from the recorder sound. The more the sound is "purified" the easier it becomes to keep track of the position within the sheet music and deviations from the sheet music. To this end the analyzer 11 may comprise a sound-data- improvement means (such as an echo or reverberation canceller) or such a sound- improvement means may be provided in between the recorder 3, 6 (for instance one or more microphones) and the analyzer 11. The analyzer may comprise for analyzing several function several filters, for instance a filter which passes those frequency ranges with which the tempo can best be identified, and other filters by which the tone may best be identified. The device and system preferably comprise means adapt to different tunings of musical instruments. For instance, a violin may be tuned in Concert A (440Hz) or in an old classical tuning (438Hz). One way of adapting such different tuning is already described above, the learning mode, i.e. a mode in which a player plays a few chords and the recorded information is used to create a file. A more straightforward manner would be a type of input device or program by which the player can identify the tuning (e.g. by typing "violin tuned in Concert A" on a key board connected or integrated into the device). Preferably the device and system also has means for 'pitch control' tuning (beats per minute). The device and system preferably has means to remember (store) the deviations of the last time played and show them when playing the piece another time. Alternatively, the system keeps a log of all the deviations that the player can view separately. The system preferably has means to personalize these data (e.g. a means to tag these data with an electronic name). If multiple players use the device with the same piece of music this tagging will be useful. An apprentice does not always (re)start at the beginning of the music piece. The system preferably has means to enable the user to indicate the position where he intends to start. This helps the system in finding the current po-.ili.in. The device and s stem preferably has means for enabling a user to indicate that he wants to start recording from only a certain position. Repetitions in the musical score usually complicate the user's navigation through the sheet music (paging back and forward). Electronic music books are expected to contain the linear musical score exactly as how to be played. The device and system preferably has means for 'Query by playing', i.e. playing a particular phrase of a music piece can also be used to retrieve its musical score, or a particular segment in the current musical score. Playing a tone or a particular tune on the instrument can be used to activate also a gauge set. The device and system preferably also has means for a transposition of the sheet music (raising or lowering the notes). However, for instance for a singer, it may be helpful if he/she cannot reach the highest notes that the music score is adapted to his/her capabilities, i.e. for instance transpositioned downwards. The invention is also embodied in any computer program comprising program code means for performing a method in accordance with the invention when said program is run on a computer as well as in any computer program product comprising program code means stored on a computer readable medium for performing a method in accordance with the invention when said program is run on a computer, as well as any program product comprising program code means for use in a device or system in accordance with the invention, for performing the action specific for the invention.

Claims

CLAIMS:
1. A device (1) having a display screen (2) and means for displaying sheet music on the display screen and having a means for advancing of the displayed sheet music, wherein the device comprises a means (3, 6) for recording music while it is played, an analyzer/comparator (11) for analyzing the recorded music to establish the temporal correspondence between the recorded music and the displayed sheet music, for generating an indicator signal Is to indicate the temporal correspondence between the played music and the displayed music, and means for advancing the displayed sheet music in dependence on the indicator signal Is.
2. A device as claimed in claim 1, wherein the means for advancing are arranged for scrolling the sheet music
3. A device as claimed in claim 1, wherein the means for advancing are arranged for turning the page.
4. A device as claimed in claim 1, wherein the device comprises means for displaying an indicator 16 on the display screen for displaying the temporal correspondence between the displayed sheet music and the recorded music.
5. A device as claimed in claim 1, wherein the means for recording comprise one or more microphones (3).
6. A device as claimed in claim 5, wherein the means for recording comprise a gauge device (41) for establishing gauge musical data.
7. A device as claimed in claim 6, wherein the device comprise means for establishing a gauge indicator signal from the gauge musical data.
8. A device as claimed in claim 1, wherein the means for displaying the indicator are arranged for displaying differences in one or more characteristics between the recorded music and the displayed sheet music.
9. A device as claimed in claim 8, wherein the means for displaying are arranged to display differences in musical characteristics by means of characteristics of the indicator 16.
10. A system comprising more than one device as claimed in any of the claims 1 to 9 wherein the devices are coupled.
11. Computer program product comprising program code means for use in a device or system as claimed in any of the claims 1 to 10, for performing a functionality specific for the invention.
PCT/IB2004/051546 2003-09-03 2004-08-24 Device for displaying sheet music WO2005022509A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP03103278 2003-09-03
EP03103278.2 2003-09-03

Publications (1)

Publication Number Publication Date
WO2005022509A1 true WO2005022509A1 (en) 2005-03-10

Family

ID=34259243

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2004/051546 WO2005022509A1 (en) 2003-09-03 2004-08-24 Device for displaying sheet music

Country Status (1)

Country Link
WO (1) WO2005022509A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005052890A1 (en) * 2005-11-07 2007-05-16 Kristoffer Schwarz Electronic music stands for use by musician, have processor e.g. computer, producing music representation from music data, where stands are connected with communication network e.g. Internet, and music data are playable at stands
EP2387029A1 (en) * 2010-05-12 2011-11-16 KnowledgeRocks Limited Automatic positioning of music notation
JP2016099512A (en) * 2014-11-21 2016-05-30 ヤマハ株式会社 Information providing device
US10235980B2 (en) 2016-05-18 2019-03-19 Yamaha Corporation Automatic performance system, automatic performance method, and sign action learning method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5315911A (en) * 1991-07-24 1994-05-31 Yamaha Corporation Music score display device
WO1998058364A1 (en) * 1997-06-19 1998-12-23 Timewarp Technologies, Ltd. A method and apparatus for real-time correlation of a performance to a musical score
US6156964A (en) * 1999-06-03 2000-12-05 Sahai; Anil Apparatus and method of displaying music
WO2002047064A1 (en) * 2000-12-05 2002-06-13 Amusetec Co. Ltd. Method for analyzing music using sounds of instruments
WO2002101338A1 (en) * 2001-05-21 2002-12-19 Amusetec Co., Ltd. Method and apparatus for tracking musical score

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5315911A (en) * 1991-07-24 1994-05-31 Yamaha Corporation Music score display device
WO1998058364A1 (en) * 1997-06-19 1998-12-23 Timewarp Technologies, Ltd. A method and apparatus for real-time correlation of a performance to a musical score
US6156964A (en) * 1999-06-03 2000-12-05 Sahai; Anil Apparatus and method of displaying music
WO2002047064A1 (en) * 2000-12-05 2002-06-13 Amusetec Co. Ltd. Method for analyzing music using sounds of instruments
WO2002101338A1 (en) * 2001-05-21 2002-12-19 Amusetec Co., Ltd. Method and apparatus for tracking musical score

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DANNENBERG R B, SANCHEZ M, JOSEPH A, SAUL R, JOSEPH R, CAPELL P: "An Expert System for Teaching Piano to Novices", ICMC GLASGOW 1990 PROCEEDINGS, 15 September 1990 (1990-09-15), GLASGOW UK, XP001183955 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005052890A1 (en) * 2005-11-07 2007-05-16 Kristoffer Schwarz Electronic music stands for use by musician, have processor e.g. computer, producing music representation from music data, where stands are connected with communication network e.g. Internet, and music data are playable at stands
DE102005052890B4 (en) * 2005-11-07 2009-04-16 Kristoffer Schwarz Electronic Music Stand
EP2387029A1 (en) * 2010-05-12 2011-11-16 KnowledgeRocks Limited Automatic positioning of music notation
US8440898B2 (en) 2010-05-12 2013-05-14 Knowledgerocks Limited Automatic positioning of music notation
JP2016099512A (en) * 2014-11-21 2016-05-30 ヤマハ株式会社 Information providing device
CN107210030A (en) * 2014-11-21 2017-09-26 雅马哈株式会社 Information providing method and information providing apparatus
EP3223274A4 (en) * 2014-11-21 2018-05-09 Yamaha Corporation Information provision method and information provision device
US10366684B2 (en) 2014-11-21 2019-07-30 Yamaha Corporation Information providing method and information providing device
CN107210030B (en) * 2014-11-21 2020-10-27 雅马哈株式会社 Information providing method and information providing apparatus
US10235980B2 (en) 2016-05-18 2019-03-19 Yamaha Corporation Automatic performance system, automatic performance method, and sign action learning method
US10482856B2 (en) 2016-05-18 2019-11-19 Yamaha Corporation Automatic performance system, automatic performance method, and sign action learning method

Similar Documents

Publication Publication Date Title
US7064261B2 (en) Electronic musical score device
JP3547702B2 (en) System and method for variable notation
EP1465150B1 (en) Apparatus and method for practicing musical instrument
WO2005062289A1 (en) Method for displaying music score by using computer
US7579541B2 (en) Automatic page sequencing and other feedback action based on analysis of audio performance data
US20050183566A1 (en) Stringed musical instrument having a built in hand-held type computer
JP4399961B2 (en) Music score screen display device and performance device
US7321094B2 (en) Electronic musical instrument
JP2012532340A (en) Music education system
WO2008004690A1 (en) Portable chord output device, computer program and recording medium
JP2006030692A (en) Musical instrument performance training device and program therefor
US7309827B2 (en) Electronic musical instrument
JP6638674B2 (en) Training device, training program and training method
JP4038836B2 (en) Karaoke equipment
WO2005022509A1 (en) Device for displaying sheet music
JP2008089975A (en) Electronic musical instrument
JP2006251376A (en) Musical sound controller
JP5109426B2 (en) Electronic musical instruments and programs
US8158874B1 (en) System and method for determining tempo in early music and for playing instruments in accordance with the same
JP4219652B2 (en) A singing practice support system for a karaoke device that controls the main melody volume at the relevant location based on the pitch error measured immediately before repeat performance
JP2007334202A (en) Karaoke device
JP6638673B2 (en) Training device, training program and training method
JP5561263B2 (en) Musical sound reproducing apparatus and program
JP2015069053A (en) Karaoke device scoring singing by considering stretch tuning
US20220310046A1 (en) Methods, information processing device, performance data display system, and storage media for electronic musical instrument

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase