JP2007025326A - Method and program for displaying musical score - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a playing position on a displayed musical score image with a small operation quantity. <P>SOLUTION: A playing position mark 2 is displayed at display positions 3 at calculated intervals on a musical score image 1 in staff notation while moving in synchronism with a musical performance of musical piece data. The display positions 3 are calculated by equally dividing measure widths calculated by measures by the number of beats of the musical piece data and display timing is calculated by equally dividing playing time by the measures by the number of beats of the musical piece data; and the playing position mark 2 is displayed on the musical score image 1 at the calculated display positions in the display timing. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a score display method and a score display program for displaying a performance position on a displayed score.

Conventionally, a musical score image of music data is displayed on the display means, and when reproducing music data, a reproduction mark (cursor) indicating a reproduction position is moved and displayed in synchronization with the reproduction timing of the music, and any position on the current musical score is displayed. It is known to present in an easy-to-understand manner whether or not In this case, since the movement display of the reproduction mark is continuously controlled in synchronization with the reproduction timing, it is necessary to perform display coordinate calculation and drawing control in real time for the display control.
JP 2002-258837 A JP 2004-085640 A JP 2004-094092 A

A convenient display form for displaying the reproduction mark is to fix the display width of each measure at the expense of the legibility of the score, and to display and arrange each note in accordance with the performance timing. However, if the display width of each measure is fixed, when there are a large number of notes in one measure, the notes are arranged close together, and when the number of notes is small, the notes are displayed apart from each other. The score is generally difficult to read. In addition, when attempting to display performance marks on a musical score with the arrangement of notes and the width of each measure adjusted for easy reading, the movement speed and distance of performance marks vary from note to note and from measure to measure. Therefore, in order to control the display of performance marks, there has been a problem that a large amount of arithmetic processing must be performed at all times.
In recent years, with the spread of the Internet, a service has been proposed in which an electronic musical score that is an image is provided online and music learning is performed via a network. In such a service, it is conceivable to provide content such as a musical score image that is displayed along with the reproduction of music by streaming distribution as a moving image. In this case, it is desirable that the arrangement of the notes and the bar width are adjusted so that the score is easy to read, but in order to display the reproduction mark in the score where the arrangement of the notes and the bar width are adjusted, As described above, a large amount of arithmetic processing is always required. Then, when playing back video data streamed via a network, priority is given to data transmission / reception and other drawing controls, so there is not enough room for calculation processing for moving display of playback marks. The display position is not updated at all, or a reproduction mark is displayed at a position that is not the current performance position, which may cause an inappropriate display.

  Accordingly, an object of the present invention is to provide a score display method and a score display program capable of displaying a performance position with a small amount of calculation on a corresponding displayed score image when music data is reproduced. .

  In order to achieve the above object, the musical score display method and the musical score display program according to the present invention divide the measure width calculated for each measure of the score image equally by the number of beats of the music data and correspond to each beat in the measure. The display position is calculated, the performance time calculated for each measure is equally divided by the number of beats of the song data, and multiple display timings are calculated based on the performance time of the measure. The most important feature is that the performance position is displayed on the score image at the displayed position and display timing.

  According to the present invention, the playing time calculated for each measure is calculated by equally dividing the measure width calculated for each measure of the score image by the number of beats of the music data to calculate a plurality of display positions corresponding to each beat in the measure. Divide the music data by the number of beats of the music data, calculate multiple display timings based on the performance time of the bar, and display the performance position at the calculated display position and display timing according to the playback of the music data. Since it is performed on the image, the display position and display timing of the performance position can be discretely controlled in beat units. At that time, the display control is not performed at the position where the note is drawn exactly, but at the position and time in which the bar width is equally divided according to the number of beats. For this reason, it is possible to extremely reduce the amount of calculation and the amount of drawing processing, and it is possible to prevent inappropriate display even when a sufficient amount of processing for display control cannot be ensured. . In this case, the performance position does not display the exact performance timing. However, when displaying music score along with playback in music lessons, etc., the playback position is only a guideline for reading, and it is sufficient to display the approximate beat position. To withstand.

A score display method according to an embodiment of the present invention will be described with reference to FIG.
FIG. 1 shows a score image 1 displayed on the display unit. The score image 1 is obtained by displaying score image data prepared in advance corresponding to music data on a display unit, and the score image data is image data such as a bitmap. In the example shown in the figure, the score image 1 is a score of a staff score, and the score image 1 shown in FIG. 1 is a score of one page, and in this example, one page is composed of two bars. From this, the score image corresponding to the music data for one song is composed of a plurality of pages, and each page of the score image is created in advance so that the vertical position and the left end position of the staff are aligned. As a result, the vertical and horizontal sizes are arranged on each page. Below the musical score image 1 is displayed a performance position mark 2 that moves sequentially as the music data is reproduced. The performance position mark 2 is displayed so as to move on the skipped display position 3 calculated in advance. The display position 3 is a plurality of display positions calculated by dividing each measure width in the score image 1 by the number of beats and using a predetermined reference position for each measure as a reference.

  The method of calculating the display position 3 will be described with reference to the example shown in FIG. 1. First, the first bar width (Width1) is obtained from the reference positions x0 and x1 (Width1 = x1-x0). The reference positions x0, x1, and x2 correspond to the display position of the first note of the first measure, the display position of the first note of the second measure, and the display position of the first note 4 of the virtual third measure, respectively. Yes. When the obtained first bar width (Width1) is divided into four equal parts and a value obtained by dividing the first bar width into four parts is a, the first display position 3 is the position (x0), and the second display position 3 is the position (x0 + a ), The third display position 3 is the position (x0 + 2a), and the fourth display position 3 is the position (x0 + 3a). Similarly, in the second measure, the first display position 3 is the position (x1), the second display position 3 is the position (x1 + b), and the third display position 3 is the position (x1 + 2b). The display position 3 is defined as a position (x1 + 3b). However, b is a value obtained by dividing the second bar width (Width2 = x2-x1) into four equal parts. The performance position mark 2 is drawn on the display position 3 calculated in this manner so as to move in a jumping manner in accordance with the reproduction of the music data. In this case, the timing at which the performance position mark 2 is displayed at the display position 3 is the timing calculated by equally dividing the performance time of each measure by the number of beats and using the reproduction time at each reference position as a reference.

An example of music data for one page corresponding to the score image 1 shown in FIG. 1 is shown in FIG. In this example of music data, the first measure is composed of note data 1, note data 2, note data 3, note data 4, and the second measure is composed of note data 5, note data 6, note data 7, and note data 8. Has been. The note data may be note sound data or MIDI data. In the case of MIDI data, note data is composed of event data of note-on / note-off, control change, program change, and duration data representing the time interval between events. The time t0 is the time when the first note is started when the start button is pressed, the time t1 is the playback time when the first note of the second measure is played, and the time t2 is the start of the virtual third measure. The playback time at which the note is played. Thus, the performance time of the first measure is calculated from (t1-t0), and the performance time of the second measure is calculated from (t2-t1). Therefore, if the calculated performance time is divided into four equal beats and the value obtained by dividing the performance into four is c, the timing for displaying the performance position mark 2 at the first display position 3 is time (t0). The timing for displaying the performance position mark 2 at the display position 3 is time (t0 + c), and the timing for displaying the performance position mark 2 at the third display position 3 is (t0 + 2c), which is displayed at the fourth display position 3. The timing is (t0 + 3c). Similarly, in the second measure, the timing for displaying the performance position mark 2 at the first display position 3 is time (t1), and the timing for displaying the performance position mark 2 at the second display position 3 is time (t1 + d). ), The timing for displaying the performance position mark 2 at the third display position 3 is (t1 + 2d), and the timing for displaying the performance position mark 2 at the fourth display position 3 is (t1 + 3d). Here, d is a value obtained by dividing the performance time (t2-t1) of the second measure into four equal parts. By drawing the performance position mark 2 so as to jump over the display position 3 at the timing calculated in this way, the performance position mark 2 moves over the display position 3 in accordance with the reproduction of the music data. It will be displayed.
As described above, in calculating the display position 3 in the musical score display method of the present invention, the calculation can be made with a small amount of calculation from the reference position information and the number of beats, and the timing of display at the display position 3 is also determined for each reference position. It can be obtained with a small amount of calculation from the reproduction time information and the number of beats.

Next, FIG. 3 shows data recorded in the recording means of the electronic music apparatus in which the musical score display method of the present invention is executed.
The data for one music is composed of music information, music data, musical score image data, and display control data. The music information includes information on at least how many bars (M: number of bars) and information on how many beats (number of beats) per page, and the music data is a MIDI file (SMF: Standard). MIDI File) and MP3 audio files. The score image data is image data such as a bitmap of the score image 1 as shown in FIG. The display control data is information for page switching between the performance position mark 2 and the score image. The score image data is image data of a score prepared in advance. As shown in the figure, the score image data for one song is composed of a plurality of score images on the first page, the second page,. For example, each page is composed of two bars as shown in FIG. Information (display control data) for page switching between the performance position mark 2 and the score image includes reference position information (x) indicating the reference position in the displayed score image in display coordinates, and reference when the music data is reproduced. The information sequence is paired with the reproduction time information (t) reaching the position. That is, as shown in FIG. 3, the display control data is (t0, x0), (t1, x1), (t2, x2),... (Tm, xm). The number of display control data is M + 1, where M is the number of bars per page. Further, the reproduction time information t0, t1, t2,..., Tm may be absolute time from the start of performance (when the music data is audio), or relative time (when the music data is MIDI, MIDI timing). (Number of clocks).

Next, FIG. 4 shows a flowchart of display control processing executed by the score display program according to the present invention. When the display control process is executed, an automatic performance (playback) process is started and executed separately. In the automatic performance (playback) process, music data is read sequentially to play music, and the playback time is counted. Is going.
The display control process is started in response to the operation of the “play button”, and the nth page musical score image is displayed in step S10. Immediately after the start, n is set to 1, and the score image of the first page is displayed on the display unit. Next, in step S11, the bar width is acquired from the reference position information in the display control data, and the mark display position of the performance position mark 2 for each beat is calculated. In this case, the display position for each beat at which the performance position mark 2 is displayed is calculated by the following arithmetic expression.
Display position of mth beat = (reference position) + (bar width) * (m−1) / number of beats

Next, in step S12, the time between measures, which is the performance time of the measure, is obtained from the reproduction time information reaching the reference position in the display control data, and the mark display timing of the performance position mark 2 for each beat is calculated. In this case, the display timing for each beat is calculated by the following arithmetic expression.
Display timing of m-th beat = (time of reference position) + (time between measures) * (m−1) / number of beats The mark display position and mark display timing of the performance position mark 2 are calculated in steps S11 and S12. Then, the performance position mark is moved and displayed at the mark display position and mark display timing calculated until the end of the measure is reached in step S13. That is, drawing processing is performed so that the display position of the performance position mark 2 is switched at the calculated display timing (reproduction time) for each beat, and this processing is performed until the end of the measure is reached. When the process of step S13 ends, the process proceeds to step S14 to determine whether or not there is a next measure on the page. Here, if it is determined that there is a next measure, the process branches and returns to step S11, and the processing from step S11 to step S13 is repeated, and the display control of the performance position mark 2 in the next measure is performed.

If it is determined in step S14 that there is no next measure, the process proceeds to step S15 to determine whether there is a next page. If it is determined that there is a next page, in this case, there are two pages, the process branches to return to step S10, the score image of the second page is displayed on the display unit, and the processing from step S11 to step S13 is repeated. Then, the display control of the performance position mark 2 in the first measure on the second page is performed. This process is repeated until the end of the last measure of the last page. When the process is performed until the end of the last measure of the last page, it is determined as no in step S15, the display control process is terminated, and the process returns to the main process. When the display control process is completed, the reproduction of the music data by the automatic performance (reproduction) process is also terminated.
The time between measures, which is the performance time of a measure, may be obtained from the tempo and the number of beats. If the music data is a MIDI file, the time between measures, which is the performance time of the measure, may be obtained by adding duration data for one measure in the MIDI data.

Next, FIG. 5 is a block diagram showing a configuration of an electronic music apparatus 5 that includes the score display program according to the present invention by applying the score display method of the present invention. The musical score display method according to the present invention is implemented by executing the musical score display program according to the present invention in the electronic music apparatus 5 having substantially the same configuration as the personal computer.
In the electronic music apparatus 5 shown in FIG. 5, a CPU (Central Processing Unit) 10 controls the entire operation of the electronic music apparatus 5 and executes operation software such as a score display program. A ROM (Read Only Memory) 11 stores at least operation software such as a score display program executed by the CPU 10, and a RAM (Random Access Memory) 12 sets a work area for the CPU 10 and a storage area for various data. Has been. By making this ROM 11 a rewritable ROM such as a flash memory, the operation software can be rewritten and the operation software can be easily upgraded. The ROM 11 can store a plurality of music data sets including music information, music data, musical score image data, and display control data.

  The detection circuit 14 detects an event of the operation element 13 by scanning the operation element 13 such as a keyboard or a pointer device, and outputs an event output corresponding to the operation element 13 having the event. The display circuit 16 includes a display unit 15 such as a liquid crystal. The display unit 16 displays a score image corresponding to the music data to be reproduced and displays a performance position mark in accordance with the progress of the performance, or the electronic music device 5. Various setting screens and the like are displayed on the display unit 15. The various setting screens are screens for selecting music data to be played back by a user using a GUI (Graphical User Interface) and instructing the start and end of the playback. The tone generator circuit 18 is a waveform memory tone generator or FM tone generator having a waveform memory, and generates tone waveform data by performing tone generation processing based on the control of the CPU 10. The musical sound waveform data generated in the sound source circuit 18 is supplied to the sound system 17 and converted into an analog signal to be emitted. The sound system 17 can perform volume control and sound quality control. The communication interface (I / F) 20 is an interface that connects the electronic music apparatus 5 to a network 20 such as a communication network such as a LAN (local area network), the Internet, or a telephone line. A hard disk device (HDD) 21 is a large-capacity storage device that can be built in, and the HDD 21 stores a plurality of music sets including music information, music data, musical score image data, and display control data. Can do. These units are connected to the communication bus 22.

  In the electronic music apparatus 5 configured as described above, when the music to be played is selected by operating the operation element 13 and the start button is operated, the music data is read from the ROM 11 or the HDD 21 and sent to the sound source circuit 18 for playback. At the same time, the musical score image data corresponding to the music data is read from the ROM 11 or the HDD 21, and the first page is displayed on the display unit 15. The musical tone signal reproduced by the tone generator circuit 18 is emitted from the sound system 17, and the performance position mark 2 moves on the display position 3 of the score image 1 as shown in FIG. Are displayed. When the reproduction of the score image 1 of the first page is completed, the score image 1 of the second page is displayed on the display unit 15, and the performance position mark 2 is displayed as the score image of the second page as the reproduction progresses. 1 is displayed so as to move on the display position 3. Until the reproduction of the music data is completed, the musical score image 1 displayed on the display unit 15 is displayed so as to move on the display position 3.

  In the electronic music device 5, as described above, the bar width calculated for each bar of the musical score image is equally divided by the number of beats of the music data, and a plurality of display positions 3 are calculated based on the reference position, and calculated for each bar. The performance time is equally divided by the number of beats of the music data to calculate a plurality of display timings based on the performance time of the measure, and the performance position mark is displayed at the calculated display position 3 and the display timing according to the playback of the music data. 2 is displayed on the score image. As a result, the display position 3 and display timing of the performance position mark 2 can be discretely controlled in units of beats, and at that time, the bar width is beaten instead of exactly matching the position where the note is drawn. Display control is performed at equal positions and times according to the number. For this reason, it is possible to extremely reduce the amount of calculation and the amount of drawing processing, and it is possible to prevent an inappropriate display from being made even when a sufficient amount of processing for display control cannot be ensured. . In this case, the performance position mark 2 does not indicate an accurate performance timing. However, when a musical score is displayed together with the reproduction in a music lesson or the like, the reproduction position is only a guideline for reading, and an approximate beat position is displayed. It will be practical enough.

Note that the data for one song need not be a single data set. For example, element content (music data, musical score image data, display control data) constituting playback content is represented by a markup description language (for example, SGML (Standard Generalized Markup Language), HTML (HyperText Markup Language), XML (eXtensible Markup). (Language) or the like) may define a URL (Uniform Resource Locator) indicating the location of each element content, and the element contents may be acquired at the time of reproduction and reproduced as described above.
In the above description, the reference position is the position corresponding to the first beat of each measure, but the display position of the bar line dividing each measure may be the reference position. In this case, the reference positions x0, x1, and x2 respectively correspond to the first bar line position of the first bar, the bar line position of the first bar terminal (second bar head), and the bar line position of the second bar terminal. When the display position of the bar line is set as the reference position, for example, the display position of m beat days is calculated by the following arithmetic expression.
Bar width = Position of the last bar line-Position of the first bar line Display position of m beat days = (reference position: bar line position) + (bar width) * (2m-1) / (2 * number of beats)
That is, the performance mark corresponding to m beat days is displayed at the center of the area obtained by equally dividing the bar width based on the bar line by the number of beats. When the display position of the bar line is set as the reference position, the performance position mark is not limited to the above, and the performance position mark may be displayed at any position such as the head or the end of each area as long as it is within the area where the bars are equally divided by the beat number . Also, a predetermined offset width may be defined for each measure or music piece, and the calculated display position may be finely adjusted with the offset width.
Further, the musical score image may be displayed in a plurality of stages, and when displaying a plurality of stages, image files of a plurality of pages are displayed in parallel in the vertical direction. Further, when displaying the staff score in a plurality of stages, the second and subsequent stages may be added to the y coordinate for displaying the performance position mark 2 with the display start position of the score image as an offset.

  In the above description, the score display method and the score display program according to the present invention are provided in the electronic music apparatus. However, the present invention is not limited to this, and the score display method is implemented by being provided in various music-related apparatuses. be able to. In this case, the score display program may be recorded on a recording medium and incorporated into various music-related devices.

It is a figure which shows the score image displayed on the display part for demonstrating the score display method of the Example of this invention. It is a figure which shows an example of the music data for one page corresponding to the score image concerning the score display method of this invention. It is a figure which shows the data recorded on the recording means of the electronic music apparatus with which the score display method of this invention is performed. It is a block diagram which shows the structure of an electronic music apparatus provided with the score display program of the Example of this invention. It is a block diagram which shows the structure of an electronic music apparatus provided with the score display program concerning this invention by applying the score display method of this invention.

Explanation of symbols

1 musical score image, 2 performance position mark, 3 display position, 4 notes, 5 electronic music device, 10 CPU, 11 ROM, 12 RAM, 13 operator, 14 detection circuit, 15 display unit, 16 display circuit, 17 sound system, 18 sound source circuit, 19 communication interface, 20 network, 21 HDD, 22 communication bus

Claims (2)

A musical score display method in an electronic music apparatus comprising recording means for recording music data, musical score image data corresponding to the musical piece data, reference position information for each musical score image, and reproduction time information reaching the reference position,
Replaying any music data recorded in the recording means;
Displaying a score image on the display unit based on the score image data corresponding to the music data to be reproduced;
The measure width is calculated based on the reference position information for each measure of the score image displayed on the display unit, and the calculated measure width is equally divided by the number of beats of the music data to correspond to each beat in the measure. Calculating a plurality of display positions,
A step of calculating a performance time of a measure for each measure based on the reproduction time information and equally dividing the calculated performance time by the number of beats of the music data to calculate a plurality of display timings based on the performance time of the measure When,
On the displayed score image, displaying the performance position in accordance with the reproduction of the music data at the calculated display position and display timing;
A musical score display method comprising: A computer comprising recording means for recording music data, musical score image data corresponding to the musical piece data, reference position information for each musical score image, and reproduction time information reaching the reference position,
Reproducing means for reproducing any music data recorded in the recording means,
Display means for displaying a score image on a display unit based on score image data corresponding to music data reproduced by the reproducing means;
The measure width is calculated based on the reference position information for each measure of the score image displayed on the display unit, and the calculated measure width is equally divided by the number of beats of the music data to correspond to each beat in the measure. Display position calculation means for calculating a plurality of display positions,
Display for calculating a plurality of display timings based on the performance time of the measure by calculating the performance time of the measure for each measure based on the reproduction time information and equally dividing the calculated performance time by the number of beats of the music data Timing calculation means,
On the displayed musical score image, performance position display means for displaying a performance position in accordance with the reproduction of the music data at the calculated display position and display timing;
A musical score display program characterized in that it is made to function as a program.

Images