JP6168117B2 - Musical score information generating apparatus, musical score information generating method, and program - Google Patents

Description

The present invention relates to a musical score information generating apparatus, a musical score, and a musical score information for controlling the reproduction of music based on music data, using musical score information associating musical score data on the displayed musical score with music data on the performance of the music based on the musical score. The present invention relates to an information generation method and a program .

  In an electronic musical instrument or a music playback device, there has been proposed a technique for realizing a musical performance by generating a musical sound corresponding to a note displayed on a score while displaying the score on a screen of a display unit.

  For example, Patent Document 1 compares performance data obtained by pressing a key with musical score data, searches for the position of a musical score played by the performer, and finds the searched position in the musical score. A display device has been proposed.

  In Patent Document 2, a MIDI data file, a score image data file storing score image data indicating a score for each measure, and practice support data including a control code for each measure are used. The control code includes a code for designating the page to which the musical score belongs, the corresponding portion of the MIDI data, and the corresponding musical score image data. The apparatus shown in Patent Document 2 is configured to recognize a page to which a practice target bar belongs based on a control code and display a score corresponding to the bar belonging to the page.

Japanese Patent No. 3077269 Japanese Patent Laid-Open No. 10-240117

An actual score usually includes various repeated symbols, and the same measure is played a plurality of times. On the other hand, music data for playing a music (for example, SMF (Standard Midi File) storing MIDI data) is an auto-on event corresponding to the start of pronunciation, a note-off event corresponding to the end of pronunciation (mute), and Since it is composed of time information between events, repetition is not considered. Therefore, the notes on the score and the events on the music data do not necessarily correspond uniquely, so that when a predetermined position (for example, a measure) on the score is specified, an appropriate piece of music cannot be played. There is.
In addition, since the shape of this repeated symbol is more complex than the staff and bar lines that are other elements constituting the score, the accuracy of recognizing this repeated symbol from the image data is low. For this reason, it is often difficult to specify a plurality of repetitive symbols and their positions on the musical score image data as constituent elements of the musical score.

The present invention accurately identifies a repetition symbol and its position on image data of a musical score, reads music data contained in a music data file for each measure based on the identified repetition symbol, and appropriately reproduces the music An object of the present invention is to provide a musical score information generating apparatus, a musical score information generating method, and a program .

An object of the present invention, in the musical score of the image data file containing image data of the music score, based on the position of the components in a staff and bar lines of the musical score, each of the regions of the bar in the score Identifies an area including image data whose degree of coincidence between the specified bar specifying process and image data in each area in the image data of the score is equal to or greater than a predetermined value. An area specifying process, a symbol drawing process for drawing a symbol corresponding to the type of the repetitive symbol at a position on the image data of the score corresponding to the specified area, and a series of musical sounds constituting the music , based on the time information of the music in the data file storing the music data including the time information indicating information and sound generation timing indicating the pitch to be sounded There are, by dividing the music data file, for each measure, the sound containing information and time information indicating the height, and the music data file division processing for generating a plurality of unit music data file, the music in the image data file the position of the staff and bar lines the is a component of music, from the the drawing symbol and its location, based on, identify the measure of the position of the symbol, the plurality of unit music data file , Unit music data file acquisition processing for acquiring unit music data files that are not duplicated by eliminating unit music data files that are duplicated by repetition, and positions of staves and bar lines in the score, each area of the bar , including the type and position of the repeating symbols, the score element data file containing the score element data raw A score element data file generation process is achieved by score information generating apparatus having a processor for execution.

  According to the present invention, a musical tone generation control apparatus and musical tone generation control for reading out music data contained in a music data file for each measure and appropriately reproducing a musical piece based on repeated symbols accurately identified from the score image data A program can be provided.

FIG. 1 is a block diagram showing a configuration of a musical sound reproduction system according to an embodiment of the present invention. FIG. 2 is a block diagram showing the configuration of the terminal device according to this embodiment. FIG. 3 is a schematic front view showing the appearance of the terminal device according to the present embodiment. FIG. 4 is a block diagram showing functions of the center device 10 according to the present embodiment. FIG. 5 is a flowchart showing an example of processing (straight line detection processing) executed by the score element extraction unit according to the present embodiment. FIG. 6 is a diagram illustrating an example of a score based on score data. FIG. 7 is a flowchart showing in more detail a processing example of step 502 (part line detection processing). FIG. 8 is a flowchart showing in more detail a processing example of step 503 (staff detection processing). FIG. 9 is a graph showing the number of pixels for each y coordinate in the binarized score. FIG. 10 is a flowchart showing in more detail a processing example of step 504 (bar line detection processing). FIG. 11 is a flowchart illustrating an example of the repeated symbol detection process according to the present embodiment. 12A to 12E are diagrams showing examples of repeated symbols and corresponding symbols. FIGS. 13A to 13D are diagrams showing examples of repeated symbols and corresponding symbols. FIG. 14 is a flowchart showing an example of a score element data file generation process according to the present embodiment. FIG. 15 is a flowchart showing an example of unit music data file generation processing executed by the music data dividing unit. FIG. 16A schematically shows the structure of a musical score of a certain music piece, and FIG. 16B schematically shows the structure of original music data of the music piece. FIG. 17 is a diagram illustrating an example of a plurality of unit music data files that are obtained without duplication. FIG. 18 is a flowchart illustrating an example of processing executed in the terminal device according to the present embodiment. FIG. 19 is a flowchart illustrating an example of the panel switch processing according to the form of the full-length character. FIG. 20 is a flowchart showing an example of song selection processing according to the present embodiment. FIG. 21 is a flowchart showing an example of start / stop switch processing according to the present embodiment. FIG. 22 is a flowchart showing an example of performance operation detection processing according to the present embodiment. FIG. 23 is a flowchart illustrating an example of the performance operation detection process according to the present embodiment. FIG. 24 is a flowchart showing an example of a performance operation detection process according to the present embodiment. FIG. 25 is a diagram illustrating an example in which a score is displayed on the screen of the display unit of the terminal device. FIG. 26 is a flowchart showing step 2203 of FIG. 22 in more detail. FIG. 27 is a flowchart showing step 2203 of FIG. 22 in more detail. FIG. 28 is a flowchart showing step 2703 of FIG. 27 in more detail. FIG. 29 is a flowchart showing an example of repeat symbol processing according to the present embodiment. FIG. 30 is a flowchart showing an example of song processing according to the present embodiment. FIG. 31 is a flowchart showing in more detail the processing example of step 1504. FIG. 32 is a flowchart illustrating an example of the image update process according to the present embodiment.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a block diagram showing a configuration of a musical sound reproduction system according to an embodiment of the present invention. As shown in FIG. 1, the musical tone reproduction system according to the present embodiment includes a center device 10 and a terminal device 30. The center device 10 according to the present embodiment includes a CPU 11, an input unit 12, a display unit 13, a ROM 14, a RAM 15, a flash memory 16, a communication interface (I / F) 17, and a sound system 18. As the center device 10, for example, a personal computer or a server can be used.

  In the present embodiment, the center device 10 stores a music data file including music data for playing music and a score data file including image data of music scores in a storage device (for example, the flash memory 16). doing. The center device 10 generates a musical score element data file which is a file including data (musical score element data described later) for associating the music data and the image data, and transmits it to the terminal device 30 together with the music data file and the musical score data file. To do.

  The CPU 11 reads the musical score data, extracts musical score elements such as staffs and bar lines in the musical score data, divides the music data into bars based on the extracted musical score elements, and performs music in units of bars. Various processes such as a process of generating a unit music data file including data are executed. The input unit 12 includes input devices such as a keyboard and a mouse. Moreover, the display part 13 contains a liquid crystal display device, for example.

  The ROM 14 reads the musical score data, extracts musical score elements such as staffs and bar lines in the musical score data, divides the music data into bars based on the extracted musical score elements, and performs music in units of bars. A processing program such as processing for generating a unit music data file including data is stored. The RAM 15 stores a program read from the ROM 14 and data generated in the course of processing. The flash memory 16 stores a music data file including music data of various musical pieces and a musical score data file including musical score data of the musical pieces.

  The communication I / F 17 controls data transmission / reception via an external network such as the Internet. The sound system 18 includes a sound source unit 19, an audio circuit 20, and a speaker 21.

  FIG. 2 is a block diagram showing the configuration of the terminal device according to this embodiment. As shown in FIG. 2, the terminal device 30 according to the present embodiment includes a CPU 31, a touch panel 32, a display unit 13, a ROM 34, a RAM 35, a flash memory 36, a communication interface (I / F) 37, and a sound system 38. ing. As the terminal device 30, for example, a smartphone can be used.

  In the present embodiment, the terminal device 30 receives a music data file (unit music data file to be described later), a score data file, and a score element data file from the center device 10, and based on the data included in these data files, The musical score is displayed, the music is played from the specified bar, or the specified bar is repeated.

  The CPU 31 executes various processes such as display of musical scores and icons to be displayed on the screen of the display unit 13, detection of touch on the touch panel, performance of music based on the musical score element data file and the unit music data file. The touch panel 32 is disposed so as to overlap the display unit 33 including the liquid crystal display device.

  The ROM 34 stores various processing programs such as display of musical scores and icons to be displayed on the screen of the display unit 13, detection of touch on the touch panel, performance of music based on musical score element data files and unit music data files. . The RAM 35 stores a program read from the ROM 34 and data generated in the course of processing. The flash memory 36 can store the received musical score data file, musical score element data file, and unit music data file. The communication I / F 37 controls data transmission / reception via an external network such as the Internet. The sound system 38 includes a sound source unit 39, an audio circuit 40, and a speaker 41.

  FIG. 3 is a schematic front view showing the appearance of the terminal device according to the present embodiment. As shown in FIG. 3, the terminal device 30 is arranged such that a display unit 33 including a liquid crystal display device and a touch panel 32 are overlapped. On the screen of the display unit 33, for example, an input unit 301 including a score (see reference numeral 300) and various icons (see reference numerals 310 to 312) is displayed. The user can specify a measure or the like in the score by touching a desired position on the score 300. In addition, the user can input a command by touching a desired icon.

  Hereinafter, processing executed by the center apparatus 10 will be described. FIG. 4 is a block diagram showing functions of the center device 10 according to the present embodiment. As shown in FIG. 4, the center device 10 includes a score element extraction unit 42, a data file generation unit 43, and a music data division unit 44. In the present embodiment, the flash memory 16 of the center device 10 stores an original music data file 400 including original music data that is music data of a music piece, and an original musical score data file that includes original music data that is music data of the music piece. 401 is stored.

  The original music data file 400 is a so-called standard MIDI file (SMF), which is information indicating the event type such as time information (delta time) indicating a time interval between events including the sound generation, note-on event and note-off event. Etc. The original score data file 401 is an image data file in a known format such as a PDF file.

  The score element extraction unit 42 reads the original score data file 401 and generates a display score data file 403 for transmission to the terminal device 30 from the data in the file. The display score data file 403 is, for example, a PNG (Portable Network Graphic) file. Of course, it may be image data of a format other than PNG. The musical score element extraction unit 42 binarizes the original musical score data file 401 to generate, for example, a bitmap binary data file 402.

  Further, the musical score element extraction unit 42 refers to the binarized data file 402 and extracts part lines, staffs, bar lines, and the like, which are musical score components. In the present embodiment, the score component includes a line for defining a time region or part in the score, such as a staff in a score, a part line or a bar line, and a repetition symbol. The musical score component does not include notes that directly define the musical piece to be played in the musical piece.

  The musical score element extraction unit 42 acquires the coordinate data of the constituent elements of the extracted musical score. The day file generation unit 43 generates a score element data file 404 including information specifying the type and position of the score element based on the information acquired by the score element extraction unit 42. The generated musical score data file for display 403, binarized data file 402, and musical score element data file 404 are stored in the flash memory 16, for example.

  The music data dividing unit 44 divides the music data into unit music data for each measure based on the music data in the original music data file 400 and the score element data 404 in the score element data file, and repeatedly. A predetermined unit music data file 405 is generated by eliminating duplication due to symbols and the like. The unit music data file 405 is also stored in the flash memory 16, for example.

  The musical score element extraction unit 42, the data file generation unit 43, and the music data division unit 44 are mainly realized by the CPU 11 shown in FIG. Hereinafter, the processing executed by these will be described in more detail. FIG. 5 is a flowchart showing an example of processing (straight line detection processing) executed by the score element extraction unit according to the present embodiment. As shown in FIG. 4, the image element extraction unit 42 binarizes the original score data and stores it in the binarized data file RAM 15 including the generated binarized data (step 501). For example, the binarized data is bitmap data. If the original image data file is already binarized data, step 501 is omitted.

  Next, the score element extraction unit 42 detects a part line from the binarized data (step 502). The part line is also referred to as a part vertical line. FIG. 6 is a diagram illustrating an example of a score based on score data. The part line indicates that the parts connected by the part line are played at the same time, and defines the stage of the score. Normally, the part line is located at the left end of the score. In FIG. 6, a line indicated by reference numeral 601 is a part line. In this example, a grand staff is defined by a so-called part line. In the so-called score (total score), the left ends of the staves of a plurality of parts are connected by the part lines.

  FIG. 7 is a flowchart showing in more detail a processing example of step 502 (part line detection processing). As shown in FIG. 7, the musical score element extraction unit 42 detects vertical lines that are more than a predetermined value in a region within a predetermined range from the left end in the musical score image (step 701). If a vertical line is detected (Yes in step 702), the musical score element extraction unit 42 specifies a pixel group corresponding to the vertical line (step 703), and is further positioned below the found vertical line. Referring to the pixel to be detected, another vertical line that continues for more than a predetermined value is detected (step 704).

  When the other vertical line is detected (Yes in Step 705), the score element extraction unit 42 specifies a pixel group corresponding to the other vertical line (Step 706). The musical score element extraction unit 42 can specify the pixel group by storing the position information of the pixel group in the RAM 15. The score element extraction unit 42 determines whether or not the search for the vertical line to the lower end of the score image has been completed (step 707). If it is determined No in step 707, the process returns to step 704. On the other hand, if it is determined Yes in step 707, the musical score element extraction unit 42 stores the position information (coordinates) of the detected vertical line in the RAM 15 (step 708), and then the part line detection process. Exit.

  In the part line detection process, in FIG. 6, the part line which is a vertical line located at the left end (reference numeral 601 is detected). Further, another vertical line (not shown in FIG. 6) located below (see reference numeral 619) from the detected vertical line (see reference numeral 601) is detected.

  When the part line detection process ends, the score element extraction unit 42 detects a staff in the score (step 503). FIG. 8 is a flowchart showing in more detail a processing example of step 503 (staff detection processing). As shown in FIG. 8, the musical score element extraction unit 42 specifies a range where the part line is located in the vertical direction (step 801). Next, the musical score element extraction unit 42 counts the number of pixels corresponding to black spots in the horizontal direction within the range specified in step 801 (step 802). The musical score element extraction unit 42 determines whether the pixel count has been completed in the entire range where the part line is located (step 803). If NO is determined in step 803, the process returns to step 802.

  In step 802, each value (pixel value) of a pixel having the same y coordinate is referred to for each coordinate (y coordinate) in the y-axis direction (vertical direction) in the range where the part line is located, and the black point is determined. If it is a value shown, the count value is incremented. In this way, the number of pixels corresponding to the black point in the horizontal direction (x-axis direction) is acquired as the count value for each y coordinate where the part line is located. FIG. 9 is a graph showing the number of pixels for each y coordinate. In FIG. 9, the horizontal axis indicates the position in the y-axis direction (vertical direction), and the vertical axis indicates the number of pixels (count value).

  As can be understood from FIG. 6, in the musical score, a straight line extends in the horizontal direction at the positions of the lines (first line to fifth line) constituting the staff (reference numerals 602 and 603). Therefore, the number of pixels (count value) at that position is significantly larger than other positions. In the example of FIG. 9, as indicated by reference numerals 901 to 905, the count values at five positions at regular intervals are significantly larger than the count values at other positions (see, for example, reference numerals 910 and 911). In the present embodiment, a position where the count value is remarkably large is located in a group of five at regular intervals as described above, and this position is determined to be a staff position. In order to determine the position of such a staff, the processing after step 804 is executed.

  The musical score element extraction unit 42 excludes positions indicating count values smaller than a predetermined ratio (for example, 20%) from the maximum count value (maximum count value) from the staff candidate positions (step 804). Next, the musical score element extraction unit 42 finds the maximum value of the count value, and merges the position indicating the maximum value and the position of the surrounding predetermined range (step 805). In step 805, the predetermined range in the periphery is regarded as the same position, and the maximum value found for the position in the predetermined range may be given. The musical score element extraction unit 42 calculates the maximum deviation σ of the count value, and excludes the position indicating the count value less than a predetermined multiple (for example, 3 times: 3σ) from the staff candidate positions (step 806). . The musical score element extraction unit 42 specifies five count values located at predetermined intervals, excluding positions excluded from the candidate positions (step 807). These five positions are staff positions. The musical score element extraction unit 42 stores the information on the staff position in the RAM 15 (step 808).

  When the staff detection process ends, the score element extraction unit 42 detects a bar line in the score (step 504). FIG. 10 is a flowchart showing in more detail a processing example of step 504 (bar line detection processing). The bar line is a vertical line on the staff or the same length as the part line for separating a bar from the next bar (see reference numerals 604 to 606 in FIG. 6). As shown in FIG. 10, the musical score element extraction unit 42 first detects notes placed on or between lines of the staff (see reference numeral 1010).

  More specifically, the score element extraction unit 42 specifies a rectangular area including the part line and a predetermined range above and below the part line in the vertical direction (step 1001). The identified area substantially corresponds to the area where the note may be placed. Next, an ellipse having a size that matches the interval between the lines constituting the staff is detected (step 1002). In step 1002, for example, the coordinates of the detected center position of the ellipse are stored in the RAM 15. The musical score element extraction unit 42 determines whether step 1002 has been executed for all part lines (step 1003). If it is determined No in step 1003, the process returns to step 1002 to detect the position of the note tama for the area specified for the next part line.

  If it is determined Yes in step 1003, the score element extraction unit 42 is separated from the ellipse corresponding to the detected note by a predetermined distance or more in an area including the part line and a predetermined range above and below the part line, and A vertical line having a length approximating the part line is found (step 1004). The musical score element extraction unit 42 stores the detected vertical line information in the RAM 15 (step 1005). The score element extraction unit 42 determines whether steps 1004 and 1005 have been executed for all part lines (step 1006). If it is determined No in step 1006, the process returns to step 1004, and the same processing is executed for the area specified for the next part line. If it is determined YES in step 1006, the bar line detection process is terminated.

  When the bar line detection (step 504 in FIG. 5) ends, the musical score element extraction unit 42 detects a repeated symbol. FIG. 11 is a flowchart illustrating an example of the repeated symbol detection process according to the present embodiment. As shown in FIG. 11, the musical score element detection unit 42 acquires binarized musical score data stored in the RAM 15 (step 1101). Next, the score element detection unit 42 selects a repeated symbol to be detected. As shown in FIG. 12 and FIG. 13, the repetition symbol (repetition symbol) includes a repetition first symbol (reference numeral 1201), a rear end symbol (reference numeral 1211), a first parenthesis (reference numeral 1231), a second parenthesis ( Reference numeral 1241), Tocoder (reference numeral 1301), Vide or coder mark (reference numeral 1311), Seño (reference numeral 1321), Dalseiyo (reference numeral 1331), Dacapo (not shown), and the like are included. Image data including these repeated symbol graphics is stored in the RAM 15 in advance, and in step 1102, the musical score element extraction unit 42 may read image data of a predetermined symbol.

  Next, the musical score element extraction unit 42 normalizes the symbol size based on the staff width (step 1103). Next, the score element extraction unit 42 calculates a coincidence coefficient (correlation value) between the symbol and a predetermined area of the score data (step 1104). For example, when the pixel value of the symbol image data is compared with the pixel of the image data in a predetermined area and the pixel values match, the match coefficient is incremented and the final match coefficient is used as the correlation value. . The score element extraction unit 42 calculates correlation values for all areas by shifting areas in the score data. The musical score element extraction unit 42 specifies an area having the maximum correlation value (step 1105), and extracts pixel data of the area (step 1106).

  Next, the score element extraction unit 42 compares the pixel of the extracted image data with the pixel of the image data in a predetermined area in the score data to calculate a correlation value (step 1107). Since the repeated symbols existing in the area detected in step 1105 are the symbols used in the score, in order to detect the same symbol with higher accuracy, in step 1107, the image of the detected area is displayed. The symbol is detected again using the data. The musical score element extraction unit 42 identifies an area where the correlation value is larger than a certain threshold (step 1108). Thereafter, the musical score element extraction unit 42 draws a predetermined symbol corresponding to the repeated symbol in the specified area in the musical score data (step 1109). The musical score element extraction unit 42 determines whether the processing has been completed for all the repeated symbols (step 1110). If it is determined YES in step 1110, the process ends. If it is determined NO in step 1110, the process returns to step 1102.

Hereinafter, a symbol corresponding to a repetition symbol will be described. In FIGS. 12A to 12E and FIGS. 13A to 13D, symbols corresponding to repetitive symbols (see reference numerals 1200 to 1240 and 1300 to 1330) described on the right side are shown on the left side (reference numeral 1201). ~ 1241, 1301-1331). A symbol 1200 corresponding to the repeated head symbol 1201 is composed of a predetermined number of pixels. Here, the upper two dots (see reference numeral 1202) are
It is used to represent the first symbol of the repetition, the last symbol of the repetition, the first parenthesis, the second parenthesis, and the lower two dots (see reference numeral 1203) to represent tocoda, coder mark, seño, darseño, dacapo Used. The repeated head symbol and rear end symbol are distinguished by disposing black pixels in the opposite direction on the upper side of the first layer (see reference numerals 1200, 1210, and 1220). Further, repeated parentheses are distinguished by arranging black pixels in the opposite direction below the first layer (see reference numerals 1230 and 1240).

  Further, the instruction to shift to the coder (Tocoder) and the coder are distinguished by arranging black pixels in the opposite direction on the lower side of the second hierarchy (see reference numerals 1300 and 1310). A distinction is made by arranging black pixels in the opposite direction above the hierarchy.

  In step 1109, the symbol composed of the predetermined number of pixels is drawn in or around the detected area in the binarized score data. The symbol is referred to when creating a pixel element data file to be described later.

  When the detection of the repeated symbols (step 505 in FIG. 5) is completed, the data file generating unit 43 generates a musical score element data file based on the information obtained in steps 502 to 505 (step 506). FIG. 14 is a flowchart showing an example of a score element data file generation process according to the present embodiment. As shown in FIG. 14, the data file generation unit 43 stores the staff position information, part line and bar line position information stored in the RAM 15 in a score element data file in the RAM 15 in a predetermined order and format. Store (steps 1401, 1402). Next, the data file generation unit 43 associates the bar number with the position of the bar having the bar number based on the part line position, the bar line position, and the staff line position in the RAM 15. The musical score element data file is stored (step 1403). Furthermore, the data file generation unit 43 determines whether there is a symbol of a repetitive symbol in the vicinity of each of the part line and the bar line. If a symbol exists, the type of repetition symbol associated with the symbol and its position information (for example, the bar number where the repetition symbol is located, and the part line or bar line adjacent to the repetition symbol are displayed. Is stored in a musical score element data file in the RAM 15 (step 1404). In this way, it is possible to generate a musical score element data file that stores information on musical score elements including the staff, part line, bar line, repetition symbol, and bar position included in the musical score. Further, when the score includes a plurality of parts, it is desirable to store information in which the position of the staff is associated with the part (tone color) in the score element file.

  The music data dividing unit 44 divides the original music data file into bar-unit data files (unit music data files), and refers to the score element data file to identify overlapping bars based on repetition symbols. Delete one of the duplicate unit music data files. FIG. 15 is a flowchart showing an example of unit music data file generation processing executed by the music data dividing unit. As shown in FIG. 15, the music data dividing unit 44 acquires the original music data file stored in the flash memory 16 (step 1501). The original music data file contains time information (delta time) indicating the time interval between events including the sound production (note-on event), information indicating events including note-on events, and information (units) Information indicating the resolution of how much the quarter note has been decomposed (eg, resolution of 240) and the time signature of the music. Based on the time information between the note-on event and the note-off event, the length of the note applied to the note-on can be known.

  In the original music data, the music data dividing unit 44 calculates the length of the note based on the above resolution with reference to the information indicating the event and the time information from the start portion of the music (step 1502). A unit music data file including information indicating an event for one measure and time information is generated (step 1503). The generated unit music data file is stored in the RAM 15. Next, the music data division unit 44 deletes the overlapping unit music data file based on the information regarding the repeated symbols (repeated symbol type and its position information) included in the musical score element data file (step 1504).

  FIG. 16A schematically shows the structure of a musical score of a certain music piece, and FIG. 16B schematically shows the structure of original music data of the music piece. In FIG. 16A and FIG. 16B, numbers in parentheses indicate bar numbers. In FIG. 16B, the number added before the measure number is the file number of the unit music data file. For example, the file number may be given by the music data dividing unit 44 when a file is generated in step 1503 of FIG. For example, the first unit music data file (see reference numeral 1621) in FIG. 16B has a file number of 1 and corresponds to the first measure as shown in parentheses.

  As shown in FIG. 16 (a), in this musical piece, there is a repeated head symbol and seigno at the beginning of the fifth measure (reference numeral 1605), the first parenthesis at the beginning of the eighth measure (reference numeral 1608), and the rear end. There is a trailing end symbol. There is a second parenthesis at the beginning of the ninth measure (reference numeral 1609). In addition, there is a Tocoder at the beginning of the twelfth measure (reference numeral 1612), a darseño at the rear end of the thirteenth measure (reference numeral 1613), and a coder at the beginning of the fourteenth measure (reference numeral 1614). As shown in FIG. 16B, there are 28 unit music data files divided from the original music data file in units of measures. Since there is repetition, the unit music data file corresponding to the fifth measure appears a plurality of times (see reference numerals 1625, 1629, 1637, and 2641).

  FIG. 31 is a flowchart showing in more detail the processing example of step 1504 of FIG. As shown in FIG. 31, the music data dividing unit 44 initializes a parameter indicating the file number to “1” (step 3101), and refers to the repetition symbol for the unit music data file indicated by the file number, The measure number is calculated (step 3102). The measure number is stored in the RAM 15 in association with the file number of the unit music data file (step 3103). The music data division unit 44 determines whether the measure number calculation has been completed for the file having the last file number (step 3104). If it is determined No in step 3104, the music data dividing unit 44 increments the file number (step 3105) and returns to step 3102.

  If it is determined Yes in step 3104, the music data dividing unit 44 initializes the file number to “1” again (step 3106), and the bar number associated with the music data file indicated by the file number is obtained. Is already present (step 3107). If it is determined Yes in step 3107, the unit music data file having the overlapping measure number is excluded (step 3108). The music data dividing unit 44 determines whether the processing for the file having the last file number has been completed (step 3109). If it is determined No in step 3109, the music data dividing unit 44 increments the file number (step 3110) and returns to step 3107. By such processing, the unit music data file that is not excluded becomes the final unit music data file without duplication. The music data division unit 44 stores the unit music data file that was not excluded in the RAM 15 in association with the measure number as the final unit music data file (step 3111).

  In the example shown in FIG. 16, the music data dividing unit 44 refers to the musical score element data file and repeats the fifth to seventh bars, and the unit music having the file numbers 9 to 11 is repeated. It is determined that the data file is a repeated fifth to seventh measure, and accordingly, it is determined that the ninth to eleventh unit music data files should be excluded. Similarly, the return from bar 13 to bar 5 is detected by the dalseño in the musical score element data file, and in addition to the repetition symbol and the coder of bar 12 and bar coder 14 above, It is determined that the 26th unit music data file is duplicated, and it is determined that these should be excluded.

  In this way, the music data dividing unit 44 can obtain 15 final unit music data files without duplication as shown in FIG. The music data dividing unit 44 also adds a bar number to each unit music data file according to the order of the files. For example, reference numerals 1701 and 1705 indicate unit music data files. As a result of eliminating the duplication, the unit music data file is composed only of files corresponding to the bar numbers of the musical score as shown in FIG. 16A, and the order of the unit music data file is also the order of the bar numbers of the musical score. Match.

  As will be described in detail below, when a unit music data file is played and a musical sound is produced, the repeated symbols in the score element data file are referred to, and the unit music data file to be played back is determined according to the repeated symbols. Can be identified.

  Hereinafter, processing in the terminal device according to the present embodiment will be described. FIG. 18 is a flowchart illustrating an example of processing executed in the terminal device according to the present embodiment. As shown in FIG. 18, when the power of the terminal device 30 is turned on, the CPU 31 of the terminal device 30 executes initial processing including clearing the data in the RAM 35 and the display screen of the display unit 33 (step 1801). .

  When the initial process (step 1801) ends, the CPU 31 detects each operation of the switch on the touch panel 32, and executes a panel switch process for executing a process according to the detected operation (step 1802). For example, various icons (see reference numeral 301 in FIG. 3) are displayed on the screen of the display unit 33, and the switch operation on the touch panel 32 is detected by the CPU 31 when the user touches the icon. FIG. 19 is a flowchart illustrating an example of panel switch processing according to the present embodiment.

  As shown in FIG. 19, the panel switch processing includes song selection processing (step 1901), start / stop switch processing (step 1902), and other panel switch processing (step 1903). FIG. 20 is a flowchart showing an example of song selection processing according to the present embodiment. As shown in FIG. 20, the CPU 31 determines whether or not the position corresponding to the song button on the touch panel 32 is turned on (step 2001). If it is determined No in step 2001, the song selection process is terminated.

  If it is determined Yes in step 2001, the CPU 31 instructs the communication I / F 37 to transmit a song list transmission request to the center device 10 (step 2002). In response to this, the communication I / F 37 transmits a song list transmission request to the center apparatus 10 and receives the song list from the center apparatus 10. The CPU 31 displays the received song list on the screen of the display unit 33 (step 2003). The user can designate a desired song name by touching the cursor button displayed on the display unit 33. The CPU 31 highlights the name of the song where the cursor is located in the song list displayed on the screen of the display unit 33 (step 2004).

  When the CPU 31 detects that the determination switch displayed on the display unit 33 is turned on (Yes in step 2005), the communication I / F 37 displays a musical score data file for displaying the song having the determined song name for the center device 10. Then, a transmission request for a series of unit music data files and musical score element data files is instructed (step 2006). In response to this, the communication I / F 37 transmits to the center apparatus 10 a request to transmit a musical score data file for displaying a predetermined music piece, a series of unit music data files, and a musical score element data file. The musical score data file for display of the music, a series of unit music data files, and a musical score element data file are received (step 2007). The CPU 31 stores the received musical score data file for display, the series of unit music data files, and the musical score element data file in the flash memory 36 (step 2007).

  Next, the CPU 31 displays the score on the screen of the display unit 33 based on the score data file (step 2008). The CPU 31 also scores the score based on the vertical line and bar line coordinates in the score element data file. In step 2009, the area corresponding to the first measure is highlighted. As the highlight display, for example, only that portion may be displayed in a translucent display of another color (red).

  Next, the start / stop switch process will be described. FIG. 21 is a flowchart showing an example of start / stop switch processing according to the present embodiment. As shown in FIG. 21, the CPU 31 determines whether or not the start / stop switch displayed on the display unit 33 has been operated (step 2101). If it is determined No in step 2101, the start / stop switch process is terminated.

  If it is determined YES in step 2101, the CPU 31 inverts the start flag STF stored in the RAM 35 (step 2102) and determines whether the start flag STF is “1” (step 2103). If it is determined Yes in step 2103, the CPU 31 refers to the score element data file and identifies a predetermined unit music data file (step 2104). For example, if the first start / stop switch is on, the CPU 31 specifies the first unit music data file as a predetermined unit music data file. Or if the reproduction | regeneration of a music is stopped by operation of a start / stop switch, CPU31 will specify the unit music data file corresponding to the stopped position as a predetermined unit music data file.

  Next, the CPU 31 acquires a data record at a predetermined address in the specified unit music data file (step 2105). The acquired data record is stored in the RAM 35, for example. For example, if the first start / stop switch is on, the CPU 31 obtains the data record of the head address. Or if the reproduction | regeneration of a music is stopped by operation of a start / stop switch, CPU31 will acquire the data record corresponding to the stop position.

  Further, the CPU 31 starts a timer interrupt (step 2106). When the timer interrupt is started, a timer interrupt process is executed at a predetermined time interval, and a timer provided in the CPU 31 is incremented. If NO is determined in step 2103, that is, if the STF is “0”, the CPU 31 stops the timer interrupt (step 2107).

  Thereafter, the CPU 31 executes another panel switch process (step 1903). Other panel switch processing includes setting tempo data by operating the tempo switch, storing tempo data in the RAM 23, and the like.

  When the panel switch process (step 1802) ends, the CPU 31 executes an image update process (step 1803). In the image update process, the CPU 31 highlights the area of the currently playing bar in the displayed score or displays the score displayed on the screen of the display unit 33 while the music is being played. Change the part. The image update process will be described later again.

  When the image update process (step 1803) ends, the CPU 31 executes a performance operation detection process (step 1804). 22-24 is a flowchart which shows the example of the performance operation detection process concerning this Embodiment. As shown in FIG. 22, the CPU 31 determines whether or not there has been an operation (contact by the user) in the area where the score is displayed on the display unit 33 (step 2201). FIG. 25 is a diagram illustrating an example in which a score is displayed on the screen of the display unit of the terminal device. In FIG. 25, for example, the area inside the broken line 2501 is the area where the score is displayed.

  If it is determined Yes in step 2201, the CPU 31 acquires the coordinates of the position touched by the user (step 2202). In step 2202, in addition to the position coordinates, the number of operations, operation time, operation time (length of contact) and difference values from the previous operation are obtained and stored in the RAM 35. Next, the CPU 31 acquires a bar number corresponding to the touched position based on the coordinates of the position touched by the user and the musical score element data file (step 2203).

  26 and 27 are flowcharts showing the step 2203 of FIG. 22 in more detail. As illustrated in FIG. 26, the CPU 31 acquires the coordinates of the operated position, the number of operations, the operation time, the operation time (the length of time of contact), and the difference value from the previous operation stored in the RAM 35. Next, the CPU 31 determines whether or not the operated position is near the bar line (step 2602). Here, it is only necessary to determine whether the operated position is within a predetermined rectangular area including front and rear, left and right including the bar line.

  If it is determined Yes in step 2602, the CPU 31 refers to the musical score element data file and determines whether a repeat symbol exists for the bar line near the operated position (step 2603). If it is determined Yes in step 2603, the CPU 31 sets the repeat flag in the RAM 35 to “1” and stores the information of the repeat symbol in the RAM 35 (step 2604).

  Next, the CPU 31 determines whether or not the operated position is within a bar range, that is, within an area surrounded by a staff and a bar line (step 2605). If it is determined Yes in step 2605, the CPU 31 refers to the score element data file and obtains a measure number corresponding to the operated position (step 2606). Further, the CPU 31 determines whether or not the operation time is longer than a predetermined threshold Th1 (step 2607). If it is determined Yes in step 2607, the CPU 31 sets the mute flag to “1” (step 2608). In step 2608, in addition to setting the mute flag, the CPU 31 refers to the position of the part line and staff in the musical score element data file, and if the displayed musical score is composed of a plurality of parts, the operation is performed. Information indicating the part is stored in the RAM 35 with the part corresponding to the set position as the mute part. As the information indicating the part, the position information of the staff to be muted can be used.

  Next, the CPU 31 determines whether or not the currently operated position is within a predetermined range from the previous operation position, and whether the difference value as the operation interval is smaller than a predetermined threshold Th2 (step 2701). If YES is determined in step 2701, the current operation count is added to the operation count, and the new operation count is stored in the RAM 35 (step 2702). Thereafter, the CPU 31 obtains a measure number to be played next by a user operation on the score (step 2703).

  FIG. 28 is a flowchart showing step 2703 of FIG. 27 in more detail. As shown in FIG. 28, the CPU 31 determines whether or not the number of iterations stored in the RAM 35 is equal to or less than the number of iterations (step 2801). If it is determined Yes in step 2801, the measure has not been repeated. In this case, the CPU 31 determines whether the number of repetitions is 2 or more (step 2802). If it is determined Yes in step 2802, the CPU 31 stores the next measure number in the RAM 35 as the same number as the current measure number (step 2803). Next, the CPU 31 increments a parameter indicating the number of completions in the RAM 35 (step 2804). If it is determined No in step 2801, that is, if the number of completions is greater than the number of repetitions, the CPU 31 sets the parameter indicating the number of repetitions and the parameter indicating the number of completions stored in the RAM 35 to “0”. Reset (step 2805).

  If it is determined No in step 2802 or after step 2805, the CPU 31 determines whether the repeat flag stored in the RAM 35 is “0” (step 2806). If YES is determined in step 2806, the CPU 31 stores the next bar number in the RAM 35 as a number obtained by adding “1” to the current bar number (step 2807). If it is determined No in step 2806, it means that a repeat symbol exists. Therefore, the CPU 31 executes a repeat destination determination process (step 2808). The repeat destination determination process will be described in detail later.

  When step 2203 in FIG. 22 ends, the CPU 31 determines whether the start flag STF is “1” (step 2204). In step 2204, it is determined whether the music is currently being played. If it is determined Yes in step 2204, the CPU 31 determines whether the repeat flag in the RAM 35 is “0” and the mute flag is “0” (step 2205). In step 2205, when there is an operation on the score displayed while the music is being played, it is determined that this is not an instruction to mute or repeat the part.

  If it is determined Yes in step 2205, it is further determined whether or not the parameter indicating the number of repetitions in the RAM 35 is “0” (step 2206). If it is determined Yes in step 2206, the CPU 31 generates a note-off event for the currently sounding tone in the data record of the unit music data file and instructs the sound source unit 39 (step 2207). Further, the CPU 31 stops the timer interrupt (step 2208) and resets the start flag STF to “0” (step 2209).

  When it is determined No in any of Steps 2204 to 2206 or after Step 2209 is executed, the process proceeds to Step 2301. In step 2301, the CPU 31 determines whether the start flag STF is “1” and the mute flag is “1” (step 2301). If it is determined Yes in step 2301, the CPU 31 generates a note-off event for the tone and pitch tone corresponding to the mute part in the data record of the unit music data file, and instructs the sound source unit 39. (Step 2302). The timbre of the part to be muted can be determined based on the position information of the staff to be muted in the musical score element data file.

  Further, the CPU 31 determines whether or not the next bar number does not match the current bar number (step 2303). If it is determined Yes in step 2303, a unit music data file corresponding to the next measure number is acquired (step 2304). Thereafter, the data record at the head address of the obtained unit music data file is obtained and stored in the RAM 35 (step 2305). Thereafter, the CPU 31 starts a timer interrupt (step 2306) and sets a start flag STF to “1” (step 2307).

  When it is determined No in step 2201, the CPU 31 determines whether the start flag is “1” (step 2401). If it is determined Yes in step 2401, the CPU 31 refers to the unit music data file and determines whether the musical sound currently being generated is the musical sound at the end of the measure (step 2402). When it is determined No in step 2401 or 2402, the performance operation detection process is terminated.

  If it is determined Yes in step 2402, the CPU 31 refers to the musical score element data file and specifies the next measure number (step 2403). As will be described later, when there is no repeat symbol for the end of the current measure in the musical score element data file, the CPU 31 sets the next measure number in the RAM 35 as a number obtained by adding “1” to the current measure number. Store. Also, if there is a repeat symbol at the end of the current measure in the score element data file, or if the next measure number obtained by adding “1” to the current measure number is obtained, it corresponds to the next measure number. If there is a repeat symbol at the head of the measure to be performed (Yes in step 2404), the CPU 31 executes a repeat destination determination process (step 2405). If it is determined No in step 2404 or after step 2405, the process proceeds to step 2304.

  FIG. 29 is a flowchart showing an example of repeat symbol processing according to the present embodiment. In the present embodiment, the repeat symbol includes a first group including a so-called repeated head symbol and rear end symbol, and numbered parentheses associated therewith, and Darseiho, Dacapo, Tucoder, Vide (Coda), and Seño. It is divided into the second group including. Further, for each of the first group and the second group, each symbol is associated with four symbol types, that is, start (Start), end (End), destination (To), and departure (From).

  For example, repeat symbols belonging to the first group are associated with the following symbol types.

First symbol of repetition: Start (Start)
End symbol of repetition: End (End)
Numbered parentheses other than the final number: From
Among the numbered parentheses, the last parenthesis: destination (To).

  The repeat symbols belonging to the second group are associated with the following symbol types.

Da Capo: End (End)
Darseño: End (End)
Top of song: Start (Start), but only if Dacapo exists Seño: Start (Start)
Wiede: From
Coda: Destination (To).

  Therefore, in the musical score element data file, the group (first group or second group) to which the repeat symbol belongs, the name of the repeat symbol, and the symbol type are included corresponding to the measure number. For numbered parentheses, in addition to the above information, a repeat designation number (that is, a number corresponding to a repetition number) is added.

  Repeat symbol processing is executed for each group. Therefore, repeat symbol processing for the first group of repeat symbols and repeat symbol processing for the second group of repeat symbols are performed. As shown in FIG. 29, the CPU 31 refers to the repeat symbol type (step 2901). If the repeat symbol type is Start (Start), the CPU 31 stores the current measure number as the repeat position in the RAM 35 (step 2902).

  If the repeat type is end (End), the CPU 31 sets the measure number at the repeat position as the next measure number in the RAM 35 (step 2903). Further, the CPU 31 increments a parameter indicating the number of repetitions related to the repeat symbol in the RAM 35 (step 2904). If the repeat symbol type is a destination (To), the process ends.

  If the desired repeat type is the departure source (From), the CPU 31 determines whether or not the number of repetitions for the repeat symbol in the RAM 35 is equal to or greater than the repeat designation number (step 2905). If NO in step 2905, the process ends. On the other hand, if it is determined Yes in step 2905, the CPU 31 searches the musical score element data file for a bar including a repeat symbol indicating the destination (To) of the repeat symbol type (step 2906). Here, repeat symbols belonging to the same group are searched. The CPU 31 sets the retrieved bar number as the next bar number in the RAM 35 (step 2907). Further, the CPU 31 resets the number of repetitions related to the repeat symbol to “0” (step 2908).

  With the repeat symbol processing, the following processing is specifically executed for the first group of repeat symbols. For example, for a unit music data file, when a repeated head symbol is included as a repetition symbol in the score element data file, the CPU 31 stores in the RAM 35 the measure number of the unit music data file as a repeat position. When the unit music data file includes a repeated terminal symbol as a repetition symbol in the score element data file, the CPU 31 stores the unit music data file to be read out next in the measure number stored in the RAM 35 as a repeat position. Determine based on.

  In addition, when a unit music data file includes a numbered parenthesis as a repetition symbol in the score element data file, if the number is smaller than the repeat designation number indicating the number of repetitions, the CPU 31 reads the unit to be read next. The music data file is determined according to the measure number that is the repeat position. If the number is equal to or greater than the repeat designation number, the CPU 31 determines a unit music data file to be read out next based on the measure number indicating the destination included in the score element data file.

  For the second group of repeat symbols, the following processing is specifically executed. For example, when the unit music data file includes dacapo as a repetition symbol in the score element data file, the CPU 31 determines the unit music data file to be read next as the unit music data file for the first measure number. .

  When the unit music data file includes “Seiyo” as a repetition symbol in the score element data file, the CPU 31 stores the measure number of the unit music data file in the RAM 35 as the repeat position. If the unit music data file includes a darseño as a repetition symbol in the musical score element data file, the CPU 31 selects the unit music data file to be read next based on the measure number stored in the RAM 35 as a repeat position. decide.

  Further, when the unit music data file contains a video as a repetition symbol in the score element data file, the CPU 31 searches the score element data file for a measure including a coder, and selects a unit music data file to be read next. It is determined as a unit music data file for a bar including the coder.

  When the performance operation detection process (step 1804 in FIG. 18) ends, the CPU 31 executes song processing (step 1805). FIG. 30 is a flowchart showing an example of song processing according to the present embodiment. As shown in FIG. 30, the CPU 31 increments the address of the unit music data file (step 3001). In step 3001, the address of the data record indicating the time is set by the step of the address. The CPU 31 determines whether the address is already at the end of the unit music data file (step 3002). If it is determined Yes in step 3002, the CPU 31 refers to the next measure number stored in the RAM 35 and acquires a unit music data file having the next measure number (step 3003).

  Thereafter, the CPU 31 refers to the time information in the data record indicated by the address in the unit music data file (step 3004), and determines whether the current time has reached the execution timing of the next event based on the time information ( Step 3005). When it is determined Yes in step 3005, the CPU 31 determines whether the mute flag in the RAM 35 is “1” (step 3006). When it is determined Yes in step 3006, the CPU 31 refers to the data record that follows the time information and determines whether the event is related to the tone of the mute part (step 3007). If it is determined YES in step 3007, the song processing is terminated.

  When it is determined Yes in step 3006 or No in step 3007, the CPU 31 executes sound generation / mute processing (step 3008). In step 3008, the CPU 31 refers to the data record that follows the time information, and if the event is a note-on event, generates a note-on event that indicates the tone and pitch of the data record, The sound is output to the sound source unit 39. Further, if the event is a note-off event, the CPU 31 refers to the note-off event for muting the musical sound being generated with the tone color and pitch indicated by the data record, and outputs it to the sound source unit 39.

  When the song process (step 1805) ends, the sound source sound generation process is executed in the sound source unit 39 (step 1806). In the sound source sound generation process, when the sound source unit 39 receives a note-on event from the CPU 31, the waveform data of a predetermined tone color is read from the ROM 34 at a speed according to the tone pitch based on the pitch and tone color information included in the note-on event. Read out and generate predetermined musical tone data. When the sound source unit 39 receives a note-off event from the CPU 31, the tone of tone and pitch indicated in the note-off event are muted.

  When the sound source sound generation process (step 1806) ends, the CPU 31 executes other processes (step 1807) and returns to step 1802. Other processing includes data transmission / reception with the center apparatus 10 via the communication I / F 37, reading of data from an external storage medium (not shown) such as a memory card, and writing of data to the external storage medium.

  Next, the image update process in step 1803 in FIG. 18 will be described again. FIG. 32 is a flowchart illustrating an example of the image update process according to the present embodiment. As shown in FIG. 32, the CPU 32 determines whether the start flag STF is “1” (step 3201). If it is determined No in step 3201, the image update process ends. When it is determined Yes in step 3201, the CPU 31 determines whether or not the next bar number is stored in the RAM 35 (step 3202). If it is determined Yes in step 3202, the bar area corresponding to the next bar number is highlighted (step 3203). Thereafter, the CPU 31 stores the next bar number as the current bar number in the RAM 35 and clears the next bar number (step 3204).

  Thereafter, the CPU 31 obtains the position of the currently highlighted bar area (step 3205), and determines whether the position is within the display range on the lower right side (terminal) of the image (step 3206). . In step 3206, it is determined whether the currently playing bar is located on the lower right side (terminal) of the image. If it is determined YES in step 3206, the CPU 31 reads out the musical score data file portion corresponding to the predetermined number of bars starting from the currently highlighted measure (step 3207), and the read musical score data file. Is displayed on the screen of the display unit 33 (step 3208).

  According to the present embodiment, the musical score element extraction unit 42, in the musical score in the image data file, based on the positions of the part line, staff, and bar line that are constituent elements of the musical score, measures in the musical score. Identify each region and measure number. The music data dividing unit 44 divides the music data file based on the time information in the music data file, and generates a plurality of unit music data files including information indicating the pitch and time information for each measure. . Further, the music data division unit 44 repeats symbols in the score in the image data file based on the type and position of the repeated symbol that is a component of the score, and the position of the part line, staff, and bar line. Is specified, and the unit music data files that are duplicated are eliminated repeatedly from a plurality of unit music data files to obtain a final unit music data file that is not duplicated. The data file and the measure number are associated with each other and stored in the RAM 35. Therefore, in the present embodiment, it is possible to obtain unit music data files each corresponding one-to-one with a musical score measure.

  In the present embodiment, using the unit music data file and the score element data file, the CPU 31 refers to the score element data file and detects a repetitive symbol for the unit music data file related to the sound generation. Then, based on the repetition symbol, a unit music data file to be read out next is determined. Therefore, in the present embodiment, it is possible to reproduce data in a unit music data file according to a repetition symbol.

  For example, in the present embodiment, when a repetition head symbol is included as a repetition symbol in a musical score element data file for a certain unit music data file, the CPU 31 sets a measure number for the unit music data file as a repeat position. And stored in the RAM 35. When the unit music data file includes a repeated terminal symbol as a repetition symbol in the score element data file, the CPU 31 stores the unit music data file to be read out next in the measure number stored in the RAM 35 as a repeat position. Determine based on. As a result, an appropriate unit music data file is selected for the music including the repeated head symbol and repeated terminal symbol, and the music data can be read out.

  In the present embodiment, if a unit music data file includes a numbered parenthesis as a repetition symbol in the musical score element data file, if the number is smaller than the repeat designation number indicating the number of repetitions, the CPU 31. Determines the unit music data file to be read out next according to the measure number which is the repeat position. If the number is equal to or greater than the repeat designation number, the CPU 31 determines a unit music data file to be read out next based on the measure number indicating the destination included in the score element data file. As a result, even when there are numbered parentheses and the repetition is performed twice or more, an appropriate unit music data file is selected and the music data can be read out.

  In the present embodiment, when the unit music data file includes dacapo as a repetition symbol in the score element data file, the CPU 31 selects the unit music data file to be read next as the unit music for the first measure number. Determined as a data file. As a result, it is possible to reproduce an appropriate music piece even in a music piece including a repeated symbol, dacapo, other than the repeated head symbol and terminal symbol.

  Further, in the present embodiment, when a sign music is included as a repetition symbol in the musical score element data file for the unit music data file, the CPU 31 sets the measure number for the unit music data file as the repeat position in the RAM 35. To store. If the unit music data file includes a darseño as a repetition symbol in the musical score element data file, the CPU 31 selects the unit music data file to be read next based on the measure number stored in the RAM 35 as a repeat position. decide. This makes it possible to reproduce appropriate music even for music that includes darseño and repetition using seño.

  Further, when the unit music data file contains a video as a repetition symbol in the score element data file, the CPU 31 searches the score element data file for a measure including a coder, and selects a unit music data file to be read next. It is determined as a unit music data file for a bar including the coder. As a result, appropriate music can be reproduced even for music that includes repetition using a vidé and a coder.

  In the present embodiment, an image data file storing image data of musical scores is stored in the RAM 35. The CPU 31 displays a score image based on the image data file on the display unit 33. Therefore, the user can check the score of the currently played music.

  The present invention is not limited to the above embodiment. For example, in the above embodiment, the center device 10 generates a display score data file, a score element data file, and a unit music data file, and the generated data file is transmitted to the terminal device 30. The terminal device 30 displays the received score data file for display on the screen of the display unit 33, and realizes the performance of the music based on the unit music data file while referring to the score element data file. However, in the center apparatus 10, the center system 10 may perform a musical piece based on the unit music data file while referring to the score element data file using the sound system 18 including the sound source unit 19. Similarly, the center device 10 can realize display of a score based on a score data file for display, designation of a measure, and the like.

  Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the above-described embodiments, and the invention described in the claims and the equivalents thereof are described in the present invention. Is included in the range. Hereinafter, the invention described in the scope of claims attached to the application of the present application will be added. Note that the item numbers of the claims described in the appendix correspond to the item numbers of the claims first attached to the application of the present application.

[Appendix]
According to the first aspect of the present invention, for a series of musical sounds constituting a musical piece, for each measure, a measure number identifying the measure, information indicating a pitch to be pronounced, and time information indicating the sound generation timing are provided. A plurality of unit music data files storing music data including a plurality of unit music data files in which duplication due to repetition is eliminated based on a type and position of a repetition symbol that is a component of the score in the score; ,
A storage element storing a musical score element data file storing musical score element data including the measure number and the type of repetition symbol;
Sound generation control means for reading out the unit music data file and instructing the sound generation means to generate a sound based on the music data;
The pronunciation control means refers to the musical score element data file, detects a repetition symbol for the unit music data file related to the pronunciation of the musical sound, and determines a unit music data file to be read next based on the repetition symbol This is a musical tone generation control device configured to do this.

The invention described in claim 2 includes, as the repetition symbol type, a repetition head symbol and a repetition terminal symbol,
The pronunciation control means includes
For the unit music data file, when a repeated head symbol is included as a repetition symbol in the score element data file, the measure number for the unit music data file is stored in the storage means as the repeat position.
When the unit music data file includes a repetition terminal symbol as a repetition symbol in the musical score element data file, the unit music data file to be read next is based on the measure number stored as the repeat position in the storage means. Is a musical tone generation control device configured to be determined.

The invention described in claim 3 includes numbered parentheses as the type of the repetition symbol,
The pronunciation control means includes
For the unit music data file, when numbered parentheses are included as repetition symbols in the musical score element data file, if the number is smaller than the repeat designation number indicating the number of repetitions, the unit music data file to be read next is , Determined according to the measure number that is the repeat position,
If the number is equal to or greater than the number of repeats specified, the musical sound generation control device is configured to determine a unit music data file to be read out next based on a bar number indicating a destination included in the score element data file. It is.

The invention described in claim 4
As a type of the repeated symbol, including Dacapo,
The pronunciation control means includes
When the unit music data file contains dacapo as a repetition symbol in the musical score element data file, the unit music data file to be read next is determined as the unit music data file for the first measure number. A musical tone generation control device.

The invention described in claim 5 includes Darseño and Seño as the type of the repetition symbol,
For the unit music data file, if the music score element data file includes a saen as a repetition symbol, the measure number for the unit music data file is stored in the storage means as the repeat position.
The pronunciation control means includes
For the unit music data file, if dalseño is included as a repetition symbol in the score element data file, the unit music data file to be read next is determined based on the measure number stored as the repeat position in the storage means. A musical sound generation control device configured as described above.

The invention described in claim 6 includes a Wiede and a coder as the repetition symbol,
The pronunciation control means includes
For the unit music data file, when a score is included as a repetition symbol in the score element data file, a measure including the coder is searched in the score element data file, and the unit music data file to be read next is selected as the coder. A musical sound generation control device configured to determine a unit music data file for a measure including a measure.

In the invention described in claim 7, the storage means has an image data file storing image data of the musical score of the music,
A musical tone generation control device comprising display means for displaying a score image based on the image data file.

According to the eighth aspect of the present invention, for a series of musical sounds constituting a musical piece, for each measure, a measure number specifying the measure, information indicating a pitch to be pronounced, and time information indicating the sounding timing are provided. A plurality of unit music data files storing music data including a plurality of unit music data files in which duplication due to repetition is eliminated based on a type and position of a repetition symbol that is a component of the score in the score; ,
A computer comprising: a musical score element data file storing musical score element data including the bar number and the type of repetition symbol included in the bar;
The unit music data file is read, and based on the music data, a sound generation control step for instructing the sound generation means to generate a sound is executed,
The pronunciation control step refers to the musical score element data file, detects a repetition symbol for the unit music data file related to the sound generation, and determines a unit music data file to be read next based on the repetition symbol. This is a musical sound generation control program.

10 Center device 30 Terminal device 11, 31 CPU
12 Input unit 13, 33 Display unit 14, 34 ROM
15, 35 RAM
16, 36 Flash memory 17, 37 Communication I / F
18, 38 Sound system 19, 39 Sound source unit 21, 41 Speaker 32 Touch panel 42 Musical score element extraction unit 43 Data file generation unit 44 Music data division unit

Claims (7)

In a score in an image data file storing musical score image data, measure specifying processing for specifying each area of the measure in the score based on the positions of the staff and the bar line which are constituent elements of the score; ,
An area specifying process for specifying an area including image data whose degree of coincidence with image data representing the type of repetition symbol is equal to or greater than a predetermined value among the image data in each area in the image data of the score;
A symbol drawing process for drawing a symbol corresponding to the type of the repetition symbol at a position on the image data of the musical score corresponding to the specified area;
The music data file is divided based on the time information in the music data file storing the music data including the information indicating the pitch to be generated and the time information indicating the sound generation timing for a series of musical sounds constituting the music A music data file dividing process for generating a plurality of unit music data files including information indicating pitches and time information for each measure;
In the score in the image data file, the measure in which the symbol is located is specified based on the positions of the staff and bar lines that are components of the score, the drawn symbol and the position thereof, and A unit music data file acquisition process for excluding duplicate unit music data files from the plurality of unit music data files to obtain unit music data files without duplication;
A musical score element data file generation process for generating a musical score element data file storing musical score element data including positions where staff and bar lines exist in the score, each area of the bars, and the type and position of the repeated symbol; The musical score information generation device provided with the processing part which performs. The musical score information generating device further includes:
2. The musical score information generating apparatus according to claim 1, further comprising a position sensor that detects a position where a staff and bar lines that are components of the musical score are present from the image data file. In the area specifying process, the processing unit includes:
An area detection process for detecting an image representing the type of repeated symbol and an area including the highest image data from the image data in each area in the image data of the score;
An area comparison process for comparing the image data in the detected area with the image data of another area in the image data of the score, and specifying an area including image data having a matching degree equal to or greater than a predetermined value; ,
The musical score information generating apparatus according to claim 1 or 2, wherein In the area detection process, the processing unit
A calculation process for calculating a correlation value between the image data of each area in the image data of the score and the image data of the repetition symbol to be specified;
A maximum correlation value area detection process for detecting an area where the calculated correlation value is maximum;
Run
In the area comparison process,
Calculation for calculating the correlation value between the image data of the area having the maximum correlation value and the image of the other area in the image data of the score, and specifying the area where the calculated correlation value is larger than a certain threshold value Processing,
The musical score information generating apparatus according to claim 3, wherein: The processing unit, in the unit music data file acquisition process,
The corresponding measure number is calculated for each unit music data file, and it is determined whether or not the associated measure number already exists sequentially from the head unit music data file. The musical score information generating apparatus according to claim 1, wherein processing for excluding files is executed. A musical score information generation method used in a musical score information generation apparatus having a processing unit, wherein the processing unit includes:
In the score in the image data file storing the image data of the musical score of the music, each region of the measure in the score is specified based on the positions of the staff and the bar line that are constituent elements of the score,
Among the image data in each area in the image data of the score, specify an area including image data whose degree of coincidence with the image data representing the type of repetition symbol is equal to or greater than a predetermined value,
Draw a symbol corresponding to the type of repetitive symbol at a position on the image data of the score corresponding to the specified area,
The music data file is divided based on the time information in the music data file storing the music data including the information indicating the pitch to be generated and the time information indicating the sound generation timing for a series of musical sounds constituting the music A plurality of unit music data files including information indicating pitches and time information for each measure,
In the score in the image data file, the measure in which the symbol is located is specified based on the positions of the staff and bar lines that are components of the score, the drawn symbol and the position thereof, and From the plurality of unit music data files, duplicate unit music data files are eliminated by repetition, and a unit music data file without duplication is obtained,
A musical score information generation method for generating a musical score element data file storing musical score element data including positions where staffs and bar lines exist in the musical score, areas of each bar, and types and positions of the repeated symbols. In a computer used as a musical score information generating device,
A measure specifying step for specifying each region of the measure in the score based on the positions of the staff and the measure line which are components of the score in the score in the image data file storing the image data of the musical score of the music; ,
An area specifying step for specifying an area including image data having a degree of coincidence with an image representing a type of repetitive symbol among the image data in each area in the image data of the score;
A symbol drawing step of drawing a symbol corresponding to the type of the repeated symbol at a position on the image data of the score corresponding to the specified area;
The music data file is divided based on the time information in the music data file storing the music data including the information indicating the pitch to be generated and the time information indicating the sound generation timing for a series of musical sounds constituting the music A music data file dividing step for generating a plurality of unit music data files including information indicating pitches and time information for each measure;
In the score in the image data file, the measure in which the symbol is located is specified based on the positions of the staff and bar lines that are components of the score, the drawn symbol and the position thereof, and A unit music data file acquisition step of acquiring unit music data files without duplication by excluding duplicate unit music data files by repetition from the plurality of unit music data files;
A score element data file generation step for generating a score element data file storing score element data, including the positions where staff and bar lines exist in the score, the areas of each measure, and the type and position of the repetition symbol;
A program that executes

Images