JP2007025411A - Musical score display device and musical score display program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a musical score display device visually representing information other than a musical score. <P>SOLUTION: A mean sound length meanlen, a mean pitch meanpit, and a mean sound volume meanvel are calculated as parameters representing the impression of selected music, and converted into a conversion value A, a conversion value B, and a conversion value C corresponding to three color properties (brightness Bri, saturation Sat, and hue Hue). A header HD[minp] having the brightness Bri, the saturation Sat, and the hue Hue closest to those conversion value A, conversion value B, and conversion value C is retrieved from an image database IDB and image data D[minp] specified by the corresponding header HD[minp] are displayed as the background of a musical score. Consequently, since an image matching the impression of the music to be displayed in the form of a musical score is displayed as the background of the musical score, information other than the musical score can visually be expressed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a score display apparatus and a score display program for visually expressing information other than a score.

  2. Description of the Related Art Music score display devices that display music data representing each sound constituting a music in a musical score are known. For example, Japanese Patent Laid-Open No. 2004-228620 can effectively perform performance practice by displaying a portion instructed for performance in a musical score in a designated color using relationship information indicating a correspondence relationship between a color and an instruction regarding how to perform a song. A musical score display apparatus as described above is disclosed.

Japanese Patent Laid-Open No. 2003-5743

By the way, in the apparatus disclosed in the above-mentioned patent document 1, since the performance instruction portion in the score is displayed in a designated color and the performance practice is only assisted, information other than the score such as the impression of the music to be scored and the performance result of the user is provided. There is a problem that cannot be expressed visually.
Therefore, the present invention has been made in view of such circumstances, and a musical score display apparatus and a musical score display program capable of visually expressing information other than a musical score, such as an impression of a song to be scored and a performance result of a user, are provided. It is intended to provide.

  In order to achieve the above object, according to the first aspect of the present invention, image storage means for storing color attributes and image data for each image and music data storage means for storing music data representing each sound constituting the music. A parameter that represents the impression of the song from the song data stored in the song data storage unit, and a song analysis unit that converts the parameter into a conversion value corresponding to a color attribute; and the song analysis unit An image selection unit that selects image data having a color attribute closest to the conversion value from the image storage unit, and a background image display that displays the image data selected by the image selection unit as a background image of a score according to the corresponding color attribute Means.

  According to the second aspect of the present invention, performance evaluation means for generating an evaluation result of performance data generated by a user performance is corrected with respect to song data serving as a performance model, and is corrected according to the evaluation result generated by the performance evaluation means. Image correction means for changing the display mode of the image displayed as the background of the score according to the color attribute.

  According to the third aspect of the present invention, image storage means for storing color attributes and image data for each image, music data storage means for storing music data representing each sound constituting the music, and the music data storage means A song analysis means for extracting a parameter representing the impression of the song from the song data stored in the song data and converting the parameter into a conversion value corresponding to the color attribute; and a color attribute closest to the conversion value generated by the song analysis means An image selection unit that selects the image data from the image storage unit, a background image display unit that displays the image data selected by the image selection unit as a background image of a score according to a corresponding color attribute, and a performance example Performance evaluation means for generating performance data evaluation results generated by user performance with respect to song data, and color attributes corrected according to the evaluation results generated by the performance evaluation means Accordingly, characterized by comprising an image correcting means for varying the display mode of the displayed background image by the background image display means.

  The invention according to claim 4, which is dependent on any one of claims 1 to 3, is characterized in that the color attribute specifies lightness, saturation and hue of a corresponding image.

  In the invention according to claim 5 that depends on either claim 2 or 3, the image correction means corrects at least one of brightness, saturation, and hue according to the evaluation result. .

  According to the sixth aspect of the present invention, a song analysis process for extracting a parameter representing the impression of a song from song data representing each sound constituting the song and converting it into a converted value corresponding to a color attribute, and storing in advance An image selection process for selecting image data having a color attribute closest to the conversion value generated by the music analysis means from among the color attribute and image data for each image, and the image data selected by the image selection process And a background image display process for displaying as a background image of a musical score according to a corresponding color attribute.

  According to the seventh aspect of the present invention, a song analysis process for extracting a parameter representing the impression of a song from song data representing each sound constituting the song and converting it into a conversion value corresponding to a color attribute, and storing in advance An image selection process for selecting image data having a color attribute closest to the conversion value generated by the music analysis means from among the color attribute and image data for each image, and the image data selected by the image selection process A background image display process for displaying the image as a background image of a musical score according to a corresponding color attribute, a performance evaluation process for generating a performance data evaluation result generated by a user performance for music data serving as a performance model, and the performance evaluation And an image correction process for changing the display mode of the background image displayed in the background image display process according to the color attribute corrected according to the evaluation result generated by the process. Characterized in that it run on the data.

  According to the first and sixth aspects of the invention, when a parameter representing the impression of a song is extracted from the song data and converted to a conversion value corresponding to the color attribute, image data having a color attribute closest to the conversion value is obtained. It is selected from among color attributes and image data for each image stored in advance, and the selected image data is displayed as a background image of a score according to the corresponding color attribute. Accordingly, since an image suitable for the impression of the music to be scored is displayed as the background of the score, information other than the score can be visually expressed.

  According to the second aspect of the present invention, when an evaluation result of performance data generated by a user performance is generated for music data serving as a performance model, the background of the score is generated according to the color attribute corrected according to the evaluation result. The display mode of the displayed image is varied. As a result, since the display mode of the image serving as the background of the score changes according to the performance result of the user, information other than the score can be visually expressed.

According to the third and seventh aspects of the present invention, when a parameter representing the impression of a song is extracted from the song data and converted into a conversion value corresponding to the color attribute, image data having a color attribute closest to the conversion value is obtained. It is selected from among color attributes and image data for each image stored in advance, and the selected image data is displayed as a background image of a score according to the corresponding color attribute. As a result, an image suitable for the impression of the music to be scored is displayed as the background of the score, so that information other than the score can be visually expressed.
Further, when an evaluation result of performance data generated by a user performance is generated with respect to music data serving as a performance example, the display mode of the background image is changed according to the color attribute corrected according to the evaluation result, so that the performance of the user Depending on the result, the display mode of the background image of the score changes and information other than the score can be visually expressed.

Embodiments of the present invention will be described below with reference to the drawings.
A. Configuration FIG. 1 is a block diagram showing a configuration of a score display apparatus according to an embodiment of the present invention. In this figure, the operation unit 10 includes input operation elements such as a key input keyboard and a mouse in addition to the power switch, and generates an event corresponding to the input operation. This event is captured by the CPU 11. The CPU 11 executes various control programs stored in the ROM 12 and controls each part of the apparatus in response to an event generated by the operation unit 10, and its characteristic processing operation will be described in detail later.

  The ROM 12 includes a program area and a data area. Various control programs loaded on the CPU 11 are stored in the program area of the ROM 12. The various control programs include a main routine, music analysis processing, image selection processing, performance evaluation processing, score display processing, image correction processing, score drawing processing, and background drawing processing which will be described later. The data area of the ROM 12 stores musical score display data for displaying notes, rests, staffs, and various screen data for forming a GUI screen. The RAM 13 includes a work area and a data area. In the work area of the RAM 13, various register / flag data used for the processing of the CPU 11 are temporarily stored. The data area of the RAM 13 has an image data area and a song data area.

  An image database IDB is provided in the image data area of the RAM 13. FIG. 2 is a diagram showing the configuration of the image database IDB provided in the image data area of the RAM 13. The image database IDB shown in this figure includes headers HD [0] to HD [N] representing the color attributes of the images and image data D [0] to [N] corresponding to the headers HD [0] to HD [N]. N]. The header HD specifies the pointer HP specifying the corresponding image data D, and the brightness Bri, saturation Sat, and hue Hue of the image data D [HP] specified by the pointer HP.

  The lightness Bri, saturation Sat, and hue Hue are the three attributes of color, the lightness Bri is brightness representing brightness, the saturation Sat is purity (saturation) representing color vividness, and the hue Hue is hue. Respectively. In this embodiment, as will be described later, a header HD [picp] having the brightness Bri, saturation Sat, and hue Hue closest to the impression of the music to be scored is searched from the image database IDB, and the corresponding header HD [picp] The image data D [picp] specified by is displayed as the background of the score.

  In the song data area of the RAM 13, song headers KH [0] to KH [N] representing the attributes of each song and song data KD [0] to [N] corresponding to these headers KH [0] to KH [N]. ]. As shown in FIG. 3, the song header KH is composed of a pointer P designating the corresponding song data KD, a tempo Tmp, a key Key, and a time signature Baet of the song data KD [P] designated by the pointer P. . Although not shown, the song data KD has a sound generation time, a tone length, a pitch, and a volume of each sound constituting the song, and is provided with data end indicating the end at the end of the song.

  The sound source 14 is configured by a well-known waveform memory reading method, and reproduces music data sequentially read out from the music data area of the RAM 13 by the CPU 11 in synchronization with a specified tempo and outputs a musical tone signal. The sound system 15 D / A converts the musical tone signal output from the sound source 14 and then amplifies it to generate sound from the speaker SP. The display unit 16 displays a musical score according to a display control signal supplied from the CPU 11 and displays an operation state of the apparatus.

  The interface (I / F) unit 17 includes a MIDI interface for exchanging MIDI format music data with an external MIDI device in addition to a normal interface for exchanging image data D with an external apparatus under the control of the CPU 11. Although not shown in FIG. 1, when a keyboard device is connected as an external MIDI device to the MIDI interface of the interface (I / F) unit 17, it occurs corresponding to a key release operation of the keyboard device. The performance data is stored as performance data in the song data area of the RAM 13 via the MIDI interface.

B. Operation Next, the operation of the embodiment having the above-described configuration will be described with reference to FIGS. In the following, first, the operation of the main routine will be described as the overall operation, and then each operation of music analysis processing, image selection processing, performance evaluation processing, and score display processing called from the main routine will be described.

(1) Operation of main routine In response to turning on the power of the apparatus, the CPU 11 executes the main routine shown in FIG. 4 and proceeds to step SA1 to reset various registers / flags provided in the work area of the RAM 13. Or perform initialization to set the initial value. Then, the process proceeds to step SA2 and enters a state of waiting for a key operation input by the user. Next, in steps SA3 to SA8, key operations for instructing execution of “song selection”, “image selection”, “playback selection”, “performance start”, “performance evaluation”, and “print” while waiting for key operation input. Determine whether there is input.

  When a key operation input for instructing “song selection” is performed, in step SA3, a song selection GUI screen for displaying a list of song data stored in the song data area of the RAM 13 is generated and displayed on the display unit 16. To display. When the user selects a song on this song selection GUI screen, the determination result in step SA3 is “YES”, and after performing a song analysis process (described later) via step SA9, step SA15 is executed. Then, a score display process (described later) is executed, and then the process returns to step SA2 to return to the key operation input waiting state.

  When a key operation input for instructing “image selection” is performed, the determination result in step SA4 is “YES”. After performing image selection processing (described later) via step SA10, step SA15 is performed. Then, a score display process (described later) is executed, and then the process returns to step SA2 to return to the key operation input waiting state.

  When the key operation input for instructing “reproduction selection” is performed, the determination result in step SA5 is “YES”, and the process proceeds to step SA11. In step SA11, a reproduction process for reproducing the music data selected in step SA3 is executed. Thereafter, a score display process (described later) is executed via step SA15, and then the process returns to step SA2 to return to the key operation input waiting state.

  When the key operation input for instructing “start of performance” is performed, the determination result of step SA6 is “YES”, and the process proceeds to step SA12. In step SA12, in accordance with a user's performance operation, a performance process is performed in which performance data input from an external MIDI device (for example, a keyboard) via the MIDI interface of the interface unit 17 is loaded into the music data area of the RAM 13. Thereafter, a score display process (described later) is executed via step SA15, and then the process returns to step SA2 to return to the key operation input waiting state.

  When a key operation input for instructing “performance evaluation” is performed, the determination result in step SA7 is “YES”. After performing performance evaluation processing (described later) through step SA13, step SA15 is performed. Then, a score display process (described later) is executed, and then the process returns to step SA2 to return to the key operation input waiting state.

  When a key operation input for instructing “print” is performed, the determination result of step SA8 is “YES”, and the process proceeds to step SA14. In step SA14, a printing process for printing the score and the background displayed on the screen of the display unit 16 is executed. Thereafter, a score display process (described later) is executed via step SA15, and then the process returns to step SA2 to return to the key operation input waiting state.

(2) Music Analysis Processing Operation Next, the music analysis processing operation will be described with reference to FIG. When this process is executed via step SA9 (see FIG. 4) of the main routine described above, the CPU 11 advances the process to step SB1. In steps SB1 to SB4, the register meanlen, the register meanpit, the register meanbel, and the counter n are reset to zero. Next, in step SB5, a note pointer notep for designating each sound (note) in the music piece data KD [P] selected in step SA3 (see FIG. 4) is initialized.

  Subsequently, in step SB6, it is determined whether or not the note pointer note has reached the end end of the music piece data KD [P]. If the terminal end has not been reached, the determination result is “NO”, and the flow proceeds to step SB7. In step SB7, the note length designated by the note pointer note is added to the register meanlen. Next, in step SB8, the pitch of the note designated by the note pointer note is added to the register meanpit. Subsequently, in step SB9, the volume of the note designated by the note pointer note is added to the register meanlevel. In step SB10, the counter n is incremented and incremented. Next, in step SB11, the note pointer notep is incremented, and then the process returns to step SB6 described above.

  Thereafter, the above-described steps SB6 to SB11 are repeated until the stepped note pointer notep reaches the end end of the song data KD [P], whereby the song data KD [ P] is counted by the counter n, the value obtained by accumulating the note length of each note is stored in the register meanlen, the value obtained by accumulating the pitch of each note is stored in the register meanpit, and the volume of each note. Are accumulated in the register meanvel. When the note pointer notep reaches the end ending of the music piece data KD [P], the determination result in Step SB6 is “YES”, and the flow proceeds to Step SB12.

In steps SB12 to SB14, the average pitch, average pitch and average volume obtained by dividing the pitch length accumulated value, pitch accumulated value and volume accumulated value by the number of notes counted by the counter n, respectively. Are stored in the register meanlen, the register meanpit, and the register meanvel, respectively.
As described above, in the music analysis process, the average tone length meanlen, average pitch meanpit and average volume meanbel of the song data KD [P] selected in step SA3 (see FIG. 4) are calculated. .

(3) Operation of Image Selection Process Next, the operation of the image selection process will be described with reference to FIG. When this process is executed via step SA10 (see FIG. 4) of the main routine described above, CPU 11 advances the process to step SC1. In step SC1, the average tone length meanlen obtained in the above-described music analysis process based on the following equation (1) is converted into a conversion value A corresponding to the brightness Bri. Similarly, in steps SC2 to SC3, the above-described music analysis is performed on the converted value B in which the average pitch meanpit obtained in the above-described music analysis processing based on the following expressions (2) and (3) is associated with the saturation Sat. The average sound volume meanbel obtained by the processing is converted into a conversion value C corresponding to the hue Hue.

Conversion value A = 64 × log 2 (meanlen / res) (1)
Conversion value B = meanpit × 2 (2)
Conversion value C = meanvel × 2 (3)
In the above equations (1) to (3), the constant res and the multiplication coefficient are set so that the conversion values A to C are within the range of “0 to 255”, respectively.

Subsequently, in steps SC4 to SC5, the register minv, the register minp, and the pointer picp are initialized. Next, in step SC6, it is determined whether or not the pointer picp for designating the header HD [picp] in the image database IDB has reached the end end. If the pointer picp has not reached the end end, the determination result is “NO”, and the flow proceeds to step SC7. In step SC7, (conversion value A, conversion value B, conversion value C) calculated in steps SC1 to SC3 and (lightness Bri, saturation Sat, hue) in the header HD [picp] specified by the pointer picp. The difference from Hue) is calculated and stored in the register min. The difference referred to here is the square sum ((A-Bri) of the difference (conversion value A-lightness Bri), (conversion value B-saturation Sat), and (conversion value C-hue Hue) for each element. ) ² + (B-Sat) ² + (C-Hue) ² ) ^1/2 .

  Next, in step SC8, it is determined whether or not the value of the register minv that holds the smallest difference is larger than the value of the register min that holds the difference calculated in step SC7. If min> minv, the determination result is “NO”, and the process proceeds to step SC11, which will be described later. If min <minv, the determination result is “YES”, the process proceeds to step SC9, and the value of the register min Is updated and registered in the register minv. As a result, the minimum difference is held in the register minv.

  Subsequently, in step SC10, a pointer picp designating the header HD [picp] having (lightness Bri, saturation Sat, hue Hue) corresponding to the minimum difference is stored in the register minp. Next, the process proceeds to step SC11, the pointer picp is incremented, and the process returns to step SC6 described above. Thereafter, steps SC6 to SC11 are repeated until the pointer picp reaches the end end, whereby the minimum difference is stored in the register minv, and the pointer picp corresponding to the minimum difference is stored in the register minp. When the pointer picp reaches the end end, the determination result in step SC6 is “YES”, and this processing is completed.

  In this way, in the image selection process, the average pitch mean mean (converted value A), average pitch mean pitch (converted value B) and average volume mean level (converted value C) of the music obtained in the above-described music analyzing process are the most. By searching the header HD [minp] having the near brightness Bri, saturation Sat, and hue Hue from the image database IDB (see FIG. 2), a background image suitable for the impression of the song is selected.

(4) Operation of Performance Evaluation Process Next, the operation of the performance evaluation process will be described with reference to FIG. In the performance evaluation process, the performance data fetched in the music data area of the RAM 13 in the performance process executed through step SA12 (see FIG. 4) of the main routine is compared with the music data corresponding to the model performance. Evaluate. That is, when this process is executed through step SA13 (see FIG. 4) of the main routine described above, the CPU 11 stores the register devon, the register devoff, the register devvel, the pointer n, and the note pointer notep in steps SD1 to SD5. Reset each to zero. Subsequently, in step SD6, it is determined whether or not the note pointer notep has reached the end end of the performance data.

  If the terminal end has not been reached, the determination result is “NO”, and the flow proceeds to step SD7. In step SD7, the correct note corresponding to the sound in the performance data designated by the note pointer note (hereinafter referred to as performance note) is retrieved from the music data KD and stored in the register tnote. Note that the correct note stored in the register tnote is composed of a pronunciation time, a tone length, a pitch, and a volume. Next, in step SD8, the absolute difference between the sounding time of the performance note designated by the note pointer note and the sounding time of the correct note stored in the register tnote is added to the register devon as a “sounding timing deviation”.

  Next, in step SD9, the absolute time between the sounding time obtained from the sounding time and sound length of the performance note specified by the note pointer note and the sounding time obtained from the sounding time and sound length of the correct note stored in the register tnote. The difference is added to the register devoff as “mute timing difference”. In step SD10, the absolute difference between the volume of the performance note specified by the note pointer note and the volume of the correct note stored in the register tnote is added to the register devvel as a “velocity difference”. In step SD11, the counter n is incremented and incremented. In the subsequent step SD12, the note pointer notep is incremented, and then the process returns to step SD6.

  Thereafter, the above steps SD6 to SD12 are repeated until the stepped note pointer notep reaches the end ending of the performance data, whereby the number of performance notes is counted by the counter n and the performance data “sounding timing deviation” is counted. The “accumulated value” is stored in the register devon, the “silence timing shift accumulated value” is stored in the register devoff, and the “velocity difference accumulated value” is stored in the register devvel. When the note pointer notep reaches the end ending of the performance data, the determination result in step SD6 is “YES”, and the flow advances to step SD13.

  Then, in steps SD13 to SD15, the “sounding timing deviation accumulated value”, “mute timing deviation accumulated value” and “velocity difference accumulated value” are respectively divided by the number of performance notes counted by the counter n. The obtained “sounding timing deviation average value”, “mute timing deviation average value”, and “velocity difference average value” are stored in the register devon, the register devoff, and the register devvel, respectively, and the process is finished.

  In this way, in the performance evaluation process, the performance data pronunciation timing deviation average value devon and mute timing are determined by performance evaluation comparing performance data fetched into the music data area of the RAM 13 by performance processing and music data serving as a performance model. The deviation average value devoff and the velocity difference average value devvel are calculated.

(5) Operation of Score Display Processing Next, the operation of the score display processing will be described with reference to FIGS. The musical score display process executed via step SA15 (see FIG. 4) of the main routine described above is executed via image correction process executed via step SE1 and step SE2, as shown in FIG. And a musical score drawing process. The operations of the image correction process and the score drawing process will be described below.

(6) Image Correction Process Operation In the image correction process, any of the evaluation elements (sound generation timing shift average value devon, mute timing shift average value devoff and velocity difference average value devvel) obtained in the performance evaluation process described above. According to one evaluation element or a plurality of evaluation elements, any one attribute or a plurality of attributes are selected from the three color attributes (brightness Bri, saturation Sat, and hue Hue) of the image displayed as the background of the score. to correct. The image correction process of the example illustrated in FIG. 9 corrects the brightness Bri of the background image according to the sound generation timing shift average value devon.

  When the image correction process is executed through step SE1 in FIG. 8, the CPU 11 proceeds to step SF1 shown in FIG. 9, and a predetermined coefficient ron is added to the sounding timing deviation average value devon obtained in the performance evaluation process described above. To calculate a corrected brightness Rbri. Next, in step SF2, the pixel pointer picp is initialized. Subsequently, in steps SF3 to SF7, each of the background images (image data D [minp] specified by the header HD [minp]) selected by the above-described image selection process while incrementing the pixel pointer picp is configured. Pixel values (Red, Gr, B1) are read out, and the read pixel values (Red, Gr, B1) are increased according to the corrected lightness Rbri. In other words, correction is performed so that the lightness increases as the sound generation timing deviation average value “devon” increases. When the brightness correction is completed for all the pixel values constituting the background image, the determination result in step SF3 is “YES”, and the present process ends.

  Therefore, according to the image correction processing of the example shown in FIG. 9, the brightness of the background image increases as the sound generation timing deviation average value “devon” generated by the user's performance increases, that is, the lower the performance, the higher the brightness of the background image. The result becomes obvious and information other than the score can be expressed visually.

  Note that the image correction processing in the example illustrated in FIG. 9 is limited to simple correction in which the brightness is corrected according to the sound generation timing deviation average value “devon” in order to simplify the description. Three attributes (lightness Bri, saturation Sat, and saturation Sat) of the image as the background of the score display, according to a plurality of evaluation elements of (average pronunciation timing deviation value Devon, mute timing deviation average value devoff, and velocity difference average value devvel) It goes without saying that various visual expressions can be achieved by correcting a plurality of attributes in the hue Hue).

(7) Operation of Score Drawing Process Next, the operation of the score drawing process will be described with reference to FIGS. When the score drawing process is executed via step SE2 of FIG. 8, the CPU 11 proceeds to step SG1 shown in FIG. 10 and executes the background drawing process. The background drawing process includes steps SH1 to SH9 illustrated in FIG. The operation of the background drawing process will be described below with reference to FIG. First, in step SH1, the background image (image data D [minp] specified by the header HD [minp]) selected by the above-described image selection process is read and drawn.

  Next, in step SH2, the stage counter is initialized. The stage counter counts the number of staffs (stave) to be drawn on the background image. In step SH2, it is determined whether or not the value of the stage counter has reached the final stage end, that is, whether or not all stages have been drawn. If all the stages have not been drawn, the determination result is “NO”, and the process proceeds to step SH4 to initialize the staff counter. The staff counter is a counter that counts the number of lines of the staff.

  In steps SH5 to SH8, each line of the staff is drawn in order while incrementing the staff counter. In the process, a background image is masked at a place where a background mask is necessary. When the drawing of each line of the staff is completed, the determination result in step SH5 is “YES”, and the process proceeds to step SH9 to increment the stage counter. Thereafter, steps SH3 to SH9 are repeated until all the stages are drawn. Then, when all the stages have been drawn, the determination result in step SH9 is “YES”, and this process ends.

  When the background drawing process illustrated in FIG. 10 is completed, the CPU 11 proceeds to step SG2 illustrated in FIG. 11 and initializes a bar counter that counts the number of bars in the score. Next, in step SG3, it is determined whether or not the value of the bar counter has reached the final bar end, that is, whether or not the notes have been drawn for all bars. If drawing of the notes for all the bars has not been completed, the determination result is “NO”, the process proceeds to step SG4, and bar lines are drawn based on the bar information. Then, the process proceeds to step SG5, and a note pointer notep for designating a note in the measure is initialized.

  Subsequently, in steps SG6 to SG9, the display position within the measure of each note sequentially designated according to the stepped note pointer notep is calculated and drawn. When all the notes in one measure have been drawn, the determination result in step SG6 is “YES”, and the flow proceeds to step SG10. In step SG10, the bar counter is incremented, and then the process returns to step SG3. Thereafter, the above-described steps SG3 to SG10 are repeated until drawing of notes for all the bars is completed, and when drawing of notes for all of the bars is completed, the determination result of step SG3 becomes “YES”, and this processing is finished.

  As described above, in the present embodiment, when a song to be scored is selected, the average pitch meanlen, the average pitch meanpit, and the average volume meanbel are calculated from the song data of the song as parameters representing the impression of the selected song. Are converted into a conversion value A, a conversion value B, and a conversion value C that correspond to the three color attributes (lightness Bri, saturation Sat, and hue Hue). The header HD [minp] having the brightness Bri, saturation Sat, and hue Hue closest to the conversion value A, conversion value B, and conversion value C is searched from the image database IDB, and the corresponding header HD [minp] is used. The designated image data D [minp] is displayed as the background of the score. As a result, since an image suitable for the impression of the music to be scored is displayed as the background of the score, information other than the score can be visually expressed.

  Further, in the above-described embodiment, as a plurality of evaluation elements for evaluating performance data generated by user performance with respect to song data serving as a performance model, for example, sound generation timing shift average value devon, mute timing shift average value devoff, and velocity difference average value devvel is generated, and according to any one of the plurality of evaluation elements or a plurality of evaluation elements, the three color attributes (brightness Bri, saturation Sat, and hue Hue) of the image displayed as the background of the score are generated. ), Any one attribute or a plurality of attributes are corrected. As a specific example, if the brightness Bri of the background image is corrected according to the sound generation timing deviation average value “devon”, the display mode of the image serving as the background of the score display changes according to the performance result of the user. The information can be expressed visually.

  In the present embodiment, as a parameter representing the impression of a song, an average pitch length meanlen, an average pitch meanpit and an average volume meanbel are calculated from the song data of the song, and these are assigned to three color attributes (lightness Bri, saturation). The conversion value A, the conversion value B, and the conversion value C corresponding to Sat and chromatic hue Hue) are converted. However, the present invention is not limited to this. These can be converted into conversion values corresponding to the three color attributes.

It is a block diagram which shows the structure of one Embodiment by this invention. It is a figure which shows the structure of image database IDB. It is a figure which shows the structure of the music header KH. It is a flowchart which shows operation | movement of a main routine. It is a flowchart which shows the operation | movement of a music analysis process. It is a flowchart which shows operation | movement of an image selection process. It is a flowchart which shows the operation | movement of a performance evaluation process. It is a flowchart which shows the operation | movement of a score display process. It is a flowchart which shows operation | movement of an image correction process. It is a flowchart which shows the operation | movement of a score drawing process. It is a flowchart which shows operation | movement of a background drawing process.

Explanation of symbols

10 Operation unit 11 CPU
12 ROM
13 RAM
14 sound source 15 sound system 16 display unit 17 interface unit

Claims (7)

Image storage means for storing color attributes and image data for each image;
Song data storage means for storing song data representing each sound constituting the song;
A song analysis unit that extracts a parameter representing the impression of a song from the song data stored in the song data storage unit and converts the parameter into a conversion value corresponding to a color attribute;
Image selecting means for selecting, from the image storage means, image data having a color attribute closest to the conversion value generated by the music analysis means;
And a background image display means for displaying the image data selected by the image selection means as a background image of the score according to the corresponding color attribute. Performance evaluation means for generating a performance data evaluation result generated by a user performance with respect to song data serving as a performance model,
A score display apparatus comprising: an image correction unit that changes a display mode of an image displayed as a score background according to a color attribute that is corrected according to an evaluation result generated by the performance evaluation unit. Image storage means for storing color attributes and image data for each image;
Song data storage means for storing song data representing each sound constituting the song;
A song analysis unit that extracts a parameter representing the impression of a song from the song data stored in the song data storage unit and converts the parameter into a conversion value corresponding to a color attribute;
Image selecting means for selecting, from the image storage means, image data having a color attribute closest to the conversion value generated by the music analysis means;
Background image display means for displaying the image data selected by the image selection means as a background image of a score according to a corresponding color attribute;
Performance evaluation means for generating a performance data evaluation result generated by a user performance with respect to song data serving as a performance model,
An image correcting means for changing a display mode of the background image displayed by the background image display means according to a color attribute corrected according to an evaluation result generated by the performance evaluation means. . 4. The musical score display device according to claim 1, wherein the color attribute specifies brightness, saturation, and hue of a corresponding image. 4. The musical score display apparatus according to claim 2, wherein the image correction unit corrects at least one of brightness, saturation, and hue according to an evaluation result. A song analysis process for extracting parameters representing the impression of a song from song data representing each sound constituting the song and converting it into a conversion value corresponding to the color attribute;
Image selection processing for selecting image data having a color attribute closest to the conversion value generated by the music analysis means, among color attributes and image data for each image stored in advance,
A score display program for causing a computer to execute background image display processing for displaying image data selected by the image selection processing as a background image of a score in accordance with a corresponding color attribute. A song analysis process for extracting parameters representing the impression of a song from song data representing each sound constituting the song and converting it into a conversion value corresponding to the color attribute;
Image selection processing for selecting image data having a color attribute closest to the conversion value generated by the music analysis means, among color attributes and image data for each image stored in advance,
A background image display process for displaying the image data selected by the image selection process as a background image of a score according to a corresponding color attribute;
A performance evaluation process for generating a performance data evaluation result generated by a user performance with respect to song data serving as a performance model,
An image correction process for changing a display mode of the background image displayed in the background image display process according to a color attribute corrected according to an evaluation result generated by the performance evaluation process is executed by a computer. Music score display program.

Images