JP6304092B2 - Display control apparatus and program - Google Patents

Description

  The present invention relates to a display control device for displaying a singing pitch and a program.

  Conventionally, a display device that analyzes a singing voice of a song in which lyrics are assigned to at least a part of a plurality of notes, estimates a singing pitch, and displays the singing pitch on a piano roll of the song. Is known (see Patent Document 1).

  In the display device described in Patent Document 1, the singing pitch is estimated based on the result of frequency analysis (for example, FFT (Fast Fourier Transform)) of the input voice.

Japanese Patent Laid-Open No. 2008-020798

  As described above, in the display device described in Patent Document 1, since frequency analysis is required for estimating the singing pitch, until the estimation of the singing pitch is completed after the voice is input, the singing pitch is eventually extended. It takes time to display.

  As a result, in the conventional display device, there is a difference between the currently singing section and the section in which the singing pitch is displayed. Due to such a shift, there is a problem that the user of the conventional display device feels uncomfortable.

  Therefore, an object of the present invention is to realize a display with less discomfort for the user.

One aspect of the present invention made to achieve the above object is a display control apparatus including an acquisition unit, a specification unit, a calculation unit, an estimation unit, and a display control unit.
The acquisition means acquires audio data that is audio input during the performance of the target music piece. The target song is a song in which lyrics are assigned to at least a part of a plurality of notes, and is a designated song.

  The specifying means specifies the singing pitch in the voice data for each unit singing section, which is a specified section, based on the voice data acquired by the acquiring means. Then, the calculation means calculates a singing pitch difference between the singing pitch specified by the specifying means and the pitch of the singing note corresponding to the unit singing section of the singing pitch based on the model data. The model data referred to here is data representing the pitch of each singing note, which is a note to which lyrics are assigned in the target music.

  Further, the estimation means estimates the estimated singing pitch representing the singing pitch for the subsequent unit section by adding the singing pitch difference calculated by the calculating means to the pitch of the singing note corresponding to the subsequent unit section. . The subsequent unit section referred to here is a unit singing section after the current unit section which is a unit singing section at the present time.

Then, the display control means displays the estimated singing pitch estimated by the estimation means in association with the subsequent unit section.
In the display control apparatus, the estimated singing pitch, which is the singing pitch of the subsequent unit section including the unit singing section to be sung next, is estimated based on the past singing pitch. And the estimated song estimation pitch is displayed in association with the song note corresponding to the subsequent unit section.

  Therefore, according to the display control apparatus, the estimated singing pitch sung in the subsequent unit section can be displayed before the subsequent unit section is actually sung. Therefore, according to the display control device, it is possible to reduce the deviation between the unit singing section currently being sung and the unit singing section in which the singing pitch is displayed.

  Furthermore, according to the display control apparatus, the time lag until the user's own singing pitch is adjusted can be suppressed. As a result, according to the display control device, it is possible to realize a display with less discomfort for the user.

The display control apparatus may further include a correction unit.
The correcting means corresponds to the estimated singing pitch estimated by the estimating means to the singing pitch in at least one previous unit section before the current unit section along the time axis, and to at least one previous unit section. Correction is made based on the pitch difference from the pitch of the singing note.

  In such a display control device, correction is performed based on the pitch difference between the singing pitch for the previous unit section and the pitch of the singing note corresponding to the previous unit section along the time axis from the current unit section. can do.

  If the pitch difference between the singing pitch in the previous unit section and the pitch of the singing note corresponding to the previous unit section is enlarged along the time axis, the correcting means is the current unit calculated by the calculating means. The estimated singing pitch may be corrected so that the pitch difference is larger than the pitch difference in the section.

  For example, in the target music, a case is assumed where, among a plurality of notes to which lyrics are assigned, a sequence of notes whose pitches are suddenly increased with specific notes is repeated. In such an assumption, a note whose pitch suddenly increases can be sung at the first stage along the time axis. However, it is assumed that the later the stage along the time axis, the more difficult it is for the user to utter a note whose pitch suddenly increases, and the note cannot be sung. In such a case, the difference between the pitch of the note and the singing pitch becomes larger as the note of the later stage in the repetition of the arrangement of the notes where the pitch suddenly increases.

  On the other hand, according to the display control device, if the pitch difference with the pitch of the singing note corresponding to the previous unit section is expanding along the time axis, the sound is higher than the pitch difference in the current unit section. Since the estimated song pitch is corrected so that the difference in height becomes larger, the estimated song pitch can be corrected according to the situation when the user actually sings. Thereby, according to the display control apparatus, a song estimation pitch can be made into the pitch close | similar to a user's song entity.

  Furthermore, the correction means is calculated by the calculation means if the pitch difference between the singing pitch in the previous unit section and the pitch of the singing note corresponding to the previous unit section is reduced along the time axis. The estimated singing pitch may be corrected so that the pitch difference is smaller than the pitch difference in the current unit section.

  Assuming the above-mentioned arrangement of notes in the target song, notes that suddenly increase in pitch cannot be sung at the first stage along the time axis, and later stages along the time axis. It is assumed that the user can respond to a note whose pitch increases suddenly and can sing the note. In such a case, the difference between the pitch of the note and the singing pitch becomes smaller as the note of the later stage in the repetition of the arrangement of the notes where the pitch suddenly increases.

  On the other hand, according to the display control device, if the pitch difference with the pitch of the singing note corresponding to the previous unit interval is reduced along the time axis, the sound is higher than the pitch difference in the current unit interval. Since the estimated song pitch is corrected so that the difference in height becomes smaller, the estimated song pitch can be corrected according to the situation when the user actually sings.

Thereby, according to the display control apparatus, a song estimation pitch can be made into the pitch close | similar to a user's song entity.
Another aspect of the present invention may be a program that causes a computer to execute an acquisition procedure, a specific procedure, a calculation procedure, an estimation procedure, and a display control procedure.

  In the acquisition procedure, audio data is acquired. In the specifying procedure, the singing pitch in the voice data is specified for each unit singing section based on the acquired voice data. In the calculation procedure, the singing pitch difference between the specified singing pitch and the pitch of the singing note corresponding to the unit singing section of the singing pitch is calculated based on the model data representing the pitch of each singing note. .

  In the estimation procedure, the estimated singing pitch is estimated by adding the singing pitch difference calculated in the calculation procedure to the pitch of the singing note corresponding to the subsequent unit section. Furthermore, in the display control procedure, the estimated singing estimated pitch is displayed in association with the subsequent unit section.

  As described above, if the present invention is implemented as a program, it is used by loading the computer from a recording medium as necessary and starting it, or by acquiring it and starting it through a communication line as necessary. be able to. And by making a computer perform each procedure, the computer can be functioned as a display control apparatus.

  The recording medium referred to here includes, for example, a computer-readable electronic medium such as a DVD-ROM, a CD-ROM, and a hard disk.

It is a block diagram which shows schematic structure of the karaoke apparatus to which this invention was applied. It is a flowchart which shows the process sequence of a display process. It is explanatory drawing which shows an example of the specific method of the song pitch in a display process. It is explanatory drawing which shows an example of the display mode in a display process. It is a flowchart which shows the process sequence of an estimation process. It is explanatory drawing which shows an example of the correction | amendment aspect of a song pitch. It is explanatory drawing which shows an example of the correction | amendment aspect of a song pitch.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
<Karaoke equipment>
The karaoke device 30 shown in FIG. 1 is a device that plays a song designated by a user (hereinafter referred to as a target song) and emits a singing voice together with the performance sound. Furthermore, the karaoke apparatus 30 displays a singing voice.

The karaoke apparatus 30 includes a communication unit 32, an input reception unit 34, a music playback unit 36, a storage unit 38, an audio control unit 40, a video control unit 46, and a control unit 50.
In the communication unit 32, the karaoke apparatus 30 communicates with the outside via a communication network. The input receiving unit 34 is an input device that receives input of information and commands in accordance with external operations. The input device referred to here is, for example, a key, a switch, a reception unit of a remote controller, or the like.

  The music playback unit 36 performs a music performance based on the MIDI music MD. The music reproducing unit 36 is, for example, a MIDI sound source. The voice control unit 40 is a device that controls voice input / output, and includes an output unit 42 and a microphone input unit 44.

  A microphone 62 is connected to the microphone input unit 44. As a result, the microphone input unit 44 acquires the sound input via the microphone 62. A speaker 60 is connected to the output unit 42. The output unit 42 outputs the sound source signal of the music reproduced by the music reproducing unit 36 and the sound source signal of the singing sound from the microphone input unit 44 to the speaker 60. The speaker 60 outputs the sound source signal input from the output unit 42 instead of sound.

  The video control unit 46 outputs a video or an image based on the video data sent from the control unit 50. The video control unit 46 is connected to a display unit 64 that displays video or images.

The storage unit 38 is a well-known storage device configured to be able to read and write stored contents. The storage unit 38 stores at least a MIDI music piece MD.
The control unit 50 is configured around a known computer having at least a ROM 52, a RAM 54, and a CPU 56. The ROM 52 stores processing programs and data that need to retain stored contents even when the power is turned off. The RAM 54 temporarily stores processing programs and data. The CPU 56 executes each process according to a processing program stored in the ROM 52 or the RAM 54.

In the ROM 52 of the present embodiment, the control unit 50 executes a reproduction process of playing the target music and emitting the performance sound from the speaker 60 and displaying the lyrics on the display unit 64 based on the MIDI music MD. Are stored. Furthermore, the ROM 52 of the present embodiment stores a processing program for the control unit 50 to execute display processing for displaying the user's singing voice together with the singing melody of the target music.
<MIDI music>
The MIDI music MD is prepared in advance for each music, and has music data, lyrics data, and music information.

  Among these, the music data is data representing the score of one music according to the well-known MIDI (Musical Instrument Digital Interface) standard. This music data has at least a musical score track representing a musical score for each musical instrument used in the music.

  The musical score track defines at least a pitch (so-called note number) and a period during which the MIDI sound source outputs the performance sound (hereinafter referred to as a note length) for each performance sound output from the MIDI sound source. Yes. The note length in the score track is defined by the note-on timing of the performance sound and the note-off timing of the performance sound.

  In this musical score track, sample data representing the musical score of the musical instrument in charge of the singing melody (ie, melody line) and the performance sounds (ie, notes) constituting the singing melody are arranged along the time axis. Is included. For example, a vibraphone is considered as an instrument in charge of singing melody.

  On the other hand, the lyric data is data relating to the lyrics of the music, and includes lyric text data and lyric output data. The lyric text data represents the lyrics of the music. The lyrics output data is data in which a timing correspondence relationship that associates the lyrics output timing, which is the output timing of characters constituting the lyrics (hereinafter referred to as “lyric constituent characters”), with the performance of the music data. In addition, the timing correspondence relationship stipulates that lyrics constituent characters are assigned to at least some of the performance sounds (that is, notes) constituting the singing melody in the music.

The music information is information about the music (for example, music name, artist name, etc.), and includes identification information (that is, music ID) for identifying the music.
<Display processing>
Next, display processing executed by the control unit 50 will be described.

This display process is repeatedly started at predetermined time intervals when the performance of the target music is started in the reproduction process.
Then, when the display process is activated, the control unit 50 acquires the voice (that is, the microphone input) input through the microphone 62 as voice data as shown in FIG. 2 (S110). Then, the control part 50 calculates the pitch showing the singing pitch (basic frequency) in the audio | voice data based on the audio | voice data acquired by S110 (S120).

  In S120 in the present embodiment, as shown in FIG. 3, the control unit 50 sets the analysis windows representing the predetermined unit times in the audio data so as to be adjacent to each other. The analysis window here is a time length shorter than the note value of a note, and is an example of a singing unit section described in the claims. Note that (1) to (9) shown in FIG. 3 mean each analysis window.

  In S120, the control unit 50 performs frequency analysis (for example, DFT) on the audio data of each set analysis window. Further, in S120, the control unit 50 calculates one pitch for one analysis window by setting the strongest frequency component as a pitch as a result of autocorrelation. Note that the pitch calculation method is not limited to this, and various known methods can be considered.

  Further, in the display process, the control unit 50 stores the pitch calculated in S120 along the time axis (S130). The storage location of the pitch in S130 may be the RAM 54 or the storage unit 38.

  Subsequently, in the display process, the control unit 50 determines whether or not the pitch in the comparison target section is stored (S140). The comparison target section referred to here is an analysis window corresponding to at least a part of a note constituting a singing melody and assigned lyrics. The number of analysis windows included in the comparison target section may be “single” or “plural”.

  If the pitch of the comparison target section is not stored as a result of the determination in S140 (S140: NO), the control unit 50 shifts the display process to S170 described later in detail. On the other hand, as a result of the determination in S140, if the pitch of the comparison target section is stored (S140: YES), the control unit 50 shifts the display process to S150.

  In S150, the control unit 50 calculates the singing pitch difference based on the model data. The singing pitch difference mentioned here is the pitch of the current analysis window (hereinafter referred to as “current unit section”) and the sound in the note corresponding to the current unit section (hereinafter referred to as “singing note”). It is the difference from high. In S150, the control unit 50 calculates the singing pitch difference by subtracting the pitch of the current unit section from the pitch center of the singing note represented by the model data.

  Subsequently, the control unit 50 stores the singing pitch difference calculated in S150 in association with the pitch of the singing note (S160). In S160, the control unit 50 stores the singing pitch difference along the time axis. Note that the storage destination of the singing pitch difference may be the RAM 54 or the storage unit 38.

Thereafter, the control unit 50 shifts the display process to S170.
In S170, the control unit 50 determines whether or not the pitch of the estimation source section is stored. The "estimation source section" here refers to the setting of the past along the time axis in the analysis window corresponding to at least a part of the notes to which the melody is assigned and the lyrics are assigned. It is a plurality of analysis windows up to several minutes analysis window. The “set number” referred to here may be “single” or “plural”. As a specific example of the estimation source section, one phrase such as “A melody” and “B melody” is conceivable.

  In the present embodiment, the singing pitch in the subsequent unit section is estimated based on the pitch of the estimation source section and the singing pitch difference in the estimation process described in detail later. The “subsequent unit section” referred to here is at least one analysis window that constitutes a singing melody and that corresponds to at least a part of a note to which lyrics are assigned, and that is after the current unit section. . As an example of the “subsequent unit section”, one phrase such as “A melody” or “B melody” is conceivable.

  As a result of the determination in S170, if the pitch of the estimation source section is not stored (S170: NO), that is, if the pitch of the voice data used for estimating the singing pitch in the subsequent unit section is not stored, The control unit 50 ends this display process.

  On the other hand, if the pitch of the estimation source section is stored as a result of the determination in S170 (S170: YES), that is, the pitch for the section of the voice data used for estimating the singing pitch in the subsequent unit section is stored. If so, the control unit 50 shifts the display process to S180.

  In S180, the control unit 50 executes an estimation process for estimating the singing pitch in the subsequent unit section. Hereinafter, the singing pitch in the subsequent unit section estimated in S180 is referred to as a singing estimated pitch.

  Subsequently, the control unit 50 displays the pitch calculated in S120 in association with the pitch of the singing note corresponding to the previous unit interval or the pitch of the singing note corresponding to the current unit interval (S190). Further, in S190, the control unit 50 displays the estimated singing pitch estimated in S180 in association with the pitch of the singing note corresponding to the subsequent unit section (S190).

  Specifically, in S <b> 190, the control unit 50 outputs the estimated singing pitch to the video control unit 46. As shown in FIG. 4, the video control unit 46 that has acquired the estimated singing pitch displays the pitch sung so far (that is, the pitch calculated in S120) and the estimated singing pitch in association with the singing note. Displayed on the unit 64. The singing notes mentioned here include the singing notes corresponding to the current unit interval, the singing notes corresponding to the previous unit interval that is at least one analysis window before the current unit interval along the time axis, and the subsequent unit intervals. Includes corresponding singing notes. Further, in S190, the video control unit 46 may display the lyrics assigned to each singing note on the display unit 64 as shown in FIG. In FIG. 4, the pitch calculated in S120 is represented by a solid line, and the estimated singing pitch is represented by a broken line.

Thereafter, the control unit 50 ends the display process.
<Estimation process>
Next, the estimation process started in S180 of the display process will be described.

  When the estimation process shown in FIG. 5 is started, the control unit 50 acquires the singing pitch difference in the estimation source section (S310). Subsequently, the control unit 50 acquires the pitch of the singing note corresponding to the subsequent unit section (S320).

  And in an estimation process, the control part 50 estimates the song estimation pitch in a subsequent unit area based on the pitch of the song note corresponding to the acquired subsequent unit area, and the song pitch difference acquired by S310. (S330).

  Specifically, in S330, the control unit 50 adds the singing pitch difference in the current unit section to the pitch center of the singing note corresponding to the subsequent unit section, thereby obtaining the estimated singing pitch corresponding to the subsequent unit section. presume. Note that the singing pitch difference added in S330 may be a singing pitch difference associated with the pitch of the singing note corresponding to the subsequent unit interval, or the singing pitch in the previous unit interval and the current unit interval. It may be a representative value of the height difference. The representative value referred to here may be an arithmetic mean result, a center value, or a mode value.

  Further, in the estimation process, the control unit 50 corrects the estimated singing pitch estimated in S330 (S340). In this S340, the control part 50 correct | amends the song estimation pitch estimated by S330 based on the song pitch difference in an estimation origin area.

  Specifically, in S340, as shown in FIG. 6, the control unit 50 determines that the pitch difference between the singing pitch in the estimation source section and the pitch of the singing note corresponding to the estimation source section is along the time axis. The estimated singing pitch is corrected so that the pitch difference is larger than the pitch difference in the current unit interval.

  Further, in S340, as shown in FIG. 7, the control unit 50 determines that the pitch difference between the singing pitch in the estimation source section and the pitch of the singing note corresponding to the estimation source section is along the time axis. If it is reduced, the estimated singing pitch is corrected so that the pitch difference is smaller than the pitch difference in the current unit section.

  Further, in the estimation process, the control unit 50 connects the estimated song pitch estimated in S330 and the estimated song pitch corrected in S340 (S350). That is, since one value is calculated | required with respect to one analysis window in the song estimation pitch in this embodiment, the process which connects these values smoothly is performed in S350. As a process to be executed in S350, a least square method or another approximation method can be considered.

Thereafter, the control unit 50 ends the estimation process and shifts the process to S190 of the display process.
[Effect of the embodiment]
As described above, in the display process, the estimated singing pitch of the analysis window (that is, the subsequent unit section) to be sung next is estimated based on the past singing pitch. And the estimated song estimation pitch is displayed in association with the song note corresponding to the subsequent unit section.

  Therefore, according to the display process, the estimated singing pitch to be sung in the subsequent unit section can be displayed before the subsequent unit section is actually sung. Therefore, according to the karaoke apparatus 30, the shift | offset | difference with the unit singing area where the singing pitch is displayed and the unit singing area currently singing can be reduced.

  Furthermore, according to the karaoke apparatus 30, the time lag until the user's own singing pitch is adjusted can be suppressed. As a result, according to the karaoke apparatus 30, it is possible to realize a display with less discomfort for the user.

  In such a karaoke apparatus 30, it correct | amends based on the pitch difference of the singing pitch with respect to the front unit area before the current unit area along the time axis, and the pitch of the singing note corresponding to the front unit area. can do.

  By the way, the object music which has the song melody in which the arrangement | sequence of the note from which the pitch becomes high suddenly with a specific note among the several notes to which the lyrics are allocated is assumed as object music. For such a target song, the user can sing a note whose pitch suddenly increases at the first stage along the time axis, but at the later stage along the time axis, the pitch is There is a possibility that it becomes difficult to utter a note that suddenly increases, and it becomes impossible to sing the note. In such a case, the singing pitch difference becomes larger as the notes in the later stage in the repetition of the arrangement of notes whose pitches suddenly increase.

  On the other hand, in the estimation process, if the singing pitch difference in the estimation source section expands along the time axis, the difference in pitch in the subsequent unit section becomes larger than the singing pitch difference in the current unit section. Thus, the estimated singing pitch is corrected. For this reason, according to the estimation process, the estimated singing pitch in the subsequent unit section can be corrected according to the situation when the user actually sings.

  In addition, when assuming the music as described above as the target music, the user cannot sing a note whose pitch suddenly increases at the first stage along the time axis, but at a later stage along the time axis. For, there is a possibility that it can respond to the pitch and sing the pitch. In such a case, the difference between the pitch of the note and the singing pitch becomes smaller as the note of the later stage in the repetition of the arrangement of the notes where the pitch suddenly increases.

  On the other hand, according to the estimation process, if the singing pitch difference in the estimation source section is reduced along the time axis, the pitch difference in the subsequent unit section is smaller than the pitch difference in the current unit section. The estimated singing pitch is corrected as follows. For this reason, according to the estimation process, the estimated singing pitch in the subsequent unit section can be corrected according to the situation when the user actually sings.

As a result, according to the estimation process, the estimated singing estimated pitch can be set to a pitch close to the singing entity of the user.
[Other Embodiments]
As mentioned above, although embodiment of this invention was described, this invention is not limited to the said embodiment, In the range which does not deviate from the summary of this invention, it is possible to implement in various aspects.

  That is, the aspect which abbreviate | omitted a part of structure of the said embodiment is also embodiment of this invention. Further, an aspect configured by appropriately combining the above embodiment and the modification is also an embodiment of the present invention. Moreover, all the aspects which can be considered in the limit which does not deviate from the essence of the invention specified by the wording described in the claims are the embodiments of the present invention.

In addition to the above-described display control device, the present invention can be realized in various forms such as a program executed by a computer to control display and a display method.
[Correspondence between Embodiment and Claims]
Finally, the relationship between the description of the above embodiment and the description of the scope of claims will be described.

  The function obtained by executing S110 in the display processing of the above embodiment is an example of the obtaining unit described in the claims, and the function obtained by executing S120 is described in the claims. This is an example of the specified means. Further, the function obtained by executing S150 in the display process is an example of the calculation means described in the claims, and the function obtained by executing S180 of the display means, that is, S330 of the estimation process. Is an example of the estimation means described in the claims.

  Furthermore, the function obtained by executing S190 of the display means is an example of the display control means described in the claims, and the function obtained by executing S340 of the estimation process is described in the claims. It is an example of the correction | amendment means described in (1).

  DESCRIPTION OF SYMBOLS 30 ... Karaoke apparatus 32 ... Communication part 34 ... Input reception part 36 ... Music reproduction part 38 ... Memory | storage part 40 ... Audio | voice control part 42 ... Output part 44 ... Microphone input part 46 ... Video | video control part 50 ... Control part 52 ... ROM 54 ... RAM 56 ... CPU 60 ... Speaker 62 ... Microphone 64 ... Display unit

Claims (5)

An acquisition means for acquiring audio data that is a music that is a song in which lyrics are assigned to at least some of the plurality of notes and that is input during the performance of the target song that is the designated song;
Based on the voice data acquired by the acquisition means, the specifying means for specifying the singing pitch in the voice data for each unit singing section that is a specified section;
The singing corresponding to the singing pitch specified by the specifying means and the unit singing section of the singing pitch based on the model data representing the pitch of each singing note that is a note to which lyrics are assigned in the target music A calculating means for calculating a difference in singing pitch from the pitch of a note;
By adding the singing pitch difference calculated by the calculating means to the pitch of the singing note corresponding to the subsequent unit section that is a unit singing section after the current unit section that is the unit singing section at the present time Estimating means for estimating a singing pitch representing a singing pitch for the subsequent unit section;
A display control device comprising: display control means for displaying the estimated singing pitch estimated by the estimation means in association with the subsequent unit section. The estimated singing pitch estimated by the estimating means includes a singing pitch in at least one previous unit section before the current unit section along a time axis, and a singing note corresponding to the at least one previous unit section. The display control apparatus according to claim 1, further comprising: a correcting unit that corrects the pitch based on a pitch difference from the pitch. The correction means includes
If the pitch difference between the singing pitch in the previous unit interval and the pitch of the singing note corresponding to the previous unit interval is expanding along the time axis, the current unit interval calculated by the calculating means as the difference in pitch than the pitch difference increases, the display control device according to 請 Motomeko 2 you and corrects the singing estimated pitch. The correction means includes
If the pitch difference between the singing pitch in the previous unit interval and the pitch of the singing note corresponding to the previous unit interval is reduced along the time axis, in the current unit interval calculated by the calculating means The display control device according to claim 2 , wherein the estimated singing pitch is corrected so that a pitch difference is smaller than a pitch difference. An acquisition procedure for acquiring audio data that is audio that is input during performance of the target music that is a song that has lyrics assigned to at least some of the plurality of notes, and
Based on the audio data acquired in the acquisition procedure, a specific procedure for specifying the singing pitch in the audio data for each unit singing section that is a specified section;
The singing pitch corresponding to the unit singing interval of the singing pitch specified in the specific procedure and the singing pitch based on the model data representing the pitch of each singing note that is a note to which lyrics are assigned in the target music A calculation procedure for calculating the difference in singing pitch from the pitch of the note;
By adding the singing pitch difference calculated in the calculation procedure to the pitch of the singing note corresponding to the subsequent unit section that is a unit singing section after the current unit section that is the unit singing section at the present time , An estimation procedure for estimating a singing estimated pitch representing a singing pitch for the subsequent unit section;
A program for causing a computer to execute a display control procedure for displaying the estimated singing pitch estimated in the estimation procedure in association with the subsequent unit section.