JP4182750B2 - Karaoke equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a melody that a singer sings in an easy-to-see state even if the singer can not read a musical score. <P>SOLUTION: Data of a guide melody track in music data for reproducing Karaoke music are used and a piano roll is displayed on a monitor along with the playing of the Karaoke music by expanding pitches of a sound of a singing melody along a longitudinal axis and the sound along a lateral axis. In synchronism with the progress of the music, a cursor is moved on the piano roll, which is scrolled to display a current playing position in an easy-to-see state. <P>COPYRIGHT: (C)2004,JPO&amp;NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a karaoke apparatus that can easily display a melody to be sung by a singer on a monitor.
[0002]
[Prior art]
Karaoke devices that guide singing have been put into practical use. For example, a karaoke device equipped with a guide melody function that generates a singing melody as a musical sound (guide melody) together with an accompaniment sound of a karaoke song has been put to practical use, and a karaoke device that visually displays and guides a singing melody as a score Has also been proposed (for example, Patent Document 1).
[0003]
[Patent Document 1]
Japanese Patent Laid-Open No. 56-85773 [0004]
[Problems to be solved by the invention]
However, it is difficult to intuitively understand the pitch and length of the musical score displayed on the staff. Therefore, it is difficult to read it unless you have some knowledge of music. For beginner singers who want to ask, there was a problem that it was not very effective.
[0005]
An object of this invention is to provide the karaoke apparatus which can display the melody which a singer should sing on a monitor in an easy-to-understand manner.
[0006]
[Means for Solving the Problems]
The invention of claim 1 is a storage means for storing song data for playing a karaoke song and guide melody data for guiding a singing melody to a singer, and a karaoke song based on the song data. In parallel with the performance of the performance means for performing , the singing voice of the singer, the scoring means for scoring the singing voice, and the performance of the karaoke song, the guide melody data is read, and the melody is pitched on the vertical axis. And a piano roll display means for drawing the piano roll with the horizontal axis expanded in time and displaying it on the monitor, and coloring the piano roll according to the scoring result of the scoring means ,
The scoring means performs scoring at intervals of a predetermined scoring time, and the piano roll display means colors the piano roll by a color corresponding to the scoring result for each colored section corresponding to the scoring time. It is characterized by doing.
According to a second aspect of the present invention, in the first aspect of the invention, the piano roll display means has a length corresponding to the scoring time from a position retroactive to the coloring section by a time required for the scoring means to process scoring. It is characterized by only going back to a further position.
The invention of claim 3 is the invention of claims 1 and 2, wherein the scoring means is means for outputting a score between a full score and 0 as a scoring result, and the piano roll display means A first specific color is assigned, a second specific color is assigned to 0 point, an intermediate color of the first and second specific colors is created according to the score of the scoring result, and the coloring section is colored with this intermediate color It is a means to do.
[0007]
According to a fourth aspect of the present invention, in the above invention, the piano roll display means includes means for indicating a current performance position of the performance means on the piano roll to be displayed.
[0008]
The invention of claim 5 is characterized in that, in the above invention, the guide melody data is a part of the song data, and the playing means generates a guide melody sound based on the guide melody data.
[0009]
In this invention, the singing melody of a karaoke song is displayed on a monitor as a piano roll. The piano roll is displayed as a horizontal band corresponding to each note, with the vertical axis representing the pitch and the horizontal axis representing the time, so the pitch can be known in semitone units based on the height of the band. At the same time, it is possible to intuitively know the length of the sound based on the length of the band.
[0010]
In the present invention, the current performance position is displayed on the piano roll. The performance position may be indicated by displaying an object such as a cursor on the displayed piano roll, or may be indicated by sequentially displaying the piano roll in accordance with the performance position. Thereby, the progress of the singing becomes easy to understand, and the singing can be further supported.
[0011]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a block diagram of a karaoke apparatus according to an embodiment of the present invention. This karaoke device performs the performance of the karaoke song based on the song data, and in parallel with this performance, the melody that the singer should sing is developed in a piano roll shape and displayed on the monitor, and the singer's singing is performed. Support. In the piano roll, the pitch is developed on the vertical axis and the time is plotted on the horizontal axis, and as shown in FIG. 3, for example, the band indicating the length of the sound is arranged in time series at the height corresponding to the pitch. The Because it is not symbolized like a score, even a singer who cannot read a score can visually and intuitively grasp the pitch and length, so this can be used as a reference for singing. be able to.
[0012]
In FIG. 1, a hard disk 11, a sound source 13, a mixer (including an effector) 14, a scoring unit 19, an MPEG decoder 20, a synthesis circuit 21, etc. are connected to a CPU (including RAM) 10 that controls the overall operation. Yes. The hard disk 11 stores music data for playing karaoke music, video data for displaying a background video on a monitor, and the like. When executing the performance of the karaoke song, the CPU 10 reads the song data and video data into the RAM.
[0013]
The sound source 13 forms a musical sound signal according to music data (note event data or the like) supplied by the processing of the sequencer 30 executed by the CPU 10. The formed tone signal is input to the mixer 14. The mixer 14 gives an effect such as echo to the plurality of musical sound signals generated by the sound source 13 and the singing voice signal of the singer input via the microphone 17 -A / D converter 18. Mix the signal with an appropriate balance. The mixed digital musical tone signal is input to the sound system 15. The sound system 15 includes a D / A converter and a power amplifier. The input digital signal is converted into an analog signal, amplified, and emitted from the speaker 16. The effect that the mixer 14 gives to each audio signal and the balance of mixing are controlled by the CPU 10.
[0014]
The piano roll display program 34 is a program for creating a piano roll screen based on the guide melody track in the song data of the karaoke song played by the sequencer 30. An example of a piano roll and a creation procedure will be described later.
[0015]
The singing voice signal converted into a digital signal by the A / D converter 18 is also input to the scoring unit 19. The scoring unit 19 compares the frequency of the input singing voice signal with reference data to determine the amount of deviation, and inputs this to the CPU 10 as difference data. The scoring program 35 executed by the CPU 10 scores the song of the singer based on the difference data. The scoring results are reflected in the display color of the piano roll band. As the reference data, guide melody data included in the song data is used, but the guide melody data may be supplied separately from the song data.
[0016]
The video data 41 stored in the hard disk 11 is encoded in the MPEG2 format, and the background video reproduction program 33 executed by the CPU 10 reads it and inputs it to the MPEG decoder 20. The MPEG decoder 20 decodes the input MPEG2 data into an NTSC video signal and inputs it to the synthesis circuit 21. The synthesizing circuit 21 is a circuit that synthesizes an OSD such as a piano roll created by the piano roll display program 34 on the video signal of the background video. A video signal obtained by synthesizing the background video and the OSD is input to the monitor 22 and displayed on the screen of the monitor 22.
[0017]
FIG. 2 is a diagram showing the composition of song data stored in the hard disk 11. As shown in FIG. 1A, the song data is composed of a musical sound track for playing a karaoke song, a guide melody track for generating a guide melody, and other tracks such as a lyrics track and an effect control track. Yes. Each track is described according to the MIDI format, and includes event data and timing data indicating the read timing of each event data. The timing data may be constituted by duration data indicating the interval between the read timings of the preceding and following event data, or may be constituted by absolute time data representing the read timing as an elapsed time from the start of the music.
[0018]
Note that the guide melody track is a track for generating a melody (melody) to be sung as a musical tone, as shown in FIG. 5B, and is therefore a single-sequence sequence track. I have never done it. That is, the event data that appears after the note-on event data is always the note-off event data.
[0019]
FIGS. 3A, 3B, and 3C are diagrams illustrating examples of piano rolls displayed on the monitor 22 during the performance of a karaoke song. FIGS. 5A to 5C illustrate two upper and lower screens, but the screen when the performance has advanced slightly from the upper screen is the lower screen.
[0020]
In the description of FIGS. 3 to 6, the scoring results performed by the scoring processing program 35 are not reflected on the display in order to simplify the description. An embodiment in which the display color of the piano roll is changed according to the scoring result will be described with reference to FIGS.
[0021]
FIG. 6A is a diagram showing an example in which a piano roll is displayed so that a band indicating a melody extends in synchronization with the progress of the song. The piano roll is not displayed on the first screen at all, but as the song progresses, the piano roll (band) is moved to the right so that the playing position at that time is displayed from the left end of the screen (X = 0). It will grow. That is, the current performance position moves from the left end to the right end of the screen. When the performance position reaches the right end (X = Xmax), the page is changed, the displayed piano roll is deleted, and the next page of the piano roll is newly displayed from the left end.
[0022]
FIG. 5B is a display example in which the piano roll is scrolled in synchronization with the progress of the song. In this display example, the display of the piano roll expands as the song progresses, but the speed at which the piano roll extends and the speed at which the entire piano roll moves to the left are the same. The current performance position is always on the monitor screen. It is a predetermined position (approximately the center). In this display method, the display range of the piano roll is moved in parallel with the progress of the music, so that the page change is unnecessary.
[0023]
(C) is a method of changing pages in the same manner as (A). First, the piano roll of the entire page is displayed, and then the cursor is moved to the current performance position. This is an example of going. Every time a song advances for a certain period of time, the entire range of piano rolls on that page is displayed, and the cursor moves from the left end to the right end. When the cursor moves to the right end, the page is deleted and the next page is displayed.
[0024]
4-6 is a flowchart which shows the process of the piano roll display program for displaying the piano roll shown to FIG. 3 (A)-(C).
[0025]
FIG. 4 is a flowchart showing a procedure for displaying the piano roll shown in FIG.
[0026]
At the start of the song, the X coordinate of the display position is set to 0 in order to display the piano roll from the left end of the screen (s1). Then, the data of the guide melody track synchronized with the progress of the karaoke song is read (s2). Reading of the data of the guide melody track is performed by the sequencer 30 that is playing a karaoke song. When the duration data is read, the time d indicated by the duration data is counted down according to a predetermined clock Δd (s11), and when it becomes 0 (s12), the next data is read (s2). During the countdown, the music is progressing, and accordingly, the display position of the piano roll is moved to the right (s6). That is, the X coordinate value is added by Δx. At this time, if the note is on, a band of piano roll is drawn on the Y coordinate determined according to the pitch by the width of Δx (s7, s8).
[0027]
As a result of moving the display position to the right, when the display position reaches the right end, that is, when the X coordinate value becomes Xmax (s9), the page displayed is changed to change the page. All the rolls are erased and the X coordinate to be displayed is reset to 0 (s10). As a result, the piano roll of a new page is displayed again from the left end of the screen. Note that when the note is not on, the band display operation of s8 is skipped in the determination of s7, and therefore, only the display position advances without displaying the band in the section without the guide melody.
[0028]
On the other hand, when the note-on event data is read out in s2, the process proceeds to s13 with the determination in s4, and the height of the band (Y coordinate) to be displayed of the band corresponding to the pitch indicated by the note-on event data. Is determined (s13). That is, the higher the pitch, the higher the band is displayed, and the lower the pitch, the lower the band is displayed. The height of the belt is determined for each semitone. Then, a note-on flag for drawing a band in the operations of s7 and s8 is set (s14). If the note-off event data is read in s2, the process proceeds to s15 with the determination of s5, and the note-on flag is reset (s15). Thereby, the operation of s8 is skipped. If the data read in s2 is data indicating the end of the song, the operation is terminated. With the above operation, it is possible to display a piano roll that extends in the right direction of the screen as the music progresses as shown in FIG.
Since the guide melody track is a track for playing a single singing melody, the event data following the note-on event data is always the note-off event data, and multiple bands are displayed in parallel by the above operation. Will never be done.
[0029]
FIG. 5 is a flowchart for displaying a scrolling piano roll as shown in FIG. The X coordinate of the display position is set to 0 so that the top of the piano roll is always at the center of the monitor screen (s21). Then, the data of the guide melody track synchronized with the progress of the karaoke song is read (s22). Reading of the data of the guide melody track is performed by the sequencer 30 that is playing a karaoke song. When the duration data is read (s23), the time d indicated by the duration data is counted down according to a predetermined clock Δd (s29), and when it becomes 0 (s30), the next data is read (s22). ). While this countdown is in progress, the music is progressing, and accordingly, the display of the entire piano roll is scrolled to the left (s26). That is, the display coordinates of all piano rolls are subtracted by Δx. Of the displayed piano roll, the portion where the X coordinate is 0 or less is not displayed. At this time, if the note is on, a band of the piano roll is newly drawn on the Y coordinate determined according to the pitch by the width of Δx (between Xmid and Xmid−Δx) (s27, s28). Note that when the note is not on, the band display operation of s28 is skipped in the determination of s27, so that the section without the guide melody is only scrolled without displaying the band.
[0030]
On the other hand, when the note-on event data is read in s22, the process proceeds to s33 with the determination of s24, and the height (Y coordinate) of the band to be displayed corresponding to the pitch indicated by the note-on event data. Is determined (s33). That is, the higher the pitch, the higher the band is displayed, and the lower the pitch, the lower the band is displayed. The height of the belt is determined for each semitone. Then, a note-on flag for drawing a band by the operations of s27 and s28 is set (s34). If the note-off event data is read in s22, the process proceeds to s35 with the determination in s25, and the note-on flag is reset (s35). Thereby, the operation of s28 is skipped. If the data read in s22 is data indicating the end of the song, the operation is terminated. With the above operation, a piano roll that scrolls to the left as the music progresses as shown in FIG. 3B can be displayed.
FIG. 6 is a flowchart for displaying the piano roll shown in FIG. When the performance is started (s40), data for one page of the guide melody track is prefetched separately from the automatic performance being executed by the sequencer 30 (s41). The reading of data for one page is all event data and duration data until the total value of duration data matches the horizontal width of the monitor (X = 0 to Xmax) after the data is read from the top.
[0031]
One page of the piano roll is displayed based on the guide melody data for one page (s42). This display is the same as when the display processes of FIGS. 3A and 4 are performed at once. Then, a cursor indicating the current performance position on the displayed piano roll is displayed at the left end (X = 0) (s43).
[0032]
Next, the displayed cursor is gradually moved to the right by Δx as the performance time elapses (corresponding to the progress of the music). When the cursor moves to the right end (X = Xmax) (s45), the currently displayed piano roll is deleted (s46), and the process returns to s41. Then, the operation is finished when the music is finished.
With the above operation, a piano roll as shown in FIG. 3C in which one page is displayed at a time and the cursor is moved thereon can be displayed on the monitor. In the piano roll described in FIGS. 3C and 6, the cursor is displayed to indicate the current performance position, but other objects may be displayed to display the current performance position. Good. Further, instead of displaying the object, the color of the band of the piano roll may be changed to indicate the current performance position.
[0033]
Here, the embodiment which colors the display of the above-mentioned piano roll based on the scoring result of the song will be described.
[0034]
In the block diagram of FIG. 1, the sequencer 30 reads out the event data of the performance track and inputs it to the sound source 13 to cause the sound source 13 to generate a musical sound of karaoke music, and also reads out the event data of the guide melody track to the sound source 13. By inputting, a guide melody is generated in the sound source 13. At the same time, the sequencer 30 inputs the event data of the guide melody track to the scoring unit 19 as reference data. The singing voice signal of the singer converted into digital data by the A / D converter 18 is input to the scoring unit 19.
[0035]
The scoring unit 19 compares the frequency detected from the singing voice signal with the pitch frequency indicated by the reference data, and outputs the difference data as the comparison result (the cent value of the deviation amount) every 50 ms. This difference data is input to the CPU 10 and processed by the scoring program 35. The scoring processing program 35 totals three consecutive difference data, scores the songs in the 150 ms (50 ms × 3) section, and determines the color corresponding to the scoring result. Then, the piano roll display program 34 is notified of the color.
[0036]
The piano roll display program 34 colors the band in the section of -50 ms to 200 ms from the head (current performance position) of the displayed piano roll with that color.
[0037]
FIG. 7 is a flowchart showing the procedure of the coloring process by the above-described scoring of the CPU 10. FIG. 8 is a diagram showing an example of a piano roll that has been colored by scoring. Difference data is input every 50 ms from the scoring unit 19 according to the performance of the karaoke song and the song of the singer (s51). Since scoring is performed based on the difference data for three times (150 ms), the input of s51 is repeated until the difference data for three times is accumulated (s52). When the difference data for three times is accumulated, scoring is performed based on the difference data (s53). This scoring is performed by processing such as converting the total value or average value of the difference data into a score based on a certain scale. Based on the scoring result (score) thus calculated, a color for coloring the band of the piano roll is determined (s54). This color may be determined by dividing the score into a plurality of areas, assigning a specific color to each area, and determining the color of the area to which the score obtained in s53 belongs. A specific color (for example, green and red) may be assigned to each of (100 points) and 0 points, and an intermediate color corresponding to the number obtained in s53 may be obtained and determined as this color.
[0038]
Then, as shown in FIG. 8, the section from the position back from the head position of the piano roll displayed at that time to the position back from 200 ms to the position back from 50 ms is colored with this determined color (s55). The reason why the section to be colored is a 150 ms section is that the scoring section is 150 ms (50 ms × 3). The reason why the painting position is 50 ms from the current performance position is that the scoring process takes about 50 ms, and the scoring result is output with a delay of about 50 ms.
The above processing is repeated until the music ends (s56), and the operation ends when the music ends.
[0039]
Note that the scale of the horizontal axis of the piano roll, that is, the length of the unit time (for example, 1 second) or the unit time displayed on one page is variable even if it is fixed. Also good. When making it variable, the singer may be able to set the length of the song that enters one page by operating the remote control, etc., and the scale information is written in the song data and the scale is determined according to this song information You may make it do. Further, even if there is no scale information in the song data, the scale may be automatically determined based on the tempo information of the song. In the flowcharts of FIGS. 4 to 6, the scale is set by the size of Δx.
[0040]
Further, in the above embodiment, scoring and coloring of the piano roll are performed every 150 ms, but the scoring and coloring intervals may be variable. The variable method is the same as the scale on the horizontal axis.
[0041]
【The invention's effect】
As described above, according to the present invention, the song melody can be displayed on the monitor in parallel with the performance of the karaoke song, so even a singer who cannot read the score is visually intuitive. Can know the pitch to sing.
[0042]
Moreover, according to this invention, since the result of the singing is displayed on the piano roll, it is possible to visually know which part of the singing has been sung or not.
[Brief description of the drawings]
FIG. 1 is a block diagram of a karaoke device according to an embodiment of the present invention. FIG. 2 is a diagram showing a composition of song data of the karaoke device. FIG. 3 is a diagram showing an example of a piano roll displayed on the karaoke device. 4 is a flowchart showing a piano roll display operation of the karaoke apparatus. FIG. 5 is a flowchart showing a piano roll display operation of the karaoke apparatus. FIG. 6 is a flowchart showing a piano roll display operation of the karaoke apparatus. Flow chart showing scoring operation of the device [Figure 8] Figure showing an example of a piano roll with scoring display [Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... CPU, 11 ... Hard disk, 13 ... Sound source, 14 ... Mixer, 15 ... Sound system, 16 ... Speaker, 17 ... Microphone, 18 ... A / D converter, 19 ... Scoring unit, 20 ... MPEG decoder, 21 ... Synthesis circuit , 22 ... monitor, 30 ... sequencer, 33 ... video playback program, 34 ... piano roll display program, 35 ... scoring program

Claims (5)

Storage means for storing song data for playing a karaoke song and guide melody data for guiding a singing melody to a singer;
Performance means for playing a karaoke song based on the song data;
A singer's singing voice is input, and a scoring means for scoring the singing voice,
In parallel with the performance of the karaoke song, the guide melody data is read, the melody is displayed on the monitor by drawing a piano roll with the vertical axis representing the pitch and the horizontal axis representing the time, and the scoring means Piano roll display means for coloring the piano roll according to the result ;
Equipped with a,
The scoring means performs scoring at predetermined scoring time intervals,
The said piano roll display means is a karaoke apparatus which colors the said piano roll by the color according to the scoring result for every colored section of the length corresponding to the said scoring time . 2. The piano roll display unit according to claim 1, wherein the piano roll display unit sets the coloring section from a position backed by a time required for the scoring process by the scoring unit to a position further back by a length corresponding to the scoring time. Karaoke equipment. The scoring means is means for outputting a score between a full score and 0 points as a scoring result,
The piano roll display means assigns the first specific color to the full score and assigns the second specific color to 0 point, and creates an intermediate color between the first and second specific colors according to the score of the scoring result The karaoke apparatus according to claim 1, wherein the karaoke device is means for coloring the colored section with the intermediate color. The piano roll display means, karaoke apparatus according to any one of claims 1 to 3 including means for indicating the current playback position of the playback section on a piano roll display. The guide melody data is part of the music data, the playing means, karaoke apparatus according to any one of claims 1 to 4 for generating a guide melody sound based on the guide melody data.

Images