JP7169243B2 - karaoke device - Google Patents

Description

The present invention relates to a karaoke machine.

A karaoke device is equipped with a scoring function that scores karaoke singing skill by comparing singing voice data extracted from singing voice input by a microphone with reference data indicating the main melody of a song played karaoke. there is

For example, in Patent Document 1, pitch data and tone length data are extracted from a singing voice signal input from a microphone in accordance with a karaoke performance, and are compared with a guide melody read out in parallel with the karaoke performance. Techniques for scoring and evaluating skill have been disclosed.

In addition, some singers imitate the singing of professional singers and sing using special singing techniques such as hiccups, falls, fists, and shouts. Patent Documents 2 to 5 disclose techniques for detecting such special singing techniques and evaluating singing.

JP-A-10-69216 JP 2005-107336 A JP 2008-225115 A JP 2008-268370 A Japanese Unexamined Patent Application Publication No. 2012-078701

By the way, as a technique used to enhance the expressive power of karaoke singing, there are techniques that are similar to conventionally known techniques in terms of auditory perception, but that sound more characteristic. If a singer uses such techniques, conventional karaoke machines cannot identify such techniques. Moreover, even though the singing technique gives the audience the impression that it is good, it was sometimes deducted by the conventional evaluation technique.

SUMMARY OF THE INVENTION An object of the present invention is to provide a karaoke apparatus capable of specifying whether or not karaoke singing includes slow-down singing (described later).

The present inventor analyzed the singing pitch contained in the singing voice signal that is judged to be karaoke singing that gives a stronger impression, although it is similar to fall singing in terms of hearing, and found that singing near the pronunciation start timing of a note It was found that the singing pitch showed a change in which the singing pitch continuously and gradually fell until the singing pitch was no longer detectable. The present invention was completed based on this discovery, and is a technique that can identify this singing by detecting the pitch change unique to this singing.

It should be noted that the transition of the singing pitch by such karaoke singing is not constant like fall singing, but a singing pitch that slowly descends to the right like a curve drawn when throwing an object. become. Therefore, karaoke singing showing such pitch changes is hereinafter referred to as "slow-down singing".

Specifically, the invention for achieving the above object is a singing pitch detection unit that detects a singing pitch in units of frames of a predetermined length of time from a singing voice signal obtained by singing karaoke music, and a main melody of karaoke music. Among the notes included in the reference data shown, the singing pitch is adjusted so as to satisfy the first condition from the frame of the singing pitch detected near the pronunciation start timing of a certain note to the frame where the singing pitch is no longer detected. A singing pitch detected in the vicinity of the sounding start timing of a particular note in which there is a continuously descending descending interval, the pitch difference between the singing pitches of the frames included in the descending interval satisfies the second condition, and the A karaoke machine comprising a slowdown singing determination unit that determines that a slowdown singing for a given note is being performed when a pitch difference of the note from a reference pitch satisfies a third condition.
Other features of the present invention will be clarified by the description of the specification and drawings described later.

According to the present invention, it is possible to determine whether karaoke singing includes slow-down singing.

It is a figure which shows the hardware structural example of the karaoke apparatus which concerns on embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on embodiment. It is a flowchart which shows the determination processing of the slowdown singing which concerns on embodiment. It is the figure which showed the relationship between the note of 1 which concerns on embodiment, and a singing pitch.

<Embodiment>
A karaoke apparatus 1 according to an embodiment will be described with reference to FIGS. 1 to 4. FIG.

==Karaoke Device==
The karaoke device 1 is a device for performing karaoke and singing karaoke by a singer. A karaoke device 1 registers karaoke songs selected by singers in a reservation queue and performs karaoke performances in order. As shown in FIG. 1, the karaoke device 1 includes a karaoke main body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50. As shown in FIG.

The speaker 20 is configured to emit sound based on the sound emission signal from the karaoke main body 10 . The display device 30 is configured to display video and images on the screen based on the signal from the karaoke main body 10 . The microphone 40 is configured to convert a singer's singing voice (input voice to the microphone 40 ) into an analog singing voice signal and input it to the karaoke main body 10 . The remote control device 50 is a device for performing various operations on the karaoke main body 10 . The singer can use the remote control device 50 to select (reserve) a desired karaoke song. Icons and the like for inputting instructions for various operations are displayed on the display screen of the remote control device 50 .

The karaoke main body 10 performs various controls related to karaoke singing, such as performance control of selected karaoke music, display control of lyrics, background images, etc., and processing of singing voice signals input through the microphone 40 . As shown in FIG. 1 , the karaoke main body 10 includes a control section 11 , a communication section 12 , a storage section 13 , a sound processing section 14 , a display processing section 15 and an operation section 16 . Each configuration is connected to bus B via an interface (not shown).

The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a realizes various control functions by executing operation programs stored in the memory 11b. The memory 11b is a storage device that stores programs to be executed by the CPU 11a and temporarily stores various types of information during execution of the programs.

The communication unit 12 provides an interface for connecting the karaoke main body 10 to a communication line via a router (not shown).

The storage unit 13 is a large-capacity storage device that stores various data, such as a hard disk drive. The storage unit 13 stores a plurality of song data for karaoke performance by the karaoke apparatus 1 .

The song data is given a song ID for specifying each karaoke song. The music data includes accompaniment data, reference data, and the like. Accompaniment data is data that is the source of karaoke performance sounds. The reference data is data indicating the main melody of a karaoke piece of music, and is data used as a reference when scoring karaoke singing by a singer. The reference data is composed of a plurality of notes (musical notes), and a predetermined pitch (reference pitch) is set for each note. The reference data also includes note-on event data and note-off event data for each note. The note-on event data is data representing the sounding of a note, and the note-off event data is data representing the muting of a note.

The storage unit 13 also stores lyrics telop data for displaying lyrics corresponding to each karaoke song on the display device 30 or the like, background image data such as a background image displayed on the display device 30 or the like during karaoke performance, Performance time data indicating karaoke performance time and music attribute information (information about the music such as singer name, lyricist/composer name, genre, etc.) are stored.

Under the control of the control unit 11 , the sound processing unit 14 controls performance of karaoke music and processes singing voice signals input through the microphone 40 . The display processing unit 15 performs processing related to various displays on the display device 30 and the remote control device 50 under the control of the control unit 11 . For example, the display processing unit 15 controls the display device 30 to display an image in which lyric telops and various icons are superimposed on a background image during performance of karaoke music. Alternatively, the display processing unit 15 causes the display screen of the remote control device 50 to display various icons for operation input. The operation unit 16 consists of a panel switch, a remote control receiving circuit, and the like, and transmits operation signals such as a music selection signal and a performance stop signal to the control unit 11 according to the operation of the panel switch of the karaoke device 1 or the remote control device 50 by the singer. Output. The control unit 11 detects an operation signal from the operation unit 16 and executes corresponding processing.

(software configuration)
FIG. 2 is a diagram showing an example of the software configuration of the karaoke main body 10. As shown in FIG. The karaoke main body 10 includes a singing pitch detection section 100 , a slowdown singing determination section 200 , a presentation section 300 and a scoring processing section 400 . The singing pitch detection unit 100, the slowdown singing determination unit 200, the presentation unit 300, and the scoring processing unit 400 are implemented by the CPU 11a executing a program stored in the memory 11b.

[Singing pitch detector]
The singing pitch detection unit 100 detects a singing pitch in frame units of a predetermined length of time from a singing voice signal obtained by singing karaoke music.

The singing pitch is detected in chronological order one sample at a time in frame units of a predetermined length of time (for example, 10 to 20 msec). For example, if the predetermined time length is 15 msec, singing pitch detection section 100 detects the singing pitch with 15 msec as one frame. The singing pitch detection unit 100 stores the singing pitch detected by analyzing the singing voice signal in the storage unit 13 in association with the reference pitch of the corresponding note. The reference pitch of the note is specified based on the note-on event data included in the reference data.

The storage unit 13 stores the detected singing pitch and the reference pitch of the corresponding note together with the elapsed time from the start of the karaoke performance. That is, the detected singing pitch and the reference pitch of the corresponding note are stored in frame units.

Note that the detection of the singing pitch may be performed sequentially along with the singing of the karaoke music, or may be performed collectively after the singing of one karaoke music is completely finished.

[Slowdown singing judgment part]
The slowdown singing determination unit 200 determines the frame from the frame of the singing pitch detected near the sounding start timing of a certain note among the notes included in the reference data indicating the main melody of the karaoke song to the frame in which the singing pitch is no longer detected. In between, there exists a descending section in which the singing pitch continuously descends so as to satisfy the first condition, the pitch difference between the singing pitches of the frames included in the descending section satisfies the second condition, and the certain note If the pitch difference between the singing pitch detected near the sounding start timing and the reference pitch of the note satisfies the third condition, it is determined that the note is being sung in slowdown.

The falling section is a section from the frame of the singing pitch detected near the sounding start timing of a certain note to the frame in which the singing pitch is no longer detected, and the singing pitch continues so as to satisfy the first condition. It is a section that descends A first condition is a condition for specifying a descending section. As for the first condition, an arbitrary condition is set in advance according to the specified degree of slow-down singing. Specifically, the first condition is the pitch difference between the singing pitches of two consecutive frames from the frame of the singing pitch detected near the sounding start timing of a certain note to the frame where the singing pitch is no longer detected. is within a first predetermined range (details will be described later).

The second condition and the third condition are conditions for determining whether slowdown singing for a certain note is being performed. As for the second condition and the third condition, arbitrary conditions are set in advance according to the specified degree of slow-down singing. Specifically, the second condition is whether or not the pitch difference between the singing pitch of the frame at the start of the descent interval and the singing pitch of the frame at the end of the descent interval is within a second predetermined range ( details later). The third condition is whether or not the pitch difference between the singing pitch of the frame at the start of the falling interval and the reference pitch of a certain note is within a third predetermined range (details will be described later).

Here, with reference to FIGS. 3 and 4, the slowdown singing determination process will be described in detail. FIG. 3 is a flow chart showing the slowdown singing determination process. FIG. 4 is a diagram showing the relationship between one note and changes in singing pitch. The vertical axis in FIG. 4 indicates singing pitch, and the horizontal axis indicates time. The start time Ts is the sounding start timing of the note N, and the end time Te is the sounding end timing of the note N. FIG. The sounding start timing of a note corresponds to the elapsed time up to the note when the performance start point of the karaoke music is set to 0. Note that the horizontal axis of FIG. 4 may be interpreted as continuous frames of a predetermined time length, and the singing pitch is detected for each frame.

In the following description, the first singing pitch used when determining whether or not a slowdown singing is performed for a certain note is the singing pitch detected after the frame a predetermined time before the sounding start timing of a certain note. Suppose that This singing pitch corresponds to the singing pitch detected near the sounding start timing of a certain note. Any value can be set in advance for the predetermined time. For example, the predetermined time can be 120 msec.

Also, in the following description, the pitch difference is indicated by a cent value. It should be noted that a portion with a reference pitch of 0 is a non-singing section (a section with no lyrics for karaoke singing), and a singing pitch of 0 cannot be detected.

First, the slowdown singing determination unit 200 determines whether the time length of one of the notes included in the reference data is within a predetermined time range.

Specifically, the slowdown singing determining section 200 acquires the time length of one note based on the note-on event data of the one note. If the acquired time length is within the predetermined time range, the slowdown singing determination unit 200 identifies the note as a note targeted for detection of slowdown singing (a note targeted for detection of slowdown singing). identification, step 10). In this example, it is assumed that a note N to be detected as a slowdown singing is identified.

The predetermined time range is a value for determining whether or not one note is to be detected as slowdown singing. Any value can be set in advance for the predetermined time range. For example, the predetermined time can range from 140 msec to 930 msec.

It should be noted that if the time length of one note is not included in the predetermined time range, the slowdown singing determination section 200 does not perform the following processing.

Next, the slow-down singing determination unit 200 selects two consecutive frames from the first frame of the singing pitch detected near the sounding start timing of a certain note to the second frame in which the singing pitch is no longer detected. When the pitch difference between the singing pitches of the frames is within the first predetermined range, the descending section DZ having the first frame as the starting frame and the second frame as the ending frame is specified (the descending section DZ). Identification, step 11).

The first predetermined range is an allowable amount of difference between singing pitches of two consecutive frames when specifying a falling section. An arbitrary value is set in advance for the first predetermined range according to the degree of slow-down singing to be determined. Note that the singing pitch gradually decreases in the descending section. Therefore, when the pitch difference between the singing pitch value of a certain frame and the singing pitch value of the next frame is obtained, the pitch difference always indicates a negative value. Therefore, the first predetermined range is also set in a negative range. For example, the first predetermined range can be -20 cents to -40 cents.

Specifically, the slow-down singing determination unit 200 sequentially refers to the singing pitch from the frame of the singing pitch P(1) detected in the vicinity of the sounding start timing of the note N specified in step 10, and A pitch difference Pd between the singing pitches of the frames is obtained. The slowdown singing determination section 200 obtains the pitch difference between the singing pitches of two consecutive frames until the singing pitch is no longer detected. The slowdown singing determination section 200 determines whether or not all the obtained pitch differences are within the first predetermined range.

When the pitch difference between the singing pitches is within the first predetermined range, the slowdown singing determining section 200 sets the frame of the singing pitch P(1) as the starting frame, and sets the frame of the singing pitch P(1) as the starting frame. A descending section DZ having the last frame as the ending frame is specified. In this example, the singing pitch of the frame at the end is set as singing pitch P(n).

Next, the slowdown singing determination unit 200 determines the pitch difference P(n) between the singing pitch P(1) of the frame at the start of the descending section DZ and the singing pitch P(n) of the frame at the end of the descending section DZ. - Determine if P(1) is within a second predetermined range.

The second predetermined range is the width of the permissible deviation between the singing pitch of the frame at the start of the falling section and the singing pitch of the frame at the end of the falling section when judging the slowdown singing. An arbitrary value is set in advance for the second predetermined range according to the specified degree of slow-down singing. As described above, the singing pitch gradually decreases in the descending section. Therefore, the singing pitch of the frame at the end of the descending interval is lower than the singing pitch of the frame at the beginning of the descending interval. Therefore, the second predetermined range is also set in a negative range. For example, the second predetermined range can be set within the range of -300 cent to -2000 cent.

The pitch difference P(n)-P(1) between the singing pitch P(1) of the frame at the start of the descending section DZ and the singing pitch P(n) of the frame at the end of the descending section DZ is the second predetermined range. (Y in step 12), the slowdown singing determination section 200 determines that the pitch difference between the singing pitch P(1) of the frame at the start of the falling section DZ and the reference pitch Pf of the note N is the It is determined whether it is within the predetermined range of 3.

The third predetermined range is the amount of deviation between the permissible singing pitch of the frame at the start of the falling section and the reference pitch of the note to be detected as the slowing-down singing when judging the slowing-down singing. An arbitrary value is set in advance for the third predetermined range according to the specified degree of slow-down singing. For example, the third predetermined range can be set within a range of 100 cents to 1500 cents as the absolute value of the width of deviation.

If the pitch difference between the singing pitch P(1) of the frame at the start of the descending section DZ and the reference pitch Pf of the note N is within the third predetermined range (Y in step 13), slowdown singing judgment The unit 200 determines the descending section DZ identified in step 11 as a section in which the slow-down singing is performed (decision of slow-down singing; step 14). The transition of the singing pitch of the slow-down singing for the note N shown in FIG. is −900 cents, and the pitch difference between the singing pitch P(1) of the frame at the start of the descending section DZ and the reference pitch Pf of note N is +300 cents.

In this example, the processing of step 13 is performed after the processing of step 12, but the processing may be performed in the reverse order. Also, if the descending section cannot be identified, the pitch difference P(n)-P between the singing pitch P(1) of the frame at the start of the descending section DZ and the singing pitch P(n) of the frame at the end of the descending section DZ (1) is not within the second predetermined range (N in step 12), and the pitch difference between the singing pitch P(1) of the frame at the start of the falling section DZ and the reference pitch Pf of note N is not within the third predetermined range (N in step 13), the slowdown singing determining section 200 determines that note N is not being slowed down.

[Presentation part]
The presentation unit 300 presents the determination result by the slowdown singing determination unit 200 to the singer. For example, when a determination result indicating that the note N has been slowed down is input, the presentation unit 300 displays the fact that the slowed down song has been performed near the guide melody image corresponding to the note N displayed on the display device 30. icon can be displayed. The guide melody image is displayed as an image of the melody of the karaoke song in order to support the karaoke singing of the singer. A known method can be used for displaying the guide melody image (see, for example, Japanese Patent Application Laid-Open No. 2004-205817).

It should be noted that the presentation unit 300 can also display only the icon indicating that the slow-down singing has been performed regardless of the guide melody image. Alternatively, the presentation unit 300 may notify that the slow-down singing has been performed by voice (applause, cheers, etc.) through the speaker 20 instead of displaying the icon indicating that the slow-down singing has been performed.

[Scoring section]
The scoring unit 400 compares a singing voice signal obtained by singing a karaoke song with reference data of the karaoke song, and calculates a score value. A known method can be used for the processing of calculating the score. For example, the grading processing section 400 performs grading processing for the accuracy of the singing pitch using the singing pitch based on the singing voice signal input from the microphone 40 and the reference pitch based on the reference data.

Here, the grading processing unit 400 according to the present embodiment, when the grading result of a certain note is determined to be unacceptable, and when the slow-down singing for the certain note is performed, the grading processing unit 400 Judged as passing. As shown in FIG. 4, slow-down singing has a large deviation from the standard pitch of notes, so there is a high possibility that it will be rejected according to a general scoring process. Therefore, even if the scoring result of a certain note is rejected, the scoring processing unit 400 determines that the slowed-down singing has been performed for the certain note by the slow-down singing determination unit 200. , the certain note is determined as a pass.

As is clear from the above, the karaoke apparatus 1 according to the present embodiment includes a singing pitch detection unit 100 for detecting a singing pitch in units of frames of a predetermined length of time from a singing voice signal obtained by singing karaoke music, and a karaoke The first condition is satisfied between the frame of the singing pitch detected near the pronunciation start timing of a certain note among the notes included in the reference data indicating the main melody of the music and the frame where the singing pitch is no longer detected. There is a falling section in which the singing pitch continuously falls, the pitch difference of the singing pitches of the frames included in the falling section satisfies the second condition, and the singing is detected near the sounding start timing of the certain note. and a slowdown singing determination unit 200 that determines that slowdown singing is being performed for a certain note when the pitch difference between the pitch and the reference pitch of the certain note satisfies a third condition. According to such a karaoke device 1, it can be determined whether or not the karaoke song includes a slowdown song.

More specifically, when the time length of one note among the notes included in the reference data is within a predetermined time range, the slowdown singing determination unit 200 identifies the note as a certain note, The pitch difference between the singing pitches of two consecutive frames is the first If it is within the predetermined range, specify the falling section with the first frame as the starting frame and the second frame as the ending frame, and determine the singing pitch of the starting frame and the singing pitch of the ending frame. is within a second predetermined range, and the pitch difference between the singing pitch of the frame at the start and the reference pitch of a certain note is within a third predetermined range, the falling section is slowed down. is determined as an interval where The slow-down singing determining section 200 can determine whether or not the karaoke singing includes slow-down singing by executing such processing.

Furthermore, the karaoke apparatus 1 according to the present embodiment determines that the scoring result of a certain note is passed when the scoring result of the certain note is determined to be unsuccessful and when the slow-down singing for the certain note is performed. It has a scoring processing unit 400 for judging. According to such a karaoke machine, it is possible to avoid a scoring result that does not reflect the slow-down singing technique used.

<Others>
It is also possible to provide the slowdown singing determination process and the like described in the above embodiment as a program. For example, the program causes a computer (for example, a karaoke device) to detect a singing pitch in units of frames of a predetermined time length from a singing voice signal obtained by singing karaoke music, and uses it as reference data indicating the main melody of karaoke music. Among the included notes, the singing pitch continuously falls so as to satisfy the first condition from the frame of the singing pitch detected near the sounding start timing of a certain note to the frame where the singing pitch is no longer detected. and the pitch difference between the singing pitches of the frames included in the falling interval satisfies the second condition, and the singing pitch detected near the pronunciation start timing of the certain note and the reference of the certain note When the pitch difference from the pitch satisfies the third condition, it is determined that the slowdown singing for the certain note is being performed.

It is also possible to supply the program to the computer using a non-transitory computer readable medium with an executable program thereon storing the program. Examples of non-transitory computer-readable media include magnetic recording media (eg, flexible discs, magnetic tapes, hard disk drives), CD-ROMs (Read Only Memory), and the like.

The above embodiments are presented as examples and are not intended to limit the scope of the invention. The above configurations can be implemented in combination as appropriate, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. The above-described embodiments and modifications thereof are included in the invention described in the claims and their equivalents, as well as being included in the scope and gist of the invention.

1 karaoke device 10 karaoke main body 11 control unit 100 singing pitch detection unit 200 slowdown singing determination unit 300 presentation unit 400 scoring processing unit

Claims (2)

A singing pitch detection unit that detects a singing pitch in units of frames of a predetermined length of time from a singing voice signal obtained by singing karaoke music;
Among the notes included in the reference data indicating the main melody of the karaoke song, if the time length of one note is within a predetermined time range, the one note is identified as a certain note,
From the first frame of the singing pitch detected in the vicinity of the pronunciation start timing of the certain note to the second frame in which the singing pitch is no longer detected , the pitch difference between the singing pitches of two consecutive frames is the first. If the singing pitch continuously falls within a predetermined range, the first frame is the start frame and the second frame is the end frame .
The pitch difference between the singing pitch of the frame at the start and the singing pitch of the frame at the end included in the falling interval is within a second predetermined range, and the singing pitch of the frame at the start and the singing pitch of the frame at the end a slow-down singing determination unit that determines the falling section as a section in which slow -down singing is performed when the pitch difference from the reference pitch of the note is within a third predetermined range ;
A karaoke device having a grading processing unit that determines that the grading result of the certain note is acceptable when the grading result of the certain note is determined to be unacceptable and when it is determined that the slow-down singing for the certain note is being performed; 2. The karaoke apparatus according to claim 1 , wherein:

Images