JP2007140165A - Karaoke device and program for karaoke device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a karaoke device and a program for karaoke device that can score not only by a fixed viewpoint, but also with amusement. <P>SOLUTION: The karaoke device has a second scoring means in addition to a first scoring means of evaluating/scoring a voice by analyzing the frequency component and/or sound volume component of a voice signal of a voice to karaoke music and comparing the analytic result with the karaoke music. The second scoring means performs scoring based upon the number of times of playing or the numbers of time of scoring for each karaoke music. Finally, total points based upon evaluations made by the first and second evaluating means are displayed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a karaoke apparatus having a scoring function and a karaoke apparatus program.

Conventionally, a karaoke apparatus having a scoring function for scoring a karaoke song with high accuracy by analyzing the frequency of a singing voice signal input from a microphone is known. For example, the following Patent Document 1 discloses a system that displays three judges, evaluates a song from different viewpoints, and displays a total score. In the system, scoring by three judges evaluates music according to the same scoring algorithm, and outputs different evaluations in a simulated manner by assigning different weights to evaluation points (pitch, volume, rhythm). It is configured to do.
JP-A-10-161673

  In the above prior art, karaoke singing can be accurately evaluated. However, as the evaluation point of view, the pitch, volume, and rhythm are only used in a fixed manner, so there is a lack of interest.

  An object of the present invention is to provide a karaoke apparatus and a karaoke apparatus program capable of performing not only scoring from a fixed point of view but also multifaceted scoring rich in interest.

  In order to achieve this object, the present invention analyzes the frequency component and / or volume component of an audio signal sung in time with karaoke, and compares it with the karaoke song, thereby evaluating and scoring the song. In addition to the first scoring means, a second scoring means is provided. The second scoring means performs scoring based on the number of times played for each karaoke song and / or the number of times scored. Finally, the total score based on the evaluation of the first scoring means and the second scoring means is displayed.

  According to this invention, by adding elements other than the singing voice as points, it is possible to perform not only scoring from a fixed viewpoint as in the prior art but also scoring that is highly entertaining and has increased entertainment properties. In particular, by scoring according to the number of times of singing, scoring can be performed to evaluate “singing”, that is, “singing effort”, and entertainment is increased.

  An embodiment for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a schematic hardware configuration diagram of a karaoke apparatus according to an embodiment of the present invention. This karaoke device includes a central processing unit (CPU) 101, a read only memory (ROM) 102, a random access memory (RAM) 103, an external storage device 104, a display 105, a sound source (including a DSP) 106, a sound system 107, An audio input unit 108, a microphone 109, a communication interface (I / F) 110, and a bus line 111 are provided.

  The CPU 101 is a processing device that controls the operation of the entire karaoke apparatus. The ROM 102 is a nonvolatile memory that stores a startup routine at power-on, a BIOS (Basic Input Output System) that controls low-level I / O processing, a control program executed by the CPU 101, and the like. The RAM 103 is a volatile memory used as a load area for programs executed by the CPU 101 and various work areas. The external storage device 104 is, for example, a hard disk (HDD) or a flash memory, and stores programs executed by the CPU 101 and various data. In particular, the external storage device 104 stores karaoke data described later. The karaoke apparatus can be configured using, for example, a general PC. The karaoke apparatus is connected to a server 120 via a network and constitutes a server / client system as a whole.

  The display 105 is a display device for displaying various information provided on the external panel of the karaoke apparatus. The sound source 106 generates a musical sound signal for karaoke accompaniment based on an instruction from the CPU 101 and sends it to the sound system 107. The sound source 106 includes a DSP and the like, and has a function of mixing singing voice and accompaniment sound input from a microphone, various effect providing functions, and an output level control function. The sound system 107 emits a musical sound based on the musical sound signal output from the sound source 106. The voice input unit 108 A / D converts the analog singing voice signal input from the microphone 109 into digital data and inputs the digital data. The communication I / F 110 is a network interface, and can receive distribution of karaoke data from the external server 120 via the network. The distributed karaoke data is stored in the external storage device 104. Karaoke data can also be received as streaming data. Although not shown in FIG. 1, it is assumed that the user has an operation unit that can give various instructions to the karaoke apparatus using a remote control device, a keyboard, a mouse, various switches, and the like.

  FIG. 2 shows a configuration of karaoke data distributed from the server 120 and stored in the external storage device 104. The karaoke data includes performance data 201, lyrics data 202, and additional data 203. The performance data 201 includes a melody part 211 and an accompaniment part 212. The melody part 211 is a MIDI format event sequence indicating the melody to be sung in this song. The accompaniment part 212 is a MIDI-format event sequence of the accompaniment sound of this song. The lyrics data 202 is the lyrics of the song (for display on the display). The additional data 203 includes a scoring parameter 231 and other data 232. Other data 232 includes music ID, music genre, vocal gender (gender), reproduction ranking, copyright related information (artist name, composer name, songwriter name, publication year, etc.). The scoring parameter 231 is data added when a scoring system unique to this music is designated. Details of the scoring parameter 231 will be described later.

  The karaoke data may not include the scoring parameter 231. When the karaoke data includes the scoring parameter 231, the scoring is performed based on the scoring parameter 231. When the karaoke data does not include the scoring parameter 231, the scoring is based on the default scoring parameter 231. Is done. Since the scoring parameter 231 includes a plurality of parameters as described later, when the karaoke data partially includes the scoring parameter 231, the designated parameter is used, and the undesignated parameter is a default value. Shall be used. Further, the scoring parameter 231 and the other data 232 are not necessarily integrated with the performance data 201 and the lyrics data 202. For example, the scoring parameter and other data 232 may be distributed from the server 120 separately. In this case, the performance data 201 and the lyrics data 202 already stored in the external storage device 104 and the additional data 203 downloaded from the server 120 may be associated with each other by the music ID.

  FIG. 3 shows a functional block diagram of the scoring function in the karaoke apparatus of the present embodiment. The storage unit 301 corresponds to the external storage device 104 in FIG. 1 and stores karaoke data 302 (FIG. 2) distributed from the server 120 in advance. Instead of reading from the storage means 301, karaoke data distributed by streaming may be used. The sequencer 303 inputs the karaoke data 302, sends each data in the karaoke data 302 to each unit, and controls the operation of each unit. The sequencer 303 is realized by the CPU 101 in FIG. 1 executing a predetermined program.

  The performance data 201 in the karaoke data 302 is sequentially sent to the sound source 305. The sound source 305 corresponds to the sound source 106 in FIG. The sound source 305 generates a musical sound based on the input performance data 201 and outputs it to the mixer 309. In addition, the drawing engine unit 332 receives the lyrics data 202 output from the sequencer 303 and draws a karaoke screen including the lyrics data 202 on the display screen 333 (the display 105 in FIG. 1). The drawing engine unit 332 is realized by the CPU 101 in FIG. 1 executing a predetermined program.

  The singing voice signal input from the microphone 306 is converted into a voice signal 308 which is digital data by the A / D converter 307. The microphone 306 and the A / D conversion unit 307 correspond to the microphone 109 and the audio input unit 108 in FIG. The audio signal 308 is input to the mixer 309. The mixer 309 mixes the musical sound from the sound source 305 and the audio signal 308 from the microphone, and performs effect addition and output level control. The mixing output is converted into an analog sound signal by the D / A converter 310 and emitted from the speaker 311. The mixer 309, the D / A converter 310, and the speaker 311 correspond to the sound source (DSP) 106 and the sound system 107 in FIG.

  The voice signal 308 of the singing voice is input to the level analysis unit 321 and the frequency analysis unit 322, and level analysis and frequency analysis are performed for each sampling period. The level analysis unit 321 outputs volume level information of the singing sound, and the frequency analysis unit 322 outputs frequency distribution information. The song analysis unit 323 inputs the volume level information and the frequency distribution information, and inputs the melody part 211 output from the sequencer 303.

The singing amount determination unit 324 in the singing analysis unit 323 determines, for each note of the melody part 211, whether the volume level of the singing voice input from the microphone 306 at the timing of the note exceeds a predetermined first threshold value. A sound volume determination value A is obtained, which is 1 when the threshold is exceeded and 0 otherwise. The singing amount determination unit 324 obtains a Σ volume determination value A that is the sum of the volume determination values A of all the notes of the melody part of the music at the time when the reproduction of the music ends.
Normalized singing amount evaluation point = (Σ sound volume judgment value A) / normalized singing amount evaluation point is calculated from the total number of notes in the melody part. The normalized singing amount evaluation score is an index indicating how many percent of the effective singing is performed. If all the notes of the melody part are uttered at a volume level exceeding the first threshold, 1.0, the first Every time the number of notes uttered at a volume level below the threshold increases, the number decreases from 1.0. When all the notes are uttered at a volume level below the first threshold, 0.0 is taken. Note that the volume level for each note is determined not by “integration of absolute value of sampling waveform / number of samples” but by “peak value / number of peaks”.

The pitch determination unit 325 in the singing analysis unit 323 is input from the microphone 306 for each note of the melody part 211 at the reference frequency of the note (pitch frequency specified from the note information) and the timing of the note. A deviation from the frequency of the formant peak (basic frequency component and / or overtone component) of the singing voice is obtained, and a pitch determination value for each note is calculated based on this deviation. The pitch determination value ranges from 0.0 to 1.0. When the deviation is 0, the pitch determination value becomes 1.0, and decreases as the deviation increases. The pitch determination unit 325 obtains a Σ pitch determination value that is the sum of the pitch determination values of all the notes of the melody part 211 of the music at the time when the reproduction of the music ends.
Normalized pitch evaluation score = (Σ pitch determination value) / normal pitch evaluation score is calculated from the total number of notes in the melody part. The normalized pitch evaluation score is an index that indicates how accurate the entire song is uttered, and the range of 1.0 to 0.0 (the formant peak of the singing voice for each note is the same as the reference frequency of each note. Take 1.0) when it is a perfect match.

The processing of the volume determination unit 326 in the song analysis unit 323 is the same as that of the song amount determination unit 324. However, instead of the first threshold value, a second threshold value that satisfies the first threshold value <the second threshold value is used. The sound volume determination value determined using the second threshold is referred to as a sound volume determination value B. The volume determination unit 326 obtains a Σ volume determination value B that is the sum of the volume determination values B of all the notes of the melody part of the music at the time when the reproduction of the music ends.
Normalized volume evaluation score = (Σvolume determination value B) / normalized volume evaluation score is calculated from the number of all notes of the melody part. Since the first threshold value <the second threshold value, normalized singing amount evaluation point ≧ normalized sound volume evaluation point. The normalized sound volume evaluation score is an index indicating how well the entire music is uttered.

  The scoring evaluation unit 327 includes a plurality of scoring agents 328. Each agent 328 inputs the normalized singing amount evaluation point, the normalized pitch evaluation point, and the normalized sound volume evaluation point that are output from the singing analysis unit 323 when the reproduction of the music is finished, and the additional data from the sequencer 303. 203 (including a scoring parameter 231. If the karaoke data does not include the scoring parameter 231, the default scoring parameter is used), and scoring is performed according to the processing procedure of FIG. 5 described later. Since the scoring parameters passed to each agent 328 are different, each agent 328 is scored by a different scoring method. The score scored by each agent 328 is input to the drawing engine 332 and displayed, and the total is displayed as an evaluation score.

  The level analysis unit 321, the frequency analysis unit 322, the song analysis unit 323, and the scoring agent 328 are realized by the CPU 101 executing a predetermined program. The DSP function of the sound source 106 may be partially used.

  Here, a parameter item (scoring parameter 231) given by each agent 328 from the sequencer 303 will be described.

  (1) Presence / absence of singing amount determination: This parameter specifies whether or not to perform singing amount determination with “present” or “not present”. If “Yes” is specified, the point is also specified. When “present” is specified, the agent multiplies the specified singing amount evaluation point (in the range of 0.0 to 1.0), which is the output from the singing amount determination unit 324, with the specified singing amount. An evaluation score is calculated and added to the score.

  (2) Presence / absence of pitch determination: a parameter for designating whether or not to perform pitch determination by “present” or “absent”. If “Yes” is specified, the point is also specified. When “present” is specified, the agent multiplies the normalized pitch evaluation score (in the range of 0.0 to 1.0), which is an output from the pitch determination unit 325, with the specified score to obtain a pitch evaluation score. Calculate and add to the score.

  (3) Presence / absence of volume determination: a parameter for designating whether or not to perform volume determination by “present” or “absent”. If “Yes” is specified, the point is also specified. When “present” is designated, the agent multiplies the designated sounding score (in the range of 0.0 to 1.0), which is an output from the sound volume determination unit 326, with the designated score, thereby obtaining a sound volume evaluation score. Calculate and add to the score.

  (4) Existence of genre scoring: This is a parameter for designating whether to perform scoring by genre with “present” or “absent”. When “Yes” is specified, the genre and the number of points to be added are also specified. A plurality of genres and a score for each genre may be designated. When "Yes" is specified, the agent determines whether the selected music is in the specified genre, and if so, adds the specified score to the score, otherwise adds do not do.

  (5) Presence / absence of announcement year: a parameter that designates “Yes” or “No” whether or not to add points according to the announcement year (release year) of the selected song. When “Yes” is specified, the period for determining the year of publication and the number of points to be added are also specified. A plurality of periods and points added for each period may be designated. When “Yes” is specified, the agent determines whether the year of the selected song is within the specified period, and if so, adds the specified score to the score, and so on. If not, no points will be added.

  (6) Presence / absence of ranking scoring: This is a parameter for designating whether or not to perform scoring according to the ranking of the selected music by “present” or “absent”. In the case of “present”, the ranking area (for example, first to tenth) for determining the ranking and the number of points to be added are also designated. A plurality of ranking areas and the number of points added for each ranking area may be designated. When “present” is designated, the agent obtains the current ranking of the selected music from the server 120, determines whether the ranking is within the designated ranking range, and if so, the above The specified score is added to the score, otherwise it is not added. The ranking may be acquired from the server 120 at the time of scoring, or may be acquired from the server 120 in advance.

  (7) Presence / absence of singing times: a parameter that designates “Yes” or “No” as to whether or not to add points based on the number of times a user who sang karaoke sings the music. When “Yes” is specified, the range of the number of playback times and the number of points to be added are also specified. When “present” is designated, the agent determines whether the number of times the music has been played is within the designated number of times specified above, and if so, adds the specified number of points to the score, Otherwise, no points are added. Note that the number of times of reproduction is held and managed on each karaoke device as a client (for each user if necessary). When streaming music data, it may be managed on the server 120 side. The number of scoring may be used instead of the number of reproductions.

  (8) In addition, the limit value (maximum value) of the score value output by the agent is designated. If a score is added as in the above (1) to (7), the score value may be inappropriately increased, so that the score is limited to a predetermined limit value.

  In this embodiment, five agents 328 are used as shown in FIG. Examples of default scoring parameters given to each agent from the sequencer 303 are shown below.

[First Agent]
Singing amount determination: Yes (their score is 10 points), Pitch determination: Yes (their score is 10 points), Volume determination: No, Genre score: No, Year of publication rating: No, Ranking score: No, Singing number of times: None, limit value: 20 points [second agent]
Singing amount judgment: Yes (the score is 15 points), Pitch judgment: No, Volume judgment: Yes (the score is 5 points), Genre scoring: No, Publication year scoring: No, Ranking scoring: No, Singing number scoring: None, limit value: 20 points [third agent]
Singing amount judgment: No, pitch judgment: No, volume judgment: No, genre scoring: yes (5 points when the genre is J-POP, 3 points when the genre is ROCK), year of scoring: yes ( Announcement year is 2004-2005, 5 points), ranking score: Yes (when ranking is 1st-10th, 10 points are added, and when ranking is 10th-20th, 5 points are added) ), Singing score: None, Limit value: 20 [fourth agent]
Singing amount judgment: No, pitch judgment: No, volume judgment: No, genre scoring: yes (8 points are added when the genre is J-POP), announcement year scoring: yes (the announcement year for the target is 1980-1995) In addition, the score is 8 points), ranking score: Yes (when the ranking is 1st to 30th, the score is 4 points), Singing score: No, limit value: 20 points [5th agent]
Singing amount judgment: No, pitch judgment: No, volume judgment: No, genre scoring: yes (when genre is enka, 10 points are added), announcement year scoring: no, ranking scoring: yes (ranking is 1st to 10th) 5 points, 3 points when the ranking is 1st to 50th, and singing score: Yes (when the number of times the song is played is 10 or more, 5 points, 5-9 times) 3 points, 1 point for 1 to 4 points), limit value: 20 points

  The first agent embodies a judge who makes a strict evaluation on the pitch deviation of a singer, such as a composer. The second agent embodies a lyricist judge who evaluates, for example, singing lyrics clearly. Since the first and second agents are singing experts, the amount of singing is also determined as a basic evaluation. The third agent, for example, has no interest in songs he does not know, and embodies the judges of Shibuya-style gals who evaluate only popular songs around 2004-2005. The fourth agent is, for example, a couple around 30 years old, who is the main singer who sings music in his school days, but who is also familiar with the latest music. The fifth agent is, for example, a woman who works at a store in Akasaka, and a calm song that is often heard by the customer's partner embodies a judge who likes it.

  FIG. 4 shows a flowchart of the scoring process. In step 401, initialization is performed. In the initial setting, the scoring parameters of the five agents used for scoring the music, the evaluation points output from the song analysis unit 323, and other data 232 in the karaoke data of the music (genre, announcement year, etc.) ) And send it to each agent. As described above, if the scoring parameter 231 is specified in the karaoke data, it is used, and if not specified, the default value is sent. In step 402, evaluation is performed at each agent. In step 403, the scoring results at each agent are totaled and output.

  FIG. 5 is a flowchart showing processing of each agent. In step 501, initialization is performed. In the initial setting, scoring parameters (values of parameter items (1) to (8) above) given to the agent are input. Also, the register for storing the score is cleared to 0 (hereinafter simply referred to as “score”). In step 502, it is determined whether or not the singing amount is determined. Singing amount determination: When “Yes” is specified, the singing amount evaluation score is calculated in step 503 as described in (1) above, and added to the score. In step 504, the presence / absence of a pitch determination is determined. Pitch determination: When “Yes” is designated, a pitch evaluation score is calculated in step 505 as described in (2) above, and added to the score. In step 506, the presence / absence of volume determination is determined. Volume determination: When “Yes” is designated, a volume evaluation score is calculated in step 507 as described in (3) above, and added to the score. In step 508, the presence / absence of genre scoring is determined. Genre scoring: If yes is specified, in step 509, as described in (4) above, it is determined whether the genre of the music is the designated genre, and if so, the designated score is scored. Add points. In step 510, it is determined whether or not there is a scoring year. Announcement year: If yes is specified, it is determined in step 511 whether the announcement year of the song is within the specified period, as described in (5) above. Score is added to the score. In step 512, it is determined whether there is a ranking score. Ranking scoring: If yes is specified, in step 513, as described in (6) above, it is determined whether the ranking of the music is within the designated ranking range, and if so, the designated score is determined. Add points to the score. In step 514, it is determined whether or not the singing frequency is scored. Ranking scoring: If yes is specified, it is determined in step 515 whether the number of times the music has been played is within the specified range, as described in (7) above, and if so, the specified score Add to the score. In step 516, it is determined whether the score as a score does not exceed the specified limit value, and if it exceeds, the limit value is scored.

  FIG. 6 shows an example of a display screen. Reference numeral 601 denotes a screen during karaoke performance. As indicated by reference numeral 611, lyrics are sequentially displayed as the music progresses. When the song ends, a screen 602 is displayed. A display 621 indicating that scoring is in progress is made, and displays 622 and 623 of the person of the judge corresponding to each agent are displayed. Reference numerals 624 and 625 are display areas for scores assigned to each judge. When the scoring is over, a screen 603 is displayed. 631 is the total score of each judge. The score given by the judge 632 is displayed in the area 634 as “18” points, and the score given by the judge 633 is displayed in the area 635 as “15” points. The display of each judge (632 and 633) may be a person display that shows the character corresponding to the judge. For example, an agent that embodies a composer who is severe in pitch is displayed as a person of such a composer, and an agent that embodies a Shibuya-style gal is displayed as a person of such a gal.

  The user can switch between the normal karaoke mode and the evaluation karaoke mode. In the normal karaoke mode, the normal karaoke function is performed without scoring. In the evaluation karaoke mode, as described above, after the karaoke performance Alternatively, the scoring agent may perform scoring and display the result. In that case, in the evaluation karaoke mode, the output level of the melody part (= guide voice) may be lowered than that in the normal karaoke mode or may be completely turned off in order to suppress erroneous scoring by the guide voice.

  In the above embodiment, five agents are used, but the number is arbitrary. However, it is set to 2 or more, and must include any one of the singing amount evaluation, the pitch evaluation, and the volume evaluation and any one of the other evaluations. Further, as a scoring method, scoring from the viewpoint of [gender] or [random number] may be introduced. In the evaluation by [gender], for example, if the vocal type (male or female) that the music has as an attribute matches the range of the singing voice, a predetermined score is added. In the evaluation by [Random Number], if the score by other scoring is less than the reference score, 1 to M points are added (M is the maximum that the agent can take by other scoring such as (1) to (7) above) And the difference between the agent's points).

  It is also possible to prepare parameter sets for a plurality of agents (each of which becomes a character of a judge with different properties / characters) so that the user can select a judge from among them.

  It should be noted that the distribution of points of each agent can be arbitrarily changed. For example, the points of the first to fifth agents are set to 4: 3: 1: 1: 1 in order. The distribution of the points may be changed for each piece of music using scoring parameters. Also, for example, the agent corresponding to the composer's judge and the agent corresponding to the Shibuya-style gal judge will distribute the points according to the combination of the agents, such as making the former's share of points larger than the latter. You may change it. Such a point attribute may be defined by a scoring parameter given to the agent.

Hardware schematic block diagram of a karaoke apparatus of one embodiment of the present invention Karaoke data configuration diagram Functional block diagram of scoring function Scoring flowchart Flow chart showing the processing of each agent Figure showing a display screen example

Explanation of symbols

  DESCRIPTION OF SYMBOLS 101 ... Central processing unit (CPU), 102 ... Read-only memory (ROM), 103 ... Random access memory (RAM), 104 ... External storage device, 105 ... Display, 106 ... Sound source (including DSP etc.), 107 ... Sound System 108, voice input unit 109, microphone, 110 communication interface (I / F), 111 bus line.

Claims (2)

Karaoke performance means for performing karaoke songs,
Counting means for counting the number of times played and / or scored for each karaoke song;
Voice input means for inputting a voice signal of a voice sung along with karaoke performed by the karaoke performance means;
A first scoring means for evaluating and scoring a song by analyzing a frequency component and / or a volume component of the sound signal input by the sound input means, and comparing with the karaoke song;
Second scoring means for scoring based on the number of performances and / or the number of scoring related to the karaoke songs counted by the number counting means;
A karaoke apparatus comprising: means for displaying a total score based on the evaluation of the first scoring means and the second scoring means. A program for a karaoke device that realizes a karaoke device by being executed by a computer,
The computer,
Karaoke performance means for performing karaoke songs,
Counting means for counting the number of times played and / or scored for each karaoke song;
Voice input means for inputting a voice signal of a voice sung along with karaoke performed by the karaoke performance means;
A first scoring means for evaluating and scoring a song by analyzing a frequency component and / or a volume component of the sound signal input by the sound input means, and comparing with the karaoke song;
Second scoring means for scoring based on the number of performances and / or the number of scoring related to the karaoke songs counted by the number counting means;
A program for a karaoke apparatus, which functions as means for displaying a total score based on the evaluation of the first scoring means and the second scoring means.

Images