JP4509074B2 - Lyric telop display control system for karaoke equipment - Google Patents

Description

  The present invention relates to a lyrics telop display control system for a karaoke apparatus having a singing scoring function while displaying lyric telops of musical performances.

  In recent years, in a karaoke apparatus, an image related to a musical piece to be played is displayed, and it is common to display lyrics of a singing musical piece during the display, and a function of scoring a user's singing is provided. Even things that have been prepared have appeared. While karaoke singing using such a karaoke device has become common, a device with a new added value is desired.

  When you sing a given song, remembering all the lyrics makes it easier to empathize, so many users want to sing without seeing the lyrics even when singing using a karaoke device. The number of users who memorize is increasing. On the other hand, while books and the like that the brain activation by memory can prevent dementia are also published, various lyrics display techniques for storing lyrics are proposed in the following patent documents. .

  In Patent Document 1, when a performance piece is played based on musical tone data in a karaoke device, when the lyric display selection means by the singer is selected to hide the lyrics telop, the lyrics telop is not displayed. It has been proposed to display the non-display mode.

  Further, in Patent Document 2, in order to prevent the lyrics telop from being displayed by the singer's arbitrary selection, a lyrics display switching button on the panel is provided, and the lyrics display switching button is pressed and provided on the microphone. It has been proposed to hide the lyrics when the cheat button is not pressed.

JP 09-114476 A Japanese Patent No. 3423137

  However, in any of the methods proposed in Patent Documents 1 and 2, since the user needs to operate the buttons, it is possible to objectively determine the improvement in the skill of singing without looking at the lyrics. In addition, there is a problem that the user has to rely on manual operation exclusively at the user's own discretion.

  Accordingly, the present invention has been made in view of the above problems, and provides a lyrics telop display control system for a karaoke apparatus that efficiently and effectively supports a user by making it possible to objectively determine the singing skill of a singer. For the purpose.

In order to solve the above-described problem, in the invention of claim 1 , a singing scoring means for displaying a lyrics telop of a performance song, performing speech recognition on an input singing voice, and scoring at least lyrics for each singing section. A karaoke device lyrics telop display control system for controlling the display form of the lyrics telop, comprising at least a user ID acquisition means, a scoring information recording means, and a lyrics display control means, the user ID acquisition means Is to acquire a user ID from an ID medium possessed by the user in response to a login request to the karaoke device by the user, and the scoring information recording means is used when the user sings a predetermined piece of music. to, the scoring information lyrics scoring each singing section in the latest of the song that is scored by the singing scoring means, the obtained user ID The lyrics display control means refers to the scoring information recording means when the user sings a predetermined music, and the lyric display control means refers to the scoring information for each song section in the music. For each singing section, in the singing section where the grading information exceeds the preset scoring reference value, the lyrics telop of the singing section is hidden, and in the singing section where the singing section is below the scoring reference value, the singing section The control is performed to display the lyrics telop with the number of characters according to the lyrics scoring information .

According to the present invention, when a user ID is acquired and the user sings a predetermined music piece, predetermined scoring information for each singing section in the latest scored music piece is associated with the user ID. When the user sings a predetermined piece of music, the scoring information for each singing section in the recorded piece of music exceeds the scoring reference value set in advance for each singing section. In the singing section, the lyrics telop in the singing section is hidden, and in the singing section below the scoring reference value, the predetermined part of the lyrics telop in the singing section is displayed. Therefore, it is possible to objectively determine the singing skill by the user and to support the user efficiently and effectively. In particular, by displaying only the phrase lyrics part display telop with the number of lyric characters according to the ratio of lyric scoring in the corresponding singing section, it is possible to evoke the reminder of the lyrics of the singing section, and the lyric memory for the user is more efficient And more effective support.

  Hereinafter, the best embodiment of the present invention will be described with reference to the drawings. The block diagram of a karaoke apparatus provided with the lyrics telop display control system which concerns on this invention is shown. In FIG. 1, the karaoke apparatus 11 includes a karaoke main body 12 and a remote input / output terminal 13 attached to the karaoke main body 12, and music data, updated music data, etc. with respect to the host device 15 via the communication network 14. Data exchange such as user information is freely connected.

  The remote input / output terminal 13 is omitted in its configuration, but has a user interface function and is compatible with the corresponding karaoke main body 12 (transmission / reception unit 31 described later) by a wired system or a wireless system (IR system or Bluetooth mechanism piconet). A connection method and the like, and includes a circuit board and a program therefor, and a program for music search means 13A that allows the user to select a music. As the user interface function, for example, in combination with a display input unit provided, it is possible to input and output by laminating a liquid crystal display (LCD) and a touch sensor, and music can be played by the touch sensor corresponding to displayed icons and the like. It is a GUI that can input data such as selection. The host device 15 is omitted in its configuration, but includes at least a customer DB (not shown) for storing information related to registered users. Information of the person ID is included.

  The karaoke main body 12 includes a bus 21, a central control unit 22, a ROM 23, a RAM 24, a music song output unit 25, a reproduction control unit 26, a music DB (song database) 27A, a video DB 27B, a singing scoring means 28, and a scoring information recording unit 29. And transmission / reception units 31 and 32 as appropriate. In this case, the central control unit 22 includes lyrics display control means 30.

  The karaoke main unit 12 includes a video display unit 33, a mixing amplifier 34, a microphone 35, a speaker 36, and a medium reading unit 37 serving as a user ID acquisition unit. The lyric display control means 30, the singing grading means 28, the grading information recording part 29, and the medium reading part 37 which is a user ID acquisition means constitute a lyric telop display control system. The user (customer) possesses the ID medium 51 that stores at least the user ID corresponding to the medium reading unit 37. In addition, even if it is an element part which is not directly related to the summary of this invention about each said structure, in order to show that most can be applied also in the conventional karaoke apparatus, the whole apparatus is demonstrated.

  The central control unit 22 is a physical CPU that performs overall process control of the system, and performs algorithm processing based on a program stored in the ROM 23. The central control unit 22 includes the lyrics display control means 30 (described later) in addition to the overall control processing of the system. The RAM 24 serves as a work area for developing and executing various programs. The RAM 24 is a concept that includes, for example, a semiconductor memory and is virtually built on a hard disk.

  The music tune output unit 25 is an electronic circuit that digitally reproduces performance data extracted from the music DB 27A using music codes, converts the performance data into analog data, and outputs the result to the mixing amplifier 34. The mixing amplifier 34 mixes the singing voice of the singer input from the microphone 35 and the performance data sent from the music tune output unit 25, amplifies it, and outputs it from the speaker 36. Further, the audio signal input from the microphone 35 is input to the singing scoring means 28.

  The playback control unit 26 outputs, to the video display unit 33, the lyrics telop data (lyric character data) of the music data selected and extracted from the music DB 27A in synchronization with the music performance data. Although it is a circuit, the display of the lyrics telop data is controlled by the lyrics display control means 30. Examples of the video display unit 33 include a cathode ray tube (CRT) display, a liquid crystal display (LCD), a plasma display (PDP), and the like.

  The music DB 27A is a database in which music codes are stored as file names for music data (files) configured by synchronizing performance data (MIDI data) and lyrics telop data. The performance data is data that digitally represents the performance of each piece of music, and the lyrics telop data is the lyrics character data of the music synchronized with the performance data. The video DB 27B is a database in which a predetermined number of background videos corresponding to the music to be played are stored as video files corresponding to the music code of the music.

  The singing scoring means 28 has a function of converting an audio signal input from the microphone 35 into a digital signal, and here is a program that performs at least pitch scoring for each singing section on the input singing audio, For this purpose, each program of the pitch determination means 41 and the synchronization determination means 42 is provided and executed by the RAM 24 and also includes reference data 43.

  Here, the reference data 43 is obtained by acquiring, for example, guide melody data included in the music data when the music data of the music to be played is extracted from the music DB 27A and sent to the music music output unit 25. is there. The pitch determination means 41 compares the frequency of the audio signal (converted audio digital signal) input from the microphone 35 with the frequency of the guide melody in the reference data 43, calculates the degree of coincidence (deviation amount), and calculates the predetermined reference. And is executed by the RAM 24. The synchronization determination means 42 determines the synchronization timing of the voice signal (voice digital signal) input from the microphone 35 with the guide melody in the reference data 43, and determines the pitch of the lyrics uttered at the timing. It is a program for scoring by the pitch determination means 41 and is executed by the RAM 24.

  That is, the singing scoring means 28 is based on the pitch of the singing voice signal at the utterance timing determined by the synchronization determination means 42 based on, for example, the reference data 43 of the guide melody for each singing section (phrase) of the corresponding music. Scoring. The pitch scoring information of each singing section is recorded in the scoring information recording unit 29 in association with the user ID for each piece of music, and if the same piece of music already exists for the user ID, the latest information is recorded for each singing section. Update. Here, the singing scoring means 28 compares the pitch (frequency) of the singing voice signal with the reference pitch to determine the amount of deviation, but the object to be compared is not limited to the pitch. Or rhythms may be compared, or a plurality of these elements may be compared.

  The scoring information recording unit 29 shows an example in FIG. 2. When the user sings a predetermined music, the scoring information recording unit 29 stores predetermined scoring information for each singing section in the latest music scored by the singing scoring means 28. A memory (semiconductor memory, hard disk device) to be recorded in association with the acquired user ID. As a recording form of the scoring information recording unit 29, here, a case where the scoring information of the singing scoring means 28 is directly recorded is shown, but the scoring information is recorded in the host device 15 and a predetermined user logs in. Sometimes, it may be downloaded from the host device 15 and stored in the scoring information recording unit 29.

  Further, the lyrics display control means 30 provided in the central control unit 22 refers to the scoring information recording unit 29 when the user sings a predetermined music piece. Information), and for each singing section, in the singing section where the grading information is higher than the preset scoring standard value, the lyrics telop of the singing section is hidden, and in the singing section where the grading value is lower than the scoring standard value This is a program for performing control to display a predetermined portion of the lyrics telop in the singing section (here, all of the lyrics telop in the singing section), and is executed in the RAM 24.

  The transmission / reception unit 31 is used to exchange data with the remote input / output terminal 13 by using a wired system or a wireless system (such as an IR system or a Bluetooth mechanism piconet connection system). Provide a program. The transmission / reception unit 32 is for exchanging data with the host device 15 via the communication network 14, and is configured by software such as a physical communication circuit or a platform for consistency with the communication method. It is what is done.

  The medium reading unit 37 as the user ID acquisition means acquires a user ID from the ID medium 51 possessed by the user in response to a login request to the karaoke apparatus 11 from the ID medium 51 possessed by the user. The acquired user ID is temporarily stored in the RAM 24 and used for access to the scoring information recording unit 29. The ID medium 51 stores at least a user ID and can freely exchange data with the medium reading unit 37, for example, in a non-contact manner. Examples of the ID medium 51 include a non-contact type IC card, an IC card function circuit incorporated in a mobile phone or a small mobile computer.

  Although not shown, the karaoke main unit 12 is also connected to an operation panel in which buttons and knobs for performing various adjustments on the performance music and singing voice are directly connected to an electronic element such as a variable resistor. And a left / right balance, a volume of an output volume from the speaker 36, and the like.

  Here, FIG. 2 shows an explanatory diagram of an example of the scoring information recording unit of FIG. In FIG. 2, the scoring information recording unit 29 includes, for example, the singing scoring means for each singing section (phrase) of the music corresponding to the music (music code) sung by the user for each user ID. 28 is a record of the pitch scored, and the latest score information is recorded for the same music. The scoring information of each singing section (phrase) is a target of whether or not to display the lyrics telop in the singing section.

  That is, if the lyrics are mistaken or forgotten when singing, the pitch or synchronization is empirically obtained. For example, the grading reference value set in the lyrics display control means 30 (for example, 85 points) ) The following phrases are specified, and the display of the lyrics telop of the phrases is controlled.

  FIG. 3 shows a processing flowchart of the lyrics telop display control according to the present invention, and FIG. 4 shows an explanatory diagram of the phrase lyrics telop display in FIG. 3A, first, the medium reading unit 37 acquires the user ID from the ID medium 51 possessed by the user in response to a login request to the karaoke apparatus 11 by the user, and the acquired user ID is Once stored in the RAM 24 (step (S) 1). Therefore, when the music is selected based on the user ID by the user, the scoring information recording unit 29 is referred to based on the user ID acquired by the lyrics control display means 30 (S2).

  If the user ID does not exist as a result of the reference, the process ends (S3). If the user ID exists and the same music (music code) as the music selected by the user does not exist, the process ends (S4). . If the user ID exists (S3) and the same music (music data) as the selected music exists (S4), it is set in advance for each phrase scoring corresponding to the music code column of the user ID. A phrase that is equal to or less than the scoring reference value (for example, 85 points) is specified (S5).

  Therefore, the lyrics display control means 30 starts the lyrics telop display control with the start of the performance of the selected music piece (S11). In the case of a singing section other than the singing section (phrase) specified by the scoring reference value after the performance is started (S12), the lyrics telop of each singing section sent from the music DB 27A is hidden. By sending the display control signal to the reproduction control unit 26, the lyrics telop in the singing section is not displayed (S13).

  This state is represented by a phrase lyrics non-display telop 62 of “...”, For example, as a non-display form of the lyrics telop to be synthesized and displayed on the background video screen 61 displayed in the video display unit 33 of FIG. By expressing the phrase lyrics non-display telop 62, it is possible to grasp the progress of the lyrics as the performance progresses. In addition, it is good also as complete non-display. For example, as shown in FIG. 2 (the user with the user ID “********* 02”), the scoring information recording unit 29 refers to the scoring information for all the singing sections. If it exceeds, the lyrics telop will not be displayed at all, and it is not necessary to represent it with “...”, And it is sufficient to make it completely undisplayed.

  On the other hand, as the performance progresses, if the predetermined singing section (phrase) is the singing section (phrase) specified by the scoring reference value (S12), the corresponding lyrics telop of each singing section sent from the music DB 27A. Is sent to the reproduction control unit 26 to display all the lyrics telops in the singing section (S14). In this state, the lyrics telop is synthesized and displayed as the phrase lyrics full display telop 63 on the background video screen 61 displayed in the video display unit 33 of FIG. By displaying the phrase lyrics all display telop 63, it becomes a support to memorize the lyrics of the singing section in the singer. The lyrics telop display control is continued until the music being played ends (S15).

  In the singing of the music, the singing scoring means 28 performs element total scoring in each singing section. If the user ID does not exist in the scoring information recording unit 29, a new user ID is provided. If there is no music (song code) that is the same as the music selected by (1), a new one is provided and scoring information is recorded in each singing section (phrase) column. On the other hand, when there is the same music (music code) as the user ID and the music selected by the user, the scoring information of each song section is updated to the latest one. That is, the latest scoring information is always recorded in the scoring information recording unit 29.

  Thus, the singing skill by the singer can be objectively determined based on the latest singing information of each singing section in the grading information recording unit 29, and the user can automatically control the display and non-display of the lyrics telop. It is possible to efficiently and effectively support lyric memory for. In addition, even if it is a karaoke apparatus provided with the singing scoring means 28 which performs singing scoring with respect to a pitch or a sound volume, this invention can be applied.

  Next, FIG. 5 shows another configuration explanatory diagram of phrase specification in the lyrics telop display control. FIG. 5A is a block diagram of the singing scoring means 28, and FIG. In FIG. 5 (A), the singing scoring means 28 is provided with a lyrics judging means 44 instead of the pitch judging means 41. In this case, the reference data 43 acquires lyric data (text code data) of the music to be played from the music DB 27A as data of a predetermined phrase unit.

  The lyrics determination means 44 has a function of recognizing a spoken word for each singing section of the input singing voice signal and converting the text code, and for each singing section (phrase) of the corresponding music, reference data 43 of text code data. The speech recognition lyrics scoring is based on the degree of coincidence with the lyric content (character data) of the singing voice signal at the utterance timing determined by the synchronization determination means 42. For example, a score is given by deducting 5 points each time a mistake is made.

  As shown in FIG. 5B, the lyrics scoring information is recorded for each song section (phrase) of the song for each song (song code) sung by the user with the user ID. The same music is recorded as the latest lyrics scoring information. The information of lyric scoring of each singing section (phrase) is a target of whether or not to display the lyrics telop in the singing section.

  That is, when music is selected based on the user ID by the user, the grading information of each phrase is referred to by referring to the scoring information recording unit 29 based on the user ID acquired by the lyrics control display means 30. Specifies a phrase that is equal to or less than a preset scoring reference value (for example, 85 points), and reproduces a display control signal that causes all the lyrics telop in the singing section to be displayed when the specified phrase is played. By sending it to the unit 26, all the lyrics telop in the singing section are displayed.

  Thus, if the singing score of each singing section by the singing scoring means 28 has lyric determination as an element, the lyrics display can be controlled based on the lyric scoring. The singing skill of the singer can be objectively determined based on the grading information of the lyrics, and the lyrics memory for the user is efficiently and effectively supported by automatically controlling the display and non-display of the lyrics telop. It is something that can be done.

  Next, FIG. 6 shows another explanatory diagram of the lyrics telop display in the lyrics telop display control. FIG. 6A is an explanatory diagram of a lyrics telop display state, and FIG. 6B is a flowchart of lyrics telop display control. In this embodiment, when the lyrics display control means 30 displays the lyrics telop in the corresponding song section, it does not display all of the lyrics telop in the song section, but as shown in FIG. 6 (A). Phrase lyrics part display telop 64 shows the number of characters corresponding to the ratio from a part of the lyric telop, for example, the first lyric part (first lyric part) at a ratio corresponding to the lyric score of the grading information recorded in the information recording unit 29. Is displayed. For example, when the lyric score is 0 point, the entire lyrics telop of the phrase is displayed, when it is 50 points, half the head lyrics are displayed, and when it is 75 points, three quarters are displayed from the head lyrics.

  The phrase display / non-display phrase specification in the lyrics display control means 30 is performed by singing information of each singing section scored by the singing scoring means 28 shown in FIG. 1 or the singing scoring means 28 shown in FIG. (FIG. 2 or FIG. 5 (B)) is compared with the set reference value, and the number of characters displayed in the lyrics telop based on the corresponding frame and its grading information is specified.

  That is, in FIG. 6B, the lyric display control means 30 performs the selection on the assumption that the corresponding singing section (phrase) for controlling the display of the lyrics telop and the number of display characters of the lyrics telop based on the scoring information are specified. The lyrics telop display control is started with the start of the performance of the performed music (S21). In the case of a singing section other than the singing section (phrase) specified by the scoring reference value after the performance is started (S22), a playback control unit displays a non-display control signal that hides the lyrics telop in the singing section. 26, the lyrics telop of the singing section is not displayed (S23).

  On the other hand, as the performance progresses, when the predetermined singing section (phrase) is the singing section (phrase) specified by the above scoring reference value (S22), the lyric data in the lyrics telop in the phrase is subjected to lyric scoring. The display control is performed for the number of lyric characters at the ratio (S24). In this state, the lyrics telop is synthesized and displayed as the phrase lyrics part display telop 64 on the background video screen 61 displayed in the video display unit 33 of FIG. The lyrics telop display control is continued until the music being played ends (S25).

  In this way, by displaying only the phrase lyrics part display telop 64 having the number of lyric characters corresponding to the ratio of lyric scoring in the corresponding singing section, it is possible to evoke the reminder of the lyrics in the singing section, and to store the lyrics for the user Can be efficiently and effectively supported.

  The lyrics telop display control system of the karaoke apparatus of the present invention can be used for all karaoke apparatuses having a singing scoring function while displaying the lyrics telop of the performance music.

It is a block diagram of a karaoke apparatus provided with the lyrics telop display control system which concerns on this invention. It is explanatory drawing of an example of the scoring information recording part of FIG. It is a process flowchart of the lyrics telop display control which concerns on this invention. It is explanatory drawing of the phrase lyrics telop display in FIG. It is another structure explanatory drawing of the phrase specification in a lyrics telop display control. It is another explanatory view of the lyrics telop display in the lyrics telop display control.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Karaoke apparatus 12 Karaoke main body 13 Remote input / output terminal 22 Central control part 27A Music DB
28 Singing scoring means 29 Grading information recording section 30 Lyric display control means 33 Video display section 44 Lyric determination means 51 ID medium 61 Background video screen 62 Phrase lyrics non-display telop 63 Phrase lyrics full display telop 64 Phrase lyrics head display telop

Claims (1)

A karaoke apparatus for displaying a lyric telop of a performance music, performing speech recognition on an input singing voice, and singing grading means for scoring at least lyrics for each singing section , and controlling a display form of the lyric telop A lyrics telop display control system,
At least a user ID acquisition means, scoring information recording means and lyrics display control means,
The user ID acquisition means is for acquiring a user ID from an ID medium possessed by the user in response to a login request to the karaoke device by the user,
The scoring information recording means, when the user sings a predetermined music, the scoring information of the lyrics scoring for each singing section of the latest music scored by the singing scoring means, the acquired user ID Is recorded in association with
The lyric display control means obtains the scoring information for each singing section in the music by referring to the scoring information recording means when the user sings a predetermined music, and the scoring information for each singing section. In the singing section that exceeds the preset scoring reference value, the lyrics telop of the singing section is hidden, and in the singing section that is below the scoring reference value, the number of characters in the ratio according to the lyrics scoring information of the singing section Control to display lyrics telop,
A lyrics telop display control system for a karaoke apparatus.

Images