JP3453298B2 - Karaoke lyrics display system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke lyrics display system for performing display processing based on lyrics moving image data associated with a karaoke song and lyrics display control data.

[0002]

2. Description of the Related Art A karaoke apparatus includes a lyrics display system for sequentially generating lyrics images in synchronization with the progress of karaoke accompaniment music and displaying the lyrics images on a display. The lyric display system includes lyrics information of the song, the display layout, the display sequence, and the singing timing instruction information in order to instruct the singer the character corresponding to the singing timing in the displayed character string. The drawing data is processed synchronously with the output process of the karaoke accompaniment music, and when the singing start time comes, the color of the corresponding character is gradually wiped from the left end and changed to indicate the singing time.

The lyrics display is not merely performed to confirm the lyrics. It also plays a role in helping the singer follow the song and sing well. The above-mentioned color changing method is effective to some extent in grasping the rough tempo of the music. However, there is a lack of information for guiding the singer to easily follow the flow of the music, such as the delicate singing timing of the lyric character at the time of singing and the timing of the next lyric character. Therefore, if the singer is not accustomed to singing a song, he / she cannot fulfill the role of assisting the singing at all.

In order to solve such a problem, there is a method of displaying a dedicated lyrics moving image containing video contents for assisting singing for each music. This lyrics moving image display system displays a live-action photographed video or animation video as a lyrics video. The lyrics moving image data for generating the lyrics moving image includes an element for displaying the lyrics character string of the corresponding karaoke piece and an element for adding a singing timing to the character string in terms of video content.

[0005]

However, in the conventional lyrics moving image display system, it is necessary to accurately match the lyrics moving image with the performance time series of the music at the stage of creating the lyrics moving image data. That is, the element for instructing the singing timing for a certain lyric character is completed at the time when the singing start timing of the lyric character in the actual performance time series is instructed from the singing end timing. For that purpose, complicated creation / editing work is required, such as creating an image corresponding to the element of the singing timing instruction while adjusting to the performance time series of the music, and partially finely adjusting the speed of the image progression. It takes a huge amount of time and money to create the lyrics video data in this way. Of course, lyrics video data must be created for each song,
It is also not possible to respond quickly to new song releases.

Therefore, the present invention provides a method for generating a lyrics moving image accurately synchronized with a performance time series using lyrics moving image data created inexpensively without considering the performance time series, and a method for creating the lyrics moving image data. It is intended to be provided.

[0007]

The karaoke lyrics display system according to the present invention is specified by the following items (1) to (5). (1) A karaoke lyrics display system that performs display processing based on the lyrics moving image data accompanying the karaoke song and the lyrics display control data. (2) The lyrics moving image data is associated with each one character of the lyrics character string. The ultra short video is continuous (3) The ultra short video is a series of a predetermined number of frames (4) The lyrics display control data is for each character of the lyrics character string. Includes singing start timing data and singing end timing data (5) The display process is to perform ultra short video corresponding to the character from the singing start timing of each character of the lyric character string to the ending time of singing at equal intervals. Allocate frames with and display sequentially

Further, a connecting ultra short moving image may be inserted between the last frame of the ultra short moving image corresponding to a certain lyric character and the first frame of the ultra short moving image corresponding to the character following the character. , A prelude ultra short video is placed in front of the first frame of the ultra short video corresponding to the first lyric text of the karaoke song, or the last ultra short video corresponding to the last lyric text of the karaoke song It is also possible to arrange the ultra short moving images for subsequent performance after the frame and display these ultra short moving images.

Further, the method of creating lyrics moving image data of the present invention has the following requirements (A) to (D). (A) A source video for a certain karaoke song is created by a live-action shooting or animation technique. This source video includes, in terms of video content, an element for displaying a lyrics character string and an element for adding a singing opportunity to the character string. (B) Each one character of the lyrics character string is decomposed into video parts corresponding to the video contents to which a singing timing is added. (C) For each video part corresponding to each character, an editing operation is performed by appropriately thinning out or overlapping the frames to configure each video part with a predetermined number of frames. (D) The source video composed of the series of edited video parts is converted into image data of an appropriate format and is associated with the corresponding karaoke song to obtain lyrics video data.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION === Basic Structure and Operation of Karaoke Device === FIG. 1 is a block diagram of an embodiment of a karaoke device adopting a singing timing instruction system according to the present invention. C inside
A central control unit 11 including a PU, a RAM, and a ROM controls the karaoke apparatus 1 by performing data communication and various controls with respect to respective peripheral components via a data bus 100 and a control bus 110.

The hard disk device 12 stores many pieces of karaoke data for generating accompaniment music and lyric images of karaoke music. The karaoke data includes music data for generating accompaniment music such as MIDI data, and lyrics depiction including various information such as lyrics character strings, display layout, display sequence, and singing time instruction (singing start timing data and singing end timing data). Data and.

When the central control unit 11 receives a request input from the remote control transmitter 17 or the operation panel 18 via the operation control unit 19, it sequentially processes the corresponding karaoke data according to the request input order. That is, the karaoke data corresponding to the requested song is retrieved from the hard disk device 12, the accompaniment music generation data is transferred to the synthesizer 13, and the accompaniment music is generated. This accompaniment music is mixed with the microphone 15 by the amplifier 14.
It is mixed with the singing voice input more and is output to the speaker 16.

The lyrics rendering data in the karaoke data is processed in one of the following two modes. One of them is a mode corresponding to normal processing, in which the lyrics depiction data is transferred to the video RAM 20 in synchronization with the accompaniment music generation processing, and the lyrics image is sequentially developed into a bitmap. The image controller 21 displays the lyrics image on the video CD changer 22.
It is superimposed on the background image output from and output to the display 23.

The other mode is a mode in which the lyrics rendering data is used as control data for lyrics moving image data prepared exclusively for each music piece. In this mode, the lyrics video is displayed in place of the lyrics image. This lyrics moving image display function can inform the singer of the delicate pronunciation timing of the lyric characters at the time of singing, or the intonation of the music, thereby strongly assisting the singer. The lyrics moving image display function will be described below.

=== Lyrics video display system === <Video content and structure of lyrics video data> The lyrics video data for generating the lyrics video dedicated to each song is associated with the corresponding karaoke song on a DVD. -Stored in ROM. By storing a plurality of DVD-ROMs in the DVD-ROM changer 30, a database corresponding to the lyrics moving image data for many songs is constructed.

The lyrics moving image data includes, in terms of video content, an element for displaying a lyrics character string of a corresponding music piece and an element for adding a singing opportunity to the character string. FIG. 2 shows, as an example, the visual contents of the lyrics moving image data in a certain music piece. Lyrics string 51 written on the whiteboard 50
Is an element for displaying a lyric character string, and an operation in which the person 52 in the video sequentially points each lyric character of the lyric character string 51 in accordance with a performance time series corresponds to an element for adding a singing timing instruction.

Here, the method of creating the lyrics moving image data and the structure thereof will be described with reference to FIG. 2 as an example. First, a person 52 is in front of the whiteboard 50 on which the lyrics character string 51 of the first page is written. Create a video that shows each lyric character in order by taking a live-action photo or animation. At this time,
The speed and timing of the operation of pointing each lyric character are appropriate. Therefore, the person 52 need only mechanically point the lyrics characters in order. Of course, it does not match the performance time series of the music. When the last lyric character of this lyric character string has been specified, an image is created for the lyric character string of the second page, starting from the first character as in the first page.

In this way, when all the lyric characters are sequentially displayed page by page and an image for instructing an operation for each character can be created, still image data for all frames included in this all image is created. To generate. In this embodiment, one frame of the NTSC standard is set as one frame, and a video signal corresponding to each frame is sampled and compression-coded into one image data of JPEG format.

Next, each frame is divided according to the action of pointing each character of the lyrics. That is, from the frame that starts the instructing operation for a certain lyric character to the frame immediately before the frame that starts the instructing operation for the next lyric character is classified as the instructing operation for that character. If you can divide the instruction actions for each lyric character, you can thin out the middle frames,
The number of frames included in each segment is made constant by overlapping the same frames. In this embodiment, the number of frames is 10.

The moving picture in which the images of 10 frames are consecutive is made into an ultra short moving picture, and one character of the corresponding lyrics is associated with each ultra short moving picture. As the correspondence, the first character of all the lyrics characters is set to 1 and the numbers are sequentially assigned to identify one specific lyrics character.

Further, the ultra short animations are arranged in the order of performance time series of the corresponding music pieces, and the identification code of the corresponding music pieces is attached to the lyrics moving picture data for each music piece. It should be noted that each still image data is provided with an appropriate identification code in order to identify what number frame of the ultra short moving image it is. Next, the control for processing the lyrics moving image data and displaying the lyrics moving image synchronized with the performance output will be described.

<Processing of lyrics moving image data> Central control unit 11
If the lyrics moving image data is prepared for the requested music, the lyrics music data is processed as karaoke data of this music in addition to the music data and the lyrics rendering data. At this time, the lyrics rendering data is used as lyrics moving image control data for processing the lyrics moving image data in synchronization with the performance time series. If the lyrics music is not prepared for the requested song, the lyrics rendering data is processed and the lyrics image is displayed in the normal mode. Further, whether or not the lyrics music data is prepared for the requested music is added to the music data or the like by a code indicating that, or a comparison table indicating whether or not the lyrics music is present for each music is prepared. This can be confirmed.

FIG. 3 shows a schematic structure of the lyrics drawing data. The order of the lyric characters and the singing start timing data and singing end timing data for each character are described. When the central control unit 11 starts the performance process of the music piece,
The D-ROM changer 30 is controlled to drive the corresponding lyrics moving image data (still image data for all frames) to an appropriate DVD-.
It is taken out of the ROM and transferred / stored in the internal RAM.
Then, the signal input of the video control unit 21 is switched to the lyrics moving image video RAM 31 side. Furthermore, for each lyric character of the lyrics rendering data, the time from the singing start time to the singing end time is calculated by dividing the time by 10, and this time is calculated for each frame included in the ultra short animation corresponding to each lyric character. Set as the display time of.

When the performance process is started, the JPEG data corresponding to the first frame of the lyrics moving image data is decoded and the still image is bit-mapped in the lyrics moving image video RAM 31. This still image is displayed on the display 23 via the video control unit 21.

When the first character in the lyrics depiction data reaches the beginning of singing, a still image corresponding to each frame of the ultra short moving image corresponding to this character is sequentially developed in the lyrics moving image video RAM 31. At this time, the video RAM3 for lyrics animation
The cycle of updating the still image data in 1 follows the previously set display time. When the display of the last frame of the ultra short image corresponding to this lyric character is completed, the ultra short moving image corresponding to the next lyric character is similarly developed in the lyrics moving image video RAM 31 for each set display time.

In this embodiment, at the time of an interlude between the first and second songs, etc., the first character of the second character starts singing the last frame of the ultra short animation corresponding to the last character of the first song. It is displayed until the time comes.

In this way, a series of lyrics moving images are displayed by continuously generating images of each frame of each ultra short moving image. The singing timing instruction for each character is expressed by images of 10 consecutive frames of the corresponding ultra-short movie.

=== Others === In the above embodiment, the number of frames of each ultra short moving image is set to 10, but it is not limited to this. Further, the visual content of the lyrics moving image can be expressed in various ways, such as the animation character moving along the lyrics characters to instruct the singing occasion. Of course, it is possible to freely express the pitch of the accompaniment sound corresponding to the character designated as an element of the singing time instruction, the time interval with the next accompaniment sound, or the volume. This makes it possible to convey the intonation of the music to the singer.

When the lyrics moving image data is created from an animation image, for example, it is possible to create the singing timing instruction operation for each lyrics character in advance with a predetermined number of frames. By using computer graphics (CG) technology, it is possible to directly generate a lyrics moving image from the lyrics rendering data. For example, a lyric character string is generated, a character layout assigned to each lyric character in the lyric character string and the time of a singing time are acquired, and the CG-generated character is used as a frame of an ultra-short movie preset for each lyric character. Automatically generate an animation that moves while performing an appropriate action with a number.

In the above embodiment, during the interlude of music, the image corresponding to the frame immediately before entering the interlude is continuously displayed, but a short moving picture for connecting is inserted between this frame and the first frame after the interlude. May be displayed. The data of this ultra short video for connecting may be inserted in the lyrics video data,
You may prepare it separately. In this case, the number of frames included in the connecting ultra short moving image data is made constant, or data indicating the number of frames is added to the image data of the first frame of the connecting ultra short moving image. Then, each frame is sequentially displayed at a display time obtained by dividing the time from the ending time of singing the last character before the interlude to the starting time of singing the first character after the interlude by this number of frames.

Of course, an ultra short animation for connecting can be inserted between the lyric characters with a long interval, or an ultra short animation for prelude can be displayed in front of the singing start time of the first lyric character of the music. It is also possible to arrange and display the afterplay ultra short video after the end of the singing of the last lyric character of the music.

In the above embodiment, the lyrics moving image data is composed of a large number of still image data, but it may be moving image data of MPEG format or the like. Then, each frame of the moving image may be controlled to be displayed as one frame.

The image of each frame of the lyrics moving image need not be displayed on the entire screen of the display. The image from the video CD changer may be used as a background and replaced with a normal lyrics image to be superimposed and displayed.

[0034]

[Effects of the Invention] By making ultra short animation videos containing a fixed number of frames for each lyric character to create lyrics animation dedicated to each song, lyrics display that makes it easy for the singer to follow the song is achieved with simple control. be able to. Moreover, since the lyrics moving image is created for each music piece, the intonation of the music piece can be sufficiently expressed, and it is possible to lead to a better singing.

By preparing an ultra-short movie for the interlude, prelude or postlude of the music, the video of the content that can accurately instruct the singing timing of the first character after the interlude or after the prelude or after the singing is performed It is possible to display an image so that you can enjoy the lingering sound until the end.

The lyrics moving image data can be created by simply editing an appropriately created video such as shooting or animation so that the ultra short moving image for each lyrics character becomes a fixed number of frames, and is made to match the performance time series. You don't have to create lyrics videos. Therefore, the time and cost required to create the lyrics video can be significantly reduced. You can quickly respond to the addition of new songs.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a karaoke device adopting a lyrics moving image display system of the present invention.

FIG. 2 is a schematic diagram of image contents of a lyrics moving image displayed on the karaoke device.

FIG. 3 is a schematic structural diagram of lyrics rendering data processed by the karaoke apparatus.

[Explanation of symbols]

1 Karaoke device 11 Central control unit 21 Video control unit 30 DVD-ROM changer Video RAM for 31 lyrics videos

Claims (4)

(57) [Claims] 1. A karaoke lyrics display system for performing display processing based on lyrics moving image data associated with a karaoke song and lyrics display control data, wherein the lyrics moving image data is associated with each one character of a lyrics character string. The ultra short video is a series of ultra short videos, and the ultra short video is a series of a predetermined number of frames. The lyrics display control data is singing start timing data and singing data for each one character of the lyrics character string. Including the ending timing data, the display process is a karaoke that sequentially displays the ultra-short movie corresponding to the character from the beginning of the singing to the ending of the singing of each character in the lyric character string by allocating frames at equal intervals. Lyrics display system. 2. The lyrics moving image data includes an ultra short moving image of content for instructing one character, and an ultra short moving image for connection arranged between the following ultra short moving image of content for instructing one character. The karaoke lyrics display system according to claim 1, wherein the process displays the connecting ultra short moving image from the time when the preceding one character is singing to the time when the following one character is singing. 3. The karaoke according to claim 1 or 2, wherein the lyrics moving image data includes a prelude ultra short animation, and the display process displays the prelude ultra short animation by the time when the singing of the first character of the lyrics starts. Lyrics display system. 4. The lyrics moving image data includes an ultra short short animation for the subsequent performance, and the display process displays the ultra short short animation for the subsequent performance after the ending time of singing the last character of the lyrics. The karaoke lyrics display system according to any one of 3 above.