JP2011053345A - Karaoke system including stereoscopic display function of lyric character - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a Karaoke system which shows singing timing to a singer without changing colors of lyric characters according to progress of a performance, and makes persons other than the singer correctly recognize lyric characters. <P>SOLUTION: Two stereoscopic source images with different brightness are set, and viewed by overlapping the two stereoscopic source image, and thus, a stereoscopic image is displayed using a DFD (Depth Fused 3-D) visual illusion. The system includes: a lyrics drawing control means 38a for drawing lyrics character images by obtaining a display timing data of the lyrics character image from a lyrics drawing data which are set for each musical piece; and a display conversion control means 38b in which one lyric character is segmented in order to indicate a singing position by obtaining a singing position data from the lyrics drawing data, and which displays either a singing finished section or a singing unfinished section, as the stereoscopic lyrics image by using the two stereoscopic source images. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a karaoke system capable of displaying lyrics characters three-dimensionally.

  In a karaoke system that is generally popular now, when playing karaoke music, a background image that matches the atmosphere of the music is displayed on the display screen, and lyrics characters are displayed in synchronization with the progress of the performance. Thus, the singing timing is shown to the singer.

  For example, the lyric characters are displayed in blocks for each singing section to be sung, and the color changes as the performance progresses to indicate the singing timing. Singers can easily understand the singing timing by performing the singing according to the color change timing of the lyrics characters, so that the singing fun using the karaoke system can be fully enjoyed. ing.

  By the way, when changing the color of a lyric character to indicate the singing timing, the color of the lyric character string to be sung is different from the color of the already sung lyric character string, so the lyric character displayed on the display screen When looking at the whole, it was sometimes difficult to see the lyrics characters.

  For such inconvenience, a technique has been proposed that can indicate the singing timing without changing the display color of the lyrics characters displayed on the screen of the display (see, for example, Patent Document 1). The technique described in Patent Document 1 includes a storage unit that stores song data including lyric information that specifies a lyric character string and singing position information that specifies a current singing position, and a song stored in the storing unit. The control means for reading and outputting data, and the lyric character string designated by the lyric information included in the music data output by the control means are displayed, and in addition to this, the singing position information included in the music data Display means for displaying a singing position display body representing the current singing position at a designated position. That is, in the technique described in Patent Document 1, as the performance progresses, the singing timing is indicated by displaying an animation or a cursor at the position of the lyric character to be sung.

JP 2000-276182 A

  In the technique described in Patent Document 1 described above, the singing timing can be shown without changing the display color of the lyrics characters displayed on the screen of the display. However, since an animation and a cursor are displayed to indicate the singing timing, these additional displays may be in the way and the lyrics characters may not be recognized accurately. In addition, when an animation or a cursor is displayed in addition to the lyric characters, the area for displaying the background video is reduced accordingly. Therefore, the purpose of the karaoke system is to entertain the background video with the performance and singing of the song, even though the background video that matches the atmosphere of the song has been projected with great difficulty Will be disturbed.

  Furthermore, the audience who becomes the audience not only listens to the song of the singer, but also enjoys a background image that matches the atmosphere of the song. At this time, if the color of the lyric character changes in synchronization with the progress of the performance, the lyric character portion that changes color is particularly noticed. On the other hand, even if the listener does not sing, there is also a desire to use the lyrics when a song he knows is played. In this case, the song is sung not only to the singer but also to the listener. It is necessary to recognize the change in the display mode of the lyrics characters indicating the timing.

  The present invention has been proposed in view of the circumstances described above, and provides a karaoke system capable of showing the singing timing without changing the color of the lyric characters as the performance progresses and accurately recognizing the lyric characters. The purpose is to provide.

  The karaoke system having the three-dimensional display function of lyric characters according to the present invention has the following characteristic points in order to achieve the above-described object. That is, the karaoke system having the three-dimensional display function of the lyric characters of the present invention prepares two three-dimensional source images having different brightnesses for each of the plurality of components of the lyric characters displayed on the display as the karaoke music is played. A karaoke system that allows a lyric character to be displayed as a three-dimensional lyric image using a DFD (Depth-Fused 3-D) illusion phenomenon by superimposing the two three-dimensional source images so that the lyrics can be displayed. A control means and a display conversion control means are provided.

  The lyrics rendering control means obtains the display timing data of the lyrics character image synchronized with the performance from the lyrics rendering data set for each song, and renders the lyrics character image displayed on the display based on the acquired data. It is a means for performing. The display conversion control means acquires singing position data synchronized with the performance from the lyric rendering data, and for each division for indicating the singing position set based on a predetermined division condition in one lyric character It is a means for displaying any one of the singing completed section and the unsung section before and after the singing position as a stereoscopic lyrics image using two stereoscopic source images having different brightness.

  In the karaoke system having the three-dimensional display function of the lyric characters having such a structure, the lyric characters are displayed in synchronization with the progress of the performance by the function of the lyric rendering control means, and the lyric characters are displayed to indicate the singing timing. The display mode is changed. At this time, by the function of the display conversion control means, each division for indicating a singing position set based on a predetermined division condition is controlled to be changed from a planar image to a stereoscopic image, or from a stereoscopic image to a planar surface. Conversion control is performed to obtain an image.

  In addition to the above-described configuration, the karaoke system having the three-dimensional display function of the lyric characters according to the present invention has different brightness as a function of the display conversion control means, except for the section where the three-dimensional lyrics image is displayed. The planar lyrics image can be displayed using only one of the two stereoscopic source images.

  In the karaoke system having such a configuration, when displaying a stereoscopic lyrics image, two stereoscopic source images having different brightness are used, and when displaying a planar lyrics image, any of the two stereoscopic source images is displayed. Use only one of them.

  According to the karaoke system of the present invention, the lyrics timing displayed on the screen of the display as the performance progresses, and the singing timing is displayed without changing the color and without performing a troublesome display such as a cursor or an underline. Can do. Therefore, the singers can be made to recognize the singing timing by image conversion not depending on the color change, while other users (listeners) are bothered by the color change display of the lyric characters, the cursor, the underline, etc. Therefore, it is possible to enjoy the background video together with the performance and singing of the music. Furthermore, since it is possible for not only the singer but also the listener to recognize the change in the display mode of the lyric character indicating the singing timing, it is possible to satisfy the listener's desire to use the lyrics together with the singer. .

  Moreover, by displaying pseudo three-dimensional lyrics characters by 3D animation using CG, an effect similar to that of the present invention can be expected. However, in a karaoke system that currently handles over 100,000 songs, a video creation engineer However, it is necessary to create 3D animations individually for each piece of music, which requires enormous costs and labor, and is not realistic. On the other hand, in the present invention, since three-dimensional lyric characters can be automatically generated using the font data attached to the lyric rendering data for each musical piece and its brightness data, three-dimensional lyric characters are individually prepared for each musical piece in advance. There is no need to do so, and the cost and labor can be greatly reduced.

  In addition, when displaying a stereoscopic lyrics image, two stereoscopic source images are used. When displaying a planar lyrics image, a lyrics image is displayed in a configuration using only one of the two stereoscopic source images. Therefore, it is possible to reduce the labor and cost of creating the source image.

The block diagram which shows schematic structure of the karaoke system which concerns on embodiment of this invention. Explanatory drawing which shows the mode of the display mode change of a lyric character. The flowchart which shows the display procedure of the lyric character which concerns on 1st Embodiment. The flowchart which shows the display procedure of the lyric character which concerns on 2nd Embodiment. Explanatory drawing which shows the display principle of the stereo image by a DFD illusion phenomenon. Explanatory drawing which shows the three-dimensional principle using the component of a lyric character.

<Basic configuration>
Hereinafter, an embodiment of a karaoke system (hereinafter referred to as a karaoke system) having a three-dimensional display function of lyrics characters according to the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a karaoke system according to an embodiment of the present invention.

  As shown in FIG. 1, the karaoke system 10 according to the embodiment of the present invention includes a karaoke main body 21, a karaoke remote control device 22, a microphone 23, a speaker 24, a mixing amplifier 25, and a display device 26.

<Karaoke remote control device>
The karaoke remote control device 22 has a user interface function, and transmits / receives data to / from the transmission / reception means 35 of the karaoke main body 21 by a wired method or a wireless method. The karaoke remote control device 22 includes a storage unit (not shown) including a program functioning as a music search unit 22a, a music index database 22b, an electronic circuit and program for transmitting and receiving data, a flash memory, and the like. A music selection operation or the like is performed by operating switches attached to the karaoke remote controller 22 or various icons displayed on an input / output display unit (not shown).

<Music search means / music index database>
The music search means 22a includes a program for searching for music by referring to the music index database 22b based on a user instruction. The music index database 22b is a database in which attribute information about karaoke music used for performance in the karaoke system 10 is described. For example, the music number, song name, singer name, lyrics of the singing part, trend time, music genre classification -Various attribute information such as whether or not a duet song is included in this.

<Karaoke body>
The karaoke main body 21 is provided with a central control means 31, ROM 32, RAM 33, HDD 34, transmission / reception means 35, reservation management means 36, music reproduction control means 37, and video reproduction control means 38. Control means 38a and display conversion control means 38b are included.

<Central control means>
The central control means 31 is a means for comprehensively controlling the karaoke main body 21 and is composed of, for example, a CPU and its peripheral devices. When the CPU or the like operates according to an application program stored in the ROM 32 or the like, The control function can be demonstrated.

<ROM / RAM>
The ROM 32 is a device for storing application program data and numerical data for controlling each device constituting the karaoke main body 21, and is configured by a semiconductor memory, for example. The RAM 33 functions as a temporary storage area for temporarily storing application programs and various types of data, and is composed of, for example, a semiconductor memory. Note that the virtual RAM 33 may be configured using a hard disk storage device or the like instead of configuring the RAM 33 with a physical semiconductor memory. In the present embodiment, a reservation queue 33 a is stored in the RAM 33.

<HDD>
The HDD 34 functions as a mass storage device, and stores a music database 34a and a video database 34b. Note that a mass storage device such as a DVD capable of rewriting data may be used instead of the HDD 34 or together with the HDD 34.

  The music database 34a is a database that stores music data configured by synchronizing performance data (MIDI (registered trademark) data) and lyrics rendering data in association with music IDs. The performance data is digitized performance data of each musical piece, and the lyric rendering data includes display timing data and singing position data of lyric characters synchronized with the performance. In the present embodiment, the lyric rendering control means 38a acquires lyric display timing data from the lyric rendering data set for each music piece. Further, the singing position data of the lyric characters is acquired from the lyric rendering data set for each music piece by the display conversion control means 38b. The video database 34b is a database that stores a predetermined number of background videos corresponding to karaoke songs to be played as video files corresponding to the song IDs of the karaoke songs.

<Transmitting / receiving means>
The transmission / reception means 35 includes an electronic circuit and a program for transmitting / receiving data between the karaoke main body 21 and the karaoke remote control device 22. In this embodiment, data transmission / reception is performed between the karaoke main body 21 and the karaoke remote control device 22 by infrared communication.

<Reservation management means>
The reservation management means 36 stores the music IDs selected by the user using the function of the music search means 22a and received via the transmission / reception means 35 in the RAM 33 as the performance reservation queue 33a in the music selection order for management. Consists of programs.

<Music playback control means>
The music reproduction control means 37 is an electronic circuit for digitally reproducing the performance data extracted from the music database 34 a based on the music ID and converting it to analog and outputting it to the mixing amplifier 25. The mixing amplifier 25 mixes the singing voice signal of the singer inputted from the microphone 23 and the performance voice signal sent from the music reproduction control means 37, and amplifies the amplified voice signal by the amplifier function to output from the speaker 24. Device.

<Video playback control means>
The video reproduction control means 38, during the performance of the karaoke music, uses the video data extracted from the video database 34b and the lyrics telop data (lyric character data) of the music data extracted from the music database 34a as performance data of the karaoke music. It is an electronic circuit for outputting to the display device 26 in synchronization with. The video reproduction control means 38 includes the functions of lyrics rendering control means 38a and display conversion control means 38b.

<Lyric rendering control means>
The lyric rendering control means 38a acquires the display timing data of the lyric character image synchronized with the performance from the lyric rendering data set for each musical piece, and based on the acquired data, the lyric character image displayed on the display is displayed. Consists of a program for drawing. The lyric rendering control means 38a controls the display of the lyric characters according to the progress of the performance of the karaoke music piece. At this time, the lyric characters are converted from a planar image to a stereoscopic image by the function of the display conversion control means 38b. Alternatively, a stereoscopic image is converted and displayed so as to become a planar image.

<Display conversion control means>
The display conversion control means 38b acquires the singing position data synchronized with the performance from the lyric rendering data, and for each section for indicating the singing position set based on a predetermined division condition in one lyric character, It consists of a program for displaying any one of the sung and unsung sections before and after an arbitrary singing position as a three-dimensional lyrics image using two three-dimensional source images having different brightness.

  In this embodiment, lyric characters are stereoscopically displayed using a stereoscopic image display method using the DFD illusion phenomenon. At this time, the display conversion unit displays a display that matches the stereoscopic image display method using the DFD illusion phenomenon. Based on the conversion control data, conversion control between a planar image and a stereoscopic image is performed. The stereoscopic image display method will be described in detail later.

<Display device>
The display device 26 is a device for displaying video, lyrics telop, and the like at the time of karaoke performance, and is configured by, for example, a liquid crystal display.

<Change display mode of lyrics characters>
FIG. 2 shows how the display mode of lyrics characters is changed. As described above, the lyric characters are displayed in synchronization with the progress of the performance, and in order to indicate the singing timing, each division of the lyric characters divided into a plurality of parts is converted from a planar image into a stereoscopic image. Alternatively, the three-dimensional image is converted into a planar image.

  That is, as shown in FIG. 2, the lyrics characters are divided into a plurality of blocks based on preset division conditions. In the example shown in FIG. 2, the lyric character is divided into five in the left-right direction, which is the direction of changing the display mode. And the lyric character currently displayed as a stereo image is converted into a plane image in an order from the left block according to a singing timing.

That is, in the performance section of the t _1, the left-most block 1 is displayed as a planar image, block 5 is displayed as a stereoscopic image from the block 2. Similarly, shifting to play section of t _2, block 2 from the block 1 is displayed as a planar image, block 5 from the block 3 is displayed as a stereoscopic image. Further, in the performance division at t ₃ , block 1 to block 3 are displayed as a planar image, and block 4 to block 5 are displayed as a stereoscopic image. In this way, in order to indicate the singing timing as the performance progresses, the lyrics characters divided into a plurality of blocks are sequentially converted from a stereoscopic image to a planar image. Note that the lyric characters displayed as a planar image may be sequentially displayed as a stereoscopic image in accordance with the singing timing. Moreover, the division | segmentation conditions of a lyric character may be what, for example, you may divide | segment into two, three, four, five, etc. along the change direction of a display mode, One lyric character may be one block as a whole.

  With reference to FIG.3 and FIG.4, the display procedure of a lyric character image is demonstrated. FIG. 3 is a flowchart showing a procedure for displaying lyrics characters according to the first embodiment, and FIG. 4 is a flowchart showing a procedure for displaying lyrics characters according to the second embodiment.

  In the lyric character display procedure according to the first embodiment, when displaying a three-dimensional lyrics image, a three-dimensional source image for a front liquid crystal display image and a three-dimensional source for a rear liquid crystal display surface, each having a different brightness. When displaying a planar lyrics image using an image, only one of the two three-dimensional source images is used. That is, as shown in FIG. 3, for the unsung segment, lyric characters are displayed using two three-dimensional source images each having different brightness (S1). Thereby, the singer and the listener can recognize the unsung segment of the lyrics characters as a stereoscopic image.

  When the singing position is reached (S2), one of the two three-dimensional source images is erased and lyric characters are displayed (S3). Thereby, a singer and a listener will recognize the singing completion | category of a lyric character as a plane image.

  In the lyric character display procedure according to the second embodiment, when displaying a three-dimensional lyrics image, a three-dimensional source image for a front liquid crystal display image and a three-dimensional source for a rear liquid crystal display surface, each having a different brightness. When displaying a planar lyrics image using an image, a separately prepared planar image is used. That is, as shown in FIG. 4, for the unsung segment, lyric characters are displayed using two three-dimensional source images each having different brightness (S11). Thereby, the singer and the listener can recognize the unsung segment of the lyrics characters as a stereoscopic image.

  When the singing position is reached (S12), the two stereoscopic images are erased and the lyric characters composed of the planar images are displayed (S13). Thereby, a singer and a listener will recognize the singing completion | category of a lyric character as a plane image.

<3D image display method>
There are various methods for displaying a stereoscopic image. In this embodiment, a stereoscopic image display method using a DFD (Depth-Fused 3-D) illusion phenomenon is employed. FIG. 5 is an explanatory diagram of a method of displaying a stereoscopic image by the DFD illusion phenomenon.

  As shown in FIG. 5, the DFD illusion phenomenon is such that two liquid crystal display surfaces are installed so that the depths overlap when viewed from the user viewing the display, and a three-dimensional image to be displayed is displayed on each of the front and rear liquid crystal displays. It is displayed as a projected image that overlaps the surface when viewed from the viewer's position. Then, the luminance ratio of the images respectively displayed on the two liquid crystal display surfaces is changed in correspondence with the depth position of the stereoscopic image to be visually recognized. For example, if the luminance ratio of the image displayed on the front liquid crystal display surface is set high and the luminance ratio of the image displayed on the rear liquid crystal display surface is set low, the user will have an illusion that the stereoscopic image is close to the front. Wake up. On the contrary, if the luminance ratio of the image displayed on the front liquid crystal display surface is set low and the luminance ratio of the image displayed on the rear liquid crystal display surface is set high, the user can make the stereoscopic image closer to the rear surface. Causes an illusion.

  Rather than arranging two liquid crystal display surfaces side by side, the two liquid crystal display surfaces are installed at a predetermined angle, and a half mirror is installed between them to display on each liquid crystal display surface. The images to be displayed may overlap optically when viewed from the user.

  In the present embodiment, the lyric characters are displayed as a stereoscopic image using two liquid crystal display surfaces. In this case, the background image may be displayed using these two liquid crystal display surfaces. However, by preparing another liquid crystal display surface and displaying the background image on this liquid crystal display surface, The background video and the three-dimensional lyrics image may be displayed by overlapping the layers.

  With reference to FIG. 6, the three-dimensional principle using the components of lyric characters will be described. FIG. 6 is an explanatory diagram showing the three-dimensional principle using the constituent elements of the lyrics characters. In order to display lyric characters in a three-dimensional manner using the DFD illusion phenomenon, as shown in FIG. 6, the lyric characters are configured as a three-dimensional source image having a plurality of edges, and each edge has a brightness gradation. Then, by displaying two stereoscopic source images having different brightness gradations as projected images overlapping each other when viewed from the viewer's position on the front and rear liquid crystal display surfaces, the lyrics characters are displayed as stereoscopic lyrics images. Can do.

<Other embodiments>
The devices and means constituting the karaoke system 10 of the present invention and its peripheral devices are not limited to those described above. Depending on the purpose of use, only the necessary devices and means may be configured, or other devices and means may be appropriately included. Can be added. Further, each unit may be configured as a unit in which a plurality of functions are integrated, instead of being configured separately.

DESCRIPTION OF SYMBOLS 10 Karaoke system 21 Karaoke main body 22 Karaoke remote control apparatus 22a Music search means 22b Music index database 23 Microphone 24 Speaker 25 Mixing amplifier 26 Display apparatus 31 Central control means 32 ROM
33 RAM
33a Reservation queue 34 HDD
34a Music database 34b Video database 35 Transmission / reception means 36 Reservation management means 37 Music reproduction control means 38 Video reproduction control means 38a Lyrics rendering control means 38b Display conversion control means

Claims (2)

DFD is prepared by preparing two stereoscopic source images with different brightness for each of a plurality of constituent elements of lyrics characters to be displayed on the display along with the performance of karaoke music, and superimposing the two stereoscopic source images for visual recognition. A karaoke system capable of displaying lyric characters as a stereoscopic lyric image using an illusion phenomenon, comprising lyric rendering control means, and display conversion control means,
The lyric rendering control means acquires lyric character image display timing data synchronized with the performance from the lyric rendering data set for each song, and based on the acquired data, the lyric character image displayed on the display Drawing,
The display conversion control means acquires singing position data synchronized with the performance from the lyric rendering data, and for each section for instructing a singing position set based on a predetermined division condition in one lyric character , Either one of the singed and unsung sections before and after any singing position is displayed as a three-dimensional lyrics image using the two three-dimensional source images,
A karaoke system having a three-dimensional display function of lyrics characters. The display conversion control means displays a planar lyric image using only one of the two stereoscopic source images for a segment other than the segment in which the stereoscopic lyric image is displayed.
The karaoke system having a three-dimensional display function of lyric characters according to claim 1.

Images