JP2003271158A - Karaoke device having image changing function and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a karaoke device and a program capable of changing an image and switching images on the basis of karaoke data information or the like by pasting an image designated by a user to a three-dimensional character and a background part. <P>SOLUTION: This invention described in a claim 1 is provided with a moving picture reproducing means for reproducing a moving picture according to karaoke data needed to reproduce karaoke, and a moving picture controlling means for sequentially changing the moving picture reproduced by the moving picture reproducing means by controlling the moving picture reproducing means according to attribute data included in the karaoke data and changing time sequentially in reproducing the karaoke. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention reproduces a moving image based on karaoke data or a microphone input level.
The present invention relates to a karaoke device and a karaoke program having a moving picture reproducing means and a moving picture control means.

[0002]

2. Description of the Related Art Songs such as songs and pops (accompaniment part)
A karaoke device that reproduces the background image and displays a background image dedicated to the reproduced music is generally known. Such a karaoke device is, for example, a VCD (Video CD) or L
It has a storage device using a D (Laser Disc) or the like, and this storage device stores and holds audio data for reproducing music, image data for displaying background images and lyrics. Here, the voice data is, for example, PCM voice data, and the image data is data formed by synthesizing lyrics with a photographed scene. Then, this karaoke device reads out audio data from the storage device and reproduces the music, and at the same time, reads out image data from the storage device and displays a background image.

In recent years, a so-called communication karaoke device, which has a communication function in a karaoke device and transmits voice data and lyrics data for reproducing music through a telephone line or the like, has become widespread.

In such a communication karaoke apparatus, the number of reproducible tunes is not limited by the storage capacity of the storage device because the voice data for replaying the tunes is received via the telephone line. Therefore, a huge amount of music can be reproduced. Even if the latest music needs to be reproduced, the latest music can be reproduced by receiving the voice data of the music via the telephone line.

In addition, in such a communication karaoke device, there is known one which displays a three-dimensional character and a background based on karaoke data.

[0006]

In these karaoke apparatuses, a fixed image (texture) is used as a three-dimensional character or a background, and these are used as a karaoke image. Therefore, 3 displayed on the karaoke device
Since the fixed texture is used for the three-dimensional character and the background, there is no change in the expression of the character,
Moreover, since the background is unchanged, there is a problem that it is not interesting.

Therefore, in the present invention, an image designated by the user is pasted on a three-dimensional character or a part of the background, and the image can be changed or the image can be switched based on the information of the karaoke data. The purpose is to provide a device and a program.

[0008]

In order to solve the above problems, the invention according to claim 1 includes a moving picture reproducing means for reproducing a moving picture according to karaoke data necessary for reproducing karaoke, and the karaoke data is included in the moving picture reproducing means. And a moving picture control means for sequentially changing the moving picture reproduced by the moving picture reproducing means by controlling the moving picture reproducing means at the time of reproducing the karaoke according to the time-sequentially changing attribute data.

According to the present invention, the reproduced karaoke image can be changed by the time-sequentially changing attribute data included in the karaoke data. I can now hold it. Also, the background stage can be changed so that the enjoyment of karaoke can be further improved.

In order to solve the above-mentioned problems, the moving picture control means according to claim 2 changes the moving picture by the moving picture reproducing means into the pronunciation of the lyrics indicated by the telop data based on the telop data as the attribute data. It is characterized by changing according to.

In this case, since it is possible to change the character and the background stage in synchronization with the pronunciation of the telop (lyric) data, the character and the background stage are matched to the music being played. It became possible to change like that.

In order to solve the above-mentioned problems, the moving picture control means according to a third aspect of the present invention uses a vowel included in the character data as the attribute data to generate a moving picture by the moving picture reproducing means according to the vowel. It is characterized by changing.

In this case, the character and the background stage can be changed in synchronization with the vowels of the telop (lyric) data, so that the character and the background stage are matched to the music being played. It became possible to change like that.

In order to solve the above-mentioned problems, the moving picture control means according to a fourth aspect of the present invention uses the vowels included in the character data as the attribute data to detect the mouth of the character in the moving picture by the moving picture reproducing means. The operation is changed according to the vowel.

Since it has become possible to change the shape of the character's mouth in synchronization with the vowels of the telop (lyric) data, it is possible to make the character sing a song that is being played. I can do it now.

In order to solve the above-mentioned problems, the moving picture control means according to claim 5 is based on the time signature data as the attribute data, and the time signature of the musical piece indicated by the time signature data of the moving picture by the moving picture reproducing means. It is characterized by changing according to.

In this case, since the character and the background stage can be changed in synchronization with the time signature indicated by the time signature data, whether the character and the background stage match the music being played. It became possible to change like.

In order to solve the above-mentioned problems, the moving picture control means according to claim 6 develops a music piece represented by the developed data into a moving picture by the moving picture reproducing means based on the developed data as the attribute data. It is characterized by changing according to.

In this case, it is possible to change the action of the character or the background stage suitable for each of the intro portion, the chorus portion, the ending portion, etc. of the music which is the expansion data of the attribute data. Now that you can do it, you can further improve the enjoyment of karaoke.

In order to solve the above-mentioned problems, a karaoke apparatus according to a seventh aspect of the present invention is a karaoke apparatus, wherein a moving picture reproducing means for reproducing a moving picture in accordance with karaoke data necessary for reproducing karaoke, and a karaoke reproducing apparatus are sequentially input through a microphone. And a moving picture control means for sequentially changing the moving picture reproduced by the moving picture reproducing means by controlling the moving picture reproducing means according to the input data.

In this case, the shape of the character can be changed according to the information input to the microphone of the person singing the song, so that the character corresponds to the song being played. Now I can express my feelings and sing as if I was singing.

In order to solve the above-mentioned problems, in the karaoke apparatus according to the eighth aspect, the moving picture control means, based on the volume information as the input data, displays the moving picture in the moving picture reproduced by the moving picture reproducing means. It is characterized in that the motion of the character's mouth is changed according to the volume information.

In this case, since the shape of the character's mouth can be changed according to the volume level input to the microphone of the person singing the song, the character's mouth shape can be changed when the volume level is high. By making the mouth correspond to a screen with a wide open mouth, and when the volume level is low, the character's mouth corresponds to a screen with a small open mouth so that the character expresses emotion in the song being played and sings. I was able to do it.

In order to solve the above-mentioned problems, a karaoke apparatus according to a ninth aspect of the invention is provided with an image creating means for creating a moving picture by pasting a previously created image, and the moving picture control means is provided with the pasting. The feature is that the attached images are changed sequentially.

In this case, an image of a character or a digital camera photographed as a background stage can be used. Therefore, it is possible to further improve the enjoyment of karaoke.

In order to solve the above-mentioned problems, a tenth aspect of the present invention is provided.
The karaoke apparatus described in (1) above is provided with image selection means for selecting one of a plurality of images prepared in advance as a part of the moving image.

In this case, an image of a character or a digital camera taken as a background stage can be used, and the taken image or an image of an advertisement prepared in advance can be played. It became possible to change the song in the middle. Therefore, it is possible to further improve the enjoyment of karaoke.

In order to solve the above-mentioned problems, the invention according to claim 11
The program described in (3) is a moving picture reproducing function for reproducing a moving picture according to karaoke data necessary for reproducing karaoke on a computer, and the moving picture reproducing function at the time of reproducing karaoke according to time-sequentially changing attribute data included in the karaoke data. The video control function that sequentially changes the video played back by the video playback function by controlling the
It is characterized by realizing.

In this case, since the karaoke reproduction image can be changed by the time-series attribute data included in the karaoke data, the character used in the karaoke can have expression such as a facial expression. I was able to do it. Also, the background stage can be changed, and the enjoyment of karaoke can be further improved.

In order to solve the above problems, a twelfth aspect of the present invention is provided.
The program described in (1) is a moving picture reproducing function for reproducing a moving picture according to karaoke data necessary for reproducing karaoke on a computer, and the moving picture reproducing function at the time of reproducing karaoke according to time-sequential attribute data included in the karaoke data. The video control function that sequentially changes the video played back by the video playback function by controlling the
It is characterized by realizing.

In this case, since the shape of the character can be changed in accordance with the information input to the microphone of the person singing the song, the character corresponds to the song being played at all. Now I can express my feelings and sing as if I was singing.

[0032]

BEST MODE FOR CARRYING OUT THE INVENTION First Embodiment Hereinafter, a first embodiment of the karaoke apparatus according to the present invention will be described. This embodiment is an embodiment of a karaoke device mainly used for business.

FIG. 1 is a block diagram showing the configuration of the karaoke apparatus of this embodiment.

The karaoke apparatus of this embodiment has a controller 1
, A memory unit 2, a display 3, a voice output unit 4,
It includes a speaker 5, a microphone input unit 6, a microphone 7, an input unit 8 and an external interface 9.

The memory section 2 is a section for storing in advance image data prepared by the user and images and sounds necessary for karaoke performance. The display 3 displays a character that is a karaoke image and a background. It is also used as a display device used when the user selects a song or an image. The microphone 7 transmits a voice uttered by the user to the microphone input unit 6. The speaker 5 outputs the sound of the song to be played and the voice input from the microphone 7 to the outside via the voice output unit 4. The input unit 8 is a keyboard or a remote control device for a user to select a song or an image from a menu displayed on the display 3, and a hard disk device or a floppy disk device for taking in a new image from the outside. The external interface unit 9 is a unit that captures video data and audio data required for karaoke from the external computer 10. The control unit 1 is a CP that performs overall control
A device such as U. The control unit 1 acquires images and sounds required for karaoke performance from the memory unit 2, reproduces a moving image on the display 3, and sends sounds to the sound output unit 4. The control unit 1 also exchanges information with the user via the input unit 8 and performs necessary processing. Further control unit 1
Via the external interface unit 9, acquires the video data and audio data necessary for the karaoke selected by the user from the external computer 10, and acquires the image selected by the user from the memory unit 2. After that, the moving image is sequentially changed according to the information indicating the time-series change included in the karaoke information, and the moving image is displayed on the display 3.

FIG. 2 is a block diagram showing the processing of the karaoke apparatus of this embodiment. Image data storage unit 1
01, character data and background stage data storage unit 104, karaoke data storage unit 107, and song information data storage unit 105 correspond to the memory unit 2 in FIG. The user interface unit 102 corresponds to the input unit 8 in FIG. Image data processing unit 103, character / stage selection unit 106, performance processing unit 110, attribute information extraction unit 1
09 and the microphone input level detection unit 108 correspond to the control unit 1 in FIG.

The image data storage section 101 is a section for storing in advance image data prepared by the user.
The user interface unit 102 uses the image data 101.
Is an interface section in which the user selects a character, a background stage, etc., and specifies an image to be captured. In the image data processing unit 103, of the images captured by the user interface unit 102, for example, when the captured image is the face of a character,
The character's face is fitted into a predesignated frame, and the user specifies the positions of the eyes, mouth, nose, and cheeks of the fitted image via the input unit 8, or the image data processing unit. 103 is automatically assigned. In addition, the user designates the image captured from the user interface unit 102 as the face or body of the character and as the background stage data by the user via the input unit 8. The character data and background stage data storage unit 104 is a unit that stores the data processed by the image data processing unit 103 as character data and background stage data. The song information data storage unit 105 stores the genres (for example, pops, enka, slow tempo, etc.) of songs played as karaoke. The character / stage selecting unit 106 transfers information about a song to be played from the song information data storage unit 105, and automatically selects optimum data from the character data and background stage data storage unit 104 according to the song information. Also,
It is also possible for the user to select and change the image displayed on the display 3 using the input unit 8.

The karaoke data storage unit 107 stores karaoke data, which is song development data (song information data, melody volume data, time base, schedule table, etc. shown in FIG. 3), MIDI data (MIDI sound source data), and telop. (Lyrics) data (telop control table, text data for lyrics, hiragana data for lips, etc. shown in FIG. 4) and MPEG data (MPEG data number, MPEG chorus data, etc.) are stored.

The microphone input level detector 108 detects the volume of the user's voice as digital data.
In the attribute information extraction unit 109, the karaoke data storage unit 10
7, necessary information is extracted from the music development data shown in FIG. 3, MIDI data, telop data shown in FIG. 4, and MPEG data. Also, the microphone input level detection unit 108
The volume level is extracted from the data input from. In the performance processing section 110, based on the attribute data extracted from the attribute information extracting section 109, the character and the background stage data displayed on the display 3 are changed and displayed, that is, operated, and a voice is output to the voice output section 3. . Here, the attribute data is telop data (Fig. 3)
, Time data (not shown), and tempo data (FIG. 3)
, A voice level input to the microphone, an intro start portion, a song number start / end portion, and a final (ending) start / end portion (FIG. 3).

FIG. 3 shows the content of the music development data which is karaoke data. The song development data includes song information data, melody volume data, time base data, and a schedule table.

FIG. 4 shows the contents of telop data (lyric data) which is karaoke data. The telop data includes a telop control table, text data for lyrics, and hiragana data for lip-sync.

Next, a process of changing the motion of the character displayed on the display 3 based on the attribute data will be described with reference to FIGS.

FIG. 5 illustrates the motion of the character based on the telop data of the karaoke data. That is,
The shape of the character's mouth displayed on the display 3 is changed in synchronization with the color change timing of the telop (lyrics) displayed on the display 3 (so-called lip-sync).
Then, it is displayed as if the character is singing the song being played.

Further details will be described with reference to FIG. In step S1, karaoke data required for karaoke performance is extracted from the karaoke data storage unit 107. In step S2, the telop (character) data and time data (not shown) shown in FIG. 3 are acquired from the attribute data extracted from the attribute information extraction unit 109, and the performance of the color change timing of vowel data and character data for each character is started. And is stored as a time data from the memory unit. In step S3, character data and background stage data necessary for performance are stored in the character data and background stage data storage unit 1.
Select from 04. In step S4, data for karaoke performance is stored in the memory based on the karaoke data extracted in step S1. In step S5,
The voice of karaoke is output from the speaker, and the character, the background stage, and the telop are displayed on the display 3.
In step S6, the performance time is calculated by the performance processing unit 110.
The color change timing time for each character stored in the memory is compared. If the current performance time and the color change timing time are equal, the process proceeds to step S7, and if they are not equal, the process proceeds to step S8. In step S7, the performance processing unit 110 changes the mouth of the character into a shape corresponding to the vowel data and outputs it to the display 3.

A method for extracting vowels and a method for determining the timing for changing the mouth of the character will be described with reference to FIGS.

First, FIG. 9 shows a method of creating a vowel table (a, i, u, e, o) for hiragana gojyuon from telop data. The telop data “Love and PEACE” is taken as an example. In this case, the telop data "Love and PEACE" is represented by the shift JIS code shown in FIG. 9 for each character. The telop data also includes hiragana data in advance. Usually, this hiragana data is used in furigana (called "ruby"). This ruby data is used as the hiragana data for the lip-sync. Corresponding vowels are extracted from the hiragana data for this lip-sync as the vowel data in FIG. The shape of the character's mouth is changed in correspondence with a, i, u, e, o of this vowel data (not shown).
That is, the shape of the character's mouth in the case of vowel data a,
Shape of character's mouth for vowel data i, shape of character's mouth for vowel data u, and vowel data e
The shape of the character's mouth in case of and the shape of the character's mouth in case of vowel data o are made different. In this case, according to the color change start time of each character,
The shape of the character may be changed, but the character "love" needs to be specially processed because it has two vowels.

FIG. 10 shows the display width of the text of the telop data “love” displayed on the display and the display of the hiragana data “ai” for the lipstick displayed together. When the character width of "love" is set to 48 dots, the hiragana data "a" and "i" for the lip-sync are each assigned 24 dots which is half the character width of the character of "love". The color of this lipstick data changes while the song is playing, while it is displayed on the display.
There is no timing in the telop data to change from "i" to "i". Therefore, a method for obtaining the timing at which this "A" changes to "I" by using the karaoke data in the telop data will be described below.

11 and 12 show the relationship between the color change start times t1, t2, t3 and the color change widths x1, x2, x3 in the telop data shown in FIG. When the time t1 has elapsed from the start of the music being played, the display color of the portion corresponding to the x1 width of the lyrics data "love" shown in FIG. 11 and the hiragana data for hiragana "A" shown in FIG. 12 changes.
Next, when t2 time has passed from the start of the song being played,
Lyrics data “love” and Hiragana data for mouth-tapping “a”
The display color of the portion corresponding to the x2 width of is changed to the same color as the x1 display color. Furthermore, from the start of the song being played, t3
As time passes, the display color of the portion corresponding to the width x3 of the lyrics data “love” and the hiragana data for lip-sync “a” is x1.
It changes to the same color as the display color. In this way, along with the performance of the song, the telop data "love" and "ai"
The display color of the character changes. However, in the present embodiment, since the shape of the mouth of the character is changed according to the change of the vowel, when t1 time elapses and t4 time elapses from the start of the song being played in FIG. Need to be detected. That is, from the beginning of the performance,
After the lapse of t1 time, the mouth shape of the character corresponding to the vowel of "a" is displayed, and after the lapse of t4 time, "i".
The mouth shape of the character corresponding to the vowel is displayed.
Although t1 is stored in advance as telop data, t4 needs to be calculated. The calculation method for that is described below. Although x1 is a color change width, its unit corresponds to the number of dots which is a unit on the display. As shown in FIG. 10, the lyrics data width is 48 dots, and the hiragana data width for lip-sync is represented by 24 dots, which is half that width. Therefore, the time corresponding to t4 is t
It can be seen that the time T5 has elapsed from the time corresponding to 2. This T5 is (24-x1) x (t3-t
2) / x2 --- (1) Therefore, t
After the time of 2 has elapsed, the mouth shape of the character corresponding to the vowel of "a" is changed to the mouth shape of the character corresponding to the vowel of "i" at the time when the time calculated by the equation (1) has elapsed. Change.

In this way, kanji, hiragana, katakana,
Extracting vowels from telop data corresponding to Roman characters and changing the mouth shape of the character when the timing corresponding to the vowel changes, thereby changing the mouth as if the character were singing the song. Is possible.

The processing of FIG. 5 further continues, and in step S8, it is determined whether or not the karaoke performance is continued.
If the performance is further continued, the process returns to step S5. If the performance of karaoke is not continued, the performance of karaoke is ended in step S9. -Second Embodiment- Hereinafter, a second embodiment of the karaoke apparatus according to the present invention will be described. A description of the same components as those in the first embodiment will be omitted.

FIG. 6 explains the motion of the character based on the time signature data of the karaoke data. Step S11
Then, karaoke data required for karaoke performance is extracted from the karaoke data storage unit 107. In step S12, the tempo data in the schedule table in the music development data of FIG. 3 is extracted. Since the tempo data is based on the length of a quarter note, a time interval that is an integral multiple N of this corresponds to the so-called start time of the beat, and this time interval is stored in the memory as the performance start time. In step S13, character data and background stage data required for performance are selected from the character data and background stage data storage unit 104. Step S14
Then, the karaoke performance is started based on the karaoke data extracted in step S11. Step S15
At, the karaoke voice is output from the speaker and the character, the background stage, and the telop are displayed on the display. In step S16, the arithmetic processing unit 110 compares the playing time with the start time of the beat stored in the memory. If they are equal, the process proceeds to step S17. If they are not equal, the process proceeds to step S18. In step S17, the arithmetic processing unit 110 changes the character and the background stage every time the time passes and displays the character and the background stage on the display. That is, if the shape of the character is changed after N times the quarter note, the character can be displayed as if it were dancing in time. Also, the background stage can be changed and displayed on the display. In step S18, it is determined whether the karaoke performance is continued. If the performance is further continued, the process returns to step S15, and if the performance of karaoke is not continued, the process is step S19.
Ends the performance at. -Third Embodiment- Hereinafter, a third embodiment of the karaoke apparatus according to the present invention will be described. A description of the same components as those in the first embodiment will be omitted.

FIG. 7 illustrates the motion of the character based on the microphone input level. In step S21, karaoke data required for karaoke performance is extracted from the karaoke data storage unit 107. In step S22, character data and background stage data required for performance are selected from the character data and background stage data storage unit 104. In step S23, karaoke is started based on the karaoke data extracted in step S21. In step S24, the voice of karaoke is output from the speaker, and the character, background stage, and telop are displayed on the display. In step S25, the microphone input level detection unit 108 detects the level of the voice input to the microphone. In step S26, the arithmetic processing unit 110
At, processing for changing the mouth of the character to a shape corresponding to the level of the voice input to the microphone is displayed on the display. That is, when the input level of the microphone is high, it corresponds to the shape of the character's mouth wide open, and when the input level of the microphone is low, it corresponds to the shape of the character's mouth open wide. Therefore,
A user singing in tune with the song being played can make the character's mouth grow louder or softer depending on the volume of the user's voice. It feels like something.
In step S27, it is determined whether the karaoke performance is continued. If the performance is further continued, the process returns to step S24, and if the performance of karaoke is not continued, the performance is ended in step S28. -Fourth Embodiment- Hereinafter, a fourth embodiment of the karaoke apparatus according to the present invention will be described. A description of the same components as those in the first embodiment will be omitted.

FIG. 8 illustrates the change of the character and the background stage based on the music development data of the karaoke data shown in FIG. In step S31, karaoke data required for karaoke performance is extracted from the karaoke data storage unit 107. In step S32, the attribute information extraction unit 10
From the attribute data extracted from No. 9, the playing time of the intro start portion, the song number start / end portion, and the end (ending) start / end portion of the song to be played is calculated from the song development information shown in FIG. In step S33, character data and background stage data required for performance are selected from the character data and background stage data storage unit 104. In step S34, the performance of karaoke is started based on the karaoke data extracted in S31. In step S35, the voice of karaoke is output from the speaker and the character, background stage, and telop are displayed on the display. In step S36, the arithmetic processing unit 110 compares the playing time with the start time of the music development data. If the two times are equal, the process proceeds to step S37, and if they are not equal, the process proceeds to step S38. In step S37, the arithmetic processing unit 110 changes the character and the background stage to those corresponding to the music development data. For example, different characters and background stage data are changed and displayed on the display at the intro start portion, the song number start portion, and the end (ending) start portion of the music to be played. Therefore, since the character and the background stage change in accordance with the development of the song, an emotional screen can be displayed on the display in accordance with the atmosphere of the song being played. In step S38, it is determined whether the karaoke performance is continued. If the performance is further continued, the process returns to step S35, and if the performance of karaoke is not continued, the performance is ended in step S39. -Fifth Embodiment- Hereinafter, a fifth embodiment of the karaoke apparatus according to the present invention will be described. A description of the same components as those in the first embodiment will be omitted. The present embodiment is an embodiment of a karaoke device whose main purpose is to use it at home.

First, a photographic image file taken by a digital camera is input from the floppy disk device, which is the input unit 8 of FIG. 1, and the image is stored in the character data and background stage data storage unit 104. After that, the user pastes the image of the digital camera on the face portion of the character while looking at the display. Thereby, for example, the face of the character shown in the first to fourth embodiments can be replaced with the image prepared by the user. This procedure will be described based on FIGS. 13 to 16. FIG. 13 is an image pasting operation screen of the present application. In the original data 20, the part of the character currently used in the karaoke performance and the background stage, which is the change source, are displayed. In FIG. 13, the part of the character "TV-FACE" is displayed. This means that a "TV-FACE" image such as a TV screen is displayed on the character's face during the performance of a song. As the image data 21, the image data exchanged with the original data 20 is displayed. Since no image data has been selected yet on this screen, nothing is displayed. All data display key 211
When is selected, all the candidate images that can be pasted as the original data can be displayed on the image display portion 212. In FIG. 13, since the all data display key 211 is not selected, the image display section 212 displays 1 of all candidate images.
/ 3 is displayed. The left end is TV-FACE,
Next to the right is the baseball field, next to the right is the bar stage, next to the right is the pool, and next to the right is the inside of the palace. When the character creation key 22 is selected, the following image file selection screen shown in FIG. 14 is displayed. The data format of the image to be pasted can be JPEG or TIFF. Image field 2 to paste in FIG.
At 71, the image specified by the file name is displayed.
A photographic image of the face taken by the user with the digital camera is displayed in the image column 271. Enter the file name in the file name field 24 and select the file reference field 25.
Character data and background stage data storage unit 104
From the image data saved in
The image data of the file name input to can be displayed. In the image file name field 23, identification information corresponding to the file name can be freely entered. Figure 1
In 4, the “booby prize” is input as the identification information. If the file reference field 25 is selected when no name is entered in the image file name field 23, a file name without an extension is automatically displayed in the name field 23 from the file names displayed in the image file name field 24. It When the cancel key 272 is selected, the screen returns to the screen shown in FIG. When the "OK" key 26 is selected while the name field 23 and the file name field 24 are both entered, the character registration screen of FIG. 15 is displayed. The original data 28 and the image data 29 selected in FIG. 14 are displayed on the character registration screen. This image data 29 is replaced with “TV-FACE” displayed in the original data 28, and indicates that the face data of the character is a candidate for image data displayed at the next performance. When the character registration key 30 is selected on this screen, in addition to the characters of the original data 28 and the background stage that have been selected so far, new characters to which the image of the image data 29 is pasted and image data of the background stage are registered. . In this embodiment, since the character is changed, the character setting screen of FIG. 16 is displayed.

In this way, it is possible to change the images of the character and the stage from the screen of the display 3 via the input unit 3. As a result, it becomes possible to display a new character or a background stage on which the image of the digital camera taken by the user is pasted and during the karaoke performance.

In the above description, a method of pasting an image obtained by the user using a digital camera on a part of the character has been described, but the image to be exchanged may be an advertisement or the like. By using an advertisement or the like for the background stage data, it becomes possible to provide the advertisement in a timely manner by changing the display method of the advertisement or changing to another advertisement in the middle of the song.

In the above-mentioned embodiments, the embodiment for the communication karaoke apparatus for business use and the embodiment for the karaoke apparatus for home use are shown, but any of the embodiments can be implemented for home use and for business use.

[0058]

As described above, it becomes possible for a user to paste a new image prepared in advance on a designated part of a character or a background stage,
Users can now enjoy karaoke while viewing their favorite images. In addition, since the character and background stage can be changed according to the karaoke data, it is now possible to change the facial expression as if the character were singing, making the karaoke fun. It can be increased. In addition, advertisements can be pasted on the background stage, and more timely advertisements can be displayed on the karaoke screen.

[Brief description of drawings]

FIG. 1 is a block diagram of a karaoke device configuration according to the present invention.

FIG. 2 is a block diagram of processing according to an embodiment of the present invention.

FIG. 3 is a diagram showing the contents of music information data used in the present invention.

FIG. 4 is a diagram showing the content of telop (lyric) data used in the present invention.

FIG. 5 is a flowchart showing a performance process based on telop (lyric) data according to the present invention.

FIG. 6 is a flowchart showing a performance process based on time signature data according to the present invention.

FIG. 7 is a flowchart showing a performance process based on a microphone input level according to the present invention.

FIG. 8 is a flowchart showing a performance process based on music development data according to the present invention.

FIG. 9 is a diagram showing a mechanism for extracting vowels from lyrics data.

FIG. 10 is a diagram showing a part of lyrics data and hiragana data for lip-sync.

FIG. 11 is a diagram showing a relationship between lyrics data and telop data.

FIG. 12 is a diagram showing a relationship between lyrics data and hiragana data for lip-sync.

FIG. 13 is an image pasting screen.

FIG. 14 is an image file selection screen.

FIG. 15 is a character registration screen.

FIG. 16 is a character setting screen.

[Explanation of symbols]

20, 28: Original data 21, 29: Image data 22: Character creation key 23: Name field 24: File name field 25: File reference field 26: "OK" key 27: Paste image 30: Character registration key 31: Character Setting area 101: Image data storage unit 102: User interface unit 103: Image data processing unit 104: Character data and background stage data storage unit 105: Music information data storage unit 106: Character / stage selection unit 107: Karaoke data storage unit 108: Microphone input level detection unit 109: Attribute information extraction unit 110: Arithmetic processing unit 211: All data display key 212: Image display portion 271: Image column 272: Cancel key

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Hironori Nagayama             Pies 4-15-5 Omorinishi, Ota-ku, Tokyo             Onia Co., Ltd. Omori Factory (72) Inventor Makoto Takanashi             Pies 4-15-5 Omorinishi, Ota-ku, Tokyo             Onia Co., Ltd. Omori Factory F-term (reference) 5D108 BE06 BF03 BF20

Claims (12)

[Claims] 1. A moving picture reproducing means for reproducing a moving picture according to karaoke data necessary for reproducing karaoke, and controlling the moving picture reproducing means at the time of reproducing karaoke according to time-series attribute data included in the karaoke data. According to the above, the karaoke apparatus comprising: a moving picture control means for sequentially changing the moving picture reproduced by the moving picture reproducing means. 2. The moving picture control means, based on the telop data as the attribute data, changes the moving picture by the moving picture reproducing means in accordance with the pronunciation of the lyrics indicated by the telop data. The karaoke device described. 3. The moving picture control means changes the moving picture by the moving picture reproducing means in accordance with the vowel, based on a vowel included in the character data as the attribute data. Karaoke device. 4. The moving picture control means changes the movement of the mouth of the character in the moving picture by the moving picture reproducing means in accordance with the vowel sound based on the vowel sound included in the character data as the attribute data. The karaoke device according to claim 1. 5. The moving picture control means, based on the time signature data as the attribute data, changes the moving picture by the moving picture playback means in accordance with the time signature of the musical piece indicated by the time signature data. Karaoke device described in. 6. The moving image control means changes the moving image by the moving image reproducing means according to the development of the musical composition indicated by the developed data, based on the developed data as the attribute data. Karaoke device described in. 7. A moving picture reproducing means for reproducing a moving picture according to karaoke data necessary for reproducing karaoke, and controlling the moving picture reproducing means according to input data sequentially inputted through a microphone at the time of reproducing karaoke.
A karaoke device comprising: a moving picture control means for sequentially changing the moving picture reproduced by the moving picture reproducing means. 8. The moving image control means, based on the volume information as the input data, changes the mouth action of the character in the moving image reproduced by the moving image reproducing means in accordance with the volume information. The karaoke device according to claim 7. 9. The apparatus according to claim 1, further comprising: an image creating unit that pastes a previously created image to create the moving image, and the moving image control unit sequentially changes the pasted image. 8. The karaoke device according to any one of 8. 10. The karaoke apparatus according to claim 1, further comprising image selection means for selecting one of a plurality of images prepared in advance as a part of the moving image. . 11. A computer having a moving image reproducing function for reproducing a moving image according to karaoke data required for reproducing karaoke, and a moving image reproducing function for reproducing karaoke according to time-sequentially changing attribute data included in the karaoke data. A program for realizing a moving picture control function of sequentially changing a moving picture played back by the moving picture playing function by controlling. 12. A computer is provided with a moving picture reproducing function for reproducing a moving picture according to karaoke data necessary for reproducing karaoke, and by controlling the moving picture reproducing function according to input data sequentially input through a microphone when reproducing karaoke.
A program for realizing a moving picture control function that sequentially changes a moving picture played by the moving picture playing function.