JP2002297164A - Karaoke device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device which can vary a key (interval) and the sound volume of a guide melody as a Karaoke device which uses MPEG sound compressed data. SOLUTION: The Karaoke device which is connected to a data server through a network compresses Karaoke data stored in the Karaoke device according to the MPEG compression format and uses stream data with a stream ID added in accordance with the kind of data used for Karaoke. The Karaoke device decides the kind of the data according to the stream ID and performs arithmetic processing according to the kind of the data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke apparatus for performing a karaoke performance while displaying a background image suitable for a song.

[0002]

2. Description of the Related Art A karaoke apparatus not only plays a karaoke song, but also displays a background image corresponding to the song on a monitor, and also displays a superimposed lyrics telop on the background image.

A conventional communication karaoke apparatus downloads music data for performance from a distribution center and is separated from a background video having a large data amount. Is stored on the media.

As described above, since the amount of video data is large, conventionally, one or more pieces of video data corresponding to each genre of karaoke songs such as enka and pops are stored, and a karaoke song is requested. At this time, video data of this genre is read and displayed as a background video, and the karaoke tune and the background video do not correspond individually.

[0005] However, in the method of selecting from a few video data based on only the genre, the same video data may be repeated in some cases, and there is a problem that the karaoke performance cannot be excited because the user gets bored. Was.

On the other hand, if video data corresponding to each karaoke tune is individually stored, video data suitable for each karaoke tune can be displayed without fail. Storing individual video data corresponding to each of the karaoke songs that are performed is not realistic because the cost is extremely high and the device becomes very large.

Therefore, a karaoke system has been proposed in which a karaoke song is played with video data individually corresponding to each karaoke song without increasing the storage capacity of the video data of each karaoke device (Japanese Patent Laid-Open No. 11-161288). reference). In this karaoke system, a plurality of karaoke devices are connected via a network, video data is shared and stored by the plurality of karaoke devices, and when individual video data is not stored in the own device, data is transmitted from another karaoke device. The data is transferred, and a background video individually corresponding to the karaoke song is reproduced using the data.

However, in the above-mentioned karaoke system, since the video data is shared among the karaoke devices connected to the system, any one of the karaoke devices is required to increase or change the number of karaoke songs. You have to decide whether or not to update the data, which is cumbersome. For this reason, it is not suitable for applications where music is frequently added or changed.

In order to frequently add or change music, it is preferable to connect the data server of the distribution center to the terminals of a plurality of karaoke apparatuses via a communication line and download the music from the distribution center.

Conventionally, when downloading and distributing data via a communication line, even if the communication speed is ISDN, it is 64 kb.
ps. Therefore, as data to be distributed, MIDI data having a small data amount is used. Also, as described above, the karaoke apparatus actually uses video data stored in a medium such as a CD-ROM or a DVD.

[0011] However, audio data is MID
MPEG audio compression data is raw sound data than I data, and better sound can be reproduced by using MPEG audio compression data.

On the other hand, a high-speed communication network called a broadband network has recently been developed. As this broadband network, for example, FTTH (F
There is a network such as an Internet To The Home (Iber To The Home) service. This network has a communication speed of 1
It is an extremely high-speed communication network of 00 Mbps.
Therefore, when data is distributed by connecting a data server of a data distribution center and terminals of a plurality of karaoke apparatuses using a broadband network, both video data and audio data can be distributed using MPEG data.

[0013]

In a conventional communication karaoke apparatus using MIDI, it is possible to change a key (pitch) of a voice excluding a drum part and a volume of a guide melody. However, a karaoke apparatus using MPEG compressed audio data handles raw sound data, and it is not possible to change the key (pitch) or the guide melody volume simply by compressing the music information. As a karaoke apparatus, a key (pitch) change and a guide melody volume change are necessary functions, and if this function cannot be used, the karaoke apparatus becomes less attractive.

The present invention has been made in view of the above-described background, and provides a karaoke apparatus using MPEG compressed audio data which can change a key (pitch) and a guide melody volume. The purpose is to:

[0015]

According to the present invention, a karaoke device connected to a data server via a network compresses karaoke data stored in the karaoke device based on an MPEG compression format.
Stream I according to the type of data used in karaoke
Using the stream data to which D has been added, the karaoke apparatus determines the type of data based on the stream ID, and performs arithmetic processing according to the type of data.

The stream ID is added to specify the type of each audio data by extending the stream ID of the packet header. By referring to the stream ID, the audio data whose key can be changed or the guide melody volume can be changed is referred to. It is preferable to perform the arithmetic processing so as to create the data.

According to the above configuration, in the karaoke apparatus using the MPEG audio compression data, it is possible to change the key (pitch) and the volume of the guide melody.

[0018]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration of a communication karaoke using a karaoke device according to an embodiment of the present invention, and FIG. 2 is a diagram showing a configuration of a karaoke device according to the embodiment of the present invention connected to a network.

In FIG. 1, a plurality of karaoke apparatuses 3, which are karaoke terminal apparatuses, are connected on a communication network 1. This communication network 1 is configured by the above-mentioned broadband network,
It is a network such as H (Fiber To The Home) service. A data transmission device 2 serving as a data server is connected to the communication network 1,
The music and the background video data are distributed to the karaoke device 3 via the communication network 1 to the karaoke device 3 which has made the request. The music is sent out as audio-compressed data in MPEG format, and the background video data is MPE
Data compressed in the G format is transmitted.

As described above, adjustment of keys and guide melodies becomes impossible only by simple compression based on the MPEG format. Therefore, in the present invention, MPE
The data structure is determined so that the stream ID of G is extended to facilitate use as audio data for karaoke.

The type and data format of data used for karaoke will be described.

As image data, background image data (M
PEG), lyrics and color change data (MPEG or WI
P format).

The music data can be divided into A) music data and B) scoring data. The music data of A) includes a normal music part (MPEG), a guide melody (MPEG), and a key control adaptive exclusion part (MPEG).
PEG).

The scoring data of B) are scoring reference singing data (MPEG), scoring reference data (MIDI), and harmony / fist data (MIDI).

The karaoke apparatus is required to have a background image selection function, a speed control function, and a function of synchronizing the background image and the lyrics. In order to realize these functions, it is conceivable to use the following three data structures.

(First Configuration) Background Video (MPEG) / Color Change (MPEG) + A) Music Data (MPEG) + B) Scoring Data (MIDI)

Since the song data and the lyrics and the color change need to be synchronized, the lyrics and the color change are used as a video stream.
A) music data (MPEG) and B) scoring data (MID)
I) is configured as a music bit stream and one MP
EG file. The background video is an MPEG file as one bit stream. The scoring data may be configured in a separate file.

(Second Configuration)) Background Video (MPEG) / Color Change (WIP) + A) Music Data (MPEG) + B) Scoring Data (MIDI)

Since it is necessary to synchronize the song data with the lyrics and the color change, the MPEG file is composed of the lyrics and the color change as one bit stream. Also, the color change data (W
The IP) and B) scoring data are described by extending the format of the above-mentioned MPEG file in order to divert MIDI karaoke data. Since the scoring function is treated as an option, B) scoring data is independent M
It may be handled as a PEG file. The background video is configured as an MPEG file as one bit stream.

(Third Configuration) Background Video + Color Change + A) Music Data + B) Scoring Data (MPEG)

The MPEG file format is extended to compose all data as an MPEG file with one bit stream. However, in this case, background image selection and speed control cannot be performed.

An example of a data recording format and a data structure will be described. FIG. 3 shows an example of using an MPEG stream ID. The data shown in FIG. 3 is obtained by extending the MPEG stream ID so that the
D is assigned. Specifically, since the MPEG specification specifies that the following ID is used,
The ID is as shown in FIG.

-MPEG Audio 0xC0 to 0xCF-MPEG Video 0xE0 to 0xEF

FIG. 4 shows a data format. As shown in FIG. 4, the stream ID of the packet
Are stored. The data is transmitted in a state where the lyrics and the color change data are stored together with the packet data of one bit stream, and the normal music part is stored together with the packet data of one bit stream and the stream ID indicating the data type.

As described above, by recording the stream ID representing the data type and the bit stream of the data, the karaoke apparatus determines the data type based on the stream ID, and performs the arithmetic processing according to the data type. Can be. For example, during a performance, a calculation process such as adjusting the volume is performed according to an instruction input by a user for a guide melody music part or a key part, and the calculation data is superimposed on the main music part, thereby providing a key control or a guide melody volume. Adjustments can be made.

The karaoke apparatus 3 is connected to the communication network 1 and performs a karaoke performance. As will be described later, each karaoke apparatus 3 in this embodiment has a portion (a few seconds) of background data for performing the performance. ~ Several tens of seconds). The retained data is, for example, a low bit rate (coarse) video, and stores long-time data with a small capacity. The background data transmitted from the data transmission device 2 in this embodiment has a high bit rate (clear).

In a system in which a plurality of karaoke apparatuses 2 are connected to a communication network 1 as shown in FIG. 1, when receiving data transfer from the data transmission apparatus 2, depending on the load of the server and the line condition. However, no matter how fast the communication network 1 is, it is inevitable that a certain time delay will occur until it is actually distributed. It is also assumed that a failure in the network or a communication rate temporarily drops.

For this reason, in each of the karaoke apparatuses 3 described above, background data of several seconds to several tens of seconds, which is a time longer than the delay time assumed in advance, is stored. Then, when a delay occurs in the distribution system, first, the video is reproduced with the background data stored in the karaoke apparatus 3, and when the data from the communication network 1 arrives, the reproduced video data is switched. To do.

By configuring the system in this manner, it is possible to reproduce the background data individually corresponding to the music regardless of the delay in the communication network 1. In addition, the storage capacity can be reduced by using a part of the background data (several seconds to several tens of seconds) and a low bit rate (coarse) video. For this reason, each karaoke apparatus 3 can store a part of the background data corresponding to each music piece.

Next, FIG. 2 shows the configuration of a karaoke apparatus that performs a performance based on the above data format.

Each karaoke device 3 is connected to the network 1
And a network interface 33 for connecting to the network. This network interface 33
It is connected to the CPU 30 via the / O control circuit 34. The CPU 30 also has a buffer RAM 3
1 is connected. The I / O control circuit 34 includes a hard disk 32 and a remote control panel interface 4
5 etc. are connected.

The CPU 30 has an MPEG decoder 35 for video, an MPE for decoding music, lyrics and color change data.
The G decoder 36 is connected. These MPEG decoders 35 and 36 are provided with a DSP (Digital Signal).
l Processor).

The CPU 30 also controls the audio DAC 4
0, graphic controller 38, video DAC3
9, MPEG voice scoring machine 42, effector scoring board 4
3 is controlled.

The MPEG audio scoring machine 42 and the effector scoring board 43 are connected to the CPU 3 via the I / O control 34.
Connected to 0. A microphone interface 44 is provided on the MPEG audio grader 42 and the effector
The microphone is connected through. A video signal from the video DAC 39 is supplied to a display device, and a background image, lyrics, and the like are displayed on the display device. Also, an audio signal from the audio DAC 40 is provided to a speaker, and music, singing voice, and the like are reproduced.

Although not shown, a ROM for storing a program for activating the karaoke apparatus is provided.

The network interface 33 controls not only communication with the data transmitting device 2 via the communication network 1 but also communication with another karaoke device connected to the communication network. From the data transmission device 2, music data of new songs, an index table, and the like are transmitted and downloaded according to the data format shown in FIG. Further, the data transmission device 2
, High bit rate (fine) MPEG data is downloaded as background data of the requested music in accordance with the data format shown in FIG. This index table is a table for instructing the correspondence between the song number of the karaoke song and the individual background video data.

The hard disk 32 stores the music data, the index table, and the like.
A program such as a system program, a karaoke performance program, a loader, and character pattern data are stored. Further, in this embodiment, a part (several seconds to several tens of seconds) of the background data individually corresponding to the music is stored as low bit rate (coarse) MPEG data.

The system program is a program for controlling the basic operation of this apparatus, and is read into the buffer RAM 31 when the karaoke apparatus is started. The karaoke performance program uses an audio DAC 4 based on the music data.
0 and a program for controlling the MPEG decoders 35 and 36 and the like. The loader is a program for downloading background data, music data, and an index table from the data transmission device 2. The character pattern data is data for developing text information such as lyrics and song titles given as code information into character patterns. In the buffer RAM 31, an area for reading the above program and a music data buffer for reading the music data currently being played and the music data to be played next are set.

The remote control panel interface 45 is connected to a circuit for receiving an infrared signal transmitted from an infrared remote controller (commander) (not shown) and converting it into data, a panel switch, and the like. The CPU 30 reserves a karaoke song based on the song number input from the commander, and executes various processes such as a key change based on other command codes.

The MPEG decoder 35 is a circuit for demodulating background data transmitted by communication, and demodulates data determined to be a background video with the stream ID of the format described above. The MPEG decoder 36 demodulates music, lyrics, and color change data, determines which data is the stream ID of the format described above, and performs demodulation according to each data.

The graphic controller 38 has an MPE
The background data demodulated by the G decoder 35, the lyric data and the color change data demodulated by the MPEG decoder 36 are received, and the lyric data is superimposed on each image image, and is displayed on the display via the video DAC 39.

The audio DAC 40 outputs a sound signal to a speaker based on a signal from a mixer 46 in which a signal demodulated by the MPEG decoder 36 and a signal from the microphone interface 44 are mixed. The signal demodulated by the MPEG decoder 36 may be composed of a plurality of channels, and the mixer 46 performs key control according to the setting of the remote control panel interface 45 in accordance with an instruction set by the user such as adjustment of a guide melody volume. It has the function of mixing the signals controlled by 41.

The MPEG decoder 36 gives the key control 41 to the normal music part and the guide melody according to the stream ID of the above-mentioned format. The key is supplied from the key controller 41 to the mixer 46. Also, MP
The EG decoder 36 provides the music excluding key control adaptation such as a drum part to the mixer 46 as it is, based on the stream ID in the format described above.

Further, based on the stream ID of the above-described format, the MPEG decoder 36 supplies MPEG reference data to the MPEG audio grader 42 and the MIDI reference data to the effector scoring board 43. The user determines which scoring machine to use, and sends scoring data to one of the scoring machines via the selector 37 based on the determined data. Then, the scoring machines 42 and 43 score based on the singing data given from the microphone interface 44, and give the scoring result to the I / O control 34, and the CPU 30 causes the display to display the scoring result.

The data transmission device 2 is a host computer for distributing data even when a new background video or a new song is released, and holds and stores all songs and background data. Further, the karaoke apparatus 3 may have a function of managing a database of music pieces and background images held by each karaoke apparatus 3.

On the other hand, a microphone is connected to a hamo amplifier (not shown), which amplifies a singing voice signal input from the microphone, and corrects a pitch shift by pitch-shifting the singing voice signal according to a mode. Or synthesize a hamori sound. The performance sound signal synthesized by the sound system 35, the sound signal such as the back chorus reproduced by the MPEG decoder 36, and the singing sound signal and the sound signal output from the memory amplifier are all input to the mixer 46. The mixer 46 mixes these signals with an appropriate balance and inputs the signals to the effector. The effector gives an effect such as an echo to these karaoke sound signals based on the effect control data of the music data.
The audio signal of the karaoke performance to which the effect has been added is output as sound from the speaker.

An index table is stored in the hard disk storage device 32 of each karaoke device. The index table stores the file name of the song data of the karaoke song corresponding to the song number and the number of the individual video data individually associated with the karaoke song. It should be noted that the index table may be a table that only associates song numbers with individual video data. In this case, the music data may be provided with an index table dedicated to the music data.

Thus, in the index table,
One individual video data is associated with one karaoke song, and the karaoke song and the individual video data are one-to-one.
Is supported. That is, it corresponds one-to-one with a part of the background data corresponding to each music piece in the karaoke device 3 and has a one-to-one correspondence with the individual video data for transmission stored in the data transmission device 3.

Incidentally, as a part of the background data stored in the karaoke apparatus 3 described above, a sufficiently large number of data (for example, about 1000 pieces) does not completely correspond to about 10,000 karaoke songs one by one. ) May be set to correspond to 10,000 karaoke songs. You.

The data transmission device 2 stores individual video data corresponding to all music pieces, and stores a table similar to the index table. In the index table, the file name of the song data of the karaoke song corresponding to the song number, the number of the individual video data individually associated with the karaoke song, the number of the general-purpose video data corresponding to the karaoke song Is stored.

In the index table of the data transmitting device 2, one individual video data is associated with one karaoke song, and the karaoke song and the individual video data correspond one-to-one. On the other hand, one piece of general-purpose video data is associated with one karaoke song, but a plurality of karaoke songs correspond to one general-purpose video data. The general-purpose video data is not about several tens of types unlike conventional general-purpose data, but is adapted to correspond to approximately 10,000 karaoke songs with several hundred types of data. This general-purpose data is used, for example, when individual video data cannot be used.

This karaoke apparatus is configured as described above. Next, the operation of the karaoke apparatus will be described with reference to the flowchart of FIG.

When the karaoke operation starts, the stream ID is determined from the read karaoke data. In step S1, it is determined whether the determined stream ID is lyrics and color change data, lyrics display and color change processing are performed in step S2, and the process proceeds to step S18.

If it is not the lyrics and the color change data, the flow advances to step S3 to determine whether or not the data is a normal music part. If it is determined that the music part is a normal music part, demodulation is performed by the MPEG decoder 36 (step S4), data is given to the key control 41, the operation of the key control 41 is performed (step S8), and the process proceeds to step S18.

If it is determined that the melody is not a normal music part, the flow advances to step S5 to determine whether or not the melody is a guide melody. If it is determined that the melody is a guide melody, the melody is demodulated by the MPEG decoder 36 (step S6), the volume is adjusted (step S7), data is given to the key control 41, and the operation of the key control 41 is performed (step S6).
8) Go to step S18.

If it is determined that the part is not a guide melody, the flow advances to step S9 to determine whether the part is a key-con adaptation exclusion part. If it is determined that the part is a key-con adaptation exclusion part, it is demodulated by the MPEG decoder 36 (step S1).
0), and after outputting to the audio output board (step S1)
1), and proceed to step S18.

If it is determined that the part is not a key-con adaptation exclusion part, the flow advances to step S12 to determine whether or not the part is grading reference singing data. If it is determined that the data is the singing standard singing data, the data is demodulated by the MPEG decoder 36 (step S1).
0), and after outputting to the voice scoring machine 42 (step S1).
4), proceed to step S18.

If it is determined that the data is not the grading reference singing data, the process proceeds to step S15, and it is determined whether the data is the grading reference data. If it is determined that the data is scoring reference data, it is output to the scoring board 43 (step S16),
Proceed to 18.

When it is determined that the data is not scoring reference data, the process proceeds to step S17, and it is determined whether or not the data is harmony / fist data. If it is determined that the data is harmony / fist data, it is output to the scoring board 43 (step S1).
6) Go to step S18.

In step S18, the process proceeds to the next block. In step S19, it is determined whether or not the data is final data. If the data is not final data, the process returns to step S1 to repeat the above-described operation. Then, when the processing is completed up to the final data, the operation ends.

[0071]

As described above, according to the present invention, in a karaoke apparatus using MPEG audio compression data, it is possible to change the key (pitch) and the volume of the guide melody so that the karaoke performance can be performed with better sound. I can do it.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a communication karaoke using a karaoke apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of a karaoke apparatus according to the embodiment of the present invention connected to a network.

FIG. 3 is a diagram showing types of stream IDs used in the present invention.

FIG. 4 is a diagram showing a data format used by the present invention.

FIG. 5 is a flowchart showing the operation of the karaoke apparatus of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Communication network 2 Data transmission device (data server) 3 Karaoke device 30 CPU3 31 Memory 32 Hard disk 33 Network interface 34 I / O control circuit 35 MPEG decoder for video 36 MPE for decoding music, lyrics and color change data
G decoder 38 Graphic controller 40 Audio DAC 39 Video DAC 42 MPEG audio scoring machine 43 Effector scoring board 44 Microphone interface 45 Remote control panel interface

 ──────────────────────────────────────────────────続 き Continuation of the front page (72) Inventor Yoshihiko Morita 2-5-5 Keihanhondori, Moriguchi-shi, Osaka Sanyo Electric Co., Ltd. F-term (reference) 5D108 BA40 BF06 BF16 BF20 BG20

Claims (2)

[Claims] 1. A karaoke device connected to a data server via a network, wherein karaoke data stored in the karaoke device is compressed based on an MPEG compression format, and a stream corresponding to the type of data used in the karaoke. A karaoke apparatus, wherein the karaoke apparatus determines the type of data based on the stream ID using stream data to which an ID has been added, and performs an arithmetic process in accordance with the type of data. 2. The stream ID is added to designate a type of each audio data by extending a stream ID of a packet header and referring to the stream ID, an audio whose key can be changed and a guide melody volume can be changed. 2. The karaoke apparatus according to claim 1, wherein the karaoke apparatus performs arithmetic processing so as to create data.