JPH1011096A - Karaoke device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To shorten a transfer time and reduce the storage capacity of music data by decoding voice data on the basis of a voice spectrum pattern read out on the basis of index information, and auxiliary information. SOLUTION: A communication interface 6 reproduces sent music data into the original music data according to its communication system and outputs the data to a hard disk drive 5, and sends a history of KARAOKE performances stored in the hard disk drive 5, etc., to a host computer 90 according to the communication system. A vector quantization data decoding means 71 converts index information included in vector quantization voice waveform data into a spectrum pattern according to a code book 81 in response to an indication for a voice track in the music data, decodes the original digital voice waveform data on the basis of the converted spectrum pattern and auxiliary information, and outputs the data to a mixer circuit 12. The code book 81 converts the index information to the spectrum pattern of the voice waveform data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke apparatus having a built-in sound source for generating a musical tone based on encoded music data, and particularly to a data encoding method for audio data included in music data. Karaoke apparatus.

[0002]

2. Description of the Related Art The simplest karaoke apparatus reproduces music by reproducing a tape in which the music is recorded as an analog signal. However, with the development of electronic technology, the tape has been replaced with a CD (Compact Disk). And LD
Instead of (Laser Disk), the signal to be recorded is also changed from an analog signal to a digital signal, and the data recorded therein is not only music data but also various information such as video data and lyrics data. Was. Recently, a communication type karaoke apparatus which takes in music data via a communication line (general telephone line or ISDN line) instead of a CD or LD and plays it using a sound source and a sequencer has rapidly spread. I've been. This communication type karaoke apparatus has a non-storage type in which music data to be reproduced is fetched and reproduced through a communication line each time, and a karaoke apparatus in which fetched music data is stored in a built-in storage device (such as a hard disk). There is a storage type that reads out and reproduces when necessary. At present, in terms of communication costs,
Storage type karaoke devices have become mainstream. In such a communication type karaoke apparatus, the latest data compression method and communication method are used in order to minimize the communication time (communication cost) and the storage capacity and to reduce the data amount of music data per music. Has been introduced. For example, if communication is performed using digital data recorded on a CD or LD as music data as it is, a communication-type karaoke apparatus cannot be established in terms of communication time and communication cost.
Therefore, the communication type karaoke apparatus transmits MIDI-related data and lyrics-related data in the music data to MIDI.
(Musical Instrument Digita
l Interface) data (hereinafter referred to as “MIDI data”).
A voice data that cannot be encoded into data
DPCM (Adaptive Differentia)
Communication was performed by reducing the data amount of music data per music by encoding the data into l Pulse Code Modulation (lPulse Code Modulation) data.

[0003]

SUMMARY OF THE INVENTION However, ADPCM
Even though the data is compressed, the data amount is relatively large as compared with the MIDI data. Therefore, the data occupies most (about two-thirds) in the storage device of the storage type karaoke apparatus, and This is one of the factors that limit the number of music data that can be stored in the device. This is also a factor that limits shortening of communication time (communication cost) when communicating music data. The present invention has been made in view of the above points, and when transferring music data via a signal line such as a communication line, the transfer time can be greatly reduced and the storage capacity of the music data can be reduced. It is an object of the present invention to provide a karaoke apparatus that can perform the karaoke.

[0004]

A karaoke apparatus according to the present invention has a storage means for storing a plurality of transferred music data and an accompaniment music tone by reading accompaniment data of the selected music data based on a music selection operation. Together with
In a karaoke apparatus for reading and producing audio data in synchronization with the accompaniment music, the audio data is composed of index information as vector quantized waveform data and auxiliary information relating to a spectrum envelope, and the index information and the audio spectrum pattern are included. Table reading means for storing the relationship of the above, reading means for reading a voice spectrum pattern from the table storing means based on the index information, and decoding for decoding voice data based on the read voice spectrum pattern and the auxiliary information. Means. A conventional karaoke apparatus has performed karaoke performance processing based on audio waveform data (ADPCM audio waveform data) that has been data-compressed by the ADPCM data compression technique. In the present invention, A
A vector quantization technique capable of compressing data at a higher compression rate than the DPCM data compression technique is employed. This vector quantization technique is capable of compressing audio waveform data at approximately three times the compression rate of the ADPCM data compression technique, and converts the audio waveform data into index information for specifying the audio spectrum pattern and auxiliary information relating to the spectrum envelope. Compress with information. According to the present invention, audio waveform data (vector quantized audio waveform data) compressed by the vector quantization technique is transferred via a signal line such as a communication line. Therefore, the karaoke apparatus decodes the transferred vector quantized audio waveform data into the original audio waveform data, and performs a karaoke performance using the decoded audio waveform data. Thereby, the conventional A
The communication time can be greatly reduced as compared with the case where the DPCM audio waveform data is transferred. Further, the karaoke apparatus can store the received vector quantized audio waveform data in a storage medium such as a hard disk apparatus as it is, so that the storage capacity of music data can be reduced.

[0005]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings. FIG. 1 is a schematic block diagram showing the overall configuration of a karaoke apparatus 70 according to an embodiment of the present invention. In this embodiment, a karaoke apparatus 70 is connected to a host computer 90 via a communication interface 6 and a communication network 80, receives music data distributed from the host computer 90, and stores the music data in a built-in hard disk. Will be described. In this embodiment,
When the host computer 90 receives the digital audio waveform data 1
.. N are compressed by a vector quantization technique, and the compressed digital audio waveform data (hereinafter referred to as “vector-quantized audio waveform data”) is added to a header portion and a MIDI data portion, as shown in FIG. Composed music data,
It is transmitted to the karaoke apparatus 70 via the communication network 80 according to a predetermined communication method. Karaoke device 70
Will be described for the case where the received vector quantized audio waveform data is sequentially stored in the hard disk device 5. This vector quantization technique will be described later with reference to FIG.

The karaoke apparatus 70 includes a microprocessor unit (CPU) 1 and a program memory (RO).
M) 2 and various processes are executed under the control of a microcomputer system including a working memory (RAM) 3. The CPU 1 controls the operation of the karaoke apparatus 70 as a whole. For this CPU 1, a program memory (ROM) 2, a working memory (RAM) 3, a panel interface 4, a hard disk device (HDD) via a data and address bus 21.
5, communication interface 6, vector quantized data decoding means 71, codebook 81, sound source circuit 10, effect means 14, video creation circuit 16, and background video playback circuit 18 are connected. In addition, MID
Attached devices such as an I interface circuit and a background video reproducing device including an LD (CD) changer are connected, but the description is omitted here.

The program memory 2 stores a system-related program of the CPU 1, a program for loading a system-related program stored in the hard disk device 5, various parameters and data, and the like. ROM). The working memory 3 temporarily stores a system program loaded from the hard disk device 5 and various data generated when the CPU 1 executes the program.
M) predetermined address areas are respectively allocated and used as registers and flags. The panel interface 4 converts command signals from various controls and a remote control device (not shown) provided on a panel (not shown) of the karaoke apparatus 70 into signals that can be processed by the CPU 1, and converts them into data and addresses. Output to the bus 21.

[0008] The hard disk device 5 includes a karaoke device 7
It stores zero system programs and music data, and has a storage capacity of several hundred M to several G, for example. In this embodiment, audio data included in the music data stored in the hard disk device 5 is compressed by a vector quantization technique. It is needless to say that the music data stored in the hard disk device 5 is not only taken in through the communication network 80 but may be read and recorded from a floppy disk driver or a CD-ROM driver (not shown). No. The communication interface 6 reproduces the music data transmitted via the communication network 80 into the original music data in accordance with the communication system, and outputs the original music data to the hard disk device 5 or the karaoke performance history stored in the hard disk device 5. To the host computer 90 according to the communication method. The vector quantized data decoding means 71 converts the index information included in the vector quantized audio waveform data into a spectrum pattern based on the codebook 8 according to the instruction of the audio track in the music data, and converts the converted spectrum pattern and the auxiliary Decoding the original digital audio waveform data based on the information and
Output to the mixer circuit 12. The code book 81 is a conversion table for converting the index information into a spectrum pattern of the audio waveform data. Codebook 8
May be configured by a dedicated memory, or may be stored in an appropriate location of the hard disk device 5. The data of the code book 8 may be taken in via the communication network 80, or may be read and recorded from a floppy disk driver or a CD-ROM driver (not shown). That is, in the karaoke apparatus 70 according to the present embodiment, the music data including the audio waveform data compressed by the vector quantization technique is fetched via the communication line 80, and the karaoke apparatus 70 receives the music data.
When performing a music, the audio data is output to the vector quantization data decoding means 71, and audio reproduction is realized based on the spectral pattern stored in the code book 81.

The tone generator circuit 10 is capable of simultaneously generating a musical tone signal on a plurality of channels.
1 to input data conforming to the MIDI standard on the musical tone track given, generate a musical tone signal based on this data, and output it to the mixer circuit 12. The tone generator circuit 10 can simultaneously generate tone signals on a plurality of channels by using a single circuit in a time-division manner to form a plurality of tone channels, or a single tone channel can be constituted by a single circuit. It may be of the type as described below. The sound source circuit 10
May be used as the tone signal generation system. For example, a memory reading method (waveform memory method) for sequentially reading out tone waveform sample value data stored in a waveform memory in accordance with address data that changes in accordance with a pitch of a musical tone to be generated, or a phase angle parameter An FM method for executing a predetermined frequency modulation operation as data to obtain tone waveform sample value data, or an AM method for executing a predetermined amplitude modulation operation using the address data as phase angle parameter data to obtain tone waveform sample value data, or the like. May be appropriately adopted. In addition to these methods, a physical model method that synthesizes a musical sound waveform by an algorithm that simulates the sounding principle of a natural musical instrument, a harmonic synthesis method that synthesizes a musical sound waveform by adding a plurality of harmonics to a fundamental wave, A formant synthesis method of synthesizing a musical tone waveform using a formant waveform having a specific spectral distribution, an analog synthesizer method using VCO, VCF, and VCA may be employed. In addition, the tone generator circuit is not limited to the one that uses the dedicated hardware, and the tone generator circuit may be configured using a DSP and a microprogram. Alternatively, the tone generator circuit may be configured using a CPU and a software program. It may be.

[0010] The mixer circuit 12 mixes the tone signal from the tone generator circuit 10, the audio signal from the vector quantized data decoding means 71, and the audio signal from the microphone 13, and outputs it to the effect means 14. . The effect means 14 adds an effect such as reverberation or reverb to the tone signal and the audio signal from the mixer circuit 12 to provide the sound output device 1 with the effect.
5 is output. The effect means 14 controls the type and degree of the effect according to the control data of the effect control track in the music data. The sound output device 15 emits a tone signal and a sound signal from the effect means 14 via a sound system including an amplifier and a speaker.

The video creation circuit 16 is provided with a character code created based on the MIDI data recorded on the lyrics track, character data relating to the display location, display time data relating to the display time of the lyrics, and the display color of the lyrics. Is generated on the monitor screen on the basis of the wipe sequence data for sequentially changing the song according to the progress of the music. The background video reproduction circuit 18 selectively reproduces a predetermined background video corresponding to the genre of the music to be played from the CD-ROM 17 and outputs it to the video mixer circuit 19. The video mixer circuit 19 superimposes the lyrics video from the video creating circuit 16 on the background video from the background video reproducing circuit 18 in a superimposed manner, and outputs the superimposed lyrics video to the video output circuit 20. The video output circuit 20 displays a composite image of the background video and the lyrics video mixed by the video mixer circuit 19 on a monitor screen.

FIG. 2 is a diagram showing an example of the configuration of one piece of music data received and stored by the karaoke apparatus 70 of FIG. 1 via a communication network. The music data includes a header section 31, a MIDI data section 32, and an audio data section 33 as shown in FIG. The header section 31 is composed of various data related to the music data, and specifically, is data such as a music title, a genre name to which the music belongs, a release date, a performance time, and the like. In addition, the header section 31 may record additional information such as a communication date, a date accessed, and a number of times. The MIDI data section 32
It consists of a music track, a lyrics track, a voice track and an effect control track. In the music track, performance data such as a melody part, an accompaniment part, and a rhythm part according to the music are recorded. The performance data is data conforming to the MIDI standard, and includes duration time data Δt indicating a time interval between events, status data indicating the type of the event (such as a sounding start command and a sounding stop command), It is composed of pitch designation data for designating a pitch at which sound is started or stopped, and volume designation data for designating a sound volume at the time of sound production. The volume designation data is given when the status data is a sound generation start command. In the lyrics track, data relating to lyrics to be displayed on a monitor screen (not shown) is recorded in a MIDI system exclusive message format. That is,
The MIDI data recorded on the lyrics track sequentially changes the character code corresponding to the lyrics to be displayed and the character data relating to the display location, the display time data relating to the display time of the lyrics, and the display color of the lyrics in accordance with the progress of the music. And wipe sequence data. In the audio track, data relating to the generation of audio waveform data recorded in the audio data section is recorded as an MID as shown in FIG.
I is recorded in the system exclusive message format. That is, M recorded on this audio track
The IDI data includes data relating to the generation timing of audio waveform data, data designating audio waveform data to be generated at that timing, the volume of the audio data,
It consists of data specifying the pitch. The effect control track stores MIDI data relating to control of the effect means 14. The lyrics track and the effect control track are also transmitted as data conforming to the MIDI standard as shown in FIG.

FIG. 2C is a diagram showing an example of the data configuration of the audio data section 33 quantized by the vector quantization technique. Data 1 to n of the audio data section 33
Include auxiliary information 37 to 39 relating to the spectral envelope of audio waveform data relating to the back chorus, sample audio, duet audio, etc., generated according to the music, and index information 34 to 36 for specifying the spectral pattern of the audio waveform data. Consists of One frame of data is composed of the auxiliary information and the index information. Start data is recorded at the beginning of the frame, and end data is recorded at the end of the frame. In the figure, data for three frames is shown, but the data of the audio data unit 33 is actually composed of many frames. FIG. 3 is a diagram showing the contents of the code book 8. For example, when the index information is “1”, the spectrum pattern 1 is read as the spectrum of the frame, and when the index information is “2”, the spectrum pattern 2 is read as the spectrum of the frame.

FIG. 4 is a diagram schematically illustrating an operation of compressing the speech waveform data into vector quantized speech waveform data. When audio waveform data exists as shown in FIG. 4A, a part of the audio waveform data is represented by a rectangle 4 in FIG.
Cut out the area as shown in FIG. The waveform data cut out as shown in FIG. 4B is subjected to an orthogonal transform (MDCT) unit 41 such as a discrete cosine transform or a discrete Fourier transform, so as to obtain a signal in the frequency domain as shown in FIG. Is converted to Further, the cut-out data is processed by a linear prediction analysis (LPC) unit 42 in FIG.
It is converted into spectrum envelope information as shown in (D). The quantization unit 43 includes spectrum envelope information as shown in FIG.
The audio power information is quantized as auxiliary information. The signal (spectral signal) in the frequency domain of FIG. 4C is converted by the normalization unit 44 into a normalized spectrum pattern as shown in FIG. Here, FIG.
A case where a normalized spectrum pattern is obtained by dividing the signal in the frequency domain of FIG. 4C by the spectrum envelope information of FIG. 4D will be described. However, normalization may be performed by any other method. The normalized spectral pattern is quantized by the quantization unit 45 into index information corresponding to the closest spectral pattern among the spectral patterns stored in the code book 8 of FIG. Thus, the quantization unit 43 and the quantization unit 4
The auxiliary information and index information respectively quantized by 5 are configured as shown in FIG. 2C, and are added to the music data as vector quantized audio waveform data representing data 1 to n of the audio data portion.

The karaoke apparatus 70 transmits music data including vector quantized audio waveform data as data of an audio data section to the communication network 80 and the communication interface 6.
And stores it in the hard disk drive 5. In performing the music, the vector quantized data decoding means 71 decodes the original digital audio waveform data in accordance with the instruction of the audio track. FIG. 5 is a diagram for explaining an outline of the operation when the vector quantized data decoding means 71 decodes the original digital audio waveform data based on the vector quantized audio waveform data. Note that FIG. 5B is shown in FIG. 4B, FIG. 5C is shown in FIG. 4C, FIG. 5D is shown in FIG. 4D, and FIG. E) respectively. In the vector quantized data decoding means 71, the normalized spectrum reproducing unit 51 converts the codebook 8 of FIG.
A spectrum pattern as shown in (E) is read. The spectrum envelope reproducing unit 52 reproduces the spectrum envelope information as shown in FIG. 5D based on the auxiliary information 37 to 39. The spectrum reproducing unit 53 multiplies the spectrum pattern from the normalized spectrum reproducing unit 51 by the spectrum envelope information from the spectrum envelope reproducing unit to obtain a signal shown in FIG.
A spectrum signal as shown in (C) is reproduced. The inverse orthogonal transform unit 54 decodes a part of the original digital audio waveform data as shown in FIG. 5 (D) by performing an inverse orthogonal transform process on the spectrum signal from the spectrum reproducing unit 53.
The decoded digital audio waveform data is supplied to a mixer circuit 7.
1 is output.

In the above-described embodiment, the case has been described where the audio data is compressed by the vector quantization technique. However, other background video and the like may be compressed by the vector quantization technique.

[0017]

According to the present invention, the karaoke voice data is used as vector quantized waveform data, and the quantized waveform data is voice-synthesized based on a codebook provided in the terminal. Compared with the related art, there is an effect that a karaoke apparatus that can shorten the communication time of music and reduce the load on the storage device of the terminal can be provided.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram showing an overall configuration of an embodiment of a karaoke apparatus according to the present invention.

FIG. 2 is a diagram showing a configuration example of music data distributed to a karaoke device.

FIG. 3 is a view showing an example of the contents of the code book of FIG. 1;

FIG. 4 is a diagram schematically illustrating an operation when audio waveform data is quantized into index information and auxiliary information by a vector quantization technique.

FIG. 5 is a diagram schematically illustrating an operation of decoding original digital audio waveform data based on vector quantized audio waveform data compressed by a vector quantization technique.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... Panel interface, 5 ... Hard disk drive, 6 ... Communication interface, 71 ... Vector quantization data decoding means, 81 ... Code book, 10 ... Sound source circuit, 12 ... Mixer Circuit, 13 microphone, 14 effect means, 15
Sound output means, 16: video creation circuit, 17: CD-RO
M, 18: background video reproduction circuit, 19: video mixer circuit,
20 video output means, 21 data and address bus

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] June 30, 1997

[Procedure amendment 1]

[Document name to be amended] Drawing

[Correction target item name] Figure 3

[Correction method] Change

[Correction contents]

FIG. 3

Claims (1)

[Claims] 1. A storage means for storing a plurality of transferred music data, and an accompaniment data of the selected music data is read out based on a music selection operation to generate an accompaniment music sound, and the music data is synchronized with the accompaniment music sound. In a karaoke apparatus for reading and generating audio data, the audio data is composed of index information as vector quantized waveform data and auxiliary information relating to a spectrum envelope, and a table storage storing a relationship between the index information and an audio spectrum pattern. Means, reading means for reading an audio spectrum pattern from the table storage means based on the index information, and decoding means for decoding audio data based on the read audio spectrum pattern and the auxiliary information. A karaoke apparatus characterized by the above-mentioned.