JP2002372981A - Karaoke system with voice converting function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke system capable of outputting the song of karaoke in the voice of an original singer. SOLUTION: Karaoke song signals are inputted and also original song signals are inputted. The original song signals are stored in piece of music data with karaoke performance data. Then, a frequency or volume is extracted from the karaoke song signals and the original song signals, and the difference is added to the original song signals so that the original song signals can be accompanied with the frequency change and volume change similar to that of the karaoke song signals. Thereby, the frequency and volume of the song signals of the original singers can be made close to the frequency and volume of the karaoke singers. Then, the original song signals are outputted as the karaoke song signals. Thereby, the karaoke song signals are corrected and outputted based on the singsong tones of the karaoke singers while the actual sound quality is belonging to the original singers.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke apparatus with a voice conversion function capable of converting the voice of a karaoke singer into the voice of an original singer and outputting the voice.

[0002]

2. Description of the Related Art In a karaoke apparatus, a karaoke apparatus capable of variously processing a singing voice in order to make the singing fun or to hear the singing well has been proposed. For example, a device has been proposed in which the quality of a singing voice is greatly changed to make it a strange / interesting voice, and a karaoke device which generates a harmony voice by increasing the pitch of the singing voice by, for example, three degrees.

[0003]

On the other hand, a desire of a karaoke singer is a desire to sing in the voice of a professional singer (original singer) singing the song. But,
The conventional device cannot convert the voice of the singer to the tone of the original singer.

[0004] It is an object of the present invention to provide a karaoke apparatus with a voice conversion function that allows a singer to sing karaoke with the voice of the original singer.

[0005]

According to the first aspect of the present invention, there is provided a storage means for storing musical tone information and specific singing voice information corresponding to the progress of the musical tone information; a sound source means for reproducing the musical tone information; Input means for inputting the singing voice, volume detecting means for detecting the volume from the singing voice, and reproducing the specific singing voice with the progress of the musical tone information, and generating the specific singing voice based on the volume detected by the volume detecting means. Voice conversion means for controlling and outputting the volume.

According to a second aspect of the present invention, in the first aspect, the voice conversion means corrects a part of the difference so that the volume of the specific singing voice approaches the volume detected from the singing voice. It is characterized by being.

According to a third aspect of the present invention, in the first and second aspects of the present invention, the voice converting means includes means for detecting difference data between the volume of the specific singing voice and the volume detected from the singing voice. It is characterized by having a scoring means for scoring the singing using the data.

According to a fourth aspect of the present invention, there is provided a storage means for storing musical tone information and specific singing voice information corresponding to the progress of the musical tone information, a sound source means for reproducing the musical tone information, and an input for inputting the singing voice of a karaoke singer. Means, frequency detecting means for detecting a frequency from the singing voice, and reproducing the specific singing voice with the progress of the musical tone information, controlling and outputting the frequency of the specific singing voice based on the frequency detected by the frequency detecting means. And voice conversion means for performing the conversion.

According to a fifth aspect of the present invention, in the fourth aspect of the present invention, the voice converting means corrects a part of the difference so that the frequency of the specific singing voice approaches the frequency detected from the singing voice. It is characterized by being.

According to a sixth aspect of the present invention, in the fourth and fifth aspects, the voice conversion means includes means for detecting difference data between the frequency of the specific singing voice and the frequency detected from the singing voice. It is characterized by having a scoring means for scoring the singing using the data.

According to a seventh aspect of the present invention, in the fourth aspect of the invention, the voice conversion means sets the frequency of the specific singing voice to 1
It is characterized by including means for shifting octaves.

According to an eighth aspect of the present invention, in the first to seventh aspects, the storage means stores, as the specific singing voice, phoneme information composed of consonants and vowels extracted from the waveform of the specific singing voice. It is characterized by.

In the karaoke apparatus with a voice conversion function according to the present invention, the storage means stores the specific singing voice information corresponding to the progress of the music information together with the music information for playing the karaoke music. The performance of the karaoke music is performed based on the musical sound information, and in parallel with this, the specific singing voice information is also read. During the performance of a karaoke song, a singing voice signal (karaoke singing voice signal) of a karaoke singer is input via a microphone or the like. When a karaoke singing signal is input, at least volume or frequency information is extracted from the karaoke singing voice signal, and the specific singing voice is reproduced with the specific singing information read in parallel with the karaoke performance,
This volume or frequency is corrected using the extracted volume or frequency information and output as if it were a karaoke singing voice. Thereby, although it is actually the singing voice of the specific person such as the original singer, it is controlled by the singing of the karaoke singer and the karaoke singing voice as if the karaoke singer were singing as a specific person. Can be obtained.

[0014]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A karaoke apparatus having a voice conversion function according to an embodiment of the present invention will be described with reference to the drawings. The karaoke apparatus of this embodiment is a so-called sound source karaoke apparatus. The sound source karaoke device generates a karaoke performance sound by driving the sound source device with music data. The karaoke apparatus is a communication type karaoke apparatus, is connected to a host station via a communication line, downloads music data from the host station, and stores the music data in the hard disk drive 17 (see FIG. 1). The hard disk device 17 can store music data for hundreds to thousands of songs. The voice conversion function is to control the singing voice signal of the original singer read in parallel with the karaoke performance by using the karaoke singing voice signal without outputting the singing voice signal of the karaoke singer input from the microphone 27 as it is. And outputs the controlled original singing voice signal as if it were a karaoke singing voice signal. Therefore, the singing signal data of the original singer is stored in the hard disk device 17 as a part of the music data.

First, the configuration of music data stored in the HDD 17 of the karaoke apparatus will be described with reference to FIGS. FIG. 3 is a diagram showing a configuration of music data. FIG. 4 is a diagram showing a detailed configuration of the musical tone track.

In FIG. 3, one piece of music data includes a header, a musical tone track, a lyrics track, an audio track, and a DS.
It consists of a P control track, a voice data section and an original singing data section. The header is a portion where various data related to the music data is written.
Data such as the song title, genre, release date, and music performance time (length) are written. The CPU 10 (see FIG. 1: the same applies hereinafter) determines the background video to be displayed on the monitor 26 based on the genre data when executing the sequence program, and transmits the chapter number of the video to the LD changer 24. The method of determining the background image is to select an image of a snowy country in the case of enka on the theme of winter, and to select an image of a foreign country in the case of pops.

In FIG. 4, tracks of various parts including a melody track and a rhythm track are formed in the musical tone track. By playing these plural parts in parallel, it is possible to output a performance sound such as an orchestra or a full band. Each track is
It is composed of event data for instructing the sound source device 18 to generate sound or mute, and sequence data in which time data Δt indicating a time interval between each event data are arranged in a time series. The CPU 10 performs the following operations by executing the sequence program. The duration data Δt of each track is separately counted based on the same clock, and for the track whose duration data Δt has been counted up, the next event data of the track is read and output to the tone generator 18. At that time, a sound channel to which the event data is to be sent is specified. This operation is repeated. The tone generator 18 assigns a sound channel based on the channel designation data, and executes the event on the sound channel.

Also, lyrics track, voice track, DS
The P control track is not music data, but is described in the MIDI data format for unifying the implementation and facilitating the work process, and is composed of event data and duration data in the same manner as the music track. The event data is described in the format of a system exclusive message.

The event data of the lyrics track includes the character data (character code and display coordinates of the character) of the lyrics displayed on the monitor 26, and the display time of the lyrics (usually 30 minutes).
Seconds) and wipe sequence data. Of these, the wipe sequence data is sequence data for changing the display color of the lyrics in accordance with the progress of the song, and includes the timing of changing the display color (the time from when the lyrics are displayed) and the change position. (Coordinates) are sequentially recorded over the length of one line.

The event data of the audio track is composed of audio designation data, pitch data, and volume data. The audio designation data is data for designating one of a plurality of audio data n (n = 1, 2, 3,...) Stored in the audio data section. The pitch data and the volume data are data for specifying the pitch and volume of the audio data to be reproduced. The voice data section stores human voices such as back chorus and harmony singing that are difficult to synthesize by the sound source device 19. Of these, back choruses such as "Ah" and "Wawa Wawa" that do not accompany words have pitches and pitches. Since it can be used many times if the volume is changed, one basic pitch and volume are stored, and the pitch and volume are shifted and used repeatedly based on this data. The audio data processing unit 19 sets the output level based on the volume data, and sets the interval of the audio signal by changing the reading interval of the audio data based on the interval data.

The event data of the DSP control track is transmitted to a DSP for controlling the effect DSP 20 connected to the sound source device 18 and the audio data processing unit 19 at the subsequent stage.
SP control data. The effect DSP 20 is mainly for giving a reverberation effect such as reverb to a musical tone, and the DSP control data is composed of data indicating the type and the degree of these effects.

On the other hand, the original singing data is obtained by converting the singing of the karaoke song by the original singer into an ADPCM and stored. The reading is performed by the CPU 10 in parallel with the reading of the music track and the like.
It is input to SP30.

FIG. 1 is a block diagram of a karaoke apparatus having the voice conversion function. CP that controls the operation of the entire device
U10 includes a ROM 11, a RAM 12, a hard disk storage device (HDD) 17, an ISDN controller 16, a remote control receiver 13, a display panel 14, a panel switch 15, a sound source device 18, and an audio data processing unit 1 via a bus.
9, an effect DSP 20, a character display unit 23, an LD changer 24, a display control unit 25, and a voice conversion DSP 30 are connected.

The ROM 11 stores a system program, an application program, a loader, and font data. The system program is a program that controls the basic operation of the device and data transmission / reception with peripheral devices. The application program is a peripheral device control program, a sequence program, or the like.

The sequence program is a program executed during karaoke performance. The sequence program counts duration data of each track, reads out event data at a predetermined timing, and outputs the data to a predetermined operation unit. The operation includes reading the original singing data in accordance with the progress of the music and inputting the data to the voice conversion DSP 30. The key (tonality) of the karaoke song is changed by rewriting the pitch data of the event data of the musical sound track in accordance with the operation of the key change switch of the panel switch 15.

The loader is a program for downloading music data from the host station. The font data is for displaying lyrics, song titles, and the like, and stores fonts of a plurality of character types, such as Mincho and Gothic. In the RAM 12, a work area is set. A music data file is set in the HDD 17.

The ISDN controller 16 is a controller for communicating with a host station via an ISDN line. Music data and the like are downloaded from the host station. The ISDN controller 16 has a built-in DMA circuit, and writes downloaded music data and application programs directly to the HDD 17 without passing through the CPU 10.

The remote control receiver 13 receives the infrared signal sent from the remote control 31 and restores the data. The remote controller 31 includes a command switch such as a music selection switch, a numeric key switch, and the like. When the user operates these switches, an infrared signal modulated with a code corresponding to the operation is transmitted. The display panel 14 is provided on the front of the karaoke apparatus, and displays the currently playing music code and the number of reserved music. The panel switch 15 is provided on a front operation unit of the karaoke apparatus, and includes a music code input switch, a key change switch, and the like.

The tone generator 18 forms a tone signal based on tone data input from the CPU 10. The audio data processing unit 19 forms an audio signal having a specified length and a specified pitch based on the audio data. The sound data is a signal waveform such as a back chorus or a model singing sound which is hardly generated electronically by the sound source device 18 and is directly converted into ADPCM and stored, and is stored in the sound data section of the music data. The tone signal formed by the sound source device 18, the sound signal formed by the sound data processing unit 19, and the singing sound signal input from the sound conversion DSP 30 are converted to the effect DS.
Input to P20. The effect DSP 20 gives effects such as reverb and echo to these input audio signals and tone signals. The type and degree of the effect provided by the effect DSP 20 are controlled based on the DSP control data included in the music data. The DSP control data is based on a DSP control sequence program, and the CPU 10 outputs the effect
Input to SP20. The tone signal and audio signal to which the effect has been added are converted into analog signals by the D / A converter 21 and then output to the amplifier / speaker 22. The amplifier / speaker 22 amplifies this signal and emits sound.

On the other hand, the singing voice signal input from the voice conversion DSP 30 is input to the karaoke singing voice signal via the singing microphone 27, the preamplifier 28 and the A / D converter 29. CPU10
, An original singing voice signal is input. The voice conversion DSP 30 corrects the frequency and volume of the original singing voice signal based on the frequency information and volume information of the karaoke singing voice signal, and outputs this to the effect DSP 20 as a karaoke singing voice signal.

The character display unit 23 generates character patterns such as song titles and lyrics based on the input character data. The LD changer 24 reproduces the background video of the corresponding LD based on the input video selection data (chapter number). The video selection data is determined based on the genre data of the karaoke song or the like. At the start of the karaoke performance, the CPU 10 reads the genre data of the music from the header of the music data. The CPU 10 determines which background video is to be reproduced based on the genre data and the content of the background video, and stores the video selection data in the LD changer 2.
4 is output. The LD changer 24 has 5 sheets (120
Scene) and a laser disk of about 120
The background video of the scene can be reproduced. One background image is selected from among them according to the image selection data,
Output as video data. The character pattern and the video data are input to the display control unit 25. The display control unit 25 superimposes these data in superimposition and displays them on the monitor 26.

FIG. 2 is a diagram showing the configuration of the voice conversion DSP. During the karaoke performance, the voice conversion DSP 30
The singing voice signal of the karaoke singer is input from the / D converter 29, and the original singing voice signal is input under the control of the CPU 10, and the original singing voice signal is corrected by the karaoke singing voice signal, and this is converted to the DSP for effect.
20 is a device for outputting to The original singing voice signal is input to the original singing analysis unit 40. The original singing analysis unit 40 analyzes the frequency and volume of the input original singing voice signal, and outputs frequency information and volume information. The karaoke singing voice signal is input to the karaoke singing analysis unit 41. The karaoke singing analysis unit 41 analyzes the frequency and volume of the karaoke singing voice signal, and outputs frequency information and volume information. The respective frequency information and volume information are subtracted by the subtracters 42 and 43, and the difference is calculated. This difference data is used as data for correcting the frequency (pitch) and volume of the original singing voice signal.

The difference data of the frequency information is input to the adder 46. To the adder 46, a frequency value of ± 1 octave is input as occasion demands. This is because when there is a difference of one octave between the original singing and the singing of the karaoke singer, such as when a male song is sung by a woman or a woman sings a female song, the difference data is added to or subtracted from the difference data from the correction target. When a woman sings a male song, a frequency value of -1 octave is input, and when a woman sings a female song, a frequency value of +1 octave is input. Thus, even if a woman sings a male song, a voice is output in a male octave, and even if a woman sings a female song, a voice is output in a female octave. The difference data output from the adder 46 is input to the multiplier 48. In the multiplier 48,
The difference data is multiplied by a correction coefficient. The correction coefficient is a numerical value generated by the correction coefficient generator 50,
This is a value between 0 and 1 that can be set as 1 or the like. That is, the original singing voice signal is not completely corrected with respect to the karaoke singing voice signal, but is multiplied by this correction coefficient in order to keep the frequency and volume of the original singing voice signal somewhat. The difference data multiplied by the correction coefficient is input to the pitch correction unit 44 as pitch correction data.
The pitch correction unit 44 corrects the pitch (frequency) of the original singing voice signal based on the input pitch correction data. The corrected original singing voice signal is input to the volume correcting unit 45.

On the other hand, the volume difference data is input to the multiplier 49. The multiplier 49 multiplies the difference data by a correction coefficient. The correction coefficient is a numerical value from 0 to 1 generated by the correction coefficient generator 50 in the same manner as described above. Like the correction coefficient input to the multiplier 48, it is a numerical value for determining the degree of correction, but both may have the same value or different values. The difference data multiplied by the correction coefficient is input to the volume correction unit 45 as volume correction data. In the volume correcting section 45, the original singing voice signal is multiplied by the volume correcting data. This singing voice signal is output to the effect DSP 20.

Further, the difference data of the frequency and the volume is input to the scoring unit 51. The scoring unit 51 accumulates the difference data, and scores the karaoke singing based on the accumulated value at the time when the karaoke song ends. This scoring result is displayed on the scoring result display 33 (see FIG. 1).

By the above operation of the voice conversion DSP 30, the original singing can be controlled by the singing of the karaoke singer, and the controlled original singing can be output as the karaoke singing. Karaoke output as if singing in the voice of the person.

In this embodiment, the original singing data is converted into 16-bit, 44.1 kHz digital data by PCM and all the data is stored. However, the storing method is not limited to this. That is, the consonants and vowels extracted from the singing of the song to be reproduced may be stored as phoneme data, and read out according to the singing progress of the karaoke singer to synthesize the original singing voice. In this case,
Even if the karaoke singer's singing tempo deviates slightly, the tempo of the original singing can be adjusted accordingly.

[0038]

As described above, according to the present invention, the frequency or volume of the original singing voice signal is adjusted based on the data extracted from the singing voice signal of the karaoke singer,
By outputting the adjusted original singing voice signal as a karaoke singing voice, the singing voice of the original singer can be output according to the singing of the singer, and the karaoke sound as if the original singer is singing. It becomes possible to enjoy.

[Brief description of the drawings]

FIG. 1 is a block diagram of a voice conversion karaoke apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of a voice conversion DSP of the voice conversion karaoke apparatus.

FIG. 3 is a diagram showing a configuration of music data used in the voice conversion karaoke apparatus.

FIG. 4 is a diagram showing a configuration of music data used in the voice conversion karaoke apparatus.

[Explanation of symbols]

30-DSP for voice conversion, 40-Original singing analysis unit, 41-Karaoke singing analysis unit, 44-Pitch conversion unit,
45-Volume converter

Claims (8)

[Claims] 1. A storage means for storing musical sound information and specific singing voice information corresponding to the progress of the musical sound information; a sound source means for reproducing the musical sound information; an input means for inputting a singing voice of a karaoke singer; A sound detecting means for detecting a sound volume from a sound signal, and a sound converting means for reproducing a specific singing voice with the progress of the musical tone information and controlling and outputting the sound volume of the specific singing sound based on the sound volume detected by the sound volume detecting means. A karaoke device with a voice conversion function, comprising: 2. The voice conversion function according to claim 1, wherein the voice conversion means corrects a part of the difference so that the volume of the specific singing voice approaches the volume detected from the singing voice. Karaoke equipment. 3. The voice conversion means includes means for detecting difference data between a volume of a specific singing voice and a volume detected from the singing voice, and a scoring means for scoring the singing using the difference data. The karaoke device with a voice conversion function according to claim 1 or 2. 4. A storage means for storing musical sound information and specific singing voice information corresponding to the progress of the musical sound information; a sound source means for reproducing the musical sound information; an input means for inputting a singing voice of a karaoke singer; A frequency detecting means for detecting a frequency from the sound, and a voice converting means for reproducing a specific singing voice with the progress of the musical tone information and controlling and outputting the frequency of the specific singing voice based on the frequency detected by the frequency detecting means, and A karaoke device with a voice conversion function, comprising: 5. The voice conversion function according to claim 4, wherein the voice conversion unit corrects a part of the difference so that the frequency of the specific singing voice approaches the frequency detected from the singing voice. Karaoke equipment. 6. The voice conversion means includes means for detecting difference data between a frequency of a specific singing voice and a frequency detected from the singing voice, and a scoring means for scoring the singing using the difference data. A karaoke device with a voice conversion function according to claim 4 or 5. 7. The karaoke apparatus with voice conversion function according to claim 4, wherein the voice conversion means includes means for shifting the frequency of the specific singing voice by one octave. 8. The speech converter according to claim 1, wherein the storage means is a means for storing, as the specific singing voice, phoneme information composed of consonants and vowels extracted from the waveform of the specific singing voice. Karaoke device with functions.