JP3564775B2 - Karaoke device with vibrato addition function - Google Patents

Description

[0001]
[Industrial applications]
The present invention relates to a karaoke apparatus capable of adding vibrato to a singing voice signal of a karaoke song.
[0002]
[Prior art]
A karaoke apparatus currently in practical use has a function of giving various effects such as delay and reverb to a singing voice signal of karaoke to excite the singing. With these functions, the sound is added to the singing voice, and the singer's voice can be heard better.
[0003]
[Problems to be solved by the invention]
However, since this kind of effect is to superimpose the singing voice signal with a time shift, the function of correcting the singing pitch (so-called pitch) and the ambiguity of the pitch make the singer's pitch correspond to the original singer's pitch. I can't hide the deviation from the vocal pitch. Further, when singing a long note, the flat singing has a disadvantage that the change is poor and the singing does not swell.
[0004]
These can be resolved if the singer sings with the vibrato on his own, but vibrato is a fairly sophisticated technique, and it has been difficult for non-experts to master this technique.
[0005]
SUMMARY OF THE INVENTION It is an object of the present invention to provide a karaoke apparatus capable of giving an appropriate vibrato to a singing voice signal.
[0006]
[Means for Solving the Problems]
The invention according to claim 1 of the present application includes an operator operated by a singer, A syllable detecting means for detecting the start of a syllable of the singing voice signal; an envelope generating means for generating an envelope waveform each time the syllable detecting means detects the start of the syllable; Manipulator operation amount And the generated envelope waveform And vibrato adding means for adding vibrato to the singing voice signal of the singer according to.
[0007]
The invention according to claim 2 of this application is characterized in that the operator is constituted by a pressure sensor provided on a grip of a singing microphone.
[0008]
The invention according to claim 3 of this application is a means for storing a plurality of vibrato control data in chronological order according to the progress of a karaoke song, a reading means for sequentially outputting the vibrato control data during a karaoke performance, Syllable detecting means for detecting the start of a syllable of the singing voice signal, and envelope generating means for generating an envelope waveform each time the syllable detecting means detects the start of the syllable, Vibrato control data read And the generated envelope waveform And vibrato adding means for adding vibrato to the singing voice signal of the singer according to.
[0009]
[Action]
According to the first aspect of the present invention, an operator operated by the singer is provided, and the singer can operate the operator during the singing. When the singer operates this operator, vibrato is added to the singing voice signal input at that time. Therefore, the singer can add vibrato according to his / her preference by operating the operator, and even a singer who cannot add vibrato by vocalization can easily sing with vibrato.
[0010]
In the invention according to claim 2, the operating element is a pressure sensor provided on a grip of a singing microphone. In general, in karaoke singing, a scene where the singer puts emphasis and a scene where a large vibrato should be added often coincide, so if the singer's action is directly reflected in the vibrato, an accurate vibrato is given. be able to.
[0011]
According to the third aspect of the present invention, the vibrato according to the progress of the karaoke singing is automatically given. Since the beginner may not know the scene where the vibrato is applied, the singer can know the place by automatically adding the vibrato. Also, unlike a conventional effect device in which vibrato is uniformly added, since the vibrato is adjusted according to the progress of the song, the effect of raising the karaoke singing is great.
[0012]
【Example】
An embodiment of the present invention will be described with reference to the accompanying drawings. This karaoke apparatus is a sound source karaoke apparatus and has a communication function and a vibrato addition function. A sound source karaoke device is a karaoke device that generates a karaoke performance sound by driving the sound source device with music data. The music data is sequence data composed of a plurality of tracks, such as a performance data sequence for specifying a pitch and a sound generation timing. The communication function is a function that is connected to a host station via a communication line, downloads music data from the host station, and stores the music data in the hard disk device 17 (see FIG. 1). The hard disk device 17 can store music data for several hundred to several thousand songs. The vibrato addition function is a function of applying fine frequency modulation and amplitude modulation to a singing voice signal of a singer to make the singing sound good.
[0013]
FIG. 1 is a block diagram of the karaoke apparatus. The CPU 10 for controlling the operation of the entire apparatus includes a ROM 11, a RAM 12, a hard disk storage device (HDD) 17, an ISDN controller 16, a remote control receiver 13, a display panel 14, a panel switch 15, a sound source device 18, a sound data The processing unit 19, the effect DSP 20, the character display unit 23, the LD changer 24, the display control unit 25, and the voice processing DSP 30 are connected.
[0014]
The ROM 11 stores a system program, an application program, a loader, and font data. The system program is a program that controls the basic operation of the device and data transmission / reception with peripheral devices. The application program is a peripheral device control program, a sequence program, or the like. During a karaoke performance, a sequence program is executed by the CPU 10 to generate musical tones and reproduce images based on music data. The loader is a program for downloading music data from the host station. The font data is for displaying lyrics, song titles, and the like, and stores fonts of a plurality of types of characters such as Mincho and Gothic. In the RAM 12, a work area is set. A music data file is set in the HDD 17.
[0015]
The ISDN controller 16 is a controller for communicating with a host station via an ISDN line. The ISDN controller 16 downloads music data and the like from the host station. Further, the ISDN controller 16 has a built-in DMA circuit, and writes downloaded music data and application programs directly to the HDD 17 without passing through the CPU 10.
[0016]
The remote control receiver 13 receives the infrared signal transmitted from the remote control 31 and restores the data. The remote controller 31 includes a command switch such as a music selection switch, a numeric key switch, and the like. When the user operates these switches, an infrared signal modulated with a code corresponding to the operation is transmitted. The display panel 14 is provided on the front of the karaoke apparatus, and displays a currently playing music code, the number of reserved music, and the like. The panel switch 15 is provided on a front operation unit of the karaoke apparatus, and includes a music code input switch, a key change switch, and the like.
[0017]
The sound source device 18 forms a tone signal based on event data input from the CPU 10 during a karaoke performance. The event data is stored in a music track of the music data. Since a plurality of tone tracks are set as shown in FIG. 8, a plurality of event data are also input in parallel. The sound source device 18 receives these data and simultaneously forms a plurality of tone signals. The audio data processing unit 19 forms an audio signal having a specified length and a specified pitch based on audio data that is ADPCM data included in the music data. The audio data is obtained by directly digitizing and storing a signal waveform, such as a back chorus or a model singing sound, which is hardly generated electronically by the sound source device 18.
[0018]
On the other hand, the singing voice signal input from the singing microphone 27 is amplified by the preamplifier 28 and converted to a digital signal by the A / D converter 29, and then input to the voice processing DSP 30. In addition, the detection value of the pressure sensor 33 provided in the microphone 27 is input to the voice processing DSP 30 via the A / D converter 34. Further, various control information is input from the CPU 10. The voice processing DSP 30 gives effects such as vibrato to the singing voice signal of the singer based on the information. The singing voice signal provided with the effect is output to the effect DSP 20. The pressure sensor 33 provided on the microphone 27 may be configured as a push switch, and may be configured to press a finger. The pressure sensor 33 is wound around the entire grip to detect the entire pressure. Is also good.
[0019]
To the effect DSP 20, a musical sound signal formed by the sound source device 18, a sound signal formed by the sound data processing unit 19, and a singing sound signal to which vibrato is added by the sound processing DSP 30 are input. The effect DSP 20 gives effects such as reverb and echo to the input audio signal and musical sound signal. The type and degree of the effect given by the effect DSP 20 are controlled based on the event data (DSP control data) of the effect track of the music data. The DSP control data is input to the effect DSP 20 at a predetermined timing by the CPU 10 based on the DSP control sequence program. The tone signal and audio signal to which the effect has been added are converted to analog signals by the D / A converter 21 and then output to the amplifier / speaker 22. The amplifier / speaker 22 amplifies this signal and emits sound.
[0020]
The character display unit 23 generates character patterns such as song titles and lyrics based on the input character data. The LD changer 24 reproduces the background video of the corresponding LD based on the input video selection data (chapter number). The video selection data is determined based on the genre data of the karaoke song or the like. The genre data is written in the header of the music data, and is read by the CPU 10 when the karaoke performance starts. The CPU 10 determines which background video is to be reproduced based on the genre data, and outputs video selection data designating the background video to the LD changer 24. The LD changer 24 contains about five (120 scenes) laser disks and can reproduce about 120 scenes of background video. One background video is selected from among them according to the video selection data, and is output as video data. The character pattern and the video data are input to the display control unit 25. The display controller 25 superimposes these data in superimposition and displays them on the monitor 26.
[0021]
Next, a configuration of music data used for karaoke performance in the karaoke apparatus will be described with reference to FIGS. FIG. 8 is a diagram showing a configuration of music data. FIGS. 9 and 10 are diagrams showing a detailed configuration of music data.
[0022]
In FIG. 8, one piece of music data is composed of a header, a musical sound track, a lyrics track, an audio track, an effect track, a vibrato control track, and an audio data section.
[0023]
The header is a portion where various data related to the music data is written, and data such as a music title, a genre, a release date, and a performance time (length) of the music are written. The CPU 10 determines a background image to be displayed on the monitor 26 based on the genre data when executing the main sequence program, and transmits a chapter number of the image to the LD changer 24. The method of determining the background image is to select an image of a snowy country in the case of an enka on the theme of winter, and to select an image of a foreign country in the case of pops.
[0024]
As shown in FIGS. 9 and 10, each track from the musical tone track to the vibrato control track is composed of sequence data including a plurality of event data and duration data Δt indicating a time interval between the event data. The event data of each track is read out by the CPU 10 based on a sequence program during a karaoke performance. The sequence program is a program that counts Δt at a predetermined tempo clock, and when Δt is counted up, determines that it is the readout timing of event data subsequent thereto, and reads out the data and outputs it to a predetermined processing unit.
[0025]
In the musical sound track, tracks of various parts including a melody track and a rhythm track are formed. The CPU 10 outputs the event data read by the tone sequence program to the tone generator 18. The sound source device 18 selects a sounding channel based on the channel designation data included in the event data, and executes the event for the sounding channel.
[0026]
Hereinafter, although the sequence data of the lyrics track, the audio track, the effect track, and the vibrato control track are not tone data, these tracks are also described in the MIDI data format in order to unify the implementation and facilitate the work process. ing. The data type is a system exclusive message.
[0027]
The lyrics track is a track that stores sequence data for displaying lyrics on the monitor 26. The event data of the lyrics track is lyrics display data. In the description of the lyrics display data, one line of lyrics is usually handled as one event data. The lyrics display data is composed of one line of character data of the lyrics (character code and display coordinates of the character), display time of the lyrics (usually around 30 seconds), and wipe sequence data. The wipe sequence data is sequence data for changing the display color of the lyrics in accordance with the progress of the song, and includes the timing of changing the display color (the time from when the lyrics are displayed) and the change position (coordinates). ) Is data sequentially recorded over the length of one line.
[0028]
The audio track is a sequence track for specifying the generation timing of the audio data n (n = 1, 2, 3,...) Stored in the audio data section. The voice data section stores human voices such as back chorus and harmony singing that are difficult to synthesize by the sound source device 18. In the audio track, audio designation data and duration data Δt for designating a read interval of the audio designation data, that is, a timing of outputting the audio data to the audio data processing unit 19 and forming an audio signal are written. The voice designation data includes a voice data number, pitch data, and volume data. The audio data number is an identification number n of each audio data recorded in the audio data section. The pitch data and the volume data are data indicating the pitch and volume of the audio data to be formed. That is, a back chorus such as "Ah" or "Wawa Wawa" without words can be used many times by changing the pitch or volume, so one basic pitch and volume are stored and this data is stored. The pitch and volume are shifted based on and used repeatedly. The audio data processing unit 19 sets the output level based on the volume data, and sets the interval of the audio signal by changing the reading interval of the audio data based on the interval data.
[0029]
In the effect track, DSP control data for controlling the effect DSP 20 is written. The effect DSP 20 applies reverberation or other reverberation effects to signals input from the sound source device 18, the audio data processing unit 19, and the audio processing DSP 30. The DSP control data is composed of data designating the kind of the effect and data of the change amount thereof.
[0030]
Control data for controlling the audio processing DSP 30 is written in the vibrato control track. This data is input from the CPU 10 to the DSP 30 for audio processing. The voice processing DSP 30 applies vibrato to the singing voice signal based on the data. Vibrato is a combination of frequency modulation and amplitude modulation, and the DSP 30 for audio processing can also apply an effect of only frequency modulation or only amplitude modulation to an audio signal. This switching is performed based on control information from the CPU 10.
[0031]
2 to 7 are views for explaining the operation of the DSP 30 for audio processing. The voice processing DSP 30 forms a harmony voice signal for the input singing voice signal based on a built-in microprogram, and this microprogram can be represented as shown in FIG.
[0032]
FIG. 2 is a diagram showing a schematic configuration of the DSP 30. This DSP includes an FM modulator 40 for performing FM modulation on an input singing voice signal and an AM modulator 41 for performing AM modulation. How the FM modulator 40 and the AM modulator 41 are combined is described below. That is, a bus 42 for switching which path the singing voice signal is output, and a control unit 43 for inputting control information to the FM modulation unit 40, the AM modulation unit 41, and the bus 42 are provided.
[0033]
The bus 42 allows the input singing voice signal to pass through both or one of the FM modulation unit 40 and the AM modulation unit 41 by switching the transmission path, or to output the singing voice signal as it is without passing through both. It is. That is, the bus 42 can form a signal transmission path by arbitrarily combining the FM modulation unit 40 and the AM modulation unit 41. The original vibrato is to apply FM modulation and a minute AM modulation synchronized with the singing voice signal to the singing voice signal, but it is also possible to apply only one of the FM modulation and the AM modulation. The data can be output as it is without applying AM modulation. Further, the FM modulation section 40 and the AM modulation section 41 can be connected in parallel, and a signal to which only FM modulation has been added and a signal to which only AM modulation has been added can be output.
[0034]
FIG. 3 is a block diagram of the control unit 43. As shown in FIG. 2, the control unit 43 includes pressure data, which is a detection value of the pressure sensor 33, digitized by the A / D converter 34, vibrato control data read from the vibrato control track, and singing. An audio signal is being input.
[0035]
The pressure data is input to the converter 50. The converter 50 converts the input pressure data into frequency control data Frq for controlling a low frequency signal generated by the low frequency oscillator 51 and intensity control data Mg. This conversion is performed using a conversion table built in the conversion unit 50. The conversion table is as shown in FIGS. FIG. 7A is a pressure data-Frq conversion table. This table is set so that even when the pressure data is 0, Frq does not become 0, and when the pressure data increases, Frq slightly increases but Frq does not increase so much. This is because the range suitable for the vibrato frequency is not so wide (about 5 to 10 Hz), so that the change in this range is stopped. FIG. 3B is a pressure data-Mg conversion table. This table is set so as to output Mg almost in proportion to the pressure data, but does not output amplitude information when the pressure data is equal to or less than a certain value. This is because the singer sings while holding the microphone 27 in his hand, so that even if there is no intention to apply vibrato, it is considered that some pressure is applied to the pressure sensor 33. Therefore, such an offset is set because it is necessary to omit the minimum pressure for holding the microphone 27. The frequency control data Frq determined by such a conversion table is output to the low frequency oscillator 51. The intensity control data Mg is output to the multiplier 57.
[0036]
The low-frequency oscillator 51 oscillates and outputs a low-frequency signal (sine wave) having a frequency corresponding to the input frequency control data Frq, and is input to the coefficient multiplier 52.
[0037]
On the other hand, the singing voice signal input to the control unit 43 is input to the syllable detection unit 55. The syllable detection unit detects a syllable break of the singing voice. In FIG. 5, the lyrics "Akashiya no" consist of five syllables, "a", "ka", "shi", "ya", and "no", respectively. It can be detected by an increase in white noise component due to switching to a consonant, a change in fundamental frequency, and the like. When the syllable detector 55 detects a syllable break, that is, the start of a new syllable, it outputs a syllable start signal to the envelope generator 56.
[0038]
The envelope generator 56 generates the envelope waveform data En shown in FIG. 4C using the syllable start signal as a trigger. The characteristic of this envelope waveform is that there is a delay for a certain time, then it gradually increases, and after reaching the upper limit, the value is maintained. In other words, in general singing, when singing short lyrics, vibrato is not applied, and when vibrating long notes, deep vibrato is applied gradually. is there. The envelope waveform data En generated by the envelope generator 56 is input to the multiplier 57.
[0039]
As described above, the intensity control data Mg output from the converter 50 and the envelope waveform data En generated by the envelope generator 56 are input to the multiplier 57. The multiplier 57 multiplies the data to generate depth control data Dep, and inputs the depth control data Dep to the coefficient multiplier 52 as a coefficient. The depth control data Dep reflects the singer's intention (Mg) on the vibrato technique (En). The coefficient multiplier 52 multiplies the low-frequency signal input from the low-frequency oscillator 51 by this coefficient to generate a vibrato waveform signal. This vibrato waveform signal is output to FM modulation section 40 and AM modulation section 41.
[0040]
The vibrato control data read from the vibrato control track is also input to the conversion unit 50 in the same manner as the pressure data. The conversion unit 50 uses the vibrato control data together with the pressure data or independently, in accordance with an instruction from the CPU 10.
[0041]
That is, (1) the vibrato control data is completely ignored. {Circle around (2)} Only when there is no input of pressure data by the singer, control is performed by using this data. {Circle around (3)} An average value of the pressure data and the vibrato control data is obtained, and is used as data to be provided to the conversion table. {Circle around (4)} Vibrato control data is used for all control regardless of pressure data. It is assumed that the singer can select any of these control methods by setting the panel switch 15. When the control is performed using the vibrato control data, the handling of the data is the same as the pressure data.
[0042]
FIG. 5 is a diagram showing a configuration of the FM modulator 40. The FM modulator includes a shift register 60 for inputting a singing voice signal and a tap assigner 61 for reading data from an arbitrary tap 60a of the shift register. The tap assigner 61 determines a read tap based on the vibrato waveform signal input from the control unit 43. That is, the read tap is moved back and forth according to the instantaneous value of the amplitude of the vibrato waveform signal. Specifically, as the instantaneous value is larger, the readout tap is moved toward the front end (leftward in the drawing), and as the instantaneous value is smaller, the readout tap is moved toward the rear end (rightward in the drawing). By performing such control, it is possible to output a singing voice signal in which the frequency of a waveform obtained by differentiating the vibrato waveform signal changes. In addition, by using the instantaneous value of the amplitude of the vibrato waveform signal as the moving speed of the readout tap, it is possible to perform frequency modulation according to the vibrato waveform signal.
[0043]
FIG. 7 is a diagram showing a configuration of the AM modulator 41. The AM modulator 41 includes a coefficient multiplier 62, an adder 63, and a multiplier 64. The singing voice signal is input to a coefficient multiplier 62 and an adder 63. The coefficient multiplier 62 multiplies the input singing voice signal by a coefficient and outputs the result to the adder 63. The coefficient input to the coefficient multiplier 62 is a vibrato waveform signal multiplied by the compression coefficient a in the multiplier 64. The compression coefficient a is a value less than 1, and is used to adjust the AM modulation by the AM modulating unit 41 so as not to be large as compared with the FM modulation. With the above configuration, the adder 63 adds a low-level singing voice signal whose level is periodically changed with a vibrato waveform signal (low-frequency signal) to a normal singing voice signal, and is output. The signal is obtained by repeating the same level change, that is, tremolo.
[0044]
According to the above configuration, the vibrato can be controlled by the power of the singer holding the microphone 27 with respect to the singing voice signal, and the vibrato is deeply applied when the singer holds the microphone 27 strongly, in accordance with the singing state of the singer. You can control.
[0045]
In the DSP 30 for audio processing, an envelope is automatically added. However, it is also possible to add a vibrato without adding an envelope while operating the singer. Further, the conversion table and the envelope waveform are not limited to those shown in FIG. 4, and for example, the offset of the pressure data-Mg conversion table may be eliminated.
[0046]
In the above embodiment, the same vibrato waveform signal is input to the FM modulator 40 and the AM modulator 41, but the signal waveforms input to both may be different. Further, even when the same waveform signal is input, the modulation effect when both are used can be changed by shifting the phase.
[0047]
【The invention's effect】
As described above, according to the present invention, the singer operates the operating element while singing, whereby vibrato is given to the singing voice signal of the singer. As a result, the singer can add vibrato according to his / her preference, and even a singer who cannot add vibrato by vocalization can easily sing with vibrato.
[0048]
Further, according to the present invention, since the operation element is a pressure sensor provided on the grip of the singing microphone, the vibrato is strongly applied when the singer squeezes the microphone strongly, and the operation is easy. In addition, the act of the singer at the time of singing can be reflected on the vibrato as it is, and an accurate vibrato can be given.
[0049]
Also, according to the present invention, by automatically adding a vibrato according to the progress of karaoke singing, even a beginner can sing with a vibrato according to the song, and the conventional method of uniformly adding vibrato Can greatly excite the karaoke singing compared to the effect device of the above.
[Brief description of the drawings]
FIG. 1 is a block diagram of a voice conversion karaoke apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram showing a configuration of a voice processing DSP of the voice conversion karaoke apparatus.
FIG. 3 is a diagram showing a configuration of a control unit of the voice processing DSP.
FIG. 4 is a diagram showing a conversion table and an envelope utterance table of the control unit.
FIG. 5 is a diagram illustrating a syllable detection operation of the control unit.
FIG. 6 is a diagram showing a configuration of an FM modulation unit of the audio processing DSP.
FIG. 7 is a diagram showing a configuration of an AM modulation unit of the DSP for audio processing.
FIG. 8 is a diagram showing a configuration of music data used in the voice conversion karaoke apparatus.
FIG. 9 is a diagram showing a configuration of music data used in the voice conversion karaoke apparatus.
FIG. 10 is a diagram showing a configuration of music data used in the voice conversion karaoke apparatus.
[Explanation of symbols]
30-DSP for voice processing, 33-pressure sensor, 40-FM modulator,
41-AM modulator, 50-converter

Claims (3)

Operators operated by the singer,
Syllable detection means for detecting the start of a syllable of the singing voice signal;
An envelope generating means for generating an envelope waveform each time the syllable detecting means detects the start of a syllable;
A vibrato adding means for adding vibrato in singing voice signal of the singer in accordance with the operation amount and the generated envelope waveform of the operating element,
A karaoke device with a vibrato addition function, comprising: 2. The karaoke apparatus with a vibrato addition function according to claim 1, wherein the operator is a pressure sensor provided on a grip of a singing microphone. Means for storing a plurality of vibrato control data in chronological order in accordance with the progress of the karaoke song;
Reading means for sequentially outputting the vibrato control data during a karaoke performance;
Syllable detection means for detecting the start of a syllable of the singing voice signal;
An envelope generating means for generating an envelope waveform each time the syllable detecting means detects the start of a syllable;
Vibrato adding means for adding vibrato to the singing voice signal of the singer according to the read vibrato control data and the generated envelope waveform ,
A karaoke device with a vibrato addition function, comprising:

Images