JP2000315100A - Harmony generating device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically add harmony to a vocal through a KARAOKE device. SOLUTION: The device is provided with an A/D converter circuit 43 which converts an audio signal of singing into a digital audio signal and an interval detecting circuit 5 which detects an interval from the digital audio signal. Further, the device is provided with an interval data generating circuit 67 which generates interval data of an interval in chord relation with the interval detected by the detecting circuit 45 and an interval converting circuit 46 which converts the digital audio signal outputted from the A/D converter circuit 43 into a digital audio signal of harmony according to the interval data. A mixer circuit 53 mixes and outputs the digital audio signal of harmony and the digital audio signal outputted from the A/D converter circuit 43.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a harmony generating device suitable for use in a karaoke apparatus.

[0002]

2. Description of the Related Art In a karaoke apparatus, echo processing (reverberation adding processing), frequency characteristic correction, and the like are performed on a singer's singing voice, that is, a vocal audio signal, in order to improve the effect of the singer's singing. ing.

[0003] These processes and corrections are widely used because they can provide an effect without a sense of incongruity irrespective of the song or lyrics sung.

[0004]

However, echo processing and correction of frequency characteristics are widely used and common, and conversely, a remarkable effect cannot be obtained.

[0005] The present invention is to solve such a problem.

[0006]

Therefore, according to the present invention, there is provided an A / D converter circuit for converting an audio signal of a singing voice for karaoke accompaniment into a digital audio signal, and a pitch detecting circuit for detecting a pitch of the digital audio signal. A pitch data generating circuit for generating pitch data of a pitch having a chord relationship with the pitch detected by the pitch detecting circuit; and a A / A based on the pitch data generated by the pitch data generating circuit. A pitch conversion circuit for converting the digital audio signal output from the D converter circuit into a harmony digital audio signal; a harmony digital audio signal output from the pitch conversion circuit; and an output signal from the A / D converter circuit A mixer that mixes the digital audio signal It is an harmony generating device and a service circuit. Accordingly, a harmony audio signal is formed from the singing audio signal, and this is added to the vocal audio signal and output.

[0007]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In FIG. 1, reference numeral 1 indicates a video CD in a karaoke format, and reference numeral 10 indicates a reproducing apparatus. As shown in FIG. 2A, the video CD 1 has a lead-in track at the beginning, similarly to a normal CD-ROM, and has N (N ≦ 99) data tracks TRK1 to TRKN and a lead-out track. Followed by a track. Then, of the tracks TRK1 to TRKN, the first track TR
The track TRK1 also describes that various information and data relating to the contents of the video CD are recorded in K1, and that the video CD is in the karaoke format.

Further, as shown in FIG. 2B, a karaoke data table for (N-1) music pieces is prepared for the first track TRK1. This data table is called a “sequence item table” and is independently configured for each music piece. That is, (N-1) sequence item tables SIT1 to SIT (N-1) are provided corresponding to each karaoke song.

FIG. 3 shows the table SITi (i = 1 to (N-
This shows the structure of 1)), and this table SITi has 64 item columns. And the items include the required ones,
Although there is an optional item, the length of the content in each item column is variable. For example, the item number 9 is an item column of a song title, and the content is text data indicating the song title. Alternatively, item number 18 is an item column for lyrics, and the lyrics are stored in the form of text data.

In item number 19, data indicating a scale (pitch) such as C, C #, or Cm is prepared. further,
The item columns of item numbers 22 to 31 are open to manufacturers,
Manufacturers can freely define and use them.

Further, the first track TRK2 has the first track TRK2.
The video signal data and the audio signal data of the karaoke of the music piece are recorded in a data compressed state, respectively. In this case, the video signal data is recorded, for example, by compressing a luminance signal and two color difference signals by the MPEG method. In the audio signal data, the left and right channel signals are formed into one block for each predetermined number of samples, and data is compressed and recorded for each block.

The video signal and the audio signal are recorded in sector units, but the order and the number (ratio) of the video signal sector and the audio signal sector are undefined. Therefore, for each sector, data indicating whether the signal recorded in the sector is a video signal or an audio signal is recorded at the head of each sector together with other information.

Similarly, the video signals and audio signals of the karaoke songs of the second to (N-1) th tracks are compressed on the third to Nth tracks TRK3 to TRKN, respectively. It is recorded in.

In the reproducing apparatus 10, a signal recorded on the video CD 1 is reproduced by the optical pickup 11, and the reproduced signal is reproduced by the reproducing amplifier 12.
, And is subjected to processing such as EFM demodulation and error correction. A signal subjected to this processing is supplied to a CD-ROM decoder circuit 14 where decoding processing is performed on a sector basis. A signal is output.

The data of the first track TRK1 among the output signals of the decoder circuit 14 is taken into the microcomputer 66 and used for the subsequent reproduction control.

The video signal data of the output signal of the decoder circuit 14 is taken into the MPEG decoder circuit 21 to decode the original video signal, that is, the luminance signal and two color difference signals. The decoded video signal is supplied to the D / A converter circuit 22.
The D / A conversion is performed on an analog signal, and the D / A converted video signal is supplied to an NTSC encoder circuit 23 to be encoded into an NTSC color composite video signal, and this video signal is output to a terminal 24. .

The audio signal data of the output signal of the decoder circuit 14 is transmitted to the MPEG decoder circuit 3
1, the original audio signal, that is, the audio signals of the left and right channels of karaoke (playing) are decoded, and the decoded audio signals are supplied to the pitch conversion circuit 32.

The pitch conversion circuit 32 adjusts the pitch of the audio signal supplied thereto to a range where the singer can utter, thereby facilitating singing. For this reason, a pitch operation section 61 is provided. When data specifying a pitch is input from the operation section 61, the data is supplied to the pitch conversion circuit 32 through the microcomputer 66, and the pitch of the audio signal supplied thereto is provided. Is converted to the pitch specified by the operation unit 61.

Further, in this example, an operation section 62 for adjusting the speed of the music is provided, and the output of the operation section 62 is supplied to a microcomputer 66, which controls the rotation speed of the CD 1 and the decoder circuit 21. , 31 are controlled to change the reproduction speed of the video signal and the audio signal in accordance with the output of the operation unit 62, and the signal change caused by the change in the speed is corrected.

The audio signal from the pitch conversion circuit 32 is supplied to the mixer circuit 53 through the equalizer circuit 33.
Supplied to In this case, for example, the equalizer circuit 33 divides the karaoke audio signal into a plurality of bands and corrects the level for each band.

An audio signal of a singer's vocal is transmitted from a microphone 41 through an amplifier 42 to an A / D converter.
The signal is supplied to the converter circuit 43 and A / D-converted into a digital audio signal. This signal is supplied to the mixer circuit 53 through a signal line of a mixer circuit 44 → an equalizer circuit 51 → an echo processing circuit 52 which will be described later. In this case, the equalizer circuit 51 divides the vocal audio signal into a plurality of bands and corrects the level for each band. The echo processing circuit 52 adds a desired reverberation to the vocal audio signal supplied thereto.

Thus, in the mixer circuit 53, the karaoke audio signal and the vocal audio signal are mixed, that is, the vocal is added to the karaoke audio signal.
The signal is supplied to the A-converter circuit 54, D / A-converted, and output to the terminal 55.

Further, in this case, in the present invention,
A harmony audio signal is formed from the vocal audio signal and added to the original vocal audio signal.

That is, the vocal audio signal from the A / D converter circuit 43 is supplied to a pitch detecting circuit 45, the pitch of the vocal is detected, and a detection signal of this pitch is supplied to a microcomputer 67, and the microcomputer 67 At 67, pitch data indicating a pitch having a chord relationship with the vocal pitch detected by the detection circuit 45 is created.

In this case, according to the chord theory, generally,
A pitch that is ± 3 degrees or ± 5 degrees apart from the vocal pitch has a chord relationship. However, according to an experiment, when a sound (harmony) with a pitch of +3 or +5 is added, the pitch of the singer tends to be drawn into the added pitch. In addition, when the pitch of the vocal is low, the harmony at -5 degrees is too low, and the effect as harmony is reduced.

Therefore, in this example, the microcomputer 67 creates pitch data indicating a pitch having a relationship of -3 degrees with respect to the vocal pitch detected by the detection circuit 45.

However, at this time, the pitch difference (frequency ratio) of a pitch three times lower than the vocal pitch differs depending on the scale of the music (karaoke). For example, FIG. 4A shows a scale in C minor, but a pitch three degrees lower than “Ab” is “F”, and the pitch difference is 300 cents. But,
As shown in FIG. 4B, in the scale in C major, "A"
The pitch three degrees lower than that is “F #”, but the pitch difference is 400 cents. Also, in the C minor of FIG. 4A,
“Eb”, which is three degrees lower than “G”, has a pitch difference of 400 cents.

Further consideration will be given using specific numerical values. That is, fv: frequency of the vocal audio signal Δf: frequency correction value by the pitch conversion circuit 32

Now, for example, if fv = 427.4 Hz (= Ab4 + 2.9%) Δf = + 50 cent (= + 2.9%), the vocal frequency at Δf = 0 is (X ** y indicates x to the power of y). And Ab lower 3
The degree is F, and when in C minor, the pitch difference is 300 cents from FIG. 4A.

For example, if fv = 403.5 Hz (= G4 + 2.9%) Δf = + 50 cent (= + 2.9%), the vocal frequency when Δf = 0 is Becomes The lower third of G is Eb, and when in C minor, the pitch difference is 400 cent from FIG. 4A.

Therefore, in the present invention, for example, FIG.
A table (pitch difference table) indicating the pitch difference of each pitch for each scale as shown in FIG. Also, data indicating the karaoke scale described in item No. 19 is extracted from the data of the table SITi of the data of the first track TRK1 loaded into the microcomputer 66, and the data of this scale is obtained. It is supplied to the microcomputer 67.

Then, in the microcomputer 67, the pitch difference table (FIG. 4) for each scale prepared in the microcomputer 67 is selected based on the scale data described in the item No. 19, and the selected pitch is selected. Using the difference table, pitch data for specifying a pitch having a relationship of -3 degrees with respect to the vocal pitch is formed.

The vocal audio signal from the A / D converter circuit 43 is supplied to the pitch conversion circuit 46, and the microcomputer 67 is supplied with pitch data from the microcomputer 67 to the pitch conversion circuit 46. The audio signal is converted into an audio signal having a pitch lower by three degrees, that is, a harmony audio signal, and the harmony audio signal is supplied to the mixer circuit 44 and mixed with the original vocal audio signal.

Accordingly, the vocal audio signal to which harmony is added is output from the mixer circuit 44, and the karaoke reproduced from the disc 1 is played back to the terminal 55 of the vocal with harmony. An audio signal is extracted.

Thus, according to the video CD 1 and the reproducing apparatus 10 of FIG. 1, karaoke can be enjoyed.
In this case, in particular, the video CD 1 and the playback device 10 described above are used.
According to this, harmony can be automatically added to the singer's vocals. For this reason, harmony can be added to a part of the lyrics that the user wants to sing with a particular mood, that is, a rust part, which is extremely effective. Moreover, by using the scale data included in the table SITi, it is possible to add harmony that matches the music theory.

According to the present invention, when the harmony is added to the vocals by mixing the harmony audio signal with the audio signal of the karaoke and recording it, the harmony is fixed. Therefore, for example, if the vocals disappear, the harmony disappears, and if the vocal pitch shifts, the harmony also shifts, which is effective as a consumer karaoke apparatus.

By the way, some karaoke songs may be transposed midway. Then, as described above, if a pitch difference table is selected according to the scale data described in item number 19 of the table SITi, the harmony does not form a chord from the transposed part, and rather unpleasant. turn into.

For this reason, in the example described below, it is possible to cope with the modulation in the middle of the music. Then, in this example, item numbers 22 to
For example, in the case of 31, the content of item number 22 is data indicating the time position of the modulation and the scale after the modulation.

That is, as shown in FIG. 5, an area of 8 bytes is allocated for one modulation, and the first byte and the second byte are, for example, as shown in FIGS. Data EDS and EDK indicating the scale are used. For example, when EDS = 20H (H indicates hexadecimal), it indicates that the scale after modulation is in major, and EDS = 21H
Indicates that the key is in minor. Also, EDK = 30H
Indicates that the scale after modulation is C, and EDK
= 31H indicates Db.

Further, the third to eighth bytes are data ET indicating minutes, seconds, and a frame at the time position of the modulation. The minute, second, and frame are absolute addresses indicating the reproduction position on the video CD1, that is, the video CD1.
The modulation position is designated by the data of the serial time written in the header at the head of each sector.

When the modulation is performed twice or more, the above 8-byte data EDS to ET are set as one set, and the data is repeated with the data contents corresponding to each modulation.

The data EDS to ET are stored in the video C
When D1 is set in the playback device 10, the video CD1
And is stored in the microcomputer 66. During playback of the music, the microcomputer 66
The modulation time position data ET of the data EDS to ET stored in the data CD is compared with the data of the continuous time reproduced in real time from each sector of the video CD 1. The scale data EDS and EDK after modulation, which are paired with the position data ET, are transferred to the microcomputer 67.

Then, the transferred scale data ED
By S and EDK, a pitch difference table for each scale prepared in the microcomputer 67 is selected,
Using the selected pitch difference table, pitch data for designating a pitch having a relationship of -3 degrees with respect to the vocal pitch is formed, and this pitch data is supplied to a pitch conversion circuit 46, and the post-modulated vocal. The harmony audio signal having a pitch three times lower than the audio signal of the harmony is formed.

Therefore, even if there is a transposition in the middle of a song,
The harmony can be a correct chord.

In the above description, the harmony audio signal can be independently subjected to frequency characteristic correction and echo processing. Further, the data EDS and EDK can be used not only for transposition but also for permission / prohibition of formation of a harmony audio signal. In this case, harmony can be added only to a specific portion of the music.

Further, in the above description, the present invention is applied to a video CD in a karaoke format and a reproducing apparatus therefor, but it is a medium having data indicating the musical scale of the karaoke together with the audio signal of the performance of the karaoke. For example, the present invention can be applied to, for example, a CD-DA, a laser disk (registered trademark), or a wired system.

[List of abbreviations used in this specification] A / D: Analog to Digital CD: Compact Disc CD-ROM: Compact Disc-ROM cent: centigrade EFM: Eight to Fourteen Modulation Hz: Hertz MPEG: Motion Picture Image Coding Experts Group NTSC: National Television System Committee; US Television System Committee ROM: Read Only Memory

[0048]

According to the present invention, harmony can be automatically added to the singer's vocal. For this reason, harmony can be added to a part of the lyrics that the user wants to sing with a particular mood, that is, a rust part, which is extremely effective. And video C
By using the scale data prepared in D1, harmony suitable for music theory can be added.

According to the present invention, when the harmony is added to the vocals by mixing and recording the harmony audio signal with the karaoke audio signal, the harmony is fixed. Therefore, for example, the harmony disappears when the vocals are lost, and the harmony shifts when the vocal pitch shifts, so that the karaoke apparatus is effective as a consumer karaoke apparatus.

Further, even if the transposition is performed in the middle of the music, it is possible to obtain the harmony that correctly forms the chord.

[Brief description of the drawings]

FIG. 1 is a system diagram showing an example of the present invention.

FIG. 2 is a diagram showing a track format.

FIG. 3 is a diagram illustrating an example of a data table.

FIG. 4 is a diagram for explaining a pitch difference.

FIG. 5 is a diagram showing an example of a data format.

FIG. 6 is a diagram showing an example of data contents.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Video CD, 10 ... Reproducing device, 11 ... Optical pickup, 13 ... Reproduction decoder circuit, 14 ... CD-ROM decoder circuit, 21 ... Video signal MPEG decoder circuit,
22 ... D / A converter circuit, 23 ... NTSC encoder circuit, 31 ... MPEG decoder circuit for audio signal, 32 ... Pitch conversion circuit, 33 ... Equalizer circuit, 41
... microphone, 43 ... A / D converter circuit, 44
... Mixer circuit, 45 ... Pitch detection circuit, 46 ... Pitch conversion circuit, 51 ... Equalizer circuit, 52 ... Echo processing circuit, 5
3: Mixer circuit, 54: D / A converter circuit, 61 and 62: Operation unit, 66 and 67: Microcomputer, SIT1 to SIT (N-1): Sequence item table

Claims (5)

[Claims] 1. An A / D converter circuit for converting an audio signal of a singing voice for a karaoke accompaniment into a digital audio signal, a pitch detection circuit for detecting a pitch of the digital audio signal, and a pitch detected by the pitch detection circuit. A pitch data generating circuit for generating pitch data of a pitch having a chord relationship with the digital audio signal output from the A / D converter circuit based on the pitch data generated by the pitch data generating circuit; A pitch conversion circuit for converting into a harmony digital audio signal; mixing the harmony digital audio signal output from the pitch conversion circuit with the digital audio signal output from the A / D converter circuit; A harmony generation device having a mixer circuit. 2. The harmony generation device according to claim 1, further comprising a memory circuit for storing a pitch difference table having different pitch differences. 3. The harmony generation device according to claim 1, wherein the pitch data generation circuit is configured to store the pitch difference stored in the memory circuit based on data indicating a scale added to a karaoke piece. A harmony generation device that selects a table, and based on the selected interval difference table, the interval data generation circuit generates interval data of intervals that are in a chord relationship with the intervals detected by the interval detection circuit. . 4. The harmony generation device according to claim 3, wherein the data indicating the scale added to the karaoke music piece is supplied from a recording medium. 5. The harmony generation device according to claim 3, wherein the data indicating the scale added to the karaoke music is supplied through a wired system.