WO2006104162A1

WO2006104162A1 - Musical composition data adjuster

Info

Publication number: WO2006104162A1
Application number: PCT/JP2006/306342
Authority: WO
Inventors: Shinya Koizumi; Yuuji Murai; Yoichi Yamada; Tatsuya Shiraishi
Original assignee: Pioneer Corporation
Priority date: 2005-03-28
Filing date: 2006-03-28
Publication date: 2006-10-05

Abstract

A musical composition data adjuster is for adjusting the musical feature of musical composition data and can be applied to, e.g., a device for reproducing musical composition data from a recording medium. Musical composition data is subjected to frequency analysis, and the frequency characteristic is detected. From the detected frequency characteristic, the variation of the musical tone constituting the musical composition data from the standard musical scale is computed. The standard musical scale is a musical scale used as standards for adjustment of musical composition data, for example, the equal temperament scale. According to the variation, a pitch shift value required to cause the musical tone to agree with the standard musical scale is computed. According to the computed pitch shift value, the musical composition data is pitch-shifted, and the musical tone of the musical composition data can be made to agree with the standard musical scale. By using frequency analysis, small variation of the musical composition from the standard musical scale can be detected, and automatic tuning of musical composition data is possible.

Description

Specification

Music data adjustment device

Technical field

The present invention relates to a method for adjusting music data with respect to a reference scale or other music.

Background art

[0002] Pitch shifters are used to match music to certain standards such as an average scale. A pitch shifter is a device that adjusts the pitch (tone level) of a musical sound by changing the frequency of the musical sound that composes the music. If the musical piece deviates from a standard scale such as the average temperament scale, a person operates the pitch shifter while listening to the musical piece, and adjusts the pitch (“tuning” t).

[0003] In addition, music data of a plurality of music sources are mixed and output using a mixer. For example, a disc jockey or the like uses a mixer to crossfade two songs when switching the song being played. The music currently being played is called “one master song”, and the next music to be played is called “slave music”. The disc jockey adjusts the speed of the slave song to match the rhythm of the master song and the slave song so that the rhythm does not change before and after switching songs, then operates the mixer to fade out the master song and simultaneously play the slave song. Fade in. In this case, if the master song and slave song keys are different, the disc jockey listens to both songs to determine the key, and operates the pitch shifter to match the slave song key to the master song key. Mix. In this way, by mixing not only the rhythm but also the key and mixing the master song and the slave song, it becomes possible to mix in a musically harmonious way. This kind of mixing that matches the harmonics is also called “Noichiichi Monic Mix”.

[0004] Patent Document 1 describes a technique for creating music data by detecting chords in an input audio signal. Patent Document 2 describes a method for detecting a music structure by detecting a chord in a music and analyzing the progress of the chord.

Patent Document 1: Japanese Patent Application Laid-Open No. 2004-184510 Patent Document 2: Japanese Patent Application Laid-Open No. 2004-184769

[0006] However, the accuracy with which humans can listen to music and detect deviations from the standard scale is limited in terms of human ability. Also, the task of listening to two songs by a disc jockey, etc., and shifting and mixing the keys of the slave songs to match the keys requires a high degree of musical sense and device operation skills.

Disclosure of the invention

Problems to be solved by the invention

[0007] The problem to be solved by the present invention is exemplified as described above. The present invention provides a music data adjustment device that can automatically match musical characteristics to a reference scale or other music data by analyzing music data musically. Let it be an issue.

Means for solving the problem

[0008] In a preferred embodiment of the present invention, the music data adjustment device configures the music data based on the frequency characteristics and a frequency analysis unit that frequency-synthesizes the music data and detects frequency characteristics. Based on the deviation amount, a deviation amount calculation unit for calculating a deviation amount of the reference scale force of the musical sound, and a pitch shift amount for shifting the pitch of the music data so that the musical tone matches the reference scale. And a pitch shift amount calculation unit for calculating.

[0009] The music data adjustment device described above is a device that adjusts musical characteristics of music data, and can be applied to, for example, a device that reproduces music data of a recording medium. The music data is subjected to frequency analysis and frequency characteristics are detected. Based on the obtained frequency characteristics, a deviation amount indicating how much the musical sound constituting the music data is deviated from the reference scale force is calculated. The reference scale is a scale used as a reference in the adjustment of music data, and examples thereof include an average scale. Further, based on the deviation amount, a pitch shift amount necessary for matching the musical tone with the reference scale is calculated. Therefore, the musical sound of the music data can be matched with the reference scale by pitch-shifting the music data according to the obtained pitch shift amount. In this way, by using frequency analysis, it is possible to detect a small shift in music with respect to the reference scale, and to automatically detect music data. Tuning is possible.

[0010] In one aspect of the music data adjusting apparatus, pitch shift means for shifting the pitch of the music data based on the pitch shift amount can be provided. As a result, music data can be adjusted in one device.

[0011] In a preferred example of the music data adjustment device, the frequency analysis unit converts the music data into a frequency domain signal, and a plurality of amplitude peak values from the frequency domain signal. And a frequency characteristic calculator that calculates the frequency characteristics by calculating frequencies of a plurality of musical sounds constituting the music data based on the plurality of peak values.

In this example, music data is first converted into a frequency domain signal by a technique such as FFT. A plurality of peak values, each corresponding to a musical tone, are detected from the frequency domain signal. Then, the frequency of the musical sound constituting the music data is calculated based on the plurality of peak values, and the frequency characteristic is calculated.

[0013] In another preferred embodiment of the present invention, the music data adjustment device performs a frequency analysis on the first music data and detects a first frequency characteristic, and the first frequency analysis unit. A first deviation amount calculating unit for calculating a first deviation amount from a reference scale of a musical sound constituting the first music data based on a frequency characteristic; the first frequency characteristic and the first frequency characteristic; A key deriving unit for deriving a key of the first music data based on a deviation amount; a second frequency analyzing unit for analyzing a frequency of the second music data and detecting a second frequency characteristic; Based on the frequency characteristic of 2, a second deviation amount calculation unit for calculating a second deviation amount of the reference scale force of the musical sound constituting the second music data, the second frequency characteristic and the second A key deriving unit for deriving a key of the second music data based on the amount of shift of Based on the first shift amount, the second shift amount, the first music data key, and the second music data key, the first music data key and the second music data And a pitch shift amount calculation unit for calculating a pitch shift amount for shifting the pitch of the second music data so that the keys coincide with each other.

[0014] The music data adjusting device adjusts two music data. The first music data is frequency-analyzed and the frequency characteristics are calculated, and the first music data is constructed based on the frequency characteristics. A first shift amount indicating a shift in the reference scale force of the composed music is detected. Also, the key of the first music data is derived based on the frequency characteristics and the first shift amount. Similarly, the second music data is subjected to frequency analysis and frequency characteristics are calculated, and based on the frequency characteristic, a second quantity indicating a deviation from the reference scale of the music constituting the second music data is detected. In addition, the key of the second music data is derived based on the frequency characteristics and the second shift amount.

[0015] Then, based on the first shift amount, the second shift amount, the first music data key, and the second music data key, at least the pitch of the second music data is determined. A pitch shift amount for shifting is calculated. The pitch shift amount is calculated so that the key of the first music data matches the key of the second music data. Therefore, the keys of the first music data and the second music data can be automatically matched by pitch-shifting at least the second music data.

[0016] Thus, for example, if the music data adjustment device described above is applied to a music playback device or mixer used by a disc jockey, the keys of the two songs can be automatically matched when switching music. Transition of a simple song becomes possible.

[0017] In one aspect of the music data adjustment apparatus, the pitch shift amount calculation unit is based on the first shift amount! /, And thus the musical tone of the first music data matches the reference scale. Based on the first pitch shift amount calculation unit for calculating the first pitch shift amount for shifting the pitch of the first music data and the second shift amount, the second music data A second pitch shift amount calculating unit for calculating a second pitch shift amount for shifting the pitch of the second music data so that the musical tone of the second musical piece coincides with a reference scale, and the first music data And the second music data key to shift the pitch of the second music data so that the key of the first music data and the key of the second music data match. Third pitch shift for calculating the third pitch shift amount A volume calculation unit.

[0018] In this aspect, first, based on the first pitch shift amount, scale correction is performed to match the first music data with the reference scale. Similarly, based on the second pitch shift amount, scale correction is performed to match the second music data with the reference scale. And the third pitch Based on the amount of music, a pitch shift, that is, a key shift, for matching the keys of the first and second music data is performed. In this way, the first music data and the second music data can further match the keys with each other in a state where they match the reference scale.

[0019] Also, in this aspect, the music data adjustment device includes a first pitch shift means that shifts a pitch of the first music data based on the first pitch shift amount, and the second pitch data. Based on the pitch shift amount, the second pitch shift means for shifting the pitch of the second music data, and the pitch of the second music data after being shifted by the second pitch shift means, A third pitch shift means for shifting based on the third pitch shift amount, the first music data after the shift by the first pitch shift means, and the shift by the third pitch shift means And a mixer that mixes and outputs the second music data later. As a result, even when the first music data and the second music data are played back simultaneously or when switched and played back, it is possible to play without feeling uncomfortable.

[0020] In another aspect of the music data adjustment device, the pitch shift amount calculation unit may be configured such that the musical tone of the first music data matches a reference scale based on the first shift amount. A first pitch shift amount calculating unit for calculating a first pitch shift amount for shifting the pitch of the first music data, the second shift amount, the key of the first music data, and Based on the key of the second music data, the musical tone of the second music data matches the reference scale, and the key of the first music data and the key of the second music data match. And a second pitch shift amount calculating unit for calculating a second pitch shift amount for shifting the pitch of the second music data.

In this aspect, first, based on the first pitch shift amount, scale correction is performed to match the first music data with the reference scale. Then, based on the second shift amount, the key of the first music data, and the key of the second music data, the tone of the second music data matches the reference scale, and the first music data The pitch of the second music data is shifted so that the key matches the key of the second music data. As a result, the scale correction of the second music data and the key shift can be performed simultaneously.

[0022] Further, in this aspect, the music data adjustment device described above has the first pitch shift amount. A first pitch shift means for shifting the pitch of the first music data based on the second pitch shift means for shifting the pitch of the second music data based on the second pitch shift amount; A mixer that mixes and outputs the first music data after the shift by the first pitch shift means and the second music data after the shift by the second pitch shift means. be able to. As a result, even when the first music data and the second music data are played back at the same time, or when the music data are switched and played back, it is possible to play without any sense of incongruity.

[0023] In another aspect of the music data adjustment apparatus, the pitch shift amount calculation unit includes the first shift amount, the second shift amount, the first music data key, and the first music data key. On the basis of the music data key of 2, the music of each of the first music data and the second music data matches a reference scale, and the key of the first music data and the second music data The pitch of the second music data is shifted so that the music data keys match.

[0024] In this aspect, based on the first shift amount, the second shift amount, the first song data key, and the second song data key, the first song data and the second song data The pitch of the second music data is shifted so that each musical tone matches the reference scale, and the key of the first music data and the key of the second music data match. That is, the scale correction of the first music data and the second music data and the key shift of the second music data can be performed simultaneously.

[0025] Also, in this aspect, the music data adjustment device includes a pitch shift means for shifting the pitch of the second music data based on the pitch shift amount, and the first music data. And a mixer that outputs the data and the second music data after the pitch shift by the pitch shift means. As a result, even when the first music data and the second music data are played back at the same time, or when the music data is switched and played back, it becomes possible to play with no sense of incongruity.

[0026] In a preferred example of the music data adjustment device, each of the first and second frequency analysis units includes: a conversion unit that converts the music data into a frequency domain signal; and a frequency domain signal. A peak detector for detecting a plurality of amplitude peak values; and calculating frequencies of a plurality of musical sounds constituting the music data based on the plurality of peak values. A frequency characteristic calculator that calculates the frequency characteristic.

[0028] In another preferable example of the music data adjusting device, each of the first and second key deriving units may perform a correction of the deviation amount based on the frequency characteristic and the deviation amount. A number of musical tones, a chord detector that detects the composed chords, and based on the detected chords

And a key determination unit for determining a key of the music data.

[0029] In this example, a chord is detected based on the frequency characteristics and shift amount of the music data, and the key of the music data is determined based on the detected chord.

Brief Description of Drawings

FIG. 1 is a block diagram showing a configuration of a music data adjustment apparatus according to a first embodiment of the present invention.

FIG. 2 is a graph showing an example of frequency characteristics of music data.

FIG. 3 is a chart showing the frequency of the average temperament scale.

FIG. 4 is a block diagram showing a configuration of a music data adjustment apparatus according to a second embodiment of the present invention.

[Figure 5] Shows an example of music data level used for chord detection.

[Figure 6] Shows an example of a chord table.

FIG. 7 is a block diagram showing a configuration of a music data adjustment apparatus according to a modification of the second embodiment.

FIG. 8 is a block diagram showing a configuration of a music data adjustment device according to another modification of the second embodiment.

Explanation of symbols

[0031] 10, 500, 501, 502 Music data adjustment device

11, 111, 211 FFT section

12, 112, 212 Peak detector 13, 113, 213 Frequency characteristics calculator

14, 114, 214 Frequency deviation calculation section

15, 115, 215 Pitch shift amount calculation unit

20, 120, 152, 151, 156, 220 Pitch shifter

10, 110, 210 Adjustment device

116, 216 Chord detector

117, 217 Chord progression pattern deriving section

118, 218 Key judgment part

150, 153, 155 Pitch shift amount calculation unit

154 mixer

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[0033] [First embodiment]

FIG. 1 shows a schematic configuration of a music data adjusting apparatus according to the first embodiment of the present invention. The music data adjustment device 10 of the first embodiment is used to adjust the input music data so as to match a certain reference scale (referred to as “reference scale”) such as an average temperament scale.

As shown in FIG. 1, the music data adjustment device 10 includes an FFT unit 11, a peak detection unit 12, a frequency characteristic calculation unit 13, a frequency shift amount calculation unit 14, and a pitch shift amount calculation unit 15. And. The music data adjustment device 10 performs frequency analysis on the input music data Din to calculate a shift amount of the reference scale force of the input music data Din, and calculates a pitch shift amount D5 corresponding to the shift amount to calculate the pitch shifter. Supply to 20. The pitch shifter 20 adjusts the pitch of the input music data Din based on the pitch shift amount D5, and matches the musical sound constituting the input music data Din with the reference scale. Then, the pitch shifter 20 outputs the corrected music data to the outside as output music data Dout.

In the example of FIG. 1, the music data adjustment device 10 itself is configured not to have a pitch shift function, and the pitch is adjusted by an external pitch shifter 20. Instead, the music data adjustment device 10 is configured to include a pitch shifter. May be.

Hereinafter, the internal configuration of the music data adjustment device 10 will be described in detail. An FFT (Fast Fourier Transform) unit 11 converts the input music data Din, which is a time domain signal, into a frequency domain signal D1 in order to analyze the input music data Din in the frequency domain. The frequency domain signal D 1 is sent to the peak detector 12.

[0037] The peak detection unit 12 detects a plurality of peak values of amplitude included in the frequency domain signal D1. An example of the frequency domain signal D1 is shown in FIG. In Fig. 2, the horizontal axis represents frequency, and the vertical axis represents level. As shown in the figure, the frequency domain signal D1 includes a plurality of amplitude peak points corresponding to a plurality of musical sounds constituting the input music data Din. The peak detection unit 12 detects the plurality of peak points and supplies a signal D2 indicating each peak point to the frequency characteristic calculation unit 13.

[0038] The frequency characteristic calculation unit 13 acquires each frequency fl, f2, ... corresponding to a plurality of peak points included in the signal S2. These frequencies correspond to the frequencies of the multiple songs that make up the input song data Din. Further, the frequency characteristic calculation unit 13 calculates the scales (C, D, E, F, G, A, B) of one octave of the input music data Din based on the frequencies fl, f2,. Each frequency is calculated and supplied to the frequency shift amount calculation unit 14 as a signal D3. Thus, the FFT unit 11, the peak detection unit 12, and the frequency characteristic calculation unit 13 constitute a frequency analysis unit in the present invention.

[0039] The frequency deviation calculation unit 14 calculates the deviation D4 of the octave of the input music data with respect to the reference scale. Figure 3 shows the frequency of the average scale as an example of the reference scale. Figure 3 shows the frequency of the average temperament scale for one octave including the reference “A” sound (440 Hz). The frequency deviation calculation unit 14 compares the frequency of each scale constituting one octave of the input music data Din supplied from the frequency characteristic calculation unit 13 with the frequency of the average temperament scale shown in FIG. Is calculated as a frequency value. Further, the frequency shift amount calculation unit 14 converts the frequency value of the obtained shift amount into “cent”. Cent is a unit of pitch, and one octave is equivalent to 1200 cents. Thus, a semitone of the average scale corresponds to 100 cents. For example, if the corresponding musical tone in the input music data is shifted by the frequency “x” with respect to the frequency “f” of an average temperament scale, the amount of deviation D4 Is

D4 = 12001og {(f + x) / f} [cent] (Formula 1)

2

Is calculated as Thus, the frequency shift amount calculation unit 14 calculates the shift amount D4 of the input music data Din from the reference average temperament scale in cents and supplies it to the pitch shift amount calculation unit 15.

[0040] The pitch shift amount calculation unit 15 should change the pitch (sound pitch) of the input music data Din in order to match the input music data Din with the average scale based on the deviation D4. D5 is calculated and supplied to the pitch shifter 20. For example, when the shift amount D4 of the input music data Din is “−10 cents”, the pitch shift amount calculation unit 15 generates “+10 cents” as the pitch shift amount D5 and supplies it to the pitch shifter 20. The pitch shift here is a pitch shift for matching the input music data to the reference scale, and this is also called “scale correction”.

[0041] The input music data Din is input to the pitch shifter 20. Therefore, the pitch shifter 120 shifts the pitch of the input music data Din based on the pitch shift amount D5, and generates and outputs the output music data Dout. In this way, the output music data Dout is adjusted to match the reference scale. This process is also called “tuning”.

[0042] As described above, according to the first embodiment of the present invention, even if the input musical composition data is shifted in the reference scale force such as the average temperament scale, the tuner is automatically matched with the reference scale. Can be performed. Therefore, accurate tuning is possible without relying on human hearing.

[0043] In the above embodiment, the average temperament scale is used as the reference scale, but the application of the present invention is not limited to this. In addition to the average temperament scale, if there is a standard scale or sound sequence, tuning is possible. In that case, if the frequency characteristic calculation unit 13 calculates the amount of frequency deviation based on the frequency table that constitutes the reference scale and the sound sequence instead of the frequency of the average scale shown in FIG. Good

[0044] [Second embodiment]

Next, a second embodiment of the present invention will be described. Music data adjustment according to the second embodiment The device matches each of the two input music data with a reference scale such as an average temperament scale, and matches the keys of the two input music data.

FIG. 4 shows a configuration of the music data adjusting device according to the second embodiment. As shown in the figure, the music data adjustment device 500 roughly includes a first adjustment device 100, a second adjustment device 200, a pitch shift amount calculation unit 150, a pitch shifter 152, and a mixer 154.

[0046] The first adjustment device 100 receives the input music data D1, and outputs the music data D19 corrected to match the reference musical scale to the mixer 154. The first adjustment device 100 determines the key of the input music data D1 and supplies it to the pitch shift amount calculation unit 150 as key data D18. The first adjustment device functions as a master-side adjustment device.

[0047] The second adjustment device 200 has basically the same configuration as the first adjustment device. The second adjusting device 200 receives the input music data D2, and outputs the music data D29 corrected to match the reference musical scale to the pitch shifter 152. The second adjustment device 200 determines the key of the input music data D2 and supplies it to the pitch shift amount calculation unit 150 as key data D28. The second adjustment device functions as a slave-side adjustment device.

[0048] The pitch shift amount calculation unit 150 matches the key of the input music data D2 with the key of the input music data D1 based on the key data D18 of the input music data D1 and the key data D28 of the input music data D2. Then, a pitch shift amount D50 to be performed on the input music data D2 is calculated and supplied to the pitch shifter 152. This pitch shift is a shift for matching the keys of the two music data, and is also called “key shift”.

[0049] The pitch shifter 152 matches the input music data D1 with the key by performing a pitch shift on the music data D29 that has been corrected to match the reference scale based on the pitch shift amount D50. The music data D52 is supplied to the mixer 154. The mixer 154 mixes the music data D19 and the music data D52 and outputs the result as output music data Dout. As described above, the music data D19 is music data obtained by correcting the input music data D1 so that it matches the reference scale. In addition, the music data D52 is corrected so that the input music data D2 matches the reference scale, and the input music data D1 and the key This is music data obtained by shifting the pitch to match. Therefore, the mixer 154 mixes two music data that match the reference scale and have the same key, and outputs it as output music data Dout. Therefore, the music data D19 and D52 are harmonically mixed and output in a musically natural state.

[0050] Next, the first adjusting device 100 will be described in detail. As illustrated, the first adjustment device 100 includes an FFT unit 111, a peak detection unit 112, a frequency characteristic calculation unit 113, a frequency shift amount calculation unit 114, a pitch shift amount calculation unit 115, and a chord detection unit. 116, a chord progression pattern derivation unit 117, and a key determination unit 118. Among these, the FFT unit 111, the peak detection unit 112, the frequency characteristic calculation unit 113, the frequency shift amount calculation unit 114, and the pitch shift amount calculation unit 1 15 are the FFT unit 11, the peak detection unit 12, The frequency characteristic calculation unit 13, the frequency shift amount calculation unit 14, and the pitch shift amount calculation unit 15 are the same, and have a role of pitch shifting so that the input music data D1 matches the reference scale. That is, the FFT unit 111 converts the input music data D1 into a frequency domain signal Dl 1, and the peak detection unit 112 detects a plurality of amplitude peak points. The frequency characteristic calculator 113 calculates the octave frequency characteristic of the input music data D1 based on the peak point of the amplitude, and the frequency shift calculator 114 calculates the frequency shift based on the frequency characteristic and the frequency of the reference scale. Calculate the quantity. Then, the pitch shift amount calculation unit 115 calculates the pitch shift amount based on the frequency shift amount, and supplies it to the pitch shifter 120. The pitch shifter 120 changes the pitch of the input music data D1 according to the pitch shift amount calculated by the pitch shift amount calculation unit 115. Thus, music data D19 matching the reference scale is generated and supplied to the mixer 154.

On the other hand, the chord detecting unit 116, the chord progression pattern deriving unit 117, and the key determining unit 118 have a role of deriving the key of the input music data D1. The signal D13 indicating the frequency characteristic calculated by the frequency characteristic calculation unit 113 and the shift amount D14 generated by the frequency shift amount calculation unit 114 are input to the chord detection unit 116. The chord detection unit 116 analyzes the frequency characteristics of the input music data D1 in consideration of the shift amount D14 for each predetermined time width, and detects a musical sound corresponding to the average temperament scale. Since the frequency of the average scale is known as shown in FIG. 3, the signal level corresponding to each frequency is detected as the level of each scale. Easily detected An example of the sound level is shown in Fig. 5.

[0052] A chord is a combination of a plurality of sounds, and the sound constituting each chord (hereinafter referred to as "component sound") is determined in music theory. The chord detection unit 116 stores a chord table indicating correspondence between a plurality of chords and their constituent sounds. An example of a chord table is shown in Fig. 6. As shown in the figure, each chord is associated with a constituent sound that constitutes the chord.

[0053] The chord detection unit 116 selects three musical tones in descending order based on the musical tone levels shown in FIG. 5, and the combinations thereof are stored in the chord table and correspond to any chord. It is determined whether or not the power to do. Thereby, the chord in the time width at that time can be detected. In the example of FIG. 5, three musical tones “C”, “E”, and “G” are selected as musical tones having a high level. Therefore, with reference to the chord table shown in FIG. 6, it is detected that the input music data D1 in the time width is composed of the chord “C”. In addition, here we can detect 4 chords and 7 chords in the same way by changing the number of songs to be selected in descending order of the power level described only for 3 chords.

The chord detection unit 116 repeats the above processing every predetermined time width. This time width is determined in consideration of a period (time width) in which a chord changes in general music. A plurality of chords detected by repeatedly performing chord detection in units of time widths are input to the chord progression pattern deriving unit 117 as a signal D16.

The chord progression pattern deriving unit 117 derives a chord progression pattern based on a plurality of input chords. A chord progression pattern is data indicating changes in chords over time in a song.For example, a plurality of chords detected by the chord detector 116 are arranged along the time axis in the song. be able to. The derived chord progression pattern D17 is input to the key determination unit 118.

The key determination unit 118 determines the key (key) of the music based on the chord progression pattern D17. Specifically, the key determination unit 118 can determine the key of the music according to some determination criteria. The key criteria are, for example, determining the chord that appears most frequently throughout the song as the key of the song, or determining the chord of the last measure of the song as the key of the song, etc. Can be considered. The key judgment unit 118 uses one of these criteria or combines multiple criteria to judge the key of the song. To do. Key data D18 indicating the determined key is supplied to pitch shift amount calculation section 150.

As described above, the chord detection unit 116, the chord progression pattern derivation unit 117, and the key determination unit 118 function as a key derivation unit that derives keys of input music data.

[0058] The second adjustment device 200 is configured in the same manner as the first adjustment device 100, and operates in the same manner. Therefore, the key determination unit 218 determines the key of the input music data D2, and supplies the key data D28 to the pitch shift amount calculation unit 150. Also in the second adjustment device 200, the pitch shifter 220 changes the pitch of the input music data D2 based on the pitch shift amount D25 calculated by the pitch shift amount calculation unit 215 to match the reference musical scale. The obtained music data D29 is supplied to the pitch shifter 152 that is not included in the mixer 154. In this respect, the second adjustment device 200 is different from the first adjustment device 100.

[0059] In this way, the pitch shift amount calculation unit 150 shifts the pitch of the input music data D2 so that the key of the input music data D1 and the key of the input music data D2 match (that is, the key shift amount). ) Calculate D50 and supply to Pitch Shifter 152. The pitch shifter 152 shifts the pitch of the music data D29 that has been corrected to match the reference scale based on the pitch shift amount D50, and supplies the music data D52 to the mixer 154. In this way, the mixer 154 mixes the music data D19 and D52, both of which match the reference scale and the keys of each other, and outputs it as output music data Dout.

[0060] In the above embodiment, the pitch shifters 120 and 220 perform pitch shift (ie, scale correction) for matching the input music data with the reference scale, and therefore, the pitch shifters 120 and 220 are high in units of several cents. Accurate pitch shift capability is required. On the other hand, the pitch shifter 152 performs a pitch shift (that is, a key shift) for matching the keys of the input music data, and therefore the shift amount may be a semitone unit necessary for matching the keys.

In the above embodiment, the pitch shift amount calculation unit 150 calculates the pitch shift amount D50 so that the keys of the input music data D1 and the input music data D2 match. However, since the pitch shifter 152 has the ability to shift the pitch in semitones, the key shift amount can be adjusted according to the user's operation. Then, as described above, the key of the input music data D2 is automatically matched with the key of the input music data D1. The key of the input music data D2 can be changed according to the user's preference, and music can be mixed according to the user's taste.

[0062] As described above, according to the present embodiment, the keys of two music pieces can be automatically matched and mixed, so that the harmony is not disturbed and can be heard smoothly and comfortably. In addition, there is an advantage that technical support is obtained for disc jockeys and the range of play is widened.

[0063] (First modification)

Next, a modification of the second embodiment will be described. FIG. 7 shows the configuration of a music data adjustment device 501 according to a modification of the second embodiment. In the second embodiment shown in FIG. 4, the pitch shifter 220 in the second adjustment device 200 performs a pitch shift (ie, scale correction) for matching the input music data D2 to the reference scale, and the pitch shifter 152 Pitch shift (ie key shift) is performed to match the key of input music data D2 with the key of input music data D1. On the other hand, in the modification shown in FIG. 7, the pitch shifter 220 in the second adjustment device 200 is omitted, and the pitch shifter 151 performs pitch shift including scale correction and key shift.

Specifically, the pitch shift amount calculation unit 215 in the second adjustment device 200 supplies the calculated pitch shift amount (scale correction amount) D25 to the pitch shift amount calculation unit 153. Based on the data D18 and D28 from the key determination units 118 and 218, the pitch shift amount calculation unit 153 is configured to match the key of the input music data D2 with the key of the input music data D1 (key shift amount). Is calculated. Then, based on the pitch shift amount and the pitch shift amount (scale correction amount) supplied from the pitch shift amount calculation unit 215, the pitch shift amount D55 is calculated and supplied to the pitch shifter 151. As a result, the pitch shifter 151 can match the input music data D2 with the reference scale and perform a pitch shift once to match the key of the input music data D1. Therefore, the pitch shifter 220 can be omitted. Note that the pitch shifter 151 is required to have a capability of performing a pitch shift in units of several cents in order to perform a pitch shift for matching the input music data D2 to the reference scale.

[0065] (Second modification)

Next, another modification of the second embodiment will be described. Fig. 8 shows another modification of the second embodiment. The structure of the music data adjustment apparatus 502 which concerns on an example is shown. In the second embodiment shown in FIG. 4, in the first adjusting device 100 corresponding to the master side, the pitch shifter 120 performs a pitch shift so that the first input music data matches the reference musical scale. However, depending on the situation, there may be a case where the input music data D1 on the master side is not subjected to pitch shift, and the input music data remains as the target of mixing by the mixer 154. The second variation corresponds to such a request.

Specifically, as shown in FIG. 8, the input music data D1 on the master side is input to the mixer 154 without being pitch-shifted. In the first adjustment device 100, the pitch shift amount D15 output from the pitch shift amount calculation unit 115 and the key data D18 output from the key determination unit 118 are input to the pitch shift amount calculation unit 155. Similarly, in second adjustment device 200, pitch shift amount D25 output from pitch shift amount calculation unit 215 and key data D28 output from key determination unit 218 are input to pitch shift amount calculation unit 155. The

[0067] Then, the pitch shift amount calculation unit 155 calculates a pitch shift amount (a scale correction amount) for matching the input music data D2 with the scale of the input music data D1 based on the pitch shift amounts D15 and D25. calculate. That is, in this modification, the scale of the input music data D1 corresponds to the reference scale. Also, the pitch shift amount calculation unit 155 calculates a pitch shift amount (key shift amount) for matching the key of the input music data D2 with the key of the input music data D1 based on the key data D18 and D28. Then, the pitch shift amount calculation unit 155 calculates the pitch shift amount D57 by adding them, and supplies the calculated pitch shift amount D57 to the pitch shifter 156.

[0068] The pitch shifter 156 matches the input music data D2 to the scale of the input music data D1, and performs a single pitch shift to match the key of the input music data D2 with the key of the input music data D1. . As a result, the mixer 154 can mix and output the input music data D1 that is not pitch-shifted. Also, the pitch shifter 156 supplies the music data D58 that has been pitch-shifted so as to match the scale and key of the input music data D1 to the mixer 154, so the music data Dout output from the mixer 154 is the scale data. And the music data with the same key is mixed, and the music without any discomfort can be played.

Industrial applicability The present invention can be used in a playback device that plays back music data, and can be used in a device used by a disc jockey in a so-called disco or club. For example, the present invention can be applied to a mixer that mixes and outputs a plurality of music pieces, or as an effector built in the mixer.

Claims

The scope of the claims

[1] A frequency analysis unit that performs frequency analysis of music data and detects frequency characteristics;

A deviation amount calculation unit for calculating a deviation amount of a musical sound constituting the music data from a reference scale based on the frequency characteristics;

A music data adjustment comprising: a pitch shift amount calculation unit that calculates a pitch shift amount for shifting the pitch of the music data so that the musical sound matches a reference scale based on the shift amount. apparatus.

[2] The music data adjustment device according to claim 1, further comprising pitch shift means for shifting the pitch of the music data based on the pitch shift amount.

[3] The frequency analysis unit includes:

A converter for converting the music data into a frequency domain signal;

A peak detector that detects a plurality of amplitude peak values from the signal in the frequency domain, and calculates the frequency characteristics by calculating the frequencies of a plurality of musical sounds constituting the music data based on the plurality of peak values. The music data adjustment device according to claim 1, further comprising: a frequency characteristic calculation unit that performs the operation.

[4] A first frequency analysis unit that performs frequency analysis on the first music data and detects a first frequency characteristic;

A first deviation amount calculation unit for calculating a first deviation amount of a reference musical scale force of the musical sound constituting the first music data based on the first frequency characteristic;

A key deriving unit for deriving a key of the first music data based on the first frequency characteristic and the first shift amount;

A second frequency analysis unit for analyzing the frequency of the second music data and detecting a second frequency characteristic;

A second deviation amount calculation unit for calculating a second deviation amount of the reference scale force of the musical sound constituting the second music data based on the second frequency characteristic;

A key deriving unit for deriving a key of the second music data based on the second frequency characteristic and the second shift amount;

The first shift amount, the second shift amount, the key of the first music data, and the second A pitch shift for shifting at least the pitch of the second music data so that the key of the first music data matches the key of the second music data based on the key of the music data of A music data adjustment apparatus comprising: a pitch shift amount calculation unit that calculates the amount.

[5] The pitch shift amount calculation unit includes:

Based on the first shift amount, a first pitch shift amount for shifting the pitch of the first song data is calculated so that the musical tone of the first song data matches the reference scale. A first pitch shift amount calculation unit;

Based on the second shift amount, a second pitch shift amount for shifting the pitch of the second song data is calculated so that the musical tone of the second song data matches the reference scale. A second pitch shift amount calculation unit;

Based on the key of the first music data and the key of the second music data, the key of the second music data is matched with the key of the first music data and the key of the second music data. 5. The music data adjusting device according to claim 4, further comprising a third pitch shift amount calculation unit that calculates a third pitch shift amount for shifting the pitch.

[6] First pitch shift means for shifting the pitch of the first music data based on the first pitch shift amount;

Second pitch shift means for shifting the pitch of the second music data based on the second pitch shift amount;

Third pitch shift means for shifting the pitch of the second music data after the shift by the second pitch shift means based on the third pitch shift amount;

A mixer that mixes and outputs the first music data after the shift by the first pitch shift means and the second music data after the shift by the third pitch shift means. The music data adjusting device according to claim 5, characterized in that it is characterized in that

[7] The pitch shift amount calculation unit includes:

Based on the first shift amount, a first pitch shift amount is calculated for shifting the pitch of the first song data so that the musical tone of the first song data matches the reference scale. A first pitch shift amount calculation unit to be output;

Based on the second shift amount, the key of the first music data, and the key of the second music data, the tone of the second music data matches a reference scale, and the first music data A second pitch shift amount calculation unit for calculating a second pitch shift amount for shifting the pitch of the second music data so that the key of the music data matches the key of the second music data; 5. The music data adjusting device according to claim 4, wherein the music data adjusting device is provided.

[8] First pitch shift means for shifting the pitch of the first music data based on the first pitch shift amount;

A mixer that mixes and outputs the first music data after the shift by the first pitch shift means and the second music data after the shift by the second pitch shift means. The music data adjusting device according to claim 7, characterized in that it is characterized in that

[9] The pitch shift amount calculation unit is configured to determine the first shift amount, the second shift amount, the first music data key, and the second music data key based on the first music data key and the second music data key. The second music data and the second music data have the same musical tone corresponding to the reference scale, and the first music data key and the second music data key match the second musical data. 5. The music data adjusting device according to claim 4, wherein a pitch shift amount for shifting the pitch of the music data is calculated.

[10] Pitch shifting means for shifting the pitch of the second music data based on the pitch shift amount;

The music according to claim 9, further comprising: a mixer that mixes and outputs the first music data and the second music data after the pitch shift by the pitch shift means. Data adjustment device.

[11] Each of the first and second frequency analysis units includes:

A converter for converting the music data into a frequency domain signal;

A peak detector for detecting a plurality of amplitude peak values from the frequency domain signal; 5. A frequency characteristic calculating unit that calculates a frequency characteristic by calculating frequencies of a plurality of musical sounds constituting the music data based on the plurality of peak values. The music data adjustment apparatus described in 1.

Each of the first and second key derivation units includes:

A chord detector for detecting a chord composed of a plurality of musical tones after the correction of the shift amount based on the frequency characteristic and the shift amount;

5. The music data adjustment device according to claim 4, further comprising: a key determination unit that determines a key of the music data based on the detected chord.