WO2010092674A1 - Audio signal mixer - Google Patents

Audio signal mixer Download PDF

Info

Publication number
WO2010092674A1
WO2010092674A1 PCT/JP2009/052314 JP2009052314W WO2010092674A1 WO 2010092674 A1 WO2010092674 A1 WO 2010092674A1 JP 2009052314 W JP2009052314 W JP 2009052314W WO 2010092674 A1 WO2010092674 A1 WO 2010092674A1
Authority
WO
WIPO (PCT)
Prior art keywords
level
band
mixing
audio signal
mixed
Prior art date
Application number
PCT/JP2009/052314
Other languages
French (fr)
Japanese (ja)
Inventor
章 服部
Original Assignee
パイオニア株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パイオニア株式会社 filed Critical パイオニア株式会社
Priority to US13/148,877 priority Critical patent/US20110317851A1/en
Priority to PCT/JP2009/052314 priority patent/WO2010092674A1/en
Priority to JP2010550370A priority patent/JP4855542B2/en
Priority to EP09839996A priority patent/EP2398252A4/en
Publication of WO2010092674A1 publication Critical patent/WO2010092674A1/en

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/038Cross-faders therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/02Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information
    • H04H60/04Studio equipment; Interconnection of studios
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • G11B2020/10537Audio or video recording
    • G11B2020/10546Audio or video recording specifically adapted for audio data
    • G11B2020/10555Audio or video recording specifically adapted for audio data wherein the frequency, the amplitude, or other characteristics of the audio signal is taken into account
    • G11B2020/10564Audio or video recording specifically adapted for audio data wherein the frequency, the amplitude, or other characteristics of the audio signal is taken into account frequency

Definitions

  • the present invention relates to an apparatus for mixing audio signals of a plurality of channels.
  • An audio signal mixing device that has a configuration of an audio mixer with two or more channels (CH) and performs long mixing of music in accordance with a user's crossfader operation designation (see, for example, Patent Document 1).
  • a plurality of channels of audio signals are separately input to a DSP (Digital Signal Processor) inside the audio signal mixing apparatus, and a plurality of audio signals are mixed and output inside the DSP.
  • DSP Digital Signal Processor
  • the audio signal mixing device performs level adjustment using the mixing ratio parameter based on the position information of the crossfader sent from the microcomputer inside the audio signal mixing device.
  • the audio signal mixing device simply mixes audio signals of multiple channels based on the position of the crossfader, the user may hear the level of the sound mixed for each band differently. There is sex.
  • the mixing operation is usually performed with the tempo and beat position of the songs to be mixed together in some way Need to be considered.
  • the bass drum “dong” sound and the bass attack sound where energy is concentrated in the low frequency range, are easily aligned in phase even between audio signals of different songs.
  • the maximum volume is doubled.
  • the audio signal is a different song, so the degree of correlation is low from the viewpoint of the spectrum distribution at a certain timing, and even if it is simply mixed, the volume feeling is not doubled. As a result, the mixed audio signal is uncomfortable to listen with a relatively low frequency emphasis.
  • An object of the present invention is to provide an audio signal mixing apparatus capable of mixing a plurality of audio signals without losing balance between bands.
  • the invention according to claim 1 is an audio signal mixing device, wherein an audio signal acquisition means for acquiring a plurality of audio signals, a mixing ratio acquisition means for acquiring a mixing ratio of the plurality of audio signals, and the plurality of audio signals are acquired.
  • An adjustment amount determining means for determining an adjustment amount of the level of each band when the audio signal is mixed at the mixing ratio, and the plurality of audio signals are mixed for each band at the mixing ratio, and the mixed signal for each band
  • the invention according to claim 6 is an audio signal mixing method for mixing a plurality of audio signals, an audio signal acquiring step for acquiring a plurality of audio signals, and a mixing ratio for acquiring a mixing ratio of the plurality of audio signals.
  • a signal mixing unit that outputs a mixed signal for each band; a level adjusting unit that performs level adjustment for each band based on the adjustment amount with respect to the mixed signal; and each band whose level is adjusted by the level adjusting unit
  • Audio signal mixing device 2 DSP 3 A / D converter 4 Microcomputer 5 Crossfader 6 D / A converter 8 Band division unit 9 Delay unit 21 Band division filter 22 Optimal mix level calculation unit 24 Band-specific level adjustment unit 25 Adder
  • an audio signal mixing device includes an audio signal acquisition unit that acquires a plurality of audio signals, a mixing ratio acquisition unit that acquires a mixing ratio of the plurality of audio signals, and the plurality of audio signals.
  • the adjustment amount determining means for determining the adjustment amount of the level of each band when mixing at the mixing ratio and the plurality of audio signals are mixed for each band at the mixing ratio, and a mixed signal is output for each band.
  • a signal mixing unit, a level adjusting unit that performs level adjustment for each band based on the adjustment amount, and a signal of each band that has been level-adjusted by the level adjusting unit are added to the mixed signal. And adding means for outputting as follows.
  • the above audio signal mixing device can be applied to, for example, DJ equipment.
  • the audio signal mixing apparatus acquires a plurality of audio signals, and acquires mixing ratio information that is information regarding a mixing ratio of the plurality of audio signals.
  • the audio signal mixing apparatus determines an adjustment amount of the level of each band when a plurality of audio signals are mixed at a mixing ratio. Then, the audio signal mixing device mixes a plurality of audio signals for each band, adjusts the level of the mixed signal by the determined level adjustment amount, and adds the signals of each band after adjustment to add the mixed audio signal Output as.
  • the audio signal mixing device calculates the level adjustment amount of each band, adjusts the level balance between the bands based on the adjustment amount, and outputs a mixed signal of a plurality of audio signals. Therefore, this audio signal mixing device can provide a voice that does not feel uncomfortable for the user without an adjustment operation by the user.
  • One aspect of the audio signal mixing apparatus is configured to analyze frequency characteristics of the plurality of audio signals and obtain level information for each band, and each band when the plurality of audio signals are mixed at the mixing ratio.
  • Level change rate calculating means for calculating the level change rate using level information for each band, and the adjustment amount determining means determines the adjustment amount based on the level change rate.
  • the frequency characteristics of a plurality of audio signals are analyzed, and the level change amount of each band when the signals are mixed is calculated. Then, the level adjustment amount is determined based on the level change amount.
  • the audio signal mixing device analyzes the frequency characteristics of the audio signal acquired in real time and detects a change in the balance between the bands before and after mixing, so that a more appropriate adjustment amount can be calculated. It is possible to provide sound suitable for the user.
  • the audio signal mixing apparatus further includes beat position detecting means for detecting a beat position based on the plurality of audio signals, and the level adjusting means adjusts the level during a predetermined period including the beat position.
  • the audio signal mixing device generally detects a place where the level balance between the bands is likely to be broken, for example, a place where the low frequency level is increased by the beat detecting means, and the level around the location where the low frequency level is increased. Make adjustments.
  • the audio signal mixing device calculates the adjustment parameter only when the level balance between the bands is likely to be lost, so that the balance between the bands is prevented from being lost, and the processing load of the adjustment parameter calculation and the level adjustment is reduced. Can be kept to a minimum.
  • level information acquisition means for acquiring level information for each band based on frequency characteristics of the plurality of audio signals, and the plurality of audio signals are mixed at the mixing ratio.
  • Level change rate calculating means for calculating the level change rate of each band using level information for each band, and the adjustment amount determining means determines the adjustment amount based on the level change rate . In this case, since the audio signal mixing device does not need to perform frequency characteristic analysis, the processing load on the audio signal mixing device can be reduced.
  • the adjustment amount determining means holds a predetermined adjustment amount.
  • the audio signal mixing since the configuration of the audio signal mixing device is simplified, the audio signal mixing that can adjust the balance between bands even in a device centered on an analog circuit such as a DSP (Digital Signal Processor) that cannot use high-performance components. An apparatus can be realized.
  • DSP Digital Signal Processor
  • an audio signal mixing method for mixing a plurality of audio signals includes an audio signal acquisition step for acquiring a plurality of audio signals, and a mixing ratio acquisition step for acquiring a mixing ratio of the plurality of audio signals.
  • An adjustment amount determining step for determining an adjustment amount of a level of each band when the plurality of audio signals are mixed at the mixing ratio; and mixing the plurality of audio signals for each band at the mixing ratio.
  • a signal mixing means for outputting a mixed signal, a level adjusting means for adjusting a level for each band based on the adjustment amount for the mixed signal, and a signal of each band whose level is adjusted by the level adjusting means. Adding means for adding and outputting as a mixed audio signal.
  • the level adjustment amount of each band is calculated, and based on the adjustment amount, the signal level of each band is adjusted and a signal in which a plurality of audio signals are mixed is output. It is possible to provide a voice that does not feel uncomfortable for the user without going through the voice adjustment operation.
  • FIG. 1 schematically shows a basic configuration of the audio signal mixing device 1.
  • the audio signal mixing device 1 includes a DSP (Digital Signal Processor) 2, A / D converters 3 A and 3 B, a microcomputer 4, a cross fader 5, and a D / A converter 6. Prepare.
  • DSP Digital Signal Processor
  • the audio signal mixing apparatus 1 acquires a two-channel audio reproduction signal from a CD (Compact Disk) player or the like (not shown), the A / D converters 3A and 3B convert the acquired audio reproduction signal into a digital signal, and the digital signal Send a signal to DSP2.
  • CD Compact Disk
  • the microcomputer 4 acquires the position information of the crossfader operated by the user and sends the position information to the DSP 2.
  • the DSP 2 acquires 2-channel digital signals from the A / D converters 3A and 3B and acquires cross-fader position information (hereinafter also referred to as “mixing ratio information”) from the microcomputer 4, first, For two-channel digital signals, the amount of adjustment of the level balance between the bands when they are mixed at the mixing ratio indicated by the mixing ratio information is determined. Next, the DSP 2 mixes the audio signals of two channels for each band based on the mixing ratio indicated by the mixing ratio information, and performs level adjustment on the mixed signal based on the adjustment amount. Then, the DSP 2 adds the signals of each band adjusted for balance, and outputs the added signal.
  • mixing ratio information cross-fader position information
  • the audio signal mixing apparatus 1 detects the balance change between the bands before and after mixing of the two-channel audio signals and adjusts the balance between the bands, so that the music mix without any sense of incongruity is performed. be able to.
  • FIG. 2 shows a schematic configuration of the DSP 2A according to the first embodiment of the present invention.
  • two-channel audio signals S1 and S2 are input to the DSP 2A.
  • channel is also expressed as “CH”.
  • the audio signal S1 which is a signal of the input channel CH1 is input from the A / D converter 3A to the DSP 2 and supplied to the optimum mix level calculation unit 22 and the band division filter 21A.
  • the audio signal S2, which is a signal of the input channel CH2 is input to the DSP 2 from the A / D converter 3B and supplied to the optimum mix level calculation unit 22 and the band division filter 21B.
  • the mixing ratio information MP output from the microcomputer 4 is supplied to the optimum mix level calculation unit 22.
  • the optimal mix level calculation unit 22 performs frequency characteristic analysis for each of the audio signals S1 and S2, and calculates an average level for each band for the three bands of high frequency, middle frequency, and low frequency for the audio signal of each channel.
  • FIG. 3A and 3B show a specific example in which the optimum mix level calculation unit 22 calculates the average level for each band of the audio signal of each channel.
  • FIG. 3A is a diagram illustrating a result of frequency characteristic analysis performed on the audio signal S1 by the optimum mix level calculation unit 22, and FIG. 3B illustrates a frequency obtained by the optimum mix level calculation unit 22 regarding the audio signal S2. It is a figure which shows the result of having performed the characteristic analysis.
  • the optimum mix level calculation unit 22 uses a high frequency average level H1 that is an average level of each of the high frequency, the middle frequency, and the low frequency as the average level for each band based on the frequency characteristic analysis result of the audio signal S1.
  • the area average level M1 and the low area average level L1 are calculated.
  • the optimal mix level calculation part 22 calculates the high frequency average level level H2, the mid frequency average level M2, and the low frequency average level L2 as the average level for each band based on the frequency characteristic analysis result of the audio signal S2.
  • the average level here may be an amplitude level, but is preferably calculated by an RMS (Root Mean Square) value (effective value).
  • the optimum mix level calculation unit 22 generates a mixed signal by mixing the audio signals S1 and S2 in the entire band based on the mixing ratio information MP.
  • FIG. 3C shows the result of frequency characteristic analysis performed on the mixed signal.
  • the optimum mix level calculation unit 22 calculates a low frequency average level L, a mid frequency average level M, and a high frequency average level H, which are average levels of the three bands of the mixed signal.
  • the low-frequency average level L, the mid-frequency average level M, and the high-frequency average level H indicate the levels of each band after the audio signals S1 and S2 are actually mixed.
  • the optimum mix level calculation unit 22 mixes the high frequency mixing level LH obtained by mixing the high frequency average levels H1 and H2 at the above mixing ratio and the mid frequency average level M1 and M2 at the above mixing ratio.
  • the obtained mid-range mixing level LM and the low-frequency mixing level LL obtained by mixing the low-frequency average levels L1 and L2 at the mixing ratio are calculated.
  • the high-frequency mixing level LH, the mid-frequency mixing level LM, and the low-frequency mixing level LL indicate the levels of the respective bands before the actual mixing of the audio signals S1 and S2.
  • the optimum mix level calculation unit 22 calculates the level change rate (hereinafter, “level change rate”) before and after mixing the audio signals S1 and S2 for each band. Specifically, the optimum mix level calculation unit 22 calculates the ratio of the high frequency average level H to the high frequency mixing level LH as a high frequency level change rate: H / LH, and the mid frequency average level to the mid frequency mixing level LM The ratio of M is calculated as the mid-range level change rate: M / LM, and the ratio of the low-frequency average level L to the low-frequency mixture level LL is calculated as the low-frequency level change rate: L / LL. Then, the ratio of the high frequency level change rate, the mid frequency level change rate, and the low frequency level change rate is calculated as an inter-band change rate H / LH: M / LM: L / LL.
  • level change rate hereinafter, “level change rate”
  • the symbol “*” means multiplication.
  • the optimum mix level calculation unit 22 calculates the adjustment parameters Vh, Vm, and Vl for each band so that the change ratio between the bands is 1: 1: 1. Then, the optimum mix level calculation unit 22 sends the mixing ratio information MP and the adjustment parameters Vh, Vm, and Vl to the band-specific level adjustment units 24H, 24M, and 24L.
  • the high frequency level change rate H / LH indicates the change rate of the high frequency level before and after mixing the audio signals S1 and S2.
  • the mid-range level change rate M / LM indicates the rate of change of the mid-range level before and after mixing the audio signals S1 and S2, and the low-range level change rate L / LL is the mix of the audio signals S1 and S2.
  • the change rate of the level of the low frequency before and after is shown.
  • the adjustment parameters Vh, Vm, and Vl are determined so that the change ratio between the bands is 1: 1: 1, and the level of the mixed audio signal in each band is adjusted accordingly, the mixing of the audio signals S1 and S2 is adjusted. Before and after, the rate of change of the level of each band is maintained. That is, the level of each band after mixing is equal to the level of each band before mixing, and the balance of the levels of each band is maintained before and after mixing. Thereby, it is possible to prevent a problem that a specific band (generally, a low frequency band) is improperly emphasized due to mixing of audio signals.
  • a specific band generally, a low frequency band
  • the band division filters 21A and 21B divide the input audio signal into three bands, a high band, a middle band, and a low band, and adjust the level of each band of the high band component signal, the mid band component signal, and the low band component signal.
  • the data is sent to the units 24H, 24M and 24L.
  • the band division filter 21A supplies the high-frequency component signal S1H of the audio signal S1 to the band-specific level adjustment unit 24H, and supplies the mid-frequency component signal S1M to the band-specific level adjustment unit 24M.
  • S1L is supplied to the level adjusting unit 24L for each band.
  • the band division filter 21B supplies the high-frequency component signal S2H of the audio signal S2 to the band-specific level adjustment unit 24H, supplies the mid-frequency component signal S2M to the band-specific level adjustment unit 24M, and the low-frequency component signal S2L. Is supplied to the band-specific level adjusting unit 24L.
  • the level adjusting unit 24H for each band adjusts the level of the high frequency component of the audio signal
  • the level adjusting unit 24M for each band adjusts the level of the middle frequency component of the audio signal
  • the level adjusting unit 24L for each band reduces the level of the audio signal. Adjust the level of the band component.
  • the level adjusting unit 24H for each band acquires the high frequency component signal S1H of the audio signal S1 from the band division filter 21A and also acquires the high frequency component signal S2H of the audio signal S2 from the band division filter 21B. Further, the band-specific level adjustment unit 24H acquires the mixing ratio information MP and the adjustment parameter Vh from the optimum mix level calculation unit 22. Then, the level adjusting unit 24H for each band mixes the high frequency component signal S1H of the audio signal S1 and the high frequency component signal S2H of the audio signal S2 at a mixing ratio (I: J) indicated by the mixing ratio information MP, and mixes them. The signal is multiplied by the adjustment parameter Vh.
  • the level adjusting unit 24M for each band acquires the middle band component signal S1M of the audio signal S1 from the band division filter 21A and also acquires the middle band component signal S2M of the audio signal S2 from the band division filter 21B. Further, the band-specific level adjustment unit 24M acquires the mixing ratio information MP and the adjustment parameter Vm from the optimum mix level calculation unit 22. Then, the level adjusting unit 24M for each band mixes the middle band component signal S1M of the audio signal S1 and the middle band component signal S2M of the audio signal S2 at the mixing ratio indicated by the mixing ratio information MP, and adjusts the mixed signal. Multiply the parameter Vm.
  • the band-specific level adjusting unit 24L acquires the low frequency component signal S1L of the audio signal S1 from the band division filter 21A and also acquires the low frequency component signal S2L of the audio signal S2 from the band division filter 21B. Further, the band-specific level adjustment unit 24L acquires the mixing ratio information MP and the adjustment parameter Vl from the optimum mix level calculation unit 22. Then, the level adjusting unit 24L for each band mixes the low frequency component signal S1L of the audio signal S1 and the low frequency component signal S2L of the audio signal S2 at the mixing ratio indicated by the mixing ratio information MP, and adjusts the mixed signal. Multiply the parameter Vl.
  • the band-specific level adjusting units 24H, 24M, and 24L mix the components of the respective bands of the audio signals S1 and S2 at the mixing ratio indicated by the mixing ratio information MP, and then adjust the adjustment parameters Vh determined for each band.
  • the level of the mixed signal is adjusted based on Vm and Vl.
  • the adjustment parameters Vh, Vm and Vl of each band are determined so that the change ratio between the bands is 1: 1: 1. Therefore, the signal level of each band after the level adjustment is The signal level balance of each band before mixing is maintained.
  • the adder 25 adds the mixed signals of the respective bands output from the band-specific level adjusting units 24H, 24M, and 24L, and outputs the result as a mixed audio signal.
  • the audio signal mixing device calculates the adjustment parameter for each band so as to maintain the level balance between the bands before and after mixing the signals, and adds the signal whose level is adjusted with the adjustment parameter for each band. Output as a mixed audio signal.
  • the audio signal mixing apparatus can generate a mixed audio signal that maintains a level balance between bands.
  • the optimum mix level calculation unit 22 functions as a mixing ratio acquisition unit, an adjustment amount determination unit, a level change rate calculation unit, an analysis unit, and a level information acquisition unit in the present invention.
  • the band-specific level adjusting units 24H, 24M and 24L function as signal mixing means and level adjusting means in the present invention, and the adder 25 functions as adding means in the present invention.
  • the microcomputer 4 detects the position of the crossfader 5, and when the position of the crossfader 5 is the mix position (step S101; Yes), the microcomputer 4 converts the position information of the crossfader 5 into the mixing ratio information MP. To the DSP 2 (step S102).
  • the mix position here refers to a position other than both ends of the crossfader.
  • the DSP 2A acquires the audio signal of each channel (step S103), and the optimal mix level calculation unit 22 in the DSP 2A performs frequency characteristic analysis on the audio signal (step S104).
  • the optimum mix level calculation unit 22 calculates the average level of the three bands of high frequency, mid frequency and low frequency for the audio signal of each channel (step S105). Specifically, the optimum mix level calculation unit 22 calculates the high frequency average level H1, the mid frequency average level M1, and the low frequency average level L1 for the audio signal S1, and the high frequency average level H2 and the mid frequency for the audio signal S2. An average level M2 and a low frequency average level L2 are calculated.
  • the optimal mix level calculation unit 22 generates a mixed signal by mixing the audio signals of the respective channels at the mixing ratio (I: J) indicated by the mixing ratio information MP (step S106).
  • the optimum mix level calculation unit 22 performs frequency characteristic analysis on the mixed signal (step S107), and the low frequency average level L, the mid frequency average level M, and the high frequency average that are the average levels of the three bands of the mixed signal.
  • Level H is calculated (step S108).
  • the optimum mix level calculation unit 22 calculates the interband change ratio H / LH: M / LM: L / LL (step S109) and adjusts the adjustment parameter Vh so that the interband change ratio is 1: 1: 1.
  • Vm and Vl are calculated (step S110), and the adjustment parameters are sent to the band-specific level adjustment units 24H, 24M, and 24L.
  • the band division filter 21A and the band division filter 21B divide each input signal into three bands, and send the signals in each band to the band-specific level adjustment units 24H, 24M, and 24L (step S111).
  • the band-specific level adjusting units 24H, 24M, and 24L mix the acquired signals at the mixing ratio (I: J) indicated by the mixing ratio information MP (step S112). Then, each of the band level adjusting units 24H, 24M, and 24L multiplies the mixed signals by adjustment parameters Vh, Vm, and Vl (step S113).
  • the adding unit 25 adds the signals output from the level adjusting units 24H, 24M, and 24L for each band (step S114), outputs the signals as mixed audio signals for the entire region (step S115), and ends the process.
  • FIG. 5 shows a schematic configuration in the DSP 2B of the audio signal mixing device 1 according to the second embodiment.
  • symbol is attached
  • the DSP 2B of the audio signal mixing device 1 includes the BPM detection unit 26, but the other points are basically the same as the DSP 2A of the first embodiment.
  • the BPM detector 26 functions as a beat detector in the present invention.
  • the BPM detection unit 26 detects the BPM (Beat Per Minute) of the audio signal S2. Specifically, the BPM detection unit 26 detects the position of the beat in the audio signal S2, for example, a portion where the low frequency level rises at a stroke, and notifies the optimum mix level calculation unit 22 of it.
  • the optimal mix level calculation unit 22 sets a certain time including the position of the beat as the adjustment target period, and based on the audio signal S1 and the audio signal S2 in the adjustment target period, in the same manner as in the first embodiment, the interband change ratio
  • the adjustment parameters Vh, Vm, and Vl are generated so that becomes 1: 1: 1.
  • the optimal mix level calculation unit 22 sets all the adjustment parameters Vh, Vm, and Vl to “1” in a period other than the adjustment target period.
  • the optimum mix level calculation unit 22 sends the adjustment parameters Vh, Vm, and Vl generated in this way to the band-specific level adjustment units 24H, 24M, and 24L.
  • the BPM detection unit 26 detects the beat position where the level balance between the bands is likely to be lost before and after the signal mixing, and in the adjustment target period around the beat position. Only level adjustment using adjustment parameters is performed. On the other hand, during the period other than the adjustment target period, all adjustment parameter values are set to “1”, and level adjustment is not substantially performed. That is, in the second embodiment, the audio signal mixing device 1 calculates the adjustment parameter and performs the level adjustment for each band only when the level balance between the bands is likely to be lost, and does not perform the level adjustment in other periods. . Therefore, it is possible to minimize the burden of the adjustment parameter calculation processing and the level adjustment processing for each band while preventing the level balance between the bands from being lost before and after mixing the signals.
  • FIG. 6 shows a schematic configuration of the DSP 2C in the audio signal mixing device 1 according to the third embodiment.
  • symbol is attached
  • the DSP 2C of the audio signal mixing device 1 according to the third embodiment omits the optimum mix level calculation unit 22 in the DSP 2A of the first embodiment.
  • the band-specific level adjusting units 24H, 24M, and 24L are predetermined for each band with respect to the mixed signal after mixing the audio signals S1 and S2 for each band based on the mixing ratio information MP.
  • the adjustment parameter (hereinafter referred to as “default adjustment parameter”) is multiplied.
  • the adder 25 adds the signal which multiplied the default adjustment parameter for every band, and outputs it as a mixed audio signal.
  • the level for each band is determined by the default adjustment parameter determined in advance without analyzing the audio signal to be mixed. Adjustments are made.
  • the configuration of the apparatus is simplified, and an audio signal mixing apparatus capable of adjusting the level balance between bands can be realized even in an analog circuit-centric apparatus that cannot use high-performance components such as a DSP. .
  • the audio signal mixing apparatus 1 of the present invention outputs a mixed audio signal after adjusting the balance between levels for each band when a plurality of audio signals are mixed. Can output a mixed audio signal that is comfortable for the user.
  • the audio signal mixing apparatus is capable of smoothly mixing with one operator while adjusting the level of music pieces to be mixed according to the position of the operator, but in reality, a disc jockey (DJ ), Etc. are often mixed with this operation element so as to connect the music pieces by lowering the low frequency level of any music piece with an equalizer knob or the like so as not to interfere.
  • DJ disc jockey
  • Etc. are often mixed with this operation element so as to connect the music pieces by lowering the low frequency level of any music piece with an equalizer knob or the like so as not to interfere.
  • This is a technique that a DJ who has a sense of discomfort naturally wears because the sound pressure difference for each band changes due to mixing and the sound pressure in a relatively low range increases and sounds.
  • the level may be corrected by detecting the level change rate for each band before and after mixing signals as in the present invention. Thereby, the mix play without a sense of incongruity is attained by one operation element.
  • the present invention is not limited to this, and the audio signal to be mixed is divided into two or four or more bands. Then, the level balance between the bands may be adjusted.
  • the audio signal mixing apparatus 1 described the case where two audio signals are mixed in the above-described embodiment, the present invention is not limited to this, and three or more audio signals may be mixed. .
  • the crossfader is used for the user to specify and input the mixing ratio.
  • the present invention is not limited to this, and the user specifies the mixing ratio by various other operations. You may do it.
  • the present invention can be used when a plurality of audio signals are mixed in a DJ device, a sound business mixer, a home recording device, or a PC application.

Abstract

An audio signal mixer can be applied to a DJ device and the like, for example. The audio signal mixer acquires a plurality of audio signals and acquires mixing rate information being information on a mixing rate of a plurality of the audio signals. The audio signal mixer decides an adjusting amount of balance between levels at every band when a plurality of the audio signals are mixed based on the mixing rate. A plurality of the audio signals are mixed at every band, adjusts the levels of the mixed signals of the respective bands based on the adjusting amount, adds the adjusted signals of the respective bands and outputs it as a mixed audio signal.

Description

オーディオ信号混合装置Audio signal mixing device
 本発明は、複数チャンネルのオーディオ信号を混合する装置に関する。 The present invention relates to an apparatus for mixing audio signals of a plurality of channels.
 2チャンネル(CH)以上のオーディオミキサーの構成で、ユーザによるクロスフェーダの操作指定に応じて楽曲のロングミックスを行うオーディオ信号混合装置が知られている(例えば、特許文献1参照)。 2. Description of the Related Art An audio signal mixing device is known that has a configuration of an audio mixer with two or more channels (CH) and performs long mixing of music in accordance with a user's crossfader operation designation (see, for example, Patent Document 1).
 上記のようなオーディオ信号混合装置では、当該オーディオ信号混合装置内部のDSP(Digital Signal Processor)へ複数チャンネルのオーディオ信号が別々に入力され、DSP内部で複数のオーディオ信号を混合して出力する。 In the audio signal mixing apparatus as described above, a plurality of channels of audio signals are separately input to a DSP (Digital Signal Processor) inside the audio signal mixing apparatus, and a plurality of audio signals are mixed and output inside the DSP.
 このとき、オーディオ信号混合装置は、当該オーディオ信号混合装置内部のマイクロコンピュータから送られてくるクロスフェーダの位置情報に基づいた混合割合パラメータを用いてレベル調整を行う。 At this time, the audio signal mixing device performs level adjustment using the mixing ratio parameter based on the position information of the crossfader sent from the microcomputer inside the audio signal mixing device.
特開平8-195068号公報JP-A-8-195068
 上記のように、オーディオ信号混合装置が単純にクロスフェーダの位置に基づいて複数チャンネルのオーディオ信号を混合すると、利用者には、帯域毎にミックスされた音のレベル感が違って聞こえてしまう可能性がある。 As described above, if the audio signal mixing device simply mixes audio signals of multiple channels based on the position of the crossfader, the user may hear the level of the sound mixed for each band differently. There is sex.
 上記現象が起こる前提として、上記のオーディオ信号混合装置を使って複数の曲をミックスする際には、通常なんらかの手法でミックスする曲同士のテンポや拍位置を合わせた状態でミックス動作を行うということを考慮する必要がある。この場合、低域にエネルギーが集中しているバスドラムの「ドン」という音やベースのアタック音などは、違う曲のオーディオ信号間であっても位相が揃い易く、2チャンネルのオーディオ信号を単純にミックスした場合、最大で2倍の音量になる。ところが中・高域に関しては、オーディオ信号が違う曲のものなので、あるタイミングでのスペクトル分布という観点で相関度が低く、単純にミックスしても音量感が2倍にはならない。その結果、混合されたオーディオ信号は、相対的に低域が強調されて聴き心地の悪いものとなってしまう。 As a premise that the above phenomenon occurs, when mixing multiple songs using the above audio signal mixing device, the mixing operation is usually performed with the tempo and beat position of the songs to be mixed together in some way Need to be considered. In this case, the bass drum “dong” sound and the bass attack sound, where energy is concentrated in the low frequency range, are easily aligned in phase even between audio signals of different songs. When mixed in, the maximum volume is doubled. However, in the middle / high range, the audio signal is a different song, so the degree of correlation is low from the viewpoint of the spectrum distribution at a certain timing, and even if it is simply mixed, the volume feeling is not doubled. As a result, the mixed audio signal is uncomfortable to listen with a relatively low frequency emphasis.
 本発明が解決しようとする課題としては、上記のようなものが例として挙げられる。本発明の目的は、帯域間のバランスを失うことなく複数のオーディオ信号を混合することができるオーディオ信号混合装置を提供することにある。 Examples of problems to be solved by the present invention include the above. An object of the present invention is to provide an audio signal mixing apparatus capable of mixing a plurality of audio signals without losing balance between bands.
 請求項1に記載の発明は、オーディオ信号混合装置であって、複数のオーディオ信号を取得するオーディオ信号取得手段と、前記複数のオーディオ信号の混合割合を取得する混合割合取得手段と、前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベルの調整量を決定する調整量決定手段と、前記複数のオーディオ信号を、前記混合割合で帯域毎に混合して、帯域毎に混合信号を出力する信号混合手段と、前記混合信号に対して、前記調整量に基づき、帯域毎にレベル調整を行うレベル調整手段と、前記レベル調整手段によりレベル調整された各帯域の信号を加算し、混合オーディオ信号として出力する加算手段と、を備えることを特徴とする。 The invention according to claim 1 is an audio signal mixing device, wherein an audio signal acquisition means for acquiring a plurality of audio signals, a mixing ratio acquisition means for acquiring a mixing ratio of the plurality of audio signals, and the plurality of audio signals are acquired. An adjustment amount determining means for determining an adjustment amount of the level of each band when the audio signal is mixed at the mixing ratio, and the plurality of audio signals are mixed for each band at the mixing ratio, and the mixed signal for each band A signal mixing means for outputting, a level adjusting means for performing level adjustment for each band based on the adjustment amount, and a signal of each band adjusted by the level adjusting means for the mixed signal, Adding means for outputting as a mixed audio signal.
 請求項6に記載の発明は、複数のオーディオ信号を混合するオーディオ信号混合方法であって、複数のオーディオ信号を取得するオーディオ信号取得工程と、前記複数のオーディオ信号の混合割合を取得する混合割合取得工程と、前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベルの調整量を決定する調整量決定工程と、前記複数のオーディオ信号を前記混合割合で帯域毎に混合して、帯域毎に混合信号を出力する信号混合手段と、前記混合信号に対して、前記調整量に基づき、帯域毎にレベル調整を行うレベル調整手段と、前記レベル調整手段によりレベル調整された各帯域の信号を加算し、混合オーディオ信号として出力する加算手段と、を備えることを特徴とする。

The invention according to claim 6 is an audio signal mixing method for mixing a plurality of audio signals, an audio signal acquiring step for acquiring a plurality of audio signals, and a mixing ratio for acquiring a mixing ratio of the plurality of audio signals. An acquisition step; an adjustment amount determination step for determining an adjustment amount of each band level when the plurality of audio signals are mixed at the mixing ratio; and the plurality of audio signals are mixed for each band at the mixing ratio. A signal mixing unit that outputs a mixed signal for each band; a level adjusting unit that performs level adjustment for each band based on the adjustment amount with respect to the mixed signal; and each band whose level is adjusted by the level adjusting unit And adding means for adding the signals to output as a mixed audio signal.

オーディオ信号混合装置の物理的構造図である。It is a physical structure figure of an audio signal mixing device. 第1実施例に係るDSP内部の構成を示すブロック図である。It is a block diagram which shows the structure inside DSP which concerns on 1st Example. 各種信号レベル値の平均レベルを示す図である。It is a figure which shows the average level of various signal level values. オーディオ信号混合方法の手順を示すフローチャートである。It is a flowchart which shows the procedure of the audio signal mixing method. 第2実施例に係るDSP内部の構成を示すブロック図である。It is a block diagram which shows the structure inside DSP which concerns on 2nd Example. 第3実施例に係るDSP内部の構成を示すブロック図である。It is a block diagram which shows the structure inside DSP which concerns on 3rd Example.
符号の説明Explanation of symbols
 1 オーディオ信号混合装置
 2 DSP
 3 A/D変換器
 4 マイクロコンピュータ
 5 クロスフェーダ
 6 D/A変換器
 8 帯域分割部
 9 遅延部
 21 帯域分割フィルタ
 22 最適ミックスレベル算出部
 24 帯域別レベル調整部
 25 加算器
1 Audio signal mixing device 2 DSP
3 A / D converter 4 Microcomputer 5 Crossfader 6 D / A converter 8 Band division unit 9 Delay unit 21 Band division filter 22 Optimal mix level calculation unit 24 Band-specific level adjustment unit 25 Adder
 本発明の1つの観点では、オーディオ信号混合装置は、複数のオーディオ信号を取得するオーディオ信号取得手段と、前記複数のオーディオ信号の混合割合を取得する混合割合取得手段と、前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベルの調整量を決定する調整量決定手段と、前記複数のオーディオ信号を、前記混合割合で帯域毎に混合して、帯域毎に混合信号を出力する信号混合手段と、前記混合信号に対して、前記調整量に基づき、帯域毎にレベル調整を行うレベル調整手段と、前記レベル調整手段によりレベル調整された各帯域の信号を加算し、混合オーディオ信号として出力する加算手段と、を備える。 In one aspect of the present invention, an audio signal mixing device includes an audio signal acquisition unit that acquires a plurality of audio signals, a mixing ratio acquisition unit that acquires a mixing ratio of the plurality of audio signals, and the plurality of audio signals. The adjustment amount determining means for determining the adjustment amount of the level of each band when mixing at the mixing ratio and the plurality of audio signals are mixed for each band at the mixing ratio, and a mixed signal is output for each band. A signal mixing unit, a level adjusting unit that performs level adjustment for each band based on the adjustment amount, and a signal of each band that has been level-adjusted by the level adjusting unit are added to the mixed signal. And adding means for outputting as follows.
 上記のオーディオ信号混合装置は、例えば、DJ機器等に適用することができる。当該オーディオ信号混合装置は、複数のオーディオ信号を取得し、当該複数のオーディオ信号の混合割合に関する情報である混合割合情報を取得する。オーディオ信号混合装置は、複数のオーディオ信号を混合割合で混合したときにおける、各帯域のレベルの調整量を決定する。そして、オーディオ信号混合装置は、複数のオーディオ信号を帯域毎に混合し、混合した信号のレベルを、決定されたレベル調整量で調整し、調整後の各帯域の信号を加算して混合オーディオ信号として出力する。 The above audio signal mixing device can be applied to, for example, DJ equipment. The audio signal mixing apparatus acquires a plurality of audio signals, and acquires mixing ratio information that is information regarding a mixing ratio of the plurality of audio signals. The audio signal mixing apparatus determines an adjustment amount of the level of each band when a plurality of audio signals are mixed at a mixing ratio. Then, the audio signal mixing device mixes a plurality of audio signals for each band, adjusts the level of the mixed signal by the determined level adjustment amount, and adds the signals of each band after adjustment to add the mixed audio signal Output as.
 このように、オーディオ信号混合装置は、各帯域のレベルの調整量を算出し、当該調整量に基づき、帯域間のレベルバランスを調整して、複数のオーディオ信号の混合信号を出力する。よって、このオーディオ信号混合装置は、利用者による調整操作を介すことなく、利用者にとって違和感のない音声を提供することができる。 In this way, the audio signal mixing device calculates the level adjustment amount of each band, adjusts the level balance between the bands based on the adjustment amount, and outputs a mixed signal of a plurality of audio signals. Therefore, this audio signal mixing device can provide a voice that does not feel uncomfortable for the user without an adjustment operation by the user.
 上記のオーディオ信号混合装置の一態様は、前記複数のオーディオ信号の周波数特性を解析し、帯域毎のレベル情報を得る解析手段と、前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベル変化率を、前記帯域毎のレベル情報を用いて計算するレベル変化率計算手段と、をさらに備え、前記調整量決定手段は、前記レベル変化率に基づいて調整量を決定する。 One aspect of the audio signal mixing apparatus is configured to analyze frequency characteristics of the plurality of audio signals and obtain level information for each band, and each band when the plurality of audio signals are mixed at the mixing ratio. Level change rate calculating means for calculating the level change rate using level information for each band, and the adjustment amount determining means determines the adjustment amount based on the level change rate.
 この態様では、複数のオーディオ信号の周波数特性を解析し、信号を混合した場合の各帯域のレベル変化量を計算する。そして、そのレベル変化量に基づいて、レベルの調整量が決定される。この場合、オーディオ信号混合装置は、リアルタイムで取得したオーディオ信号について、周波数特性を解析し、混合前と混合後の帯域間バランス変化を検知するので、より適切な調整量を算出することができ、利用者にとって適切な音声を提供することが可能となる。 In this aspect, the frequency characteristics of a plurality of audio signals are analyzed, and the level change amount of each band when the signals are mixed is calculated. Then, the level adjustment amount is determined based on the level change amount. In this case, the audio signal mixing device analyzes the frequency characteristics of the audio signal acquired in real time and detects a change in the balance between the bands before and after mixing, so that a more appropriate adjustment amount can be calculated. It is possible to provide sound suitable for the user.
 上記のオーディオ信号混合装置の他の一態様は、前記複数のオーディオ信号に基づいて拍位置を検出する拍位置検出手段をさらに備え、前記レベル調整手段は、前記拍位置を含む所定期間にレベル調整を行う。この場合、オーディオ信号混合装置は、一般的に帯域間のレベルバランスが崩れやすいと考えられる箇所、例えば低域レベルが上がる箇所を拍検出手段で検出し、低域レベルが上がる箇所周辺について、レベル調整を行う。即ち、オーディオ信号混合装置は、帯域間のレベルバランスが崩れやすい時だけ、調整パラメータの算出を行うので、帯域間のバランスが崩れることを防止しつつ、調整パラメータの算出及びレベル調整の処理負担を最小限に留めることができる。 Another aspect of the audio signal mixing apparatus further includes beat position detecting means for detecting a beat position based on the plurality of audio signals, and the level adjusting means adjusts the level during a predetermined period including the beat position. I do. In this case, the audio signal mixing device generally detects a place where the level balance between the bands is likely to be broken, for example, a place where the low frequency level is increased by the beat detecting means, and the level around the location where the low frequency level is increased. Make adjustments. In other words, the audio signal mixing device calculates the adjustment parameter only when the level balance between the bands is likely to be lost, so that the balance between the bands is prevented from being lost, and the processing load of the adjustment parameter calculation and the level adjustment is reduced. Can be kept to a minimum.
 上記のオーディオ信号混合装置の他の一態様は、前記複数のオーディオ信号の周波数特性に基づく帯域毎のレベル情報を取得するレベル情報取得手段と、前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベル変化率を、前記帯域毎のレベル情報を用いて計算するレベル変化率計算手段と、をさらに備え、前記調整量決定手段は、前記レベル変化率に基づいて調整量を決定する。この場合、オーディオ信号混合装置は、周波数特性解析を行う必要がないので、オーディオ信号混合装置の処理負担を軽減させることができる。 In another aspect of the audio signal mixing device, level information acquisition means for acquiring level information for each band based on frequency characteristics of the plurality of audio signals, and the plurality of audio signals are mixed at the mixing ratio. Level change rate calculating means for calculating the level change rate of each band using level information for each band, and the adjustment amount determining means determines the adjustment amount based on the level change rate . In this case, since the audio signal mixing device does not need to perform frequency characteristic analysis, the processing load on the audio signal mixing device can be reduced.
 上記のオーディオ信号混合装置の他の一態様では、前記調整量決定手段は、予め決定された調整量を保持している。この場合、オーディオ信号混合装置の構成が簡素化されるので、DSP(Digital Signal Processor)のような高性能な部品を使えないアナログ回路中心の装置でも、帯域間のバランスを調整し得るオーディオ信号混合装置を実現することができる。 In another aspect of the above audio signal mixing device, the adjustment amount determining means holds a predetermined adjustment amount. In this case, since the configuration of the audio signal mixing device is simplified, the audio signal mixing that can adjust the balance between bands even in a device centered on an analog circuit such as a DSP (Digital Signal Processor) that cannot use high-performance components. An apparatus can be realized.
 本発明の他の観点では、複数のオーディオ信号を混合するオーディオ信号混合方法は、複数のオーディオ信号を取得するオーディオ信号取得工程と、前記複数のオーディオ信号の混合割合を取得する混合割合取得工程と、前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベルの調整量を決定する調整量決定工程と、前記複数のオーディオ信号を前記混合割合で帯域毎に混合して、帯域毎に混合信号を出力する信号混合手段と、前記混合信号に対して、前記調整量に基づき、帯域毎にレベル調整を行うレベル調整手段と、前記レベル調整手段によりレベル調整された各帯域の信号を加算し、混合オーディオ信号として出力する加算手段と、を備える。 In another aspect of the present invention, an audio signal mixing method for mixing a plurality of audio signals includes an audio signal acquisition step for acquiring a plurality of audio signals, and a mixing ratio acquisition step for acquiring a mixing ratio of the plurality of audio signals. An adjustment amount determining step for determining an adjustment amount of a level of each band when the plurality of audio signals are mixed at the mixing ratio; and mixing the plurality of audio signals for each band at the mixing ratio. A signal mixing means for outputting a mixed signal, a level adjusting means for adjusting a level for each band based on the adjustment amount for the mixed signal, and a signal of each band whose level is adjusted by the level adjusting means. Adding means for adding and outputting as a mixed audio signal.
 上記のオーディオ信号混合方法によっても、各帯域のレベル調整量を算出し、当該調整量に基づき、各帯域の信号のレベルを調整して複数のオーディオ信号を混合した信号を出力するので、利用者による音声調整操作を介すことなく、利用者にとって違和感のない音声を提供することができる。 Also by the above audio signal mixing method, the level adjustment amount of each band is calculated, and based on the adjustment amount, the signal level of each band is adjusted and a signal in which a plurality of audio signals are mixed is output. It is possible to provide a voice that does not feel uncomfortable for the user without going through the voice adjustment operation.
 以下、図面を参照して本発明の好適な実施例について説明する。 Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
 [概要説明]
 まず、本発明によるオーディオ信号混合装置の概要について説明する。図1に、オーディオ信号混合装置1の基本的構成を模式的に示す。図示のように、オーディオ信号混合装置1は、DSP(Digital Signal Processor)2と、A/D変換器3A及び3Bと、マイクロコンピュータ4と、クロスフェーダ5と、D/A変換器6と、を備える。
[Overview]
First, an outline of an audio signal mixing apparatus according to the present invention will be described. FIG. 1 schematically shows a basic configuration of the audio signal mixing device 1. As shown in the figure, the audio signal mixing device 1 includes a DSP (Digital Signal Processor) 2, A / D converters 3 A and 3 B, a microcomputer 4, a cross fader 5, and a D / A converter 6. Prepare.
 オーディオ信号混合装置1が図示しないCD(Compact Disk)プレーヤ等から2チャンネルのオーディオ再生信号を取得すると、A/D変換器3A及び3Bは、取得したオーディオ再生信号をデジタル信号に変換し、当該デジタル信号をDSP2へ送出する。 When the audio signal mixing apparatus 1 acquires a two-channel audio reproduction signal from a CD (Compact Disk) player or the like (not shown), the A / D converters 3A and 3B convert the acquired audio reproduction signal into a digital signal, and the digital signal Send a signal to DSP2.
 マイクロコンピュータ4は、ユーザによって操作されるクロスフェーダの位置情報を取得し、当該位置情報をDSP2へ送出する。 The microcomputer 4 acquires the position information of the crossfader operated by the user and sends the position information to the DSP 2.
 DSP2は、A/D変換器3A及び3Bから2チャンネルのデジタル信号を取得し、マイクロコンピュータ4からクロスフェーダの位置情報(以下、「混合割合情報」とも呼ぶ。)を取得すると、まず、上記の2チャンネルのデジタル信号について、それらを混合割合情報が示す混合割合で混合した場合の帯域間のレベルバランスの調整量を決定する。次に、DSP2は、混合割合情報が示す混合割合に基づいて2チャンネルのオーディオ信号を帯域毎に混合し、混合した信号に対して上記調整量に基づきレベル調整を行う。そして、DSP2はバランス調整した各帯域の信号を加算し、加算した信号を出力する。 When the DSP 2 acquires 2-channel digital signals from the A / D converters 3A and 3B and acquires cross-fader position information (hereinafter also referred to as “mixing ratio information”) from the microcomputer 4, first, For two-channel digital signals, the amount of adjustment of the level balance between the bands when they are mixed at the mixing ratio indicated by the mixing ratio information is determined. Next, the DSP 2 mixes the audio signals of two channels for each band based on the mixing ratio indicated by the mixing ratio information, and performs level adjustment on the mixed signal based on the adjustment amount. Then, the DSP 2 adds the signals of each band adjusted for balance, and outputs the added signal.
 このように、オーディオ信号混合装置1は、2チャンネルのオーディオ信号の混合前と混合後の帯域間のバランス変化を検知して帯域間のバランス調整をしているので、違和感のない楽曲ミックスを行うことができる。 In this way, the audio signal mixing apparatus 1 detects the balance change between the bands before and after mixing of the two-channel audio signals and adjusts the balance between the bands, so that the music mix without any sense of incongruity is performed. be able to.
 [第1実施例]
 図2に、本発明の第1実施例に係るDSP2Aの概略構成を示す。本実施例では、DSP2Aへは、2チャンネルのオーディオ信号S1及びS2が入力される。以下、「チャンネル」を「CH」とも表記する。
[First embodiment]
FIG. 2 shows a schematic configuration of the DSP 2A according to the first embodiment of the present invention. In this embodiment, two-channel audio signals S1 and S2 are input to the DSP 2A. Hereinafter, “channel” is also expressed as “CH”.
 入力チャンネルCH1の信号であるオーディオ信号S1は、A/D変換器3AよりDSP2へ入力され、最適ミックスレベル算出部22及び帯域分割フィルタ21Aへ供給される。入力チャンネルCH2の信号であるオーディオ信号S2は、A/D変換器3BよりDSP2へ入力され、最適ミックスレベル算出部22及び帯域分割フィルタ21Bへ供給される。 The audio signal S1, which is a signal of the input channel CH1, is input from the A / D converter 3A to the DSP 2 and supplied to the optimum mix level calculation unit 22 and the band division filter 21A. The audio signal S2, which is a signal of the input channel CH2, is input to the DSP 2 from the A / D converter 3B and supplied to the optimum mix level calculation unit 22 and the band division filter 21B.
 また、マイクロコンピュータ4が出力した混合割合情報MPは、最適ミックスレベル算出部22へ供給される。 Further, the mixing ratio information MP output from the microcomputer 4 is supplied to the optimum mix level calculation unit 22.
 最適ミックスレベル算出部22は、オーディオ信号S1及びS2のそれぞれについて周波数特性解析を行い、各チャンネルのオーディオ信号について、高域、中域及び低域の3帯域について帯域別平均レベルを算出する。 The optimal mix level calculation unit 22 performs frequency characteristic analysis for each of the audio signals S1 and S2, and calculates an average level for each band for the three bands of high frequency, middle frequency, and low frequency for the audio signal of each channel.
 最適ミックスレベル算出部22が各チャンネルのオーディオ信号の帯域別平均レベルを算出する具体例を図3(A)及び図3(B)に示す。図3(A)は、最適ミックスレベル算出部22がオーディオ信号S1について周波数特性解析を行った結果を示す図であり、図3(B)は、最適ミックスレベル算出部22がオーディオ信号S2について周波数特性解析を行った結果を示す図である。この場合、最適ミックスレベル算出部22は、オーディオ信号S1の周波数特性解析結果に基づき、帯域別平均レベルとして、高域、中域及び低域のそれぞれの平均レベルである高域平均レベルH1、中域平均レベルM1及び低域平均レベルL1を算出する。また、最適ミックスレベル算出部22は、オーディオ信号S2の周波数特性解析結果に基づき、帯域別平均レベルとして、高域平均レベルレベルH2、中域平均レベルM2及び低域平均レベルL2を算出する。ここでいう平均レベルは、振幅レベルでも良いが、RMS(Root Mean Square)値(実効値)で算出する方が望ましい。 3A and 3B show a specific example in which the optimum mix level calculation unit 22 calculates the average level for each band of the audio signal of each channel. FIG. 3A is a diagram illustrating a result of frequency characteristic analysis performed on the audio signal S1 by the optimum mix level calculation unit 22, and FIG. 3B illustrates a frequency obtained by the optimum mix level calculation unit 22 regarding the audio signal S2. It is a figure which shows the result of having performed the characteristic analysis. In this case, the optimum mix level calculation unit 22 uses a high frequency average level H1 that is an average level of each of the high frequency, the middle frequency, and the low frequency as the average level for each band based on the frequency characteristic analysis result of the audio signal S1. The area average level M1 and the low area average level L1 are calculated. Moreover, the optimal mix level calculation part 22 calculates the high frequency average level level H2, the mid frequency average level M2, and the low frequency average level L2 as the average level for each band based on the frequency characteristic analysis result of the audio signal S2. The average level here may be an amplitude level, but is preferably calculated by an RMS (Root Mean Square) value (effective value).
 次に、最適ミックスレベル算出部22は、混合割合情報MPに基づいて、全帯域でオーディオ信号S1とS2を混合して混合信号を生成する。混合信号について周波数特性解析を行った結果を図3(C)に示す。そして、最適ミックスレベル算出部22は、混合信号の3帯域の平均レベルである、低域平均レベルL、中域平均レベルM及び高域平均レベルHを算出する。ここで、低域平均レベルL、中域平均レベルM及び高域平均レベルHは、オーディオ信号S1とS2を実際に混合した後における各帯域のレベルを示すものとなる。 Next, the optimum mix level calculation unit 22 generates a mixed signal by mixing the audio signals S1 and S2 in the entire band based on the mixing ratio information MP. FIG. 3C shows the result of frequency characteristic analysis performed on the mixed signal. Then, the optimum mix level calculation unit 22 calculates a low frequency average level L, a mid frequency average level M, and a high frequency average level H, which are average levels of the three bands of the mixed signal. Here, the low-frequency average level L, the mid-frequency average level M, and the high-frequency average level H indicate the levels of each band after the audio signals S1 and S2 are actually mixed.
 次に、最適ミックスレベル算出部22は、高域平均レベルH1及びH2を上記混合割合で混合して得られる高域混合レベルLHと、中域平均レベルM1及びM2を上記混合割合で混合して得られる中域混合レベルLMと、低域平均レベルL1及びL2を上記混合割合で混合して得られる低域混合レベルLLとを算出する。ここで、高域混合レベルLH、中域混合レベルLM及び低域混合レベルLLは、オーディオ信号S1及びS2の実際の混合前における各帯域のレベルを示すものとなる。 Next, the optimum mix level calculation unit 22 mixes the high frequency mixing level LH obtained by mixing the high frequency average levels H1 and H2 at the above mixing ratio and the mid frequency average level M1 and M2 at the above mixing ratio. The obtained mid-range mixing level LM and the low-frequency mixing level LL obtained by mixing the low-frequency average levels L1 and L2 at the mixing ratio are calculated. Here, the high-frequency mixing level LH, the mid-frequency mixing level LM, and the low-frequency mixing level LL indicate the levels of the respective bands before the actual mixing of the audio signals S1 and S2.
 そして、最適ミックスレベル算出部22は、帯域毎に、オーディオ信号S1とS2の混合の前後におけるレベルの変化割合(以下、「レベル変化率」)を算出する。具体的には、最適ミックスレベル算出部22は、高域混合レベルLHに対する高域平均レベルHの割合を高域レベル変化率:H/LHとして算出し、中域混合レベルLMに対する中域平均レベルMの割合を中域レベル変化率:M/LMとして算出し、低域混合レベルLLに対する低域平均レベルLの割合を低域レベル変化率:L/LLとして算出する。そして、高域レベル変化率と中域レベル変化率と低域レベル変化率の比率を、帯域間変化比率H/LH:M/LM:L/LLとして算出する。
Then, the optimum mix level calculation unit 22 calculates the level change rate (hereinafter, “level change rate”) before and after mixing the audio signals S1 and S2 for each band. Specifically, the optimum mix level calculation unit 22 calculates the ratio of the high frequency average level H to the high frequency mixing level LH as a high frequency level change rate: H / LH, and the mid frequency average level to the mid frequency mixing level LM The ratio of M is calculated as the mid-range level change rate: M / LM, and the ratio of the low-frequency average level L to the low-frequency mixture level LL is calculated as the low-frequency level change rate: L / LL. Then, the ratio of the high frequency level change rate, the mid frequency level change rate, and the low frequency level change rate is calculated as an inter-band change rate H / LH: M / LM: L / LL.
 いま、混合割合情報MPが示すオーディオ信号S1とオーディオ信号S2との混合割合をI:Jとすると、オーディオ信号S1の混合割合を示す混合係数Aは、A=I/(I+J)と表せ、オーディオ信号S2の混合割合を示す混合係数Bは、B=J/(I+J)と表せる。よって、高域混合レベルLH、中域混合レベルLM、低域混合レベルLLはそれぞれ、
  高域混合レベルLH=A*H1+B*H2
  中域混合レベルLM=A*M1+B*M2
  低域混合レベルLL=A*L1+B*L2
となる。なお、記号「*」は乗算を意味する。
Now, assuming that the mixing ratio of the audio signal S1 and the audio signal S2 indicated by the mixing ratio information MP is I: J, the mixing coefficient A indicating the mixing ratio of the audio signal S1 can be expressed as A = I / (I + J). The mixing coefficient B indicating the mixing ratio of the signal S2 can be expressed as B = J / (I + J). Therefore, the high frequency mixing level LH, the mid frequency mixing level LM, and the low frequency mixing level LL are respectively
High frequency mixing level LH = A * H1 + B * H2
Mid-range mixing level LM = A * M1 + B * M2
Low frequency mixing level LL = A * L1 + B * L2
It becomes. The symbol “*” means multiplication.
 よって、帯域間変化比率は、
  帯域間変化比率H/LH:M/LM:L/LL=
H/(A*H1+B*H2):M/(A*M1+B*M2):L/(A*L1+B*L2)
となる。
Therefore, the change ratio between bands is
Band-to-band change ratio H / LH: M / LM: L / LL =
H / (A * H1 + B * H2): M / (A * M1 + B * M2): L / (A * L1 + B * L2)
It becomes.
 最適ミックスレベル算出部22は、帯域間変化比率が1:1:1となるように帯域毎に調整パラメータVh、Vm及びVlを算出する。そして、最適ミックスレベル算出部22は、上記混合割合情報MPと、調整パラメータVh、Vm及びVlとを帯域別レベル調整部24H、24M及び24Lへ送出する。 The optimum mix level calculation unit 22 calculates the adjustment parameters Vh, Vm, and Vl for each band so that the change ratio between the bands is 1: 1: 1. Then, the optimum mix level calculation unit 22 sends the mixing ratio information MP and the adjustment parameters Vh, Vm, and Vl to the band-specific level adjustment units 24H, 24M, and 24L.
 ここで、帯域間変化比率が1:1:1となるように帯域毎に調整パラメータVh、Vm及びVlを算出する理由を説明する。前述のように、高域レベル変化率H/LHは、オーディオ信号S1とS2の混合の前後における高域のレベルの変化割合を示している。同様に、中域レベル変化率M/LMはオーディオ信号S1とS2の混合の前後における中域のレベルの変化割合を示しており、低域レベル変化率L/LLはオーディオ信号S1とS2の混合の前後における低域のレベルの変化割合を示している。よって、帯域間変化比率が1:1:1となるように調整パラメータVh、Vm及びVlを決定し、それに従って各帯域の混合オーディオ信号のレベルを調整すれば、オーディオ信号S1とS2の混合の前後において、各帯域のレベルの変化率が維持される。即ち、混合後における各帯域のレベルは、混合前の各帯域のレベルと等しくなり、各帯域のレベルのバランスが混合前後で保たれることになる。これにより、オーディオ信号の混合により、特定の帯域(一般的には低域)が不適切に強調されたりするという不具合を防止することができる。 Here, the reason why the adjustment parameters Vh, Vm, and Vl are calculated for each band so that the change ratio between the bands is 1: 1: 1 will be described. As described above, the high frequency level change rate H / LH indicates the change rate of the high frequency level before and after mixing the audio signals S1 and S2. Similarly, the mid-range level change rate M / LM indicates the rate of change of the mid-range level before and after mixing the audio signals S1 and S2, and the low-range level change rate L / LL is the mix of the audio signals S1 and S2. The change rate of the level of the low frequency before and after is shown. Therefore, if the adjustment parameters Vh, Vm, and Vl are determined so that the change ratio between the bands is 1: 1: 1, and the level of the mixed audio signal in each band is adjusted accordingly, the mixing of the audio signals S1 and S2 is adjusted. Before and after, the rate of change of the level of each band is maintained. That is, the level of each band after mixing is equal to the level of each band before mixing, and the balance of the levels of each band is maintained before and after mixing. Thereby, it is possible to prevent a problem that a specific band (generally, a low frequency band) is improperly emphasized due to mixing of audio signals.
 一方、帯域分割フィルタ21A及び21Bは、入力されたオーディオ信号を高域、中域及び低域の3帯域に分割し、高域成分信号、中域成分信号及び低域成分信号を帯域別レベル調整部24H、24M及び24Lへ送出する。 On the other hand, the band division filters 21A and 21B divide the input audio signal into three bands, a high band, a middle band, and a low band, and adjust the level of each band of the high band component signal, the mid band component signal, and the low band component signal. The data is sent to the units 24H, 24M and 24L.
 具体的に、帯域分割フィルタ21Aは、オーディオ信号S1の高域成分信号S1Hを帯域別レベル調整部24Hへ供給し、中域成分信号S1Mを帯域別レベル調整部24Mへ供給し、低域成分信号S1Lを帯域別レベル調整部24Lへ供給する。同様に、帯域分割フィルタ21Bは、オーディオ信号S2の高域成分信号S2Hを帯域別レベル調整部24Hへ供給し、中域成分信号S2Mを帯域別レベル調整部24Mへ供給し、低域成分信号S2Lを帯域別レベル調整部24Lへ供給する。 Specifically, the band division filter 21A supplies the high-frequency component signal S1H of the audio signal S1 to the band-specific level adjustment unit 24H, and supplies the mid-frequency component signal S1M to the band-specific level adjustment unit 24M. S1L is supplied to the level adjusting unit 24L for each band. Similarly, the band division filter 21B supplies the high-frequency component signal S2H of the audio signal S2 to the band-specific level adjustment unit 24H, supplies the mid-frequency component signal S2M to the band-specific level adjustment unit 24M, and the low-frequency component signal S2L. Is supplied to the band-specific level adjusting unit 24L.
 帯域別レベル調整部24Hは、オーディオ信号の高域成分のレベルを調整し、帯域別レベル調整部24Mはオーディオ信号の中域成分のレベルを調整し、帯域別レベル調整部24Lはオーディオ信号の低域成分のレベルを調整する。 The level adjusting unit 24H for each band adjusts the level of the high frequency component of the audio signal, the level adjusting unit 24M for each band adjusts the level of the middle frequency component of the audio signal, and the level adjusting unit 24L for each band reduces the level of the audio signal. Adjust the level of the band component.
 具体的に、帯域別レベル調整部24Hは、帯域分割フィルタ21Aからオーディオ信号S1の高域成分信号S1Hを取得するとともに帯域分割フィルタ21Bからオーディオ信号S2の高域成分信号S2Hを取得する。また、帯域別レベル調整部24Hは、最適ミックスレベル算出部22から混合割合情報MP及び調整パラメータVhを取得する。そして、帯域別レベル調整部24Hは、オーディオ信号S1の高域成分信号S1Hとオーディオ信号S2の高域成分信号S2Hを、混合割合情報MPが示す混合割合(I:J)で混合し、混合した信号に対して調整パラメータVhを乗算する。 Specifically, the level adjusting unit 24H for each band acquires the high frequency component signal S1H of the audio signal S1 from the band division filter 21A and also acquires the high frequency component signal S2H of the audio signal S2 from the band division filter 21B. Further, the band-specific level adjustment unit 24H acquires the mixing ratio information MP and the adjustment parameter Vh from the optimum mix level calculation unit 22. Then, the level adjusting unit 24H for each band mixes the high frequency component signal S1H of the audio signal S1 and the high frequency component signal S2H of the audio signal S2 at a mixing ratio (I: J) indicated by the mixing ratio information MP, and mixes them. The signal is multiplied by the adjustment parameter Vh.
 帯域別レベル調整部24Mは、帯域分割フィルタ21Aからオーディオ信号S1の中域成分信号S1Mを取得するとともに帯域分割フィルタ21Bからオーディオ信号S2の中域成分信号S2Mを取得する。また、帯域別レベル調整部24Mは、最適ミックスレベル算出部22から混合割合情報MP及び調整パラメータVmを取得する。そして、帯域別レベル調整部24Mは、オーディオ信号S1の中域成分信号S1Mとオーディオ信号S2の中域成分信号S2Mを、混合割合情報MPが示す混合割合で混合し、混合した信号に対して調整パラメータVmを乗算する。 The level adjusting unit 24M for each band acquires the middle band component signal S1M of the audio signal S1 from the band division filter 21A and also acquires the middle band component signal S2M of the audio signal S2 from the band division filter 21B. Further, the band-specific level adjustment unit 24M acquires the mixing ratio information MP and the adjustment parameter Vm from the optimum mix level calculation unit 22. Then, the level adjusting unit 24M for each band mixes the middle band component signal S1M of the audio signal S1 and the middle band component signal S2M of the audio signal S2 at the mixing ratio indicated by the mixing ratio information MP, and adjusts the mixed signal. Multiply the parameter Vm.
 同様に、帯域別レベル調整部24Lは、帯域分割フィルタ21Aからオーディオ信号S1の低域成分信号S1Lを取得するとともに帯域分割フィルタ21Bからオーディオ信号S2の低域成分信号S2Lを取得する。また、帯域別レベル調整部24Lは、最適ミックスレベル算出部22から混合割合情報MP及び調整パラメータVlを取得する。そして、帯域別レベル調整部24Lは、オーディオ信号S1の低域成分信号S1Lとオーディオ信号S2の低域成分信号S2Lを、混合割合情報MPが示す混合割合で混合し、混合した信号に対して調整パラメータVlを乗算する。 Similarly, the band-specific level adjusting unit 24L acquires the low frequency component signal S1L of the audio signal S1 from the band division filter 21A and also acquires the low frequency component signal S2L of the audio signal S2 from the band division filter 21B. Further, the band-specific level adjustment unit 24L acquires the mixing ratio information MP and the adjustment parameter Vl from the optimum mix level calculation unit 22. Then, the level adjusting unit 24L for each band mixes the low frequency component signal S1L of the audio signal S1 and the low frequency component signal S2L of the audio signal S2 at the mixing ratio indicated by the mixing ratio information MP, and adjusts the mixed signal. Multiply the parameter Vl.
 このように、帯域別レベル調整部24H、24M及び24Lは、オーディオ信号S1及びS2の各帯域の成分を混合割合情報MPが示す混合割合で混合した後、帯域毎に決定された調整パラメータVh、Vm及びVlに基づいて混合信号をレベル調整する。ここで、各帯域の調整パラメータVh、Vm及びVlは、前述のように、帯域間変化比率が1:1:1となるように決定されているので、レベル調整後の各帯域の信号レベルは、混合前における各帯域の信号レベルのバランスを維持したものとなっている。 As described above, the band-specific level adjusting units 24H, 24M, and 24L mix the components of the respective bands of the audio signals S1 and S2 at the mixing ratio indicated by the mixing ratio information MP, and then adjust the adjustment parameters Vh determined for each band. The level of the mixed signal is adjusted based on Vm and Vl. Here, as described above, the adjustment parameters Vh, Vm and Vl of each band are determined so that the change ratio between the bands is 1: 1: 1. Therefore, the signal level of each band after the level adjustment is The signal level balance of each band before mixing is maintained.
 そして、加算器25は、帯域別レベル調整部24H、24M及び24Lから出力される各帯域の混合信号を加算して混合オーディオ信号として出力する。 The adder 25 adds the mixed signals of the respective bands output from the band-specific level adjusting units 24H, 24M, and 24L, and outputs the result as a mixed audio signal.
 このように、オーディオ信号混合装置は、信号の混合前後で帯域間のレベルバランスを維持するように、帯域毎に調整パラメータを算出し、帯域毎に当該調整パラメータでレベルを調整した信号を加算して混合オーディオ信号として出力する。これによれば、オーディオ信号混合装置は、帯域間のレベルバランスを保った混合オーディオ信号を生成することができる。 Thus, the audio signal mixing device calculates the adjustment parameter for each band so as to maintain the level balance between the bands before and after mixing the signals, and adds the signal whose level is adjusted with the adjustment parameter for each band. Output as a mixed audio signal. According to this, the audio signal mixing apparatus can generate a mixed audio signal that maintains a level balance between bands.
 なお、上記の構成において、最適ミックスレベル算出部22は、本発明における混合割合取得手段、調整量決定手段、レベル変化率計算手段、解析手段、レベル情報取得手段として機能する。また、帯域別レベル調整部24H、24M及び24Lは、本発明における信号混合手段及びレベル調整手段として機能し、加算器25は本発明における加算手段として機能する。 In the above configuration, the optimum mix level calculation unit 22 functions as a mixing ratio acquisition unit, an adjustment amount determination unit, a level change rate calculation unit, an analysis unit, and a level information acquisition unit in the present invention. The band-specific level adjusting units 24H, 24M and 24L function as signal mixing means and level adjusting means in the present invention, and the adder 25 functions as adding means in the present invention.
 [第1実施例に係るオーディオ信号混合方法]
 次に、第1実施例に係るオーディオ信号混合方法について図4に示すフローチャートを用いて説明する。
[Audio signal mixing method according to first embodiment]
Next, the audio signal mixing method according to the first embodiment will be described with reference to the flowchart shown in FIG.
 まず、マイクロコンピュータ4は、クロスフェーダ5の位置を検出し、クロスフェーダ5の位置がミックス位置である場合(ステップS101;Yes)、マイクロコンピュータ4は、クロスフェーダ5の位置情報を混合割合情報MPとしてDSP2へ送出する(ステップS102)。ここでいうミックス位置とは、クロスフェーダの両端以外の位置をいう。 First, the microcomputer 4 detects the position of the crossfader 5, and when the position of the crossfader 5 is the mix position (step S101; Yes), the microcomputer 4 converts the position information of the crossfader 5 into the mixing ratio information MP. To the DSP 2 (step S102). The mix position here refers to a position other than both ends of the crossfader.
 そして、DSP2Aは、各チャンネルのオーディオ信号を取得し(ステップS103)、当該オーディオ信号について、DSP2A内の最適ミックスレベル算出部22が周波数特性解析を行う(ステップS104)。 The DSP 2A acquires the audio signal of each channel (step S103), and the optimal mix level calculation unit 22 in the DSP 2A performs frequency characteristic analysis on the audio signal (step S104).
 そして、最適ミックスレベル算出部22は、各チャンネルのオーディオ信号について、高域、中域及び低域の3帯域の平均レベルを算出する(ステップS105)。具体的には、最適ミックスレベル算出部22は、オーディオ信号S1について高域平均レベルH1、中域平均レベルM1及び低域平均レベルL1を算出し、オーディオ信号S2について高域平均レベルH2、中域平均レベルM2及び低域平均レベルL2を算出する。 Then, the optimum mix level calculation unit 22 calculates the average level of the three bands of high frequency, mid frequency and low frequency for the audio signal of each channel (step S105). Specifically, the optimum mix level calculation unit 22 calculates the high frequency average level H1, the mid frequency average level M1, and the low frequency average level L1 for the audio signal S1, and the high frequency average level H2 and the mid frequency for the audio signal S2. An average level M2 and a low frequency average level L2 are calculated.
 次に、最適ミックスレベル算出部22は、各チャンネルのオーディオ信号を、混合割合情報MPが示す混合割合(I:J)で混合して混合信号を生成する(ステップS106)。 Next, the optimal mix level calculation unit 22 generates a mixed signal by mixing the audio signals of the respective channels at the mixing ratio (I: J) indicated by the mixing ratio information MP (step S106).
 次に、最適ミックスレベル算出部22は、混合信号について周波数特性解析を行い(ステップS107)、混合信号の3帯域の平均レベルである、低域平均レベルL、中域平均レベルM及び高域平均レベルHを算出する(ステップS108)。 Next, the optimum mix level calculation unit 22 performs frequency characteristic analysis on the mixed signal (step S107), and the low frequency average level L, the mid frequency average level M, and the high frequency average that are the average levels of the three bands of the mixed signal. Level H is calculated (step S108).
 そして、最適ミックスレベル算出部22は、帯域間変化比率H/LH:M/LM:L/LLを算出し(ステップS109)、帯域間変化比率が1:1:1となるような調整パラメータVh、Vm及びVlを算出し(ステップS110)、当該調整パラメータを各帯域別レベル調整部24H、24M及び24Lへ送出する。 Then, the optimum mix level calculation unit 22 calculates the interband change ratio H / LH: M / LM: L / LL (step S109) and adjusts the adjustment parameter Vh so that the interband change ratio is 1: 1: 1. Vm and Vl are calculated (step S110), and the adjustment parameters are sent to the band-specific level adjustment units 24H, 24M, and 24L.
 一方、帯域分割フィルタ21A及び帯域分割フィルタ21Bは、各入力信号を3帯域に分割し、各帯域の信号を帯域別レベル調整部24H、24M及び24Lへ送出する(ステップS111)。 On the other hand, the band division filter 21A and the band division filter 21B divide each input signal into three bands, and send the signals in each band to the band-specific level adjustment units 24H, 24M, and 24L (step S111).
 帯域別レベル調整部24H、24M及び24Lは、取得した信号を、混合割合情報MPが示す混合割合(I:J)で混合する(ステップS112)。そして、各帯域別レベル調整部24H、24M及び24Lは、混合された信号に対して調整パラメータVh、Vm及びVlを乗算する(ステップS113)。加算部25は、各帯域別レベル調整部24H、24M及び24Lが出力した信号を加算し(ステップS114)、全体域の混合オーディオ信号として出力し(ステップS115)、処理を終了する。 The band-specific level adjusting units 24H, 24M, and 24L mix the acquired signals at the mixing ratio (I: J) indicated by the mixing ratio information MP (step S112). Then, each of the band level adjusting units 24H, 24M, and 24L multiplies the mixed signals by adjustment parameters Vh, Vm, and Vl (step S113). The adding unit 25 adds the signals output from the level adjusting units 24H, 24M, and 24L for each band (step S114), outputs the signals as mixed audio signals for the entire region (step S115), and ends the process.
 [第2実施例]
 次に、本発明の第2実施例について説明する。図5に第2実施例に係るオーディオ信号混合装置1のDSP2B内の概略構成を示す。なお、図1に示す第1実施例のDSP2Aと同一の構成要素には同一の符号を付し、その説明を省略する。
[Second Embodiment]
Next, a second embodiment of the present invention will be described. FIG. 5 shows a schematic configuration in the DSP 2B of the audio signal mixing device 1 according to the second embodiment. In addition, the same code | symbol is attached | subjected to the component same as DSP2A of 1st Example shown in FIG. 1, and the description is abbreviate | omitted.
 第2実施例に係るオーディオ信号混合装置1のDSP2Bは、BPM検出部26を備えるが、それ以外の点は基本的に第1実施例のDSP2Aと同様である。なお、BPM検出部26は本発明における拍検出手段として機能する。 The DSP 2B of the audio signal mixing device 1 according to the second embodiment includes the BPM detection unit 26, but the other points are basically the same as the DSP 2A of the first embodiment. The BPM detector 26 functions as a beat detector in the present invention.
 BPM検出部26は、オーディオ信号S2のBPM(Beat Per Minute)を検出する。具体的にはBPM検出部26は、オーディオ信号S2中の拍の位置、例えば低域レベルが一気に上がる部分を検出し、最適ミックスレベル算出部22へ通知する。最適ミックスレベル算出部22は、拍の位置を含む一定時間を調整対象期間とし、調整対象期間におけるオーディオ信号S1及びオーディオ信号S2に基づいて、第1実施例と同様の手法で、帯域間変化比率が1:1:1となるように調整パラメータVh、Vm及びVlを生成する。なお、最適ミックスレベル算出部22は、調整対象期間以外の期間では調整パラメータVh、Vm及びVlの全てを「1」とする。最適ミックスレベル算出部22は、こうして生成した調整パラメータVh、Vm及びVlを帯域別レベル調整部24H、24M及び24Lへ送出する。 The BPM detection unit 26 detects the BPM (Beat Per Minute) of the audio signal S2. Specifically, the BPM detection unit 26 detects the position of the beat in the audio signal S2, for example, a portion where the low frequency level rises at a stroke, and notifies the optimum mix level calculation unit 22 of it. The optimal mix level calculation unit 22 sets a certain time including the position of the beat as the adjustment target period, and based on the audio signal S1 and the audio signal S2 in the adjustment target period, in the same manner as in the first embodiment, the interband change ratio The adjustment parameters Vh, Vm, and Vl are generated so that becomes 1: 1: 1. The optimal mix level calculation unit 22 sets all the adjustment parameters Vh, Vm, and Vl to “1” in a period other than the adjustment target period. The optimum mix level calculation unit 22 sends the adjustment parameters Vh, Vm, and Vl generated in this way to the band-specific level adjustment units 24H, 24M, and 24L.
 このように、第2実施例では、一般的に信号の混合前後において帯域間のレベルバランスが崩れやすいと考えられる拍の位置をBPM検出部26で検出し、拍の位置周辺の調整対象期間においてのみ調整パラメータを利用したレベル調整を行う。一方、調整対象期間以外では、調整パラメータの値を全て「1」として実質的にレベル調整を行わないこととする。つまり、第2実施例では、オーディオ信号混合装置1は、帯域間のレベルバランスが崩れやすい時だけ、調整パラメータを算出して帯域毎にレベル調整を行い、それ以外の期間ではレベル調整を行わない。よって、信号の混合前後で帯域間のレベルバランスが崩れることを防止しつつ、調整パラメータの算出処理及び帯域毎のレベル調整処理の負担を必要最小限に留めることができる。 As described above, in the second embodiment, the BPM detection unit 26 detects the beat position where the level balance between the bands is likely to be lost before and after the signal mixing, and in the adjustment target period around the beat position. Only level adjustment using adjustment parameters is performed. On the other hand, during the period other than the adjustment target period, all adjustment parameter values are set to “1”, and level adjustment is not substantially performed. That is, in the second embodiment, the audio signal mixing device 1 calculates the adjustment parameter and performs the level adjustment for each band only when the level balance between the bands is likely to be lost, and does not perform the level adjustment in other periods. . Therefore, it is possible to minimize the burden of the adjustment parameter calculation processing and the level adjustment processing for each band while preventing the level balance between the bands from being lost before and after mixing the signals.
 [第3実施例]
 次に、本発明の第3実施例について説明する。図6に第3実施例に係るオーディオ信号混合装置1内のDSP2Cの概略構成を示す。なお、図1に示す第1実施例のオーディオ信号混合装置1と同一の構成要素には同一の符号を付し、その説明を省略する。第3実施例に係るオーディオ信号混合装置1のDSP2Cは、第1実施例のDSP2Aにおける最適ミックスレベル算出部22を省略している。
[Third embodiment]
Next, a third embodiment of the present invention will be described. FIG. 6 shows a schematic configuration of the DSP 2C in the audio signal mixing device 1 according to the third embodiment. In addition, the same code | symbol is attached | subjected to the component same as the audio signal mixing apparatus 1 of 1st Example shown in FIG. 1, and the description is abbreviate | omitted. The DSP 2C of the audio signal mixing device 1 according to the third embodiment omits the optimum mix level calculation unit 22 in the DSP 2A of the first embodiment.
 第3実施例では、帯域別レベル調整部24H、24M及び24Lは、混合割合情報MPに基づいて、帯域毎にオーディオ信号S1とS2を混合した後に、混合信号に対して帯域毎に予め定められた調整パラメータ(以下、「デフォルト調整パラメータ」と呼ぶ。)を乗算する。そして、加算器25は、各帯域毎にデフォルト調整パラメータを乗算した信号を加算し、混合オーディオ信号として出力する。 In the third embodiment, the band-specific level adjusting units 24H, 24M, and 24L are predetermined for each band with respect to the mixed signal after mixing the audio signals S1 and S2 for each band based on the mixing ratio information MP. The adjustment parameter (hereinafter referred to as “default adjustment parameter”) is multiplied. And the adder 25 adds the signal which multiplied the default adjustment parameter for every band, and outputs it as a mixed audio signal.
 ここで、デフォルト調整パラメータの決定例について説明する。混合の対象となる複数のオーディオ信号を考えた場合、一般的に低域成分は比較的相関が高いので混合したときにある程度のレベルの増加が見込まれる。一方、中・高域成分は低域成分に比べて相関が低いので、混合したときのレベルの増加は低域成分と比べて小さいと考えられる。そこで、信号の混合により例えば低域成分は6dB程度、中・高域成分は3dB程度のレベル増加があると想定し、低域成分のレベルを中・高域成分のレベルより3dB程度下げるようにデフォルト調整パラメータを決定する。これにより、信号の混合後における帯域毎のレベルバランスを維持することができる。なお、上記の値は単なる一例であり、混合する曲の種類などに応じて適宜決定することができる。 Here, an example of determining the default adjustment parameters will be described. Considering a plurality of audio signals to be mixed, generally, low-frequency components have a relatively high correlation, and therefore a certain level of increase is expected when mixed. On the other hand, since the correlation between the mid and high frequency components is lower than that of the low frequency components, the increase in the level when mixed is considered to be small compared to the low frequency components. Therefore, it is assumed that the level of the low frequency component is increased by about 6 dB and the level of the middle / high frequency component is increased by about 3 dB, and the level of the low frequency component is lowered by about 3 dB from the level of the middle / high frequency component. Determine default tuning parameters. Thereby, the level balance for every zone | band after mixing of a signal is maintainable. In addition, said value is a mere example and can be suitably determined according to the kind etc. of the music to mix.
 第3実施例のオーディオ信号混合装置1の場合、第1及び第2の実施例と異なり、混合の対象となるオーディオ信号を解析等することなく、予め決定されたデフォルト調整パラメータにより帯域毎のレベル調整が行われる。これにより、装置の構成が簡素化されるので、DSPのような高性能な部品を使えないアナログ回路中心の装置でも、帯域間のレベルバランスを調整し得るオーディオ信号混合装置を実現することができる。 In the case of the audio signal mixing apparatus 1 of the third embodiment, unlike the first and second embodiments, the level for each band is determined by the default adjustment parameter determined in advance without analyzing the audio signal to be mixed. Adjustments are made. As a result, the configuration of the apparatus is simplified, and an audio signal mixing apparatus capable of adjusting the level balance between bands can be realized even in an analog circuit-centric apparatus that cannot use high-performance components such as a DSP. .
 以上説明したように、本発明のオーディオ信号混合装置1は、複数のオーディオ信号を混合した際の帯域毎のレベル間のバランス調整を行った上で、混合オーディオ信号を出力しているので、利用者にとって違和感のない混合オーディオ信号を出力することができる。 As described above, the audio signal mixing apparatus 1 of the present invention outputs a mixed audio signal after adjusting the balance between levels for each band when a plurality of audio signals are mixed. Can output a mixed audio signal that is comfortable for the user.
 先行技術に係るオーディオ信号混合装置は、操作子の位置に対応して混合させたい楽曲同士のレベルを調整しながら1つの操作子でスムーズに混合を行えるというものだが、実際にはディスクジョッキー(DJ)などが楽曲同士をつなげるためにこの操作子で混合を行う際、いずれかの曲の低域レベルをイコライザーつまみ等で下げて干渉しないようにして混合することが多い。これは、混合することによって帯域毎の音圧差が変化して相対的に低域の音圧が上がって聞こえてしまうため、違和感を覚えたDJが自然に身につけたテクニックである。しかし、より簡単に違和感の少ない混合を行うためには、本発明のように信号の混合前と混合後の帯域毎のレベル変化率を検出してレベルを補正すればよい。これにより、1つの操作子で違和感のないミックスプレイが可能となる。 The audio signal mixing apparatus according to the prior art is capable of smoothly mixing with one operator while adjusting the level of music pieces to be mixed according to the position of the operator, but in reality, a disc jockey (DJ ), Etc. are often mixed with this operation element so as to connect the music pieces by lowering the low frequency level of any music piece with an equalizer knob or the like so as not to interfere. This is a technique that a DJ who has a sense of discomfort naturally wears because the sound pressure difference for each band changes due to mixing and the sound pressure in a relatively low range increases and sounds. However, in order to perform mixing with less uncomfortable feeling more easily, the level may be corrected by detecting the level change rate for each band before and after mixing signals as in the present invention. Thereby, the mix play without a sense of incongruity is attained by one operation element.
 [変形例]
 上述の第1実施例では、入力信号についてリアルタイムで周波数特性解析を行い各帯域の平均レベルを算出する手法について述べたが、本発明はこれに限られず、他のPC(パーソナルコンピュータ)などから、予め取得されている周波数特性のデータを取得するようにしてもよい。この場合、オーディオ信号混合装置1は、周波数特性解析を行う必要がないので、装置の処理負担を軽減させることができる。
[Modification]
In the first embodiment described above, the method of calculating the average level of each band by performing frequency characteristic analysis on the input signal in real time has been described. However, the present invention is not limited to this, and from other PCs (personal computers), etc. You may make it acquire the data of the frequency characteristic acquired beforehand. In this case, since the audio signal mixing device 1 does not need to perform frequency characteristic analysis, the processing load on the device can be reduced.
 また、上述の実施例では、オーディオ信号を3つの帯域に分割する場合について述べたが、本発明は、これに限られず、混合の対象となるオーディオ信号を2つ又は4つ以上の帯域に分割して各帯域間のレベルバランス調整を行うこととしても良い。 In the above-described embodiments, the case where the audio signal is divided into three bands has been described. However, the present invention is not limited to this, and the audio signal to be mixed is divided into two or four or more bands. Then, the level balance between the bands may be adjusted.
 また、上述の実施例では、オーディオ信号混合装置1は、2つのオーディオ信号を混合する場合について述べたが、本発明は、これに限られず、3以上のオーディオ信号を混合するようにしても良い。 Moreover, although the audio signal mixing apparatus 1 described the case where two audio signals are mixed in the above-described embodiment, the present invention is not limited to this, and three or more audio signals may be mixed. .
 また、上述の実施例では、ユーザが混合割合を指示、入力するためにクロスフェーダを用いているが、本発明は、これに限られず、他の種々の操作により、ユーザが混合割合を指示するようにしても良い。 In the above-described embodiment, the crossfader is used for the user to specify and input the mixing ratio. However, the present invention is not limited to this, and the user specifies the mixing ratio by various other operations. You may do it.
 本発明は、DJ機器、音響業務用ミキサ、家庭用レコーディング機器、PCアプリケーションで複数のオーディオ信号を混合する際に利用することができる。 The present invention can be used when a plurality of audio signals are mixed in a DJ device, a sound business mixer, a home recording device, or a PC application.

Claims (6)

  1.  複数のオーディオ信号を取得するオーディオ信号取得手段と、
     前記複数のオーディオ信号の混合割合を取得する混合割合取得手段と、
     前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベルの調整量を決定する調整量決定手段と、
     前記複数のオーディオ信号を、前記混合割合で帯域毎に混合して、帯域毎に混合信号を出力する信号混合手段と、
     前記混合信号に対して、前記調整量に基づき、帯域毎にレベル調整を行うレベル調整手段と、
     前記レベル調整手段によりレベル調整された各帯域の信号を加算し、混合オーディオ信号として出力する加算手段と、を備えることを特徴とするオーディオ信号混合装置。
    Audio signal acquisition means for acquiring a plurality of audio signals;
    Mixing ratio acquisition means for acquiring a mixing ratio of the plurality of audio signals;
    An adjustment amount determining means for determining an adjustment amount of the level of each band when the plurality of audio signals are mixed at the mixing ratio;
    The signal mixing means for mixing the plurality of audio signals for each band at the mixing ratio and outputting a mixed signal for each band;
    Level adjustment means for performing level adjustment for each band based on the adjustment amount for the mixed signal;
    An audio signal mixing apparatus comprising: adding means for adding the signals of the respective bands whose levels have been adjusted by the level adjusting means and outputting them as mixed audio signals.
  2.  前記複数のオーディオ信号の周波数特性を解析し、帯域毎のレベル情報を得る解析手段と、
     前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベル変化率を、前記帯域毎のレベル情報を用いて計算するレベル変化率計算手段と、をさらに備え、
     前記調整量決定手段は、前記レベル変化率に基づいて調整量を決定することを特徴とする請求項1に記載のオーディオ信号混合装置。
    Analyzing means for analyzing frequency characteristics of the plurality of audio signals and obtaining level information for each band;
    Level change rate calculating means for calculating a level change rate of each band when the plurality of audio signals are mixed at the mixing ratio, using level information for each band; and
    The audio signal mixing apparatus according to claim 1, wherein the adjustment amount determination unit determines an adjustment amount based on the level change rate.
  3.  前記複数のオーディオ信号に基づいて拍位置を検出する拍位置検出手段をさらに備え、
     前記レベル調整手段は、前記拍位置を含む所定期間にレベル調整を行うことを特徴とする請求項2に記載のオーディオ信号混合装置。
    Beat position detecting means for detecting a beat position based on the plurality of audio signals,
    The audio signal mixing apparatus according to claim 2, wherein the level adjustment unit performs level adjustment in a predetermined period including the beat position.
  4.  前記複数のオーディオ信号の周波数特性に基づく帯域毎のレベル情報を取得するレベル情報取得手段と、
     前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベル変化率を、前記帯域毎のレベル情報を用いて計算するレベル変化率計算手段と、をさらに備え、
     前記調整量決定手段は、前記レベル変化率に基づいて調整量を決定することを特徴とする請求項1に記載のオーディオ信号混合装置。
    Level information acquisition means for acquiring level information for each band based on frequency characteristics of the plurality of audio signals;
    Level change rate calculating means for calculating a level change rate of each band when the plurality of audio signals are mixed at the mixing ratio, using level information for each band; and
    The audio signal mixing apparatus according to claim 1, wherein the adjustment amount determination unit determines an adjustment amount based on the level change rate.
  5.  前記調整量決定手段は、予め決定された調整量を保持していることを特徴とする請求項1に記載のオーディオ信号混合装置。 2. The audio signal mixing apparatus according to claim 1, wherein the adjustment amount determination means holds a predetermined adjustment amount.
  6.  複数のオーディオ信号を混合するオーディオ信号混合方法であって、
     複数のオーディオ信号を取得するオーディオ信号取得工程と、
     前記複数のオーディオ信号の混合割合を取得する混合割合取得工程と、
     前記複数のオーディオ信号を前記混合割合で混合したときにおける各帯域のレベルの調整量を決定する調整量決定工程と、
     前記複数のオーディオ信号を前記混合割合で帯域毎に混合して、帯域毎に混合信号を出力する信号混合手段と、
     前記混合信号に対して、前記調整量に基づき、帯域毎にレベル調整を行うレベル調整手段と、
     前記レベル調整手段によりレベル調整された各帯域の信号を加算し、混合オーディオ信号として出力する加算手段と、を備えることを特徴とするオーディオ信号混合方法。
    An audio signal mixing method for mixing a plurality of audio signals,
    An audio signal acquisition step of acquiring a plurality of audio signals;
    A mixing ratio acquisition step of acquiring a mixing ratio of the plurality of audio signals;
    An adjustment amount determining step for determining an adjustment amount of the level of each band when the plurality of audio signals are mixed at the mixing ratio;
    Signal mixing means for mixing the plurality of audio signals for each band at the mixing ratio, and outputting a mixed signal for each band;
    Level adjustment means for performing level adjustment for each band based on the adjustment amount for the mixed signal;
    An audio signal mixing method comprising: adding means for adding signals of respective bands whose levels have been adjusted by the level adjusting means and outputting the signals as mixed audio signals.
PCT/JP2009/052314 2009-02-12 2009-02-12 Audio signal mixer WO2010092674A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US13/148,877 US20110317851A1 (en) 2009-02-12 2009-02-12 Audio signal mixing device
PCT/JP2009/052314 WO2010092674A1 (en) 2009-02-12 2009-02-12 Audio signal mixer
JP2010550370A JP4855542B2 (en) 2009-02-12 2009-02-12 Audio signal mixing device
EP09839996A EP2398252A4 (en) 2009-02-12 2009-02-12 Audio signal mixer

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2009/052314 WO2010092674A1 (en) 2009-02-12 2009-02-12 Audio signal mixer

Publications (1)

Publication Number Publication Date
WO2010092674A1 true WO2010092674A1 (en) 2010-08-19

Family

ID=42561526

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2009/052314 WO2010092674A1 (en) 2009-02-12 2009-02-12 Audio signal mixer

Country Status (4)

Country Link
US (1) US20110317851A1 (en)
EP (1) EP2398252A4 (en)
JP (1) JP4855542B2 (en)
WO (1) WO2010092674A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014202892A (en) * 2013-04-04 2014-10-27 パイオニア株式会社 Acoustic equipment

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9696884B2 (en) * 2012-04-25 2017-07-04 Nokia Technologies Oy Method and apparatus for generating personalized media streams
WO2019043797A1 (en) * 2017-08-29 2019-03-07 Pioneer DJ株式会社 Song analysis device and song analysis program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05291839A (en) * 1992-04-08 1993-11-05 Sony Corp Audio mixer device
JPH08195068A (en) 1995-01-20 1996-07-30 Pioneer Electron Corp Audio signal mixer
JP2005292317A (en) * 2004-03-31 2005-10-20 Denon Ltd Mixing device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004343590A (en) * 2003-05-19 2004-12-02 Nippon Telegr & Teleph Corp <Ntt> Stereophonic signal processing method, device, program, and storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05291839A (en) * 1992-04-08 1993-11-05 Sony Corp Audio mixer device
JPH08195068A (en) 1995-01-20 1996-07-30 Pioneer Electron Corp Audio signal mixer
JP2005292317A (en) * 2004-03-31 2005-10-20 Denon Ltd Mixing device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014202892A (en) * 2013-04-04 2014-10-27 パイオニア株式会社 Acoustic equipment

Also Published As

Publication number Publication date
US20110317851A1 (en) 2011-12-29
EP2398252A4 (en) 2012-10-17
EP2398252A1 (en) 2011-12-21
JP4855542B2 (en) 2012-01-18
JPWO2010092674A1 (en) 2012-08-16

Similar Documents

Publication Publication Date Title
US8041046B2 (en) Reverberation adjusting apparatus, reverberation adjusting method, reverberation adjusting program, recording medium on which the reverberation adjusting program is recorded, and sound field correcting system
US9281795B2 (en) Acoustic signal processing apparatus
US7490044B2 (en) Audio signal processing
EP2291002B1 (en) Acoustic processing apparatus
US8638962B2 (en) Method to reduce feedback in hearing aids
US8031876B2 (en) Audio system
US9386389B2 (en) Audio signal processing device
US8638954B2 (en) Audio signal processing apparatus and speaker apparatus
JP4855542B2 (en) Audio signal mixing device
WO2007116802A1 (en) Output control device, output control method, output control program, and recording medium
US9666196B2 (en) Recording apparatus with mastering function
US9240208B2 (en) Recording apparatus with mastering function
US8300835B2 (en) Audio signal processing apparatus, audio signal processing method, audio signal processing program, and computer-readable recording medium
JP4430105B2 (en) Sound playback device
US20150236664A1 (en) Sound enhancement for television speakers
JP6531418B2 (en) Signal processor
US20120288122A1 (en) Method and a system for an acoustic curtain that reveals and closes a sound scene
JP2008227606A (en) Band number conversion apparatus and band number conversion method of equalizer
JP2018133637A (en) Acoustic apparatus and sound quality adjustment method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09839996

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2010550370

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2009839996

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 13148877

Country of ref document: US