KR20150135517A - Mixing management device and mixing management method - Google Patents

Abstract

The first acquisition section 32 acquires the recording characteristic data Q indicating the acoustic characteristics of a plurality of recording data DA representing the sound of the performance part in which the target music piece is different. The second acquiring unit 34 acquires the target characteristic data R indicating the acoustic characteristic of the target of the target musical composition. The setting unit 36 sets the control parameters X (X) applied to the mixing so that the acoustic characteristics after the execution of the mixing with respect to the plurality of recording data DA of the target musical composition approximate to the acoustic characteristics expressed by the target characteristic data R ) Is set according to the recorded characteristic data (Q) and the target characteristic data (R).

Description

TECHNICAL FIELD [0001] The present invention relates to a mixing management device and a mixing management method,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to mixing of a plurality of sound data representing a waveform of sound, and more particularly, to setting of parameters applied to mixing.

There has been proposed a technique of mixing a plurality of pieces of sound data containing a performance sound of each performance part of a musical composition. For example, Patent Document 1 discloses a technique in which a template reflecting a tendency of mixing by a mixing engineer is prepared in advance and applied to mixing of a plurality of sound data.

Japanese Patent No. 4079260

A plurality of sound data is actually recorded based on various conditions (recording environment or usage description). In the technique of Patent Document 1, since the template prepared in advance is not related to the recording condition of the sound data, appropriate mixing which is originally intended by the template is not executed depending on the recording condition of each sound data There is a possibility. In view of the above circumstances, the present invention aims to realize desired mixing by compensating for differences in recording conditions.

In order to solve the above problems, a mixing management apparatus of the present invention comprises: a first acquiring section for acquiring recording characteristic data indicating acoustic characteristics of a plurality of recording data representing musical compositions of different musical compositions; A second obtaining unit that obtains target characteristic data indicating an acoustic characteristic of the plurality of pieces of recording data so as to approximate the acoustic characteristic after the execution of the mixing with respect to the plurality of recorded data to the acoustic characteristic represented by the target characteristic data; And a setting unit for setting a control parameter for setting the control parameter in accordance with the recording characteristic data and the target characteristic data.

A mixing management method of the present invention includes a first acquiring step of acquiring recording characteristic data indicating acoustic characteristics of a plurality of recording data indicating the sound of a different performance piece of music, A second acquisition step of acquiring the characteristic data and a control parameter to be applied to the mixing so that the acoustic characteristic after the execution of the mixing with respect to the plurality of recorded data approximates the acoustic characteristic expressed by the target characteristic data, And a setting step of setting in accordance with the recorded characteristic data and the target characteristic data.

1 is a block diagram of a sound processing system according to a first embodiment of the present invention.
2 is a diagram for explaining a mixing of a plurality of recorded data.
3 is an explanatory diagram of various data.
4 is a block diagram of a functional configuration of a sound processing system.
5 is an explanatory diagram of the operation of the sound processing system.
6 is a block diagram of a functional configuration of the sound processing system according to the second embodiment.
7 is an explanatory diagram of the operation of the sound processing system according to the second embodiment.
8 is an explanatory diagram of correction data.
Fig. 9 is an explanatory diagram of target characteristic data in the third embodiment. Fig.
10 is an explanatory diagram of the operation of the sound processing system in the third embodiment.
11 is a list explanatory diagram of target characteristic data.
12 is a block diagram of a functional configuration of the mixing management apparatus according to the fourth embodiment.
13 is a block diagram of a functional configuration of a mixing management apparatus according to a modification.

≪ First Embodiment >

1 is a block diagram of an acoustic processing system 100 according to a first embodiment of the present invention. 1, the sound processing system 100 is a communication system including a plurality of terminal devices 12 and a mixing management device 14. [ Each terminal device 12 is a communication terminal such as a mobile phone, a smart phone, or a tablet, and communicates with the mixing management device 14 via a communication network 16 such as a mobile communication network or the Internet.

1, each of the terminal devices 12 includes a control device 121, a storage device 122, a communication device 123, a display device 124, And is realized by a computer system having an input device 125 and a soundproofing device 126. [ The control device 121 is an arithmetic processing device that executes various control processing and arithmetic processing by executing a program stored in the storage device 122. [ The storage device 122 (for example, a semiconductor recording medium) stores a program executed by the control device 121 or various data used by the control device 121. [ The communication device 123 communicates with the mixing management device 14 via the communication network 16. [ Communication between the terminal device 12 and the communication network 16 is typically wireless communication. For example, when the stationary information processing device is used as the terminal device 12, It is also possible to perform wired communication.

The display device 124 (e.g., a liquid crystal display panel) displays an image instructed from the control device 121. [ The input device 125 is an operating device for accepting an instruction from the user for the terminal device 12, for example, including a plurality of operators operated by the user. It is also possible to employ a touch panel integrally formed with the display device 124 as the input device 125. [

The control device 121 of the first embodiment functions as the sound processing section 22 of Fig. 2 by executing the program stored in the storage device 122. [ As shown in Fig. 2, the sound processing section 22 generates adjusted sound data DB by mixing a plurality of recorded data DA corresponding to different performance parts of music. Each recorded data DA is sound data representing a time waveform of a performance sound (voice or a tone) recorded in advance for a specific performance part of the music. On the other hand, the adjusted sound data DB is sound data (for example, sound data of two channels on the left and right sides) representing a time waveform of a performance sound of a music composed of a plurality of performance parts.

Specifically, the sound processing section 22 generates the adjusted sound data DB by adding sound processing to each of the plurality of recorded data DA of the music piece separately, and adding them together. The acoustic processing for each recorded data DA is various signal processing for changing the acoustic characteristic. For example, an amplification process for increasing or decreasing the average volume of the sound, a characteristic adjustment process for changing the frequency characteristics of the sound (for example, the volume per band), a delay process for delaying the sound on the time axis, As shown in Fig. Control parameters (hereinafter referred to as " control parameters ") X are applied to mixing of the plurality of recorded data DA by the sound processing section 22. [ The soundproofing device 126 reproduces sounds according to the adjusted sound data DB generated by the sound processing section 22. [ In addition, the illustration of the D / A converter for converting the adjusted sound data DB from digital to analog has been omitted for convenience.

The mixing management device 14 of FIG. 1 manages the mixing of a plurality of recorded data DA by the sound processing section 22 of each terminal device 12. Specifically, the mixing management device 14 of the first embodiment is a server device (typically a web server) for setting a preferable control parameter X to be applied to mixing of a plurality of recorded data DA, and includes a control device 142 And is realized by a computer system having a storage device 144 and a communication device 146. [ It is also possible to realize the mixing management device 14 with a plurality of devices separately configured (for example, a plurality of server devices communicating with each other via the communication network 16). The control device 142 is an arithmetic processing device that executes various control processes and arithmetic processes by executing the program stored in the storage device 144. [ The communication device 146 communicates with each of the terminal devices 12 via the communication network 16.

The storage device 144 stores programs executed by the control device 142 and various data used by the control device 142. [ For example, a known recording medium such as a semiconductor recording medium or a magnetic recording medium, or a combination of a plurality of recording media may be employed as the storage device 144. A storage device 144 is installed in an external device (for example, a server device) which is separate from the mixing management device 14 and the mixing management device 14 is connected to the storage device 144 of the external device via the communication network 16 ) May be employed as well.

3 is an explanatory diagram of the storage contents by the storage device 144 and the operation contents of the control device 142. Fig. As illustrated in FIG. 3, the storage device 144 of the first embodiment stores a plurality of pieces of music data M. Each musical sound data M includes attribute data MA for designating related information such as a musical composition name and a singer name, and N pieces of recorded data DA (N is a natural number of 2 or more) corresponding to a performance part in which music pieces are different. The N pieces of recorded data DA are sound data to be subjected to mixing by the terminal device 12 (sound processing section 22) as described above. N pieces of recorded data DA of N pieces (N tracks) in which pieces of performance of N performance parts of music are recorded in parallel or individually are stored in the storage device 144. [ Concretely, N pieces of recorded data DA generated by recording the performance sound (multi-track recording) in the acoustic space of a music studio or the like are transmitted from the terminal device 12 to the mixing management device 14, 144). Therefore, even when the music piece itself is common to a plurality of pieces of music data M, the recording condition (recording environment or used device) of each recording data DA may be different for each piece of music data M. In the following description, the case where the musical composition is composed of N performance parts of each piece of music is illustrated for convenience, but in practice, the total number of performance parts may be different for each piece of music.

In addition, the storage device 144 of the first embodiment stores a plurality of target characteristic data R corresponding to different music tones as exemplified in Fig. Each target characteristic data R is data representing an acoustic characteristic (that is, an acoustic characteristic that is a target of mixing) of an exemplary performance sound of a piece of music. As illustrated in FIG. 3, attribute data RA specifying information relating to a piece of music , And N pieces of unit data r [1] to r [N] corresponding to different performance parts. The attribute data RA designates, for example, related information such as a musical composition name or a music composition (structure of intro, A melody, B melody, hook, etc.).

Each unit data r [n] (n = 1 to N) contained in one target characteristic data R is obtained by dividing the acoustic characteristic of the performance sound of the nth one of the N performance parts constituting the music Acoustic characteristics). Specifically, the acoustic characteristics such as the average volume in the music, the time variation of the volume, the sound position (the position at which the sound image perceived by the receiver is positioned), the frequency characteristic, and the reverberation characteristic are specified as the unit data r [n] . Examples of reverberation characteristics include a reverberation time and a length of time of an early reflection section or a rearward reversion section when the reverberation section is divided into an early reflection section and a posterior reversion section on the time axis.

The types of acoustic characteristics designated by the respective unit data r [n] are set individually for each performance part, and may be different between the respective performance parts. 3, the unit data r [n] of a performance part in which a voiced sound (dominant sound) such as a vocal part or a guitar part dominates is a frequency structure (a sequence of an original sound component and a plurality of harmonic components) The unit data r [n] of the performance part including the time variation of the frequency characteristics such as the envelope of the music piece and the unvoiced sound (non-frequency sound) of the drum part (rhythm part) A tempo of a musical composition, a cycle of each beat point, and the like).

The target characteristic data R in the first embodiment are generated in advance by analyzing existing sound data (hereinafter referred to as " target data ") and stored in the storage device 144. [ For example, existing sound data recorded on a recording medium such as a music CD, or audio data in MP3 format for recording to each terminal device 12 is interpreted as target data (i.e., sound data of an exemplary performance sound) So that the target characteristic data R is generated. It is also possible that the producer of the acoustic engineer or the like generates the target characteristic data R manually.

4 is a functional configuration diagram of the mixing management device 14 in the first embodiment. 4, the control device 142 of the mixing management device 14 executes the program stored in the storage device 144 to store N pieces of recorded data (hereinafter referred to as " target music data ") of a specific piece of music A plurality of functions (the first acquisition unit 32, the second acquisition unit 34, the setting unit 36, and the communication control unit 42) for setting and using the control parameter X applied to the mixing of the DA . It is also possible to adopt a configuration in which each function of the control device 142 is distributed to a plurality of integrated circuits or a configuration in which a dedicated electronic circuit (for example, a DSP) realizes a part of the function of the control device 142.

The first acquisition unit 32 of FIG. 4 acquires the recording characteristic data Q indicating the acoustic characteristics of the performance sound (for example, the actual performance sound of each user) indicated by the N recording data DA of the target music. As described above, since the recording conditions (sound characteristics of the played sound) of each recorded data DA can be different for each piece of music data M, even if the pieces of music themselves are common, the recorded characteristic data Q May be different for each piece of music data M.

As illustrated in Fig. 3, the recorded characteristic data Q includes N unit data q [1] to q [N] corresponding to the performance part (track) in which the target music piece is different. Each unit data q [n] represents the acoustic characteristics of the performance sound of one nth one of the N performance parts of the target musical piece. Concretely, like the unit data r [n] of the target characteristic data R, the acoustic characteristics such as the average volume in the music, the time variation of the volume, the sound position, the frequency characteristic and the reverberation characteristic, Is designated as data q [n]. The kind of acoustic characteristic designated by each unit data q [n] may be different for each performance part.

The first acquisition unit 32 of the first embodiment generates the recording characteristic data Q by analyzing the N recording data DA of the music data M of the target music piece stored in the storage device 144. [ Specifically, the first acquisition section 32 determines the performance part for each of the N pieces of recorded data DA of the target musical piece and analyzes the recorded data DA of each performance part to obtain unit data q [n] for each performance part, (Recording characteristic data Q).

In the determination of the performance part of each recorded data DA, for example, reference data defining the time series (i.e., the melody) of the notes of each performance part of the music is appropriately used. The reference data is, for example, time series data in a MIDI (Musical Instrument Digital Interface) format used for playing karaoke. Specifically, the first acquisition unit 32 analyzes the time variation of the pitch of the recorded data DA indicated by the respective recorded data DA, and determines whether or not the time series of the notes in the plurality of the performance parts of the reference data is similar to the time variation of the pitch of the recorded data DA As the performance part of the data DA. In addition, a configuration for discriminating a performance part in accordance with the sound range (range of distribution of sound pitch) of the sound represented by the recording data DA or a configuration for discriminating a performance part depending on the presence or absence of a sound wave structure indicated by the recording data DA The structure in which the performance part of the data DA is judged as the drum part as the structure does not exist) can also be employed.

The second acquiring unit 34 in Fig. 4 acquires the target characteristic data R of the target musical composition. The second acquisition section 34 of the first embodiment selects one target characteristic data R corresponding to the target music piece among the plurality of target characteristic data R stored in the storage device 144 for different pieces of music and stores them in the storage device 144 .

The setting unit 36 sets the control parameter X of the target music piece in accordance with the recording characteristic data Q acquired by the first acquisition unit 32 and the target characteristic data R acquired by the second acquisition unit 34. [ Specifically, the setting unit 36 sets the acoustic characteristic after the execution of mixing for the N recorded data DA of the target music piece to approximate (ideally, coincide) with the acoustic characteristic expressed by the target characteristic data R, And the control parameter X is set according to the target characteristic data R. For example, the control parameter X is set in order so that the acoustic characteristics in the case of mixing the N recorded data DA by applying the provisional control parameter X approximate to the acoustic characteristics of the target characteristic data R (the difference of the acoustic characteristics is minimized) The optimizing process for updating is appropriately used for setting the control parameter X by the setting unit 36. [ As described above, the storing condition of each recorded data DA can be different for each piece of music data M, so that even when the pieces of music themselves are common, the control parameter X can be different for each piece of music data M.

3, the control parameter X of the first embodiment includes a plurality of parameters (a time code X1, a sound volume parameter X2, a positional parameter X3, a frequency characteristic (F characteristic ) Parameter X4, and reverberation parameter X5).

The time code X1 is data for adjusting each point of each recorded data DA on the time axis at the time point corresponding to the target data (synchronizing corresponding musical tones in the music on the time axis). Specifically, the time code X1 specifies the amount of delay (amount of movement on the time axis) of each point in the data DA as each point in the recorded data DA corresponds to each point in the target data. The setting unit 36 sets rhythm information designated by the unit data q [n] of the rhythm part of the recorded characteristic data Q and rhythm information designated by the unit data r [n] of the rhythm part of the target characteristic data R To set the time code X1. Further, for the generation of the time code X1 (synchronization analysis between the recording data DA and the target data), for example, the technique described in Japanese Patent Laid-Open Publication No. 2011-053589 is appropriately used.

The volume parameter X2 is data for approximating (ideally integrating) the volume of each recorded data DA of the music data M to the volume of each performance part of the target data. Specifically, the setting unit 36 sets the unit volume r [n] of the target characteristic data R and the volume (the temporal change of the average volume or the volume in the music) specified by each unit data q [n] And sets the volume parameter X2 according to the difference between the volume specified by the volume parameter X2. The orientation parameter X3 is data for approximating (ideally integrating) the sound position of each stored data DA to the sound position of each performance part of the target data. Specifically, the setting unit 36 sets the position of the sound image specified by the unit data q [n] of the recording characteristic data Q and the position of the sound image specified by each unit data r [n] of the target characteristic data R Set parameter X3.

The frequency characteristic parameter X4 is data for approximating (ideally integrating) the frequency characteristics of the respective recorded data DA of the music data M to the frequency characteristics of the respective performance parts of the target data. For example, Specifies the gain (equalizer parameter) for each band applied. Specifically, the setting unit 36 sets the unit data r [n] of the target characteristic data R and the frequency characteristic (envelope of the frequency structure) specified by the unit data q [n] of the recorded characteristic data Q And the frequency characteristic parameter X4 is set according to the difference between the frequency characteristics to be designated. The reverberation parameter X5 is data for approximating (ideally integrating) the reverberation characteristic of each recorded data DA to the reverberation characteristic of each performance part of the target data. The setting unit 36 sets the reverberation parameter X5 according to the difference between the reverberation characteristic specified by the unit data q [n] of the recorded characteristic data Q and the reverberation characteristic specified by the unit data r [n] of the target characteristic data R Setting. The above is a specific example of the control parameter X.

The communication control unit 42 of FIG. 4 controls communication with each terminal device 12 via the communication device 146. FIG. Specifically, the communication control unit 42 transmits the recording data DA of the control parameter X set by the setting unit 36 to the target music piece and N pieces of music data M of the target music piece stored in the storage device 144 to the communication device ( 146 to the terminal device 12. That is, the control device 142 (communication control section 42) of the first embodiment functions as an element for transmitting the control parameter X and the plurality of stored data DA to the terminal device 12. [

5 is an explanatory diagram of the operation of the first embodiment. The user appropriately operates the input device 125 of the terminal device 12 to select a desired music piece and instruct the start of mixing. The control device 121 of the terminal device 12 transmits a processing request including designation of the target music piece selected by the user from the communication device 123 to the mixing management device 14 via the communication network 16 (S1).

When the communication device 146 receives the processing request transmitted from the terminal device 12, the control device 142 (first acquiring part 32) of the mixing management device 14 acquires attribute data MA Name, etc.) of the target music piece to retrieve the music data M of the target music piece designated in the processing request from the storage device 144 and to analyze the music data M (each recording data DA) of the target music piece to generate the recording characteristic data Q S2). The control device 142 (the second obtaining unit 34) searches the target characteristic data R of the target music piece by referring to the attribute data RA (music name, etc.) of each target characteristic data R, The data R is acquired from the storage device 144 (S3). The control unit 142 (setting unit 36) determines whether or not the acoustic characteristics of the N pieces of recorded data DA of the target musical composition after the mixing is approximated to the acoustic characteristics of the target characteristic data R, And control parameters X (X1 to X5) corresponding to the target characteristic data R acquired in step S3 (S4). The control device 142 (communication control section 42) transmits N recorded data DA included in the music data M of the target music piece and the control parameter X set in step S4 to the terminal device 12 From the communication device 146 (S5).

When the communication device 123 receives the control parameter X and the N stored data DA transmitted from the mixing management device 14, the control device 121 (sound processing part 22) of the terminal device 12 transmits the control parameter X And the adjusted sound data DB is supplied to the soundproof device 126 to reproduce the target music piece (S6).

As described above, in the first embodiment, the control parameter X is set so that the acoustic characteristics in the case of mixing N pieces of the recorded data DA approximate to the acoustic characteristics of the target characteristic data R. Therefore, in step S6 of Fig. 5, The acoustic characteristic of the reproduced sound soundproofed from the device 126 approximates or conforms to the acoustic characteristic specified by the target characteristic data R. [ That is, according to the first embodiment, even when the recording condition of each recorded data DA is different for each piece of music data M (i.e., regardless of the recording condition of the music data M), the difference of the recording condition is reduced Can be realized. In the first embodiment, the setting of the control parameter X in accordance with the recorded characteristic data Q and the target characteristic data R is uniformly performed by the mixing management device 14, and the control parameter X is transmitted to each terminal device 12. [ Therefore, there is an advantage in that the processing load on each terminal device 12 is reduced as compared with the configuration in which the calculation and setting of the control parameter X (setting section 36) is executed by each terminal device 12. [

≪ Second Embodiment >

A second embodiment of the present invention will be described below. In the following embodiments, the same reference numerals as those in the first embodiment are used for elements having the same functions and functions as those in the first embodiment, and detailed description thereof will be appropriately omitted.

Fig. 6 is a block diagram of the sound processing system 100 in the second embodiment, and Fig. 7 is an explanatory diagram of the operation in the second embodiment. 7, in the second embodiment, the same operations (S1 to S6) as in the first embodiment are executed so that the adjusted sound data DB obtained by mixing N recorded data DA in accordance with the control parameter X is outputted to the soundproofing device (126).

The user who has received the reproduced sound of the target music piece soundproofed from the soundproofing device 126 can instruct the user to correct the reproduced sound characteristics of the target music piece by appropriately operating the input device 125 of the terminal device 12. [ The control device 121 of the terminal device 12 generates modified data Z in accordance with an instruction for correcting the acoustic characteristics (S7) and, as understood from Figs. 6 and 7, To the mixing management device 14 (S8).

Fig. 8 is a diagram for explaining correction of acoustic characteristics. When the reproduction of the adjusted sound data DB of the target music is completed, the control device 121 of the terminal device 12 causes the display device 124 to display the edited image 50 shown in Fig. In the edited image 50, the acoustic characteristics (the acoustic characteristics of the recorded data DA) before execution of the mixing and the acoustic characteristics (the acoustic characteristics of the adjusted acoustic data DB) after the execution of the mixing using the control parameter X are displayed in contrast . In FIG. 8, time variations (horizontal axis: time, vertical axis: volume) of the volume before and after the mixing using the control parameter X are illustrated. The user appropriately operates the input device 125 in comparison with the acoustic characteristic CA before the mixing is performed in consideration of the result of receiving the reproduced sound of the adjusted sound data DB so that the acoustic characteristic CB after execution of the mixing is converted into the desired acoustic characteristic CZ It is possible to edit it. The control device 121 of the terminal device 12 generates the correction data Z indicating the corrected acoustic characteristic CZ from the user (S7) and sends the correction data Z from the communication device 123 to the mixing management device 14. [ (S8).

As understood from Fig. 6, the communication device 146 of the mixing management device 14 of the second embodiment receives the modification data Z transmitted from the terminal device 12. Fig. The communication control unit 42 acquires the correction data Z received by the communication device 146. [ That is, the control device 142 (communication control section 42) of the second embodiment functions as an element (instruction reception section) for acquiring correction data Z according to an instruction from the user who has received the reproduced sound of the adjustment sound data DB. Editing of the acoustic characteristic CB (transmission of the correction data Z) in the terminal device 12 is repeated for each reproduction of the adjusted sound data DB generated by mixing using the control parameter X. [ Therefore, the communication control section 42 sequentially acquires a plurality of pieces of correction data Z according to an instruction from different users, from a plurality of terminal devices 12, in relation to a common target music piece.

As illustrated in Fig. 6, the mixing management device 14 of the second embodiment has a configuration in which an update section 44 is added to the mixing management device 14 of the first embodiment. The update unit 44 updates the target characteristic data R of the target music piece in the storage device 144 in accordance with the correction data Z acquired from the terminal device 12 by the communication control unit 42 (S9). Specifically, the updating unit 44 updates the target characteristic data R (each unit data r [n]) of the target music piece so as to approach the acoustic characteristic indicated by the correction data Z. [ For example, the update unit 44 performs predetermined statistical processing (typically, average) on the plurality of pieces of correction data Z acquired by the communication control unit 42 from each of the terminal devices 12, Z to update the target characteristic data R of the target musical composition.

The same effects as those of the first embodiment are also realized in the second embodiment. In the second embodiment, since the instruction (corrected data Z) from the user who has received the reproduced sound of the adjusted sound data DB is reflected in the target characteristic data R, the target characteristic data R stored in the storage device 144, There is an advantage that the user can update the contents to specify the desired acoustic characteristics. Particularly in the second embodiment, since a plurality of pieces of modification data Z according to instructions from different users are reflected in the target characteristic data R, there is a remarkable advantage that the target characteristic data R can be updated to the preferable contents in a large number of users have.

≪ Third Embodiment >

Fig. 9 is an explanatory diagram of the target characteristic data R in the third embodiment. In the first embodiment, a plurality of target characteristic data R corresponding to different music tones are prepared. In the third embodiment, as illustrated in Fig. 9, a plurality of target characteristic data R representing different acoustic characteristics are stored in the storage device 144 for each piece of music. That is, for one arbitrary piece of music, a plurality of target characteristic data R having different acoustic characteristics are prepared. For example, in addition to the target characteristic data R representing standard acoustic characteristics, target characteristic data R representing individual acoustic characteristics, such as acoustic characteristics preferable for playing musical instruments and acoustic characteristics emphasizing rhythm, (144).

10 is an explanatory diagram of the operation of the third embodiment. The control device 142 (communication control unit 42) of the mixing management device 14 receives the processing request specifying the target music piece from the terminal device 12 as in the first embodiment, The terminal device 12 is notified of the plurality of target characteristic data R stored in the storage device 144 as a selection candidate by the user (S11). 11, the control device 121 of the terminal device 12 displays a list 52 in which a plurality of target characteristic data R of target music pieces are arranged as selection candidates by the user on the display device 124 (S12). The user can select desired target characteristic data R by appropriately operating the input device 125. [ When receiving the selection of the target characteristic data R (S13), the control device 121 of the terminal device 12 notifies the mixing management device 14 of the target characteristic data R selected by the user (S14).

Upon receiving the notification of the target characteristic data R selected by the user, the control device 142 of the mixing management device 14 generates the recording characteristic data Q by analyzing the music data M of the target music tune (S2) From the storage device 144, the target characteristic data R notified from the terminal device 12 in the step S14 among the plurality of target characteristic data R of the plurality of target characteristic data R (S3). The control device 142 (setting unit 36) sets the control parameter X in accordance with the recording characteristic data Q of the target music piece and the target characteristic data R selected by the user of the terminal device 12 (S4). The subsequent operations are the same as those of the first embodiment and the second embodiment.

Also in the third embodiment, the same effects as those of the first embodiment are realized. In the third embodiment, since the plurality of target characteristic data R prepared for each piece of music is selectively applied to the setting of the control parameter X, a configuration in which one kind of target characteristic data R is fixedly applied to the setting of the control parameter X It is possible to generate the adjusted sound data DB having various acoustic characteristics. In the third embodiment, since the target characteristic data R selected by the user out of the plurality of target characteristic data R is applied to the setting of the control parameter X, the adjustment sound data DB of the acoustic characteristic matching the user's intention or preference is generated There is an advantage to be able to.

It is also possible to adopt the configuration of the second embodiment for updating the target characteristic data R in accordance with the correction data Z in the third embodiment. More specifically, the update unit 44 updates the target characteristic data R selected by the user from the list 52 among the plurality of target characteristic data R of the target music piece stored in the storage device 144, And updates it in accordance with the correction data Z.

≪ Fourth Embodiment &

In each of the above-described embodiments, the sound processing system 100 including the terminal device 12 and the mixing management device 14 communicating with each other via the communication network 16 is exemplified. The mixing management device 14 of the fourth embodiment realizes the same functions as the above-described sound processing system 100 of each of the above embodiments.

12 is a block diagram of the mixing management device 14 in the fourth embodiment. 12, the mixing management device 14 of the fourth embodiment includes a control device 121, a storage device 122, and a display device 124, similar to the terminal devices 12 of the above- And a computer system including an input device 125 and a soundproofing device 126. For example, an information processing apparatus such as a mobile phone, a smart phone, or a personal computer is used as the mixing management device 14. [

The storage device 122 stores the music data M and the target characteristic data R for each piece of music in addition to storing the program executed by the control device 121. [ The control device 121 executes the program stored in the storage device 122 so that the functions of the respective functions (the first acquisition section 32, the second acquisition section 34, the setting section 36, The sound processing unit 22, and the updating unit 44). More specifically, the first obtaining unit 32 generates the recorded characteristic data Q by analyzing the music data M of the target music piece stored in the storage device 122, and the second obtaining unit 34 obtains the target characteristic And acquires the data R from the storage device 122. [ The setting unit 36 generates the control parameter X from the recording characteristic data Q generated by the first obtaining unit 32 and the target characteristic data R acquired by the second obtaining unit 34. [ The sound processing section 22 generates the adjusted sound data DB by mixing N pieces of recorded data DA of the music data M of the target music piece by applying the control parameter X set by the setting section 36 and reproduces the adjusted sound data DB from the soundproofing device 126 . The update unit 44 updates the target characteristic data R of the target music piece in the storage device 122 in accordance with the instruction (corrected data Z) from the user who has received the reproduced sound of the adjusted sound data DB. The contents of the concrete processing of each element are as exemplified in the above-mentioned respective forms.

Also in the fourth embodiment, the same effects as those of the first embodiment are realized. It is also possible to employ the configuration of the third embodiment in which a plurality of target characteristic data R corresponding to the target music piece is selectively used for setting the control parameter X in the fourth embodiment. The configuration (update unit 44) for updating the target characteristic data R in accordance with the correction data Z can be omitted from the fourth embodiment.

<Modifications>

Each of the above-described forms can be variously modified. Specific forms of modification are illustrated below. Two or more forms arbitrarily selected from the following examples may be suitably incorporated.

(1) In each of the above-described embodiments, the first acquisition unit 32 generates the recording characteristic data Q by analyzing the respective recording data DA of the music data M. However, the recording characteristic data Q of each music (Storage device 122 in the fourth embodiment) in advance. In the configuration in which the recorded characteristic data Q is stored in the storage device 144, the first obtaining unit 32 functions as an element for reading the recorded characteristic data Q of the target music from the storage device 144. [ As can be understood from the above description, the first acquisition section 32 is expressed as a generic element for acquiring the recording characteristic data Q indicating the acoustic characteristics of the plurality of recording data DA, (Each of the above-described forms) for generating Q, and an element for reading the recording characteristic data Q previously stored in the storage device 144. [

In the above-described embodiments, the configuration in which the second obtaining unit 34 reads the target characteristic data R stored in the storage device 144 (the storage device 122 in the fourth embodiment) is exemplified. However, It is also possible to store the target data in the storage device 144. [ In the configuration in which the target data is stored in the storage device 144, the second obtaining section 34 functions as an element for generating the target characteristic data R by analyzing the target data of the target music. As can be understood from the above description, the second acquisition section 34 is expressed comprehensively as an element for acquiring the target characteristic data R representing the target acoustic characteristic of the musical tune, and acquires the target characteristic (Each of the above-described forms) for reading the data R and an element for generating the target characteristic data R in the interpretation of the target data.

(2) In the first to third embodiments, the control parameter X and the N recorded data DA are transmitted from the mixing management device 14 to the terminal device 12, and the sound processing section 22 ) Mixes N pieces of recorded data DA, but it is also possible to provide the sound processing section 22 in the mix management apparatus 14 as illustrated in Fig. The sound processing unit 22 of FIG. 13 generates the adjusted sound data DB by mixing the N pieces of recorded data DA of the target music piece by applying the control parameter X set by the setting unit 36. [ The communication control unit 42 transmits the adjustment sound data DB generated by the sound processing unit 22 from the communication device 146 to the terminal device 12 via the communication network 16. [ According to the above configuration, there is an advantage that it is not necessary to mount the sound processing section 22 in each of the terminal devices 12.

(3) In the second embodiment, although the terminal device 12 of the group executes the reproduction of the adjusted sound data DB and the transmission of the corrected data Z, the device for reproducing the adjusted sound data DB and the device for transmitting the corrected data Z It is also possible to configure it as a separate entity. For example, the reproduction of the adjusted sound data DB is executed by an information processing apparatus such as a personal computer, and the generation and transmission of the correction data Z in response to an instruction from the user is performed by a portable information processing apparatus such as a cellular phone or a smart phone Is preferable.

(4) In the second embodiment, a plurality of pieces of modification data Z reflecting the intentions and preferences of various users are transmitted from each terminal device 12 to the mixing management device 14. In the above configuration, it is also possible to generate a plurality of target characteristic data R using a plurality of correction data Z obtained from each terminal device 12. [ For example, it is possible to classify (clusters) a plurality of pieces of correction data Z obtained from each terminal device 12 for one piece of music into a plurality of sets in accordance with the tendency of instruction contents by the user, Individual target characteristic data R are generated for each set (for each tendency of the correction data Z) by updating the initial (standard) target characteristic data R in accordance with the respective correction data Z in the set. For example, the update unit 44 generates the target characteristic data R 1 by reflecting each corrected data Z classified into the set G 1 into the initial target characteristic data R, and outputs each corrected data Z classified into the set G 2 as an initial target The target characteristic data R2 is generated so as to be different from the target characteristic data R1. The plurality of target characteristic data R generated for each piece of music in the above procedure is selectively applied to the setting of the control parameter X in accordance with an instruction from the user as in the third embodiment. According to the above configuration, for example, standard (average) target characteristic data R and unique target characteristic data R can be generated.

(5) The contents of the processing by the sound processing section 22 are not limited to the examples in the above-described embodiments. For example, it is also possible to generate the adjusted sound data DB approximating the acoustic characteristics of the target characteristic data R by adding a specific frequency component (for example, a harmonic component) to each recorded data DA by the sound processing section 22 . More specifically, it is possible to add various sound effects such as distortion and exciter to the recording data DA.

The present disclosure is summarized below.

A mixing management device of the present invention includes a first acquisition section for acquiring recorded characteristic data indicating acoustic characteristics of a plurality of recorded data representing the sound of a different performance piece of music, And a second acquisition section for acquiring control parameters to be applied to the mixing so that the acoustic characteristics after the execution of the mixing with respect to the plurality of recording data approximate the acoustic characteristics represented by the target characteristic data, And a setting unit for setting in accordance with the data. In the above configuration, the control parameters to be applied to the mixing are set in accordance with the recording characteristic data and the target characteristic data so that the acoustic characteristic after the execution of the mixing with respect to the plurality of recording data approximates to the acoustic characteristic expressed by the target characteristic data. Therefore, it is possible to realize the desired mixing by compensating the recording conditions of a plurality of recorded data.

The mixing management device according to the present invention can be realized, for example, as a communication device (for example, a server device) that communicates with a terminal device via a communication network. Specifically, a mixing management apparatus according to a preferred embodiment of the present invention includes a communication control section that transmits a control parameter set by a setting section and a plurality of recorded data to a terminal device via a communication network. According to another aspect of the present invention, there is provided a mix management apparatus comprising: a sound processing section for generating adjusted sound data by mixing a plurality of recorded data to which control parameters set by a setting section are applied; And a communication control unit. In the above-described embodiment, there is an advantage that it is not necessary to mount the sound processing unit in each terminal apparatus.

In a preferred form of the present invention, the second obtaining section obtains the target characteristic data stored in the storage device, applies the control parameters acquired by the setting section, and stores the plurality of recording data in the memory And an update unit for updating the target characteristic data of the apparatus. In the above embodiment, since the target characteristic data is updated in accordance with the instruction from the user who has received the sound mixed with the plurality of recorded data by applying the control parameter, the target characteristic data is updated to the content specifying the desired acoustic characteristic There is an advantage to be able to do. Further, there is provided an instruction reception unit that acquires a plurality of correction data according to instructions from different listeners through a communication network from a plurality of terminal apparatuses used by each receiver, and in accordance with the plurality of correction data acquired by the instruction reception unit, According to the configuration for updating the target characteristic data, there is a remarkable advantage that the target characteristic data can be updated with preferable contents in a large number of users.

In a preferred form of the present invention, the second obtaining unit selects any one of a plurality of target characteristic data showing different acoustic characteristics for a common music tune. In the above configuration, since a plurality of target characteristic data showing different acoustic characteristics for a common musical composition are selectively used for setting control parameters, comparison with a configuration in which one kind of target characteristic data is fixedly applied to the setting of control parameters It is possible to realize various mixing. Further, according to the configuration in which the second acquiring unit acquires the target characteristic data selected by the user from among the plurality of the target characteristic data, there is an advantage that the mixing can be realized in accordance with the intention and the taste of the user.

In a preferred form of the present invention, the acoustic characteristic indicated by each of the recorded characteristic data and the recorded characteristic data is obtained by calculating, for each of a plurality of performance parts of the musical composition, an average sound volume, a temporal change in sound volume, And reverberation characteristics. For example, according to the configuration in which the sound position and the reverberation characteristic are reflected in the control parameters in addition to the temporal change of the average volume or the volume, it is possible to realize various and highly-complicated mixing.

The mixing management device according to each of the above embodiments is implemented by hardware (electronic circuit) such as a DSP (Digital Signal Processor) dedicated to management of control parameters applied to mixing, In cooperation with the arithmetic processing unit of the present invention. The program of the present invention may be provided in a form stored in a computer-readable recording medium and installed in a computer. The recording medium is, for example, a non-transitory recording medium, and is a good example of an optical recording medium (optical disk) such as a CD-ROM. The recording medium may be any known type such as a semiconductor recording medium and a magnetic recording medium Of the recording medium. Further, for example, the program of the present invention may be provided in the form of distribution through a communication network and installed in a computer.

The present invention is also specified as a method of managing control parameters (mixing management method). A mixing management method of the present invention is a method for managing a mix of a plurality of pieces of music data obtained by acquiring recording characteristic data representing acoustic characteristics of a plurality of recorded data representing sounds of different performance parts of a musical piece and acquiring target characteristic data representing acoustic characteristics of the target of the musical composition, The control parameters to be applied to the mixing are set according to the recording characteristic data and the target characteristic data so that the acoustic characteristic after the execution of the mixing with respect to the recording data approximates the acoustic characteristic expressed by the target characteristic data.

A mixing management method according to the present invention includes a first acquiring step of acquiring recording characteristic data indicating an acoustic characteristic of a plurality of recorded data indicating the sound of a different performance piece of music, And a second acquisition step of acquiring the control parameter applied to the mixing so that the acoustic characteristic after the execution of the mixing with respect to the plurality of recorded data approximates to the acoustic characteristic expressed by the target characteristic data In accordance with the characteristic data and the target characteristic data.

For example, the mixing management method further includes a communication control step of transmitting the control parameter set in the setting step and the plurality of recording data to the terminal device via the communication network.

For example, in the second acquisition step, the target characteristic data stored in the storage device is acquired, and the mixing management method further includes a step of acquiring the target characteristic data by using the control parameter acquired in the setting step, And an update step of updating the target characteristic data of the storage device in accordance with an instruction from the receiver.

For example, the mixing management method may further include an instruction reception step of acquiring a plurality of correction data according to an instruction from different listeners from a plurality of terminal devices used by the receiver, through a communication network, In the step, the target characteristic data is updated in accordance with a plurality of correction data acquired in the instruction reception step.

For example, in the second acquisition step, any one of a plurality of target characteristic data showing different acoustic characteristics for a common music tune is selected.

For example, the acoustic characteristic indicated by each of the recording characteristic data and the target characteristic data is obtained by calculating, for each of a plurality of performance parts of the music, an average sound volume, a time variation of sound volume, Or the like.

Although the present invention has been described in detail with reference to specific embodiments, it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the present invention.

The present application is based on Japanese Patent Application (Japanese Patent Application No. 2013-139212) filed on July 2, 2013, the contents of which are incorporated herein by reference.

[Industrial applicability]

According to the mixing management device and the mixing management method of the present invention, it is possible to realize the desired mixing by compensating for the difference in the recording condition.

100: sound processing system
12:
14: Mixing management device
16: Network
22: Acoustic processor
121, 142: Control device
122, 144: storage device
123, 146: communication device
124: display device
125: input device
126: Soundproofing device
32: First acquiring unit
34: Second Acquisition Unit
36: Setting section
42:
44:

Claims (12)

A first acquiring unit that acquires recording characteristic data indicating acoustic characteristics of a plurality of recorded data representing the sounds of different performance parts of music;
A second obtaining unit that obtains target characteristic data indicating an acoustic characteristic of a target of the musical composition,
The control parameter applied to the mixing is set in accordance with the recording characteristic data and the target characteristic data so that the acoustic characteristic after the execution of the mixing with respect to the plurality of recording data approximates the acoustic characteristic represented by the target characteristic data And a setting unit for setting the setting of the mixing management unit. The method according to claim 1,
And a communication control unit for transmitting the control parameter set by the setting unit and the plurality of recording data to the terminal device via the communication network. 3. The method according to claim 1 or 2,
The second obtaining section obtains the target characteristic data stored in the storage device,
Further comprising an updating unit that updates the target characteristic data of the storage device in accordance with an instruction from a sound reproducer that mixes the plurality of recording data by applying the control parameter acquired by the setting unit. The method of claim 3,
And an instruction reception unit for acquiring a plurality of correction data according to an instruction from different listeners through a communication network from a plurality of terminal apparatuses used by each receiver,
Wherein the updating unit updates the target characteristic data in accordance with a plurality of pieces of correction data acquired by the instruction accepting unit. 5. The method according to any one of claims 1 to 4,
Wherein the second obtaining unit selects any one of a plurality of target characteristic data that exhibits different acoustic characteristics for a common music tune. 6. The method according to any one of claims 1 to 5,
Wherein the acoustic characteristic of each of the plurality of performance parts of the musical composition includes at least one of an average volume in the musical composition, a time variation of the volume, an image position, a frequency characteristic, and a reverberation property The mixing management device. A first acquiring step of acquiring recording characteristic data indicating acoustic characteristics of a plurality of recorded data representing the sound of a performance part in which music pieces are different,
A second acquiring step of acquiring target characteristic data indicating an acoustic characteristic of a target of the music;
The control parameter applied to the mixing is set in accordance with the recording characteristic data and the target characteristic data so that the acoustic characteristic after the execution of the mixing with respect to the plurality of recording data approximates the acoustic characteristic represented by the target characteristic data And a setting step of setting the mixing management method. 8. The method of claim 7,
And a communication control step of transmitting the control parameter set in said setting step and said plurality of recording data to a terminal device via a communication network. 9. The method according to claim 7 or 8,
In the second acquisition step, the target characteristic data stored in the storage device is acquired,
Further comprising an update step of updating the target characteristic data of the storage device in accordance with an instruction from a sound reproducer that mixes the plurality of recorded data by applying the control parameter acquired in the setting step. 10. The method of claim 9,
Further comprising an instruction reception step of acquiring a plurality of correction data according to an instruction from different listeners through a communication network from a plurality of terminal devices used by the receiver,
And in the updating step, the target characteristic data is updated in accordance with a plurality of pieces of correction data acquired in the instruction reception step. 11. The method according to any one of claims 7 to 10,
Wherein the second acquisition step selects any one of a plurality of target characteristic data that exhibits different acoustic characteristics for a common musical composition. 12. The method according to any one of claims 7 to 11,
Wherein the acoustic characteristic of each of the plurality of performance parts of the musical composition includes at least one of an average volume in the musical composition, a time variation of the volume, an image position, a frequency characteristic, and a reverberation property Includes a mixing management method.

Images