JP2015012592A - Mixing management device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To implement expected mixing by compensating for the difference of recording conditions.SOLUTION: A first acquisition part 32 acquires recording property data Q representing acoustic properties of a plurality of recording data DA representing acoustics of different performance parts of object music. A second acquisition part 34 acquires target property data R representing target acoustic properties of the object music. A setting part 36 sets a control parameter X to be applied to mixing subjected to the plurality of recording data DA of the object music in accordance with the recording property data Q and the target property data R in such a manner that acoustic properties after execution of the mixing are approximated to the acoustic properties represented by the target property data R.

Description

  The present invention relates to mixing of a plurality of acoustic data representing an acoustic waveform, and more particularly to setting of parameters applied to mixing.

  Conventionally, a technique for mixing a plurality of acoustic data including performance sounds of each performance part of a music has been proposed. For example, Patent Document 1 discloses a technique in which a template that reflects a tendency of mixing by a mixing engineer is prepared in advance and applied to mixing of a plurality of acoustic data.

Japanese Patent No. 4079260

  A plurality of acoustic data is actually recorded under various conditions (recording environment and equipment used). In the technique of Patent Document 1, a template prepared in advance is applied to mixing regardless of the recording condition of acoustic data. Therefore, depending on the recording condition of each acoustic data, appropriate mixing originally intended by the template is performed. May not be executed. In view of the above circumstances, an object of the present invention is to realize a desired mixing by compensating for a difference in recording conditions.

  In order to solve the above-described problems, the mixing management device of the present invention includes a first acquisition unit that acquires recording characteristic data representing the acoustic characteristics of a plurality of recording data representing the sounds of different performance parts of a music, A second acquisition unit that acquires target characteristic data representing target acoustic characteristics, and an acoustic characteristic after performing the mixing for a plurality of recorded data approximate the acoustic characteristic represented by the target characteristic data. A setting unit configured to set control parameters applied to the mixing according to the recording characteristic data and the target characteristic data. In the above configuration, the control parameters applied to the mixing are the recording characteristic data and the target characteristic data so that the acoustic characteristics after mixing for a plurality of recorded data approximate the acoustic characteristics represented by the target characteristic data. Is set according to Therefore, it is possible to realize the desired mixing by compensating the recording conditions of a plurality of recorded data.

  The mixing management device according to the present invention can be realized as a communication device (for example, a server device) that communicates with a terminal device via a communication network, for example. Specifically, a mixing management apparatus according to a preferred embodiment of the present invention includes a communication control unit that transmits control parameters set by the setting unit and a plurality of recorded data to a terminal device via a communication network. The mixing management device according to another aspect of the present invention includes an acoustic processing unit that generates adjusted acoustic data by mixing a plurality of recorded data to which the control parameter set by the setting unit is applied, and an adjusted acoustic signal via a communication network. A communication control unit that transmits data to the terminal device. In the above aspect, there exists an advantage that it is not necessary to mount an acoustic process part in each terminal device.

  In a preferred aspect of the present invention, the second acquisition unit acquires the target characteristic data stored in the storage device, and applies the control parameter acquired by the setting unit to the sound listener who has mixed a plurality of recorded data. The updating unit updates the target characteristic data of the storage device in response to the instruction. In the above aspect, the target characteristic data is updated in accordance with an instruction from the user who has listened to the sound obtained by mixing the plurality of recorded data by applying the control parameter. There is an advantage that the contents can be updated to the contents that specify the characteristics. In addition, an instruction receiving unit that acquires a plurality of correction data according to instructions from different listeners from a plurality of terminal devices used by each listener via a communication network, the plurality of data acquired by the instruction receiving unit According to the configuration in which the update unit updates the target characteristic data according to the correction data, there is a special advantage that the target characteristic data can be updated to contents suitable for a large number of users.

  In a preferred aspect of the present invention, the second acquisition unit selects any one of a plurality of target characteristic data representing different acoustic characteristics for a common music piece. In the above aspect, since a plurality of target characteristic data representing different acoustic characteristics for a common musical piece are selectively used for setting a control parameter, one type of target characteristic data is fixedly applied to the control parameter setting. It is possible to realize various mixing as compared with the configuration to be performed. Further, according to the configuration in which the second acquisition unit acquires target characteristic data selected by the user from among the plurality of target characteristic data, there is an advantage that mixing that matches the user's intention and preference can be realized.

  In a preferred aspect of the present invention, the acoustic characteristics represented by each of the recording characteristic data and the target characteristic data are, for each of a plurality of performance parts of the music, an average volume in the music, a temporal change in volume, a sound image position, a frequency characteristic, and Includes at least one reverberation characteristic. For example, according to the configuration in which the sound image position and the reverberation characteristics are reflected in the control parameters in addition to the average sound volume and the time change of the sound volume, various and advanced mixing can be realized.

  The mixing management device according to each aspect described above is realized by hardware (electronic circuit) such as a DSP (Digital Signal Processor) dedicated to management of control parameters applied to mixing, and a CPU (Central Processing Unit). It is also realized by cooperation between a general-purpose arithmetic processing device such as the above and a program. The program of the present invention can be provided in a form stored in a computer-readable recording medium and installed in the computer. The recording medium is, for example, a non-transitory recording medium, and an optical recording medium (optical disk) such as a CD-ROM is a good example, but a known arbitrary one such as a semiconductor recording medium or a magnetic recording medium This type of recording medium can be included. For example, the program of the present invention can be provided in the form of distribution via a communication network and installed in a computer.

  The present invention is also specified as a method for managing control parameters (mixing management method). The mixing management method of the present invention acquires recording characteristic data representing the acoustic characteristics of a plurality of recording data representing the sounds of different performance parts of the music, obtains target characteristic data representing the target acoustic characteristics of the music, and Depending on the recording characteristic data and the target characteristic data, the control parameters applied to the mixing should be adjusted so that the acoustic characteristics after mixing for the recorded data of the target approximate the acoustic characteristics represented by the target characteristic data. To set.

1 is a block diagram of a sound processing system according to a first embodiment of the present invention. It is explanatory drawing of mixing of some recorded data. It is explanatory drawing of various data. It is a block diagram of a functional structure of a sound processing system. It is explanatory drawing of operation | movement of a sound processing system. It is a block diagram of a functional structure of the sound processing system which concerns on 2nd Embodiment. It is explanatory drawing of operation | movement of the sound processing system which concerns on 2nd Embodiment. It is explanatory drawing of correction data. It is explanatory drawing of the target characteristic data in 3rd Embodiment. It is explanatory drawing of operation | movement of the sound processing system in 3rd Embodiment. It is explanatory drawing of the list of target characteristic data. It is a block diagram of a functional structure of the mixing management apparatus which concerns on 4th Embodiment. It is a block diagram of a functional structure of the mixing management apparatus which concerns on a modification.

<First Embodiment>
FIG. 1 is a block diagram of a sound processing system 100 according to the first embodiment of the present invention. As illustrated in FIG. 1, the sound processing system 100 is a communication system including a plurality of terminal devices 12 and a mixing management device 14. Each terminal device 12 is a communication terminal such as a mobile phone or a smartphone, and communicates with the mixing management device 14 via a communication network 16 such as a mobile communication network or the Internet.

  As representatively shown in FIG. 1 for one terminal device 12, each terminal device 12 includes a control device 121, a storage device 122, a communication device 123, a display device 124, an input device 125, and a sound emitting device 126. It is realized by a computer system provided. The control device 121 is an arithmetic processing device that executes various types of control processing and arithmetic processing by executing a program stored in the storage device 122. The storage device 122 (for example, a semiconductor recording medium) stores a program executed by the control device 121 and various data used by the control device 121. The communication device 123 communicates with the mixing management device 14 via the communication network 16. The communication between the terminal device 12 and the communication network 16 is typically wireless communication. However, for example, when a stationary information processing device is used as the terminal device 12, the terminal device 12 and the communication network 16 Can also be wired.

  The display device 124 (for example, a liquid crystal display panel) displays an image instructed from the control device 121. The input device 125 is an operating device that accepts an instruction from the user to the terminal device 12 and includes, for example, a plurality of operating elements operated by the user. A touch panel configured integrally with the display device 124 may be employed as the input device 125.

  The control device 121 according to the first embodiment functions as the acoustic processing unit 22 in FIG. 2 by executing a program stored in the storage device 122. As shown in FIG. 2, the acoustic processing unit 22 generates adjusted acoustic data DB by mixing a plurality of recorded data DA corresponding to different performance parts of the music. Each recorded data DA is acoustic data representing a time waveform of a performance sound (sound or music) recorded in advance for a specific performance part of the music. On the other hand, the adjustment sound data DB is sound data (for example, sound data of two channels on the left and right sides) representing a time waveform of a performance sound of a music composed of a plurality of performance parts.

  Specifically, the acoustic processing unit 22 performs the acoustic processing individually for each of the plurality of recorded data DA of the music, and generates the adjusted acoustic data DB by adding each other. The acoustic processing for each recorded data DA is various signal processing for changing acoustic characteristics. For example, amplification processing for increasing / decreasing the average sound volume, characteristic adjustment processing for changing sound frequency characteristics (for example, volume for each band), delay processing for delaying sound on the time axis, etc. Illustrated as a process. A control parameter (hereinafter referred to as “control parameter”) X is applied to the mixing of a plurality of recorded data DA by the acoustic processing unit 22. The sound emitting device 126 reproduces sound according to the adjusted sound data DB generated by the sound processing unit 22. In addition, illustration of the D / A converter which converts the adjustment acoustic data DB from digital to analog was abbreviate | omitted for convenience.

  The mixing management device 14 in FIG. 1 manages mixing of a plurality of recorded data DA by the acoustic processing unit 22 of each terminal device 12. Specifically, the mixing management device 14 of the first embodiment is a server device (typically a web server) that sets a suitable control parameter X that is applied to mixing of a plurality of recorded data DA. 142, a storage device 144, and a communication device 146. Note that the mixing management apparatus 14 can be realized by a plurality of apparatuses configured separately from each other (for example, a plurality of server apparatuses communicating with each other via the communication network 16). The control device 142 is an arithmetic processing device that executes various types of control processing and arithmetic processing by executing a program stored in the storage device 144. The communication device 146 communicates with each terminal device 12 via the communication network 16.

  The storage device 144 stores a program executed by the control device 142 and various data used by the control device 142. For example, a known recording medium such as a semiconductor recording medium or a magnetic recording medium or a combination of a plurality of recording media may be employed as the storage device 144. The storage device 144 is installed in an external device (for example, a server device) separate from the mixing management device 14, and the mixing management device 14 writes and reads information to and from the storage device 144 of the external device via the communication network 16. A configuration for performing the above can also be adopted.

  FIG. 3 is an explanatory diagram of the content stored in the storage device 144 and the operation content of the control device 142. As illustrated in FIG. 3, the storage device 144 of the first embodiment stores a plurality of music data M. Each piece of music data M includes attribute data MA for specifying related information such as a music title and singer name, and N pieces of recorded data DA (N is a natural number of 2 or more) corresponding to different performance parts of the music. Composed. As described above, the N pieces of recorded data DA are acoustic data to be mixed by the terminal device 12 (acoustic processing unit 22). N pieces (N tracks) of recorded data DA in which performance sounds of N performance parts of the music are recorded in parallel or individually are stored in the storage device 144. Specifically, N pieces of recorded data DA generated by recording performance sounds (multitrack recording) in an acoustic space such as a music studio are transmitted from the terminal device 12 to the mixing management device 14 and then stored in the storage device 144. Stored. Therefore, even when the music itself is common to a plurality of music data M, the recording conditions (recording environment and equipment used) of each recording data DA may be different for each music data M. In the following description, the case where each piece of music is composed of N performance parts is illustrated for convenience, but the total number of performance parts may actually differ for each piece of music.

  Further, the storage device 144 of the first embodiment stores a plurality of target characteristic data R corresponding to different music pieces as illustrated in FIG. Each target characteristic data R is data representing the acoustic characteristics of an exemplary performance sound of a musical piece (that is, the acoustic characteristic that is the target of mixing), and is an attribute that specifies information related to the musical piece as illustrated in FIG. It includes data RA and N unit data r [1] to r [N] corresponding to different performance parts of the music. The attribute data RA specifies, for example, related information such as a music title and a music composition (structure such as an intro, A melody, B melody, and chorus).

  Each unit data r [n] (n = 1 to N) included in one target characteristic data R is the performance sound of the nth performance part among the N performance parts constituting the musical composition. Represents the acoustic characteristics (target acoustic characteristics). More specifically, each unit data r [n] includes acoustic characteristics such as average volume in music, temporal change in volume, sound image position (position where the sound image perceived by the listener is localized), frequency characteristics and reverberation characteristics. It is specified. Examples of the reverberation characteristics include reverberation time and the time length of the initial reflection section or the rear reverberation section when the reverberation section is divided into the initial reflection section and the rear reverberation section on the time axis.

  The type of acoustic characteristic specified by each unit data r [n] is individually set for each performance part, and may differ between performance parts. For example, as illustrated in FIG. 3, the unit data r [n] of a performance part in which a voiced sound (harmonic sound) such as a vocal part or a guitar part is dominant has a harmonic structure (a fundamental component and a plurality of harmonic components). The unit data r [n] of the performance part that includes the time variation of the frequency characteristic such as the envelope of the series) and that is dominant in the unvoiced sound (non-harmonic sound) such as the drum part (rhythm part) is information on the rhythm of the music ( For example, the tempo of music and the cycle of each beat point).

  The target characteristic data R of the first embodiment is generated in advance by analyzing existing acoustic data (hereinafter referred to as “target data”) and stored in the storage device 144. For example, by analyzing existing sound data recorded on a recording medium such as a music CD or sound data in MP3 format for distribution to each terminal device 12 as target data (that is, sound data of an exemplary performance sound). Target characteristic data R is generated. It is also possible for a producer such as an acoustic engineer to manually generate the target characteristic data R.

  FIG. 4 is a functional configuration diagram of the mixing management device 14 according to the first embodiment. As illustrated in FIG. 4, the control device 142 of the mixing management device 14 executes the program stored in the storage device 144, so that N pieces of recorded data DA of a specific music piece (hereinafter referred to as “target music piece”). A plurality of functions (a first acquisition unit 32, a second acquisition unit 34, a setting unit 36, and a communication control unit 42) for setting and using the control parameter X applied to the above mixing are realized. A configuration in which each function of the control device 142 is distributed over a plurality of integrated circuits, or a configuration in which a dedicated electronic circuit (for example, DSP) realizes a part of the function of the control device 142 may be employed.

  The first acquisition unit 32 in FIG. 4 acquires recording characteristic data Q representing the acoustic characteristics of the performance sound (for example, the actual performance sound of each user) represented by the N recorded data DA of the target music. As described above, since the recording conditions (acoustic characteristics of the performance sound) of each recording data DA can be different for each piece of music data M, the recording characteristic data Q representing the acoustic characteristics of each recording data DA is the same even if the music itself is common. It may be different for each piece of music data M.

  As illustrated in FIG. 3, the recording characteristic data Q is configured to include N unit data q [1] to q [N] corresponding to different performance parts (tracks) of the target music. Each unit data q [n] represents the acoustic characteristics of the performance sound of the nth performance part among the N performance parts of the target music piece. Specifically, like the unit data r [n] of the target characteristic data R, the sound characteristics such as the average sound volume in the music, the time change of the sound volume, the sound image position, the frequency characteristic, and the reverberation characteristic are recorded characteristic data Q Specified by the unit data q [n]. The type of acoustic characteristic specified by each unit data q [n] can be different for each performance part.

  The first acquisition unit 32 of the first embodiment generates recording characteristic data Q by analyzing N pieces of recording data DA of the music data M of the target music stored in the storage device 144. Specifically, the first acquisition unit 32 determines the performance part for each of the N pieces of recorded data DA of the target music, and analyzes the recorded data DA of each performance part, thereby unit data q [ n] (recording characteristic data Q) is generated.

  For the discrimination of the performance part of each recorded data DA, for example, reference data defining the time series (that is, the melody) of the notes of each performance part of the music is preferably used. The reference data is, for example, time-series data in the MIDI (Musical Instrument Digital Interface) format used for karaoke performance. Specifically, the first acquisition unit 32 analyzes the time change of the pitch represented by each recorded data DA, and the time series of notes among the plurality of performance parts of the reference data is the time change of the pitch of the recorded data DA. Is determined as the performance part of the recorded data DA. In addition, the structure which discriminate | determines a performance part according to the sound range (pitch distribution range) which the recording data DA represents, or the structure which discriminates a performance part according to the presence or absence of the acoustic harmonic structure which the recording data DA represents ( For example, a configuration in which a performance part of recorded data DA having no harmonic structure is determined as a drum part may be employed.

  The second acquisition unit 34 in FIG. 4 acquires target characteristic data R of the target song. The 2nd acquisition part 34 of 1st Embodiment selects the one target characteristic data R corresponding to an object music from the several target characteristic data R memorize | stored in the memory | storage device 144 about different music, and the memory | storage device 144. Get from.

  The setting unit 36 sets the control parameter X of the target music in accordance with the recording characteristic data Q acquired by the first acquisition unit 32 and the target characteristic data R acquired by the second acquisition unit 34. Specifically, the setting unit 36 approximates (ideally matches) the acoustic characteristics after performing the mixing on the N recorded data DA of the target music to the acoustic characteristics represented by the target characteristic data R. The control parameter X is set according to the recording characteristic data Q and the target characteristic data R. For example, control is performed so that the acoustic characteristics when N recorded data DA are mixed by applying the provisional control parameter X approximate to the acoustic characteristics of the target characteristic data R (a difference in acoustic characteristics is minimized). Optimization processing for sequentially updating the parameter X is preferably used for setting the control parameter X by the setting unit 36. As described above, since the recording conditions of each recording data DA can be different for each piece of music data M, the control parameter X can be different for each piece of music data M even when the music itself is common.

  As illustrated in FIG. 3, the control parameter X of the first embodiment includes a plurality of types of parameters (time code X1, volume parameter X2, localization parameter X3, frequency characteristics (reflected in the mixing of the N recorded data DA). F characteristic) is configured to include a parameter X4 and a reverberation parameter X5).

  The time code X1 is data for adjusting each time point of each recorded data DA to the time point corresponding to the target data on the time axis (synchronizing the corresponding musical sounds in the music on the time axis). Specifically, the time code X1 designates a delay amount (movement amount on the time axis) at each time point of the recorded data DA so that each time point of the recorded data DA corresponds to each time point of the target data. The setting unit 36, for example, the rhythm information specified by the rhythm part unit data q [n] in the recording characteristic data Q and the rhythm specified by the rhythm part unit data r [n] in the target characteristic data R. The time code X1 is set by comparing information with each other. For example, the technique described in Japanese Patent Application Laid-Open No. 2011-053589 is suitably used for generating the time code X1 (synchronous analysis between the recorded data DA and the target data).

  The volume parameter X2 is data for approximating (ideally matching) the volume of each recorded data DA of the music data M to the volume of each performance part of the target data. Specifically, the setting unit 36 sets each unit data r [n] of the volume specified by each unit data q [n] of the recording characteristic data Q (the average volume in the music and the time change of the volume) and the target characteristic data R. ] Sets the volume parameter X2 in accordance with the difference from the volume designated by []. The localization parameter X3 is data for approximating (ideally matching) the sound image position of each recorded data DA to the sound image position of each performance part of the target data. Specifically, the setting unit 36 responds to the difference between the sound image position specified by each unit data q [n] of the recording characteristic data Q and the sound image position specified by each unit data r [n] of the target characteristic data R. To set the localization parameter X3.

  The frequency characteristic parameter X4 is data for approximating (ideally matching) the frequency characteristic of each recorded data DA of the music data M to the frequency characteristic of each performance part of the target data, for example, the sound of each recorded data DA. Specifies the gain (equalizer parameter) for each band applied to. Specifically, the setting unit 36 determines whether each unit data r [n] of the frequency characteristics (for example, envelope of harmonic structure) designated by each unit data q [n] of the recording characteristic data Q and the target characteristic data R is specified. The frequency characteristic parameter X4 is set according to the difference from the designated frequency characteristic. The reverberation parameter X5 is data for approximating (ideally matching) the reverberation characteristic of each recorded data DA to the reverberation characteristic of each performance part of the target data. The setting unit 36 sets the reverberation parameter X5 according to the difference between the reverberation characteristic designated by each unit data q [n] of the recorded characteristic data Q and the reverberation characteristic designated by each unit data r [n] of the target characteristic data R. Set. The above is a specific example of the control parameter X.

  The communication control unit 42 in FIG. 4 controls communication with each terminal device 12 via the communication device 146. Specifically, the communication control unit 42 receives from the communication device 146 the control parameter X set by the setting unit 36 for the target music and the N recorded data DA of the music data M of the target music stored in the storage device 144. It transmits to the terminal device 12. That is, the control device 142 (communication control unit 42) of the first embodiment functions as an element that transmits the control parameter X and the plurality of recorded data DA to the terminal device 12.

  FIG. 5 is an explanatory diagram of the operation of the first embodiment. The user appropriately operates the input device 125 of the terminal device 12 to select a desired target music piece and instruct to start mixing. When the above instruction is received, the control device 121 of the terminal device 12 transmits a processing request including the designation of the target music selected by the user from the communication device 123 to the mixing management device 14 via the communication network 16 (S1). .

  When the communication device 146 receives the processing request transmitted from the terminal device 12, the control device 142 (first acquisition unit 32) of the mixing management device 14 refers to the attribute data MA (music name, etc.) of each song. Then, the music data M of the target music designated by the processing request is searched from the storage device 144, and the music data M (each recorded data DA) of the target music is analyzed to generate the recording characteristic data Q (S2). In addition, the control device 142 (second acquisition unit 34) searches the target characteristic data R of the target music by referring to the attribute data RA (music name, etc.) of each target characteristic data R, and the target characteristic data of the target music. R is acquired from the storage device 144 (S3). Then, the control device 142 (setting unit 36) acquires the recording characteristics acquired in step S2 so that the acoustic characteristics after performing the mixing on the N recorded data DA of the target music approximate the acoustic characteristics of the target characteristic data R. A control parameter X (X1 to X5) corresponding to the data Q and the target characteristic data R acquired in step S3 is generated (S4). The control device 142 (communication control unit 42) uses the N recorded data DA included in the music data M of the target music and the control parameter X set in step S4 to transmit the terminal device 12 that is the transmission source of the processing request (S1). Is transmitted from the communication device 146 (S5).

  When the communication device 123 receives the control parameter X and N pieces of recorded data DA transmitted from the mixing management device 14, the control device 121 (acoustic processing unit 22) of the terminal device 12 applies the control parameter X to N pieces. The recorded sound data DA is mixed to generate adjusted sound data DB, and the adjusted sound data DB is supplied to the sound emitting device 126 to reproduce the target music (S6).

  As described above, in the first embodiment, the control parameter X is set so that the acoustic characteristics when the N recorded data DA are mixed approximate the acoustic characteristics of the target characteristic data R. The acoustic characteristic of the reproduced sound emitted from the sound emitting device 126 in step S6 approximates or matches the acoustic characteristic specified by the target characteristic data R. That is, according to the first embodiment, even when the recording conditions of each recording data DA are different for each piece of music data M (that is, regardless of the recording conditions of the music data M), the difference in the recording conditions is reduced (compensated). There is an advantage that the desired mixing can be realized. In the first embodiment, the setting of the control parameter X according to the recording characteristic data Q and the target characteristic data R is uniformly executed by the mixing management device 14, and the control parameter X is transmitted to each terminal device 12. . Therefore, there is an advantage that the processing load on each terminal device 12 is reduced as compared with the configuration in which the calculation or setting (setting unit 36) of the control parameter X is executed on each terminal device 12.

Second Embodiment
A second embodiment of the present invention will be described below. In addition, about the element which an effect | action and function are the same as that of 1st Embodiment in each form illustrated below, the reference | standard referred by description of 1st Embodiment is diverted, and each detailed description is abbreviate | omitted suitably.

  FIG. 6 is a block diagram of the sound processing system 100 in the second embodiment, and FIG. 7 is an explanatory diagram of the operation of the second embodiment. As illustrated in FIG. 7, in the second embodiment, the same operation (S1 to S6) as that in the first embodiment is executed, so that N recorded data DA are mixed according to the control parameter X. The acoustic data DB is reproduced from the sound emitting device 126.

  A user who has listened to the reproduction sound of the target music emitted from the sound emission device 126 instructs the correction of the acoustic characteristics of the reproduction sound of the target music by appropriately operating the input device 125 of the terminal device 12. Is possible. The control device 121 of the terminal device 12 generates correction data Z corresponding to the instruction for correcting the acoustic characteristics (S7), and mixing is performed from the communication device 123 via the communication network 16 as understood from FIGS. The correction data Z is transmitted to the management device 14 (S8).

  FIG. 8 is an explanatory diagram of correction of acoustic characteristics. When the reproduction of the adjustment sound data DB of the target music is completed, the control device 121 of the terminal device 12 displays the edited image 50 of FIG. In the edited image 50, the acoustic characteristics before the mixing (acoustic characteristics of the recorded data DA) CA and the acoustic characteristics after the mixing using the control parameter X (acoustic characteristics of the adjusted acoustic data DB) CB are contrasted. Is displayed. In FIG. 8, the time change (horizontal axis: time, vertical axis: volume) of the volume before and after mixing to which the control parameter X is applied is illustrated. In consideration of the result of listening to the reproduced sound of the adjusted acoustic data DB, the user appropriately operates the input device 125 while comparing it with the acoustic characteristic CA before performing the mixing, so that the acoustic characteristic after the mixing is performed. It is possible to edit CB to a desired acoustic characteristic CZ. The control device 121 of the terminal device 12 generates correction data Z representing the corrected acoustic characteristic CZ instructed by the user (S7) and transmits the correction data Z from the communication device 123 to the mixing management device 14 (S8). ).

  As understood from FIG. 6, the communication device 146 of the mixing management device 14 of the second embodiment receives the correction data Z transmitted from the terminal device 12. The communication control unit 42 acquires the correction data Z received by the communication device 146. That is, the control device 142 (communication control unit 42) of the second embodiment functions as an element (instruction receiving unit) that acquires the correction data Z according to the instruction from the user who has listened to the reproduced sound of the adjusted acoustic data DB. To do. The editing of the acoustic characteristic CB (transmission of the correction data Z) in the terminal device 12 is repeated every time the adjusted acoustic data DB generated by mixing to which the control parameter X is applied is reproduced. Therefore, the communication control unit 42 sequentially acquires a plurality of correction data Z corresponding to instructions from different users from a plurality of terminal devices 12 for a common target music piece.

  As illustrated in FIG. 6, the mixing management device 14 of the second embodiment has a configuration in which an updating unit 44 is added to the mixing management device 14 of the first embodiment. The update unit 44 updates the target characteristic data R of the target music in the storage device 144 according to the correction data Z acquired by the communication control unit 42 from the terminal device 12 (S9). Specifically, the updating unit 44 updates the target characteristic data R (each unit data r [n]) of the target music so as to approach the acoustic characteristic represented by the correction data Z. For example, the updating unit 44 performs predetermined statistical processing (typically average) on the plurality of correction data Z acquired from each terminal device 12 by the communication control unit 42 and uses the corrected data Z after processing. The target characteristic data R of the target music is updated.

  In the second embodiment, the same effect as in the first embodiment is realized. In the second embodiment, since the instruction (corrected data Z) from the user who has received the reproduced sound of the adjusted acoustic data DB is reflected in the target characteristic data R, the target characteristic data R stored in the storage device 144 is reflected. There is an advantage that can be updated to the content specifying the desired acoustic characteristics of the user. Particularly in the second embodiment, since a plurality of correction data Z corresponding to instructions from different users are reflected in the target characteristic data R, the target characteristic data R can be updated to contents suitable for a large number of users. There are special advantages.

<Third Embodiment>
FIG. 9 is an explanatory diagram of the target characteristic data R in the third embodiment. In the first embodiment, a plurality of target characteristic data R corresponding to different music pieces are prepared. In the third embodiment, as illustrated in FIG. 9, a plurality of target characteristic data R representing different acoustic characteristics is stored in the storage device 144 for each music piece. That is, for a single piece of music, a plurality of target characteristic data R having different acoustic characteristics is prepared. For example, in addition to target characteristic data R representing standard acoustic characteristics, target characteristic data R representing individual acoustic characteristics such as acoustic characteristics suitable for narration of musical instruments and acoustic characteristics with an emphasis on rhythm are provided for each musical piece. Stored in the storage device 144.

  FIG. 10 is an explanatory diagram of the operation of the third embodiment. When the processing request specifying the target music is received from the terminal device 12 as in the first embodiment (S1), the control device 142 (communication control unit 42) of the mixing management device 14 determines the target music specified in the processing request. A plurality of target characteristic data R stored in the storage device 144 is notified to the terminal device 12 as selection candidates by the user (S11). As illustrated in FIG. 11, the control device 121 of the terminal device 12 causes the display device 124 to display a list 52 in which a plurality of target characteristic data R of the target music are arranged as selection candidates by the user (S12). The user can select desired target characteristic data R by appropriately operating the input device 125. When the selection of the target characteristic data R is accepted (S13), the control device 121 of the terminal device 12 notifies the mixing management apparatus 14 of the target characteristic data R selected by the user (S14).

  When the notification of the target characteristic data R selected by the user is received, the control device 142 of the mixing management device 14 generates the recording characteristic data Q by analyzing the music data M of the target music (S2), and a plurality of target music pieces. Among the target characteristic data R, the target characteristic data R notified from the terminal device 12 in step S14 is acquired from the storage device 144 (S3). The control device 142 (setting unit 36) sets the control parameter X according to the recording characteristic data Q of the target music and the target characteristic data R selected by the user of the terminal device 12 (S4). Subsequent operations are the same as those in the first and second embodiments.

  In the third embodiment, the same effect as in the first embodiment is realized. In the third embodiment, since a plurality of target characteristic data R prepared for each piece of music is selectively applied to the setting of the control parameter X, one type of target characteristic data R is fixed to the setting of the control parameter X. Therefore, it is possible to generate adjusted acoustic data DB having various acoustic characteristics as compared with the configuration to be applied to the system. In the third embodiment, in particular, the target characteristic data R selected by the user among the plurality of target characteristic data R is applied to the setting of the control parameter X, so that the adjustment sound of the acoustic characteristic that matches the user's intention and preference There is an advantage that data DB can be generated.

  In addition, it is also possible to employ | adopt the structure of 2nd Embodiment which updates the target characteristic data R according to the correction data Z to 3rd Embodiment. Specifically, the update unit 44 reflects the instruction for editing the target characteristic data R selected by the user from the list 52 among the plurality of target characteristic data R of the target music stored in the storage device 144. It is updated according to the corrected data Z.

<Fourth embodiment>
In each of the above-described embodiments, the acoustic processing system 100 including the terminal device 12 and the mixing management device 14 that communicate with each other via the communication network 16 is illustrated. The mixing management device 14 according to the fourth embodiment realizes the same function as the acoustic processing system 100 according to each embodiment described above by a single device.

  FIG. 12 is a block diagram of the mixing management device 14 in the fourth embodiment. As illustrated in FIG. 12, the mixing management device 14 of the fourth embodiment is similar to the terminal device 12 of each of the above-described embodiments, in that the control device 121, the storage device 122, the display device 124, the input device 125, and the sound emitting device. 126 and a computer system. For example, an information processing device such as a mobile phone, a smartphone, or a personal computer is used as the mixing management device 14.

  The storage device 122 stores a program executed by the control device 121 and stores music data M and target characteristic data R for each music. The control device 121 executes each program (first acquisition unit 32, second acquisition unit 34, setting unit 36, acoustic processing unit 22, update, etc.) exemplified in the above-described embodiment by executing a program stored in the storage device 122. Part 44). Specifically, the first acquisition unit 32 generates the recording characteristic data Q by analyzing the music data M of the target music stored in the storage device 122, and the second acquisition unit 34 sets the target characteristics of the target music. Data R is acquired from the storage device 122. The setting unit 36 generates a control parameter X from the recording characteristic data Q generated by the first acquisition unit 32 and the target characteristic data R acquired by the second acquisition unit 34. The sound processing unit 22 applies the control parameter X set by the setting unit 36 and mixes the N pieces of recorded data DA of the music data M of the target music to generate the adjusted sound data DB and generates the adjusted sound data DB from the sound emitting device 126. Let it play. The update unit 44 updates the target characteristic data R of the target music in the storage device 122 in accordance with an instruction (correction data Z) from the user who has received the reproduced sound of the adjusted sound data DB. The specific processing content of each element is as exemplified in the above-described embodiments.

  In the fourth embodiment, the same effect as in the first embodiment is realized. In addition, it is also possible to employ | adopt the structure of 3rd Embodiment which selectively utilizes the some target characteristic data R corresponding to an object music for the setting of the control parameter X to 4th Embodiment. Moreover, the structure (update part 44) which updates the target characteristic data R according to the correction data Z can be omitted from the fourth embodiment.

<Modification>
Each of the aforementioned embodiments can be variously modified. Specific modifications are exemplified below. Two or more aspects arbitrarily selected from the following examples can be appropriately combined.

(1) In each embodiment described above, the first acquisition unit 32 exemplifies a configuration in which the recording characteristic data Q is generated by analyzing the recording data DA of the music data M. It is also possible to store in advance in the storage device 144 (storage device 122 in the fourth embodiment). In the configuration in which the recording characteristic data Q is stored in the storage device 144, the first acquisition unit 32 functions as an element for reading the recording characteristic data Q of the target music piece from the storage device 144. As understood from the above description, the first acquisition unit 32 is comprehensively expressed as an element for acquiring the recording characteristic data Q representing the acoustic characteristics of the plurality of recording data DA, and the recording characteristics are analyzed by analyzing each recording data DA. It includes both an element that generates data Q (each of the above-described forms) and an element that reads recording characteristic data Q stored in advance in storage device 144.

  In each of the above-described embodiments, the second acquisition unit 34 has exemplified the configuration in which the target characteristic data R stored in the storage device 144 (the storage device 122 in the fourth embodiment) is read. Can also be stored in the storage device 144. In the configuration in which the target data is stored in the storage device 144, the second acquisition unit 34 functions as an element that generates the target characteristic data R by analyzing the target data of the target music. As understood from the above description, the second acquisition unit 34 is comprehensively expressed as an element that acquires target characteristic data R representing the target acoustic characteristic of the music, and is stored in advance in the storage device 144. It includes both elements for reading data R (each of the above-described forms) and elements for generating target characteristic data R by analyzing target data.

(2) In the first to third embodiments, the control parameter X and N pieces of recorded data DA are transmitted from the mixing management device 14 to the terminal device 12, and the acoustic processing unit 22 of the terminal device 12 has N pieces of sound processing units 22. Although the configuration for mixing the recorded data DA has been illustrated, the acoustic processing unit 22 can be installed in the mixing management device 14 as illustrated in FIG. The sound processing unit 22 in FIG. 13 generates the adjusted sound data DB by mixing the N pieces of recorded data DA of the target music by applying the control parameter X set by the setting unit 36. The communication control unit 42 transmits the adjusted acoustic data DB generated by the acoustic processing unit 22 from the communication device 146 to the terminal device 12 via the communication network 16. According to the above structure, there exists an advantage that it is not necessary to mount the acoustic process part 22 in each terminal device 12. FIG.

(3) In the second embodiment, the reproduction of the adjustment sound data DB and the transmission of the correction data Z are performed by the single terminal device 12, but the device for reproducing the adjustment sound data DB and the device for transmitting the correction data Z Can be configured separately. For example, the adjustment acoustic data DB is reproduced by an information processing apparatus such as a personal computer, and the correction data Z is generated and transmitted according to an instruction from the user, and is executed by a portable information processing apparatus such as a mobile phone or a smartphone. The structure to be made is suitable.

(4) In the second embodiment, a large number of correction data Z reflecting the intentions and preferences of various users is transmitted from each terminal device 12 to the mixing management device 14. In the above configuration, a plurality of target characteristic data R can be generated using a plurality of correction data Z acquired from each terminal device 12. For example, a plurality of correction data Z acquired from each terminal device 12 for one piece of music is classified (clustered) into a plurality of sets according to the tendency of the instruction content by the user, and each of the plurality of sets is initially ( By updating the standard target characteristic data R according to each correction data Z in the set, individual target characteristic data R is generated for each set (for each tendency of the correction data Z). For example, the update unit 44 generates the target characteristic data R1 by reflecting each correction data Z classified into the set G1 in the initial target characteristic data R, and initially sets each correction data Z classified into the set G2. By reflecting the target characteristic data R, target characteristic data R2 representing an acoustic characteristic different from the target characteristic data R1 is generated. The plurality of target characteristic data R generated for each music piece by the above procedure is selectively applied to the setting of the control parameter X in accordance with an instruction from the user, as in the third embodiment. According to the above configuration, there is an advantage that, for example, standard (average) target characteristic data R and individual target characteristic data R can be generated.

(5) The contents of the processing by the acoustic processing unit 22 are not limited to the examples in the above-described embodiments. For example, the acoustic processing unit 22 can generate adjusted acoustic data DB that approximates the acoustic characteristics of the target characteristic data R by adding a specific frequency component (for example, a harmonic component) to each recorded data DA. It is. Specifically, various sound effects such as distortion and exciter can be added to the recorded data DA.

DESCRIPTION OF SYMBOLS 100 ... Acoustic processing system, 12 ... Terminal device, 14 ... Mixing management device, 16 ... Communication network, 22 ... Acoustic processing part, 121, 142 ... Control device, 122, 144 ... Storage device, 123 146: Communication device 124 ... Display device 125 ... Input device 126 ... Sound emitting device 32 ... First acquisition unit 34 ... Second acquisition unit 36 ... Setting unit 42 ... ... communication control unit, 44 ... update unit.

Claims (6)

A first acquisition unit for acquiring recording characteristic data representing the acoustic characteristics of a plurality of recorded data representing the sounds of different performance parts of the music;
A second acquisition unit that acquires target characteristic data representing a target acoustic characteristic of the music;
Control parameters applied to the mixing are set to the recording characteristic data and the target so that the acoustic characteristic after the execution of the mixing for the plurality of recording data approximates the acoustic characteristic represented by the target characteristic data. A mixing management device comprising: a setting unit configured to set according to the characteristic data. The mixing management device according to claim 1, further comprising: a communication control unit that transmits the control parameter set by the setting unit and the plurality of recorded data to a terminal device via a communication network. The second acquisition unit acquires target characteristic data stored in a storage device,
The update part which updates the target characteristic data of the said memory | storage device according to the instruction | indication from the listener of the sound which mixed the some recorded data using the control parameter which the said setting part acquired. Item 2. The mixing management device according to item 2. An instruction receiving unit that acquires a plurality of correction data according to instructions from different listeners from a plurality of terminal devices used by each listener via a communication network,
The mixing management device according to claim 3, wherein the update unit updates the target characteristic data in accordance with a plurality of correction data acquired by the instruction receiving unit. The mixing management apparatus according to any one of claims 1 to 4, wherein the second acquisition unit selects any one of a plurality of target characteristic data representing different acoustic characteristics for a common music piece. The acoustic characteristics represented by each of the recording characteristic data and the target characteristic data include at least one of an average volume, a temporal change in volume, a sound image position, a frequency characteristic, and a reverberation characteristic in each of a plurality of performance parts of the music. The mixing management device according to claim 1.

Images