WO2004109910A1

WO2004109910A1 - Kansei mastering device

Info

Publication number: WO2004109910A1
Application number: PCT/JP2003/007270
Authority: WO
Inventors: Miwa Fukino
Original assignee: Matsushita Electric Industrial Co. Ltd.
Priority date: 2003-06-09
Filing date: 2003-06-09
Publication date: 2004-12-16
Also published as: AU2003242060A1

Abstract

Manufacturing of a DVD-Audio requires more time than manufacturing of a CD because the technique is more complicated and the work amount is increased. Moreover, a new authoring technique and engineer are required which are not required for manufacturing of the CD. Accordingly, communication between a mastering engineer and an authoring engineer is broken and the DVD-Audio cannot be handled as one commodity. The problem is how to manufacture the DVD-Audio effectively. In order to solve this problem, the sense and technique of the mastering engineer are separated from each other and the automatic sound quality adjustment technique is introduced. Mastering, authoring, and emulation are made into a unitary body so that a technique for manufacturing by one engineer is developed.

Description

Description Kansei mastering device Technical field

The present invention relates to a mastering and authoring device for music with video. Background art

Music media has shifted from records to CDs, and sound quality has been improved with the development of digital technology. The conventional mainstream CD production process is mainly divided into front-end and back-end processes. In the pre-process, recording processing of individual music and mixing processing of the recorded music are mainly performed. On the other hand, in the post-process, the music processed in the pre-process is mastered. This mastering process is generally performed based on the taste (sense) and technology of the mastering engineer. In other words, the mastering process performed by a conventional mastering engineer listens to a song and adjusts it to the tone (instrument composition, melody, harmony, tempo, etc.) and sound image. The idea was to come up with the best sound quality with each engineer's sense, and to use the equalizer and compressor more than once to create the sound while listening to the sound. In other words, the mastering engineer's sense and operation skills were all united.

(Patent Document 1)

JP-A-9-1 5 1 2 3 9

(Patent Document 2)

JP 8-2 9 8 4 1 8

(Patent Document 3) Unexamined Japanese Patent Publication No. 6-34440

However, with the progress of digital technology in recent years, the demands for further improvement in sound quality and integration with video have increased. Therefore, media such as DVD—Audio are being developed. D VD—Audio is a high bit (number of encoded bits: 16 bits, 20 bits, 24 bits) 'High sampling (available sampling frequency: 4 4. lk H z, 88.2 kHz, 176.4 kHz, 48 kHz, 96 kHz, 192 kHz), multi-channel (5.1 ch.), It is a standard for high-definition audio that features additional functions (still images, menus, movies, etc.). It is a medium that combines excellent sound quality and multi-audio as the next-generation audio, and is expected to become more and more popular in the future.

The production process of DVD-Audio, like the production process of CDs, is mainly divided into front-end and back-end processes. In the pre-process, recording processing of individual music and mixing processing of the recorded music are mainly performed. On the other hand, in the post-process, it is general that the music processed in the pre-process is subjected to a mastering process, and is further subjected to an authoring process and an emulation process. DVD—The post-production process of Audio, which is not included in the post-production process of CD, adds an authoring process and an emulation process. For this reason, mastering engineer and authoring engineer are required in the post-process. DVD—Audio's mastering engineer performs the same process as a CD mastering engineer. However, DVD—Audio takes more time to process than CDs because of the complexity of the technology and the amount of work required. New authoring techniques and engineers that were not in the CD production process As a result, the communication between mastering and authoring engineers is disrupted, making them unmanageable as a single product.

The question is how to make more efficient DVD—Audio production.

In the present invention, in order to solve such a problem, the preference (sense) of the master ringer and the technology are separated, and an automatic sound quality adjustment technology is introduced. Then, mastering, authoring, and emulation are integrated to develop technology that can be created by only one engineer.

A first invention is a kansei mastering device for mastering music using kansei words, comprising: a music input section for inputting music; and a music input section for inputting music to the music input section. A genre parameter calculation unit that calculates a genre parameter associated with a kansei word, which is a parameter indicating the music genre of the music; and a genre parameter calculated by the genre parameter calculation unit. A sound quality parameter calculation unit that calculates a sound quality parameter associated with a kansei word, which is a parameter indicating the sound quality of music; a genre parameter calculation unit; and a sound quality parameter calculated by the sound quality parameter calculation unit. A parameter adjusting unit for adjusting a genre parameter or / and a sound quality parameter; An adjusted music generating section for equalizing or compressing the music in accordance with the parameters adjusted by the adjusting section to generate an adjusted music that is an adjusted music. Related to equipment.

The second invention relates to the kansei mastering device according to the first invention, further comprising a reproducing unit for reproducing the adjusted music generated by the adjusted music generating unit. A third invention relates to the kansei mastering device according to the first invention or the second invention, wherein the genre parameter is a parameter associated with at least one of a tune and a sound image, which are kansei words.

According to a fourth aspect, the sound quality parameter is any one of the first invention to the third invention, which is a parameter associated with any one or more of the sensibility words, center of gravity, clearness, and warmth. It relates to the described emotion mastering device. A fifth aspect of the present invention is any of the first to fourth aspects, wherein the music input unit has an adjusted music input unit for inputting the adjusted music generated by the adjusted music generation unit. The present invention relates to the kansei mastering device described in (1). A sixth invention is a kansei mastering authoring device for mastering and authoring music with video using kansei words, and a music input unit for inputting music, A genre parameter calculation unit that calculates, from the music input to the music input unit, a genre parameter that is a parameter indicating a music genre of the music and is associated with a kansei word; A sound quality parameter calculation unit that calculates a sound quality parameter associated with a kansei word, which is a parameter indicating the sound quality of the music, using the genre parameter, the genre parameter calculation unit, and the sound quality parameter calculation unit. Use the calculated genre parameters and / or sound quality parameters to cut off the video to be displayed along with the music. A switching timing information generating unit that generates switching timing information that is information indicating timing, music input to the music input unit, and switching generated by the switching timing information generating unit. A music-with-image generation unit that generates music with video using timing information; a genre parameter calculation unit; and a genre parameter or a genre associated with the kansei word calculated by the sound quality parameter calculation unit. A parameter adjustment unit for adjusting a sound quality parameter; and a parameter adjusted by the parameter adjustment unit. An adjusted music generator for generating adjusted music that is adjusted music by equalizing or compressing the music according to the parameters; and an adjusted music generated by the adjusted music generator. And a readjustment input unit capable of inputting to the music input unit.

The seventh invention relates to the kansei mastering authoring apparatus according to the sixth invention, further comprising a playback unit for playing back the music with video generated by the music with video generation unit. BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a conceptual diagram of the first embodiment.

FIG. 2 is a functional block diagram of the first embodiment.

FIG. 3 is an explanatory diagram of the musical feature amount according to the first embodiment.

FIG. 4 shows genre parameters 1 of the first embodiment.

FIG. 5 shows a genre parameter 2 of the first embodiment.

FIG. 6 is an explanatory diagram of the physical feature amounts according to the first embodiment.

FIG. 7 shows the first sound quality parameter of the first embodiment.

FIG. 8 shows the sound quality parameter 2 of the first embodiment.

Figure 9 is a conceptual diagram of equalizing and compressing.

FIG. 10 shows the flow of processing in the first embodiment.

FIG. 11 shows the flow of the processing of the first embodiment (continued).

Figure 12 outlines the tune and sound image.

FIG. 13 shows a genre parameter 1 of the second embodiment.

FIG. 14 shows a genre parameter 2 of the second embodiment.

FIG. 15 is an explanatory diagram of the musical feature amount of the second embodiment.

FIG. 16 shows a genre parameter 3 of the second embodiment. FIG. 17 shows a genre parameter 4 of the second embodiment.

FIG. 18 is an explanatory diagram of the physical feature amounts of the third embodiment.

FIG. 19 shows the sound quality parameters of the third embodiment.

FIG. 20 is a functional block diagram of the fourth embodiment.

FIG. 21 shows the flow of processing in the fourth embodiment.

FIG. 22 is a flowchart (continued) of the processing of the fourth embodiment.

FIG. 23 is a functional block diagram of the fifth embodiment.

FIG. 24 is an explanatory diagram of the video switching timing of the fifth embodiment.

FIG. 25 shows a processing flow of the fifth embodiment.

FIG. 26 shows the flow of the process of the fifth embodiment (continuation 1).

FIG. 27 is a flowchart (continuation part 2) of the processing of the fifth embodiment.

FIG. 28 is an explanatory diagram of the “knob” of the parameter adjustment unit according to the first embodiment. FIG. 29 is a conceptual diagram of the effect of the fifth embodiment. BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described. The relationship between the embodiment and the claims is roughly as follows. '

The first embodiment mainly describes claims 1, 2, and 8. The second embodiment mainly describes claim 3.

Embodiment 3 mainly describes claim 4.

Embodiment 4 mainly describes claim 5.

The fifth embodiment mainly describes claims 6, 7, 9 and the like.

<<Embodiment 1>>

Embodiment 1 is a kansei mastering device for mastering music using kansei words, and is one of the most basic embodiments of the present invention. It is.

FIG. 1 is a diagram for explaining the concept of the present invention. For example, suppose that music is input to the emotion mastering device of the present invention. The music is analyzed, and musical and physical features are extracted. The extracted musical features are collated with the genre parameter database, and the corresponding genre parameters are calculated. Next, the physical feature parameters and the genre parameters are collated with the sound quality parameter database, and the corresponding sound quality parameters are calculated. Next, when the mastering engineer adjusts the calculated genre parameters and sound quality parameters, the music is automatically equalized and compressed, and the desired music is generated.

FIG. 2 shows the emotion mastering device 200 of the first embodiment. The emotion mastering device according to the first embodiment includes a music input unit 0201, a genre parameter calculation unit 0202, a sound quality parameter calculation unit 0203, and a parameter adjustment unit 0204. , An adjusted music generating unit 0205 and a reproducing unit 0206.

Description of configuration>

(Music input section)

Hereinafter, the music input unit will be described.

The music input unit inputs music. The input music is output to the genre parameter calculation unit. Here, “music” is generally analog or digital music data that has been recorded and mixed. However, the “music” of the first embodiment is not limited thereto, and may be a sound input from a microphone or the like. Music to the music input section is recorded, audio tape, LD (Laser Disk), CD (Compact Disk) media, MD (Mini Disc), DV Input from recording media such as D (Digital Versatile Disk) media. However, the present invention is not limited to the above case, and the music may be input to the music input unit directly from a microphone or from a communication means such as the Internet.

(Genre parameter calculator)

Hereinafter, the genre parameter calculation unit will be described.

The genre parameter calculation unit calculates a genre parameter associated with a kansei word, which is a parameter indicating a music genre of the music, from the music input to the music input unit.

Here, "music genre" includes pop, rock, dance, nonk, techno, house, R & B, soul, hip hop, funk, reggae, trance, jazz, blues, classic, world, Lapp, Drum & Bass, Goth Penole, Folk, Inst, Heavy Metal Tanole, Musical, Chorus, Traditional Music, Fairy Tale, Prog, Black, Club, Fusion, Jujutsu, Enka, Sanka This includes tigers, commercial songs, games, countries, new age, oldies, a cappella, mixia, and pop songs.

“Parameter” is a numerical value.

In addition, “kansei words” are words that express natural desires based on human physical sensations. The sentiment words used in the first embodiment include fun, energetic, children's, adults', summer festival-style, movie-style, and images that express an image of the music genre that humans feel when listening to music. Such styles include sco-style, power laoke style, party style, formal style, tune style, and sound image.

First, the genre parameter calculation unit selects a kansei word in advance before calculating the genre parameter. Here, as an example, the sensibility word “fun” is selected. Next, the genre parameter calculation unit extracts a musical feature amount from the music input to the music input unit.

Figure 3 shows an example of attributes of musical features, such as tempo, beat whiteness, basic beat, beat intensity 1, beat intensity 2, beat intensity ratio, average number of notes, and spec. This corresponds to the degree of change in torque. Here, as an example, a set of musical features (tempo, beat whiteness, basic beat, beat intensity 1, beat intensity 2, beat intensity ratio, average number of notes, spectrum) Change) is used to calculate genre parameters. The set of extracted musical features is (tempo, beat whiteness, basic beat, beat intensity 1, beat intensity 2, beat intensity ratio, average number of notes, spectrum change) = (60, 20, 30, 55, 43, 29, 80, 73). The extracted set of musical features is collated with the genre parameter database. As a result of the matching, a genre parameter corresponding to the set of extracted musical features is calculated. The genre parameter database is a database based on empirical rules or a calculation formula based on empirical rules. However, the calculation formula may be based on pure theory that is not based on empirical rules. The calculated genre parameters are used in the sound quality parameter section and the parameter adjustment section.

Figure 4 shows a set of extracted musical features (tempo, beat whiteness, basic beat, beat intensity 1, beat intensity 2, beat intensity ratio, average number of notes, and the number of musical notes). Torr change)-This is a genre parameter corresponding to (60, 20, 30, 55, 43, 29, 80, 73). In this case, the genre parameter was calculated as “75” for the emotional word “fun”. The musical feature quantity and the genre parameter are, for example, normalized so as to take any one of integer values between 1 and 100, respectively. In the above description, only one kansei word is selected in advance, but it is also possible to select a kansei word in a set. That is, as an example, a set of sensibility words (fun, energetic, for children, for adults, summer festival style, disco style) can be selected.

Figure 5 shows the set of extracted musical features (tempo, beat whiteness, basic beat, beat intensity 1, beat intensity) calculated as a result of matching the genre parameter with the database. 2. Beat intensity ratio, average number of notes, spectral change) = genre parameter corresponding to (60, 20, 30, 55, 43, 29, 80, 73). The sentiment words “fun” are “75”, “energetic” is “90”, “kids” is “13”, “adults” is “30”, and “summer festival style” is “8”. 7 ”and“ disco style ”are“ 5 5 ”. In this case, the genre parameter may be independently calculated. Further, in the above description, the genre parameters are calculated after selecting the kansei words in advance, but the kansei words can be associated with the genre parameters after calculating the genre parameters. In this case, the genre parameters corresponding to the set of extracted musical features are calculated from the database. Kansei words that match the calculated genre parameters are selected from the database and associated with the genre parameters.

(Sound quality parameter calculator)

Hereinafter, the sound quality parameter calculation unit will be described.

The sound quality parameter calculation unit uses the genre parameters calculated by the genre parameter calculation unit to calculate a sound quality parameter associated with the kansei word, which is a parameter indicating the sound quality of the music.

The kansei words used in the first embodiment include an image relating to sound quality that a human perceives when listening to music, such as clarity, a feeling of air, no, ° ヮ, center of gravity, and clearness. , Warmth and so on. First, the sound quality parameter calculation unit selects a kansei word in advance before calculating the sound quality parameter. Here, as an example, the sensitivity word “power” is selected.

Next, the sound quality parameter calculation unit extracts physical features from the music input to the music input unit.

FIG. 6 shows an example of the attribute of the physical feature quantity, which corresponds to the fundamental frequency, the level, the configuration of the harmonic, and the like. Here, as an example, let us consider the case of using a set of physical features (basic frequency, level, and harmonic configuration). Assume that the set of extracted physical features is (fundamental frequency, level, harmonic composition) = (60, 40, 25). The set of extracted physical features and the combination of genre parameters calculated by the genre parameter calculator (hereinafter referred to as the set of physical features and the set of genre parameters) are as follows: Compared with the sound quality parameter database. As a result of the matching, a sound quality parameter corresponding to the set of physical features and a set of genre parameters is calculated. The sound quality parameter database is a database based on empirical rules or a formula based on empirical rules. However, the calculation formula may be based on pure theory that is not based on empirical rules. The calculated sound quality parameters are used in the parameter adjustment unit.

Figure 7 shows the sound quality corresponding to a set of physical features and a set of genre parameters (fundamental frequency, level, harmonic composition, fun) (60, 40, 25, 75). Parameter. In this case, the sound quality parameter was calculated to be “85” for the sensibility word “Pa ヮ i”. In addition, as an example, the physical feature and the sound quality parameter are normalized so as to take any one of integer values from 1 to 100, respectively. In the above explanation, only one kansei word was selected beforehand. It can also be selected as a set. That is, as an example, a set of sensitivity words (transparency, air feeling, warmth, power) can be selected. Figure 8 shows a set of physical features and a set of genre parameters (basic frequency, level, harmonic composition, fun) calculated as a result of collating the sound quality parameter with the database. , 40, 25, 75). In other words, the sentiment words “transparency” were “10”, “air” was “10”, “warmth” was “15”, and “power” was “85”. In this case, each sound quality parameter may be calculated independently.

Further, in the above description, the sound quality parameter is calculated after selecting the kansei word in advance, but it is also possible to calculate the sound quality parameter and then associate the kansei word with the sound quality parameter. In this case, a set of physical features and a set of genre parameters are calculated from a database. Kansei words that match the calculated sound quality parameters are selected from the database and associated with the sound quality parameters.

For the extraction of the physical feature pattern, a wavelet transform, an OCT (discrete cosine transform), or a combination of both can be used.

(Parameter adjustment section)

Hereinafter, the parameter adjustment unit will be described.

The parameter adjustment unit has a function of adjusting the genre parameter calculated by the genre parameter calculation unit and the genre parameter or the sound quality parameter associated with the kansei word calculated by the sound quality parameter calculation unit.

Adjusted music can be generated by adjusting the genre parameter or the sound quality parameter. For example, as an example, the genre parameter is set to “75” for the sensibility word “fun”. Also sound As an example, suppose that the quality parameter is “85” for the sensitivity word “power”. Here, it is assumed that the kanji word "fun" of the genre parameter and the kansei word "power" of the sound quality parameter are each a "knob" for adjustment.

As shown in Fig. 28, it is assumed that the user wants to increase the degree of "fun" a little more than the calculated parameters and to reduce the "power". Therefore, to increase the degree of “fun”, move the “knob” of “fun” to a value of “80”, and move the “knob” of “power” to decrease “power”. Suppose that the numerical value is set to “70”. Then, the genre parameter becomes “80” for the sensitivity word “fun”, and the sound quality parameter is adjusted to “60” for the sensitivity word “power”. When the genre parameters and the sound quality parameters are adjusted, the adjusted music generator automatically performs equalizing and compression in conjunction. By repeating the above operations, desired music can be generated.

(Adjusted music generator)

Hereinafter, the adjusted music generating unit will be described.

The adjusted music generating section generates adjusted music that is adjusted music by equalizing or compressing the music according to the parameters adjusted by the parameter adjusting section.

Here, "equalizing" refers to the operation of adjusting the frequency, band width, level, etc. of music, and is not limited to the audible range, but uses digital technology that extends beyond the audible range. It is also possible to process.

Fig. 9 (1) shows a conceptual diagram of equalizing.

Also, "compression" refers to the operation of adjusting the music threshold and the IN / OUT ratio, and is not limited to the audible range, but can be processed by digital technology using the audible range or higher. It is possible. Fig. 9 (2) shows a conceptual diagram of compression.

According to the genre parameters and sound quality parameters adjusted by the parameter adjustment unit, the music is automatically equalized and compressed, and adjusted music is generated. The equalizing and compression operations are performed in conjunction with the adjustment of genre parameters or sound quality parameters in the parameter adjustment unit.

By employing such a configuration, by using the kansei mastering device of the present invention, mastering can be easily performed without having to be proficient in the operation of the conventional mastering device. it can. In other words, according to the present invention, it has become possible to separate the mastering engineer's sense and operation technology from being completely integrated into the operation technology and sense independently. Furthermore, since the operation technique only increases or decreases the parameter associated with the kansei word, anyone can easily perform the operation. Therefore, according to the present invention, the mastering engineer can concentrate his or her attention on senses (preferences), and can expect to create music with better sense. Was.

(Playback part)

Hereinafter, the reproducing unit will be described.

The above description of the embodiment does not describe how the mastering engineer views the adjusted music and checks the adjustment result in the parameter adjustment unit of the mastering engineer. However, in general, a configuration having an additional reproduction unit will be employed. The reproduction unit reproduces the adjusted music generated by the adjusted music generation unit.

"Play" refers to actually playing sound from the speaker, but is not limited to the speaker, and may play sound from the headphone or play the sound to another audio device. May be output. The sound quality is The sound quality may be the same as the sound quality when input to the music input unit. The sound quality expected when actually recorded on a CD or DVD may be used.

Process flow>

Hereinafter, a processing flow of the first embodiment will be described.

FIGS. 10 and 11 show the processing flow of the first embodiment.

First, the music input unit inputs music (step S1001). Next, the genre parameter calculation unit selects a kansei word associated with the genre parameter (step S1002). Next, the genre parameter calculation unit calculates, from the music input to the music input unit, a genre parameter associated with the kansei word, which is a parameter indicating the music genre of the music (step S10). 0 3). Next, the genre parameter calculation unit determines whether there is another sensible word to be selected (step S1004). As a result of the judgment, if there is another sentiment word to be selected, the process returns to step S1002 and repeats the same processing. When there is no other sentiment word to be selected, the process proceeds to step S111. Next, the sound quality parameter calculation unit selects a sensibility word associated with the sound quality parameter (step S111). Next, the sound quality parameter calculation unit uses the genre parameter calculated by the genre parameter calculation unit to convert a sound quality parameter associated with the selected kansei word, which is a parameter indicating the sound quality of the music. It is calculated (step S111). Next, the sound quality parameter calculating unit determines whether there is another sensible word to be selected (step S111). If the result of determination is that there is another sentiment word to be selected, return to step S111 and repeat the same processing. If there is no other sentiment word to be selected, the process proceeds to step S111. Next, the parameter adjustment unit adjusts the genre parameter calculation unit, the genre parameter or no associated with the kansei word calculated by the sound quality parameter calculation unit, and the sound quality parameter (step S111). Next, the adjusted music generation unit According to the parameters adjusted by the parameter adjustment unit, the music is equalized or compressed to generate adjusted music that is adjusted music (step S111). The playback unit plays the adjusted music (step S111).

The kansei mastering device according to the first embodiment automatically calculates a genre parameter and a tone quality parameter from input music, and adjusts parameters associated with kansei words, thereby obtaining a musical impression. Equalization and compression can be adjusted automatically.

As a result, even those who have had a great sense and sensitivity in the past, but could not get an excellent reputation as a mastering engineer because of insufficient operating technology of the mastering device, willingly think. It is now possible to demonstrate its sense and sensitivity. In other words, it was possible to eliminate the operation technology that was considered essential in the conventional mastering process. Therefore, it opened the door to the master profession of profession, with many wonderful senses, sensibilities and tastes.

Concept of Embodiment 2>

The second embodiment relates to the kansei mastering device according to the first embodiment, in which the genre parameter is a parameter associated with any one or more of a tune and a sound image, which are kansei words. The whole is basically the same as the first embodiment except that it can be processed in association with at least one of a tune and a sound image as a genre parameter. That is, also in the present embodiment, the sensitivity mastering device includes a music input unit, a genre parameter calculation unit, a sound quality parameter calculation unit, a parameter adjustment unit, an adjusted music generation unit, and a playback unit. In the following description, the differences will be described. (Genre parameter calculator)

Hereinafter, the genre parameter calculation unit will be described.

The genre parameter calculation unit calculates, from the music input to the music input unit, a genre parameter which is a parameter indicating a music genre of the music associated with at least one of a tune and a sound image which are sensitivity words.

FIG. 12 is a diagram for explaining the melody and the sound image, which are emotional words. Here, “tune” refers to melody, rhythm pattern, harmony, etc., rock, pop, classic, ballad, folk music, jazz, fusion, R & D. B-tone, hip-hop tone, punk tone, rap tone, etc. are applicable. The “sound image” refers to how the image is blurred (blurred), the sense of distance (near or far), the sense of left and right, and the sense of up and down.

(When the sensitivity word is tune)

Hereinafter, the case where the sensitivity word “jazz style” is selected will be described.

Figure 13 shows a set of extracted musical features (tempo, beat whiteness, basic beats, beat intensity 1, beat intensity 2, beat intensity ratio, average number of notes, spec. Torr change) = (50, 35, 45, 65, 47, 55, 20, 52) is a genre parameter. In this case, the genre parameter “77” was calculated for the sensitivity word “jazz”. In addition, as an example, the musical feature amount and the genre parameter are assumed to be normalized so as to take any one of integer values from 1 to 100, respectively. .

In the above description, only one kansei word is selected in advance, but it is also possible to select a kansei word using a set of kansei words. That is, as an example, a set of sensibility words (paradise, rock, classic, jazz, fusion, hip hop) can be selected.

Figure 14 shows the results of the genre parameter comparison with the database. Set of extracted musical features calculated as a result (tempo, beat whiteness, basic beat, beat intensity 1, beat intensity 2, beat intensity ratio, average number of sounds, spectrum change) = (50, 35, 45, 65, 47, 55, 20,

5 This is a genre parameter corresponding to 2). In other words, the sensitivity words "ballad" are "5", "lock" j is "70", "classic" is 10, "jazz" is 77, "fusion" Is “10”, “Hip-hop” is “1”

5 ”. In this case, the genre parameters may be calculated independently.

Further, in the above description, the genre parameters are calculated after selecting the kansei words in advance, but the kansei words can be associated with the genre parameters after calculating the genre parameters. In this case, the genre parameters corresponding to the set of extracted musical features are calculated from the database. Kansei words that match the calculated genre parameters are selected from the database and associated with the genre parameters.

(When the sensitivity word is a sound image)

Next, a case in which the sensibility word “right and left feeling j” is selected will be described.

FIG. 15 shows an example of an attribute of a musical feature amount, such as a phase difference between left and right channel signals and a volume difference. Here, as an example, consider the case of using a set of musical features (phase difference and volume difference of left channel signal). Assume that the set of extracted musical features is (phase difference between left and right channel signals, volume difference) = (63, 55). This set of extracted musical features is collated with the genre parameter database. As a result of the matching, genre parameters corresponding to the set of extracted musical features are calculated. The genre parameter database is a database based on empirical rules or a calculation formula based on empirical rules. However, the calculation formula may be based on a pure theory that is not based on empirical rules. The calculated genre parameters are used in the sound quality parameter section and the parameter adjustment section.

Figure 16 shows the genre parameters corresponding to the set of extracted musical features (phase difference and volume difference between left and right channel signals) = (63, 55). In this case, the genre parameter “70” was calculated for the sensitivity word “left and right feeling”. In addition, the musical feature quantity and the genre parameter are assumed to be normalized so as to take any one integer value between 1 and 100, for example.

In the above description, only one kansei word is selected in advance, but it is also possible to select a kansei word in a set. That is, as an example, it is possible to select a set of sensibility words such as (blur, sense of distance, sense of left / right, sense of up / down). Figure 17 shows the set of extracted musical features calculated as a result of collation with the genre parameter database (phase difference between left and right channel signals, volume difference) = (63, 55) ) Is a genre parameter corresponding to). That is, the sentiment words “blurring” were “13”, “feeling of distance” was “40”, “feeling right and left” was “70”, and “feeling up and down” was “34”. In this case, the genre parameters may be independently calculated.

In the above description, the genre parameters are calculated after selecting the kansei words in advance, but the kansei words can be associated with the genre parameters after calculating the genre parameters. In this case, the genre parameters corresponding to the set of extracted musical features are calculated from the database. Kansei words that match the calculated genre parameters are selected from the database and associated with the genre parameters.

The kansei mastering device according to the second embodiment automatically calculates genre parameters and sound quality parameters from input music and associates them with kansei words. By adjusting these parameters, music equalization and compression can be automatically adjusted, greatly saving the time required for mastering work. .

In addition, since the work of adjusting the tune and sound image is considered to be relatively large, it is possible to reduce the work time by adjusting the genre parameters associated with the kansei words to the tune and sound image or a combination thereof. It is possible.

Concept of Embodiment 3>

The third embodiment relates to the kansei mastering device according to the first or second embodiment, wherein the sound quality parameter is a parameter associated with any one or more of the center of gravity, clearness, and warmth. The whole is basically the same as Embodiment 1 or 2 except that it can be processed in association with at least one of the center of gravity, clearness, and warmth as a sound quality parameter. is there. That is, also in the present embodiment, the kansei mastering device includes a music input unit, a genre parameter calculation unit, a sound quality parameter calculation unit, a parameter adjustment unit, an adjusted music generation unit, and a playback unit. In the following description, the differences will be described. .

(Sound quality parameter calculator)

Hereinafter, the sound quality parameter calculation unit will be described.

The sound quality parameter calculation unit uses the genre parameters calculated by the genre parameter calculation unit to calculate a sound quality parameter associated with the kansei word, which is a parameter indicating the sound quality of music.

Here, the kansei word in the third embodiment refers to any one or more of “center of gravity”, “clearness”, and “warmth”.

FIG. 18 shows an example of the attribute of the physical feature, and the fundamental frequency, Level, harmonic composition, sound pressure distribution, etc. correspond. Here, as an example, consider the case of using a set of physical features (fundamental frequency, level, harmonic composition, sound pressure. Distribution). Assume that the set of extracted physical features is (basic frequency, level, harmonic composition, sound pressure distribution) = (60, 25, 30, 70). The combination of the extracted set of physical features and the genre parameter calculated by the genre parameter calculation unit (hereinafter referred to as a set of the physical feature and the genre parameter) is defined as Checked against the database. Here, “75” for the calculated sensibility word “karaoke style” is used as the genre parameter. As a result of the matching, a sound quality parameter corresponding to the set of physical feature amounts and the set of genre parameters is calculated. The database of sound quality parameters is a database based on empirical rules or a calculation formula based on empirical rules. However, the formula may be based on pure theory that is not based on empirical rules. The calculated sound quality parameters are used in the parameter adjustment unit.

Figure 19 shows a set of physical features and a set of genre parameters (fundamental frequency, level, harmonic composition, sound pressure distribution, karaoke style) = (60, 25, 30, 7) These are sound quality parameters corresponding to 0, 75). In this case, the sound quality parameters are calculated as “80” for the sensitivity word “center of gravity”, “10” for the sensitivity word “clearness”, and “5 5” for the sensitivity word “warmth”. Was issued.

The kansei mastering device according to the third embodiment automatically calculates genre parameters and sound quality parameters from input music, and refines parameters associated with kansei words to thereby improve the music. Equalization and compression can be automatically adjusted for mastering work. The time required can be greatly reduced.

Also, by using the kansei word as the center of gravity, clarity, warmth, or a combination thereof, music with higher sound quality can be obtained.

<<Embodiment 4>>

The music input unit according to any one of the first to third embodiments further includes an adjusted music input unit for inputting the adjusted music generated by the adjusted music generation unit. Related to an operating device.

FIG. 20 shows the emotion mastering device 2000 of the fourth embodiment. The emotion mastering device of the fourth embodiment includes a music input unit 2001, a genre parameter calculation unit 2002, a sound quality parameter calculation unit 2003, and a parameter adjustment unit 2004. , An adjusted music generating unit 205 and a reproducing unit 206.

Further, the music input unit has adjusted music input means 2007.

(Music input section)

The music input unit has an adjusted music input unit for inputting the adjusted music generated by the adjusted music generation unit. By having the adjusted music input means, the adjusted music generated by the adjusted music generation unit can be automatically fed back to the music input unit, thereby improving work efficiency.

The other points are the same as those in any one of the first to third embodiments, and the description is omitted.

Process Flow>

Hereinafter, a processing flow of the fourth embodiment will be described.

FIGS. 21 and 22 show the processing flow of the fourth embodiment. Steps S2101 through S2206 are the same as steps S1001 through S1106, and a description thereof will be omitted.

The music input unit determines whether to input the adjusted music (step S2207). If the adjusted music is input, the process of step S2101 is executed. If it is difficult to input the adjusted music, the process ends.

The kansei mastering device according to the fourth embodiment automatically calculates genre parameters and sound quality parameters from input music, and adjusts parameters associated with kansei words to thereby improve the music. Since the equalizing and the compression can be adjusted automatically, the time required for the mastering operation can be greatly reduced.

Embodiment 5 >>

Embodiment 5 is a kansei mastering and authoring device for mastering and authoring music using kansei words, and is one of the basic embodiments of the present invention. is there.

FIG. 23 shows the kansei mastering-authoring device 230 of the fifth embodiment. The kansei mastering and authoring apparatus of the fifth embodiment includes a music input unit 2301, a genre parameter calculation unit 2302, a sound quality parameter calculation unit 2303, and switching timing information. Generation section 2304, music with video generation section 2305, parameter adjustment section 2306, adjusted music generation section 2307, and input section for readjustment 2308 And a playback unit 230.

Description of configuration>

That the entire system is configured so that Except for, the music input unit, the sound quality parameter calculation unit, the parameter adjustment unit, and the adjusted music generation unit are basically the same as any one of the first to fourth embodiments, and therefore, description thereof will be omitted.

(Switch timing information generator)

The switching timing information generator will be described below.

The switching timing information generation unit uses the genre parameter calculation unit and the genre parameter or the sound quality parameter calculated by the sound quality parameter calculation unit, and the switching timing of the video to be displayed along with the music using the sound quality parameter. The switching timing information, which is information indicating the timing, is generated. “Video” includes both still and moving images.

Fig. 24 shows the timing of switching the video to be displayed along with the music using the genre parameter or the sound quality parameter. In FIG. 24, switching timing 0, switching timing 1, switching timing 2, and switching timing 3 are generated as switching timing information. The first music that flows is the genre parameter power S “90” corresponding to the sensitivity word “summer festival style”. However, over time, music with a genre parameter of “85” corresponding to the sensibility word “classic” and a sound quality parameter of “45” corresponding to the sensibility word “clear feeling” flows. You. The transition of the music may be a regular one, or it may be a gradual fade-out or fade-in. Next, the genre parameter corresponding to the sensibility word “classic” is replaced by music with the sensation word “85” and the sound quality parameter corresponding to the sensibility word “clear feeling” is “80”. It is assumed that the genre parameter power “70” corresponding to “for infants” and the musical feature of the attribute “beat whiteness” are replaced with music of “55”. According to the present embodiment, when a series of music is played, switching timing information is automatically generated at the time when music is replaced. The switching timing information according to the present embodiment includes, in addition to simply generating a signal for switching a video at the timing, a genre parameter obtained from music, a sound quality parameter, and a physical A signal for selecting a video to be imported or a type of a video may be generated using the feature amount and the musical feature amount of music. This embodiment includes both of the above. In the former case, the engineer will select the video that matches the music, and manually insert the video in accordance with the switching timing signal. In the latter case, the sensitivity of this embodiment will be higher. Mastering The authoring device automatically performs the operations up to image input.

For example, in the latter case, at the start of the first music (switching timing 0), a Picture Ol representing "summer festival style 90" is inserted, and the next music or the music When the tone changes (switching timing 1), insert Picture 02 representing "Clear feeling 45" in "Classic tone 85", and then When the condition of the music or the song changes, (Picture 03) representing "Clear feeling 80" in "Classic style 85" is input at (Switching timing 2). When the tone of the last music or song changes (switching timing 3), a Picture 04 representing "beat whiteness 55" in "70 for infants" will be imported. To This can be achieved by including information identifying the video in the timing information. The information for identifying the video is information for identifying the video to be input at the switching timing. In addition to the information for uniquely identifying the video, an attribute indicating the type of the video is also included. The information may be identification information. The former is, for example, information indicating a specific “landscape picture”, and the latter is, for example, information for identifying a group of videos indicating “quiet scenery”. In order for the mastering and authoring device of the present embodiment to automatically import these images, it is naturally necessary that the images associated with the identification information be used. It is assumed that For example, there is a case where a video and information for identifying the video are stored so as to be usable in association with each other in the video storage unit.

It is needless to say that the switching timing information can be generated by using the musical feature amount and the physical feature amount in addition to the genre parameter and the sound quality parameter.

(Music generator with video)

The following describes the music-with-image generation unit.

The music-with-video generation unit generates music with video using the music input to the music input unit and the switching timing information generated by the switching timing information generation unit.

As shown in Fig. 24, the music generator with video inserts Picture 01 representing "summer festival style" into switching timing 0, generates DVD-Audio, and performs switching timing. 1 Insert Picture 0 2 representing “Classic” and “Clear” to generate a DVD—Audio, and switch to “Classic” and “Clear” DVD—Picture 03 representing “for infants” and “Beat whiteness” at switching timing 3 — Generate A udio.

(Input part for readjustment)

The readjustment input unit will be described below.

The readjustment input unit can input the adjusted music generated by the adjusted music generation unit to the music input unit.

(Playback part)

Hereinafter, the reproducing unit will be described.

In the above description of the embodiment, how the authoring engineer He did not mention whether he would watch music with video and check the adjustment result in his own parameter adjustment unit. However, in general, a configuration having an additional reproduction unit will be adopted. The reproduction unit reproduces the music with video generated by the music with video generation unit.

“Play” refers to actually outputting video from a speaker with a display and making a sound, but is not limited to speakers with a display, and outputs video from a headphone with a display and reproduces sound. The sound may be emitted, or a video may be output to another audio visual device, and a signal for sound may be output. The sound quality may be as high as the sound quality when input to the music input unit, or may be the sound quality expected when actually recording on CD or DVD.

Hereinafter, a processing flow of the fifth embodiment will be described.

FIGS. 25, 26 and 27 show the processing flow of the fifth embodiment. First, the music input unit inputs music (step S2501). Next, the genre parameter calculation unit selects a sensitivity word associated with the genre parameter (step S2502). Next, the genre parameter calculation unit calculates, from the music input to the music input unit, a genre parameter associated with the kansei word, which is a parameter indicating the music genre of the music (step S2503) ). Next, the genre parameter calculating unit determines whether there is another sensible word to be selected (step S2504). As a result of the judgment, if there is another sentiment word to be selected, the process returns to step S2502 and the same processing is repeated. If there is no other sentiment word to be selected, the process proceeds to step S2661. Next, the sound quality parameter calculation unit selects a kansei word to be associated with the sound quality parameter (step S2601). Next, the sound quality parameter calculation unit calculates the genre parameter calculated by the genre parameter calculation unit. Using the data, a sound quality parameter associated with the selected sensibility word, which is a parameter indicating the sound quality of the music, is calculated (step S2662). Next, the sound quality parameter calculation unit determines whether there is another sensible word to be selected (step S2663). As a result of the determination, if there is another sentiment word to be selected, the flow returns to step S2601 to repeat the same processing. If there is no other sensibility word to select, the process proceeds to step S2664. Next, the switching timing information generation unit uses the genre parameter calculation unit and the genre parameter or / and the sound quality parameter calculated by the sound quality parameter calculation unit to switch the video to be displayed in time with the music. The switching timing information, which is information indicating the timing, is generated (Step S2644). Next, the music-with-video generation unit generates music with video using the music input to the music input unit and the switching timing information generated by the switching timing information generation unit (step S265). Next, the parameter adjustment unit adjusts the genre parameter and / or sound quality parameter associated with the kansei word calculated by the genre parameter calculation unit and the sound quality parameter calculation unit (step S26) 0 6). Next, the adjusted music generating unit generates equalized music, which is adjusted music, by equalizing or compressing the music according to the parameters adjusted by the parameter adjusting unit (step S2701). ). Next, the music input unit determines whether to input the adjusted music (step S2702). When inputting the adjusted music, the process returns to step S2501. If the adjusted music is not to be input, go to step S2703. The playback unit plays the music with video (step S2703).

Brief description of effects of Embodiment 5>

The kansei master linguistic authoring apparatus according to the fifth embodiment automatically calculates genre parameters and sound quality parameters from input music, and adjusts parameters associated with kansei words to thereby improve the music. I Korai Zing and compression can be adjusted automatically. Furthermore, it is possible to automatically generate switching timing information for music with video using genre parameters, sound quality parameters, and the like.

FIG. 29 is a diagram conceptually showing the effect of the present embodiment. Conventionally, in the mastering process, technology and taste (sense) were inseparable. The authoring and emulation technologies were separate from the mastering technology. However, as shown in step 1 in the figure, in the mastering process, technology and taste (sense) were separated, and the technology part was replaced with automatic adjustment technology. However, as shown in step 2 in the figure, it has become possible to integrate mastering technology, authoring technology, and emulation technology. Furthermore, it has become easier to separate technology from taste (sense) and to pursue taste (sense) without difficult operations. Industrial applicability

The kansei mastering and listening device according to the present invention automatically calculates genre parameters and sound quality parameters from input music, and adjusts parameters associated with kansei words. It can automatically adjust music equalization and compression. Furthermore, switching timing information for music with video can be automatically generated using genre parameters, sound quality parameters, and the like.

As a result, despite having a great sense and sensibility in the past, it seems that the mastering authoring engineer did not get an excellent reputation as a mastering engineer or an authoring engineer due to insufficient operation technology of the mastering authoring device. It is now possible for even the most sophisticated people to fully demonstrate their senses and sensibilities. In other words, it is essential in the conventional mastering and authoring processes. This eliminates the need for the previously used operating techniques. Therefore, it opened the door to the profession of a mastering engineer and a soliciting engineer to many excellent senses, sensibilities and tastes. And because the work efficiency has improved, it has become possible for a single technician to perform mastering, authoring, and emulation.

Claims

The scope of the claims

1. An emotional mastering device for mastering music using emotional words,

A music input unit for inputting music,

A genre parameter calculation unit that calculates a genre parameter associated with a kansei word, which is a parameter indicating a music genre of the music, from the music input to the music input unit;

A sound quality parameter calculating unit that calculates a sound quality parameter associated with a kansei word, which is a parameter indicating the sound quality of the music, using the genre parameter calculated by the genre parameter calculating unit;

A genre parameter calculation unit; a parameter adjustment unit for adjusting a genre parameter or a sound parameter associated with the kansei word calculated by the sound quality parameter calculation unit; and a sound quality parameter.

An adjusted music generator for generating adjusted music that is adjusted music by equalizing or compressing the music according to the parameters adjusted by the parameter adjuster;

Kansei mastering device with

2. The sensibility mastering device according to claim 1, further comprising a reproduction unit for reproducing the adjusted music generated by the adjusted music generation unit.

3. The sensibility mastering device according to claim 1, wherein the genre parameter is a parameter associated with any one or more of tunes and sound images as sensibility words.

4. The feeling mastering device according to any one of claims 1 to 3, wherein the sound quality parameter is a parameter associated with any one or more of a feeling word, such as a center of gravity, clearness, and warmth. .

5. The sensibility mastering device according to any one of claims 1 to 4, wherein the music input unit has an adjusted music input unit for inputting the adjusted music generated by the adjusted music generation unit. .

6. A sensitivity masterling device for mastering and authoring music with video using sensitivity words,

A music input unit for inputting music,

A sound quality parameter calculation unit that calculates a sound quality parameter associated with a kansei word, which is a parameter indicating the sound quality of the music, using a genre parameter calculated by the genre parameter calculation unit;

The genre parameter calculating unit, and a switching tie that is information indicating a switching timing of a video to be displayed along with music using the genre parameter or / and the sound quality parameter calculated by the sound quality parameter calculating unit. A switching timing information generating unit for generating timing information, and a music input to the music input unit and the switching timing information generated by the switching timing information generating unit. A music-with-image generation unit that generates music with a video,

A genre parameter calculation unit, a genre parameter or / and a parameter adjustment unit for adjusting a sound quality parameter associated with the kansei word calculated by the sound quality parameter calculation unit,

An adjusted music generating unit for equalizing or compressing the music according to the parameters adjusted by the parameter adjusting unit to generate adjusted music that is adjusted music;

The adjusted music generated by the adjusted music generator is input to the music input unit. An input unit for readjustment that can be input,

Kansei mastering authoring device with

7. The kansei mastering authoring device according to claim 6, further comprising a reproduction unit for reproducing the music with video generated by the music with video generation unit.

8. An emotion mastering method for mastering music using emotion words,

Music input step for inputting music,

A genre parameter calculating step of calculating a genre parameter associated with a kansei word, which is a parameter indicating a music genre of the music, from the music input in the music input step;

A sound quality parameter calculating step of calculating a sound quality parameter associated with a kansei word, which is a parameter indicating the sound quality of the music, using the genre parameter calculated in the genre parameter calculation step. A genre parameter calculation step; a genre parameter and / or a sound quality parameter associated with the kansei word calculated in the sound quality parameter calculation step; An adjusted music generation step for generating adjusted music that is adjusted music by equalizing or compressing the music according to the parameters adjusted in the parameter adjustment step;

Kansei mastering method having a process consisting of:

9. An emotional mastering method for mastering and authoring music with video using emotional words,

A music input step for inputting music;

A genre parameter associated with a kansei word, which is a parameter indicating a music genre of the music from the music input in the music input step. A genre parameter calculation step of outputting

A sound quality parameter calculating step of calculating a sound quality parameter associated with a kansei word, which is a parameter indicating a sound quality of the music, using the genre parameter calculated in the genre parameter calculating step; A parameter calculation step, and a switching parameter which is information indicating switching timing of a video to be displayed along with music by using the genre parameter or parameter calculated in the sound quality parameter calculating step and the sound quality parameter. Using a switching timing information generating step of generating timing information, music input to the music input step, and switching timing information generated in the switching timing information generating step. Generating music with video for generating music with video;

The genre parameter calculating step, a genre parameter or Z associated with the kansei word calculated in the sound quality parameter calculating step, and a parameter adjusting step for adjusting a sound quality parameter; and the parameter adjusting step. An adjusted music generation step for equalizing or compressing the music according to the adjusted parameters to generate an adjusted music that is an adjusted music;

A readjustment input step capable of inputting the adjusted music generated in the adjusted music generation step to the music input step;

Kansei mastering and authoring method having a process consisting of: